| *** jamesmcarthur has quit IRC | 00:02 | |
| corvus | re-enqueue is done | 00:04 |
|---|---|---|
| corvus | it no longer appears that we are reconfiguring everytime someone does something to ansible :) | 00:10 |
| *** sshnaidm_ has joined #openstack-infra | 00:12 | |
| *** sshnaidm__ has quit IRC | 00:15 | |
| *** rascasoft has joined #openstack-infra | 00:18 | |
| clarkb | yay | 00:19 |
| *** rascasoft has quit IRC | 00:23 | |
| openstackgerrit | Merged openstack-infra/system-config master: Turn on the future parser for all mirrors https://review.openstack.org/615993 | 00:28 |
| openstackgerrit | Merged openstack-infra/system-config master: Turn on the future parser for files.openstack.org https://review.openstack.org/615994 | 00:28 |
| *** slaweq has joined #openstack-infra | 00:39 | |
| *** yamamoto has quit IRC | 00:42 | |
| *** slaweq has quit IRC | 00:43 | |
| *** gyee has quit IRC | 00:45 | |
| *** rascasoft has joined #openstack-infra | 00:52 | |
| *** markvoelker has quit IRC | 00:54 | |
| *** markvoelker has joined #openstack-infra | 00:54 | |
| *** rascasoft has quit IRC | 00:58 | |
| *** lbragstad has quit IRC | 00:59 | |
| *** markvoelker has quit IRC | 00:59 | |
| *** yamamoto has joined #openstack-infra | 01:01 | |
| openstackgerrit | Merged openstack-infra/system-config master: Turn on future parser for one zookeeper instance https://review.openstack.org/615995 | 01:04 |
| *** bobh_ has joined #openstack-infra | 01:05 | |
| *** rlandy|rover has quit IRC | 01:06 | |
| clarkb | for the prioritization setup that cinder et al are using couldn't we set a range of -1 to +1 then set noop function and copyminscore and copymaxscore | 01:08 |
| *** bobh has quit IRC | 01:08 | |
| clarkb | Then you end up with -1 "this shouldn't be reviewed", 0 "default priority", 1 a priority. Values copy as patchsets are pushed but don't affect your ability to merge or not | 01:09 |
| *** lbragstad has joined #openstack-infra | 01:09 | |
| clarkb | smcginnis: jungleboyj: fungi ^ | 01:09 |
| clarkb | it doesn't give you fine grained control over levels of priority but I think it gets everything else? | 01:09 |
| *** lbragstad has quit IRC | 01:09 | |
| *** bobh has joined #openstack-infra | 01:15 | |
| *** bobh_ has quit IRC | 01:16 | |
| *** tosky has quit IRC | 01:17 | |
| *** bobh has quit IRC | 01:20 | |
| *** AJaeger has quit IRC | 01:23 | |
| *** AJaeger has joined #openstack-infra | 01:29 | |
| *** jamesmcarthur has joined #openstack-infra | 01:32 | |
| fungi | that's along the lines of what i suggested in #swift a little while ago | 01:38 |
| clarkb | I responded ont he mailing list with that | 01:39 |
| clarkb | I think it gets 99% of the way there, you just don't get multiple levels of positive priority | 01:39 |
| clarkb | which if you have a real emergency of "please only review this one change" you can remove existing priority from changes to unprioritize them | 01:40 |
| *** bobh has joined #openstack-infra | 01:41 | |
| *** dave-mccowan has quit IRC | 01:41 | |
| clarkb | though maybe is:starred works well enough for that without changing labels | 01:42 |
| clarkb | -1 Workflow to deprioritize and apply star to prioritize | 01:43 |
| timburke | i wonder if there'd be a relatively easy way to search for "starred by someone who can merge code in this repo"... | 01:46 |
| timburke | short of a giant "(starredby:... OR starred by:... OR ...)" | 01:47 |
| *** yamamoto has quit IRC | 01:47 | |
| clarkb | timburke: I don't think gerrit exposes that aggregation in a simpler manner | 01:48 |
| clarkb | so maybe the label with +1 that can only be applied by $group does have an advantage | 01:48 |
| clarkb | it simplifies knowing what to look for | 01:48 |
| *** yamamoto has joined #openstack-infra | 01:48 | |
| *** dave-mccowan has joined #openstack-infra | 01:49 | |
| clarkb | (as I emntioned in the ml thread, this is potentially something we could chagne upstream then backport though) | 01:49 |
| clarkb | (we don't want to carry non upstreamable patches locally anymore though) | 01:49 |
| *** markmcd has quit IRC | 01:51 | |
| *** yamamoto has quit IRC | 01:53 | |
| *** markvoelker has joined #openstack-infra | 01:55 | |
| *** wolverineav has quit IRC | 01:58 | |
| *** wolverineav has joined #openstack-infra | 01:59 | |
| *** sshnaidm_ has quit IRC | 02:02 | |
| clarkb | cmurphy: ok I've just approved the last change before the nameservers in the stack. I'm off for the night (zk01 was fine so zk* should be too) and will look for nameserver updates in the morning andp ush them myself if you haven't been able to | 02:02 |
| *** wolverineav has quit IRC | 02:03 | |
| *** yamamoto has joined #openstack-infra | 02:10 | |
| *** harlowja has quit IRC | 02:12 | |
| *** hongbin has joined #openstack-infra | 02:15 | |
| *** sshnaidm_ has joined #openstack-infra | 02:19 | |
| openstackgerrit | wanghao proposed openstack-infra/project-config master: Add 'Review-Priority' for Zaqar repos https://review.openstack.org/628323 | 02:19 |
| openstackgerrit | Merged openstack-infra/system-config master: Turn on future parser for all zookeeper instances https://review.openstack.org/615996 | 02:22 |
| *** mandre has quit IRC | 02:24 | |
| *** mandre has joined #openstack-infra | 02:29 | |
| *** bobh_ has joined #openstack-infra | 02:32 | |
| *** bobh has quit IRC | 02:34 | |
| *** markvoelker has quit IRC | 02:46 | |
| *** yamamoto has quit IRC | 02:51 | |
| *** yamamoto has joined #openstack-infra | 02:52 | |
| *** anteaya has quit IRC | 03:03 | |
| *** psachin has joined #openstack-infra | 03:04 | |
| *** bobh has joined #openstack-infra | 03:05 | |
| *** psachin has quit IRC | 03:07 | |
| *** psachin has joined #openstack-infra | 03:08 | |
| *** bobh_ has quit IRC | 03:08 | |
| *** hwoarang has quit IRC | 03:09 | |
| *** lifeless has joined #openstack-infra | 03:10 | |
| *** hwoarang has joined #openstack-infra | 03:10 | |
| *** apetrich has quit IRC | 03:15 | |
| *** hwoarang has quit IRC | 03:18 | |
| *** hwoarang_ has joined #openstack-infra | 03:18 | |
| *** jamesmcarthur has quit IRC | 03:21 | |
| *** jamesmcarthur has joined #openstack-infra | 03:24 | |
| *** yamamoto has quit IRC | 03:24 | |
| *** hongbin has quit IRC | 03:26 | |
| *** bobh_ has joined #openstack-infra | 03:26 | |
| *** bhavikdbavishi has joined #openstack-infra | 03:29 | |
| *** bobh has quit IRC | 03:29 | |
| *** bhavikdbavishi1 has joined #openstack-infra | 03:29 | |
| *** jamesmcarthur has quit IRC | 03:31 | |
| *** bhavikdbavishi has quit IRC | 03:33 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 03:33 | |
| *** ykarel|away has joined #openstack-infra | 03:37 | |
| *** bobh_ has quit IRC | 03:50 | |
| *** jamesmcarthur has joined #openstack-infra | 04:00 | |
| *** hongbin has joined #openstack-infra | 04:01 | |
| *** ramishra has joined #openstack-infra | 04:18 | |
| *** dave-mccowan has quit IRC | 04:25 | |
| *** shardy has quit IRC | 04:33 | |
| *** shardy has joined #openstack-infra | 04:34 | |
| *** wolverineav has joined #openstack-infra | 04:36 | |
| *** jamesmcarthur has quit IRC | 04:47 | |
| *** jamesmcarthur has joined #openstack-infra | 04:47 | |
| *** udesale has joined #openstack-infra | 04:52 | |
| *** hongbin has quit IRC | 04:52 | |
| *** bobh has joined #openstack-infra | 04:55 | |
| *** diablo_rojo has quit IRC | 05:03 | |
| *** wolverineav has quit IRC | 05:10 | |
| *** wolverineav has joined #openstack-infra | 05:11 | |
| *** wolverineav has quit IRC | 05:15 | |
| *** bobh has quit IRC | 05:22 | |
| *** yamamoto has joined #openstack-infra | 05:22 | |
| *** whoami-rajat has joined #openstack-infra | 05:22 | |
| *** ykarel|away has quit IRC | 05:26 | |
| *** jamesmcarthur has quit IRC | 05:27 | |
| *** ykarel|away has joined #openstack-infra | 05:43 | |
| *** ykarel|away is now known as ykarel | 05:44 | |
| *** yamamoto has quit IRC | 06:04 | |
| *** bhavikdbavishi has quit IRC | 06:13 | |
| *** hwoarang_ has quit IRC | 06:25 | |
| *** armax has quit IRC | 06:26 | |
| *** hwoarang has joined #openstack-infra | 06:29 | |
| *** auristor has quit IRC | 06:32 | |
| *** bhavikdbavishi has joined #openstack-infra | 06:34 | |
| *** agopi has quit IRC | 06:34 | |
| *** wolverineav has joined #openstack-infra | 06:34 | |
| *** auristor has joined #openstack-infra | 06:34 | |
| *** bhavikdbavishi1 has joined #openstack-infra | 06:37 | |
| *** bhavikdbavishi has quit IRC | 06:38 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 06:38 | |
| *** yamamoto has joined #openstack-infra | 06:42 | |
| *** rcernin has quit IRC | 06:47 | |
| *** janki has joined #openstack-infra | 06:48 | |
| *** janki has quit IRC | 06:49 | |
| *** janki has joined #openstack-infra | 06:49 | |
| *** jamesmcarthur has joined #openstack-infra | 06:50 | |
| *** jamesmcarthur has quit IRC | 06:55 | |
| *** quiquell|off has quit IRC | 07:13 | |
| *** quiquell has joined #openstack-infra | 07:14 | |
| *** dpawlik has joined #openstack-infra | 07:24 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for one nameserver https://review.openstack.org/615998 | 07:28 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for all nameservers https://review.openstack.org/615999 | 07:29 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for master nameserver https://review.openstack.org/616000 | 07:29 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn on future parser for one nodepool launcher https://review.openstack.org/616288 | 07:29 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn on future parser for all nodepool launchers https://review.openstack.org/616289 | 07:29 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn on future parser for one nodepool builder https://review.openstack.org/616290 | 07:29 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn on future parser for all nodepool builders https://review.openstack.org/616291 | 07:29 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn on future parser for one zuul executor https://review.openstack.org/616292 | 07:29 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn on future parser for all zuul executors https://review.openstack.org/616293 | 07:29 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for one zuul merger https://review.openstack.org/616294 | 07:29 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for all zuul mergers https://review.openstack.org/616295 | 07:29 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for zuul.openstack.org https://review.openstack.org/616296 | 07:29 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Fix glob for lists.katacontainers.io https://review.openstack.org/628216 | 07:29 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Fix glob for lists.o.o https://review.openstack.org/628217 | 07:29 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for openstackid-dev https://review.openstack.org/616001 | 07:29 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for openstackid https://review.openstack.org/616002 | 07:29 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for refstack https://review.openstack.org/628153 | 07:29 |
| *** pgaxatte has joined #openstack-infra | 07:30 | |
| openstackgerrit | wanghao proposed openstack-infra/project-config master: Add 'Review-Priority' for Zaqar repos https://review.openstack.org/628323 | 07:31 |
| *** apetrich has joined #openstack-infra | 07:32 | |
| *** dpawlik has quit IRC | 07:34 | |
| *** dpawlik has joined #openstack-infra | 07:38 | |
| *** wolverineav has quit IRC | 07:40 | |
| *** wolverineav has joined #openstack-infra | 07:43 | |
| *** slaweq has joined #openstack-infra | 07:45 | |
| *** rpittau has joined #openstack-infra | 07:53 | |
| *** yamamoto has quit IRC | 07:58 | |
| *** ccamacho has joined #openstack-infra | 08:01 | |
| *** aojea has joined #openstack-infra | 08:01 | |
| *** ykarel is now known as ykarel|lunch | 08:02 | |
| *** shardy has quit IRC | 08:05 | |
| *** shardy has joined #openstack-infra | 08:05 | |
| *** rascasoft has joined #openstack-infra | 08:07 | |
| *** markvoelker has joined #openstack-infra | 08:08 | |
| *** markvoelker has quit IRC | 08:13 | |
| *** lpetrut has joined #openstack-infra | 08:15 | |
| *** armax has joined #openstack-infra | 08:27 | |
| *** armax has quit IRC | 08:32 | |
| *** wolverineav has quit IRC | 08:34 | |
| *** jaosorior has joined #openstack-infra | 08:39 | |
| *** jpich has joined #openstack-infra | 08:44 | |
| *** markmcd has joined #openstack-infra | 08:45 | |
| *** agopi has joined #openstack-infra | 08:47 | |
| *** tosky has joined #openstack-infra | 08:47 | |
| *** udesale has quit IRC | 08:52 | |
| *** bhavikdbavishi has quit IRC | 08:53 | |
| *** bhavikdbavishi1 has joined #openstack-infra | 08:53 | |
| *** udesale has joined #openstack-infra | 08:54 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 08:55 | |
| *** lewo has joined #openstack-infra | 09:09 | |
| *** xek_ has joined #openstack-infra | 09:10 | |
| *** ykarel|lunch is now known as ykarel | 09:12 | |
| *** gfidente has joined #openstack-infra | 09:13 | |
| *** zaneb has quit IRC | 09:17 | |
| *** agopi has quit IRC | 09:17 | |
| *** lpetrut has quit IRC | 09:18 | |
| *** agopi has joined #openstack-infra | 09:23 | |
| *** shardy has quit IRC | 09:27 | |
| *** shardy has joined #openstack-infra | 09:27 | |
| ssbarnea | i see lots of error that indicate a broken ruby bundler on build nodes: see http://logstash.openstack.org/#/dashboard/file/logstash.json?query=message:%5C%22bundled_gems%2Fbin%2Fbundle:%20No%20such%20file%20or%20directory%5C%22 | 09:30 |
| ykarel | mmm bundler 2.0.1 also released | 09:33 |
| ykarel | hmm released today | 09:33 |
| ykarel | we are pinning to 1.17.3 in https://review.openstack.org/#/c/628155/ | 09:34 |
| ykarel | ssbarnea, ^^ | 09:34 |
| ykarel | u can check if that's take care of ur issue | 09:34 |
| *** derekh has joined #openstack-infra | 09:35 | |
| ssbarnea | i am working on it... | 09:36 |
| ssbarnea | seems to be related to code in puppet-openstack-integration | 09:37 |
| ykarel | yes most of jobs are configured there only | 09:37 |
| ssbarnea | perfect, no need to fix it :D | 09:38 |
| ssbarnea | ykarel: i personally do not like the pinning approach, it should be smarter: install a version supported by current ruby | 09:39 |
| ssbarnea | but is clearly better than now | 09:39 |
| *** udesale has quit IRC | 09:39 | |
| ykarel | ssbarnea, so new ruby is required if we don't go with pinning | 09:39 |
| ykarel | there may be some constraints to bump ruby . /me not aware about that | 09:40 |
| ssbarnea | is the gem installer so stupid? pip at least will not install packages not supporting current interpreter. | 09:40 |
| *** udesale has joined #openstack-infra | 09:40 | |
| *** yamamoto has joined #openstack-infra | 09:40 | |
| ykarel | okk ruby coming from centos base and we don't controll that | 09:41 |
| ykarel | don't know about that gem installer, so can't say | 09:41 |
| ssbarnea | i am having a look now, better to know for the future | 09:42 |
| *** yamamoto has quit IRC | 09:43 | |
| ykarel | ack | 09:44 |
| *** markmcd has left #openstack-infra | 09:47 | |
| *** agopi has quit IRC | 09:47 | |
| *** jpich has quit IRC | 09:48 | |
| *** jpich has joined #openstack-infra | 09:48 | |
| ssbarnea | i was able to replicate the issue, clearly new bundler broke centos-7, but fedora-28 works. | 09:50 |
| *** agopi has joined #openstack-infra | 09:50 | |
| *** e0ne has joined #openstack-infra | 09:52 | |
| ssbarnea | ykarel: i ended up creating https://github.com/bundler/bundler/issues/6870 | 09:56 |
| ssbarnea | is better to assure that we raise issues upstream before adding workarounds | 09:57 |
| ykarel | ssbarnea, ack | 09:57 |
| ykarel | i think EmilienM mwhahaha would have idea around it | 09:58 |
| EmilienM | hello | 09:58 |
| ssbarnea | ykarel: imagine what would happen if pip will do that | 09:58 |
| ykarel | ssbarnea, in pip also i think we need to set what we want with py2/py3, no? | 10:00 |
| *** wolverineav has joined #openstack-infra | 10:04 | |
| *** wolverineav has quit IRC | 10:08 | |
| *** markmcd has joined #openstack-infra | 10:09 | |
| *** markmcd has left #openstack-infra | 10:09 | |
| *** markvoelker has joined #openstack-infra | 10:09 | |
| *** bhavikdbavishi has quit IRC | 10:10 | |
| *** armax has joined #openstack-infra | 10:29 | |
| openstackgerrit | Merged openstack-infra/system-config master: Update Zuul service documentation https://review.openstack.org/605556 | 10:29 |
| *** armax has quit IRC | 10:33 | |
| openstackgerrit | Merged openstack-infra/puppet-infra-cookiecutter master: Dissuade .gitignore references to personal tools https://review.openstack.org/608334 | 10:34 |
| *** jpich has quit IRC | 10:43 | |
| *** jpich has joined #openstack-infra | 10:49 | |
| *** sshnaidm__ has joined #openstack-infra | 11:01 | |
| *** pbourke has quit IRC | 11:02 | |
| *** pbourke has joined #openstack-infra | 11:04 | |
| *** sshnaidm_ has quit IRC | 11:05 | |
| *** sshnaidm__ has quit IRC | 11:06 | |
| *** sshnaidm has joined #openstack-infra | 11:08 | |
| *** sshnaidm is now known as sshnaidm|off | 11:08 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/zuul-jobs master: WIP: Default private_ipv4 to use public_ipv4 address when null https://review.openstack.org/623294 | 11:13 |
| *** panda is now known as panda|reloc | 11:16 | |
| *** rpittau is now known as rpittau|lunch | 11:28 | |
| *** janki has quit IRC | 11:30 | |
| *** dtantsur|afk is now known as dtantsur | 11:32 | |
| openstackgerrit | Sean McGinnis proposed openstack-infra/project-config master: Consolidate Cinder repo ACL settings https://review.openstack.org/628407 | 11:37 |
| openstackgerrit | Sean McGinnis proposed openstack-infra/project-config master: Remove Cinder CI Verified label https://review.openstack.org/628408 | 11:37 |
| *** rpittau|lunch has quit IRC | 11:43 | |
| *** rpittau|lunch has joined #openstack-infra | 11:44 | |
| *** dkehn has quit IRC | 11:57 | |
| *** rpittau|lunch has quit IRC | 11:58 | |
| *** rpittau|lunch has joined #openstack-infra | 12:01 | |
| *** dkehn has joined #openstack-infra | 12:02 | |
| *** bhavikdbavishi has joined #openstack-infra | 12:10 | |
| *** rpittau|lunch has quit IRC | 12:13 | |
| *** rpittau|lunch has joined #openstack-infra | 12:13 | |
| *** rpittau|lunch has quit IRC | 12:28 | |
| *** armax has joined #openstack-infra | 12:29 | |
| openstackgerrit | lijunjie proposed openstack-infra/zuul master: Fix the misspelling of "connection" https://review.openstack.org/628422 | 12:32 |
| *** rpittau has joined #openstack-infra | 12:33 | |
| openstackgerrit | lijunjie proposed openstack-infra/puppet-translation_checksite master: Fix the misspelling of "openstack" https://review.openstack.org/628425 | 12:33 |
| *** armax has quit IRC | 12:34 | |
| openstackgerrit | lijunjie proposed openstack-infra/openstackweb master: Fix the misspelling of "openstack" https://review.openstack.org/628426 | 12:34 |
| *** lifeless has quit IRC | 12:42 | |
| fungi | ykarel: ssbarnea: cmurphy pinned to bundler<2 yesterday in our infra puppet integration tests and that seems to have worked for us anyway | 12:48 |
| ssbarnea | fungi: i got a big more flexible approach: https://review.openstack.org/#/c/628395/3/playbooks/prepare-node-integration.yaml | 12:49 |
| ssbarnea | it should be better, sooner or later we will hit something that needs newer bundler | 12:50 |
| *** ssbarnea has quit IRC | 12:51 | |
| ykarel | fungi, ack | 12:55 |
| *** panda|reloc is now known as panda | 13:00 | |
| AJaeger | fungi: https://review.openstack.org/628283 is also needed for pinning AFAIU | 13:02 |
| *** jcoufal has joined #openstack-infra | 13:02 | |
| cmurphy | yes that will fix https://review.openstack.org/606021 | 13:03 |
| *** rlandy has joined #openstack-infra | 13:06 | |
| *** rlandy is now known as rlandy|rover | 13:14 | |
| *** boden has joined #openstack-infra | 13:16 | |
| *** slaweq has quit IRC | 13:23 | |
| *** slaweq has joined #openstack-infra | 13:24 | |
| *** trown|outtypewww is now known as trown | 13:26 | |
| *** bhavikdbavishi has quit IRC | 13:28 | |
| *** markvoelker has quit IRC | 13:33 | |
| *** wolverineav has joined #openstack-infra | 13:40 | |
| *** wolverineav has quit IRC | 13:44 | |
| *** agopi has quit IRC | 13:49 | |
| *** agopi has joined #openstack-infra | 13:51 | |
| *** ykarel is now known as ykarel|away | 13:59 | |
| *** dave-mccowan has joined #openstack-infra | 14:01 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Updated meeting time for D&I WG https://review.openstack.org/628214 | 14:03 |
| *** lbragstad has joined #openstack-infra | 14:08 | |
| *** iurygregory has quit IRC | 14:15 | |
| *** iurygregory has joined #openstack-infra | 14:15 | |
| *** ssbarnea has joined #openstack-infra | 14:20 | |
| *** shardy has quit IRC | 14:23 | |
| *** ykarel|away has quit IRC | 14:24 | |
| *** mriedem has joined #openstack-infra | 14:30 | |
| *** armax has joined #openstack-infra | 14:30 | |
| *** EmilienM is now known as EvilienM | 14:34 | |
| *** armax has quit IRC | 14:35 | |
| *** quiquell is now known as quiquell|off | 14:45 | |
| *** sshnaidm_ has joined #openstack-infra | 14:46 | |
| *** sshnaidm|off has quit IRC | 14:47 | |
| *** sshnaidm_ is now known as sshnaidm|off | 14:50 | |
| *** kgiusti has joined #openstack-infra | 14:56 | |
| *** kgiusti has left #openstack-infra | 14:56 | |
| ssbarnea | fungi: clarkb: a very old one https://review.openstack.org/#/c/570546/ - so old that I do not remember exactly where I encountered the bug, but should be no brainer to review it. | 14:57 |
| *** udesale has quit IRC | 14:59 | |
| *** Goneri has quit IRC | 15:05 | |
| *** rlandy|rover is now known as rlandy|rover|brb | 15:10 | |
| *** rlandy|rover|brb is now known as rlandy|rover | 15:22 | |
| *** ykarel|away has joined #openstack-infra | 15:24 | |
| *** dpawlik has quit IRC | 15:25 | |
| corvus | mordred, fungi: it looks like the issue with gitea replication is that the ssh connection on gerrit's side is in close_wait: | 15:25 |
| corvus | java 12318 gerrit2 308u IPv6 1607582864 0t0 TCP 104.130.246.32:52934->38.108.68.66:ssh (CLOSE_WAIT) | 15:26 |
| openstackgerrit | jacky06 proposed openstack/diskimage-builder master: Update hacking version to latest https://review.openstack.org/628466 | 15:26 |
| corvus | mordred, fungi: i don't see a running sshd subprocess on gitea's side to correspond with that | 15:27 |
| corvus | that public ip terminates at an octavia lb -- can we log into that and look at netstat there? | 15:28 |
| mordred | corvus: I don't know if we can or not ... mnaser ? | 15:29 |
| mordred | corvus: in other news, the ceph cluster seems to be back to being happy | 15:29 |
| corvus | mordred: neat, any idea what happened? | 15:30 |
| mordred | corvus: no clue at all | 15:30 |
| mordred | corvus: I also don't know what made it unhappy in the first place | 15:30 |
| corvus | ok... i guess "wait and see if it fixes itself" is a viable option to consider in response to "osds are unbalanced" | 15:31 |
| mordred | yeah. maybe osds just get unbalanced from time to time? | 15:31 |
| corvus | it looks like osd1 is still a little more used than the others | 15:31 |
| johnsom | corvus: You can log into the amp via ssh if octavia is configured with an ssh keypair. Are you trying to do an ssh through the lb vip? | 15:32 |
| mordred | johnsom: yah - it's lb'ing ssh | 15:33 |
| johnsom | Ok, did you crank up the listener timeouts? | 15:33 |
| mordred | we did not - we didn't actually create the lb ourselves, k8s created it for us - is that a thing we can alter in a running lb? | 15:34 |
| johnsom | The defaults are good for HTTP, but ssh will idle and run longer. | 15:34 |
| johnsom | Yes, they can be updated after the fact | 15:34 |
| * corvus logs into horizon | 15:34 | |
| mordred | cool | 15:35 |
| fungi | (unless we set ssh keepalives on both the client and server side, which is probably a pain to do for whatever gerrit's using) | 15:35 |
| corvus | johnsom: when you say 'octavia configured with an ssh key' is that an operator or end-user feature? | 15:35 |
| *** lbragstad has quit IRC | 15:36 | |
| johnsom | Operator only | 15:36 |
| corvus | we're not the operator here, so i guess we can't log into it then | 15:36 |
| corvus | johnsom: for the timeout, i assume that would be on the listener? | 15:36 |
| johnsom | Yes | 15:37 |
| *** EvilienM is now known as EmilienM | 15:37 | |
| corvus | it doesn't look like that's an option in horizon: https://screenshots.firefox.com/kC6p0Rl9HeLs4WUP/dashboard.vexxhost.net | 15:38 |
| corvus | i guess i should dig out the cli :) | 15:38 |
| johnsom | Yeah, that looks like an older dashboad | 15:38 |
| mordred | that's weird- mnaser is normally running all the coolest/latest things | 15:39 |
| *** lbragstad has joined #openstack-infra | 15:40 | |
| corvus | here we are: http://paste.openstack.org/show/739934/ | 15:41 |
| mnaser | Hi | 15:41 |
| mnaser | Yes our dashboard is queens :( things are changing soon though | 15:42 |
| johnsom | corvus: those values are in ms, crank the client and server way up for your estimated ssh times. | 15:43 |
| corvus | so that's 5 seconds to connect, and 50 seconds without sending data? that is probably too low for an interactive ssh session, but since this is non-interactive, i wonder if there's still another problem. | 15:47 |
| clarkb | I agree, if running git push over ssh that should be plenty | 15:48 |
| johnsom | Doesn’t hurt to bump them anyway unless you are expecting a very high number of connections coming/going. | 15:50 |
| corvus | yeah, i'll go ahead and do that -- it could be that the server is slow enough to trip the timeout, and that's the immediate cause of the close_wait. perhaps increasing the timeout will improve that, but still leave us with the question of why the connection went idle. | 15:51 |
| corvus | loadbalancer listener set 3f56eb2d-c85d-44d9-a472-addd038fc6b2 --timeout-client-data=181000 --timeout-member-data=181000 | 15:53 |
| *** diablo_rojo has joined #openstack-infra | 16:00 | |
| *** smarcet has joined #openstack-infra | 16:03 | |
| clarkb | is that an openstack client command? | 16:04 |
| corvus | ya | 16:04 |
| *** apetrich has quit IRC | 16:07 | |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/git-review master: Switch from testrepository to stestr https://review.openstack.org/628525 | 16:07 |
| *** jamesmcarthur has joined #openstack-infra | 16:07 | |
| *** adriancz has quit IRC | 16:08 | |
| *** jrist has joined #openstack-infra | 16:09 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Turn on the future parser for master nameserver https://review.openstack.org/616000 | 16:09 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Turn on future parser for one nodepool launcher https://review.openstack.org/616288 | 16:09 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Turn on future parser for all nodepool launchers https://review.openstack.org/616289 | 16:09 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Turn on future parser for one nodepool builder https://review.openstack.org/616290 | 16:09 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Turn on future parser for all nodepool builders https://review.openstack.org/616291 | 16:09 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Turn on future parser for one zuul executor https://review.openstack.org/616292 | 16:09 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Turn on future parser for all zuul executors https://review.openstack.org/616293 | 16:09 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Turn on the future parser for one zuul merger https://review.openstack.org/616294 | 16:09 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Turn on the future parser for all zuul mergers https://review.openstack.org/616295 | 16:09 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Turn on the future parser for zuul.openstack.org https://review.openstack.org/616296 | 16:09 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Fix glob for lists.katacontainers.io https://review.openstack.org/628216 | 16:09 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Fix glob for lists.o.o https://review.openstack.org/628217 | 16:09 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Turn on the future parser for openstackid-dev https://review.openstack.org/616001 | 16:09 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Turn on the future parser for openstackid https://review.openstack.org/616002 | 16:09 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Turn on the future parser for refstack https://review.openstack.org/628153 | 16:09 |
| clarkb | cmurphy: ^ adns was in same situation | 16:09 |
| clarkb | fungi: care to rereview changes starting at https://review.openstack.org/#/c/615998/7 ? They've changed slightly | 16:09 |
| cmurphy | clarkb: oops thansk | 16:10 |
| *** armax has joined #openstack-infra | 16:10 | |
| *** dpawlik has joined #openstack-infra | 16:11 | |
| *** arxcruz is now known as arxcruz|brb | 16:11 | |
| *** dpawlik has quit IRC | 16:15 | |
| *** smarcet has quit IRC | 16:18 | |
| *** ykarel|away has quit IRC | 16:18 | |
| *** smarcet has joined #openstack-infra | 16:21 | |
| openstackgerrit | jacky06 proposed openstack/ansible-role-cloud-launcher master: Update hacking version to latest https://review.openstack.org/628537 | 16:21 |
| *** bhavikdbavishi has joined #openstack-infra | 16:26 | |
| *** apetrich has joined #openstack-infra | 16:28 | |
| *** smarcet has quit IRC | 16:29 | |
| *** hamerins has joined #openstack-infra | 16:30 | |
| *** smarcet has joined #openstack-infra | 16:31 | |
| *** psachin has quit IRC | 16:32 | |
| *** Goneri has joined #openstack-infra | 16:34 | |
| *** apetrich has quit IRC | 16:35 | |
| *** anteaya has joined #openstack-infra | 16:35 | |
| *** e0ne has quit IRC | 16:36 | |
| *** sthussey has quit IRC | 16:39 | |
| *** smarcet has quit IRC | 16:42 | |
| openstackgerrit | weizj proposed openstack/os-performance-tools master: Update hacking version to latest https://review.openstack.org/628595 | 16:42 |
| *** smarcet has joined #openstack-infra | 16:43 | |
| openstackgerrit | weizj proposed openstack/os-testr master: Update hacking version to latest https://review.openstack.org/628608 | 16:43 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Run k8s-on-openstack to manage k8s control plane https://review.openstack.org/626965 | 16:46 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Add resources for deploying rook and xtradb to kuberenets https://review.openstack.org/626054 | 16:46 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Increase number of k8s nodes to 4 https://review.openstack.org/628031 | 16:46 |
| *** iurygregory has quit IRC | 16:48 | |
| *** sthussey has joined #openstack-infra | 16:50 | |
| zxiiro | Anyone know if there's a way to list all object storage items using the openstack client? "openstack object list" seems to be about listing a specific container and not about listing all available containers. | 17:03 |
| *** jbadiapa has quit IRC | 17:04 | |
| *** derekh has quit IRC | 17:04 | |
| zxiiro | or do I have ot use the swift client for this? | 17:04 |
| *** pgaxatte has quit IRC | 17:04 | |
| *** derekh has joined #openstack-infra | 17:04 | |
| ssbarnea | https://review.openstack.org/#/c/628525/ -- adopts use of stestr instead of testrepository for git-review | 17:04 |
| clarkb | zxiiro: You want to list all objects in all containers? | 17:05 |
| clarkb | zxiiro: my hunch is that you have to list all containers then do a foreach type loop since objects are parented to containers and list is a container activity. notmyname should know though | 17:06 |
| *** ramishra has quit IRC | 17:06 | |
| zxiiro | clarkb: just want to list containers | 17:07 |
| clarkb | zxiiro: `openstack container list` iirc | 17:07 |
| zxiiro | clarkb: AH! Just occurred to me... | 17:07 |
| zxiiro | duh | 17:08 |
| clarkb | zxiiro: in this context they are swift containers not linux containers (because swift came first in our world I don't know if it came first on wall clock) | 17:08 |
| pabelanger | corvus: I believe so, but cannot remember ATM. I'll be able to look this afternoon and refresh my memory | 17:08 |
| zxiiro | cool thanks this works for me. | 17:09 |
| timburke | clarkb: fwiw, there have been rumblings about wanting to rename them to be "buckets" to match S3's nomenclature, but the transition would be... painful... | 17:10 |
| clarkb | timburke: fwiw when I think of the shipping container memes I think they apply to swift better than docker :) | 17:10 |
| *** rpittau has quit IRC | 17:12 | |
| notmyname | clarkb: :-) | 17:15 |
| fungi | also, yes, swift had "containers" before docker popularized the term to apply to system isolation | 17:16 |
| fungi | though maybe the term dates back to lxc, which predates swift by two years | 17:17 |
| *** armax has quit IRC | 17:18 | |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/git-review master: Switch from testrepository to stestr https://review.openstack.org/628525 | 17:19 |
| *** armax has joined #openstack-infra | 17:20 | |
| clarkb | fungi: https://review.openstack.org/#/c/615998/ fixes the futureparser stuff for name servers. I'll merge and monitor those again this morning | 17:20 |
| fungi | thanks, i've been sidelined by a bunch of discussions this morning, so just getting to reviews now | 17:21 |
| notmyname | fungi: swift got the name "containers" from the internal project that it replaced at rackspace. IIRC that project at rackspace started in 2007. swift started in the middle of 2009 to replace that system | 17:22 |
| fungi | oh, also, in container history, i found a reference to https://lkml.org/lkml/2006/10/20/251 introducing "generic process containers" (before they got renamed to "control groups" the next year) | 17:23 |
| fungi | so i guess the linux kernel has been using the term in more or less that way dating back to '06 | 17:23 |
| *** whoami-rajat has quit IRC | 17:27 | |
| fungi | but yeah, given linux only briefly used the term to refer to control groups in 06, rackspace can't be blamed for not being aware of possible future confusion over use of the term when it designed an object storage system around the same time ;) | 17:31 |
| openstackgerrit | Logan V proposed openstack-infra/project-config master: Add node host_ids to logstash fields https://review.openstack.org/628642 | 17:34 |
| clarkb | logan-: ^ thank you for that | 17:35 |
| logan- | clarkb: reading your backscroll yesterday I think ^ will help me a lot when im digging thru logstash for failures | 17:35 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Pin bundler in puppet-lint and -syntax jobs https://review.openstack.org/628283 | 17:35 |
| clarkb | yup and http://logs.openstack.org/15/625915/3/gate/tripleo-ci-centos-7-undercloud-containers/0a7a9b7/zuul-info/inventory.yaml shows it is available as we expect it to be on the zuul side | 17:36 |
| clarkb | pabelanger: ^ maybe you can review https://review.openstack.org/628642 too? its related to your host id work | 17:37 |
| *** e0ne has joined #openstack-infra | 17:43 | |
| *** e0ne has quit IRC | 17:44 | |
| *** hamerins has quit IRC | 17:44 | |
| *** hamerins has joined #openstack-infra | 17:46 | |
| *** jpich has quit IRC | 17:49 | |
| *** dustinc has joined #openstack-infra | 17:51 | |
| openstackgerrit | Merged openstack-infra/system-config master: Turn on the future parser for one nameserver https://review.openstack.org/615998 | 17:54 |
| *** josephrsandoval has joined #openstack-infra | 17:55 | |
| *** martinkennelly has joined #openstack-infra | 17:56 | |
| *** josephrsandoval has quit IRC | 17:57 | |
| dirk | could anyone help me understand where this fedora 27 image reference comes from? | 17:58 |
| dirk | http://logs.openstack.org/13/628413/1/check/heat-functional-convg-mysql-lbaasv2/3ab6aa4/logs/devstacklog.txt.gz#_2019-01-04_12_35_42_377 | 17:58 |
| dirk | it seems running jobs against stable/pike doesn't work right now | 17:58 |
| dirk | it looks like the mirror only has fedora 28+ | 17:59 |
| clarkb | dirk: we deleted fedora27 as it is eol now aiui | 17:59 |
| *** hamerins has quit IRC | 18:00 | |
| martinkennelly | Hey all, I am developing a CI. I have a service account setup, but how do I get my CI posting results like this for each patch? https://imgur.com/zmVmk4L | 18:00 |
| clarkb | dirk: I think that url comes from the devstack config? | 18:00 |
| fungi | dirk: clarkb: looks like that's a stable/pike job | 18:01 |
| fungi | so http://codesearch.openstack.org/?q=Fedora-Cloud-Base-27-1 isn't much help | 18:01 |
| dirk | ah, it looks like we need https://review.openstack.org/#/c/622853/ | 18:01 |
| dirk | which also fails | 18:01 |
| *** hamerins has joined #openstack-infra | 18:01 | |
| dirk | sigh | 18:01 |
| clarkb | martinkennelly: the way that table is generated is we load js into gerrit that scans the comments for comments in a specific format that it recognizes | 18:01 |
| martinkennelly | clarkb: Awesome thank you!! | 18:02 |
| clarkb | martinkennelly: if your CI starts commenting with that format then it will get picked up by the js comment scanner | 18:02 |
| clarkb | martinkennelly: you can expand the comments below on the change to see that format | 18:02 |
| martinkennelly | clarkb: exactly what I wished to understand :) | 18:02 |
| clarkb | and I think we've got it written down somewhere but I'm not sure where ( maybe in our zuul config? or is that default zuul gerrit report format?) | 18:03 |
| fungi | martinkennelly: https://docs.openstack.org/infra/system-config/third_party.html#posting-result-to-gerrit | 18:03 |
| fungi | the last paragraph of that section | 18:03 |
| fungi | "For example, to have your test results formatted in the same manner as the upstream Jenkins results, use a template for each result matching..." | 18:03 |
| *** derekh has quit IRC | 18:03 | |
| *** gyee has joined #openstack-infra | 18:04 | |
| dirk | clarkb: but it looks like non-EOLed images are not working with pike | 18:04 |
| martinkennelly | fungi: Thank you so much. I am humbled by your help. | 18:04 |
| clarkb | logan-: http://logs.openstack.org/42/628642/1/check/openstack-zuul-jobs-linters/94c4e02/job-output.txt.gz#_2019-01-04_17_43_01_264400 pep8 is unhappy with that change if you want ot update it :) | 18:04 |
| *** aojea has quit IRC | 18:04 | |
| fungi | martinkennelly: i am honored to be able to help! | 18:04 |
| clarkb | dirk: this is why we have been wary to support old branches for long periods of time :/ | 18:04 |
| dirk | well | 18:05 |
| clarkb | dirk: eventually you end upfixing all the things if you didn't pick something with long term support to start with | 18:05 |
| fungi | dirk: it's perfectly acceptable under the extended maintenance model to declare a branch untestable, or to declare certain jobs no longer viable on a branch and stop running them | 18:05 |
| *** xek_ has quit IRC | 18:05 | |
| dirk | this isn't a nodepool OS | 18:05 |
| dirk | its a test image. so I would assume that newer images work like older images | 18:05 |
| clarkb | dirk: fedora 28 is very different than fedora 27 | 18:06 |
| dirk | hmm | 18:06 |
| dirk | so we're sure its not 28 vs 29 but 27 vs 28? | 18:06 |
| dirk | the review I linked above goes from 27 to 29 | 18:06 |
| clarkb | dirk: i'm not sure where it will breka but in general fedora has massive changes between releases | 18:07 |
| *** ccamacho has quit IRC | 18:07 | |
| clarkb | my suggestion would be to stop using fedora there if you want to support it over a very long period of time | 18:07 |
| clarkb | and use something with a long support period instead | 18:07 |
| *** tosky has quit IRC | 18:09 | |
| dirk | clarkb: the fedora 29 image works with queens | 18:09 |
| dirk | so I guess something was fixed in queens that needs to be backported to pike now | 18:09 |
| *** jamesmcarthur has quit IRC | 18:10 | |
| *** jamesmcarthur has joined #openstack-infra | 18:10 | |
| *** jamesmcarthur has quit IRC | 18:11 | |
| *** dtantsur is now known as dtantsur|afk | 18:11 | |
| *** jamesmcarthur has joined #openstack-infra | 18:11 | |
| fungi | huh, so github is sending out uselessly vague notices to projects about a high-severity vulnerability in pyyaml: "Known high severity security vulnerability in pyyaml v< 4.2b1 ..." (3.13 is the latest non-prerelease version of pyyaml on pypi, so...) | 18:12 |
| fungi | my best guess is it's about https://github.com/yaml/pyyaml/issues/5 | 18:12 |
| clarkb | fungi: ya they were going to flip 4.x over to safe load by default | 18:12 |
| fungi | aha, breadcrumb leads to https://github.com/opsdroid/opsdroid/issues/580 | 18:13 |
| clarkb | and I think have removed at least one release that did so from pypi | 18:13 |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/git-review master: Adds JAVA_HOME to tox passenv https://review.openstack.org/628525 | 18:13 |
| fungi | yeah, just wondering what triggers github to send out notices recommending upgrading to a beta release of pyyaml after some 7 months | 18:13 |
| clarkb | fungi: probably a question for jlk | 18:14 |
| openstackgerrit | Logan V proposed openstack-infra/project-config master: Add node host_ids to logstash fields https://review.openstack.org/628642 | 18:14 |
| fungi | further tracking leads to https://github.com/yaml/pyyaml/issues/207 | 18:14 |
| fungi | to be honest i find the whole situation with https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2017-18342 ridiculous | 18:18 |
| *** jcoufal has quit IRC | 18:18 | |
| clarkb | fungi: considering that is a feature of yaml: yes | 18:19 |
| fungi | i mean, it's a library for loading data, and includes support for loading all sorts of data types not limited to "safe" ones | 18:19 |
| fungi | and its documentation clearly states not to use load() on untrusted data | 18:19 |
| fungi | this is like saying applications using python are unsafe because someone might write an application which uses the pickle routines from stdlib on untrusted data | 18:20 |
| fungi | yeah, so? | 18:20 |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/git-review master: Switch from testrepository to stestr https://review.openstack.org/628655 | 18:20 |
| *** smarcet has quit IRC | 18:21 | |
| fungi | anyway, basically every repository on github which indicates a dependency on a non-beta version of pyyaml just got spammed about this "known high-severity security vulnerability in pyyaml" | 18:23 |
| clarkb | well now we know :) | 18:24 |
| fungi | and knowing's half teh battle, go joe | 18:24 |
| *** smarcet has joined #openstack-infra | 18:24 | |
| * fungi disappears to get some grocery shopping out of the way, bbiab | 18:24 | |
| *** smarcet has quit IRC | 18:35 | |
| *** smarcet has joined #openstack-infra | 18:39 | |
| *** jamesmcarthur has quit IRC | 18:46 | |
| aspiers | smarcet: please could you explain https://review.openstack.org/#/c/585516/3/www/templates/deprecated_badge.tmpl@6 to me? | 18:47 |
| *** jamesmcarthur has joined #openstack-infra | 18:47 | |
| aspiers | in particular "if this html its included externally, as it does on doctheme" | 18:47 |
| *** smarcet has quit IRC | 18:50 | |
| *** jamesmcarthur has quit IRC | 18:51 | |
| *** smarcet has joined #openstack-infra | 18:52 | |
| clarkb | fungi: looks like github is also complaining about django | 18:52 |
| *** jamesmcarthur has joined #openstack-infra | 18:55 | |
| *** gfidente has quit IRC | 18:56 | |
| *** whoami-rajat has joined #openstack-infra | 18:57 | |
| openstackgerrit | Merged openstack-infra/system-config master: Turn on the future parser for all nameservers https://review.openstack.org/615999 | 18:58 |
| anteaya | fungi: I agree with the mailing list kudos, for me I would substitute the 'actually' with 'consistently' | 19:00 |
| *** jcoufal has joined #openstack-infra | 19:00 | |
| aspiers | smarcet: ohhh, I guess it's referring to https://github.com/openstack/openstackdocstheme/blob/a0684ace5e49ef935bd314928dc1acde3da6e11a/openstackdocstheme/theme/openstackdocs/layout.html#L107 | 19:00 |
| *** bobh has joined #openstack-infra | 19:01 | |
| aspiers | as used in places like https://docs.openstack.org/nova/queens/ ... OK, returning to #openstack-docs now :) | 19:03 |
| openstackgerrit | Merged openstack-infra/devstack-gate master: Avoid failure to install zuul when venv exists https://review.openstack.org/570546 | 19:03 |
| *** wolverineav has joined #openstack-infra | 19:04 | |
| *** wolverineav has quit IRC | 19:04 | |
| *** wolverineav has joined #openstack-infra | 19:04 | |
| openstackgerrit | Merged openstack-infra/system-config master: Turn on the future parser for master nameserver https://review.openstack.org/616000 | 19:11 |
| *** jamesmcarthur has quit IRC | 19:11 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Add #opendev to accessbot https://review.openstack.org/628664 | 19:12 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Add #opendev to meetbot https://review.openstack.org/628665 | 19:12 |
| corvus | infra-root config-core: ^ group registration for the #opendev namespace is in progress; the channel is now registered to us | 19:14 |
| *** jamesmcarthur has joined #openstack-infra | 19:17 | |
| *** bobh_ has joined #openstack-infra | 19:17 | |
| *** bobh has quit IRC | 19:19 | |
| *** smarcet has quit IRC | 19:20 | |
| mriedem | clarkb: i'm seeing gate failures but not getting comments from e-r, is the worker ok? | 19:22 |
| clarkb | mriedem: I don't see anything obivously wrong in the logs | 19:29 |
| clarkb | but these tend to be painful to dig through because tehy have the gerrit comments in them which have things like "traceback" in them too :) | 19:29 |
| mriedem | ew yeah | 19:30 |
| mriedem | should maybe audit what/how e-r logs stuff to make that more useful | 19:30 |
| clarkb | mriedem: it looked at https://review.openstack.org/#/c/628511/ recently which recently failed | 19:34 |
| mriedem | but didn't report on it | 19:35 |
| fungi | thanks for the update, corvus! | 19:35 |
| clarkb | no, but that could be because there were no matches? I'm still trying to run through what it did there | 19:36 |
| clarkb | it found all console logs were ready for all those failed jobs | 19:36 |
| mriedem | ok i don't think e-r comments on tox job failures...looking | 19:36 |
| *** dkehn has quit IRC | 19:36 | |
| fungi | anteaya: thanks for the kudos! it's not why i'm here, but it's always nice to feel appreciated nonetheless | 19:37 |
| mordred | clarkb, fungi, corvus: https://review.openstack.org/#/c/511828/ <-- could I get a +A on that? I'm gonna see if I can't finish driving the logs/artifacts stack in | 19:37 |
| clarkb | mriedem: ya I don't think it does | 19:37 |
| fungi | mordred: lookinb | 19:37 |
| fungi | er, looking | 19:37 |
| clarkb | mriedem: do you hvae an example where you expected it to comment? I can try looking that direction instead | 19:37 |
| clarkb | corvus: safe to approve the accessbot change? looking at chanserv it appears to be ready | 19:38 |
| *** dkehn has joined #openstack-infra | 19:38 | |
| mriedem | https://review.openstack.org/#/c/628302/ | 19:39 |
| *** wolverineav has quit IRC | 19:39 | |
| *** wolverineav has joined #openstack-infra | 19:39 | |
| clarkb | mriedem: I wonder if our regex only matches the legacy jobs | 19:39 |
| clarkb | mriedem: jobs_re=(dsvm|tripleo) | 19:40 |
| clarkb | that is at least part of the problem | 19:40 |
| mriedem | yeah JOBS_RE = 'dsvm' | 19:42 |
| *** jamesmcarthur has quit IRC | 19:43 | |
| *** jamesmcarthur has joined #openstack-infra | 19:43 | |
| mriedem | do we have an elasticRecheck.conf in system-config or something? | 19:44 |
| anteaya | fungi glad the appreciation is felt :) | 19:44 |
| mordred | fungi: thanks! | 19:46 |
| mriedem | http://git.openstack.org/cgit/openstack-infra/puppet-elastic_recheck/tree/templates/elastic-recheck.conf.erb | 19:46 |
| clarkb | mriedem: http://git.openstack.org/cgit/openstack-infra/puppet-elastic_recheck/tree/templates/elastic-recheck.conf.erb | 19:46 |
| *** bhavikdbavishi has quit IRC | 19:46 | |
| clarkb | ya | 19:46 |
| mriedem | i win | 19:46 |
| * anteaya hands mriedem a cookie | 19:46 | |
| mriedem | yeah so i suppose that should include |devstack|tempest | 19:46 |
| *** jamesmcarthur has quit IRC | 19:46 | |
| mriedem | and |grenade | 19:47 |
| *** jamesmcarthur has joined #openstack-infra | 19:47 | |
| mriedem | patch incoming | 19:47 |
| clarkb | corvus: puppet is broken on adns1.openstack.org because /etc/ansible/hosts/group_vars/adns.yaml sets dnssec_keys to include opendev. I think this means on the flip side adns1.opendev.org should already have keys set up for zuulci.org and zuul-ci.org | 19:49 |
| clarkb | corvus: rather than try and support two nameservers like this should we just move ahead with moving zuul*.org to opendev.org name servers? | 19:50 |
| clarkb | corvus: I think you need to do glue things on the registrar side (and we need to double check zone files are in place in addition to the keys), so I don't think I should just go ahead and do that | 19:50 |
| mordred | clarkb: I agree with you | 19:50 |
| openstackgerrit | Merged openstack-infra/project-config master: Use ensure-output-dirs in base-test https://review.openstack.org/511828 | 19:50 |
| *** eernst has joined #openstack-infra | 19:51 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: DNM Testing ensure-output-dirs https://review.openstack.org/628668 | 19:51 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/puppet-elastic_recheck master: Update elastic-recheck jobs_re config https://review.openstack.org/628669 | 19:51 |
| fungi | yeah, it did appear the zones were being served both by adns1 and ns1/2 | 19:51 |
| fungi | when i was figuring out how to reload nsd | 19:51 |
| *** jamesmcarthur has quit IRC | 19:52 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/puppet-elastic_recheck master: Update elastic-recheck jobs_re config https://review.openstack.org/628669 | 19:52 |
| clarkb | another option is to not use create_resources on the dnssec keys and explicitly list them in puppet as we explicitly list the zones in puppet | 19:52 |
| *** eernst has quit IRC | 19:53 | |
| clarkb | if we want to keep the old servers around longer | 19:53 |
| fungi | http://paste.openstack.org/show/739941/ | 19:53 |
| fungi | the serials differ though | 19:53 |
| fungi | checking that out now | 19:53 |
| clarkb | oh interesting | 19:54 |
| fungi | the on-disk serial for /var/lib/bind/zones/zuul-ci.org/zone.db is 1522167762 for both of them | 19:55 |
| fungi | i suspect those are the serials for the signed zones | 19:55 |
| fungi | yeah, all three are from 2018-03-27 | 19:56 |
| fungi | mere seconds apart | 19:56 |
| pabelanger | clarkb: logan-: +3 | 19:57 |
| *** hamerins has quit IRC | 19:59 | |
| fungi | the zonefiles themselves have identical checksums | 19:59 |
| fungi | so i think this is fine | 19:59 |
| *** hamerins has joined #openstack-infra | 20:00 | |
| clarkb | ya so next steps should be updating registrar and our ns records then we cna clena up the old servers and the puppet manifests | 20:04 |
| fungi | and the zsk | 20:05 |
| *** eernst has joined #openstack-infra | 20:06 | |
| fungi | because pretty sure the zsk on openstack is different from the one on opendev | 20:06 |
| fungi | ds records | 20:06 |
| fungi | whatever | 20:06 |
| clarkb | ah ya thats server specific right | 20:07 |
| fungi | well, it's tied to the master nameserver generally | 20:07 |
| fungi | we could have reused them, but pretty sure a fresh one was generated on adns1.opendev.org (which is preferable anyway) | 20:08 |
| openstackgerrit | Merged openstack-infra/project-config master: Add node host_ids to logstash fields https://review.openstack.org/628642 | 20:09 |
| *** lifeless has joined #openstack-infra | 20:12 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Use ensure-output-dirs in base https://review.openstack.org/511829 | 20:17 |
| mordred | pabelanger: ^^ would you remove your -2 from that - also, a +2 would be lovely | 20:17 |
| mordred | pabelanger, fungi, clarkb: ^^ it has been tested with base-test here: http://logs.openstack.org/68/628668/1/check/tox-py35/1eecc09/ara-report/result/2b78b874-968b-40fa-b571-4f255084c9a0/ | 20:17 |
| pabelanger | +2 | 20:18 |
| mordred | pabelanger: (I'm picking up the baton on this one again :) ) | 20:18 |
| pabelanger | Yay | 20:18 |
| mordred | pabelanger: maybe between the two of us we'll get it done before we both retire | 20:19 |
| pabelanger | ikr | 20:19 |
| mordred | pabelanger: when I"m done, I might go beat the drum on your base-minimal stack too | 20:19 |
| mordred | but I wanna get this darned thing done :) | 20:19 |
| pabelanger | mordred: sure, wfm. I should have some cycles to help also. Let me know | 20:20 |
| fungi | mordred: is that also a candidate for the example base and base-test jobs in teh zuul-base-jobs repo? | 20:22 |
| openstackgerrit | Merged openstack-infra/system-config master: Turn on future parser for one nodepool launcher https://review.openstack.org/616288 | 20:22 |
| mordred | fungi: yah. lemme do that real quick | 20:22 |
| fungi | i mean, let's dogfood it in project-config first for sure | 20:23 |
| fungi | since as previously discussed ni #zuul we do apparently have users of the zuul-base-jobs repo so may need to announce any behavior changes there | 20:23 |
| *** hamerins has quit IRC | 20:23 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-base-jobs master: Add ensure-output-dirs to base jobs https://review.openstack.org/628674 | 20:25 |
| mordred | fungi: there you go | 20:25 |
| fungi | thanks! | 20:25 |
| mordred | fungi: I believe these changes should be mostly transparent to people using zbj (and to use in project-config) | 20:25 |
| openstackgerrit | Merged openstack-infra/project-config master: Use ensure-output-dirs in base https://review.openstack.org/511829 | 20:34 |
| mordred | woot. we'v made progress | 20:35 |
| martinkennelly | I am trying to use the ci sandbox (https://git.openstack.org/cgit/openstack-dev/ci-sandbox/), but I am having trouble connecting to it. I am not sure what to put in as the frontend url for it. I only have the git link to it. I cant seem to find it in any documentation. | 20:37 |
| mordred | now that I have your attention - pabelanger, fungi: https://review.openstack.org/#/c/511843 ... pabelanger wrote a different version - but if it's ok with y'all I'd like to just get in the single role for now (so we can reduce the number of base-test patches we need to cycle through) and maybe refactor later? or would you prefer to go with the split approach? | 20:37 |
| clarkb | martinkennelly: it is a project hosted by our gerrit server, review.openstack.org. Depending on your CI tooling the tooling will talk to it over https or ssh | 20:38 |
| clarkb | martinkennelly: are you using Zuul or something else? | 20:38 |
| openstackgerrit | Merged openstack-infra/puppet-elastic_recheck master: Update elastic-recheck jobs_re config https://review.openstack.org/628669 | 20:39 |
| martinkennelly | clarkb: Jenkins. I see. I see. Think its clicking with me now. | 20:39 |
| clarkb | martinkennelly: with jenkins you'll configure the gerrit plugin to talk to our gerrit and listen for events from the sandbox repo | 20:39 |
| *** bdodd has quit IRC | 20:40 | |
| martinkennelly | clarkb: Yes, thats what I am configuring. I am just unsure how to link it to the ci sandbox. I have no trouble doing it with normal gerrit on review.openstack.org | 20:40 |
| clarkb | martinkennelly: it should be the same, our sandbox repo is just lik eevery othe rrepo except tha tanyone can vote on it to show people how that works | 20:41 |
| martinkennelly | clarkb: I understand now. You have just made that connection with me. Thank you so much for your time. | 20:41 |
| clarkb | no problem | 20:42 |
| clarkb | the goal with that is its a plcae you can hook up to that looks identical to the real repos, make sure everything works then switch the config over | 20:42 |
| martinkennelly | clarkb: yes yes :) and I can post test patches to this sandbox to trigger it off. | 20:42 |
| clarkb | exactly | 20:43 |
| martinkennelly | clarkb: have a nice day :) | 20:43 |
| corvus | clarkb: yes accessbot/meetbot changes should be fine to aprv | 20:49 |
| corvus | clarkb, fungi: i'll start working on moving zuul-ci.org over; we don't need to update glue records, just ns records and possible the zsk as fungi mentioned (i'll double check that) | 20:50 |
| fungi | oh, right, no glue because the nameservers aren't in the zuul-ci.org zone | 20:50 |
| fungi | just need to update ns records at the registrar (as well as in the zone we're serving, though those should be doable asynchronously) and also maybe the ds | 20:51 |
| mordred | corvus, clarkb: you might also have opinions on https://review.openstack.org/#/c/511843 and on which way we might want to go with that | 20:51 |
| *** jtomasek has quit IRC | 20:51 | |
| clarkb | oh right | 20:51 |
| corvus | mordred: ack; will look as soon as i check on the ns stuff | 20:52 |
| fungi | depending on the registrar, they may want to see the ns records in the zone changed first, but doubtful in this case | 20:52 |
| clarkb | mordred: I'm lacking the context to know what the options are there? | 20:53 |
| openstackgerrit | James E. Blair proposed openstack-infra/zone-zuul-ci.org master: Move ns records to opendev https://review.openstack.org/628680 | 20:53 |
| clarkb | many roles or one? | 20:53 |
| mordred | clarkb: sorry - there's a comment on the change- the other option is https://review.openstack.org/#/c/583346/ - which is to make three different roles | 20:53 |
| clarkb | when debugging and trying to understand things I tend to find grouping things into larger roles to be easier | 20:54 |
| clarkb | I'd probably go with one role over 3 for this for that reason | 20:54 |
| openstackgerrit | James E. Blair proposed openstack-infra/zone-zuul-ci.org master: Move ns records to opendev https://review.openstack.org/628680 | 20:55 |
| openstackgerrit | Merged openstack-infra/project-config master: Add #opendev to accessbot https://review.openstack.org/628664 | 20:56 |
| mordred | clarkb: cool. well, https://review.openstack.org/#/c/511843/ is ready for review/landing then :) | 20:57 |
| openstackgerrit | Merged openstack-infra/zone-zuul-ci.org master: Move ns records to opendev https://review.openstack.org/628680 | 20:58 |
| corvus | fungi: i believe the same zsk is in use on both sets of servers and are both signed by the same ksk, so i don't think the ds record needs updating with the registrar. did you see something different? | 21:03 |
| fungi | corvus: ahh, no i hadn't looked. i thought i remembered you creating a new one when bootstrapping adns1.opendev.org but double-checking now | 21:03 |
| corvus | fungi: (we did make a new ksk/zsk for the opendev.org zone itself, so it doesn't share a key with zuul-ci.org) | 21:03 |
| fungi | oh, right. that's what i was thinking of. it's tied to the zone not the master nameserver | 21:04 |
| corvus | ok, so i think we're on the same page then. we shouldn't need to do anything other than change the ns records (in dns and with the registrar) | 21:05 |
| fungi | confirmed, the contents of all files in /etc/bind/keys/zuul-ci.org/ on both servers have matching checksums | 21:06 |
| corvus | #status log updated zuul-ci.org domain registration to use ns[12].opendev.org as nameservers | 21:07 |
| openstackstatus | corvus: finished logging | 21:07 |
| corvus | okay, so sometime in the next day or so all of the respective rube goldberg machines should have updated and it'll be moved :) | 21:08 |
| clarkb | and then we can delete old servers next week | 21:08 |
| clarkb | \o/ | 21:08 |
| fungi | and yes, the change to the zones is approved now. i'll give the osf lot a heads up that it can be changed on the zuulci.org domain as well if they can convince the registrar | 21:08 |
| fungi | though i'll probably wait until it's working for zuul-ci.org first | 21:09 |
| clarkb | oh are those separate? | 21:09 |
| clarkb | hrm maybe not quite so quick to deleting old servers | 21:09 |
| fungi | yeah, the osf registered zuulci.org through csc, over concerns that users don't know how to type hyphens or tend to assume they're optional | 21:09 |
| fungi | but it's still delegated to our nameservers | 21:10 |
| corvus | fungi: probably a good idea to submit the request after zuul-ci.org is confirmed working; clarkb: after that though, i vote we don't wait more than a day; i'm not going to lose sleep if zuulci.org doesn't work. | 21:10 |
| mordred | I don't know what people have-against hyphens | 21:10 |
| anteaya | it is the horizontalness of it all | 21:10 |
| fungi | if only rfc 883 had included | instead of - | 21:12 |
| corvus | huzzah! i am a rook contributor! https://github.com/rook/rook/pull/2450 :) | 21:12 |
| fungi | congrats! | 21:12 |
| fungi | rapid turn-around | 21:13 |
| clarkb | mordred: I've +2'd the output dir collection change but left a comment for a followup thing | 21:14 |
| corvus | mordred, clarkb: i was just looking at that and wanted to refresh my memory about that -- what does/will happen with the stuff in those 3 dirs? | 21:15 |
| clarkb | corvus: they get copied into executor.log_root/docs /logs /artifacts | 21:15 |
| clarkb | corvus: then our existing log publishing will copy from that location out | 21:15 |
| corvus | right -- what's the plan there? | 21:15 |
| clarkb | (multinode jobs have the dirs prefixed by the hostname) | 21:15 |
| clarkb | corvus: I think we add it to our base job, notify people that it can be used in this way then let them update jobs as appropriate? maybe we push to devtsack/tempest an update as an example? | 21:16 |
| mordred | corvus: https://review.openstack.org/#/c/511853/5 and https://review.openstack.org/#/c/511858/4 have the changes to do thigns with them | 21:16 |
| corvus | yeah those 2 changes are the question i was trying to ask :) | 21:17 |
| mordred | yah - then once the base job will publish the thigns in those changes, we can let people know and they can start deleting custom fetching/uploading code | 21:17 |
| corvus | in particular, the current plan is basically about structured uploading to the log server, and not necessarily (at this point) anything about publishing docs to afs or tarballs to tarballs | 21:18 |
| corvus | which i think is *great* because these 3 changes, plus the promote work i'm doing, will get us to a really good place there | 21:19 |
| mordred | yeah. the stuff that's written just gets us to log uploading | 21:19 |
| corvus | so i think the story about publishing docs/tarballs should, in the future, basically be "use the promote pipeline to fetch previously uploaded logs/docs/artifacts" from the logserver and publish them in the right place. | 21:19 |
| mordred | yup | 21:19 |
| fungi | so the artifacts in that scenario are uploaded to the logserver by jobs run in the gate pipeline? | 21:20 |
| corvus | mordred: 511843 +3 -- though i agree with clark's doc++ comment | 21:20 |
| mordred | corvus: yah - I do too - followup coming | 21:21 |
| corvus | fungi: yep | 21:21 |
| fungi | and then the promote pipeline jobs grab the gate pipeline artifacts? | 21:21 |
| fungi | makes sense | 21:21 |
| corvus | fungi: yep | 21:21 |
| corvus | fungi: zuul now has a concept of structured data for artifacts, so the promote jobs will be able to query zuul to find out where to get their artifacts | 21:21 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Combine artifact URLs with log_url if empty https://review.openstack.org/628068 | 21:21 |
| fungi | since we'll only trigger promote if the gate pipeline results in a merge (so all voting jobs succeed) | 21:22 |
| corvus | fungi, clarkb, mordred: ^ though i need that change to move forward | 21:22 |
| corvus | fungi: yep | 21:22 |
| corvus | er, let me write more in the commit message | 21:22 |
| fungi | i guess for promote we should avoid jobs which overwrite the same published artifacts (e.g., documentation) since they might race? | 21:23 |
| corvus | fungi: promote can be supercedent | 21:23 |
| fungi | as long as we don't need it to run jobs for every merge | 21:24 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Add longer description to fetch-output https://review.openstack.org/628683 | 21:24 |
| *** eernst has quit IRC | 21:25 | |
| mordred | clarkb, corvus: ^^ | 21:25 |
| fungi | i guess that's the trade-off. there will be jobs we want run independently for every change which merges, and other jobs we want run for the most recent merge but it's okay if several roll up together in a short period of time | 21:25 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Combine artifact URLs with log_url if empty https://review.openstack.org/628068 | 21:25 |
| corvus | now with actual commit message ^ | 21:26 |
| *** rlandy|rover has quit IRC | 21:26 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Combine artifact URLs with log_url if relative https://review.openstack.org/628068 | 21:26 |
| mordred | corvus: SO ... | 21:26 |
| corvus | now with sensible commit message ^ | 21:27 |
| corvus | 4 patchets, all commit message changes. it's friday. | 21:27 |
| clarkb | is that why everything is ewird today? | 21:27 |
| fungi | oh, wait, friday is today? | 21:27 |
| * fungi 's sense of time is entirely screwed up | 21:28 | |
| clarkb | I keep reminding myself "puppet-4 changes" | 21:28 |
| clarkb | and somehow I am getting things done, but I also haveto do administrivia paperwork things, but maybe its easier to do that later :) | 21:28 |
| mordred | corvus: you can remove a chunk of that and just urljoin all the time... | 21:28 |
| *** tomaw_ has joined #openstack-infra | 21:29 | |
| corvus | mordred: oh ok. i'll try that, and i'll also add a test | 21:29 |
| mordred | corvus: http://paste.openstack.org/show/739943/ | 21:29 |
| *** tomaw has quit IRC | 21:30 | |
| mordred | corvus: I learned **ALL** about this dealing with catalog urls, version discovery urls, relative paths - and openstack services that serve broken base urls in their discovery docs | 21:30 |
| mordred | I wish I new much less | 21:30 |
| corvus | mordred: should i keep the urljoin in the exception handler? or does it never fail? | 21:31 |
| mordred | I don't believe it ever fails | 21:31 |
| mordred | I mean, unless you passed it a non-string | 21:31 |
| *** tomaw_ is now known as tomaw | 21:32 | |
| corvus | that *should* be validated | 21:32 |
| corvus | but i'll leave it just in case | 21:32 |
| mordred | corvus: main key - make sure the log url has a trailing slash - that way 'foo/bar', '/foo/bar' and 'https://somewhere.else.io' will all override or append as you'd expect them to | 21:33 |
| clarkb | git review struggles with ^ | 21:33 |
| clarkb | mordred: I thought urljoin always rooted things though | 21:34 |
| clarkb | ah it depends on that trailing / as you say | 21:36 |
| clarkb | if oyu odn't have it on the url side it roots oetherwise its appens | 21:36 |
| mordred | yeah | 21:36 |
| mordred | http://paste.openstack.org/show/739944/ might be a clearer example | 21:37 |
| *** dave-mccowan has quit IRC | 21:42 | |
| *** bobh_ has quit IRC | 21:47 | |
| *** bobh has joined #openstack-infra | 21:49 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Combine artifact URLs with log_url if relative https://review.openstack.org/628068 | 21:50 |
| corvus | okay, that's way more complete; thanks mordred :) | 21:50 |
| *** smarcet has joined #openstack-infra | 21:51 | |
| clarkb | logan-: I see build_hostids in elasticsearch now. thanks! | 21:51 |
| clarkb | mriedem: your config update for elastic-recheck watch bot seems to have applied about 20 minutes ago | 21:51 |
| mordred | corvus: yay! | 21:53 |
| mordred | corvus: oh no - now there's more lines to review. what was I thinking? | 21:54 |
| *** bobh has quit IRC | 21:54 | |
| corvus | but i totally removed one | 21:54 |
| mriedem | clarkb: ok | 21:57 |
| mriedem | i'm out next week, | 21:58 |
| mriedem | so not sure i'll get to benefit until i'm back | 21:58 |
| mordred | clarkb: can you see what failed here: http://logs.openstack.org/43/511843/4/gate/openstack-zuul-jobs-linters/01ae832/job-output.txt.gz ? | 21:58 |
| clarkb | corvus: left a note about your docs example (its path is not relative) | 21:59 |
| *** xek has joined #openstack-infra | 21:59 | |
| mordred | clarkb: or did ansible-lint just now make a new release? | 21:59 |
| clarkb | mordred: that looks like ansible lint >= 4.0.0 | 22:00 |
| clarkb | mordred: not just now but semi recently yes | 22:00 |
| mordred | yup. jeez | 22:00 |
| mordred | shall I submit a cap patch? | 22:00 |
| clarkb | I think that is what was done elsewhere | 22:00 |
| *** boden has quit IRC | 22:01 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Combine artifact URLs with log_url if relative https://review.openstack.org/628068 | 22:01 |
| clarkb | mordred: it is also affecting system-config too if you want to fix that repo while you are at it | 22:01 |
| corvus | clarkb: fixed; mordred re+2 pls? | 22:01 |
| clarkb | I'm guessing some transitive dep updated their ansible lint dep? | 22:02 |
| clarkb | actually I have a pin proposed already fo rsystem-cofnig? | 22:02 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Add role to fetch output from nodes https://review.openstack.org/511843 | 22:02 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Pin ansible-lint to < 4 https://review.openstack.org/628692 | 22:02 |
| clarkb | mordred: https://review.openstack.org/#/c/625999/ if you want to +3 that one | 22:02 |
| corvus | mordred: i think you need to rebase 692 | 22:02 |
| mordred | clarkb: +A | 22:03 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Pin ansible-lint to < 4 https://review.openstack.org/628692 | 22:03 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Add role to fetch output from nodes https://review.openstack.org/511843 | 22:03 |
| mordred | corvus, clarkb: ^^ rebased and stuff - I also squashed the readme fix since it's a respin | 22:04 |
| *** trown is now known as trown|outtypewww | 22:04 | |
| *** jcoufal has quit IRC | 22:10 | |
| corvus | fungi, mordred: https://review.openstack.org/628665 is ready for +3 (accessbot has run) | 22:14 |
| openstackgerrit | Merged openstack-infra/system-config master: Cap ansible-lint at < 4.0.0 https://review.openstack.org/625999 | 22:20 |
| corvus | infra-root: i'd like to restart gerrit now and see if gitea replication survives now that we've increased the lb timeout | 22:24 |
| mordred | corvus: I would also like for you to do that | 22:25 |
| logan- | clarkb: awesome, looks great. thanks | 22:25 |
| corvus | #status log restarted gerrit to restart gitea replication thread | 22:26 |
| openstackstatus | corvus: finished logging | 22:26 |
| *** whoami-rajat has quit IRC | 22:37 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add #opendev to meetbot https://review.openstack.org/628665 | 22:38 |
| *** jaosorior has quit IRC | 22:42 | |
| *** smarcet has quit IRC | 22:49 | |
| *** jbadiapa has joined #openstack-infra | 22:50 | |
| *** bobh has joined #openstack-infra | 22:52 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Pin ansible-lint to < 4 https://review.openstack.org/628692 | 22:55 |
| *** hwoarang has quit IRC | 23:03 | |
| *** hwoarang has joined #openstack-infra | 23:04 | |
| corvus | mnaser: i'm not sure how, but i seem to have caused a server to go into error state by asking for a hard reboot | 23:07 |
| corvus | mnaser: | fault | {u'message': u"Domain not found: no domain with matching uuid '6913a24e-8da5-4805-b075-4d539ccda138' (instance-0007c6c6)", u'code': 500, u'created': u'2019-01-04T23:06:12Z'} | | 23:08 |
| *** xek has quit IRC | 23:09 | |
| clarkb | corvus: I think that means nova couldn't find the VM in libvirt to restart it | 23:09 |
| clarkb | (which is odd) | 23:09 |
| clarkb | especially if the instance is running | 23:09 |
| corvus | yeah, it was running. it just hung at the end of the soft reboot process | 23:10 |
| mordred | corvus: I'm impressed | 23:11 |
| *** rascasoft has quit IRC | 23:12 | |
| clarkb | I've reapproved the fetch output role | 23:12 |
| corvus | this is at the end of a long series of disappointments: k8s container wouldn't terminate; docker container process is zombied; reboot the system; soft reboot the instance; hard reboot the system | 23:12 |
| openstackgerrit | Merged openstack-infra/system-config master: Turn on future parser for all nodepool launchers https://review.openstack.org/616289 | 23:14 |
| openstackgerrit | Merged openstack-infra/system-config master: Turn on future parser for one nodepool builder https://review.openstack.org/616290 | 23:14 |
| clarkb | woo got ^ moving again after the system-config ansible-lint pin | 23:15 |
| mordred | corvus: perhaps that series of disappointments is all caused by something going south on the hypervisor host - so it's really just all one disappointment with many faces | 23:15 |
| corvus | mordred: i hope i haven't ruined mnaser's friday | 23:15 |
| mnaser | corvus: mordred no idea how that’s even possible. I will dig in 20 minutes | 23:17 |
| mordred | corvus: look, he's excited about the possibility of joyous debugging you've provided him | 23:17 |
| *** bdodd has joined #openstack-infra | 23:19 | |
| *** bobh has quit IRC | 23:21 | |
| *** Adri2000 has quit IRC | 23:22 | |
| *** Adri2000 has joined #openstack-infra | 23:25 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Add fetch-output to base-test https://review.openstack.org/511850 | 23:30 |
| *** bobh has joined #openstack-infra | 23:36 | |
| *** owalsh_ has joined #openstack-infra | 23:38 | |
| *** owalsh has quit IRC | 23:41 | |
| *** openstack has joined #openstack-infra | 23:44 | |
| *** ChanServ sets mode: +o openstack | 23:44 | |
| clarkb | hogepodge: who is a good person to point out http://logs.openstack.org/11/627411/7/gate/openstack-tox-py35/db0d0d5/job-output.txt#_2019-01-04_22_25_48_666928 that test bug to in airship? | 23:45 |
| clarkb | I suppose I could just file a bug | 23:45 |
| clarkb | https://storyboard.openstack.org/#!/story/2004703 if anyone is curious | 23:54 |
| *** bobh has quit IRC | 23:58 | |
| hogepodge | clarkb: I'll ping the team. The #airshipit channel is a good place for this | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!