| *** HenryG has joined #openstack-infra | 00:15 | |
| *** rfolco|rover|off has quit IRC | 00:25 | |
| *** tetsuro has joined #openstack-infra | 00:30 | |
| *** ociuhandu has joined #openstack-infra | 00:36 | |
| *** tetsuro_ has joined #openstack-infra | 00:40 | |
| *** Goneri has quit IRC | 00:41 | |
| *** tetsuro has quit IRC | 00:43 | |
| *** ociuhandu has quit IRC | 00:44 | |
| *** redrobot has quit IRC | 01:34 | |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: bindep: use virtualenv_command from ensure-pip https://review.opendev.org/727561 | 01:37 |
|---|---|---|
| *** tetsuro has joined #openstack-infra | 01:44 | |
| *** tetsuro_ has quit IRC | 01:47 | |
| *** viks____ has joined #openstack-infra | 01:49 | |
| *** lbragstad_ is now known as lbragstad | 01:52 | |
| *** rlandy has quit IRC | 01:58 | |
| *** tetsuro_ has joined #openstack-infra | 02:12 | |
| *** tetsuro has quit IRC | 02:15 | |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: Unset bindep_command to exercise install paths https://review.opendev.org/727593 | 02:31 |
| *** kevinz has joined #openstack-infra | 02:35 | |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: Unset bindep_command to exercise install paths https://review.opendev.org/727593 | 02:39 |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: Unset bindep_command to exercise install paths https://review.opendev.org/727593 | 02:44 |
| openstackgerrit | Ghanshyam Mann proposed openstack/os-testr master: Fix hacking min version to 3.0.1 https://review.opendev.org/727618 | 02:52 |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: Unset bindep_command to exercise install paths https://review.opendev.org/727593 | 02:54 |
| openstackgerrit | Ghanshyam Mann proposed openstack/os-performance-tools master: Fix hacking min version to 3.0.1 https://review.opendev.org/727620 | 02:55 |
| *** tetsuro has joined #openstack-infra | 03:06 | |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: Unset bindep_command to exercise install paths https://review.opendev.org/727593 | 03:08 |
| *** tetsuro_ has quit IRC | 03:09 | |
| *** lbragstad has quit IRC | 03:18 | |
| *** gyee has quit IRC | 03:18 | |
| *** dustinc has quit IRC | 03:34 | |
| *** psachin has joined #openstack-infra | 03:37 | |
| *** cdearborn has quit IRC | 03:53 | |
| *** tetsuro_ has joined #openstack-infra | 04:06 | |
| *** tetsuro has quit IRC | 04:09 | |
| *** ykarel|away is now known as ykarel | 04:26 | |
| *** evrardjp has quit IRC | 04:36 | |
| *** evrardjp has joined #openstack-infra | 04:36 | |
| *** ociuhandu has joined #openstack-infra | 04:42 | |
| *** dmellado has quit IRC | 04:45 | |
| *** ociuhandu has quit IRC | 04:49 | |
| *** psachin has quit IRC | 04:56 | |
| *** mtreinish has quit IRC | 05:01 | |
| *** dklyle has quit IRC | 05:01 | |
| *** dpawlik has quit IRC | 05:04 | |
| *** mihalis68_ has quit IRC | 05:16 | |
| *** mtreinish has joined #openstack-infra | 05:34 | |
| *** udesale has joined #openstack-infra | 05:36 | |
| *** tetsuro has joined #openstack-infra | 05:43 | |
| *** tetsuro_ has quit IRC | 05:47 | |
| *** ysandeep|away is now known as ysandeep | 05:50 | |
| *** lmiccini has joined #openstack-infra | 05:55 | |
| *** ccamacho has joined #openstack-infra | 06:00 | |
| *** tetsuro_ has joined #openstack-infra | 06:23 | |
| *** nightmare_unreal has joined #openstack-infra | 06:23 | |
| *** dpawlik has joined #openstack-infra | 06:25 | |
| *** tetsuro has quit IRC | 06:26 | |
| *** xek_ has joined #openstack-infra | 06:26 | |
| *** xek has quit IRC | 06:29 | |
| *** tetsuro has joined #openstack-infra | 06:29 | |
| *** ociuhandu has joined #openstack-infra | 06:30 | |
| *** tetsuro_ has quit IRC | 06:32 | |
| *** lpetrut has joined #openstack-infra | 06:42 | |
| *** slaweq has joined #openstack-infra | 06:51 | |
| *** onovy has quit IRC | 06:53 | |
| *** onovy has joined #openstack-infra | 06:59 | |
| *** Lucas_Gray has joined #openstack-infra | 07:03 | |
| *** jcapitao has joined #openstack-infra | 07:08 | |
| *** apetrich has quit IRC | 07:11 | |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: Policy rule for ownership between remote and executor https://review.opendev.org/724855 | 07:20 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: Add linting rule to enforce no-same-owner policy https://review.opendev.org/727642 | 07:20 |
| *** yolanda has joined #openstack-infra | 07:21 | |
| *** Lucas_Gray has quit IRC | 07:22 | |
| *** tetsuro_ has joined #openstack-infra | 07:24 | |
| *** tetsuro has quit IRC | 07:27 | |
| *** ociuhandu has quit IRC | 07:27 | |
| *** ociuhandu_ has joined #openstack-infra | 07:27 | |
| *** xek__ has joined #openstack-infra | 07:28 | |
| *** rpittau|afk is now known as rpittau | 07:29 | |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: Add linting rule to enforce no-same-owner policy https://review.opendev.org/727642 | 07:29 |
| *** xek_ has quit IRC | 07:30 | |
| *** amoralej|off is now known as amoralej | 07:34 | |
| *** tosky has joined #openstack-infra | 07:35 | |
| *** aedc has quit IRC | 07:37 | |
| *** dmellado has joined #openstack-infra | 07:37 | |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: Policy rule for ownership between remote and executor https://review.opendev.org/724855 | 07:41 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: Add linting rule to enforce no-same-owner policy https://review.opendev.org/727642 | 07:41 |
| *** ralonsoh has joined #openstack-infra | 07:41 | |
| *** apetrich has joined #openstack-infra | 07:45 | |
| *** apetrich has quit IRC | 07:45 | |
| *** apetrich has joined #openstack-infra | 07:46 | |
| *** aedc has joined #openstack-infra | 07:47 | |
| *** jpena|off is now known as jpena | 07:56 | |
| *** pkopec has joined #openstack-infra | 08:00 | |
| *** gfidente has joined #openstack-infra | 08:02 | |
| openstackgerrit | Sorin Sbarnea (zbr) proposed zuul/zuul-jobs master: bindep: Add missing virtualenv and fixed repo install https://review.opendev.org/693637 | 08:08 |
| *** jcapitao has quit IRC | 08:27 | |
| *** ykarel is now known as ykarel|lunch | 08:30 | |
| *** jcapitao has joined #openstack-infra | 08:30 | |
| *** jcapitao has quit IRC | 08:38 | |
| *** jcapitao has joined #openstack-infra | 08:42 | |
| openstackgerrit | Thierry Carrez proposed openstack/openstack-zuul-jobs master: Also trigger Github mirroring on tags https://review.opendev.org/727665 | 08:47 |
| *** tetsuro_ has quit IRC | 08:47 | |
| *** jcapitao has quit IRC | 08:48 | |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: Also trigger Github mirroring on tags https://review.opendev.org/727665 | 08:48 |
| AJaeger | config-core, I'll +2A for the release quickly ^ | 08:49 |
| ttx | AJaeger: agree it would be great to have it in /before/ releasing so many tags | 08:49 |
| ttx | I /think/ it should be safe | 08:49 |
| *** jcapitao has joined #openstack-infra | 08:50 | |
| *** jcapitao has quit IRC | 08:50 | |
| *** jcapitao has joined #openstack-infra | 08:50 | |
| ttx | I'll try it before pushing the big red button | 08:50 |
| smcginnis | ttx: Do one more release-test release quick before things kick off? | 08:51 |
| ttx | yes | 08:51 |
| ttx | on it | 08:51 |
| *** Tengu has quit IRC | 08:57 | |
| *** Tengu has joined #openstack-infra | 08:58 | |
| openstackgerrit | Andreas Jaeger proposed zuul/zuul-jobs master: Fix nodejs-npm-run-test https://review.opendev.org/727670 | 09:03 |
| ttx | We are missing the latest tag on GitHub for adjutant 0.5.1, rally-openstack 2.0.0 and hacking 3.0.1. Those will be updated at the next merge. Keystone 15.0.1 and 16.0.1 were pushed due to a recent merge, and are ok. | 09:03 |
| *** tetsuro has joined #openstack-infra | 09:07 | |
| openstackgerrit | Merged openstack/openstack-zuul-jobs master: Also trigger Github mirroring on tags https://review.opendev.org/727665 | 09:08 |
| *** dtantsur|afk is now known as dtantsur | 09:13 | |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: Don't require tox_envlist https://review.opendev.org/726829 | 09:14 |
| openstackgerrit | Merged zuul/zuul-jobs master: Fix nodejs-npm-run-test https://review.opendev.org/727670 | 09:20 |
| *** tetsuro has quit IRC | 09:23 | |
| *** ykarel|lunch is now known as ykarel | 09:24 | |
| *** ociuhandu_ has quit IRC | 10:01 | |
| *** ociuhandu has joined #openstack-infra | 10:02 | |
| *** ysandeep is now known as ysandeep|lunch | 10:09 | |
| *** derekh has joined #openstack-infra | 10:20 | |
| *** dpawlik has quit IRC | 10:21 | |
| *** udesale_ has joined #openstack-infra | 10:36 | |
| *** udesale has quit IRC | 10:38 | |
| *** ysandeep|lunch is now known as ysandeep | 10:55 | |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: intercept-job -- self-service SSH access https://review.opendev.org/679306 | 10:56 |
| *** jcapitao is now known as jcapitao_lunch | 10:57 | |
| *** rpittau is now known as rpittau|bbl | 11:04 | |
| *** alejandrosg has quit IRC | 11:16 | |
| *** alejandrosg has joined #openstack-infra | 11:17 | |
| *** ociuhandu has quit IRC | 11:23 | |
| *** dpawlik has joined #openstack-infra | 11:32 | |
| *** jpena is now known as jpena|lunch | 11:34 | |
| *** yamamoto has joined #openstack-infra | 11:43 | |
| *** yamamoto has quit IRC | 11:43 | |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: Add linting rule to enforce no-same-owner policy https://review.opendev.org/727642 | 11:45 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: fetch-coverage-output: do not synchronize owner https://review.opendev.org/727717 | 11:45 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: fetch-javascript-content-tarball: do not synchronize owner https://review.opendev.org/727718 | 11:45 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: fetch-javascript-output: do not synchronize owner https://review.opendev.org/727719 | 11:45 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: fetch-javascript-tarball: do not synchronize owner https://review.opendev.org/727720 | 11:45 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: fetch-markdownlint: do not synchronize owner https://review.opendev.org/727721 | 11:45 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: fetch-phoronix-results: do not synchronize owner https://review.opendev.org/727722 | 11:45 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: fetch-puppet-module-output: do not synchronize owner https://review.opendev.org/727723 | 11:45 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: fetch-python-sdist-output: do not synchronize owner https://review.opendev.org/727724 | 11:45 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: fetch-sphinx-output: do not synchronize owner https://review.opendev.org/727725 | 11:45 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: fetch-sphinx-tarball: do not synchronize owner https://review.opendev.org/727726 | 11:45 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: fetch-tox-output: do not synchronize owner https://review.opendev.org/727727 | 11:45 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: fetch-translation-output: do not synchronize owner https://review.opendev.org/727728 | 11:45 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: fetch-subunit-output: do not synchronize owner https://review.opendev.org/727729 | 11:45 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: prepare-workspace: do not synchronize owner https://review.opendev.org/727730 | 11:45 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: publish-artifacts-to-fileserver: do not synchronize owner https://review.opendev.org/727731 | 11:45 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: upload-logs: do not synchronize owner https://review.opendev.org/727732 | 11:45 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: Add linting rule to enforce no-same-owner policy https://review.opendev.org/727642 | 11:49 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: tarball-post.yaml: do not synchronize owner https://review.opendev.org/727735 | 11:49 |
| *** amoralej is now known as amoralej|lunch | 11:58 | |
| *** ociuhandu has joined #openstack-infra | 12:04 | |
| *** rfolco has joined #openstack-infra | 12:04 | |
| *** rfolco is now known as rfolco|rover | 12:05 | |
| *** rlandy has joined #openstack-infra | 12:09 | |
| *** ociuhandu has quit IRC | 12:10 | |
| *** ociuhandu has joined #openstack-infra | 12:10 | |
| *** sshnaidm|afk is now known as sshnaidm | 12:16 | |
| *** ysandeep is now known as ysandeep|brb | 12:17 | |
| *** rpittau|bbl is now known as rpittau | 12:19 | |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: Drop support for ansible 2.7 https://review.opendev.org/727410 | 12:20 |
| *** jcapitao_lunch is now known as jcapitao | 12:22 | |
| *** tkajinam has quit IRC | 12:24 | |
| *** ociuhandu has quit IRC | 12:27 | |
| *** ociuhandu has joined #openstack-infra | 12:28 | |
| *** jpena|lunch is now known as jpena | 12:40 | |
| *** lpetrut has quit IRC | 12:46 | |
| *** ianychoi has quit IRC | 12:55 | |
| *** amoralej|lunch is now known as amoralej | 13:00 | |
| *** mihalis68_ has joined #openstack-infra | 13:02 | |
| *** gshippey has joined #openstack-infra | 13:03 | |
| *** ykarel is now known as ykarel|afk | 13:09 | |
| *** alejandrosg has quit IRC | 13:11 | |
| *** alejandrosg has joined #openstack-infra | 13:11 | |
| *** lbragstad has joined #openstack-infra | 13:23 | |
| *** ociuhandu has quit IRC | 13:24 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-jobs master: fetch-sphinx-tarball: introduce zuul_use_fetch_output https://review.opendev.org/681870 | 13:28 |
| *** fresta_ has quit IRC | 13:29 | |
| *** fresta has joined #openstack-infra | 13:30 | |
| *** redrobot has joined #openstack-infra | 13:34 | |
| *** lajoskatona has joined #openstack-infra | 13:48 | |
| lajoskatona | Hi, I have a question for networking-bgpvpn jobs | 13:48 |
| lajoskatona | the situation is that the stable/ussuri py36/py37 jobs are failing due the fact that it is using for these jobs old neutron (example: https://354bc8764de216064b0f-738e7a066c935883ae419d9b7cfe468f.ssl.cf1.rackcdn.com/periodic-stable/opendev.org/openstack/networking-bgpvpn/stable/ussuri/openstack-tox-py37/3f75673/job-output.txt ) | 13:49 |
| lajoskatona | but the same jobs are passing if I upload a patch to stable/ussuri | 13:49 |
| lajoskatona | I am wondering if it is possible to extend a template definition or similar, as we have the template reference in zuul.yaml: https://opendev.org/openstack/networking-bgpvpn/src/branch/master/.zuul.yaml#L60 | 13:50 |
| AJaeger | lajoskatona: sure, you can do the same in the periodic-stable pipeline | 13:51 |
| lajoskatona | AJaeger: Hi, could you please point to an example? quick googling and Hounding was not enough :-) | 13:52 |
| AJaeger | lajoskatona: the template is defiend in openstack-zuul-jobs, so copy over the bits you need and expand like you do already | 13:54 |
| *** __ministry1 has joined #openstack-infra | 13:54 | |
| lajoskatona | AJaeger: ok thanks, I check it | 13:55 |
| *** __ministry1 has quit IRC | 13:55 | |
| AJaeger | lajoskatona: compare openstack-python3-victoria-jobs-neutron in openstack-zuul-jobs and your lines 79 etc - and do the same | 13:55 |
| *** ykarel|afk is now known as ykarel | 13:59 | |
| *** jamesdenton has quit IRC | 14:03 | |
| *** ociuhandu has joined #openstack-infra | 14:05 | |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Combine javascript deployment and deployment-tarball jobs https://review.opendev.org/727370 | 14:08 |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Set node_version in js-build base job https://review.opendev.org/727774 | 14:08 |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Combine javascript deployment and deployment-tarball jobs https://review.opendev.org/727370 | 14:09 |
| *** ociuhandu has quit IRC | 14:11 | |
| *** jamesdenton has joined #openstack-infra | 14:11 | |
| *** ociuhandu has joined #openstack-infra | 14:12 | |
| *** ociuhandu has quit IRC | 14:18 | |
| *** Goneri has joined #openstack-infra | 14:20 | |
| *** lpetrut has joined #openstack-infra | 14:29 | |
| sshnaidm | is http://mirror.ord.rax.opendev.org:8082/v2/ dead? | 14:32 |
| sshnaidm | infra-root ^ | 14:33 |
| *** ociuhandu has joined #openstack-infra | 14:33 | |
| fungi | sshnaidm: looks like it says that whatever it's trying to proxy to is dead | 14:35 |
| fungi | and now i'm getting a different response from it | 14:36 |
| fungi | temporary dockerhub outage? | 14:36 |
| fungi | or intermittent connectivity issue to dockerhub maybe | 14:36 |
| sshnaidm | fungi, seems like happened in all last jobs | 14:37 |
| sshnaidm | docker doesn't report something yet https://status.docker.com/ | 14:37 |
| *** ysandeep|brb is now known as ysandeep | 14:38 | |
| *** ociuhandu has quit IRC | 14:39 | |
| *** mmethot has quit IRC | 14:39 | |
| fungi | they likely won't report it right away, and if it was brief they may not mention it at all | 14:40 |
| *** mmethot has joined #openstack-infra | 14:40 | |
| fungi | seems to be intermittent, i'm back to getting a proxy error for it again | 14:40 |
| *** lajoskatona has left #openstack-infra | 14:41 | |
| *** dklyle has joined #openstack-infra | 14:42 | |
| clarkb | sshnaidm: fungi https://registry-1.docker.io/ is what we proxy / on port 8082 to | 14:48 |
| clarkb | that seems reliable from here | 14:52 |
| clarkb | so ya I'm thinking maybe something to do with the remote node? /me tries to reproduce with curl | 14:52 |
| fungi | yeah, they could be having cdn-endpoint-specific issues | 14:56 |
| clarkb | I've not been able to reproduce it with curl but apache seems to flip flop pretty regularly | 14:58 |
| clarkb | makes me wonder if a particular apache backend has some dns record cached that it shouldn't | 14:58 |
| clarkb | (or similar) | 14:58 |
| *** ociuhandu has joined #openstack-infra | 15:01 | |
| *** priteau has joined #openstack-infra | 15:01 | |
| clarkb | http://mirror.ord.rax.opendev.org:8081/registry-1.docker/ shows the same sort of flip flopping (a sanity check it isn't that specific vhost) | 15:01 |
| clarkb | registry-1.docker.io resolves to a number of round robin'd A records. I'm going to try and s_client each of them | 15:02 |
| clarkb | they have a 60 second ttl too which would explain the flip flopping | 15:02 |
| clarkb | s_client reports verification ok for all the ips with that servername set | 15:06 |
| *** lpetrut has quit IRC | 15:08 | |
| clarkb | fungi: I think I may just restart apache there to rule out caches in apache (maybe they took out a bad backend but we are still talking to it?) | 15:08 |
| fungi | entirely possible, you could also note the ages of the oldest workers before you restart | 15:08 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: Install correct node version in ensure-yarn https://review.opendev.org/727789 | 15:09 |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Pass node_version explicitly https://review.opendev.org/727774 | 15:11 |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Combine javascript deployment and deployment-tarball jobs https://review.opendev.org/727370 | 15:11 |
| clarkb | the oldest is from april 14 | 15:11 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: Install correct node version in ensure-yarn https://review.opendev.org/727789 | 15:13 |
| clarkb | restarted and after ~20 refreshes I haven't hit the error yet | 15:14 |
| clarkb | sshnaidm: ^ fyi | 15:14 |
| sshnaidm | rfolco|rover, ^^ | 15:14 |
| sshnaidm | clarkb, thanks | 15:14 |
| rfolco|rover | sshnaidm, ack thanks | 15:16 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: Install correct node version in ensure-yarn https://review.opendev.org/727789 | 15:16 |
| fungi | the stale apache worker process clinging to an old dns rr entry theory is a good one, in that case | 15:16 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: Install correct node version in ensure-yarn https://review.opendev.org/727789 | 15:17 |
| clarkb | fungi: we've noticed similar too where stale processes don't reload rotate out and cause us to trip ssl cert check alarms | 15:19 |
| clarkb | really probably should set up a global 8k connection limit or similar on apache | 15:19 |
| fungi | right, before we switched to graceful reloads i expect we had frequent enough config changes going on which masked the problem | 15:20 |
| *** lmiccini has quit IRC | 15:21 | |
| *** rlandy_ has joined #openstack-infra | 15:23 | |
| *** rlandy has quit IRC | 15:25 | |
| *** rlandy_ is now known as rlandy | 15:25 | |
| *** sshnaidm is now known as sshnaidm|afk | 15:28 | |
| *** zxiiro has joined #openstack-infra | 15:32 | |
| *** ykarel is now known as ykarel|away | 15:35 | |
| *** dtantsur is now known as dtantsur|afk | 15:36 | |
| *** jcapitao has quit IRC | 15:41 | |
| *** jamesdenton has quit IRC | 15:42 | |
| *** gyee has joined #openstack-infra | 15:43 | |
| *** jamesdenton has joined #openstack-infra | 15:46 | |
| openstackgerrit | Merged openstack/project-config master: Retire x/pbrx - part 1 https://review.opendev.org/726461 | 16:11 |
| openstackgerrit | Merged openstack/project-config master: Remove noop-jobs from oslo.tools https://review.opendev.org/727178 | 16:11 |
| openstackgerrit | Merged openstack/project-config master: Revert "Temporarily disable OVH" https://review.opendev.org/727393 | 16:11 |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Set node_version in js-build base job https://review.opendev.org/727774 | 16:13 |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Combine javascript deployment and deployment-tarball jobs https://review.opendev.org/727370 | 16:13 |
| *** jamesdenton has quit IRC | 16:16 | |
| *** rf0lc0 has joined #openstack-infra | 16:20 | |
| *** __ministry1 has joined #openstack-infra | 16:21 | |
| *** rpittau is now known as rpittau|afk | 16:21 | |
| *** gary_perkins has quit IRC | 16:23 | |
| *** ramishra has quit IRC | 16:23 | |
| *** rfolco|rover has quit IRC | 16:23 | |
| *** gary_perkins has joined #openstack-infra | 16:24 | |
| *** jackedin has joined #openstack-infra | 16:26 | |
| *** __ministry1 has quit IRC | 16:28 | |
| *** udesale_ has quit IRC | 16:33 | |
| *** evrardjp has quit IRC | 16:36 | |
| *** evrardjp has joined #openstack-infra | 16:36 | |
| *** jamesdenton has joined #openstack-infra | 16:38 | |
| openstackgerrit | Merged zuul/zuul-jobs master: Set node_version in js-build base job https://review.opendev.org/727774 | 16:40 |
| *** ociuhandu has quit IRC | 16:42 | |
| *** ociuhandu has joined #openstack-infra | 16:43 | |
| *** ociuhandu has quit IRC | 16:43 | |
| *** ociuhandu has joined #openstack-infra | 16:43 | |
| openstackgerrit | Andreas Jaeger proposed zuul/zuul-jobs master: Combine javascript deployment and deployment-tarball jobs https://review.opendev.org/727370 | 16:48 |
| weshay|ruck | lots of jobs failing on a rax mirror fyi.. not sure what you guys can do.. if anything | 16:53 |
| weshay|ruck | http://cacti.openstack.org/cacti/graph_view.php | 16:53 |
| weshay|ruck | monitoring isn't showing much | 16:54 |
| clarkb | weshay|ruck: is this the mirror.ord.rax.opendev.org dockerhub issue that sshnaidm|afk pointed out earlier? if so I think we corrected it but hard to confirm when its a third party service having ssl issues | 16:54 |
| clarkb | weshay|ruck: if you have errors after 15:15 UTC linking to those would be helpful (we restarted apache at ~15:14 to clear old stale apache worker processes) | 16:55 |
| fungi | weshay|ruck: any more hits with logged timestamps after 15:23 utc? | 16:55 |
| weshay|ruck | https://zuul.opendev.org/t/openstack/build/f7bf170d7313474296f09b7f53a7343e/log/job-output.txt#1235 | 16:55 |
| fungi | er, clarkb probably has a more precise timestamp there | 16:56 |
| fungi | i was just going by our status log | 16:56 |
| weshay|ruck | but .. so it goes w/ mirrors.. sounds like we're aware of the issue | 16:56 |
| *** rf0lc0 is now known as rfolco|rover | 16:56 | |
| fungi | 14:51:38 < 15:15 | 16:57 |
| fungi | so presumably still fixed | 16:57 |
| clarkb | thats a different url and backend though | 16:57 |
| fungi | quay? | 16:58 |
| clarkb | note that isn't a mirror, it is a caching proxy | 16:58 |
| clarkb | fungi: I think that is rdo packages not docker stuff | 16:58 |
| clarkb | and that url is a 404 through the proxy | 16:58 |
| clarkb | now to check direct access | 16:58 |
| fungi | oh, i guess we do proxy to the rdo package site | 16:59 |
| *** jackedin has quit IRC | 16:59 | |
| clarkb | weshay|ruck: fungi https://trunk.rdoproject.org/fedora28-master/current-tripleo/delorean.repo that is a 404 too so not something on our side | 16:59 |
| *** jackedin_ has joined #openstack-infra | 16:59 | |
| clarkb | we're properly proxying the 404 there | 16:59 |
| *** piotrowskim has quit IRC | 17:00 | |
| weshay|ruck | ah.. look at that.. thank you :) | 17:01 |
| clarkb | the first thing to check is almost always "does the target backend produce a different result" | 17:01 |
| *** piotrowskim has joined #openstack-infra | 17:01 | |
| *** derekh has quit IRC | 17:03 | |
| clarkb | weshay|ruck: looking at that backend it appears t ohave centos things but not fedora? | 17:06 |
| clarkb | weshay|ruck: not sure how it is organized beyond that though | 17:06 |
| weshay|ruck | ya... just saw that as well.. taking care of it | 17:06 |
| *** jpena is now known as jpena|off | 17:11 | |
| *** ysandeep is now known as ysandeep|away | 17:12 | |
| *** calebb has joined #openstack-infra | 17:13 | |
| *** apevec has joined #openstack-infra | 17:14 | |
| *** jamesdenton has quit IRC | 17:15 | |
| apevec | hi, where is the list of infra cores maintained, I'm now getting dms@redhat.com emails since dmsimard left RHT, so I might get something I'm not supposed to see :) | 17:15 |
| dmsimard | apevec: I should have been removed | 17:16 |
| dmsimard | are those the cron emails ? | 17:16 |
| apevec | lemme look | 17:16 |
| clarkb | its possible some server isn't successfully ansibling | 17:16 |
| clarkb | if you can give us more info we can track that down | 17:16 |
| dmsimard | iirc mordred removed me from private vars on bridge | 17:17 |
| clarkb | dmsimard: just confirmed you aren't in that list | 17:17 |
| clarkb | so if I had a guess its some server that is either in emergency.yaml so not getting updated or is failing ansible and bailing out before exim configs are written | 17:18 |
| *** amoralej is now known as amoralej|off | 17:18 | |
| apevec | here's one: From: storyboard@storyboard.openstack.org | 17:20 |
| apevec | To: dms@redhat.com | 17:20 |
| apevec | earlier today | 17:20 |
| dmsimard | eh, storyboard subscriptions perhaps | 17:20 |
| dmsimard | let me try and see if I can unsub from that | 17:20 |
| clarkb | ah ya that could be it | 17:21 |
| clarkb | you are not in the root alias for storyboard.o.o though | 17:21 |
| *** ociuhandu has quit IRC | 17:21 | |
| clarkb | fwiw we do have a number of servers in the emergency file and now that the openstack release is done we should tryand remove as much as possible from there | 17:22 |
| *** nightmare_unreal has quit IRC | 17:22 | |
| dmsimard | I was subscribed (or "starred") to zuul/zuul but I'm not sure if I'm subscribed elsewhere :p | 17:22 |
| apevec | and there was one yesterday: From: Cron Daemon <root@storyboard-dev01.opendev.org> | 17:22 |
| apevec | To: root@storyboard-dev01.opendev.org | 17:22 |
| apevec | and looks like everything else stopped in the meantime | 17:23 |
| *** ociuhandu has joined #openstack-infra | 17:23 | |
| apevec | cron email had Delivered-To: dmsimard@redhat.com | 17:24 |
| *** gfidente is now known as gfidente|afk | 17:27 | |
| clarkb | apevec: thanks for looking. The storyboard-dev server is in emergency.yaml so not getting updated by ansible right now. We can update the aliases file by hand or maybe if fungi says it is ok remove that server from emergency.yaml | 17:28 |
| *** hemna_ has quit IRC | 17:29 | |
| clarkb | (I'll take it as a todo to try and minimze the contents of that emergency file) | 17:29 |
| *** hemna has joined #openstack-infra | 17:29 | |
| *** ociuhandu has quit IRC | 17:33 | |
| fungi | that server's in the emergency disable list while i test out swift credentials for artifacts | 17:34 |
| fungi | which i need to get around to doing | 17:34 |
| fungi | basically trying to keep ansible from reverting the creds in the config | 17:34 |
| *** ociuhandu has joined #openstack-infra | 17:34 | |
| *** dpawlik has quit IRC | 17:36 | |
| *** viks____ has quit IRC | 17:37 | |
| *** priteau has quit IRC | 17:38 | |
| *** ociuhandu has quit IRC | 17:40 | |
| fungi | i've manually deleted his address from the root alias on that server for now | 17:41 |
| *** ralonsoh has quit IRC | 17:44 | |
| *** jamesdenton has joined #openstack-infra | 17:57 | |
| *** jamesdenton has quit IRC | 18:04 | |
| *** jamesdenton has joined #openstack-infra | 18:09 | |
| *** rlandy is now known as rlandy|lunch | 18:10 | |
| *** hashar has joined #openstack-infra | 18:21 | |
| *** jackedin_ has quit IRC | 18:29 | |
| openstackgerrit | James E. Blair proposed zuul/zuul-jobs master: Add zuul_work_dir to run-test-command https://review.opendev.org/727855 | 18:31 |
| *** ociuhandu has joined #openstack-infra | 18:32 | |
| openstackgerrit | Merged zuul/zuul-jobs master: ansible-lint-rules: Fix bad path and filename https://review.opendev.org/726449 | 18:33 |
| *** rlandy|lunch is now known as rlandy | 18:39 | |
| *** ociuhandu has quit IRC | 18:40 | |
| *** ociuhandu has joined #openstack-infra | 18:40 | |
| *** jamesdenton has quit IRC | 18:53 | |
| *** jamesdenton has joined #openstack-infra | 18:57 | |
| openstackgerrit | Merged zuul/zuul-jobs master: fetch-sphinx-output: introduce zuul_use_fetch_output https://review.opendev.org/681905 | 18:59 |
| openstackgerrit | Merged zuul/zuul-jobs master: fetch-sphinx-tarball: add missing zuul_success default https://review.opendev.org/727272 | 19:04 |
| openstackgerrit | Merged zuul/zuul-jobs master: Add zuul_work_dir to run-test-command https://review.opendev.org/727855 | 19:04 |
| *** ociuhandu has quit IRC | 19:27 | |
| *** ociuhandu has joined #openstack-infra | 19:28 | |
| *** dklyle has quit IRC | 19:38 | |
| *** ociuhandu has quit IRC | 19:39 | |
| *** ociuhandu has joined #openstack-infra | 19:40 | |
| *** ociuhandu has quit IRC | 19:40 | |
| *** ociuhandu has joined #openstack-infra | 19:40 | |
| *** dklyle has joined #openstack-infra | 19:46 | |
| *** hashar has quit IRC | 19:48 | |
| *** ociuhandu has quit IRC | 19:51 | |
| *** ociuhandu has joined #openstack-infra | 19:52 | |
| *** ociuhandu has quit IRC | 19:52 | |
| *** ociuhandu has joined #openstack-infra | 19:52 | |
| *** dciabrin has quit IRC | 19:55 | |
| *** dciabrin has joined #openstack-infra | 19:55 | |
| *** ociuhandu has quit IRC | 20:02 | |
| *** ociuhandu has joined #openstack-infra | 20:03 | |
| *** ociuhandu has quit IRC | 20:03 | |
| *** ociuhandu has joined #openstack-infra | 20:03 | |
| *** ociuhandu has quit IRC | 20:14 | |
| *** ociuhandu has joined #openstack-infra | 20:15 | |
| *** jamesdenton has quit IRC | 20:16 | |
| openstackgerrit | Clark Boylan proposed openstack/project-config master: Use infra-root-keys-2020-05-13 in nodepool https://review.opendev.org/727867 | 20:20 |
| *** gshippey has quit IRC | 20:24 | |
| *** ociuhandu has quit IRC | 20:26 | |
| *** ociuhandu has joined #openstack-infra | 20:27 | |
| *** ociuhandu has quit IRC | 20:27 | |
| *** ociuhandu has joined #openstack-infra | 20:27 | |
| openstackgerrit | Oleksandr Kozachenko proposed zuul/zuul-jobs master: Patch CoreDNS corefile The minikube v1.10.x is appending the systemd-resolved conf always. So to workaround this problem, do a patch after deployment. https://review.opendev.org/727868 | 20:30 |
| *** jamesdenton has joined #openstack-infra | 20:30 | |
| *** gfidente|afk has quit IRC | 20:30 | |
| *** ociuhandu has quit IRC | 20:37 | |
| *** ociuhandu has joined #openstack-infra | 20:38 | |
| *** ociuhandu has quit IRC | 20:38 | |
| *** ociuhandu has joined #openstack-infra | 20:39 | |
| openstackgerrit | Oleksandr Kozachenko proposed zuul/zuul-jobs master: Patch CoreDNS corefile The minikube v1.10.x is appending the systemd-resolved conf always. So to workaround this problem, do a patch after deployment. https://review.opendev.org/727868 | 20:39 |
| openstackgerrit | Oleksandr Kozachenko proposed zuul/zuul-jobs master: Patch CoreDNS corefile The minikube v1.10.x is appending the systemd-resolved conf always. So to workaround this problem, do a patch after deployment. https://review.opendev.org/727868 | 20:42 |
| *** ociuhandu has quit IRC | 20:49 | |
| *** ociuhandu has joined #openstack-infra | 20:50 | |
| *** ociuhandu has quit IRC | 20:50 | |
| *** ociuhandu has joined #openstack-infra | 20:50 | |
| *** ccamacho has quit IRC | 20:54 | |
| openstackgerrit | Oleksandr Kozachenko proposed zuul/zuul-jobs master: Patch CoreDNS corefile https://review.opendev.org/727868 | 20:58 |
| *** ociuhandu has quit IRC | 21:01 | |
| *** ociuhandu has joined #openstack-infra | 21:02 | |
| openstackgerrit | Oleksandr Kozachenko proposed zuul/zuul-jobs master: Patch CoreDNS corefile https://review.opendev.org/727868 | 21:05 |
| *** ociuhandu has quit IRC | 21:07 | |
| *** rfolco|rover has quit IRC | 21:16 | |
| *** jamesdenton has quit IRC | 21:30 | |
| *** slaweq has quit IRC | 21:57 | |
| *** Goneri has quit IRC | 22:07 | |
| *** slaweq has joined #openstack-infra | 22:09 | |
| *** Goneri has joined #openstack-infra | 22:10 | |
| openstackgerrit | Oleksandr Kozachenko proposed zuul/zuul-jobs master: Patch CoreDNS corefile https://review.opendev.org/727868 | 22:13 |
| *** slaweq has quit IRC | 22:13 | |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: Unset bindep_command to exercise install paths https://review.opendev.org/727593 | 22:17 |
| *** slaweq has joined #openstack-infra | 22:24 | |
| *** slaweq has quit IRC | 22:28 | |
| *** tkajinam has joined #openstack-infra | 22:46 | |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: Unset bindep_command to exercise install paths https://review.opendev.org/727593 | 22:57 |
| *** hongbin has joined #openstack-infra | 23:05 | |
| *** tosky has quit IRC | 23:06 | |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: Unset bindep_command to exercise install paths https://review.opendev.org/727593 | 23:06 |
| *** apevec has quit IRC | 23:06 | |
| *** threestrands has joined #openstack-infra | 23:29 | |
| *** rcernin has quit IRC | 23:31 | |
| *** rcernin has joined #openstack-infra | 23:32 | |
| *** rlandy has quit IRC | 23:33 | |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: Switch nodepool builders to opendev.org mirrors https://review.opendev.org/690757 | 23:34 |
| *** ociuhandu has joined #openstack-infra | 23:36 | |
| *** ociuhandu has quit IRC | 23:52 | |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: [wip] Unset bindep_command to exercise install paths https://review.opendev.org/727593 | 23:56 |
| *** xek has joined #openstack-infra | 23:58 | |
| *** xek__ has quit IRC | 23:59 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!