| openstackgerrit | Ian Wienand proposed opendev/system-config master: Remove files02.openstack.org and related puppet https://review.opendev.org/709639 | 00:05 |
|---|---|---|
| *** mattw4 has quit IRC | 00:07 | |
| *** jamesmcarthur has joined #openstack-infra | 00:10 | |
| *** artom has joined #openstack-infra | 00:11 | |
| *** jamesmcarthur has quit IRC | 00:13 | |
| *** gfidente has quit IRC | 00:14 | |
| *** jamesmcarthur has joined #openstack-infra | 00:14 | |
| ianw | clarkb: actually i don't know how per-project ssh keys passed me by. i think we could run the extant script from a job, just for the POC | 00:16 |
| clarkb | ianw: thats a good point. Then we can sort out goaccess later | 00:17 |
| clarkb | (that said goaccess shouldn't be that tricky) | 00:17 |
| ianw | i can rework what i put up | 00:18 |
| *** auristor has joined #openstack-infra | 00:19 | |
| *** jamesmcarthur has quit IRC | 00:19 | |
| clarkb | ianw: I was thinking that we may just be fine with publishing the reports to the swift logs containers | 00:22 |
| clarkb | ianw: then you can use zuul's build list to pull up recent builds | 00:23 |
| clarkb | and get the logs via that mechanism. As a halfway step before we have dedicated location for them | 00:23 |
| ianw | yeah, i feel like that's enough history | 00:23 |
| *** auristor has quit IRC | 00:23 | |
| ianw | is it http://zuul.openstack.org/api/tenant/opendev/project-ssh-key/system-config.pub ? | 00:23 |
| clarkb | ianw: its based on where the job is defined. So if you define and run the job out of opendev/system-config I believe that is roughly correct | 00:24 |
| clarkb | though it isn't loading for me. | 00:24 |
| *** icarusfactor has joined #openstack-infra | 00:24 | |
| * clarkb tries wget | 00:24 | |
| ianw | i guess tenant is openstack? | 00:25 |
| clarkb | ianw: http://zuul.opendev.org/api/tenant/openstack/project-ssh-key/opendev/system-config.pub | 00:26 |
| clarkb | the openstack.org domain whitelabels the tenant so its something like api/project-ssh-key/opendev/system-config.pub but the above link should work (it works from here) | 00:27 |
| *** factor has quit IRC | 00:27 | |
| ianw | yep, cool | 00:27 |
| clarkb | also maybe use https instead of http | 00:27 |
| ianw | i guess we just add that to root's authorized keys | 00:28 |
| *** tetsuro has joined #openstack-infra | 00:29 | |
| clarkb | ya, then in your job you can do an empty nodeset and addhost from the executor | 00:29 |
| clarkb | in theory that should all work now | 00:29 |
| clarkb | though our test job for it kind of died on the vine | 00:29 |
| *** jamesmcarthur has joined #openstack-infra | 00:44 | |
| *** jamesmcarthur has quit IRC | 00:50 | |
| *** auristor has joined #openstack-infra | 00:54 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: static: add a periodic 404 checker https://review.opendev.org/709382 | 00:55 |
| ianw | clarkb: ^ i feel like that is way too small and easy | 00:56 |
| *** smarcet has joined #openstack-infra | 00:59 | |
| *** auristor has quit IRC | 00:59 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: [wip] static: provide git services https://review.opendev.org/709403 | 01:08 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Remove files02.openstack.org and related puppet https://review.opendev.org/709639 | 01:08 |
| *** jamesmcarthur has joined #openstack-infra | 01:14 | |
| *** nicolasbock has quit IRC | 01:15 | |
| *** smarcet has left #openstack-infra | 01:22 | |
| *** yamamoto has joined #openstack-infra | 01:31 | |
| *** rlandy has quit IRC | 01:34 | |
| *** Lucas_Gray has joined #openstack-infra | 01:37 | |
| *** jamesmcarthur has quit IRC | 01:38 | |
| *** jamesmcarthur has joined #openstack-infra | 01:38 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: [wip] static: provide git services https://review.opendev.org/709403 | 01:40 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Remove files02.openstack.org and related puppet https://review.opendev.org/709639 | 01:40 |
| *** matt_kosut has joined #openstack-infra | 01:41 | |
| *** jamesmcarthur has quit IRC | 01:44 | |
| *** matt_kosut has quit IRC | 01:46 | |
| *** smarcet has joined #openstack-infra | 01:48 | |
| *** smarcet has left #openstack-infra | 01:49 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: static: add a periodic 404 checker https://review.opendev.org/709382 | 01:57 |
| *** ijw has quit IRC | 01:59 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: [wip] static: provide git services https://review.opendev.org/709403 | 02:08 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Remove files02.openstack.org and related puppet https://review.opendev.org/709639 | 02:08 |
| *** jamesmcarthur has joined #openstack-infra | 02:08 | |
| *** jamesmcarthur has quit IRC | 02:15 | |
| *** Lucas_Gray has quit IRC | 02:30 | |
| *** Lucas_Gray has joined #openstack-infra | 02:40 | |
| *** jamesmcarthur has joined #openstack-infra | 02:41 | |
| *** artom has quit IRC | 02:42 | |
| *** jamesmcarthur has quit IRC | 02:47 | |
| *** Lucas_Gray has quit IRC | 02:50 | |
| *** rfolco has quit IRC | 02:53 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: [wip] static: provide git services https://review.opendev.org/709403 | 03:11 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Remove files02.openstack.org and related puppet https://review.opendev.org/709639 | 03:11 |
| *** apetrich has quit IRC | 03:12 | |
| *** jamesmcarthur has joined #openstack-infra | 03:23 | |
| *** gyee has quit IRC | 03:25 | |
| *** gyee has joined #openstack-infra | 03:27 | |
| *** psachin has joined #openstack-infra | 03:28 | |
| *** jamesmcarthur has quit IRC | 03:29 | |
| *** psachin has quit IRC | 03:33 | |
| *** psachin has joined #openstack-infra | 03:35 | |
| *** jamesmcarthur has joined #openstack-infra | 03:36 | |
| *** jamesmcarthur has quit IRC | 03:41 | |
| *** jamesmcarthur has joined #openstack-infra | 03:44 | |
| *** clarkb has quit IRC | 03:45 | |
| *** clarkb has joined #openstack-infra | 03:45 | |
| *** HenryG has quit IRC | 03:46 | |
| *** diablo_rojo__ has joined #openstack-infra | 03:49 | |
| *** timburke has quit IRC | 03:50 | |
| *** onovy has quit IRC | 03:51 | |
| *** smarcet_ has joined #openstack-infra | 03:51 | |
| *** jamesmcarthur_ has joined #openstack-infra | 03:51 | |
| *** bdodd has quit IRC | 03:52 | |
| *** jamesmcarthur has quit IRC | 03:52 | |
| *** diablo_rojo has quit IRC | 03:52 | |
| *** ikla has quit IRC | 03:52 | |
| *** onovy has joined #openstack-infra | 03:53 | |
| *** timburke has joined #openstack-infra | 03:53 | |
| *** bdodd has joined #openstack-infra | 03:54 | |
| *** lbragstad_ has joined #openstack-infra | 04:08 | |
| *** lbragstad has quit IRC | 04:10 | |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder master: Allow installing glean from package https://review.opendev.org/557867 | 04:20 |
| *** udesale has joined #openstack-infra | 04:23 | |
| *** ykarel|away is now known as ykarel | 04:26 | |
| *** imacdonn has quit IRC | 04:47 | |
| *** imacdonn has joined #openstack-infra | 04:47 | |
| *** lbragstad_ has quit IRC | 04:59 | |
| *** jamesmcarthur_ has quit IRC | 05:01 | |
| *** jamesmcarthur has joined #openstack-infra | 05:03 | |
| *** jamesmcarthur has quit IRC | 05:08 | |
| *** larainema has joined #openstack-infra | 05:18 | |
| AJaeger | ianw: governance.o.o looks fine - both on files and published. thanks | 05:20 |
| *** matt_kosut has joined #openstack-infra | 05:21 | |
| *** gagehugo has quit IRC | 05:27 | |
| *** gagehugo has joined #openstack-infra | 05:27 | |
| *** jamesmcarthur has joined #openstack-infra | 05:32 | |
| *** evrardjp has quit IRC | 05:34 | |
| *** evrardjp has joined #openstack-infra | 05:35 | |
| *** kozhukalov has quit IRC | 05:38 | |
| *** tetsuro has quit IRC | 05:39 | |
| openstackgerrit | Merged zuul/zuul-helm master: Drop args from container spec https://review.opendev.org/709424 | 05:39 |
| *** kozhukalov has joined #openstack-infra | 05:39 | |
| *** tetsuro has joined #openstack-infra | 05:40 | |
| *** tetsuro has quit IRC | 05:48 | |
| *** gyee has quit IRC | 05:49 | |
| *** tetsuro has joined #openstack-infra | 06:03 | |
| *** raukadah is now known as chandankumar | 06:03 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: [wip] static: provide git services https://review.opendev.org/709403 | 06:08 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Remove files02.openstack.org and related puppet https://review.opendev.org/709639 | 06:08 |
| *** jamesmcarthur has quit IRC | 06:12 | |
| *** lmiccini has joined #openstack-infra | 06:12 | |
| *** strigazi has quit IRC | 06:16 | |
| *** strigazi has joined #openstack-infra | 06:18 | |
| *** kozhukalov has quit IRC | 06:18 | |
| *** matt_kosut has quit IRC | 06:20 | |
| *** matt_kosut has joined #openstack-infra | 06:42 | |
| *** AJaeger has quit IRC | 06:44 | |
| *** roman_g has quit IRC | 06:48 | |
| *** AJaeger has joined #openstack-infra | 06:51 | |
| *** dpawlik has joined #openstack-infra | 07:26 | |
| *** admcleod has quit IRC | 07:27 | |
| *** piotrowskim has joined #openstack-infra | 07:32 | |
| *** jamesmcarthur has joined #openstack-infra | 07:41 | |
| *** ykarel is now known as ykarel|lunch | 07:41 | |
| *** ociuhandu has joined #openstack-infra | 07:43 | |
| *** psachin has quit IRC | 07:47 | |
| *** jamesmcarthur has quit IRC | 07:47 | |
| *** pgaxatte has joined #openstack-infra | 07:47 | |
| *** slaweq_ has joined #openstack-infra | 07:50 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: [wip] static: provide git services https://review.opendev.org/709403 | 07:51 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Remove files02.openstack.org and related puppet https://review.opendev.org/709639 | 07:51 |
| *** admcleod has joined #openstack-infra | 07:54 | |
| *** pkopec has joined #openstack-infra | 08:00 | |
| *** tosky has joined #openstack-infra | 08:04 | |
| *** ccamacho has joined #openstack-infra | 08:05 | |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: Scheduler test app manager https://review.opendev.org/708812 | 08:05 |
| *** auristor has joined #openstack-infra | 08:13 | |
| *** dchen has quit IRC | 08:16 | |
| *** yamamoto has quit IRC | 08:16 | |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: Use scheduler factory consistently in tests https://review.opendev.org/709542 | 08:17 |
| *** auristor has quit IRC | 08:17 | |
| evrardjp | thanks ianw and AJaeger | 08:20 |
| *** auristor has joined #openstack-infra | 08:20 | |
| *** yamamoto has joined #openstack-infra | 08:21 | |
| *** tkajinam has quit IRC | 08:22 | |
| *** tesseract has joined #openstack-infra | 08:23 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: static: provide git services https://review.opendev.org/709403 | 08:26 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Remove files02.openstack.org and related puppet https://review.opendev.org/709639 | 08:26 |
| *** ykarel|lunch is now known as ykarel | 08:28 | |
| *** Tengu has quit IRC | 08:30 | |
| *** Tengu has joined #openstack-infra | 08:32 | |
| *** slaweq_ has quit IRC | 08:32 | |
| *** jpena|off is now known as jpena | 08:32 | |
| *** amoralej|off is now known as amoralej | 08:33 | |
| *** ysastri has joined #openstack-infra | 08:36 | |
| *** ociuhandu has quit IRC | 08:37 | |
| *** ociuhandu has joined #openstack-infra | 08:37 | |
| *** ralonsoh has joined #openstack-infra | 08:40 | |
| *** smarcet_ has quit IRC | 08:41 | |
| *** ociuhandu has quit IRC | 08:43 | |
| *** tkajinam has joined #openstack-infra | 08:43 | |
| AJaeger | evrardjp: could you have a look at https://review.opendev.org/#/c/709299/ , please? | 08:43 |
| *** jamesmcarthur has joined #openstack-infra | 08:43 | |
| evrardjp | sure thing | 08:44 |
| AJaeger | thanks | 08:45 |
| evrardjp | oh I love it already | 08:46 |
| evrardjp | testing it locally just to make sure, but I love it! :) | 08:46 |
| *** jcapitao has joined #openstack-infra | 08:47 | |
| *** jamesmcarthur has quit IRC | 08:48 | |
| *** iurygregory has joined #openstack-infra | 08:50 | |
| AJaeger | ;) | 08:50 |
| *** ociuhandu has joined #openstack-infra | 08:52 | |
| *** gfidente has joined #openstack-infra | 08:52 | |
| jrosser | good morning! I have a change here which does not seem to trigger a job running https://review.opendev.org/#/c/709515/ | 08:59 |
| *** priteau has joined #openstack-infra | 09:00 | |
| *** yolanda__ is now known as yolanda | 09:00 | |
| dpawlik | Hi, does someone of you maintain log server in OS? | 09:00 |
| *** ociuhandu has quit IRC | 09:01 | |
| *** ociuhandu has joined #openstack-infra | 09:02 | |
| *** lucasagomes has joined #openstack-infra | 09:03 | |
| *** udesale has quit IRC | 09:07 | |
| *** ociuhandu has quit IRC | 09:08 | |
| *** apetrich has joined #openstack-infra | 09:22 | |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: Use scheduler manager consistently in tests https://review.opendev.org/709542 | 09:24 |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: Refactor executor_client in tests https://review.opendev.org/709672 | 09:24 |
| *** jamesmcarthur has joined #openstack-infra | 09:29 | |
| *** ociuhandu has joined #openstack-infra | 09:31 | |
| AJaeger | jrosser: where are the jobs configured for that repo? | 09:32 |
| AJaeger | jrosser: oh, found it | 09:33 |
| *** jamesmcarthur has quit IRC | 09:33 | |
| jrosser | AJaeger: if you look at the topic on that change the proposal bot made dozens of patches yesterday, and oddly that one out of all of them does not run a job | 09:34 |
| AJaeger | jrosser: looks like all your jobs have bindep.txt in their irrelevant files | 09:34 |
| jrosser | hmm | 09:34 |
| *** ociuhandu_ has joined #openstack-infra | 09:35 | |
| AJaeger | jrosser: I thought docs jobs would always run - strange... | 09:35 |
| *** ociuhandu has quit IRC | 09:36 | |
| AJaeger | jrosser: hope somebody else can help later | 09:36 |
| jrosser | ok thanks, i think that over the weekend when zuul had an issue there was a problem with our rabbitmq_server repo - was wondering if that was co-incidence or not | 09:37 |
| *** ociuhandu has joined #openstack-infra | 09:38 | |
| *** ociuhandu_ has quit IRC | 09:40 | |
| *** ociuhandu_ has joined #openstack-infra | 09:43 | |
| AJaeger | jrosser: it might be, so let's see wait for an infra-root to dig into this... | 09:44 |
| *** ociuhandu has quit IRC | 09:47 | |
| AJaeger | jrosser: today https://review.opendev.org/#/admin/projects/?filter=rabbit returns the repo, it didn't do it over the weekend | 09:47 |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: Refactor merge_client in tests https://review.opendev.org/709676 | 09:47 |
| jrosser | AJaeger: thats good - thanks for taking a look | 09:48 |
| frickler | jrosser: AJaeger: I'm seeing no errors for that patch, just zuul deciding that there are no jobs to run http://paste.openstack.org/show/789964/ . you may want to test with a dummy patch | 09:48 |
| AJaeger | frickler: strange, the docs job should run, there are no irrelevant files on that one. Yeah, a dummy patch might help, perhaps iwth "debug: true" added to check queue... | 09:51 |
| AJaeger | jrosser: let me push something quickly... | 09:51 |
| AJaeger | frickler, jrosser, https://review.opendev.org/709678 | 09:53 |
| AJaeger | frickler: still no reports, even after adding noop ;( | 09:57 |
| *** yamamoto has quit IRC | 09:58 | |
| AJaeger | jrosser: that smells fishy, something looks broken to me. Let's investigate with the US experts if frickler has no additional ideas | 09:59 |
| jrosser | sure, thanks for sanity checking for me - something certainly is odd there | 09:59 |
| *** yamamoto has joined #openstack-infra | 10:09 | |
| *** mgoddard has joined #openstack-infra | 10:26 | |
| mgoddard | Hi, I'm having issues running kolla CentOS 8 deploy jobs on the stable/train branch | 10:27 |
| mgoddard | The jobs all fail after ~20 seconds | 10:27 |
| mgoddard | https://zuul.opendev.org/t/openstack/build/ad9665089fb54ef99a2cad7d5ca79c36 | 10:27 |
| mgoddard | Patch adding them is https://review.opendev.org/#/c/709536/1 | 10:28 |
| AJaeger | mgoddard: "recheck" and try to follow the log file via http://zuul.opendev.org/t/openstack/status/change/709536,1 - click on one of the jobs once it's started | 10:38 |
| AJaeger | mgoddard: I hope that gives an insight on what fails... | 10:39 |
| *** ociuhandu_ has quit IRC | 10:42 | |
| *** priteau has quit IRC | 10:52 | |
| mgoddard | AJaeger: good hint, that helped. Forcing ansible_python_interpreter=python2 isn't going to work on CentOS8 :) | 10:53 |
| openstackgerrit | Sorin Sbarnea proposed zuul/zuul-jobs master: Fix install-docker on centos-8 https://review.opendev.org/709184 | 10:57 |
| openstackgerrit | Sorin Sbarnea proposed zuul/zuul-jobs master: Tests ensure-tox on all-platforms https://review.opendev.org/708642 | 11:00 |
| openstackgerrit | Sorin Sbarnea proposed zuul/zuul-jobs master: Tests bindep role on all-platforms https://review.opendev.org/708704 | 11:01 |
| openstackgerrit | Sorin Sbarnea proposed zuul/zuul-jobs master: Tests bindep role on all-platforms https://review.opendev.org/708704 | 11:02 |
| openstackgerrit | Sorin Sbarnea proposed zuul/zuul-jobs master: Tests ensure-tox on all-platforms https://review.opendev.org/708642 | 11:02 |
| *** udesale has joined #openstack-infra | 11:17 | |
| *** yamamoto has quit IRC | 11:20 | |
| *** yamamoto has joined #openstack-infra | 11:22 | |
| *** iurygregory has quit IRC | 11:26 | |
| *** rcernin has quit IRC | 11:37 | |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: Refactor merge_client in tests https://review.opendev.org/709676 | 11:42 |
| *** jamesdenton has quit IRC | 11:45 | |
| *** jamesdenton has joined #openstack-infra | 11:46 | |
| *** nicolasbock has joined #openstack-infra | 11:53 | |
| *** jcapitao is now known as jcapitao_lunch | 11:54 | |
| *** gagehugo has quit IRC | 11:56 | |
| *** rfolco has joined #openstack-infra | 11:58 | |
| *** jpena is now known as jpena|lunch | 12:01 | |
| *** amoralej is now known as amoralej|lunch | 12:01 | |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: Refactor nodepool in tests https://review.opendev.org/709703 | 12:07 |
| *** ysastri has quit IRC | 12:09 | |
| *** AJaeger has quit IRC | 12:12 | |
| *** dave-mccowan has joined #openstack-infra | 12:17 | |
| *** AJaeger has joined #openstack-infra | 12:17 | |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: Refactor zookeeper in tests https://review.opendev.org/709709 | 12:23 |
| *** roman_g has joined #openstack-infra | 12:25 | |
| openstackgerrit | Merged zuul/zuul master: Ensure job.queued is correct after reconfig https://review.opendev.org/709559 | 12:28 |
| *** ykarel is now known as ykarel|afk | 12:29 | |
| *** ociuhandu has joined #openstack-infra | 12:30 | |
| *** tkajinam has quit IRC | 12:30 | |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: WIP: Store unparsed branch config in Zookeeper https://review.opendev.org/705716 | 12:36 |
| jrosser | could i get a hold on job openstack-ansible-deploy-aio_metal-centos-8 on https://review.opendev.org/#/c/689629 | 12:39 |
| *** rosmaita has quit IRC | 12:39 | |
| *** rosmaita has joined #openstack-infra | 12:41 | |
| *** smarcet has joined #openstack-infra | 12:42 | |
| frickler | jrosser: done | 12:44 |
| jrosser | thanks! | 12:45 |
| openstackgerrit | sebastian marcet proposed opendev/system-config master: OpenStackID v3.0.0 https://review.opendev.org/709719 | 12:46 |
| *** ociuhandu has quit IRC | 12:56 | |
| *** sshnaidm is now known as sshnaidm|bbl | 12:59 | |
| *** ykarel|afk is now known as ykarel | 12:59 | |
| *** rlandy has joined #openstack-infra | 13:00 | |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: Consolidate scheduler pause/exit as hibernation https://review.opendev.org/709723 | 13:12 |
| *** jpena|lunch is now known as jpena | 13:15 | |
| *** jcapitao_lunch is now known as jcapitao | 13:15 | |
| *** amoralej|lunch is now known as amoralej | 13:17 | |
| *** jamesmcarthur has joined #openstack-infra | 13:27 | |
| *** rh-jelabarre has joined #openstack-infra | 13:33 | |
| *** nicolasbock has quit IRC | 13:33 | |
| *** nicolasbock has joined #openstack-infra | 13:34 | |
| *** jamesmcarthur has quit IRC | 13:35 | |
| *** nicolasbock has quit IRC | 13:36 | |
| *** yamamoto has quit IRC | 13:36 | |
| *** lbragstad_ has joined #openstack-infra | 13:44 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: config: add tenant.toDict() method and REST endpoint https://review.opendev.org/621344 | 13:49 |
| *** kozhukalov has joined #openstack-infra | 13:50 | |
| *** tkajinam has joined #openstack-infra | 13:53 | |
| *** yamamoto has joined #openstack-infra | 13:58 | |
| *** aaronsheffield has joined #openstack-infra | 14:00 | |
| *** priteau has joined #openstack-infra | 14:00 | |
| *** Lucas_Gray has joined #openstack-infra | 14:04 | |
| *** slaweq_ has joined #openstack-infra | 14:05 | |
| jrosser | frickler: my hold on https://review.opendev.org/#/c/689629 should be ready, http://jrosser.woaf.net/openstack.pub | 14:06 |
| *** Goneri has joined #openstack-infra | 14:24 | |
| *** priteau has quit IRC | 14:27 | |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: Scheduler's pause/resume functionality https://review.opendev.org/709735 | 14:27 |
| *** eharney has joined #openstack-infra | 14:27 | |
| *** Lucas_Gray has quit IRC | 14:39 | |
| *** Lucas_Gray has joined #openstack-infra | 14:41 | |
| fungi | jrosser: AJaeger: the zuul scheduler seems to think there are no relevant jobs for that change... zuul.Pipeline.openstack.check: [e: 669a6e5c73fd4be78b91c21ed4a6a924] No jobs for change <Change 0x7f3026ded518 openstack/openstack-ansible-rabbitmq_server 709515,1> | 14:45 |
| fungi | we'd need to turn on debug in that change to get info on every job it tried to match against and why it decided they didn't fit | 14:46 |
| *** ykarel is now known as ykarel|away | 14:46 | |
| *** dave-mccowan has quit IRC | 14:47 | |
| AJaeger | fungi, I added debug to https://review.opendev.org/#/c/709678/ - still no result | 14:53 |
| AJaeger | so, please check 709687 logs as well - and review my change. | 14:53 |
| AJaeger | Did Zuul forgot about the jobs after the trouble on Saturday? | 14:54 |
| fungi | i suppose it's possible it cached a bad configuration state at some point | 14:54 |
| *** jaosorior has joined #openstack-infra | 14:55 | |
| clarkb | pabelanger points out http://paste.openstack.org/show/789969/. Why is new review dev trying to s end more than 40 emails a day? | 14:56 |
| AJaeger | fungi: yeah, that's what I fear... | 14:57 |
| *** michael-beaver has joined #openstack-infra | 14:57 | |
| AJaeger | any idea how to validate that? | 14:58 |
| *** eharney has quit IRC | 14:59 | |
| clarkb | but that email issue should go away once dns is sorted. mordred fyi | 15:00 |
| *** matt_kosut has quit IRC | 15:01 | |
| clarkb | AJaeger: fungi we could try a tenant full reload | 15:02 |
| fungi | AJaeger: looking through the scheduler debug log entries for 709678,3 i don't see anything different. says there are no jobs for that change in the check pipeline | 15:02 |
| AJaeger | fungi: my change added a noop job! So, that one should be there - could you check my change, please? | 15:02 |
| clarkb | if the mergershave badgit data though we may need to rm the repo on all mergers and executors first | 15:02 |
| fungi | yeah, i guess the scheduler didn't get restarted yesterday with the other seervices | 15:02 |
| fungi | AJaeger: i did check that change, that's the 709678,3 i mentioned above | 15:03 |
| *** eharney has joined #openstack-infra | 15:03 | |
| fungi | it did not register the added noop job | 15:03 |
| AJaeger | fungi: thansk for double checking | 15:04 |
| *** iurygregory has joined #openstack-infra | 15:05 | |
| fungi | so i agree, something seems broken | 15:05 |
| *** sreejithp has joined #openstack-infra | 15:05 | |
| fungi | i'm up for clarkb's suggestion, will give it a shot (i don't think it's seriously disruptive other than to pause the scheduler's queue processing) | 15:06 |
| fungi | the logs say it did a tenant reconfig at 2020-02-25 11:12:40 | 15:07 |
| fungi | clarkb: i guess that's not quite the same? | 15:07 |
| *** ociuhandu has joined #openstack-infra | 15:08 | |
| *** tkajinam has quit IRC | 15:08 | |
| clarkb | ya I think there is incremental (typical) and full | 15:09 |
| fungi | also i guess we don't use the rpc cli for this (or else it's missing from the zuul --help output) | 15:09 |
| clarkb | full is what you get when you restart | 15:09 |
| * fungi rtfms | 15:09 | |
| fungi | ahh, right, it's zuul-scheduler cli not zuul cli | 15:11 |
| fungi | https://zuul-ci.org/docs/zuul/discussion/components.html#reconfiguration | 15:11 |
| smarcet | fungi: morning there is a new version of openstackid to deploy for production https://review.opendev.org/#/c/709719/ | 15:12 |
| smarcet | fungi: could we re enable the puppet agent at production after that patch is approved also ? thx u :) | 15:12 |
| fungi | #status log triggered a zuul-scheduler full-reconfigure on zuul01 to troubleshoot lack of job matches on openstack/openstack-ansible-rabbitmq_server changes | 15:13 |
| openstackstatus | fungi: finished logging | 15:13 |
| fungi | smarcet: sure, looking now | 15:13 |
| AJaeger | fungi, shall I recheck? | 15:14 |
| smarcet | fungi: thx u | 15:14 |
| fungi | AJaeger: just a sec, i need to see if the reconfigure completed | 15:15 |
| fungi | 2020-02-25 15:13:42,810 DEBUG zuul.Scheduler: Processing management event <zuul.scheduler.ReconfigureEvent object at 0x7f2f8ce2ffd0> | 15:15 |
| fungi | i guess we don't log the end of a reconfig, but it looks like it was received anyway, so go ahead and recheck since the reconfig will block queue processing until it's completed anyway | 15:16 |
| corvus | fungi: we log start and stop | 15:16 |
| corvus | fungi: grep for "Full reconfiguration" | 15:17 |
| AJaeger | change is showing up in Zuul dashboard! | 15:18 |
| fungi | aha, thanks! 2020-02-25 15:18:18,776 DEBUG zuul.Scheduler: Reconfiguration complete | 15:19 |
| AJaeger | fungi: both changes show up - so, this has helped. Thanks! | 15:19 |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: Make test setup_config more pure https://review.opendev.org/709084 | 15:19 |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: Scheduler test app manager https://review.opendev.org/708812 | 15:19 |
| corvus | that's the one after "Full reconfiguration complete (duration: %s seconds)" | 15:19 |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: Use scheduler manager consistently in tests https://review.opendev.org/709542 | 15:19 |
| AJaeger | jrosser: FYI, rabbitmy-server should be fine again | 15:20 |
| fungi | ahh, yep | 15:20 |
| fungi | 2020-02-25 15:18:18,771 INFO zuul.Scheduler: Full reconfiguration complete (duration: 275.961 seconds) | 15:20 |
| fungi | so i think that means that we did indeed have bad configuration cached from when that repo was broken | 15:20 |
| jrosser | AJaeger: great | 15:20 |
| jrosser | thanks all for taking a look at that | 15:20 |
| fungi | or at least the full reconfig "shook something loose" | 15:20 |
| corvus | yay, we used full-reconfigure to recover from an inconsistent state! that's one of those "theoretical possibilities" we keep it around for, but i'm not sure if we've really needed to do it until now. :) | 15:21 |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: Refactor executor_client in tests https://review.opendev.org/709672 | 15:22 |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: Refactor merge_client in tests https://review.opendev.org/709676 | 15:22 |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: Refactor nodepool in tests https://review.opendev.org/709703 | 15:22 |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: Refactor zookeeper in tests https://review.opendev.org/709709 | 15:22 |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: Consolidate scheduler pause/exit as hibernation https://review.opendev.org/709723 | 15:22 |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: Scheduler's pause/resume functionality https://review.opendev.org/709735 | 15:22 |
| *** smarcet has quit IRC | 15:22 | |
| fungi | corvus: if only we knew how to reproduce that inconsistent state | 15:22 |
| *** smarcet has joined #openstack-infra | 15:23 | |
| mordred | clarkb: my brain is still waking up - what's the DNS issue? | 15:25 |
| clarkb | mordred: the reverse and forward records for that host don't match up so my email provider limits it to sending 40 emails a day | 15:25 |
| mordred | oh - weird | 15:26 |
| mordred | oh - wait - that's old review-dev | 15:26 |
| *** irclogbot_1 has quit IRC | 15:27 | |
| corvus | so we just need to delete that; we're probably ready for that now? | 15:27 |
| *** irclogbot_0 has joined #openstack-infra | 15:28 | |
| mordred | yeah, I think new review-dev is happy enough - and it's not like old review-dev was super precious anyway | 15:28 |
| clarkb | oh I see its old server because dns moved for new | 15:29 |
| *** smarcet has quit IRC | 15:30 | |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: WIP: Store unparsed branch config in Zookeeper https://review.opendev.org/705716 | 15:30 |
| *** smarcet has joined #openstack-infra | 15:31 | |
| mordred | infra-root: I'm going to delete old review-dev unless someone screams | 15:32 |
| clarkb | mordred: if there is concern we could snapshot it first | 15:32 |
| clarkb | I don't think I'm too concerned | 15:32 |
| mordred | clarkb: I'm not too concerned either | 15:32 |
| *** rfolco has quit IRC | 15:32 | |
| mordred | #status log deleted old review-dev01.openstack.org | 15:35 |
| openstackstatus | mordred: finished logging | 15:35 |
| *** matt_kosut has joined #openstack-infra | 15:36 | |
| *** gagehugo has joined #openstack-infra | 15:37 | |
| *** matt_kosut has quit IRC | 15:40 | |
| jrosser | i have a held node on job openstack-ansible-deploy-aio_metal-centos-8 / https://review.opendev.org/#/c/689629 which should be ready now, here's my key http://jrosser.woaf.net/openstack.pub | 15:41 |
| corvus | jrosser: i can add it | 15:43 |
| clarkb | infra-root docs.opendev.org and review.opendev.org's ssl certs will expire in ~29 days. docs.opendev.org is on ianw's static/files list and should be done real soon now. review.opendev.org likely needs changes to LE. I doubt I'll get to that today, but will try to have that high on my list unless someone else would like to kick the tires on our LE tooling | 15:44 |
| mordred | clarkb: I've already added the patches for review.opendev.org to get the LE certs | 15:44 |
| clarkb | mordred: oh perfect | 15:45 |
| clarkb | high on my list to review then | 15:45 |
| mordred | I'm pretty sure they're landed | 15:45 |
| mordred | one se | 15:45 |
| mordred | sec | 15:45 |
| clarkb | hrm we still have a non LE cert there according to my browser | 15:45 |
| mordred | hrm. nope - not landed | 15:45 |
| mordred | oh - yeah, still definitely have non-LE | 15:45 |
| clarkb | https://review.opendev.org/#/c/709402/1 is the docs.opendev.org change (which is already set up with LE on the new side) | 15:45 |
| mordred | the patch I'm thinking about goes ahead and requests the LE cert | 15:45 |
| corvus | jrosser: ssh root@162.242.237.218 | 15:45 |
| mordred | (part of the ansible/docker work) | 15:46 |
| jrosser | corvus: thanks! | 15:46 |
| clarkb | mordred: do you think we can decouple it and land that first? | 15:46 |
| clarkb | mordred: then its a puppet side change to consume the cert and an ansible/docker change to consume it there | 15:46 |
| mordred | clarkb: https://review.opendev.org/#/c/705670/ | 15:47 |
| mordred | clarkb: already landed - but there's no LE certs on review | 15:47 |
| mordred | clarkb: so, you know - not really sure what's up with that - we should investigate | 15:47 |
| openstackgerrit | Merged opendev/system-config master: OpenStackID v3.0.0 https://review.opendev.org/709719 | 15:47 |
| *** ociuhandu has quit IRC | 15:48 | |
| mordred | clarkb: but yes, idea was go ahead and get the certs, then we can consume them with puppet if we don't roll out the ansible first | 15:48 |
| *** pkopec has quit IRC | 15:48 | |
| mordred | clarkb: /var/log/acme.sh is also empty on review | 15:49 |
| clarkb | mordred: do you know if an acme record was created in the openstack.org domain for it? however if there is no /var/log/acme.sh content I expect that isn't the issue | 15:51 |
| clarkb | mordred: I've got a meeting in a few minutes but can help debug after likely | 15:52 |
| mordred | clarkb: I *think* I created one - but I could have done something wrong | 15:52 |
| *** ijw has joined #openstack-infra | 15:52 | |
| mordred | clarkb: cool. I'll see what I can find in the meantime | 15:52 |
| fungi | #status log removed openstackid01.openstack.org from emergency disable list now that 709719 has merged | 15:52 |
| openstackstatus | fungi: finished logging | 15:52 |
| fungi | smarcet: ^ | 15:52 |
| clarkb | mordred: you can also check the ansible log side to see which things it evaluated | 15:52 |
| clarkb | on bridge | 15:52 |
| mordred | clarkb: yeah- that's what I'm doing now | 15:53 |
| smarcet | fungi: ack thx u :) | 15:53 |
| *** nicolasbock has joined #openstack-infra | 15:54 | |
| fungi | you're welcome | 15:54 |
| mordred | clarkb: hah | 15:54 |
| mordred | clarkb: the host is review01.openstack.org - but we have host_vars as review01.opendev.org | 15:55 |
| *** jamesmcarthur has joined #openstack-infra | 15:55 | |
| clarkb | that would do it | 15:55 |
| *** jamesmcarthur has quit IRC | 15:55 | |
| *** jamesmcarthur_ has joined #openstack-infra | 15:55 | |
| clarkb | mordred: is the gerrit2/le gid thing a concern with puppet managed gerrit? I assume not as much because the puppet stuff is preexisting? and so ansible will just pick a new gid for le? | 15:56 |
| clarkb | either way I suppose be specific won't hurt either | 15:56 |
| mordred | clarkb: yeah to both | 15:57 |
| mordred | clarkb: should we change the inventory hostname to review01.opendev.org? or the host_vars file name to review01.openstack.org ? | 15:58 |
| mordred | I think I lean towards the first | 15:58 |
| mordred | hrm. although the fqdn the host reports on the host is review01.openstack.org | 15:58 |
| clarkb | ya there might be unexpected side effects with updating the inventory hostname | 15:59 |
| mordred | although the openstack server knows itself as review-dev01.opendev.org | 15:59 |
| mordred | wait | 15:59 |
| clarkb | canonically the server is review-dev01.openstack.org | 15:59 |
| mordred | yeah - server name is review01.openstack.org | 15:59 |
| clarkb | it serves gerrit at review.opendev.org | 16:00 |
| mordred | yup | 16:00 |
| mordred | so let's keep the inventory name matching for sanity | 16:00 |
| mordred | "sanity" | 16:00 |
| *** pkopec has joined #openstack-infra | 16:02 | |
| openstackgerrit | Monty Taylor proposed opendev/system-config master: Rename gerrit hostvars to review01.openstack.org https://review.opendev.org/709765 | 16:02 |
| mordred | clarkb: ^^ | 16:02 |
| mordred | that should get us LE certs on review | 16:02 |
| *** matt_kosut has joined #openstack-infra | 16:03 | |
| clarkb | mordred: and that change isn't going to magically start managing gerrit with ansible + docker there right? thats a groups.yaml change? | 16:03 |
| clarkb | or maybe even in the playbook itself (not seeing that in groups.yaml) | 16:03 |
| *** pgaxatte has quit IRC | 16:04 | |
| mordred | clarkb: it's a playbook - so no, it won't | 16:05 |
| *** ociuhandu has joined #openstack-infra | 16:09 | |
| *** eharney has quit IRC | 16:12 | |
| *** diablo_rojo__ is now known as diablo_rojo | 16:13 | |
| *** ociuhandu has quit IRC | 16:24 | |
| *** eharney has joined #openstack-infra | 16:25 | |
| *** ociuhandu has joined #openstack-infra | 16:25 | |
| *** gyee has joined #openstack-infra | 16:27 | |
| *** rfolco has joined #openstack-infra | 16:27 | |
| *** jaosorior has quit IRC | 16:28 | |
| *** ociuhandu has quit IRC | 16:30 | |
| mordred | fungi: have a sec for ^^ ? | 16:35 |
| *** lbragstad_ is now known as lbragstad | 16:36 | |
| *** ociuhandu has joined #openstack-infra | 16:39 | |
| *** pkopec has quit IRC | 16:42 | |
| *** pkopec has joined #openstack-infra | 16:43 | |
| fungi | yeah, sorry, in the middle of a meeting but i can multitask ) | 16:44 |
| *** mattw4 has joined #openstack-infra | 16:44 | |
| openstackgerrit | Merged zuul/zuul-jobs master: Fix cleanup of symlink fixtures https://review.opendev.org/709306 | 16:46 |
| *** iurygregory has quit IRC | 16:48 | |
| mordred | fungi: silly meetings | 16:52 |
| smarcet | fungi: got some erros at deployment on production | 16:53 |
| smarcet | fungi: Feb 25 16:46:31 openstackid01 puppet-user[18035]: (/Stage[main]/Apache::Service/Service[httpd]) Triggered 'refresh' from 1 events | 16:53 |
| smarcet | Feb 25 16:51:32 openstackid01 puppet-user[18035]: Command exceeded timeout | 16:53 |
| smarcet | Feb 25 16:51:32 openstackid01 puppet-user[18035]: (/Stage[main]/Openstackid/Exec[update-site]/returns) change from notrun to 0 failed: Command exceeded timeout | 16:53 |
| smarcet | fungi: not sure if we should retrigger something | 16:53 |
| *** tesseract has quit IRC | 16:54 | |
| fungi | smarcet: sounds like the update-site command takes longer to run than puppet was willing to wait. how long does that usually take to complete? | 16:57 |
| smarcet | fungi: well not sure, its working at dev it seems | 16:57 |
| fungi | i can manually retrigger application of the manifest against that server, though it may timeout again | 16:57 |
| fungi | i'll give it a shot | 16:57 |
| fungi | running now | 16:58 |
| smarcet | fungi: ok if its fail again perhaps i could trigger the deployment script manually and check where is the bottle neck | 16:58 |
| smarcet | fungi: ok thx u | 16:58 |
| fungi | smarcet: yeah, it may be related to the size of the data set, or maybe the server is a slower flavor than dev, many possibilities | 16:59 |
| fungi | i think we can also increase the execution timeout for that command if it's prone to this problem | 17:00 |
| clarkb | ya its a setting on exec resources | 17:01 |
| smarcet | fungi: matter of fact openstackid.org seems slower than openstackid-dev server | 17:01 |
| smarcet | fungi: perhaps we could create a new server with same flavor as dev for prod ? | 17:02 |
| fungi | smarcet: i'll look to see what the relative flavors for those are | 17:02 |
| smarcet | fungi: thx u | 17:03 |
| *** lucasagomes has quit IRC | 17:03 | |
| fungi | smarcet: looks like it finished. does it seem to have successfully upgraded this time? | 17:04 |
| smarcet | its seems so | 17:04 |
| smarcet | checking | 17:04 |
| *** udesale has quit IRC | 17:04 | |
| smarcet | fungi: yes sire :) | 17:04 |
| smarcet | fungi: thx u again | 17:04 |
| fungi | smarcet: for the record, rackspace says openstackid01.openstack.org and openstackid-dev01.openstack.org are both booted with flavor "15 GB Performance" | 17:05 |
| smarcet | fungi: ack thx u | 17:05 |
| zbr | fungi: clarkb: can we do https://review.opendev.org/#/c/709184/ ? (had to rebase due to conflict) | 17:06 |
| fungi | so it's possible one is just on a busier host than the other, or may be under some production load which slows down puppet | 17:06 |
| *** lbragstad_ has joined #openstack-infra | 17:07 | |
| *** lbragstad has quit IRC | 17:10 | |
| *** jamesmcarthur has joined #openstack-infra | 17:10 | |
| *** lbragstad_ is now known as lbragstad | 17:10 | |
| openstackgerrit | Monty Taylor proposed opendev/system-config master: Replace kubectl snap with apt repo https://review.opendev.org/709253 | 17:10 |
| openstackgerrit | Monty Taylor proposed opendev/system-config master: Remove snap cleanup tasks https://review.opendev.org/709293 | 17:10 |
| *** jamesmcarthur_ has quit IRC | 17:13 | |
| *** lmiccini has quit IRC | 17:16 | |
| openstackgerrit | Merged opendev/system-config master: Rename gerrit hostvars to review01.openstack.org https://review.opendev.org/709765 | 17:26 |
| *** ijw has quit IRC | 17:34 | |
| *** chandankumar is now known as raukadah | 17:35 | |
| *** ociuhandu has quit IRC | 17:37 | |
| *** evrardjp has quit IRC | 17:39 | |
| *** evrardjp has joined #openstack-infra | 17:39 | |
| *** ijw has joined #openstack-infra | 17:40 | |
| openstackgerrit | Merged zuul/zuul-jobs master: Fix install-docker on centos-8 https://review.opendev.org/709184 | 17:52 |
| *** yamamoto has quit IRC | 17:53 | |
| *** jpena is now known as jpena|off | 17:55 | |
| *** matt_kosut has quit IRC | 17:59 | |
| *** sshnaidm|bbl is now known as sshnaidm | 18:04 | |
| *** igordc has joined #openstack-infra | 18:10 | |
| *** slaweq_ has quit IRC | 18:10 | |
| *** jamesmcarthur has quit IRC | 18:26 | |
| *** michael-beaver has quit IRC | 18:27 | |
| openstackgerrit | Sean McGinnis proposed openstack/project-config master: Make update_constraints.sh aware of python_versions https://review.opendev.org/709809 | 18:28 |
| openstackgerrit | Bob Fournier proposed openstack/diskimage-builder master: Do not include efibootmgr and efivars for ppc architectures https://review.opendev.org/709811 | 18:29 |
| openstackgerrit | Sean McGinnis proposed openstack/project-config master: Make update_constraints.sh aware of python_versions https://review.opendev.org/709809 | 18:29 |
| *** jcapitao has quit IRC | 18:29 | |
| *** Lucas_Gray has quit IRC | 18:31 | |
| smcginnis | That one could save the requirements team some headache for updates when new libraries are released. ^ | 18:31 |
| openstackgerrit | sebastian marcet proposed opendev/system-config master: OpenStackId v3.0.1 deployment https://review.opendev.org/709812 | 18:35 |
| *** jamesmcarthur has joined #openstack-infra | 18:38 | |
| *** jamesmcarthur has quit IRC | 18:39 | |
| *** jamesmcarthur has joined #openstack-infra | 18:42 | |
| *** ralonsoh has quit IRC | 18:42 | |
| *** Lucas_Gray has joined #openstack-infra | 18:43 | |
| *** jamesmcarthur has quit IRC | 18:43 | |
| *** trident has quit IRC | 18:52 | |
| *** amoralej is now known as amoralej|off | 18:53 | |
| *** jamesmcarthur has joined #openstack-infra | 18:56 | |
| *** trident has joined #openstack-infra | 18:58 | |
| *** pkopec has quit IRC | 18:59 | |
| *** rosmaita has quit IRC | 19:00 | |
| *** slaweq_ has joined #openstack-infra | 19:03 | |
| *** pkopec has joined #openstack-infra | 19:09 | |
| *** rosmaita has joined #openstack-infra | 19:13 | |
| *** ijw has quit IRC | 19:17 | |
| *** igordc has quit IRC | 19:17 | |
| *** ijw has joined #openstack-infra | 19:18 | |
| *** slaweq_ has quit IRC | 19:21 | |
| openstackgerrit | Merged opendev/system-config master: OpenStackId v3.0.1 deployment https://review.opendev.org/709812 | 19:23 |
| *** ijw has quit IRC | 19:24 | |
| *** sshnaidm has quit IRC | 19:28 | |
| *** jamesmcarthur has quit IRC | 19:28 | |
| *** sshnaidm has joined #openstack-infra | 19:28 | |
| *** jamesmcarthur has joined #openstack-infra | 19:32 | |
| *** apetrich has quit IRC | 19:37 | |
| *** slaweq_ has joined #openstack-infra | 19:47 | |
| *** eharney has quit IRC | 19:48 | |
| *** larainema has quit IRC | 19:48 | |
| openstackgerrit | Merged opendev/jeepyb master: Overhaul default welcome message for OpenDev https://review.opendev.org/708975 | 19:49 |
| *** igordc has joined #openstack-infra | 19:49 | |
| mordred | ianw: if you're bored whilst waking up - two LE related investigations .,.. 1) why are we still not getting LE certs for review01.openstack.org and 2) why is review-dev unhappy | 19:50 |
| mordred | ianw: I'm looking at review-dev atm (was looking at 1, noticed 2 and looking at it now) | 19:51 |
| *** kozhukalov has quit IRC | 19:51 | |
| mordred | ianw: oh - weird. remember last week when there were no new certs with the addition of review-dev.openstack.org to the cert- so I moved the old certs out of the way so that LE would re-get them? | 19:52 |
| mordred | nothing has gotten new certs - so review-dev is grumpy | 19:52 |
| *** smarcet has quit IRC | 19:52 | |
| ianw | 2020-02-25 06:51:00,386 p=root u=2837 | ok: [review01.openstack.org] => { | 19:53 |
| ianw | "letsencrypt_certs": "VARIABLE IS NOT DEFINED!" | 19:53 |
| ianw | } | 19:53 |
| clarkb | did we get the key in host vars wrong? | 19:53 |
| *** Lucas_Gray has quit IRC | 19:53 | |
| fungi | that's a very descriptive value | 19:53 |
| ianw | mordred: ahh,maybe there's a cache file that needs to be removed? | 19:53 |
| *** smarcet has joined #openstack-infra | 19:55 | |
| *** jamesmcarthur has quit IRC | 19:56 | |
| mordred | clarkb: does the key in letsencrypt_certs need to match the hostname pattern? | 19:57 |
| clarkb | mordred: no they are arbitrary inside the dict | 19:57 |
| mordred | kk. | 19:58 |
| clarkb | mordred: static.opendev.org is a good example since it has all the things now | 19:58 |
| *** slaweq_ has quit IRC | 19:58 | |
| mordred | yeah | 19:58 |
| *** ociuhandu has joined #openstack-infra | 19:58 | |
| *** aaronsheffield has quit IRC | 20:00 | |
| fungi | on a gerrit note, i tried to make more progress on https://review.opendev.org/681906 after yet another user ran into a related problem, and i suspect those behaviors in our version of gerrit (how topic string encoding/decoding is handled) may differ from more recent releases | 20:01 |
| fungi | the user reached out to me via irc privmsg after finding the earlier iteration of that change, and noted that on gerrit 3.1.2 (what they're currently running), simply wrapping the topic in quotes seems to work out but it definitely does not with 2.13 | 20:03 |
| *** jamesmcarthur has joined #openstack-infra | 20:03 | |
| ianw | mordred: so on 1) when i look at | 20:03 |
| ianw | 2020-02-25 19:21:44,519 p=root u=32757 | TASK [letsencrypt-request-certs : Show cert list] ****************************** | 20:03 |
| fungi | in their case it was commas in the topic breaking git-review instead of spaces | 20:03 |
| clarkb | fungi: could possibly test the version of gerrit and either fail with an error message or wrap with quoites | 20:03 |
| ianw | mordred: i don't think i'm seeing review01.openstack.org in the list. which suggests it may not be in the letsencrypt group somehow. was something changed there? | 20:04 |
| fungi | clarkb: yeah, i was leaning that direction, i don't think we currently branch behavior on gerrit versions so some care would be needed | 20:04 |
| fungi | ianw: before earlier today we were using review01.opendev.org which did not match the ansible inventory entry for it | 20:05 |
| *** jamesmcarthur has quit IRC | 20:08 | |
| *** pkopec has quit IRC | 20:10 | |
| clarkb | ianw: the files cleanup stack lgtm. I'll skip reviewing the haproxy changes | 20:10 |
| *** ociuhandu_ has joined #openstack-infra | 20:11 | |
| clarkb | I'm going to find lunch now. Then when I get back will try to catch up on some zuul reviews (there is an ha scheduelr spec to review) | 20:11 |
| *** jamesmcarthur has joined #openstack-infra | 20:12 | |
| *** ociuhandu_ has quit IRC | 20:12 | |
| mordred | ianw: - review[0-9]*.open*.org is in the group | 20:12 |
| *** ociuhandu_ has joined #openstack-infra | 20:12 | |
| mordred | ianw: so one would _expect_ it to be in the group | 20:12 |
| *** ociuhandu_ has quit IRC | 20:13 | |
| mordred | ianw: yeah - ansible --list-hosts letsencrypt shows it | 20:13 |
| *** ociuhandu_ has joined #openstack-infra | 20:13 | |
| ianw | fatal: [review01.openstack.org]: FAILED! => {"changed": false, "msg": "groupmod: GID '3001' already exists\n", "name": "letsencrypt"} | 20:14 |
| mordred | ah | 20:14 |
| ianw | hrm, i wonder if that stopped things, and then it never registers the required variables for the renewal | 20:14 |
| *** ociuhandu has quit IRC | 20:14 | |
| mordred | k. that's likely from when we were doing it otherwise | 20:14 |
| mordred | lemme look real quick | 20:15 |
| mordred | clarkb gets a cookie for suggesting that might be an issue earlier :) | 20:15 |
| mordred | HAH | 20:15 |
| mordred | we have a set of pre-existing groups there | 20:16 |
| mordred | let me make quick patch | 20:16 |
| ianw | ok, i think that's likely 1). now for 2), why does LE not renew ... | 20:17 |
| ianw | i mean acme.sh not renew | 20:17 |
| openstackgerrit | Monty Taylor proposed opendev/system-config master: Bump letsencrypt group id to match reality https://review.opendev.org/709826 | 20:17 |
| mordred | ianw, clarkb: ^^ I think that should be 1 | 20:18 |
| ianw | ahh i think there's stuff in /root/.acme.sh which keeps timestamps | 20:20 |
| mordred | ianw: ah - fascinating | 20:22 |
| *** ociuhandu_ has quit IRC | 20:23 | |
| ianw | mordred: ahh, no i think the key file that drives everything is actually review-dev.opendev.org.conf, which happens to be the one file with a ".mt" extension :) | 20:27 |
| *** ociuhandu has joined #openstack-infra | 20:27 | |
| ianw | i've moved that and will watch the next ansible pulse | 20:28 |
| mordred | ianw: cool. this is good to learn! | 20:30 |
| *** eharney has joined #openstack-infra | 20:30 | |
| ianw | i think ideally we should never have to learn this :) | 20:34 |
| mordred | ianw: yah. but we know how well ideally works out :) | 20:37 |
| *** smarcet has quit IRC | 20:37 | |
| *** smarcet has joined #openstack-infra | 20:37 | |
| *** ociuhandu has quit IRC | 20:40 | |
| *** ociuhandu has joined #openstack-infra | 20:44 | |
| ianw | so in short, acme.sh updated the domain list in its config, but due to our orchestration failure, never issued the new certificate. so then it has an updated domain list, but the old certificate; neither of which will trigger it to renew | 20:45 |
| ianw | (i.e. domains look unchanged, and old certificate still has plenty of time before renewal) | 20:45 |
| mordred | ianw: super edge case | 20:45 |
| *** slaweq_ has joined #openstack-infra | 20:47 | |
| *** ociuhandu_ has joined #openstack-infra | 20:50 | |
| *** matt_kosut has joined #openstack-infra | 20:51 | |
| *** pkopec has joined #openstack-infra | 20:52 | |
| *** ociuhandu has quit IRC | 20:53 | |
| *** rfolco has quit IRC | 20:54 | |
| *** matt_kosut has quit IRC | 20:56 | |
| *** ijw has joined #openstack-infra | 20:57 | |
| clarkb | mordred: I've approved the LE gid change | 20:58 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Evaluate CODEOWNERS settings during canMerge check https://review.opendev.org/644557 | 20:59 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Refactor branch protection test infrastructure https://review.opendev.org/709834 | 20:59 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Test canMerge also with checks api https://review.opendev.org/709835 | 20:59 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Optimize canMerge using graphql https://review.opendev.org/709836 | 20:59 |
| mordred | clarkb: \o/ | 20:59 |
| clarkb | mordred: why are https://review.opendev.org/#/c/709295/4/playbooks/zuul/gerrit/jgit.yaml and https://review.opendev.org/#/c/709295/4/playbooks/zuul/gerrit/polymer-bridges.yaml split out of the submodules.yaml? | 21:00 |
| mordred | clarkb: because we need one of them for 3.1 and both of them for master | 21:01 |
| *** factor__ has joined #openstack-infra | 21:01 | |
| clarkb | oh I see | 21:01 |
| clarkb | we apply them differently on the job side | 21:01 |
| mordred | clarkb: there is a first stab at a generic solution here: https://review.opendev.org/#/c/709602/ | 21:01 |
| mordred | but it's not working yet | 21:01 |
| mordred | and I haven't circled back around to debugging it yet | 21:02 |
| *** jamesmcarthur has quit IRC | 21:03 | |
| *** icarusfactor has quit IRC | 21:04 | |
| *** slaweq_ has quit IRC | 21:04 | |
| *** ociuhandu_ has quit IRC | 21:08 | |
| *** ociuhandu has joined #openstack-infra | 21:08 | |
| *** igordc has quit IRC | 21:08 | |
| mordred | clarkb: wow. "panic: template: repo/header:16: unexpected "}" in end" | 21:09 |
| mordred | clarkb: that's why the gitea job is bong | 21:09 |
| openstackgerrit | Monty Taylor proposed opendev/system-config master: Upgrade gitea to 1.11.1 https://review.opendev.org/705807 | 21:10 |
| *** ociuhandu_ has joined #openstack-infra | 21:12 | |
| *** ociuhandu has quit IRC | 21:13 | |
| mordred | clarkb: please to enjoy the difference between those two patches | 21:13 |
| openstackgerrit | Jeremy Stanley proposed opendev/system-config master: Correct openstackid tarball URL redirection https://review.opendev.org/709838 | 21:14 |
| fungi | smarcet: that ^ should correct my mistake on the redirect | 21:14 |
| fungi | infra-root: ^ quick brown-bag fix i've tested by hand on the server to make sure it does what we're needing | 21:15 |
| clarkb | fungi: huh does foo$.* parse properly? | 21:16 |
| *** igordc has joined #openstack-infra | 21:16 | |
| clarkb | (/.*|$) is probably how I would write it but if your version works good enough for me. | 21:16 |
| smarcet | fungi: thx u | 21:16 |
| fungi | clarkb: seems to. though i guess i could do (/.*|$) instead | 21:16 |
| mordred | o_O | 21:17 |
| fungi | sure, i prefer that too in retrospect | 21:17 |
| mordred | oh - I guess yeah | 21:17 |
| mordred | end of line followed by zero of more of any character | 21:17 |
| corvus | makes sense to me: end of string, followed by anything (which will never match) | 21:17 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Optimize canMerge using graphql https://review.opendev.org/709836 | 21:17 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Evaluate CODEOWNERS settings during canMerge check https://review.opendev.org/644557 | 21:17 |
| mordred | would work - because there will be zero characters after eol | 21:17 |
| mordred | yeah | 21:17 |
| openstackgerrit | Jeremy Stanley proposed opendev/system-config master: Correct openstackid tarball URL redirection https://review.opendev.org/709838 | 21:17 |
| mordred | but - I did have to run it through my internal regex engine | 21:17 |
| *** igordc has quit IRC | 21:18 | |
| *** igordc has joined #openstack-infra | 21:18 | |
| *** jamesmcarthur has joined #openstack-infra | 21:18 | |
| fungi | i'd rather write it in a way which will confuse the fewest number of people (which will always be >>0 because regex) | 21:18 |
| corvus | i agree (/.*|$) seems more idiomatic -- but fungi's original is kinda growing on me. i like that it lets you essentially terminate the machine early (especially if the machine is running in your head) and you don't have to confirm the alternative all the way to the end. | 21:18 |
| fungi | they're technically not equivalent in how $2 gets passed as a backreference, but we're not using $2 | 21:19 |
| corvus | true | 21:19 |
| *** ociuhandu_ has quit IRC | 21:20 | |
| corvus | i've left the +3 vote; plenty of time to change our minds though | 21:20 |
| fungi | which is preferable depends on context, but here i don't think it matters either way so happy to go with consensus | 21:20 |
| fungi | smarcet: anyway, hopefully that redirect wasn't the problem since i already updated the puppet module for the new url | 21:21 |
| smarcet | fungi: thx sire :) | 21:22 |
| fungi | you're welcome | 21:24 |
| *** pkopec has quit IRC | 21:25 | |
| *** igordc has quit IRC | 21:26 | |
| openstackgerrit | Merged opendev/system-config master: Bump letsencrypt group id to match reality https://review.opendev.org/709826 | 21:27 |
| ianw | infra-root: mentioned in the meeting, but https://review.opendev.org/#/c/709382/ worked out pretty small as the POC for a zuul-based periodic job for 404's ... if we want to approve that i can trigger it for testing, as i'm not sure we've used this before so sure to be something up | 21:29 |
| *** xek_ has quit IRC | 21:29 | |
| clarkb | ianw: I want to say we got far enough into doing that that using root was problematic, but I don't recall why | 21:32 |
| clarkb | ianw: this precipitated my change to use a zuul user on bridge instead. Let me see if git logs can remind me why that was a problem | 21:32 |
| clarkb | oh I remember | 21:32 |
| clarkb | ianw: we disallow root ssh except from bridge :) | 21:32 |
| ianw | ooohhhh doh, yeah | 21:32 |
| *** bdodd has quit IRC | 21:34 | |
| ianw | how does zuul bounce through bridge? | 21:34 |
| clarkb | ianw: well we never quite got that working, but the plan was to add a zuul user to bridge and then have jobs bounce through that way | 21:34 |
| ianw | i guess the other option is a user who can sudo with become: yes on this task | 21:34 |
| clarkb | (using the system-cofnig project key) | 21:34 |
| clarkb | so I guess we can try it that way instead. Have job addhost bridge then ansible to static from there | 21:35 |
| clarkb | or ya have a sudo able user on static that you can ssh with instead | 21:35 |
| *** bdodd has joined #openstack-infra | 21:37 | |
| ianw | i don't really see any advantage to going via bridge directly as root? seems to open bridge up to more potential stuff-ups but not really be more secure? | 21:39 |
| ianw | mordred: cert got renewed. http://review-dev.openstack.org didn't give any issues, which IIRC was the issue before? | 21:40 |
| fungi | ianw: i agree with you on testinfra tests for additional legacy tarball redirects. have an example of a redirect test elsewhere? i'll go ahead and add this one to start it off | 21:41 |
| *** bdodd has quit IRC | 21:41 | |
| ianw | fungi: probably a model like https://review.opendev.org/#/c/709403/13/testinfra/test_static.py | 21:42 |
| ianw | fungi: (btw, review on that change welcome too :) | 21:43 |
| *** mattw4 has quit IRC | 21:43 | |
| clarkb | ianw: it would be zuul -> bridge as zuul user; then as zuul user on bridge run ansible to static | 21:43 |
| fungi | ianw: yup, on it, thanks! | 21:46 |
| mordred | ianw: nope - it was https://review-dev.openstack.org ... and that's still giving issues | 21:47 |
| mordred | ianw: maybe apache graceful didn't fire? | 21:47 |
| mordred | ianw: http://review-dev.openstack.org is fine because it just redirects straight to https://review-dev.opendev.org - but https://review-dev.openstack.org has to process the openstack.org cert before it can throw the redirect | 21:48 |
| fungi | ianw: nice use of the macro feature in apache! | 21:48 |
| corvus | ianw, clarkb: is a non-root user on static a possibility? | 21:49 |
| clarkb | corvus: yup that was my suggsetion on the change itself | 21:49 |
| ianw | Feb 25 21:22:18 review-dev01 apache2[31004]: SSLCertificateKeyFile: file '/etc/letsencrypt-certs/review-dev.opendev.org/review-dev.opendev.org.key' does not exist or is empty | 21:49 |
| fungi | it just needs read access to the apache logs | 21:49 |
| ianw | corvus: yeah, that's what i'm writing up now | 21:50 |
| ianw | mordred: ok, that file was renamed, i don't think we should have. i put it back, restarted apache, and i *think* it work nows? | 21:52 |
| ianw | works now even | 21:52 |
| mordred | ianw: yes! I agree | 21:52 |
| ianw | see, it's that easy :) | 21:53 |
| *** ociuhandu has joined #openstack-infra | 21:55 | |
| *** ociuhandu has quit IRC | 22:00 | |
| *** ociuhandu has joined #openstack-infra | 22:03 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: static: add a periodic 404 checker https://review.opendev.org/709382 | 22:06 |
| *** rfolco has joined #openstack-infra | 22:07 | |
| *** ociuhandu has quit IRC | 22:07 | |
| ianw | clarkb: ^ i think that might even work | 22:08 |
| *** jamesmcarthur has quit IRC | 22:08 | |
| clarkb | ianw: I've+2'd it but also left a testing suggestion | 22:08 |
| *** factor__ has quit IRC | 22:11 | |
| mordred | also +2 with a comment - but I left it open because this feels like one of those that should get another eye or two on it | 22:11 |
| *** factor has joined #openstack-infra | 22:12 | |
| clarkb | mordred: that came up when we did this with bridge and I want to say one issue with it was applying multiple project keys. But since this is a single key we may be ok? | 22:12 |
| clarkb | (I ended up writing a thing to fetch the content in the multi key case iirc) | 22:13 |
| mordred | nod | 22:14 |
| mordred | ianw: https://review.opendev.org/#/c/709038 should be ok to +A yeah? | 22:15 |
| mordred | ianw: 2x+2 on that stack actually - so I think feel free to +A it when it makes sense | 22:16 |
| *** mattw4 has joined #openstack-infra | 22:18 | |
| *** smarcet has quit IRC | 22:25 | |
| ianw | mordred: thanks! | 22:26 |
| mordred | ianw, fungi: https://review.opendev.org/#/c/705807/ is green now if we're in the mood to upgrade to 1.11 | 22:26 |
| *** dave-mccowan has joined #openstack-infra | 22:27 | |
| ianw | mordred: hrm, i guess if we got it from the api as a string we could use the same mechanism to insert it, but maybe it's also better for us to know if it ever changed and have to commit something? | 22:27 |
| *** jamesmcarthur has joined #openstack-infra | 22:27 | |
| mordred | ianw: yeah - maybe so? | 22:27 |
| mordred | ianw: at the very least - we might want to refactor zuul.yaml out into a role since it would be the same for any host we want to use from system-config | 22:28 |
| mordred | that way we'd only have one copy of the public key | 22:29 |
| ianw | that's a good point | 22:29 |
| mordred | could be a followup though | 22:29 |
| *** kvenkata has joined #openstack-infra | 22:29 | |
| fungi | mordred: any idea what new features in it are relying on npm? | 22:30 |
| *** matt_kosut has joined #openstack-infra | 22:30 | |
| mordred | ianw: also - if you think about it - maybe a comment with the key data "this is the key from https://zuul.opendev.org/api/blah/blah ..." | 22:30 |
| openstackgerrit | Merged opendev/system-config master: Correct openstackid tarball URL redirection https://review.opendev.org/709838 | 22:30 |
| mordred | fungi: I believe they changed their build to build web assets using javascript toolchain | 22:30 |
| fungi | (what the gitea build is incorporating via npm i mean | 22:30 |
| fungi | k | 22:30 |
| mordred | (kind of like what we do with zuul-web) | 22:30 |
| *** jamesmcarthur has quit IRC | 22:32 | |
| mordred | woohoo here we go! | 22:34 |
| fungi | this has got me stumped... | 22:35 |
| fungi | https://opendev.org/osf/openstackid/src/branch/master/.zuul.yaml#L37-L39 | 22:35 |
| *** matt_kosut has quit IRC | 22:35 | |
| fungi | a 3.0.2 tag was pushed (tagging the commit which added those lines in fact) | 22:36 |
| fungi | but that job was not run in the release pipeline | 22:36 |
| fungi | what am i overlooking? | 22:36 |
| mordred | fungi: was the tag signed? | 22:36 |
| fungi | yeah | 22:38 |
| *** mattw4 has quit IRC | 22:38 | |
| fungi | i'll check the scheduler logs | 22:38 |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Store build.error_detail in SQL https://review.opendev.org/709857 | 22:39 |
| *** migawa|lunch is now known as masayukig | 22:39 | |
| *** michael-beaver has joined #openstack-infra | 22:40 | |
| *** icarusfactor has joined #openstack-infra | 22:41 | |
| openstackgerrit | Merged zuul/zuul master: Add spec for scale out scheduler https://review.opendev.org/621479 | 22:41 |
| *** factor has quit IRC | 22:42 | |
| fungi | zuul.layout: [e: 76c12b5d912b4313a722933b688c9d19] No matching parents for job openstackid-release-branch and change <Tag 0x7f2e7c2fd780 osf/openstackid creates refs/tags/3.0.2 on c1ffc5f31f8bbaf78e7b3755001be75c23a6844b> | 22:42 |
| fungi | it's parent is legacy-publish-openstack-artifacts, i wonder if that's got a branch matcher in it | 22:43 |
| fungi | indeed it does, there are two versions of that job, one for old openstack stable branches (to use xenial) and one for newer branches (to use bionic) | 22:45 |
| fungi | so it can't run from a trigger which isn't branch-relevant | 22:45 |
| * fungi sighs | 22:45 | |
| *** mattw4 has joined #openstack-infra | 22:47 | |
| fungi | looks like switching the parent to publish-openstack-artifacts ought to work | 22:48 |
| *** ijw has quit IRC | 22:48 | |
| *** factor has joined #openstack-infra | 22:49 | |
| *** icarusfactor has quit IRC | 22:49 | |
| fungi | unless the job relies on anything which gets done in playbooks/legacy/pre.yaml | 22:51 |
| fungi | oh yeah, it's still using zuul-cloner | 22:51 |
| fungi | i wonder if we have anything equivalent to legacy-publish-openstack-artifacts which is made for tags | 22:52 |
| fungi | seems the answer is no | 22:57 |
| mordred | fungi: you have found yourself a lovely rabbit hole! | 22:58 |
| fungi | not one i was looking for either | 22:58 |
| *** tkajinam has joined #openstack-infra | 22:58 | |
| *** factor has quit IRC | 23:06 | |
| *** factor has joined #openstack-infra | 23:06 | |
| fungi | it's relying on https://opendev.org/openstack/openstack-zuul-jobs/src/branch/master/roles/legacy-copy-jenkins-scripts/files/version-properties.sh to set $PROJECT_VER | 23:07 |
| *** kaisers has quit IRC | 23:08 | |
| *** smarcet has joined #openstack-infra | 23:08 | |
| *** kaisers has joined #openstack-infra | 23:09 | |
| fungi | seems it and gearman-plugin are the only projects using it | 23:09 |
| fungi | i don't suppose there's a more v3-native solution than the sieve of git --rev-parse and git describe mangles going on in there? | 23:10 |
| openstackgerrit | Merged opendev/system-config master: Upgrade gitea to 1.11.1 https://review.opendev.org/705807 | 23:17 |
| openstackgerrit | Merged opendev/system-config master: static: add a periodic 404 checker https://review.opendev.org/709382 | 23:17 |
| clarkb | fungi: I don't think so in the non tag case | 23:19 |
| clarkb | fungi: for the tag case you just use the tag value | 23:20 |
| *** dchen has joined #openstack-infra | 23:22 | |
| *** ijw has joined #openstack-infra | 23:25 | |
| *** ijw has quit IRC | 23:26 | |
| *** ijw has joined #openstack-infra | 23:26 | |
| fungi | https://review.opendev.org/709864 Migrate openstackid-release-branch to Zuul v3 | 23:26 |
| fungi | clarkb: ^ see if that makes sense or if you can think of further simplifications | 23:27 |
| fungi | obviously the same needs to be done for other in-tree jobs in that repo | 23:27 |
| fungi | but since we don't have a lot of php projects, i'd like to make sure this job is working before repeating | 23:27 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: zuul-user: add role to install system-config key https://review.opendev.org/709865 | 23:29 |
| clarkb | fungi: you removed the sudo access cleanup. Is that handled in pre on non legacy jobs? | 23:31 |
| clarkb | (its not critical either way I suppose) | 23:31 |
| fungi | i think there's a role we can add for that if it's not already | 23:32 |
| * fungi checks | 23:32 | |
| *** Goneri has quit IRC | 23:32 | |
| clarkb | that looks correct to me though | 23:33 |
| clarkb | basically you remove the z-c stuff and use zuul's src_dir. Then build tarball an copy it into tarballs/ with version suffix and -latest suffix and finally rsync that data out into the artifacts dir on the executor and let the parent job publish | 23:34 |
| fungi | clarkb: it's not done by publish-openstack-artifacts that i can tell, but other jobs are parenting directly on publish-openstack-artifacts and not bothering with revoke-sudo | 23:34 |
| clarkb | ok revoking sudo isn't super important there. The risk is that you'll need root to produce a tarball | 23:34 |
| fungi | seems fairly unlikely to become an issue | 23:36 |
| fungi | thanks for looking it over! | 23:36 |
| openstackgerrit | Merged opendev/system-config master: Revert "Generate list of 404s for docs.o.o" https://review.opendev.org/709038 | 23:39 |
| ianw | infra-root: anyone for a quick eye on https://review.opendev.org/#/c/709402/ and that will switch docs.opendev.org to the new server | 23:39 |
| *** rcernin has joined #openstack-infra | 23:39 | |
| mordred | #status log opendev.org gitea has been upgraded to 1.11.1 | 23:40 |
| openstackstatus | mordred: finished logging | 23:40 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: static: add static.openstack.org/files.openstack.org https://review.opendev.org/709042 | 23:45 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: static: provide git services https://review.opendev.org/709403 | 23:45 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Remove files02.openstack.org and related puppet https://review.opendev.org/709639 | 23:45 |
| openstackgerrit | Merged opendev/zone-opendev.org master: docs.opendev.org : switch to static.opendev.org https://review.opendev.org/709402 | 23:47 |
| fungi | and another one down | 23:47 |
| ianw | thanks :) | 23:50 |
| ianw | i've added all the _acme-challenge domains for the git and static services; only a trivial rebase on the testinfra stuff from the 404 checker | 23:51 |
| clarkb | ianw: you saw my note about the project dns management being in rax too? | 23:51 |
| * clarkb looks to see if new votes are needed | 23:52 | |
| *** tosky has quit IRC | 23:52 | |
| ianw | clarkb: for openstack/starlingx/airhship? yep i've logged in and created those cnames just now | 23:53 |
| clarkb | ianw: https://review.opendev.org/#/c/709403/13..14/playbooks/roles/static/tasks/main.yaml that got rebase tags in it | 23:53 |
| ianw | boo emerge why did you fail me | 23:54 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: static: provide git services https://review.opendev.org/709403 | 23:56 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Remove files02.openstack.org and related puppet https://review.opendev.org/709639 | 23:56 |
| fungi | is it possible to reenqueue a tag after you've merged job changes and have those job changes take effect, or does zuul freeze the configuration from the point of that tag? | 23:58 |
| clarkb | fungi: I think my brain just melted | 23:59 |
| fungi | i'm still getting No matching parents for job openstackid-release-branch and change <Tag 0x7f2de2ec5780 osf/openstackid creates refs/tags/3.0.2 on c1ffc5f31f8bbaf78e7b3755001be75c23a6844b> | 23:59 |
| clarkb | I think it may be relative to the tag | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!