| ianw | the original problem wasn't just centos, was it? | 00:00 |
|---|---|---|
| ianw | i.e. is this a centos era networkmanager bug, that's likely never going to get fixed | 00:00 |
| *** markvoelker has quit IRC | 00:01 | |
| johnsom | FYI, There was a problem delivering your message to storyboard@storyboard.openstack.org. | 00:01 |
| johnsom | The recipient server did not accept our requests to connect. Learn more at https://support.google.com/mail/answer/7720 [storyboard.openstack.org 2001:4800:7818:103:be76:4eff:fe04:976a: timed out] [storyboard.openstack.org 162.209.77.101: generic::failed_precondition: connect error (113): No route to host] | 00:01 |
| johnsom | For some reason gmail is not happy with storyboard. | 00:01 |
| clarkb | johnsom: this is you trying to send email to storyboard? | 00:02 |
| johnsom | Lol, I just saw that it did try to send an e-mail there. Nevermind. | 00:02 |
| clarkb | the firewall says no incoming mail fwiw | 00:02 |
| ianw | clarkb: i ran a salvage on the afs02 epel ro volume, which seemed to go ok; now trying a release, i think it's recreating it on afs02 | 00:15 |
| clarkb | salvage meaning delete it? | 00:17 |
| *** mattw4 has quit IRC | 00:18 | |
| *** michael-beaver has quit IRC | 00:19 | |
| ianw | clarkb: well the salvager, that should automatically find errors, had stuff in root@afs02:/var/log/openafs/SalsrvLog about being unable to salvage 536870967 ; so i manually reran the salvage | 00:19 |
| ianw | then it has said | 00:20 |
| ianw | Tue Aug 20 00:10:18 2019 1 Volser: Delete: volume 536870968 deleted | 00:20 |
| ianw | Tue Aug 20 00:10:18 2019 1 Volser: CreateVolume: volume 536870968 (mirror.epel.readonly) created | 00:20 |
| *** jamesmcarthur has quit IRC | 00:23 | |
| clarkb | ah | 00:34 |
| *** gyee has quit IRC | 00:36 | |
| *** sgw has quit IRC | 00:37 | |
| *** aaronsheffield has quit IRC | 00:38 | |
| *** noorul has joined #openstack-infra | 00:40 | |
| *** altlogbot_0 has quit IRC | 00:46 | |
| *** altlogbot_3 has joined #openstack-infra | 00:47 | |
| *** gregoryo has joined #openstack-infra | 00:50 | |
| ianw | says it released | 00:56 |
| ianw | http://grafana.openstack.org/d/ACtl1JSmz/afs?orgId=1&from=now-7d&to=now shows suse out of sync too | 00:57 |
| *** igordc has quit IRC | 01:11 | |
| fungi | johnsom: i think story creation and comments via e-mail are on what passes for the roadmap, which is why we set it up to send with a local address for the server in hopes that will eventually be useful to actually send messages back to as well | 01:13 |
| fungi | but yeah, 25/tcp is blocked via iptables for now since it isn't implemented | 01:14 |
| *** hongbin has joined #openstack-infra | 01:24 | |
| *** tdasilva has quit IRC | 01:30 | |
| *** tdasilva has joined #openstack-infra | 01:30 | |
| ianw | ok, the opensuse release is also stuck since Jul26 | 01:45 |
| ianw | i'm going to chalk it up to the same thing as the epel, as same date from clarkb's message | 01:45 |
| ianw | and a yum-puppetlabs | 01:47 |
| ianw | same date | 01:47 |
| ianw | i'm just going to reboot the update server, rather than risk any half-clearing out of hung processes, it's not doing anything right now | 01:48 |
| *** markvoelker has joined #openstack-infra | 01:51 | |
| *** markvoelker has quit IRC | 01:55 | |
| clarkb | ianw: did fedora finish? | 02:01 |
| clarkb | if not you'll want to regrab that lock file post boot | 02:02 |
| ianw | clarkb: oh yeah, it seemed to have finished; there was only old processes active | 02:06 |
| clarkb | the vos release is running on afsp1 | 02:08 |
| clarkb | er afs01.dfw fwiw | 02:08 |
| clarkb | to take advantage of localauth | 02:08 |
| ianw | oohhh, that explains it; let me take lock | 02:09 |
| *** apetrich has quit IRC | 02:10 | |
| ianw | done, will keep an eye | 02:10 |
| *** n-saito has joined #openstack-infra | 02:12 | |
| *** n-saito has left #openstack-infra | 02:13 | |
| *** bobh has joined #openstack-infra | 02:24 | |
| *** bobh has quit IRC | 02:26 | |
| *** tdasilva has quit IRC | 02:31 | |
| *** noorul has quit IRC | 02:31 | |
| *** tdasilva has joined #openstack-infra | 02:31 | |
| *** ricolin has joined #openstack-infra | 02:39 | |
| *** diablo_rojo has joined #openstack-infra | 02:43 | |
| *** noorul has joined #openstack-infra | 03:00 | |
| *** spsurya has joined #openstack-infra | 03:03 | |
| *** bhavikdbavishi has joined #openstack-infra | 03:08 | |
| *** bhavikdbavishi1 has joined #openstack-infra | 03:11 | |
| *** bhavikdbavishi has quit IRC | 03:13 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 03:13 | |
| *** eernst has joined #openstack-infra | 03:13 | |
| *** eernst has quit IRC | 03:32 | |
| *** tdasilva has quit IRC | 03:32 | |
| *** tdasilva has joined #openstack-infra | 03:33 | |
| *** eernst has joined #openstack-infra | 03:39 | |
| *** ramishra has joined #openstack-infra | 03:41 | |
| *** psachin has joined #openstack-infra | 03:43 | |
| *** noorul has quit IRC | 03:47 | |
| *** hongbin has quit IRC | 03:51 | |
| *** rlandy|ruck|bbl is now known as rlandy|ruck | 03:56 | |
| *** ramishra has quit IRC | 04:00 | |
| *** eernst has quit IRC | 04:00 | |
| *** armax has quit IRC | 04:00 | |
| *** udesale has joined #openstack-infra | 04:02 | |
| *** rlandy|ruck has quit IRC | 04:02 | |
| *** ykarel has joined #openstack-infra | 04:07 | |
| *** tkajinam has quit IRC | 04:09 | |
| *** tkajinam has joined #openstack-infra | 04:16 | |
| *** tkajinam has quit IRC | 04:17 | |
| *** tkajinam has joined #openstack-infra | 04:18 | |
| *** tdasilva has quit IRC | 04:34 | |
| *** tdasilva has joined #openstack-infra | 04:34 | |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Fix promote api-ref jobs https://review.opendev.org/677384 | 04:41 |
| AJaeger | ianw, config-core, could you review the change above to unbreak these jobs, please? ^ | 04:42 |
| *** ykarel is now known as ykarel|afk | 04:49 | |
| *** ykarel|afk has quit IRC | 04:53 | |
| *** tdasilva has quit IRC | 04:58 | |
| *** stakeda has joined #openstack-infra | 04:59 | |
| *** janki has joined #openstack-infra | 05:10 | |
| *** sthussey has quit IRC | 05:12 | |
| *** raukadah is now known as chkumar|rover | 05:15 | |
| *** kjackal has joined #openstack-infra | 05:15 | |
| *** ykarel|afk has joined #openstack-infra | 05:19 | |
| *** ykarel|afk is now known as ykarel | 05:19 | |
| *** diablo_rojo has quit IRC | 05:27 | |
| *** jaosorior has joined #openstack-infra | 05:32 | |
| *** ykarel is now known as ykarel|meeting | 05:33 | |
| *** kopecmartin|off is now known as kopecmartin | 05:37 | |
| *** kjackal has quit IRC | 05:37 | |
| *** ykarel has joined #openstack-infra | 05:37 | |
| *** ykarel|meeting has quit IRC | 05:38 | |
| *** ramishra has joined #openstack-infra | 05:41 | |
| *** persia has quit IRC | 05:49 | |
| *** noama has joined #openstack-infra | 05:51 | |
| *** sgw has joined #openstack-infra | 05:52 | |
| *** markvoelker has joined #openstack-infra | 05:55 | |
| openstackgerrit | Merged zuul/zuul master: web: link the buildset page from the build https://review.opendev.org/675493 | 05:57 |
| openstackgerrit | Akihiro Motoki proposed openstack/openstack-zuul-jobs master: Add support for building PDFs https://review.opendev.org/664555 | 05:59 |
| *** persia has joined #openstack-infra | 06:00 | |
| *** dingyichen has joined #openstack-infra | 06:02 | |
| *** persia has quit IRC | 06:03 | |
| openstackgerrit | Merged openstack/project-config master: Fix promote api-ref jobs https://review.opendev.org/677384 | 06:03 |
| *** persia has joined #openstack-infra | 06:05 | |
| *** persia has quit IRC | 06:05 | |
| *** markvoelker has quit IRC | 06:05 | |
| *** persia has joined #openstack-infra | 06:05 | |
| *** dychen has quit IRC | 06:06 | |
| *** markvoelker has joined #openstack-infra | 06:06 | |
| *** markvoelker has quit IRC | 06:10 | |
| *** dchen has joined #openstack-infra | 06:15 | |
| *** dingyichen has quit IRC | 06:18 | |
| openstackgerrit | Akihiro Motoki proposed openstack/openstack-zuul-jobs master: Add support for building PDFs https://review.opendev.org/664555 | 06:19 |
| *** ykarel is now known as ykarel|meeting | 06:26 | |
| *** udesale has quit IRC | 06:33 | |
| *** kjackal has joined #openstack-infra | 06:34 | |
| *** udesale has joined #openstack-infra | 06:34 | |
| *** rcernin has quit IRC | 06:35 | |
| *** diga has joined #openstack-infra | 06:38 | |
| *** odicha has joined #openstack-infra | 06:49 | |
| *** hongbin has joined #openstack-infra | 06:52 | |
| *** xenos76 has joined #openstack-infra | 06:52 | |
| *** hongbin has quit IRC | 06:56 | |
| *** udesale has quit IRC | 07:01 | |
| *** udesale has joined #openstack-infra | 07:02 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: simple-init: add configurable RA timeout with network-manager https://review.opendev.org/677410 | 07:07 |
| *** dpawlik has joined #openstack-infra | 07:08 | |
| ianw | clarkb: ^ a bit more investigation, i imagine crossed over with what you've done. i get the feeling it must be somehow related to nm-settings-ifcfg-rh because i think that's where we're being a bit unique | 07:08 |
| ianw | possibly, moving to the nm ini files directly might help. i'll put it on todo list, but it's big changes to glean etc :/ | 07:09 |
| *** trident has quit IRC | 07:16 | |
| *** trident has joined #openstack-infra | 07:24 | |
| *** psachin has quit IRC | 07:25 | |
| *** fabo has joined #openstack-infra | 07:28 | |
| *** dychen has joined #openstack-infra | 07:39 | |
| *** ricolin has quit IRC | 07:39 | |
| *** ricolin has joined #openstack-infra | 07:39 | |
| *** jpena|off is now known as jpena | 07:41 | |
| *** exsdev has quit IRC | 07:42 | |
| *** dchen has quit IRC | 07:42 | |
| *** exsdev has joined #openstack-infra | 07:42 | |
| *** ianychoi has quit IRC | 07:46 | |
| *** ianychoi has joined #openstack-infra | 07:47 | |
| *** ykarel has joined #openstack-infra | 07:50 | |
| *** ykarel is now known as ykarel|lunch | 07:51 | |
| *** ykarel|meeting has quit IRC | 07:52 | |
| *** guoqiao has quit IRC | 07:54 | |
| *** ralonsoh has joined #openstack-infra | 07:55 | |
| *** lucasagomes has joined #openstack-infra | 07:56 | |
| *** ociuhandu has joined #openstack-infra | 07:58 | |
| *** dougsz has joined #openstack-infra | 07:59 | |
| *** ociuhandu has quit IRC | 07:59 | |
| *** ociuhandu has joined #openstack-infra | 08:00 | |
| openstackgerrit | Akihiro Motoki proposed openstack/openstack-zuul-jobs master: Add support for building PDFs https://review.opendev.org/664555 | 08:00 |
| *** priteau has joined #openstack-infra | 08:06 | |
| ianw | ok, opensuse mirror released ok now, i think they're all back in action | 08:07 |
| AJaeger | thanks, ianw ! | 08:07 |
| *** apetrich has joined #openstack-infra | 08:13 | |
| *** pkopec has joined #openstack-infra | 08:15 | |
| *** jaosorior has quit IRC | 08:16 | |
| *** panda has quit IRC | 08:18 | |
| *** panda has joined #openstack-infra | 08:20 | |
| openstackgerrit | Akihiro Motoki proposed openstack/openstack-zuul-jobs master: Add support for building PDFs https://review.opendev.org/664555 | 08:20 |
| ianw | clarkb: i don't know what happened to your vos release of fedora on afs01.dfw mentioned before ... but the volume is still not released. i'm running it in screen on mirror-update.opendev.org (where i have the lock) and it's going, at least ... | 08:22 |
| ianw | http://paste.openstack.org/show/760145/ | 08:23 |
| ianw | see if it finishes before i go to bed :) | 08:23 |
| *** e0ne has joined #openstack-infra | 08:26 | |
| *** dychen has quit IRC | 08:27 | |
| *** derekh has joined #openstack-infra | 08:28 | |
| *** jamesmcarthur has joined #openstack-infra | 08:28 | |
| *** ykarel|lunch is now known as ykarel | 08:29 | |
| *** yolanda has quit IRC | 08:30 | |
| zbr | ianw: can you help with https://review.opendev.org/#/c/639951/ ? | 08:30 |
| *** tkajinam has quit IRC | 08:32 | |
| *** sgw has quit IRC | 08:36 | |
| *** yolanda has joined #openstack-infra | 08:43 | |
| *** tdasilva has joined #openstack-infra | 08:54 | |
| *** jamesmcarthur has quit IRC | 08:57 | |
| *** jamesmcarthur has joined #openstack-infra | 08:59 | |
| fdegir | clarkb: mordred: corvus: can we get https://review.opendev.org/#/c/652238/ in please? | 09:00 |
| *** jchhatbar has joined #openstack-infra | 09:06 | |
| *** gregoryo has quit IRC | 09:06 | |
| *** jchhatbar has quit IRC | 09:06 | |
| *** jchhatbar has joined #openstack-infra | 09:07 | |
| *** janki has quit IRC | 09:07 | |
| *** jchhatbar has quit IRC | 09:07 | |
| *** janki has joined #openstack-infra | 09:08 | |
| *** jamesmcarthur has quit IRC | 09:08 | |
| *** jamesmcarthur has joined #openstack-infra | 09:09 | |
| *** kjackal has quit IRC | 09:11 | |
| *** kjackal has joined #openstack-infra | 09:11 | |
| *** rcernin has joined #openstack-infra | 09:15 | |
| *** ociuhandu_ has joined #openstack-infra | 09:15 | |
| *** ociuhandu_ has quit IRC | 09:16 | |
| *** apetrich has quit IRC | 09:25 | |
| *** bhavikdbavishi has quit IRC | 09:27 | |
| AJaeger | config-core, do we want to switch openstack-tox-docs to promote publishing? Then, please review https://review.opendev.org/677009 and https://review.opendev.org/677013 | 09:27 |
| *** apetrich has joined #openstack-infra | 09:28 | |
| *** kjackal has quit IRC | 09:29 | |
| *** kjackal has joined #openstack-infra | 09:31 | |
| *** kjackal has quit IRC | 09:36 | |
| *** jamesmcarthur has quit IRC | 09:41 | |
| *** jaosorior has joined #openstack-infra | 09:47 | |
| *** dougsz has left #openstack-infra | 09:48 | |
| *** sshnaidm|afk is now known as sshnaidm | 09:49 | |
| *** ociuhandu has quit IRC | 09:54 | |
| *** yamamoto has quit IRC | 10:00 | |
| *** gfidente has joined #openstack-infra | 10:05 | |
| openstackgerrit | Sorin Sbarnea proposed zuul/zuul-jobs master: DNM: experiment ansible-version: 2.8 https://review.opendev.org/677440 | 10:11 |
| *** kjackal has joined #openstack-infra | 10:16 | |
| *** udesale has quit IRC | 10:16 | |
| *** jamesmcarthur has joined #openstack-infra | 10:16 | |
| *** udesale has joined #openstack-infra | 10:17 | |
| *** priteau has quit IRC | 10:18 | |
| *** jamesmcarthur has quit IRC | 10:23 | |
| *** yamamoto has joined #openstack-infra | 10:23 | |
| amotoki | AJaeger: I have a question related to PDF build support in openstack-tox-docs https://review.opendev.org/#/c/664555/. can we pass 'vars' for zuul project-template? | 10:24 |
| amotoki | AJaeger: As I commented in the review, I am trying to introduce a flag to specify whether PDF doc is build or not, but I wonder how individual projects can pass the flag in their .zuul.yaml. | 10:25 |
| *** ociuhandu has joined #openstack-infra | 10:27 | |
| amotoki | If there is no convenient way,I started to think using 'ignore_errors' is a good compromise at the moment. | 10:28 |
| *** rcernin has quit IRC | 10:28 | |
| amotoki | another idea is to introduce a new project-template like "build-openstack-docs-pti-with-pdf" but it is hacky enough.... | 10:31 |
| openstackgerrit | Akihiro Motoki proposed openstack/openstack-zuul-jobs master: Add support for building PDFs https://review.opendev.org/664555 | 10:32 |
| *** ykarel is now known as ykarel|afk | 10:34 | |
| *** ykarel|afk is now known as ykarel | 10:35 | |
| *** ociuhandu has quit IRC | 10:35 | |
| *** dosaboy has quit IRC | 10:42 | |
| *** aluria has quit IRC | 10:42 | |
| *** jamesmcarthur has joined #openstack-infra | 10:55 | |
| *** jamesmcarthur has quit IRC | 11:00 | |
| *** tesseract has joined #openstack-infra | 11:08 | |
| *** ociuhandu has joined #openstack-infra | 11:08 | |
| *** ociuhandu has quit IRC | 11:09 | |
| *** ociuhandu has joined #openstack-infra | 11:09 | |
| *** ykarel is now known as ykarel|afk | 11:13 | |
| AJaeger | amotoki: you can pass vars, let me find an example... | 11:16 |
| AJaeger | amotoki: https://opendev.org/openstack/openstack-zuul-jobs/src/branch/master/zuul.d/project-templates.yaml#L279 or https://opendev.org/openstack/openstack-zuul-jobs/src/branch/master/zuul.d/jobs.yaml#L47 | 11:16 |
| *** udesale has quit IRC | 11:18 | |
| *** dave-mccowan has joined #openstack-infra | 11:19 | |
| *** dosaboy has joined #openstack-infra | 11:28 | |
| *** rh-jelabarre has joined #openstack-infra | 11:33 | |
| amotoki | AJaeger: what I am finding is like http://paste.openstack.org/show/760306/ but IIUC we cannot do it. | 11:34 |
| *** markvoelker has joined #openstack-infra | 11:35 | |
| amotoki | AJaeger: publish-openstack-docs-pti (and build-openstack-docs-pti) is defined in openstack-zuul-jobs, and each project cannot change 'build_pdf' var in .zuul.yaml..... | 11:35 |
| *** jamesmcarthur has joined #openstack-infra | 11:36 | |
| *** jamesmcarthur has quit IRC | 11:40 | |
| *** markvoelker has quit IRC | 11:40 | |
| *** jamesmcarthur has joined #openstack-infra | 11:43 | |
| *** roman_g has quit IRC | 11:43 | |
| *** roman_g has joined #openstack-infra | 11:46 | |
| *** bhavikdbavishi has joined #openstack-infra | 11:51 | |
| *** bhavikdbavishi1 has joined #openstack-infra | 11:54 | |
| *** ociuhandu has quit IRC | 11:54 | |
| *** ociuhandu has joined #openstack-infra | 11:54 | |
| *** bhavikdbavishi has quit IRC | 11:55 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 11:55 | |
| *** markvoelker has joined #openstack-infra | 11:57 | |
| *** rlandy has joined #openstack-infra | 12:02 | |
| *** rlandy is now known as rlandy|ruck | 12:03 | |
| *** rpittau|afk is now known as rpittau | 12:05 | |
| *** ykarel|afk is now known as ykarel | 12:08 | |
| AJaeger | amotoki: you can do that only on jobs, so would need to change the template or break it out... | 12:13 |
| *** ociuhandu has quit IRC | 12:24 | |
| *** jamesmcarthur has quit IRC | 12:24 | |
| *** jamesmcarthur has joined #openstack-infra | 12:25 | |
| *** jamesmcarthur has quit IRC | 12:29 | |
| mordred | fdegir: done | 12:32 |
| fdegir | mordred: thanks a lot! | 12:35 |
| AJaeger | mordred, could I trouble you with changes to use promote in tox-docs, please? https://review.opendev.org/677009 and https://review.opendev.org/677013 | 12:36 |
| *** jaosorior has quit IRC | 12:43 | |
| *** yamamoto has quit IRC | 12:47 | |
| *** auristor has quit IRC | 12:48 | |
| amotoki | AJaeger: thanks for double checking. I am first relieved my understanding is correct. I will add new variants and let's discuss the direction in the review. | 12:51 |
| *** jamesmcarthur has joined #openstack-infra | 12:52 | |
| *** mriedem has joined #openstack-infra | 12:53 | |
| AJaeger | amotoki: thanks! | 12:53 |
| *** ociuhandu has joined #openstack-infra | 12:57 | |
| *** ramishra has quit IRC | 12:57 | |
| *** ociuhandu has quit IRC | 12:58 | |
| *** ociuhandu has joined #openstack-infra | 12:58 | |
| *** jaosorior has joined #openstack-infra | 12:59 | |
| *** auristor has joined #openstack-infra | 12:59 | |
| *** yamamoto has joined #openstack-infra | 13:00 | |
| openstackgerrit | Akihiro Motoki proposed openstack/openstack-zuul-jobs master: Add support for building PDFs https://review.opendev.org/664555 | 13:01 |
| *** xenos76 has quit IRC | 13:01 | |
| mnaser | any infra-core around for https://review.opendev.org/#/c/676687/ ? :> | 13:02 |
| *** ramishra has joined #openstack-infra | 13:03 | |
| *** yamamoto has quit IRC | 13:04 | |
| *** ramishra has quit IRC | 13:05 | |
| *** yamamoto has joined #openstack-infra | 13:05 | |
| openstackgerrit | Merged zuul/zuul master: Include ref info in smtp reporter subjects https://review.opendev.org/677285 | 13:08 |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: WIP: builds: set missing start time for merger failure https://review.opendev.org/677466 | 13:09 |
| *** owalsh has quit IRC | 13:09 | |
| *** hogepodge has joined #openstack-infra | 13:09 | |
| sshnaidm | Does new logs interface have some json interface? How can I get log_url from https://zuul.opendev.org/t/openstack/build/17b451beedb94502a0a9f5e6167d4a95 ? | 13:11 |
| *** goldyfruit has quit IRC | 13:13 | |
| *** goldyfruit has joined #openstack-infra | 13:14 | |
| *** smarcet has joined #openstack-infra | 13:20 | |
| *** bhavikdbavishi has quit IRC | 13:24 | |
| *** yamamoto has quit IRC | 13:28 | |
| corvus | sshnaidm: https://zuul.opendev.org/api/tenant/openstack/build/17b451beedb94502a0a9f5e6167d4a95 | 13:29 |
| sshnaidm | corvus, great, thanks! | 13:30 |
| sshnaidm | corvus, where to keep up with zuul api so I won't bother people? | 13:30 |
| corvus | sshnaidm: there's documentation, but it's out of date. you could volunteer to keep it up to date, then you'd be an expert :) | 13:32 |
| frickler | mnaser: +2, but pinging infra-root would be a better way to highlight the correct people ;) | 13:32 |
| *** ykarel is now known as ykarel|away | 13:33 | |
| sshnaidm | corvus, ok, then at least where to look in code? :) | 13:33 |
| *** xenos76 has joined #openstack-infra | 13:33 | |
| *** aaronsheffield has joined #openstack-infra | 13:33 | |
| corvus | sshnaidm: zuul/web/__init__.py in the zuul repo | 13:34 |
| sshnaidm | corvus, thanks | 13:34 |
| *** udesale has joined #openstack-infra | 13:35 | |
| corvus | sshnaidm: the api docs are in web/public/openapi.yaml :) | 13:35 |
| corvus | they show up here when published: https://zuul.opendev.org/openapi | 13:36 |
| corvus | (there's an api link on the header bar) | 13:36 |
| *** rosmaita has left #openstack-infra | 13:36 | |
| *** ykarel|away has quit IRC | 13:40 | |
| *** ociuhandu has quit IRC | 13:41 | |
| *** owalsh has joined #openstack-infra | 13:41 | |
| *** Goneri has joined #openstack-infra | 13:41 | |
| *** eharney has joined #openstack-infra | 13:42 | |
| *** udesale has quit IRC | 13:42 | |
| *** sthussey has joined #openstack-infra | 13:42 | |
| *** udesale has joined #openstack-infra | 13:43 | |
| openstackgerrit | James E. Blair proposed zuul/zuul master: manager: specify report failure in logs https://review.opendev.org/671760 | 13:45 |
| *** ociuhandu has joined #openstack-infra | 13:46 | |
| *** ralonsoh has quit IRC | 13:48 | |
| *** udesale has quit IRC | 13:50 | |
| openstackgerrit | Merged openstack/openstack-zuul-jobs master: Use promote jobs for openstack-tox-docs https://review.opendev.org/677009 | 13:53 |
| *** ralonsoh has joined #openstack-infra | 13:55 | |
| openstackgerrit | Merged opendev/system-config master: ircbot: add #openstack-ansible-sig to bots https://review.opendev.org/676687 | 13:56 |
| *** ykarel|away has joined #openstack-infra | 13:59 | |
| AJaeger | corvus, infra-root, I want to send a short mail out about the promote docs job, draft is at https://etherpad.openstack.org/p/STDJ1veVNw . Do you have time to review and improve? | 13:59 |
| *** ykarel|away is now known as ykarel | 13:59 | |
| *** bobh has joined #openstack-infra | 14:00 | |
| corvus | AJaeger: fixed a minor typo and added some suggested text to hopefully answer the question "do people need to do anything for their projects?" | 14:02 |
| mordred | yeah - I fixed a couple of minor things - but I think it's a great email to send | 14:03 |
| *** kjackal has quit IRC | 14:04 | |
| *** janki has quit IRC | 14:04 | |
| *** goldyfruit has quit IRC | 14:04 | |
| *** ricolin has quit IRC | 14:04 | |
| AJaeger | thanks, corvus | 14:04 |
| AJaeger | and thanks mordred as well... | 14:04 |
| corvus | mordred, AJaeger: i updated the sentence in line 3 to clarify what i think was meant by "first document jobs" | 14:05 |
| *** liuyulong has joined #openstack-infra | 14:06 | |
| *** eernst has joined #openstack-infra | 14:06 | |
| *** bobh has quit IRC | 14:06 | |
| AJaeger | thanks - I updated as well a bit more | 14:07 |
| corvus | ++ | 14:07 |
| openstackgerrit | Akihiro Motoki proposed openstack/openstack-zuul-jobs master: Add support for building PDFs https://review.opendev.org/664555 | 14:08 |
| AJaeger | will sent it out now - thanks! | 14:09 |
| *** dave-mccowan has quit IRC | 14:12 | |
| *** yamamoto has joined #openstack-infra | 14:16 | |
| *** yamamoto has quit IRC | 14:16 | |
| *** yamamoto has joined #openstack-infra | 14:18 | |
| *** michael-beaver has joined #openstack-infra | 14:20 | |
| *** yamamoto has quit IRC | 14:20 | |
| *** yamamoto has joined #openstack-infra | 14:21 | |
| *** kjackal has joined #openstack-infra | 14:21 | |
| *** yamamoto has quit IRC | 14:22 | |
| *** yamamoto has joined #openstack-infra | 14:24 | |
| *** jeliu_ has joined #openstack-infra | 14:27 | |
| *** pkopec has quit IRC | 14:31 | |
| *** pkopec has joined #openstack-infra | 14:35 | |
| *** yamamoto has quit IRC | 14:35 | |
| openstackgerrit | Merged zuul/zuul master: Switch to review.opendev.org for README.rst https://review.opendev.org/676529 | 14:38 |
| AJaeger | changes just in gate fail promote pipeline - next time, we should change first the job and later move to promote. Hope those few fails are not a problem, otherwise we should revert the promote change | 14:38 |
| *** ykarel is now known as ykarel|away | 14:40 | |
| *** dpawlik has quit IRC | 14:41 | |
| *** yamamoto has joined #openstack-infra | 14:44 | |
| openstackgerrit | Merged zuul/zuul master: Use a requests session to simplify auth'd calls https://review.opendev.org/670511 | 14:44 |
| *** fresta has quit IRC | 14:56 | |
| *** openstackstatus has quit IRC | 14:58 | |
| *** openstack has joined #openstack-infra | 15:00 | |
| *** ChanServ sets mode: +o openstack | 15:00 | |
| *** ramishra has joined #openstack-infra | 15:01 | |
| openstackgerrit | Merged zuul/zuul master: manager: specify report failure in logs https://review.opendev.org/671760 | 15:02 |
| *** armax has joined #openstack-infra | 15:03 | |
| *** pkopec has quit IRC | 15:03 | |
| *** pkopec has joined #openstack-infra | 15:03 | |
| fungi | AJaeger: i can't even pull up the build results... http://zuul.opendev.org/t/openstack/buildset/940c5353b91c439dadef5ec9306056e4 for example just gives me a little spinny thing for minutes so far with no sign of stopping | 15:06 |
| AJaeger | fungi, I think those are the "old" jobs - new ones should be fine. | 15:07 |
| AJaeger | And looking at http://zuul.opendev.org/t/openstack/builds?pipeline=promote , we're starting to get green - cloudkitty was just promoted! | 15:07 |
| *** mattw4 has joined #openstack-infra | 15:07 | |
| *** chkumar|rover is now known as raukadah | 15:08 | |
| fungi | excellent | 15:08 |
| AJaeger | but timestamp looks off - will need to double check that in a bit... | 15:08 |
| AJaeger | yeah, from yesterday ;( | 15:09 |
| openstackgerrit | Merged openstack/project-config master: Remove now obsolete publish-jobs https://review.opendev.org/677013 | 15:09 |
| AJaeger | http://zuul.opendev.org/t/openstack/build/99d3f0cd807b4142a359a101ddb5b8ea/console#1/0/8/localhost looks correct, isn't it? | 15:09 |
| AJaeger | so, why is it not visible on docs.openstack.org/cloudkitty/latest with correct timestamp? | 15:10 |
| clarkb | AJaeger: need afs vos release? | 15:10 |
| clarkb | (that happens via cron) | 15:10 |
| fungi | roughly every 5 minutes i think? | 15:11 |
| *** electrofelix has joined #openstack-infra | 15:11 | |
| clarkb | that sounds right | 15:11 |
| *** icarusfactor has quit IRC | 15:12 | |
| AJaeger | 2019-08-20T15:02:12 was run - so, we're 10 mins past that | 15:13 |
| *** yamamoto has quit IRC | 15:14 | |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: Go back to normal publishing for tox-docs https://review.opendev.org/677481 | 15:15 |
| * AJaeger needs to step out for probably 2 hours. if you need a stop gap, please merge ^ | 15:15 | |
| *** noorul has joined #openstack-infra | 15:15 | |
| fungi | /usr/local/bin/release-volumes is run */5 * * * * on afsdb01.o.o, i'll check the log for it | 15:15 |
| clarkb | checking the log for ^ and then checking the RW volume contents are probably the next steps | 15:15 |
| AJaeger | I'll check back asap - and read backscroll. Thanks for looking into it. | 15:15 |
| *** bhavikdbavishi has joined #openstack-infra | 15:16 | |
| fungi | 2019-08-20 15:15:01,275 release INFO Releasing docs | 15:16 |
| fungi | no errors | 15:16 |
| fungi | is the content appearing in the read-write volume? (the one with the leading .) | 15:16 |
| AJaeger | did we publish to wrong path somehow? | 15:16 |
| AJaeger | /afs/.openstack.org/docs/openstack/cloudkitty/latest is correct, isn't it? | 15:16 |
| AJaeger | bbl | 15:17 |
| AJaeger | It'S wrong! Check http://files.openstack.org/docs/openstack/cloudkitty/ | 15:17 |
| AJaeger | an extra "openstack" ;( | 15:18 |
| fungi | whups | 15:18 |
| *** bhavikdbavishi1 has joined #openstack-infra | 15:19 | |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Fix docs promote publishing https://review.opendev.org/677486 | 15:19 |
| AJaeger | fix here ^ can we enqueue that one? | 15:19 |
| clarkb | looks like that dir is empty thoguh? | 15:20 |
| *** bhavikdbavishi has quit IRC | 15:20 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 15:20 | |
| AJaeger | and once that is merged, plesae delete the directory http://files.openstack.org/docs/openstack/ | 15:20 |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Store autohold requests in zookeeper https://review.opendev.org/661114 | 15:20 |
| AJaeger | clarkb: indeed - why that? | 15:20 |
| AJaeger | Now I'm out of ideas - and have to leave. | 15:20 |
| clarkb | I think that implies the artifact tarball would've been empty | 15:20 |
| AJaeger | let's check https://zuul.opendev.org/t/openstack/build/4210ee1a0be64b8cac8ed978abbaaee4 | 15:21 |
| AJaeger | so, https://review.opendev.org/677481 is stop-gap if needed... | 15:21 |
| AJaeger | bbl | 15:22 |
| clarkb | https://storage.bhs1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/logs_68/677468/3/gate/openstack-tox-docs/4210ee1/docs/ has content | 15:22 |
| clarkb | and the archive tarball has content too | 15:22 |
| *** sgw has joined #openstack-infra | 15:25 | |
| corvus | clarkb, fungi, mordred: here's another instance of the intermediate registry not having the expected blob: https://zuul.opendev.org/t/zuul/build/fcc8bdbb056c4b70a9400591d93b05c6 | 15:26 |
| corvus | i'm wondering if we should switch it back to using the local filesystem instead of swift | 15:26 |
| clarkb | corvus: we'll have to aggressively prune it if so (and that can't be done while the service is running?) | 15:27 |
| corvus | or maybe i should just write a registry service (there are several things we could improve by writing our own, and they're not that complicated) | 15:28 |
| clarkb | other ideas: maybe the s3 api is more reliable if we can use a swift with s3 api? | 15:29 |
| corvus | (authentication, pass-through, multiple hosts) | 15:30 |
| corvus | i never did get s3 working | 15:30 |
| corvus | we learned we were wrong about the cors thing before that | 15:30 |
| *** odicha has quit IRC | 15:31 | |
| *** dave-mccowan has joined #openstack-infra | 15:32 | |
| clarkb | ah | 15:34 |
| *** noorul has quit IRC | 15:34 | |
| *** noorul has joined #openstack-infra | 15:36 | |
| openstackgerrit | Merged openstack/os-performance-tools master: Remove the incorrect bug tracker link https://review.opendev.org/677163 | 15:36 |
| corvus | wow, it used to be in python: https://github.com/docker/docker-registry | 15:37 |
| mordred | corvus: I'm starting to think a service is not a terrible idea | 15:37 |
| mordred | because we keep running in to areas in which the existing things do almost what we want but not really - and things like this missing blob thing | 15:38 |
| mordred | corvus: also - I think I just learned another yamlism from that readme | 15:39 |
| corvus | mordred: the dict merge thing? | 15:40 |
| mordred | corvus: yeah. | 15:40 |
| corvus | what i *really* want is 'list append' but i don't think it has it. yet. | 15:40 |
| corvus | but i bet we could make use of the dict merge stuff in some complex jobs | 15:40 |
| mordred | yeah | 15:40 |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: docs: add test jobs howto https://review.opendev.org/676424 | 15:43 |
| clarkb | https://cf0f5f3cf3873fd8b4b8-b0f74dea23666e59f1fd76c410995d5c.ssl.cf1.rackcdn.com/677468/3/promote/promote-openstack-tox-docs/99d3f0c/ara-report/reports/23153148-5892-433a-9058-08bcbbb572fa.html are the relevant logs from that promote job for where it fetched, extracted and copied the contents of the docs archive | 15:44 |
| clarkb | I've fetched the same archive and extracted it locally. It is a valid archive with contents you would expect | 15:44 |
| donnyd | Can I add a baremetal flavor to FN so people can request a job be run on metal?? kinda like the expanded memory instance? | 15:44 |
| clarkb | the zuul_afs action doesn't seem to log much | 15:45 |
| *** gyee has joined #openstack-infra | 15:45 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: docs: add test jobs howto https://review.opendev.org/676424 | 15:46 |
| noorul | I have two PRs both changing the same file. If we merge them one by one then there will be a conflict. But when I approve these PRs in parallel, the gate pipeline tests them successfully. I was expecting it to fail because there is a merge conflict and the second one in the queue should run with first patch merged together. | 15:46 |
| corvus | noorul: is this a question for #zuul? | 15:47 |
| noorul | This is using bitbucket driver. I am not sure whether a driver has anything to do with this logic | 15:47 |
| noorul | corvus: Yes | 15:47 |
| *** dayou has joined #openstack-infra | 15:47 | |
| corvus | noorul: ah yep, it'd be best to repeat your question in the #zuul channel | 15:47 |
| noorul | Oops | 15:48 |
| openstackgerrit | Merged openstack/project-config master: Fix docs promote publishing https://review.opendev.org/677486 | 15:48 |
| noorul | sorry | 15:48 |
| corvus | noorul: np, we do it all the time :) | 15:48 |
| *** dayou_ has quit IRC | 15:50 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-jobs master: DNM: test match-on-config-updates for third-party-CI https://review.opendev.org/677499 | 15:50 |
| clarkb | TIL tar is smart enough to determine the compression type now (or at least we don't pass a -j) | 15:50 |
| mordred | clarkb: that's wonderful | 15:57 |
| clarkb | reading zuul_afs I think it is possible that the bad destination results in no source marker files which makes the copying not happen? I need more time to fully udnerstand what might happen in that case | 15:58 |
| clarkb | mordred: it is great that a command as old as tar can continue to improve over time :) | 15:58 |
| mordred | clarkb: and without just throwing everything out and releasing a new incompatible tool | 15:58 |
| *** udesale has joined #openstack-infra | 16:00 | |
| clarkb | ya we seem to only rsync content if there is a root marker | 16:00 |
| clarkb | but docs/openstack/cloudkitty is empty so doesn't have one? and ya the role writes a root marker conditionally but that condition wasn't tripped | 16:01 |
| clarkb | given that I think AJaeger's fix to the dir location should make this work | 16:01 |
| clarkb | (basically we nooped due to lack of root marker at the expected root) | 16:01 |
| *** ramishra has quit IRC | 16:02 | |
| clarkb | er wait no the markers it iterates over are on the source not the target | 16:02 |
| * clarkb checks the tarball | 16:02 | |
| clarkb | ya no root markers in the tarball | 16:03 |
| clarkb | so this may still fail due to taht once AJaeger's fix goes in. Will that result in us deleting content from afs? | 16:03 |
| clarkb | (I don't think so because rsync won't run) | 16:03 |
| *** jamesmcarthur has quit IRC | 16:03 | |
| *** lucasagomes has quit IRC | 16:04 | |
| *** jamesmcarthur has joined #openstack-infra | 16:05 | |
| clarkb | AJaeger: if we set write_root_marker then the job will write a root marker for us if we want that | 16:05 |
| clarkb | that may be the additional missing piece here | 16:05 |
| openstackgerrit | Tristan Cacqueray proposed zuul/nodepool master: openstack: handle safely invalid network name https://review.opendev.org/677501 | 16:07 |
| *** mattw4 has quit IRC | 16:08 | |
| clarkb | mriedem: if you get a chance can you quickly double check that elasticsearch data looks to be mostly back to normal now? | 16:09 |
| *** tdasilva has quit IRC | 16:11 | |
| mriedem | clarkb: looks ok on the e-r graph | 16:12 |
| mriedem | gap from friday to today | 16:12 |
| mriedem | with hits showing up today | 16:12 |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Store autohold requests in zookeeper https://review.opendev.org/661114 | 16:13 |
| *** jpena is now known as jpena|off | 16:14 | |
| *** eernst has quit IRC | 16:14 | |
| fungi | gap is expected, presumably | 16:14 |
| *** eernst has joined #openstack-infra | 16:14 | |
| clarkb | yes the gap is expected | 16:15 |
| *** rpittau is now known as rpittau|afk | 16:17 | |
| *** markvoelker has quit IRC | 16:17 | |
| *** eernst has quit IRC | 16:20 | |
| *** noorul has quit IRC | 16:20 | |
| *** noama has quit IRC | 16:20 | |
| *** kjackal has quit IRC | 16:22 | |
| clarkb | zbr: sshnaidm do you know if https://zuul.opendev.org/t/openstack/build/0d3a2390eb574917bd74dfc31a88b2bd/log/job-output.txt#1729 is a known issue in tripleo-ci's prepare-node role? | 16:24 |
| zbr | clarkb: yes, i know it. | 16:24 |
| clarkb | that currently results in a -1 to dib changes | 16:25 |
| *** e0ne has quit IRC | 16:25 | |
| *** noorul has joined #openstack-infra | 16:26 | |
| zbr | clarkb: https://review.opendev.org/#/c/676497/ was supposed to fix it, it would ever merge. | 16:27 |
| clarkb | infra-root anyone care to review https://review.opendev.org/#/c/677410/1 to increase the ra listening timeout to hopefully fix ipv4 in limestone? | 16:28 |
| clarkb | the test failure there is known to tripleo ^ | 16:28 |
| openstackgerrit | James E. Blair proposed zuul/zuul master: DNM: sample conversion of gerrit to bitbucket job https://review.opendev.org/677510 | 16:29 |
| openstackgerrit | James E. Blair proposed zuul/zuul master: DNM: sample conversion of gerrit to bitbucket job https://review.opendev.org/677510 | 16:31 |
| *** owalsh_ has joined #openstack-infra | 16:32 | |
| *** markvoelker has joined #openstack-infra | 16:33 | |
| *** owalsh has quit IRC | 16:35 | |
| *** spsurya has quit IRC | 16:36 | |
| AJaeger | clarkb: where do you see that write_root_marker is not set? | 16:37 |
| clarkb | AJaeger: the task was skipped which only happens if that value isn't truthy | 16:37 |
| clarkb | AJaeger: https://cf0f5f3cf3873fd8b4b8-b0f74dea23666e59f1fd76c410995d5c.ssl.cf1.rackcdn.com/677468/3/promote/promote-openstack-tox-docs/99d3f0c/ara-report/result/481f2753-1595-470d-8bcd-52034d27d474/ | 16:38 |
| AJaeger | thanks, clarkb. Let me check... | 16:39 |
| AJaeger | clarkb, I don't understand which conditional result should be false??? | 16:41 |
| clarkb | let me a get a link | 16:42 |
| AJaeger | zuul.branch should be defined for this | 16:42 |
| clarkb | AJaeger: https://opendev.org/opendev/base-jobs/src/branch/master/playbooks/docs/promote.yaml#L23-L27 the when there | 16:42 |
| clarkb | its the write_root_marker var | 16:43 |
| fungi | clarkb: is 677410 going to need to bypass gating to merge, or do those tripleo jobs need to be removed/nonvoting for now? | 16:43 |
| clarkb | fungi: I'm happy to set the job to non voting while it is broken | 16:44 |
| AJaeger | clarkb: I'm an idiot - that condition is broken ;( | 16:44 |
| clarkb | maybe we shoudl double check with tripleo that they still find taht useful? | 16:44 |
| openstackgerrit | Andreas Jaeger proposed opendev/base-jobs master: Fix docs promote playbook https://review.opendev.org/677512 | 16:45 |
| AJaeger | clarkb, fungi ^ | 16:46 |
| AJaeger | or should I set write_root_marker to True per default? | 16:46 |
| clarkb | AJaeger: I think having a default value of True might be easier to understand (it explicitly states by default this action should happen) | 16:46 |
| AJaeger | ok, will rework | 16:47 |
| openstackgerrit | Andreas Jaeger proposed opendev/base-jobs master: Fix docs promote playbook https://review.opendev.org/677512 | 16:48 |
| AJaeger | clarkb, fungi, next try - and thanks for debugging this! | 16:48 |
| AJaeger | hope that is the solution... | 16:48 |
| clarkb | AJaeger: we need the path fix too | 16:49 |
| openstackgerrit | Jeff Liu proposed zuul/zuul-operator master: Add PerconaXDB Cluster to Zuul-Operator https://review.opendev.org/677315 | 16:49 |
| AJaeger | clarkb: didn't that one merge? | 16:50 |
| clarkb | oh yup | 16:50 |
| clarkb | so we are good once 677512 is in I think | 16:50 |
| * AJaeger crosses fingers and prepares dinner... | 16:50 | |
| fungi | on 677512, the conditional will now allow for non-truthy values to also trigger inclusion of the role, right? | 16:51 |
| clarkb | fungi: not with the update | 16:51 |
| AJaeger | we want the inclusion by default ;) | 16:51 |
| *** armax has quit IRC | 16:51 | |
| fungi | it was previously when: "write_root_marker is defined and write_root_marker" | 16:51 |
| fungi | oh | 16:52 |
| clarkb | and now is when: write_root_marker | 16:52 |
| fungi | right, i had it backwards in my head | 16:52 |
| fungi | i was interpreting the new version as when: write_root_marker is defined | 16:52 |
| AJaeger | I didn't want the inclusion when write_root_marker was false. | 16:52 |
| AJaeger | But since it was undefined, the condition was wrong ;( | 16:53 |
| fungi | yep | 16:54 |
| fungi | makes sense now | 16:54 |
| fungi | and i guess ansible doesn't freak out if write_root_marker is undefined but used in a conditional | 16:55 |
| *** owalsh_ is now known as owalsh | 16:55 | |
| fungi | or was opendev-promote-docs-base the only job including the docs/promote playbook without setting a value? | 16:56 |
| clarkb | it will freak out, but I think that is the only place we use it? maybe we should double check taht | 16:57 |
| *** diablo_rojo has quit IRC | 16:58 | |
| *** diablo_rojo has joined #openstack-infra | 16:59 | |
| *** kjackal has joined #openstack-infra | 16:59 | |
| *** derekh has quit IRC | 16:59 | |
| AJaeger | opendev-promote-docs-base was the only job using that playbook | 17:02 |
| *** udesale has quit IRC | 17:04 | |
| *** jamesmcarthur has quit IRC | 17:04 | |
| openstackgerrit | Merged opendev/base-jobs master: Fix docs promote playbook https://review.opendev.org/677512 | 17:05 |
| fungi | cool, then hopefully we'll see it correct itself shortly | 17:06 |
| fungi | i'm happy to reenqueue any promote pipeline refs if needed | 17:06 |
| * AJaeger waits for next run ;) | 17:07 | |
| *** smarcet has quit IRC | 17:07 | |
| AJaeger | can anybody delete these empty dirs, please? http://files.openstack.org/docs/openstack/ | 17:07 |
| *** gyee has quit IRC | 17:09 | |
| AJaeger | yeah, it works "20 August 2019, 17.04.19 CEST" - https://docs.openstack.org/glance/latest/ | 17:10 |
| *** tesseract has quit IRC | 17:10 | |
| clarkb | AJaeger: I'll clean up the empty dirs | 17:11 |
| clarkb | the openstack/ parent dir can go away too right? | 17:11 |
| *** kjackal has quit IRC | 17:11 | |
| AJaeger | yes | 17:12 |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Fix publish path for api-jobs https://review.opendev.org/677519 | 17:13 |
| AJaeger | and one more promote error, sorry ;( ^ | 17:13 |
| *** mbuil has joined #openstack-infra | 17:14 | |
| *** smarcet has joined #openstack-infra | 17:14 | |
| clarkb | AJaeger: those dirs including openstack/ should be gone now | 17:14 |
| AJaeger | clarkb, fungi, could you review 677519 as well, please? | 17:15 |
| AJaeger | thanks, clarkb | 17:15 |
| AJaeger | thanks to both of you! | 17:15 |
| *** ykarel|away has quit IRC | 17:18 | |
| *** ociuhandu has quit IRC | 17:18 | |
| *** kopecmartin is now known as kopecmartin|off | 17:19 | |
| mbuil | mordred: I was told in the ironic channel that you could help me with a glean problem. DHCP gets started even if there is a config for an interface. As a result, when I see the log: "Started Glean for interface xxx", that interface is already configured with an ip. Any hint about what might be wrong? | 17:21 |
| *** gyee has joined #openstack-infra | 17:22 | |
| *** ykarel|away has joined #openstack-infra | 17:22 | |
| *** mattw4 has joined #openstack-infra | 17:24 | |
| *** bhavikdbavishi has quit IRC | 17:24 | |
| *** bhavikdbavishi has joined #openstack-infra | 17:27 | |
| *** ralonsoh has quit IRC | 17:28 | |
| openstackgerrit | Merged openstack/project-config master: Fix publish path for api-jobs https://review.opendev.org/677519 | 17:31 |
| clarkb | mbuil: your image probably has dhcp config for eth0 by default. You can clean those out. Though glean should run before networking is started | 17:31 |
| *** factor has joined #openstack-infra | 17:34 | |
| *** armax has joined #openstack-infra | 17:36 | |
| *** jamesmcarthur has joined #openstack-infra | 17:38 | |
| mbuil | clarkb: yes, it does. I wanted to understand why DHCP runs though. This does not happen in another image I have which uses py2. My new image with py3 has this problem | 17:41 |
| *** ykarel|away has quit IRC | 17:42 | |
| clarkb | mbuil: I don't think the version of python is going to affect it. Likely it has to do with service startup ordering | 17:42 |
| clarkb | mbuil: glean should execute before networking is started ensuring that glean overwrites any interface configuration that may be present | 17:43 |
| clarkb | but if that doesn't happen then the existing configs can be used | 17:43 |
| *** sshnaidm is now known as sshnaidm|afk | 17:44 | |
| *** tesseract has joined #openstack-infra | 17:45 | |
| openstackgerrit | Clark Boylan proposed openstack/project-config master: Revert "Include ref info on stmp reporter subjects" https://review.opendev.org/677523 | 17:45 |
| clarkb | AJaeger: ^ | 17:46 |
| *** smarcet has quit IRC | 17:47 | |
| *** igordc has joined #openstack-infra | 17:48 | |
| corvus | AJaeger, clarkb: actual problem: Exception: Job release-wheel-mirror depends on publish-wheel-mirror-centos-7 which was not run. | 17:51 |
| clarkb | corvus: fwiw I've been digging into the scheduler logs and having a hard time filtering out the relevant bits | 17:52 |
| clarkb | I do notice that the old subject line seems to be used though | 17:52 |
| AJaeger | clarkb: the error is much longer than when the change you reverted merged | 17:52 |
| clarkb | params {'subject': 'Stable check of {change.project} failed', 'to': 'openstack-stable-maint@lists.openstack.org', 'from': 'zuul@openstack.org'}, message: Build failed. | 17:52 |
| corvus | clarkb: here's what i did -- grabbed a buildset uuid from the list AJaeger supplied, grepped for that, found an event id (e: f0c0dd0e53d64681a2d8ed14c1a40f41) grepped for that, then found this line: | 17:53 |
| corvus | 2019-08-20 06:00:32,799 ERROR zuul.Pipeline.openstack.periodic: [e: f0c0dd0e53d64681a2d8ed14c1a40f41] Error freezing job graph for <QueueItem 0x7f18645dc470 for <Branch 0x7f18645dcba8 openstack/requirements refs/heads/stable/pike updated None..None> in periodic> | 17:53 |
| clarkb | ah | 17:53 |
| corvus | clarkb: and i grepped for the timestamp with "-C 200" to get the full error | 17:53 |
| corvus | the new "e: <eventid>" thing is really handy | 17:54 |
| AJaeger | so, why throw an CONFIG_ERROR if a job was not run? | 17:54 |
| clarkb | AJaeger: I think the error is that the job is specified to be run but does not exist? | 17:54 |
| clarkb | the freezing job graph happens on config generation time | 17:55 |
| corvus | AJaeger: we told zuul that we wanted it to always run release-wheel-mirror, and we told it that release-wheel-mirror always requires publish-wheel-mirror-centos-7 and we told it not to run publish-wheel-mirror-centos-7 | 17:55 |
| clarkb | (and that probably explains why the old subject is still used) | 17:55 |
| AJaeger | interesting... | 17:55 |
| corvus | that set of constraints is not resolvable, so it bails | 17:55 |
| AJaeger | so, which zuul config file needs updating? | 17:55 |
| clarkb | https://opendev.org/openstack/project-config/src/branch/master/zuul.d/projects.yaml#L4366-L4376 is where we set the dependencies | 17:56 |
| corvus | this is where we need to add more info to http://zuul.openstack.org/project/openstack/requirements -- it should answer that question, but it doesn't :( | 17:57 |
| clarkb | https://opendev.org/openstack/project-config/src/branch/master/zuul.d/jobs.yaml#L924-L934 is the job config | 17:57 |
| AJaeger | it has secrets - is that the problem? | 17:58 |
| AJaeger | we cannot run it on requirements? | 17:58 |
| clarkb | I think that is ok because the job is defined in a trusted repo | 17:58 |
| fungi | curious why this just started happening. looking for the change which set one of those constraints | 17:59 |
| clarkb | and applied to requirements in that same trusted repo | 17:59 |
| AJaeger | fungi: looking at http://zuul.opendev.org/t/openstack/buildsets?result=CONFIG_ERROR&pipeline=periodic it's a long list, so that's several days... | 17:59 |
| AJaeger | note it only errors on stable/ branches, not on master | 17:59 |
| clarkb | AJaeger: https://opendev.org/openstack/project-config/src/branch/master/zuul.d/jobs.yaml#L905 that is why then I think | 18:00 |
| AJaeger | pike is listed 9 times | 18:00 |
| corvus | https://opendev.org/openstack/project-config/src/branch/master/zuul.d/jobs.yaml#L903-L905 | 18:00 |
| corvus | clarkb: yep | 18:00 |
| clarkb | we should restrict release-wheel-mirror to master only too | 18:00 |
| AJaeger | agreed, good find, clarkb ! | 18:00 |
| AJaeger | who will fix? I can either fix or review ;) | 18:01 |
| corvus | 2019-08-20 06:00:32,788 DEBUG zuul.layout: [e: f0c0dd0e53d64681a2d8ed14c1a40f41] Variant <Job build-wheel-mirror-base branches: {MatchAny:{BranchMatcher:master}} source: openstack/project-config/zuul.d/jobs.yaml@ | 18:01 |
| corvus | master#1011> did not match <Branch 0x7f18645dcba8 openstack/requirements refs/heads/stable/pike updated None..None> | 18:01 |
| clarkb | AJaeger: I can push a change momentarily | 18:02 |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-jobs master: doc: note that mirror_info isn't actually implemented https://review.opendev.org/677529 | 18:04 |
| AJaeger | thanks, clarkb | 18:04 |
| openstackgerrit | Clark Boylan proposed openstack/project-config master: Restrict release-wheel-mirror job to master https://review.opendev.org/677530 | 18:04 |
| *** jamesmcarthur has quit IRC | 18:05 | |
| *** jamesmcarthur has joined #openstack-infra | 18:06 | |
| fungi | i'm still hunting for what caused this to start ~9 days ago. so far all of this seems to have been in place for a year or more | 18:09 |
| clarkb | fungi: restarted zuul and zuul got pickier maybe? | 18:09 |
| clarkb | I'm guessing before zuul would simply not run the job if it dependencies couldn't be resolved | 18:10 |
| *** jamesmcarthur has quit IRC | 18:12 | |
| *** mbuil has left #openstack-infra | 18:13 | |
| *** jamesmcarthur has joined #openstack-infra | 18:13 | |
| *** mbuil has joined #openstack-infra | 18:13 | |
| *** goldyfruit has joined #openstack-infra | 18:18 | |
| openstackgerrit | Merged openstack/project-config master: Restrict release-wheel-mirror job to master https://review.opendev.org/677530 | 18:25 |
| openstackgerrit | Merged zuul/zuul-jobs master: Update documentation for Debian/Ubuntu mirror_info https://review.opendev.org/675703 | 18:25 |
| *** noorul has quit IRC | 18:32 | |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Add more promote docs jobs https://review.opendev.org/677537 | 18:33 |
| *** markvoelker has quit IRC | 18:34 | |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/project-config master: Add ansible-role-uwsgi project https://review.opendev.org/677538 | 18:34 |
| openstackgerrit | Merged openstack/diskimage-builder master: simple-init: add configurable RA timeout with network-manager https://review.opendev.org/677410 | 18:35 |
| *** xarses_ has quit IRC | 18:35 | |
| *** electrofelix has quit IRC | 18:35 | |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/project-config master: Add os_murano project https://review.opendev.org/677538 | 18:36 |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Add more promote docs jobs https://review.opendev.org/677537 | 18:37 |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: Use promote for publish-tox-docs-infra https://review.opendev.org/677540 | 18:38 |
| *** xarses has joined #openstack-infra | 18:40 | |
| *** factor has quit IRC | 18:40 | |
| *** xarses has quit IRC | 18:40 | |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Add more promote docs jobs https://review.opendev.org/677537 | 18:40 |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/project-config master: Add os_murano project https://review.opendev.org/677538 | 18:41 |
| *** xarses has joined #openstack-infra | 18:41 | |
| *** xarses has quit IRC | 18:41 | |
| *** xarses has joined #openstack-infra | 18:42 | |
| AJaeger | config-core, one more promote review please: https://review.opendev.org/677537 | 18:43 |
| openstackgerrit | Merged zuul/zuul-jobs master: doc: note that mirror_info isn't actually implemented https://review.opendev.org/677529 | 18:45 |
| *** diga has quit IRC | 18:48 | |
| *** xarses_ has joined #openstack-infra | 18:49 | |
| *** xarses has quit IRC | 18:49 | |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Remove publish-openstack-tox-docs-direct https://review.opendev.org/677547 | 18:49 |
| Shrews | infra-root: Doesn't look like we've leaked anymore swift objects from failed image uploads to rax since the builder restart on the 15th with the latest openstacksdk. The 3 rax regions are now cleaned up, except for the ghost objects that just won't go away (dfw: 36, ord: 9, iad: 126). Those aren't hurting anything afaict. | 18:50 |
| AJaeger | looks like promote docs job work fine now and publish correctly. | 18:52 |
| * AJaeger calls it a day... | 18:52 | |
| clarkb | hurray to both swift and publishing | 18:52 |
| clarkb | AJaeger: enjoy your evening | 18:52 |
| AJaeger | thanks | 18:52 |
| AJaeger | and thanks for all the help | 18:52 |
| clarkb | we'll have our team meeting in just a few minutes over in #openstack-meeting. Join us at 19:00 UTC | 18:56 |
| *** jamesmcarthur has quit IRC | 18:58 | |
| fungi | thanks AJaeger! have a pleasant remainder of your evening | 19:00 |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/project-config master: Add os_murano project https://review.opendev.org/677538 | 19:02 |
| openstackgerrit | Merged openstack/project-config master: Add more promote docs jobs https://review.opendev.org/677537 | 19:07 |
| *** cjloader has left #openstack-infra | 19:10 | |
| *** cjloader has joined #openstack-infra | 19:13 | |
| AJaeger | argh, just found another problem - stable brnaches publish wrongly, we now have https://docs.openstack.org/python-tripleoclient/stable/stein/ with an extra "stable/" in there. How to get that one out? This is from http://zuul.opendev.org/t/openstack/build/842d894a561c44559d93935bc4054979 . We would need zuul.project.short_branch to make it easy to set in secrets.yaml. corvus, better ideas? | 19:15 |
| clarkb | AJaeger: I think there may be a jinja filter you could use to do that | 19:15 |
| clarkb | pabelanger or dmsimard may have thoughts on how to best do that | 19:18 |
| dmsimard | regexp_replace jinja filter ? | 19:19 |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/project-config master: Add os_murano project https://review.opendev.org/677538 | 19:20 |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/project-config master: Add os_murano project https://review.opendev.org/677538 | 19:22 |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Fix branch path for promote job https://review.opendev.org/677554 | 19:23 |
| AJaeger | thanks, dmsimard and clarkb. Here's a proposal ^ | 19:23 |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Fix branch path for promote job https://review.opendev.org/677554 | 19:24 |
| openstackgerrit | Andreas Jaeger proposed opendev/base-jobs master: Fix stable branch path https://review.opendev.org/677555 | 19:26 |
| AJaeger | if this is not correct, happy if somebody takes over - otherwise tomorrow... | 19:26 |
| *** jamesmcarthur has joined #openstack-infra | 19:28 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-jobs master: generate-zuul-manifest: add excludes list https://review.opendev.org/677556 | 19:32 |
| *** e0ne has joined #openstack-infra | 19:32 | |
| *** mriedem has quit IRC | 19:50 | |
| openstackgerrit | Merged openstack/project-config master: Fix branch path for promote job https://review.opendev.org/677554 | 19:52 |
| *** mriedem has joined #openstack-infra | 19:54 | |
| *** jamesmcarthur has quit IRC | 19:59 | |
| *** jamesmcarthur has joined #openstack-infra | 20:00 | |
| *** shadiakiki has joined #openstack-infra | 20:01 | |
| fungi | i need to cook dinner and write some newsletter content, but will be around somewhat for the remainder of the evening | 20:02 |
| shadiakiki | Bon Appétit. Thanks guys for being responsive about all my questions. It's amazing that you work so much in the open. | 20:03 |
| shadiakiki | fungi: about your comment about being a small team with limited time, | 20:06 |
| shadiakiki | I agree that most tools out there are perceived as complex and don't scale well without requiring more and more of your time | 20:07 |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-jobs master: generate-zuul-manifest: add excludes list https://review.opendev.org/677556 | 20:07 |
| shadiakiki | Anyway, I don't want to take up more of your time. Itll be a great boost for me if you find that this is an interesting subject that you'd be willing to contribute to | 20:09 |
| shadiakiki | For example in design discussions in the future. And I'll just leave this link here https://autofitcloud.com | 20:10 |
| *** diablo_rojo has quit IRC | 20:10 | |
| shadiakiki | Bye | 20:10 |
| *** markvoelker has joined #openstack-infra | 20:15 | |
| *** markvoelker has quit IRC | 20:16 | |
| *** markvoelker has joined #openstack-infra | 20:16 | |
| *** Lucas_Gray has joined #openstack-infra | 20:16 | |
| openstackgerrit | Merged opendev/system-config master: run_all.sh : add backup playbook https://review.opendev.org/675537 | 20:18 |
| fungi | oh, also just a heads-up that i'm not going to be around much tomorrow before the storyboard meeting... need to get my visa photo for shanghai, and we've got early voting underway for a special congressional election but i need to hop to an adjacent island to vote (so will run a couple of other errands we've been needing to do there since we don't get over to it very often) | 20:18 |
| ianw | pabelanger: https://review.opendev.org/#/c/676855/ was where i ended up on the fedora30 stuff ... bind mount before the relabel to ensure we get the underlying directories. it seems to work, not sure if you have any thoughts ... it's not pretty | 20:20 |
| ianw | i always think "this is it for dib, this is the one we just can't work around" but somehow it finds a way :) | 20:20 |
| *** shadiakiki has quit IRC | 20:21 | |
| *** kjackal has joined #openstack-infra | 20:22 | |
| *** shadiakiki has joined #openstack-infra | 20:23 | |
| shadiakiki | ianw btw here's a link to my mvp if you have servers on aws https://mvp.autofitcloud.com | 20:24 |
| ianw | clarkb: just put a couple of other bits for merge (promethanfire's gentoo update and arm64 efi partition fix) ... will do a dib release and rebuild centos after | 20:25 |
| *** shadiakiki has quit IRC | 20:26 | |
| *** factor has joined #openstack-infra | 20:26 | |
| *** diablo_rojo has joined #openstack-infra | 20:27 | |
| *** Goneri has quit IRC | 20:28 | |
| *** kjackal has quit IRC | 20:29 | |
| ianw | shadiakiki: one thing we don't have is any servers running on AWS | 20:30 |
| clarkb | ianw: do those need review? | 20:30 |
| ianw | clarkb: no, just waiting for them to get in at this point | 20:32 |
| *** guoqiao has joined #openstack-infra | 20:33 | |
| ianw | i dunno why mirror.opensuse is still showing as out of date in http://grafana.openstack.org/d/ACtl1JSmz/afs?orgId=1 | 20:34 |
| ianw | maybe it's the monitoring | 20:34 |
| ianw | | mirror.opensuse.readonly creation | 2019-07-26 02:10:11 | | 20:37 |
| ianw | ... but i released it yesterday :/ | 20:37 |
| ianw | Released volume mirror.opensuse successfully | 20:37 |
| *** jamesmcarthur has quit IRC | 20:40 | |
| *** jamesmcarthur_ has joined #openstack-infra | 20:40 | |
| *** eharney has quit IRC | 20:40 | |
| *** jamesmcarthur_ has quit IRC | 20:47 | |
| *** bhavikdbavishi has quit IRC | 20:47 | |
| *** e0ne has quit IRC | 20:50 | |
| clarkb | this afternoon is becoming a paperwork day for me. Ping if you need reviews or help with stuff | 20:54 |
| *** jamesmcarthur has joined #openstack-infra | 20:55 | |
| *** kjackal has joined #openstack-infra | 20:56 | |
| *** jamesmcarthur has quit IRC | 20:58 | |
| *** jamesmcarthur has joined #openstack-infra | 20:58 | |
| *** jamesmcarthur has quit IRC | 21:04 | |
| *** gfidente is now known as gfidente|afk | 21:07 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-jobs master: generate-zuul-manifest: add excludes list https://review.opendev.org/677556 | 21:11 |
| guilhermesp | infra-root: I'm hitting a failure on a job that is quit tricky to reproduce in a local vm. Is it possible to get a hold on openstack-ansible-deploy-aio_distro_metal-ubuntu-bionic over project openstack/openstack-ansible-os_heat (review #672948 ) ? | 21:14 |
| fungi | anybody have any idea how to get to logs for https://zuul.opendev.org/t/openstack/build/c553f0df9e7d45e9bb7a6e3aae9e5316 ? | 21:15 |
| * fungi can go spelunking in zuul service logs if necessary | 21:15 | |
| clarkb | donnyd: sorry I never got around to your question about baremetal flavors | 21:15 |
| clarkb | donnyd: I think we would be happy to experiment with that | 21:15 |
| guilhermesp | btw, pub keys :) https://github.com/guilhermesteinmuller.keys | 21:15 |
| fungi | guilhermesp: i can set up an autohold, just a sec | 21:16 |
| clarkb | donnyd: as a sanity check we give our jobs root, some providers have told us that means baremetal jobs basically would force them to not reuse the hardware. I think some clouds like rax use special firmware reflashing before reuse of hardware | 21:16 |
| guilhermesp | thanks fungi | 21:16 |
| clarkb | donnyd: somethign for you to consider depending on how manageable the hardware is an how expendable it might be | 21:16 |
| clarkb | that said it should mostly just work via nova's ironic driver | 21:17 |
| clarkb | using our existing images even | 21:17 |
| fungi | guilhermesp: i've done a `zuul autohold --tenant openstack --project openstack/openstack-ansible-os_heat --job openstack-ansible-deploy-aio_distro_metal-ubuntu-bionic --change 672948 --reason "guilhermesp debugging mysterious failure which won't reproduce locally" --count 1` so recheck that change at will if the job isn't already running for it | 21:19 |
| guilhermesp | nice fungi ! I will recheck right away | 21:19 |
| fungi | i'll keep an eye on it and as soon as the autohold triggers i'll add your ssh key and let you know the ip address | 21:20 |
| guilhermesp | i appreciate that | 21:20 |
| openstackgerrit | Merged openstack/diskimage-builder master: update gentoo systemd profile to 17.1 from 17.0 https://review.opendev.org/677290 | 21:21 |
| *** markvoelker has quit IRC | 21:22 | |
| donnyd | clarkb: I am checking all of our images now. Other cloud providers and this CP are a little different | 21:23 |
| *** bnemec has quit IRC | 21:27 | |
| donnyd | makes sense why someone would be concerned about malicious firmwares infecting a host in a public cloud. | 21:27 |
| *** diablo_rojo has quit IRC | 21:31 | |
| *** tesseract has quit IRC | 21:32 | |
| *** Lucas_Gray has quit IRC | 21:32 | |
| *** Lucas_Gray has joined #openstack-infra | 21:33 | |
| *** markvoelker has joined #openstack-infra | 21:35 | |
| *** armax has quit IRC | 21:35 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-jobs master: generate-zuul-manifest: add excludes list https://review.opendev.org/677556 | 21:36 |
| *** yamamoto has joined #openstack-infra | 21:38 | |
| *** yamamoto has quit IRC | 21:39 | |
| *** harlowja has joined #openstack-infra | 21:39 | |
| *** markvoelker has quit IRC | 21:40 | |
| fungi | donnyd: yeah, especially since there are viable proof-of-concept implementations in the wild of firmware/bios shims which intercept updates and preserve themselves | 21:41 |
| fungi | so even just reflashing everything doesn't help if you have to boot the machine from its existing bios to update the bios | 21:42 |
| fungi | having external hardware do the reflashing on the other hand can mitigate that | 21:42 |
| mriedem | can we put this out of its misery? https://review.opendev.org/#/c/507974/ | 21:43 |
| donnyd | In my case, someone would just be stealing data... from ci jobs.. I am thinking they would be pretty disappointed | 21:43 |
| *** mattw4 has quit IRC | 21:43 | |
| donnyd | Anyways I will keep tinkering with it. I only have 1 node available atm, so not super useful... | 21:44 |
| donnyd | working on getting that to 4ish | 21:44 |
| *** kjackal has quit IRC | 21:46 | |
| fungi | yeah, it becomes more of a risk if important decisions or artifacts result from the use of those machines | 21:49 |
| *** mattw4 has joined #openstack-infra | 21:51 | |
| ianw | although, it might be possible they run trusted jobs with secrets these days? | 21:52 |
| ianw | mriedem: is it blocking something? | 21:53 |
| mriedem | ianw: no, but been sitting in my dashboard for 2 years and it's trivial | 21:55 |
| mriedem | so i'd like to merge or abandon | 21:55 |
| fungi | ianw: yes, running jobs which install secrets onto the job node there would be a similar concern, though usually those only go as far as the executor | 21:55 |
| *** rcernin has joined #openstack-infra | 22:00 | |
| *** mattw4 has quit IRC | 22:02 | |
| *** trident has quit IRC | 22:02 | |
| *** Lucas_Gray has quit IRC | 22:04 | |
| *** mattw4 has joined #openstack-infra | 22:07 | |
| *** markvoelker has joined #openstack-infra | 22:10 | |
| *** trident has joined #openstack-infra | 22:11 | |
| *** zbr has quit IRC | 22:14 | |
| *** markvoelker has quit IRC | 22:15 | |
| *** zbr has joined #openstack-infra | 22:15 | |
| *** markvoelker has joined #openstack-infra | 22:29 | |
| openstackgerrit | James E. Blair proposed zuul/zuul-jobs master: Add configure-os-mirrors role https://review.opendev.org/677578 | 22:37 |
| *** jeliu_ has quit IRC | 22:40 | |
| *** markvoelker has quit IRC | 22:48 | |
| *** tkajinam has joined #openstack-infra | 22:55 | |
| fungi | guilhermesp: ssh root@162.242.235.61 | 22:56 |
| *** mattw4 has quit IRC | 23:03 | |
| *** mriedem has quit IRC | 23:05 | |
| *** xenos76 has quit IRC | 23:05 | |
| *** markvoelker has joined #openstack-infra | 23:12 | |
| *** zbr has quit IRC | 23:22 | |
| *** markvoelker has quit IRC | 23:22 | |
| *** zbr has joined #openstack-infra | 23:23 | |
| ianw | hrrm, this is an unexpected POST_FAILURE : https://zuul.opendev.org/t/openstack/build/6ea6dc95a7f64b35b394f73ffebe3743 | 23:30 |
| ianw | "WARNING:keystoneauth.discover:Failed to contact the endpoint at https://storage101.dfw1.clouddrive.com/v1/MossoCloudFS_ ..." | 23:33 |
| clarkb | I think that warning was said to be noise by mordred | 23:41 |
| clarkb | there should be a different failure like a 404 or 50x | 23:41 |
| *** sthussey has quit IRC | 23:42 | |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: upload-logs-swift: fix keystoneauth1 exceptions https://review.opendev.org/677584 | 23:57 |
| ianw | clarkb / modred / corvus : ^ from the logs, I think this caused it to fail when it didn't have to because it blew up on the missing exception | 23:57 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!