| *** mattw4 has quit IRC | 00:05 | |
| *** sshnaidm has quit IRC | 00:06 | |
| *** sshnaidm has joined #openstack-infra | 00:07 | |
| *** ahosam has quit IRC | 00:08 | |
| kevinz | clarkb: sure will take a look at that | 00:08 |
|---|---|---|
| *** ianychoi_ has joined #openstack-infra | 00:09 | |
| clarkb | kevinz: thank you! let me know if I can help at all | 00:09 |
| *** ianychoi has quit IRC | 00:11 | |
| *** rlandy is now known as rlandy|bbl | 00:22 | |
| openstackgerrit | Merged openstack/project-config master: Update hacking, fix errors/warnings https://review.opendev.org/702310 | 00:32 |
| openstackgerrit | Merged openstack/project-config master: Generate PEP503 index pages for wheel mirrors https://review.opendev.org/702299 | 00:35 |
| fungi | ianw: ^ | 00:36 |
| ianw | thanks! i'll see about babysitting for testing | 00:36 |
| clarkb | fungi: ianw if you get a chance review on https://review.opendev.org/#/c/702051/ would be great, though maybe don't approve today and I'll get it in the morning | 00:36 |
| clarkb | I've got a football game to watch real soon now | 00:36 |
| clarkb | mordred: go tigers right? | 00:37 |
| fungi | clarkb: oh, yep, i was watching to see how the changes to 702303 worked out | 00:37 |
| fungi | oh, wait, i was thinking of a different change | 00:38 |
| fungi | i guess this will cause a brief blip which could tank some running jobs for a few seconds every few months? | 00:40 |
| clarkb | fungi: yes | 00:41 |
| fungi | i don't suppose the impact from those outages is gauged to be less than the cost in complexity of available mitigations? | 00:51 |
| fungi | er, i *do* suppose | 00:51 |
| *** igordc has joined #openstack-infra | 00:51 | |
| fungi | (high availability of some description, or maybe buffered/cached request responses?) | 00:52 |
| clarkb | fungi: I spent about 10 minutes in cherrypy's docs looking for a "reset ssl config" option and couldn't find one. I think what we'd have to do is something like set SO_REUSEADDR, for new registry, wait for old requests on old registry to die then exit | 00:52 |
| clarkb | *fork a new registry | 00:52 |
| clarkb | then we'd need to send the appropriate signal to the running process on our side | 00:53 |
| fungi | or do some sort of a/b seesaw with a load balancer | 00:53 |
| *** jamesmcarthur has joined #openstack-infra | 00:54 | |
| clarkb | ya SO_REUSEADDR is sort of cheap version of a load balancer | 00:54 |
| fungi | i suppose if we observe worse than anticipated impact, we have options | 00:54 |
| clarkb | another option would be to terminate ssl in front of zuul-registry with something that knows how to reload its config | 00:54 |
| fungi | apache does a trick with gracefully swapping out a socket handler | 00:55 |
| clarkb | fungi: ya we should double check we are using that | 00:55 |
| *** tkajinam has quit IRC | 00:56 | |
| fungi | pretty sure last time i looked, reload with the initscript sent the graceful restart signal | 00:56 |
| clarkb | ya but I'm not sure our handler uses that | 00:57 |
| fungi | ahh | 00:57 |
| clarkb | and ya putting apache in front of zuul-registry is one of the options available to us | 00:57 |
| *** jamesmcarthur has quit IRC | 00:57 | |
| *** tkajinam has joined #openstack-infra | 00:59 | |
| *** jamesmcarthur has joined #openstack-infra | 00:59 | |
| *** jamesmcarthur has quit IRC | 01:04 | |
| *** jamesmcarthur has joined #openstack-infra | 01:06 | |
| openstackgerrit | Merged zuul/nodepool master: Delete dib images when all uploads set to deleting https://review.opendev.org/702062 | 01:13 |
| *** jamesmcarthur has quit IRC | 01:14 | |
| *** nicolasbock has quit IRC | 01:18 | |
| *** rh-jelabarre has quit IRC | 01:26 | |
| *** gyee has quit IRC | 01:34 | |
| *** igordc has quit IRC | 01:45 | |
| *** jamesmcarthur has joined #openstack-infra | 01:45 | |
| *** jamesmcarthur has quit IRC | 01:56 | |
| *** jamesmcarthur has joined #openstack-infra | 02:18 | |
| *** jamesmcarthur has quit IRC | 02:27 | |
| *** jamesmcarthur has joined #openstack-infra | 02:30 | |
| *** tetsuro has joined #openstack-infra | 02:33 | |
| *** roman_g has quit IRC | 02:34 | |
| *** tkajinam has quit IRC | 02:36 | |
| *** tkajinam has joined #openstack-infra | 03:02 | |
| ianw | oh, the wheels are in a/... b/... c/... (but the index hides that detail) ... hrm | 03:03 |
| ianw | ansible doesn't make this incredibly easy | 03:04 |
| clarkb | I think we mv them at the end so they arent that way | 03:09 |
| clarkb | but I wasnt looking too closely earlier | 03:09 |
| ianw | it's weird, the a links are not nested, but the directory structure is | 03:11 |
| ianw | i wonder if we paper over this in apache config | 03:11 |
| ianw | RewriteRule ^/wheel/([^/]+)/([^/])([^/]*)(/.*)?$ /wheel/$1/$2/$2$3$4 [L] | 03:13 |
| ianw | looks like we do ... so ok that can excuse some of my confusion | 03:13 |
| clarkb | ah | 03:14 |
| *** xinranwang has joined #openstack-infra | 03:18 | |
| *** rh-jelabarre has joined #openstack-infra | 03:22 | |
| *** gfidente|afk has quit IRC | 03:23 | |
| *** psachin has joined #openstack-infra | 03:35 | |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: Fix wheel index generation https://review.opendev.org/702331 | 03:45 |
| *** hongbin has joined #openstack-infra | 03:50 | |
| clarkb | ianw ^ will that fail on the non directory entries? | 03:52 |
| clarkb | since you cant chdir into that top level index.html | 03:52 |
| ianw | i don't think that matches */* ... in my testing at least | 03:54 |
| ianw | oh, i think i dropped a -d there | 03:54 |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: Fix wheel index generation https://review.opendev.org/702331 | 03:55 |
| *** psachin has quit IRC | 04:09 | |
| *** rh-jelabarre has quit IRC | 04:20 | |
| *** udesale has joined #openstack-infra | 04:21 | |
| *** jhesketh has quit IRC | 04:23 | |
| *** jhesketh has joined #openstack-infra | 04:24 | |
| *** rlandy|bbl has quit IRC | 04:24 | |
| *** jamesmcarthur has quit IRC | 04:25 | |
| *** jamesmcarthur has joined #openstack-infra | 04:27 | |
| openstackgerrit | Merged openstack/project-config master: Fix wheel index generation https://review.opendev.org/702331 | 04:27 |
| *** jamesmcarthur has quit IRC | 04:32 | |
| *** dchen has quit IRC | 04:33 | |
| *** dchen has joined #openstack-infra | 04:34 | |
| *** jamesmcarthur has joined #openstack-infra | 04:56 | |
| *** jamesmcarthur has quit IRC | 05:03 | |
| *** surpatil has joined #openstack-infra | 05:04 | |
| *** hongbin has quit IRC | 05:05 | |
| *** ykarel|away has joined #openstack-infra | 05:14 | |
| *** hongbin has joined #openstack-infra | 05:14 | |
| *** ykarel|away is now known as ykarel | 05:16 | |
| *** hongbin has quit IRC | 05:19 | |
| *** evrardjp has quit IRC | 05:33 | |
| *** evrardjp has joined #openstack-infra | 05:34 | |
| openstackgerrit | Ian Wienand proposed openstack/openstack-zuul-jobs master: Add CentOS 8 openafs package build job https://review.opendev.org/702348 | 05:43 |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: Add centos8 openafs client package build to periodic jobs https://review.opendev.org/702349 | 05:45 |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: Add <build|publish>-wheel-mirror-centos-8 jobs https://review.opendev.org/702350 | 05:45 |
| *** ociuhandu has joined #openstack-infra | 05:56 | |
| *** jamesmcarthur has joined #openstack-infra | 05:59 | |
| *** ociuhandu has quit IRC | 06:00 | |
| *** jamesmcarthur has quit IRC | 06:04 | |
| *** xinranwang has quit IRC | 06:07 | |
| *** pcaruana has quit IRC | 06:17 | |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: Add centos8 openafs client package build to periodic jobs https://review.opendev.org/702349 | 06:24 |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: Add <build|publish>-wheel-mirror-centos-8 jobs https://review.opendev.org/702350 | 06:24 |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: copy-wheels: ensure split actually splits https://review.opendev.org/702354 | 06:24 |
| *** jtomasek has joined #openstack-infra | 06:32 | |
| *** jamesmcarthur has joined #openstack-infra | 06:38 | |
| *** jamesmcarthur has quit IRC | 06:43 | |
| *** hamzy has quit IRC | 06:49 | |
| *** hamzy has joined #openstack-infra | 06:50 | |
| *** tetsuro has quit IRC | 06:53 | |
| *** tetsuro has joined #openstack-infra | 06:54 | |
| *** ccamacho has quit IRC | 07:00 | |
| *** lmiccini has joined #openstack-infra | 07:03 | |
| *** AJaeger has quit IRC | 07:08 | |
| openstackgerrit | Merged openstack/project-config master: copy-wheels: ensure split actually splits https://review.opendev.org/702354 | 07:08 |
| *** fdegir has quit IRC | 07:08 | |
| *** fdegir has joined #openstack-infra | 07:09 | |
| *** AJaeger has joined #openstack-infra | 07:11 | |
| *** ralonsoh has joined #openstack-infra | 07:12 | |
| *** jamesmcarthur has joined #openstack-infra | 07:15 | |
| *** jamesmcarthur has quit IRC | 07:20 | |
| openstackgerrit | Simon Westphahl proposed zuul/nodepool master: Fix missing node tuple arg in static provider https://review.opendev.org/702358 | 07:24 |
| *** pgaxatte has joined #openstack-infra | 07:24 | |
| *** tesseract has joined #openstack-infra | 07:41 | |
| *** kjackal has joined #openstack-infra | 07:45 | |
| *** ykarel is now known as ykarel|lunch | 07:47 | |
| *** jamesmcarthur has joined #openstack-infra | 07:50 | |
| *** ociuhandu has joined #openstack-infra | 07:52 | |
| *** ociuhandu has quit IRC | 07:52 | |
| *** rcernin has quit IRC | 07:52 | |
| *** jamesmcarthur has quit IRC | 07:55 | |
| *** ociuhandu has joined #openstack-infra | 07:55 | |
| *** ricolin has quit IRC | 07:55 | |
| yoctozepto | ianw: could one also ask for debian buster wheels? | 08:01 |
| yoctozepto | (that one being me representing kolla) | 08:01 |
| *** slaweq has joined #openstack-infra | 08:02 | |
| ianw | yoctozepto: yes, we could do, it would be similar to the centos8 above. i can put it on my todo | 08:02 |
| yoctozepto | ianw: thanks, appreciated! | 08:02 |
| *** dchen has quit IRC | 08:08 | |
| *** tosky has joined #openstack-infra | 08:08 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: admin REST API: zuul-web integration https://review.opendev.org/643536 | 08:14 |
| *** zbr|rover has quit IRC | 08:14 | |
| *** zbr has joined #openstack-infra | 08:15 | |
| *** jamesmcarthur has joined #openstack-infra | 08:15 | |
| openstackgerrit | Simon Westphahl proposed zuul/nodepool master: Fix missing node tuple arg in static provider https://review.opendev.org/702358 | 08:19 |
| *** ccamacho has joined #openstack-infra | 08:20 | |
| *** jamesmcarthur has quit IRC | 08:20 | |
| *** dpawlik has quit IRC | 08:22 | |
| *** tkajinam has quit IRC | 08:24 | |
| *** dpawlik has joined #openstack-infra | 08:27 | |
| openstackgerrit | Simon Westphahl proposed zuul/nodepool master: Fix missing node tuple arg in static provider https://review.opendev.org/702358 | 08:36 |
| *** iurygregory has joined #openstack-infra | 08:37 | |
| openstackgerrit | Simon Westphahl proposed zuul/nodepool master: Fix missing node tuple arg in static provider https://review.opendev.org/702358 | 08:37 |
| *** zhurong has quit IRC | 08:46 | |
| *** jpena|off is now known as jpena | 08:54 | |
| *** dmellado has quit IRC | 08:55 | |
| *** dmellado has joined #openstack-infra | 08:56 | |
| *** pcaruana has joined #openstack-infra | 08:56 | |
| *** ccamacho has quit IRC | 09:00 | |
| *** ykarel|lunch is now known as ykarel | 09:06 | |
| *** xek has joined #openstack-infra | 09:08 | |
| *** lucasagomes has joined #openstack-infra | 09:12 | |
| *** rpittau|afk is now known as rpittau | 09:16 | |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Fix occasionally wrong change url with github https://review.opendev.org/702378 | 09:30 |
| *** ramishra has quit IRC | 09:31 | |
| *** ramishra has joined #openstack-infra | 09:33 | |
| *** derekh has joined #openstack-infra | 09:39 | |
| *** gfidente has joined #openstack-infra | 09:41 | |
| *** ccamacho has joined #openstack-infra | 09:52 | |
| *** ociuhandu has quit IRC | 09:57 | |
| *** ociuhandu has joined #openstack-infra | 10:02 | |
| openstackgerrit | Sorin Sbarnea proposed zuul/zuul-jobs master: install-docker: allow removal of conflicting packages https://review.opendev.org/702304 | 10:06 |
| *** ramishra has quit IRC | 10:08 | |
| *** ramishra has joined #openstack-infra | 10:16 | |
| *** jamesmcarthur has joined #openstack-infra | 10:17 | |
| *** jamesmcarthur has quit IRC | 10:22 | |
| *** ociuhandu has quit IRC | 10:22 | |
| *** pcaruana has quit IRC | 10:23 | |
| openstackgerrit | Eyal proposed openstack/devstack-gate master: Use python3 for virtualenv if exists https://review.opendev.org/702126 | 10:29 |
| *** kjackal has quit IRC | 10:35 | |
| *** ociuhandu has joined #openstack-infra | 10:35 | |
| *** yolanda has joined #openstack-infra | 10:37 | |
| evrardjp | could I get some reviews on https://review.opendev.org/#/c/701530/ ? | 10:41 |
| evrardjp | it got quorum in governance, so I think we can go ahead. | 10:42 |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: Add spec for scale out scheduler https://review.opendev.org/621479 | 10:46 |
| *** ramishra has quit IRC | 10:58 | |
| *** pcaruana has joined #openstack-infra | 11:02 | |
| *** ramishra has joined #openstack-infra | 11:05 | |
| *** ramishra has quit IRC | 11:10 | |
| *** rpittau is now known as rpittau|bbl | 11:11 | |
| *** ramishra has joined #openstack-infra | 11:11 | |
| *** Lucas_Gray has joined #openstack-infra | 11:12 | |
| *** ociuhandu has quit IRC | 11:13 | |
| *** kjackal has joined #openstack-infra | 11:15 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: OIDCAuthenticator: add capabilities, scope option https://review.opendev.org/702275 | 11:15 |
| *** ramishra has quit IRC | 11:16 | |
| *** ociuhandu has joined #openstack-infra | 11:21 | |
| *** ramishra has joined #openstack-infra | 11:22 | |
| *** ramishra has quit IRC | 11:28 | |
| *** udesale has quit IRC | 11:28 | |
| *** ykarel is now known as ykarel|afk | 11:33 | |
| *** ykarel|afk has quit IRC | 11:39 | |
| *** tbachman has quit IRC | 11:43 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: OIDCAuthenticator: add capabilities, scope option https://review.opendev.org/702275 | 11:50 |
| *** ykarel|afk has joined #openstack-infra | 11:54 | |
| *** ykarel|afk is now known as ykarel | 11:54 | |
| *** dtantsur|afk is now known as dtantsur | 12:03 | |
| *** ociuhandu has quit IRC | 12:03 | |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Optionally support mitogen for job execution https://review.opendev.org/657024 | 12:04 |
| *** diablo_rojo has joined #openstack-infra | 12:07 | |
| *** ramishra has joined #openstack-infra | 12:22 | |
| *** Lucas_Gray has quit IRC | 12:23 | |
| *** Lucas_Gray has joined #openstack-infra | 12:25 | |
| *** dpawlik has quit IRC | 12:26 | |
| *** rfolco has joined #openstack-infra | 12:28 | |
| *** dpawlik has joined #openstack-infra | 12:28 | |
| *** jpena is now known as jpena|lunch | 12:31 | |
| *** ociuhandu has joined #openstack-infra | 12:39 | |
| *** ociuhandu has quit IRC | 12:43 | |
| mordred | clarkb: actually, that would be geaux tigers :) - go tigers was the other team | 12:46 |
| *** ramishra has quit IRC | 12:58 | |
| *** rlandy has joined #openstack-infra | 13:00 | |
| *** ociuhandu has joined #openstack-infra | 13:03 | |
| *** tbachman has joined #openstack-infra | 13:05 | |
| *** tbachman_ has joined #openstack-infra | 13:07 | |
| *** rh-jelabarre has joined #openstack-infra | 13:07 | |
| *** tbachman has quit IRC | 13:10 | |
| *** tbachman_ is now known as tbachman | 13:10 | |
| *** Lucas_Gray has quit IRC | 13:11 | |
| *** ykarel is now known as ykarel|afk | 13:11 | |
| *** jamesmcarthur has joined #openstack-infra | 13:16 | |
| *** surpatil has quit IRC | 13:21 | |
| *** iurygregory has quit IRC | 13:23 | |
| *** iurygregory has joined #openstack-infra | 13:23 | |
| *** aaronsheffield has joined #openstack-infra | 13:25 | |
| *** rpittau|bbl is now known as rpittau | 13:26 | |
| *** michael-beaver has joined #openstack-infra | 13:30 | |
| *** ykarel|afk is now known as ykarel|away | 13:33 | |
| *** jamesmcarthur has quit IRC | 13:33 | |
| *** jpena|lunch is now known as jpena | 13:33 | |
| *** liuyulong has joined #openstack-infra | 13:53 | |
| *** tkajinam has joined #openstack-infra | 13:56 | |
| *** pgaxatte has quit IRC | 13:57 | |
| openstackgerrit | Paul Albertella proposed zuul/nodepool master: Fix error (missing parameter) in static driver https://review.opendev.org/702436 | 14:01 |
| *** pgaxatte has joined #openstack-infra | 14:02 | |
| *** ociuhandu has quit IRC | 14:03 | |
| *** ociuhandu has joined #openstack-infra | 14:05 | |
| *** eharney has joined #openstack-infra | 14:16 | |
| *** ykarel|away is now known as ykarel | 14:17 | |
| *** iurygregory has quit IRC | 14:18 | |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Add --validate-tenants option to zuul scheduler https://review.opendev.org/542160 | 14:22 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Add --validate-tenants option to zuul scheduler https://review.opendev.org/542160 | 14:26 |
| *** Lucas_Gray has joined #openstack-infra | 14:27 | |
| *** ociuhandu has quit IRC | 14:29 | |
| *** udesale has joined #openstack-infra | 14:30 | |
| *** iurygregory has joined #openstack-infra | 14:33 | |
| *** sshnaidm is now known as sshnaidm|mtg | 14:44 | |
| *** liuyulong has quit IRC | 14:45 | |
| sean-k-mooney | hi quick question. did we disabel compressing the screen-* logs in the tempest based job for zuulv3 native jobs or do we have to do that in our own jobs | 14:46 |
| *** roman_g has joined #openstack-infra | 14:51 | |
| *** vesper has quit IRC | 14:53 | |
| *** vesper11 has joined #openstack-infra | 14:53 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: OIDCAuthenticator: add capabilities, scope option https://review.opendev.org/702275 | 14:59 |
| *** ramishra has joined #openstack-infra | 15:02 | |
| *** ociuhandu has joined #openstack-infra | 15:06 | |
| *** tkajinam has quit IRC | 15:10 | |
| fungi | sean-k-mooney: if the job doesn't compress those files, they are transparently compressed on upload to swift and then served to your browser/client either compressed or uncompressed depending on what content encoding it claims to accept | 15:11 |
| *** ociuhandu has quit IRC | 15:11 | |
| *** mattw4 has joined #openstack-infra | 15:12 | |
| fungi | if the job does compress them, they're uploaded raw without a compression content type and served as compressed files to your client unless you do something special | 15:12 |
| fungi | what symptom are you seeing? | 15:12 |
| openstackgerrit | Merged zuul/nodepool master: Fix missing node tuple arg in static provider https://review.opendev.org/702358 | 15:12 |
| gmann | clarkb: yeah, few projects started using python-requires>3.6 but not all. we can do this during end of py2-drop things when all cross/dependent projects drop py2 jobs. | 15:12 |
| *** davidlenwell has quit IRC | 15:13 | |
| *** dougwig has quit IRC | 15:13 | |
| fungi | sean-k-mooney: note that this did change a couple weeks ago, mainly to prevent things like gzipped tarballs getting silently decompressed by download tools | 15:13 |
| *** pgaxatte has quit IRC | 15:15 | |
| fungi | so now the rule of thumb is: if you want browsers to display text/html/json content to users, don't compress them in your jobs. if you want files to always be in a compressed form when retrieved (e.g., .tar.gz files) then make sure they are compressed by your job | 15:16 |
| *** dougwig has joined #openstack-infra | 15:17 | |
| *** davidlenwell has joined #openstack-infra | 15:18 | |
| sean-k-mooney | fungi: the job in question inherits from tempest-all and i do not expressly enable compression. i am seeing them be uploaded with a .gz exteiontion https://5cc56642d8b9842419c2-fa065b3d3badff7cb87ccafc6f749b5a.ssl.cf2.rackcdn.com/701533/1/check/networking-ovs-dpdk-tempest/8121f95/controller/logs/ | 15:21 |
| sean-k-mooney | if i brows this via the zuul ui it renders the compressed bytes | 15:22 |
| *** pgaxatte has joined #openstack-infra | 15:22 | |
| sean-k-mooney | fungi: yep i rememebr seeing you change that fixt the results html file but it looks like the default configuration of the tempest-all or one of its parents is incorrect and compressing the service logs | 15:23 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Add --validate-tenants option to zuul scheduler https://review.opendev.org/542160 | 15:23 |
| fungi | yeah, something in the job is compressing them | 15:23 |
| fungi | oh, is it a legacy job? | 15:24 |
| fungi | if so, devstack-gate compresses stuff | 15:24 |
| sean-k-mooney | no | 15:24 |
| sean-k-mooney | it is a zull v3 native job | 15:24 |
| sean-k-mooney | its also the same on other jobs | 15:25 |
| sean-k-mooney | https://zuul.opendev.org/t/openstack/build/210742a826434af8945f452f9f2e075f/logs | 15:25 |
| fungi | yeah, if it's not using devstack-gate then maybe this is a behavior of devstack | 15:25 |
| sean-k-mooney | that is form os-vif | 15:25 |
| fungi | or at least a behavior of the devstack job playbooks/roles | 15:25 |
| sean-k-mooney | looking at https://github.com/openstack/devstack/blob/master/.zuul.yaml i dont see it enabled | 15:27 |
| frickler | https://opendev.org/openstack/devstack/src/branch/master/roles/export-devstack-journal/tasks/main.yaml#L17 | 15:28 |
| frickler | Guess we should drop the "| gzip" part there | 15:28 |
| sean-k-mooney | ah | 15:28 |
| fungi | likely | 15:28 |
| sean-k-mooney | yes | 15:28 |
| sean-k-mooney | am want me to submit a patch to do that or will i leave it to ye | 15:29 |
| frickler | sean-k-mooney: if you propose it, I can +2 it, that would be my preferred solution ;) | 15:29 |
| sean-k-mooney | hehe that is what i was thinking too | 15:29 |
| * fungi appreciates sean-k-mooney's even more archaic spelling of the already archaic second-person singular | 15:29 | |
| sean-k-mooney | same here right https://opendev.org/openstack/devstack/src/branch/master/roles/export-devstack-journal/tasks/main.yaml#L32 | 15:30 |
| frickler | sean-k-mooney: yup | 15:31 |
| sean-k-mooney | fungi: ye is the plural of you rather then second-person singular | 15:31 |
| sean-k-mooney | what about the xz compressed devstack journal | 15:31 |
| sean-k-mooney | is it just gzip that is the issue or all commpression | 15:31 |
| frickler | sean-k-mooney: that isn't for direct viewing anyhow, so leaving it at xz seems fine to me | 15:32 |
| frickler | see https://opendev.org/openstack/devstack/src/branch/master/roles/export-devstack-journal/templates/devstack.journal.README.txt.j2 | 15:32 |
| sean-k-mooney | cool ill add you to the review when its up | 15:32 |
| sean-k-mooney | ah right i never use that myself | 15:33 |
| fungi | ahh, yep, ye was used for second-person plural pronoun (originally only nominative, later also for the objective). i was mistaking it for þee which often had typographically vague similarities | 15:34 |
| *** udesale_ has joined #openstack-infra | 15:34 | |
| * fungi has been away from university for far too long, apparently | 15:34 | |
| *** jamesmcarthur has joined #openstack-infra | 15:34 | |
| *** udesale has quit IRC | 15:37 | |
| sean-k-mooney | fungi: https://en.wikipedia.org/wiki/Hiberno-English#From_Old_and_Middle_English ye is still used commonly in ireland because in irish we have a plural form of you that is used with certin verbs | 15:37 |
| fungi | neat! | 15:38 |
| fungi | a fair amount of middle english still surfaces in more isolated communities here too. a couple islands south of here, where the only way in and out is by boat, still has a distinct brogue (though it's evolved heavily in the hundreds of years since it was settled). some of the small mountain towns near where i grew up were similar in that regard | 15:40 |
| *** ociuhandu has joined #openstack-infra | 15:42 | |
| *** ykarel is now known as ykarel|mtg | 15:43 | |
| *** Goneri has joined #openstack-infra | 15:44 | |
| *** davidlenwell has quit IRC | 15:48 | |
| *** dougwig has quit IRC | 15:48 | |
| *** dougwig has joined #openstack-infra | 15:52 | |
| *** davidlenwell has joined #openstack-infra | 15:52 | |
| *** jackedin has joined #openstack-infra | 15:52 | |
| *** jamesmcarthur has quit IRC | 15:55 | |
| *** jamesmcarthur has joined #openstack-infra | 15:55 | |
| sean-k-mooney | added ye both https://review.opendev.org/#/c/702465/1 | 15:56 |
| *** Lucas_Gray has quit IRC | 15:57 | |
| sean-k-mooney | how would you say that without using ye, "added both of you" "added you both" | 15:57 |
| sean-k-mooney | i guess both work it just sound weird to me | 15:57 |
| mordred | sean-k-mooney: added y'all | 16:01 |
| *** ccamacho has quit IRC | 16:02 | |
| JayF | not to be confused with "all y'all" which is the super-plural form (for large groups of people) ;) | 16:02 |
| mordred | (wjhich is the re-discovery of the need for ye - complete with disregarding prior art) | 16:02 |
| mordred | JayF: ++ | 16:02 |
| mordred | JayF: I think "all y'all" might be unique to southern | 16:02 |
| JayF | so was y'all when I was younger :P | 16:02 |
| mordred | nobody else has seemed to develop the need for the super-plural 2nd person | 16:02 |
| sean-k-mooney | hehe that is a very american form but y'all is ye all so it still uses ye. i guess it could be you all | 16:02 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Add --validate-tenants option to zuul scheduler https://review.opendev.org/542160 | 16:03 |
| mordred | sean-k-mooney: it should never be you all ;) | 16:03 |
| JayF | when I de-contractionalize y'all I say "you all" | 16:03 |
| sean-k-mooney | this is why we all comunicate better in python then english | 16:04 |
| JayF | I don't know, this is kinder than some code reviews I've gotten :P | 16:04 |
| sean-k-mooney | ok that is not always true but english is rahter ill defined at times | 16:04 |
| mordred | haha | 16:04 |
| clarkb | sean-k-mooney: frickler: correct re the xz'd journal file. We should leave that one as is. The xz compression was a compromise beacuse those files get rather large and xz compressed better than gz. Considering the file has to be processed locally by systemd to consume it we figured that was reasonable | 16:07 |
| *** ramishra_ has joined #openstack-infra | 16:07 | |
| *** ykarel|mtg is now known as ykarel | 16:08 | |
| *** ramishra has quit IRC | 16:09 | |
| sean-k-mooney | clarkb: i asked the same question earlier and frickler linked me to https://opendev.org/openstack/devstack/src/branch/master/roles/export-devstack-journal/templates/devstack.journal.README.txt.j2 | 16:10 |
| clarkb | ianw: http://mirror.dfw.rax.openstack.org/wheel/ubuntu-18.04-x86_64/greenlet/index.html.test appears to be the last generated index file (and it seems to have gone in order alphabetically) | 16:11 |
| sean-k-mooney | so ya i think it should be left as is give its intended usage and as you siad it grows large | 16:11 |
| clarkb | ianw: what we've got there looks good except for it stopping halfway through the list. Also haven't been able to find any with requires-python attributes in the html | 16:11 |
| *** arxcruz is now known as arxcruz|off | 16:13 | |
| *** ykarel is now known as ykarel|away | 16:14 | |
| *** dave-mccowan has joined #openstack-infra | 16:18 | |
| *** zxiiro has joined #openstack-infra | 16:19 | |
| zbr | this was waiting for W for >3 months, is still valid? https://review.opendev.org/#/c/631509/ | 16:21 |
| clarkb | zbr: did it get tested on review-dev? | 16:21 |
| zbr | clarkb: clearly it got merged there, but not sure how to force it generate a DISK_FULL error. | 16:22 |
| clarkb | zbr: you should be able to leave a comment as your user on review-dev to show the DISK_FULL rendering | 16:22 |
| clarkb | I don't think you need to force it from the CI side in this case. Instead leave a comment as your user with the same format (possibly copied from review.opendev.org) | 16:23 |
| fungi | though to force disk_full you could make a job which tries to log a gigabyte of /dev/urandom | 16:23 |
| openstackgerrit | Clark Boylan proposed zuul/nodepool master: Use iterate_timeout in test waits https://review.opendev.org/702303 | 16:25 |
| *** dosaboy has quit IRC | 16:28 | |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: DNM: Try out test sharding for tox-py35 https://review.opendev.org/702473 | 16:28 |
| *** kjackal_v2 has joined #openstack-infra | 16:29 | |
| *** kjackal has quit IRC | 16:32 | |
| openstackgerrit | Merged opendev/system-config master: Manage insecure-ci-registry cert with LE https://review.opendev.org/702051 | 16:32 |
| *** hamzy has quit IRC | 16:33 | |
| *** dave-mccowan has quit IRC | 16:36 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/diskimage-builder master: Add non-voting ironic jobs to the CI https://review.opendev.org/702474 | 16:37 |
| *** dave-mccowan has joined #openstack-infra | 16:38 | |
| openstackgerrit | Merged zuul/zuul master: executor: prevent restart exception on bad build log https://review.opendev.org/702228 | 16:42 |
| *** rfarr has joined #openstack-infra | 16:42 | |
| *** gyee has joined #openstack-infra | 16:42 | |
| *** udesale_ has quit IRC | 16:43 | |
| openstackgerrit | Merged zuul/zuul master: Authorization rules: support YAML nested dictionaries https://review.opendev.org/684790 | 16:44 |
| *** jpena is now known as jpena|brb | 16:45 | |
| *** surpatil has joined #openstack-infra | 16:53 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: OIDCAuthenticator: add capabilities, scope option https://review.opendev.org/702275 | 16:58 |
| *** pgaxatte has quit IRC | 16:59 | |
| *** lucasagomes has quit IRC | 17:00 | |
| *** rpittau is now known as rpittau|afk | 17:01 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: OIDCAuthenticator: add capabilities, scope option https://review.opendev.org/702275 | 17:01 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: DNM: Try out test sharding for tox-py35 https://review.opendev.org/702473 | 17:04 |
| clarkb | infra-root I'm going to restart nodepool builders on nb01, nb02, and nb03 now | 17:05 |
| clarkb | this picks up the deletion of image files as soon as all cloud providers enter a deleting state change as well as a static provider fix (which we don't use) | 17:05 |
| clarkb | Shrews: we probably want to restart the launchers and make a release if a few days? | 17:05 |
| clarkb | #status log Restarted nodepool-builders on nodepool==3.10.1.dev41 # git sha b0c0d27 | 17:07 |
| openstackstatus | clarkb: finished logging | 17:08 |
| *** rfarr has quit IRC | 17:08 | |
| *** gfidente is now known as gfidente|afk | 17:11 | |
| *** dpawlik has quit IRC | 17:14 | |
| *** kjackal_v2 has quit IRC | 17:16 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: WIP: Import user tutorials from Software Factory project blog https://review.opendev.org/702487 | 17:18 |
| Shrews | tristanC: \o/ | 17:19 |
| Shrews | "If you build it, they will come." | 17:20 |
| *** ociuhandu_ has joined #openstack-infra | 17:20 | |
| tristanC | Shrews: heh, there is still a lot of work left to adapt the content to the zuul-quick-start environment | 17:22 |
| *** mattw4 has quit IRC | 17:22 | |
| *** ociuhandu has quit IRC | 17:24 | |
| *** jpena|brb is now known as jpena | 17:24 | |
| *** ociuhandu_ has quit IRC | 17:24 | |
| *** ociuhandu has joined #openstack-infra | 17:26 | |
| *** ociuhandu has quit IRC | 17:28 | |
| *** hamzy has joined #openstack-infra | 17:33 | |
| *** evrardjp has quit IRC | 17:33 | |
| *** evrardjp has joined #openstack-infra | 17:34 | |
| *** kjackal has joined #openstack-infra | 17:34 | |
| clarkb | insecure-ci-registry.opendev.org has an LE cert now | 17:39 |
| clarkb | certcheck validates it as does firefox | 17:40 |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Documentation reorg https://review.opendev.org/701608 | 17:47 |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Extract project config YAML into ref docs https://review.opendev.org/701977 | 17:47 |
| *** dosaboy has joined #openstack-infra | 17:59 | |
| *** sshnaidm|mtg is now known as sshnaidm|afk | 18:00 | |
| *** derekh has quit IRC | 18:00 | |
| *** surpatil has quit IRC | 18:04 | |
| openstackgerrit | Monty Taylor proposed opendev/system-config master: Switch to ansible on review-dev https://review.opendev.org/702496 | 18:05 |
| mordred | clarkb: service-review-dev.yaml playbook seems to run happily - although nothing is currently plumbed through - so that ^^ should get it going going | 18:06 |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Extract project config YAML into ref docs https://review.opendev.org/701977 | 18:09 |
| *** tbachman has quit IRC | 18:09 | |
| *** tbachman has joined #openstack-infra | 18:10 | |
| *** mattw4 has joined #openstack-infra | 18:10 | |
| *** jamesmcarthur has quit IRC | 18:10 | |
| *** mattw4 has quit IRC | 18:15 | |
| *** mattw4 has joined #openstack-infra | 18:15 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: WIP: Import user tutorials from Software Factory project blog https://review.opendev.org/702487 | 18:17 |
| *** jamesmcarthur has joined #openstack-infra | 18:20 | |
| *** mattw4 has quit IRC | 18:22 | |
| *** jpena is now known as jpena|off | 18:29 | |
| fungi | clarkb: thanks for getting that le cert done! | 18:32 |
| openstackgerrit | Paul Belanger proposed zuul/zuul-jobs master: Add github-workflows job https://review.opendev.org/702502 | 18:32 |
| *** dtantsur is now known as dtantsur|afk | 18:32 | |
| *** ahosam has joined #openstack-infra | 18:33 | |
| openstackgerrit | Merged zuul/nodepool master: Use iterate_timeout in test waits https://review.opendev.org/702303 | 18:36 |
| *** jamesmcarthur has quit IRC | 18:43 | |
| openstackgerrit | Paul Belanger proposed zuul/zuul-jobs master: Add github-workflows job https://review.opendev.org/702502 | 18:43 |
| *** lmiccini has quit IRC | 18:44 | |
| openstackgerrit | Clark Boylan proposed zuul/zuul master: Add note about GitHub Action limitations https://review.opendev.org/702503 | 18:45 |
| *** ykarel|away has quit IRC | 18:50 | |
| *** ykarel|away has joined #openstack-infra | 18:58 | |
| *** jamesmcarthur has joined #openstack-infra | 18:59 | |
| ianw | clarkb: yeah ... i realised there's no python3 on !bionic by default so the script fails on other wheel builds | 19:05 |
| fungi | oh, oops | 19:05 |
| fungi | i missed that | 19:05 |
| *** mattw4 has joined #openstack-infra | 19:07 | |
| clarkb | ianw: it seems to have gotten only part way through the bionic list though too | 19:07 |
| clarkb | something else might be tripping it up | 19:07 |
| fungi | fd buffering maybe | 19:08 |
| *** pcaruana has quit IRC | 19:16 | |
| *** ykarel|away has quit IRC | 19:17 | |
| *** factor has joined #openstack-infra | 19:18 | |
| corvus | #status log removed gerrit sysvinit scripts from review-dev01 | 19:19 |
| openstackstatus | corvus: finished logging | 19:19 |
| *** jackedin has quit IRC | 19:21 | |
| ianw | clarkb: POST-RUN END RESULT_TIMED_OUT: [trusted : opendev.org/openstack/project-config/playbooks/publish/wheel-mirror.yaml@master] | 19:21 |
| ianw | i think, upon reflection, we might have to do the directory walk in python. it's *super* slow doing it in ansible | 19:21 |
| *** gfidente|afk is now known as gfidente | 19:24 | |
| clarkb | ianw: ya the per task overhead is really high :( | 19:25 |
| *** armax has joined #openstack-infra | 19:30 | |
| openstackgerrit | Merged opendev/system-config master: Switch to ansible on review-dev https://review.opendev.org/702496 | 19:31 |
| openstackgerrit | Jeremy Stanley proposed opendev/zone-opendev.org master: Reorganize zonefile https://review.opendev.org/701833 | 19:33 |
| *** gmann is now known as gmann_afk | 19:36 | |
| *** jamesmcarthur has quit IRC | 19:43 | |
| *** jamesmcarthur has joined #openstack-infra | 19:44 | |
| fungi | clarkb: so we use a service module for apache2 and set state: restarted | 19:49 |
| fungi | according to https://docs.ansible.com/ansible/latest/modules/service_module.html#parameters there's also state: reloaded | 19:49 |
| clarkb | fungi: cool did you want to make that update? if not I can do it | 19:50 |
| fungi | yeah, still digging into the underlying implementation of the module | 19:50 |
| fungi | but will do if it looks like it's sane and we didn't select restarted for some subtle reason | 19:50 |
| clarkb | I think we may have selected restarted because on investigating it seemd we needed a restart for certs to update. Since then I think that may have been for older apache and now that isn't necessary? | 19:51 |
| *** jamesmcarthur has quit IRC | 19:52 | |
| *** jamesmcarthur has joined #openstack-infra | 19:53 | |
| fungi | yeah, there is technically no "reload" in apache2ctl anyway, it's either graceful or ungraceful restarts | 19:55 |
| *** slaweq has quit IRC | 20:02 | |
| mordred | corvus: are we thinking do the same with sysvinit scripts for review when we do it? (or should we add a file: absent to the playbook?) | 20:05 |
| *** ralonsoh has quit IRC | 20:06 | |
| corvus | mordred: i'm happy either way; if it's not too hard, file will help us remember. if it is hard, no big deal. | 20:06 |
| mordred | corvus: should be easy enough I'd hope | 20:07 |
| mordred | also - I kinda think we should maybe split the manage-projects sequence from the overall review config management and make it a different playbook ... but am I overthinking that? | 20:07 |
| *** hamzy_ has joined #openstack-infra | 20:08 | |
| corvus | mordred: yeah, but that can probably only happen once puppet isn't used on any of the manage-projects hosts | 20:09 |
| corvus | i dunno though, i haven't thought that through completely | 20:09 |
| corvus | i am in favor of that whenever it can happen | 20:10 |
| * corvus lunches | 20:10 | |
| mordred | corvus: ++ | 20:10 |
| fungi | clarkb: so in our cases, it looks like https://github.com/ansible/ansible/blob/devel/lib/ansible/modules/system/service.py is going to execute either the apache2 initscript or systemctl and pass the reload action to them if we specify state: reloaded | 20:10 |
| fungi | so it comes down to the platform | 20:11 |
| clarkb | fungi: cool and reload action is what we want to get graceful restart right? | 20:11 |
| *** hamzy has quit IRC | 20:11 | |
| fungi | at least the initscript i was looking at does so, yes | 20:13 |
| fungi | what platforms are we dealing with in this case? | 20:13 |
| clarkb | fungi: xenial and bionic | 20:14 |
| fungi | i guess xenial, bionic, ... anything we care about in container images? | 20:14 |
| clarkb | containers are all running not apache at this point | 20:14 |
| clarkb | mordred: ^ is the review-dev container setup running an apache? | 20:14 |
| fungi | k | 20:14 |
| mordred | clarkb: not running an apache in the container | 20:15 |
| fungi | so on xenial, /etc/init.d/apache2 reload does apache2ctl graceful | 20:15 |
| clarkb | after lunch I'm going to take the hiera/hostvars lock | 20:16 |
| clarkb | I need to clean up unused and expiring certs from there | 20:16 |
| fungi | on bionic, systemd has a ExecReload=/usr/sbin/apachectl graceful | 20:16 |
| fungi | so i think we're clear on using state: reloaded | 20:17 |
| fungi | patch on the way now | 20:17 |
| clarkb | ++ | 20:17 |
| mordred | clarkb: hrm. I think I may have missed that bit with gerrit in container | 20:17 |
| fungi | unrelated | 20:17 |
| AJaeger | team, ianychoi_ , amotoki , translation jobs for dashboard repos fail - a requirement (Pint) is only available >= python 3.6 but we must run on Xenial for the zanata tools (Java 8). Example failure: http://zuul.opendev.org/t/openstack/build/b7f614b119a34da8be2620906cea32ef . mordred, I think we need to put zanta-cli in a container for uploading ;( Or has anybody a better idea - and wants to dig | 20:18 |
| AJaeger | further into this? | 20:18 |
| clarkb | ya this is the set of things that got LetsEncrypted over the last few days. I need to clean out their old cert config from hiera | 20:18 |
| fungi | mordred: this was letsencrypt management of reloading apache to make sure it switches to/notices replaced certs | 20:18 |
| mordred | oh - no - what I mean is ... | 20:18 |
| clarkb | AJaeger: can we pin pint? | 20:18 |
| mordred | I forgot to add the apache in front of the gerrit | 20:18 |
| mordred | in the new ansible | 20:18 |
| fungi | ahh | 20:18 |
| clarkb | mordred: oh! | 20:18 |
| mordred | clarkb: java versions | 20:18 |
| mordred | so - I was suggesting making a conatiner image for the translation tools since we've got a bunch of version stuff going on that's getting weird | 20:19 |
| mordred | AJaeger: can you point me to where we install zanata tools? | 20:19 |
| AJaeger | clarkb: it's in upper-requirements ;( | 20:19 |
| clarkb | ah | 20:19 |
| AJaeger | mordred: openstack-zuul-jobs, I give you a link ... | 20:20 |
| clarkb | pint==0.9 doesn't not require python3.6 fwiw | 20:20 |
| AJaeger | mordred: https://opendev.org/openstack/openstack-zuul-jobs/src/branch/master/roles/prepare-zanata-client | 20:20 |
| mordred | AJaeger: thanks. I can take a quick stab at making an image and we can see if that would then let us run translation jobs on bionic | 20:20 |
| AJaeger | thanks, mordred . | 20:20 |
| AJaeger | clarkb: yeah, the requirements change to update to Pint 0.10.1 broke it ;( | 20:21 |
| clarkb | https://packages.ubuntu.com/bionic/openjdk-8-jdk bionic has java-8 too | 20:22 |
| clarkb | AJaeger: ^ would that work on bionic if we installed java 8 there? | 20:22 |
| AJaeger | clarkb: yes, should. | 20:22 |
| AJaeger | I think our images have version 11, so we need to downgrade... | 20:23 |
| clarkb | I think you can install them side by side. At least that link doesn't show 8 conflicting with 11 | 20:24 |
| openstackgerrit | Jeremy Stanley proposed opendev/system-config master: Gracefully restart Apache after cert replacements https://review.opendev.org/702511 | 20:25 |
| AJaeger | clarkb: we install default-jre-headless - see https://opendev.org/openstack/openstack-zuul-jobs/src/branch/master/roles/prepare-zanata-client/vars/Debian.yaml | 20:26 |
| AJaeger | Changing that might just be enough... | 20:26 |
| fungi | AJaeger: clarkb: yes, debian and its derivatives have traditionally allowed multiple jdks coinstalled | 20:26 |
| fungi | similar to installing multiple python interpreter versions | 20:26 |
| AJaeger | mordred: let me send a patch using Bionic... | 20:26 |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: Require JDK 8 for translations https://review.opendev.org/702515 | 20:29 |
| *** slaweq has joined #openstack-infra | 20:33 | |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Use Bionic for translation jobs https://review.opendev.org/702516 | 20:35 |
| AJaeger | here're the two changes needed ^ | 20:35 |
| AJaeger | mordred: that might be easier to do. But all depends how long we have Zanata in OpenDev | 20:35 |
| *** hamzy__ has joined #openstack-infra | 20:43 | |
| *** hamzy_ has quit IRC | 20:46 | |
| *** tesseract has quit IRC | 20:50 | |
| *** hamzy_ has joined #openstack-infra | 20:51 | |
| *** hamzy__ has quit IRC | 20:53 | |
| *** jamesmcarthur has quit IRC | 20:59 | |
| *** jtomasek has quit IRC | 21:01 | |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: Add centos8 openafs client package build to periodic jobs https://review.opendev.org/702349 | 21:02 |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: Add <build|publish>-wheel-mirror-centos-8 jobs https://review.opendev.org/702350 | 21:02 |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: copy-wheels : generate indexes version 2 https://review.opendev.org/702531 | 21:02 |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Fix nits from initial reorg https://review.opendev.org/702532 | 21:02 |
| *** hamzy__ has joined #openstack-infra | 21:02 | |
| ianw | clarkb: ^^ lessons learnt from first attempt | 21:02 |
| ianw | http://paste.openstack.org/show/788383/ is an example of data-requires-python | 21:02 |
| *** jamesmcarthur has joined #openstack-infra | 21:03 | |
| *** hamzy_ has quit IRC | 21:04 | |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: copy-wheels : generate indexes version 2 https://review.opendev.org/702531 | 21:04 |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: Add centos8 openafs client package build to periodic jobs https://review.opendev.org/702349 | 21:04 |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: Add <build|publish>-wheel-mirror-centos-8 jobs https://review.opendev.org/702350 | 21:05 |
| ianw | infra-root: if i could get an eye on https://review.opendev.org/#/c/702348/ i will test it today -- it builds our local copy of centos-8 openafs rpm files, which we use in the openafs-client role | 21:06 |
| amotoki | AJaeger: I think it is an issue in upper-constraints.txt in the requirements repo. It was updated in https://review.opendev.org/#/c/701104/9/upper-constraints.txt (bot change). | 21:06 |
| donnyd | Anyone else having an issue responding to openstack-discuss | 21:06 |
| donnyd | It complains about my message size being larger than 40kb | 21:06 |
| amotoki | AJaeger: if Pint 0.10 does not work with python35, it looks better to cap for python <=3.5. | 21:07 |
| amotoki | AJaeger: in addition, I wonder whether horizon really need to require Pint itself..... it is not imported in horizon.... | 21:08 |
| *** hamzy_ has joined #openstack-infra | 21:10 | |
| *** hamzy__ has quit IRC | 21:13 | |
| fungi | donnyd: if you send large messages to the mailing list, especially ones with attachments, they'll wind up in the moderation queue for me or another mod to approve | 21:15 |
| fungi | just as a sanity check so that nobody sends a massive message to a mailing lists which has thousands of subscribers | 21:16 |
| *** jamesmcarthur has quit IRC | 21:16 | |
| donnyd | Hrm, well it was a simple response in text only to a message that had just been sent | 21:17 |
| *** eernst has joined #openstack-infra | 21:18 | |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Extract project config YAML into ref docs https://review.opendev.org/701977 | 21:19 |
| clarkb | donnyd: if the email you are replying ti was html that can account for it too as those grow large quickly | 21:20 |
| *** hamzy has joined #openstack-infra | 21:22 | |
| *** hamzy_ has quit IRC | 21:23 | |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Fix nits from initial reorg https://review.opendev.org/702532 | 21:26 |
| donnyd | Oh this happens to every message I respond to, but only on openstack-discuss | 21:26 |
| donnyd | "Message body is too big: 171907 bytes with a limit of 40 KB" | 21:26 |
| clarkb | donnyd: can you instpect the raw message content and see if anything stands out? | 21:28 |
| donnyd | Probably... I was just curious if anyone else had reported an issue with it | 21:29 |
| fungi | doesn't seem to be an actual issue but i'll take a look at the message | 21:31 |
| fungi | Attachment #2: image001.png Size: 72K | 21:32 |
| fungi | Attachment #3: image001.png Size: 72K | 21:32 |
| fungi | looks like you're replying without trimming the quoted material (also top-posting! tsk tsk ;)) and reincluding screenshots from prior messages as well as an html attachment | 21:34 |
| fungi | so it's no surprise the message is large relative to what's typical on that ml | 21:35 |
| clarkb | ianw: small thing on https://review.opendev.org/#/c/702531/2 that the linter caught | 21:35 |
| fungi | donnyd: some tips to keep your message size down when communicating on mailing lists: https://wiki.openstack.org/wiki/MailingListEtiquette | 21:36 |
| clarkb | ianw: that affects the rest of the stack but I dont see anything elsewrong with it | 21:37 |
| clarkb | ianw: can you review https://review.opendev.org/#/c/702511/ to update LE restart_apache handler to be graceful reload? | 21:38 |
| openstackgerrit | Merged openstack/openstack-zuul-jobs master: Add CentOS 8 openafs package build job https://review.opendev.org/702348 | 21:38 |
| amotoki | AJaeger: requirements patch to cap Pint for py35 https://review.opendev.org/702538 and horizon patch to drop Pint which is unused https://review.opendev.org/702539 | 21:39 |
| donnyd | fungi so you are telling me I shouldn't use gmail anymore 🤣 | 21:39 |
| donnyd | Lol | 21:39 |
| fungi | donnyd: that wiki page even has gmail-specific tips | 21:41 |
| donnyd | Oh nice | 21:41 |
| donnyd | Thanks fungi and clarkb as always :) | 21:41 |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Fix nits from initial reorg https://review.opendev.org/702532 | 21:42 |
| fungi | donnyd: but yeah, i gather gmail is especially bad about going to extreme lengths to hide from you what it is you're sending to the internet | 21:42 |
| donnyd | Well from my phone it just looks like a normal response. I have never really looked deeply at gmail to see what it does | 21:43 |
| clarkb | infra-root I am releasing the hiera/host vars lock now | 21:45 |
| clarkb | claened up the old cert data | 21:45 |
| *** jamesmcarthur has joined #openstack-infra | 21:46 | |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: copy-wheels : generate indexes version 2 https://review.opendev.org/702531 | 21:46 |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: Add centos8 openafs client package build to periodic jobs https://review.opendev.org/702349 | 21:46 |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: Add <build|publish>-wheel-mirror-centos-8 jobs https://review.opendev.org/702350 | 21:46 |
| openstackgerrit | Merged zuul/zuul master: Documentation reorg https://review.opendev.org/701608 | 21:46 |
| *** kjackal has quit IRC | 21:47 | |
| *** hamzy_ has joined #openstack-infra | 21:50 | |
| openstackgerrit | Clark Boylan proposed opendev/system-config master: Update registry testing to use LE https://review.opendev.org/702541 | 21:50 |
| clarkb | infra-root ^ is a cleanup related to the LEification of zuul-registry. I failed to update the testing for that service to also use LE | 21:51 |
| *** tbachman has quit IRC | 21:53 | |
| *** hamzy has quit IRC | 21:53 | |
| *** mattw4 has quit IRC | 21:55 | |
| *** hamzy_ has quit IRC | 21:58 | |
| *** hamzy has joined #openstack-infra | 21:59 | |
| *** hamzy_ has joined #openstack-infra | 22:06 | |
| *** rcernin has joined #openstack-infra | 22:08 | |
| *** hamzy has quit IRC | 22:09 | |
| *** tbachman has joined #openstack-infra | 22:12 | |
| openstackgerrit | Clark Boylan proposed zuul/zuul master: Add note about GitHub Action limitations https://review.opendev.org/702503 | 22:13 |
| clarkb | ianw: https://review.opendev.org/#/c/702531/3 lgtm | 22:19 |
| ianw | thanks; i might again babysit this ... i'll remove any current temp files manually now | 22:22 |
| openstackgerrit | Merged openstack/diskimage-builder master: allow building of Gentoo images for non-systemd profiles https://review.opendev.org/700258 | 22:22 |
| *** jamesmcarthur has quit IRC | 22:23 | |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: Add <build|publish>-wheel-mirror-centos-8 jobs https://review.opendev.org/702350 | 22:28 |
| *** tbachman has quit IRC | 22:30 | |
| openstackgerrit | Merged opendev/system-config master: Gracefully restart Apache after cert replacements https://review.opendev.org/702511 | 22:30 |
| clarkb | mordred: for the webserver on review-dev is the plan to run that in a container too or have ansible configure it on the host? | 22:31 |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: Add centos8 openafs client package build to periodic jobs https://review.opendev.org/702349 | 22:31 |
| clarkb | an upside to running it on the host is potentially easier LE cert renewals. Will apache2 in a container properly gracefully restart (thinking there is no init there though I guess we could add an init) | 22:32 |
| clarkb | even if we apachectl graceful'd I would worry about zombie processes leakign | 22:32 |
| *** xek has quit IRC | 22:33 | |
| *** slaweq has quit IRC | 22:34 | |
| fungi | yeah, likely needs an init to reap child processes | 22:42 |
| clarkb | wow so gerrit pushed the hooks implementation into a plugin then neglected to move the docs? | 22:52 |
| clarkb | ah no they are hidden | 22:53 |
| clarkb | master actually points to them from the readme thankfully | 22:53 |
| *** gmann_afk is now known as gmann | 22:53 | |
| *** tkajinam has joined #openstack-infra | 22:55 | |
| openstackgerrit | Merged openstack/project-config master: Add centos8 openafs client package build to periodic jobs https://review.opendev.org/702349 | 22:58 |
| *** igordc has joined #openstack-infra | 22:58 | |
| *** igordc has quit IRC | 23:01 | |
| *** igordc has joined #openstack-infra | 23:01 | |
| *** igordc has quit IRC | 23:02 | |
| corvus | things are quieting down; how about a zuul restart? | 23:03 |
| clarkb | gmann: ianw fungi https://review.opendev.org/#/c/702126/10 is ready now to plug the python version gap on d-g if you all have a moment to review that | 23:03 |
| *** igordc has joined #openstack-infra | 23:03 | |
| clarkb | corvus: seems reasonably quiet. I would say grab the check-arm64 queue too | 23:03 |
| corvus | i think the new script grabs everything! | 23:04 |
| clarkb | even better | 23:04 |
| *** igordc has quit IRC | 23:06 | |
| *** igordc has joined #openstack-infra | 23:07 | |
| fungi | so 702126... is that going to be okay for older stable branch jobs on platforms where python3 is available? devstack-gate is branchless, so... | 23:07 |
| fungi | curious if anybody tested this with some stable branch changes setting it as a depends-on | 23:08 |
| ianw | clarkb: yeah, i do not know what legacy-tempest-dsvm-neutron-full-centos-7 is doing there, it is somehow picking up python3.5 | 23:08 |
| clarkb | fungi: it should be, we are running a new enough ansible version there (2.7.something) that it should just work | 23:08 |
| clarkb | ianw: I think that job was never updated to disable python3 after python3 became the devstack default | 23:08 |
| clarkb | ianw: I was starting to look at that too | 23:08 |
| fungi | i guess this will select python 2.7 on xenial unless we go out of our way to install python3? | 23:09 |
| clarkb | fungi: right, but also that python venv is used to install an ansible that does stack.sh execution | 23:09 |
| fungi | and 3.6 on bionic | 23:09 |
| ianw | fungi: and it's just for the virtualenv that installs the ansible that drives the rest of the script too? so that shouldn't really leak into the job, as such | 23:09 |
| clarkb | fungi: as long as ansible can run under that python3 it shouldn't matter what branch we are talking about | 23:09 |
| *** igordc has quit IRC | 23:09 | |
| clarkb | (and I believe ansible 2.7 is new enough to be python3 happy) | 23:09 |
| fungi | ahh, i'll reread. for some reason i thought it was a general virtualenv wrapper for devstack's use | 23:10 |
| *** igordc has joined #openstack-infra | 23:10 | |
| corvus | the release queue looks clear, i'm going to start a full zuul restart now | 23:11 |
| *** igordc has quit IRC | 23:11 | |
| *** igordc has joined #openstack-infra | 23:12 | |
| openstackgerrit | Clark Boylan proposed openstack/openstack-zuul-jobs master: Force python2 on CentOS 7 d-g legacy job https://review.opendev.org/702554 | 23:14 |
| *** igordc has quit IRC | 23:14 | |
| clarkb | ianw: ^ I think that may fix it (assuming that is the only problem) | 23:14 |
| *** igordc has joined #openstack-infra | 23:15 | |
| *** tosky has quit IRC | 23:15 | |
| *** hwoarang has quit IRC | 23:15 | |
| ianw | i'm guessing nobody really looks at that job | 23:16 |
| *** igordc has quit IRC | 23:19 | |
| clarkb | corvus: Shrews: thinking maybe we should restart the nodepool launchers too? I did the builders earlier today | 23:22 |
| clarkb | but then we can do a nodepool and zuul release together? | 23:22 |
| *** hwoarang has joined #openstack-infra | 23:22 | |
| corvus | clarkb, Shrews: sounds good | 23:22 |
| clarkb | k I'll get working on that | 23:23 |
| corvus | i think it would be fine to do that now or at any time later | 23:23 |
| clarkb | yup loading my ssh key now | 23:23 |
| corvus | (scheduler has restarted, executors are still stopping) | 23:23 |
| ianw | heh, the status page currently shows "-1 hr -7 min" for what's managed to get in the queue | 23:24 |
| fungi | proof zuul *does* test the future | 23:25 |
| fungi | it can now test changes before they're even proposed | 23:25 |
| fungi | (or conceived) | 23:26 |
| clarkb | alright restarting nl01-04's launchers now | 23:26 |
| clarkb | and done | 23:27 |
| clarkb | they are all running nodepool==3.10.1.dev43 # git sha 9036dd7 if you want to incorporate that into your log mesage for zuul | 23:27 |
| clarkb | that is one test only change ahead of where the builders restarted | 23:28 |
| clarkb | so should be able to tag that commit if everything is happy | 23:28 |
| *** dchen has joined #openstack-infra | 23:29 | |
| corvus | zuul restart is done; re-enqueue is in progress | 23:30 |
| *** armax has quit IRC | 23:30 | |
| corvus | #status log restarted all of zuul at e6d8b210cc416ed494b0b0248404e3e6d7ce337c | 23:30 |
| openstackstatus | corvus: finished logging | 23:30 |
| clarkb | #status log restarted nodepool launchers at nodepool==3.10.1.dev43 # git sha 9036dd7 | 23:30 |
| *** ociuhandu has joined #openstack-infra | 23:30 | |
| openstackstatus | clarkb: finished logging | 23:30 |
| *** dchen has quit IRC | 23:32 | |
| *** dchen has joined #openstack-infra | 23:33 | |
| *** ociuhandu has quit IRC | 23:35 | |
| *** hamzy_ has quit IRC | 23:38 | |
| *** tbachman has joined #openstack-infra | 23:38 | |
| ianw | it does actually seem that the enqueue time is, possibly in the future? | 23:39 |
| corvus | ianw: it looks normal to me | 23:39 |
| corvus | i see "unknown/18 minutes" for the oldest change in the check pipeline. | 23:40 |
| clarkb | me too | 23:40 |
| clarkb | the unknown/18 minutes that is | 23:40 |
| ianw | x/tobiko | 23:41 |
| ianw | 700824,13 | 23:41 |
| ianw | unknown | 23:41 |
| ianw | -1 hr -2 min | 23:41 |
| corvus | ianw: still happen after a reload? | 23:41 |
| clarkb | ianw: huh it shows me unknown, 7 minutes | 23:41 |
| ianw | now all the jobs are queued, it goes back to 0 | 23:42 |
| ianw | this was after a shift-reload, i'll see if i can get it again | 23:43 |
| ianw | yep, can see it on the next change too, hrm | 23:43 |
| *** tbachman_ has joined #openstack-infra | 23:44 | |
| corvus | ianw: it might be worth considering local clock/timezone issues | 23:44 |
| ianw | https://imgur.com/a/vObmAJ8 | 23:44 |
| corvus | though i don't know what would cause change[-2] to be different than change[-1]. | 23:45 |
| *** tbachman has quit IRC | 23:46 | |
| *** tbachman_ is now known as tbachman | 23:46 | |
| ianw | hrrmm, yes it seems like my VM is a few minutes behind. almost exactly how long it would have been suspended when i rebooted recently | 23:46 |
| clarkb | the status json might offer a clue? | 23:46 |
| *** aaronsheffield has quit IRC | 23:49 | |
| ianw | ok, my time is back in sync (for now? i'm not sure what timesyncd actually does, if not keep time in sync) | 23:50 |
| ianw | i was only about 9 minutes behind, but somehow that confused the calculations into that -1 hour i guess | 23:51 |
| corvus | huh. i guess timesyncd just syncs time in a better way that isn't immediately obvious to me. and i guess zuul helpfully provides an indicator that your clock is wrong. | 23:52 |
| openstackgerrit | Merged openstack/openstack-zuul-jobs master: Force python2 on CentOS 7 d-g legacy job https://review.opendev.org/702554 | 23:52 |
| corvus | teamwork | 23:52 |
| *** ahosam has quit IRC | 23:55 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!