| fungi | got it, so any in-repo job fixes for tag-triggered jobs will need a new tag | 00:00 |
|---|---|---|
| clarkb | that is my hunch | 00:00 |
| clarkb | for the same reason that jobs with branch restrictions don't apply to tags | 00:00 |
| clarkb | basically the tag exists in its own mini universe without externally inferred state | 00:01 |
| fungi | now i feel like i'm watching a string theory documentary | 00:02 |
| corvus | is that more approachable than "speculative execution"? | 00:03 |
| fungi | the many universes model of zuul | 00:03 |
| *** mattw4 has quit IRC | 00:03 | |
| corvus | i think clarkb is right; i also think our reliance on centrally defined jobs for tags and reluctance to replace tagged artifacts means this is largely unexplored space | 00:03 |
| *** ociuhandu has joined #openstack-infra | 00:04 | |
| fungi | okay, still no luck | 00:06 |
| fungi | 2020-02-26 00:03:38,684 DEBUG zuul.layout: [e: 3a97242756fb4ba892843a01854b9460] No matching parents for job openstackid-release-branch and change <Tag 0x7f2e0c1c4320 osf/openstackid creates refs/tags/3.0.3 on 7dff48831caa6f4a808482669818ba338bd259f6> | 00:06 |
| fungi | that job is parented on publish-openstack-artifacts | 00:06 |
| fungi | which has no parents and no branch matchers | 00:07 |
| fungi | and the job doesn't itself have a branch matcher | 00:07 |
| fungi | publish-openstack-artifacts is defined in openstack/project-config so i shouldn't need to require the repo either | 00:08 |
| fungi | i feel like i'm missing something very obvious | 00:08 |
| clarkb | its possible that the tag context is such that it can't find the parent jobs at all? | 00:08 |
| corvus | fungi: well, the previous line is telling: | 00:08 |
| corvus | 2020-02-26 00:03:38,684 DEBUG zuul.layout: [e: 3a97242756fb4ba892843a01854b9460] Variant <Job openstackid-release-branch branches: {MatchAny:{BranchMatcher:master}} source: osf/op | 00:09 |
| corvus | enstackid/.zuul.yaml@master#1> did not match <Tag 0x7f2e0c1c4320 osf/openstackid creates refs/tags/3.0.3 on 7dff48831caa6f4a808482669818ba338bd259f6> | 00:09 |
| fungi | where is that branch matcher coming from? | 00:09 |
| fungi | i must be blind | 00:09 |
| *** ociuhandu has quit IRC | 00:09 | |
| corvus | fungi: it's a branch matcher on the job itself because it's defined in a branched repo (openstackid has 2 branches) | 00:10 |
| corvus | it's possible this is the first time we've had that situation | 00:10 |
| fungi | huh | 00:10 |
| corvus | fungi: has this ever worked? | 00:10 |
| corvus | (was the last release using a job defined in project-config?) | 00:11 |
| fungi | i don't think it has successfully released since moving jobs in-tree | 00:11 |
| fungi | i'm trying to get the jobs rewritten to non-legacy because they were parented on jobs with branch matchers to start with | 00:11 |
| fungi | so just now ripped out a bunch of zuul-cloner cruft and copied in some novel bits from old jenkins slave scripts | 00:12 |
| corvus | fungi: i think a workaround for now would be to add "branches: .*" to the job defs | 00:12 |
| corvus | and https://review.opendev.org/578557 is real fix | 00:12 |
| fungi | we could also consider deleting the 6-year-old feature/openid branch | 00:12 |
| corvus | that would work too, i think | 00:12 |
| fungi | smarcet: do you still need the feature/openid branch? | 00:12 |
| fungi | looks like it ceased use in 2013 | 00:14 |
| *** eharney has quit IRC | 00:15 | |
| fungi | and yeah, i agree this is probably the first case we have of a tag-triggered job in a repo with more than a master branch | 00:17 |
| corvus | well maybe it's the second, after whatever prompted me to write 578557 | 00:18 |
| fungi | heh | 00:18 |
| *** nicolasbock has quit IRC | 00:18 | |
| smarcet | fungi: nope we could delete it | 00:25 |
| fungi | thanks smarcet! doing that now, then i'll reenqueue 3.0.3 | 00:26 |
| *** eharney has joined #openstack-infra | 00:27 | |
| smarcet | fungi: thx u | 00:27 |
| fungi | #status deleted unused branch feature/openid of project osf/openstackid previously at 7350bfc8f40a5735984271d2c13123df8c0872a0 with smarcet's approval | 00:28 |
| openstackstatus | fungi: unknown command | 00:28 |
| fungi | #status log deleted unused branch feature/openid of project osf/openstackid previously at 7350bfc8f40a5735984271d2c13123df8c0872a0 with smarcet's approval | 00:28 |
| openstackstatus | fungi: finished logging | 00:28 |
| *** smarcet has quit IRC | 00:31 | |
| fungi | 2020-02-26 00:29:13,139 DEBUG zuul.layout: Variant <Job openstackid-release-branch branches: {MatchAny:{BranchMatcher:master}} source: osf/openstackid/.zuul.yaml@master#1> did not match <Tag 0x7f2dc4654e80 osf/openstackid creates refs/tags/3.0.3 on 7dff48831caa6f4a808482669818ba338bd259f6> | 00:32 |
| fungi | does zuul know to clear branches when they're deleted from gerrit? | 00:32 |
| *** kvenkata has quit IRC | 00:32 | |
| fungi | i confirmed it saw the deletion before that | 00:34 |
| *** takamatsu has quit IRC | 00:35 | |
| ianw | "msg": "Data could not be sent to remote host \"static.opendev.org\". Make sure this host can be reached over ssh: Host key verification failed.\r\n", ... the add_host documentation is pretty thin :/ | 00:35 |
| *** smarcet has joined #openstack-infra | 00:36 | |
| ianw | do you have to pre-add the host key to the local ssh config? | 00:37 |
| fungi | that is the safer solution | 00:37 |
| ianw | yeah, i mean i can't see a way to do it via add_host | 00:37 |
| fungi | maintaining an /etc/ssh/known_hosts list on all our servers has always seemed like it might be a good idea | 00:38 |
| ianw | well this is in the executor for that 404 job | 00:38 |
| fungi | or sshfp records, but you have to turn on support for those in the client config *and* be using dnssec everywhere | 00:38 |
| *** smarcet has quit IRC | 00:39 | |
| *** smarcet has joined #openstack-infra | 00:41 | |
| clarkb | ianw: maybe you can add it via the known_hosts module? | 00:41 |
| clarkb | (I think that will depend on whether or not we let you write that file in the executors build context | 00:42 |
| clarkb | I don't know if that will work | 00:42 |
| *** gshippey has quit IRC | 00:45 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: 404 periodic job : use executor only, add host key https://review.opendev.org/709874 | 00:45 |
| ianw | clarkb: ^ one way to find out! :) | 00:45 |
| clarkb | ianw: how are you triggering it outside of periodic? I realized that wen eed to be careful with changes to it to ensure it runs post merge only | 00:47 |
| fungi | ERROR! Invalid options for include_role: chdir | 00:47 |
| fungi | oof | 00:47 |
| ianw | clarkb: i triggered it via an enqueue-ref | 00:47 |
| clarkb | fungi: I've run into that before. You can chdir on a block iirc | 00:47 |
| clarkb | ianw: cool just making sure there wasn't some backdoor to getting it to run that would be unsafe | 00:48 |
| ianw | not that i know of :) | 00:48 |
| clarkb | fungi: so you do something like block:chdir:include_role all at the same level | 00:48 |
| fungi | oho, i also just discovered a missing bit of magic | 00:51 |
| fungi | https://opendev.org/openstack/project-config/src/branch/master/zuul.d/projects.yaml#L4683-L4687 | 00:52 |
| fungi | which wasn't running until now because openstackid-release-master is defined in the osf/openstackid repo | 00:52 |
| *** takamatsu has joined #openstack-infra | 00:52 | |
| clarkb | and because that was a branched repo it didn't apply to tag? | 00:54 |
| clarkb | and now that it is unbranched it works? | 00:54 |
| fungi | yup | 00:55 |
| fungi | even succeeds http://zuul.opendev.org/t/openstack/build/7b525c8f232f44dd8289eb8861cca2a7 | 00:56 |
| fungi | https://tarballs.opendev.org/osf/openstackid/openstackid-3.0.3.tar.gz exists and has a decidedly nonzero size | 00:57 |
| *** rh-jelabarre has quit IRC | 00:58 | |
| clarkb | firefox turned on dns over https to cloudflare by default today. If you are like me and would prefer to continue using your own dns servers you can go to preferences -> general -> network settings -> uncheck box to use dns over https | 00:59 |
| fungi | clarkb: thanks for the heads up! looks like "Enable DNS over HTTPS" is still unchecked for me (thanks debian?) but i'll be sure to keep an eye on it | 01:00 |
| fungi | i vaguely recall a lengthy debate on debian-devel about disabling that by default in packaged firefox | 01:01 |
| clarkb | I'm a bit torn on the change. For the vast majority of users using isp default dns servers its a huge benefit for security and privacy | 01:01 |
| fungi | well, maybe | 01:02 |
| clarkb | but for people that already care about security and privacy and have taken steps to address that its a major step back | 01:02 |
| fungi | that's also debatable | 01:02 |
| clarkb | fungi: it does require you to trust that cloudflare rotates their logs as they say they do and doesn't data mine the data as they say they don't | 01:02 |
| fungi | is the user's isp less trustworthy than cloudflare, who already also has a ton of their web browsing data to combine with their dns lookup data? | 01:02 |
| clarkb | but you know that every major ISP is doing the opposite | 01:02 |
| clarkb | fungi: I definitely trust cloudflare more than my isp | 01:03 |
| clarkb | comcast for example intentionally poisons dns to serve ads | 01:03 |
| fungi | i get that. i personally trust neither and so have a hard time guessing which some users might trust more | 01:03 |
| fungi | i think self-serving dns poison to generate advertising income is probably less of an overall risk than combining all the cdn access and dns lookups of a major swath of the internet into the hands of a single organization which promises to "do no evil" | 01:05 |
| clarkb | thats fair. | 01:05 |
| *** rh-jelabarre has joined #openstack-infra | 01:05 | |
| fungi | especially since companies can't really make promises like that. at least in the usa they're treated like persons yet have none of the legal responsibilities of one | 01:06 |
| fungi | and if the gubment decides to lean on them so they can go on fishing expeditions, they could also be under a gag order to refrain from acknowledging that they're doing evil anyway | 01:08 |
| clarkb | looks like the dns over https resolver is customizable too so you could configure it that way, but ya cloudflare is default and it is on by default now | 01:08 |
| fungi | it's a move which makes me suspicious | 01:10 |
| clarkb | fungi: your isp will likely be a US company (if living in the US at least) and subject to the same issues | 01:11 |
| clarkb | really I think the biggest concern is the other one you point out. They have significant amounts of data if they want to look at it | 01:11 |
| fungi | yup, but my isp is a much smaller chunk of overall internet traffic than "every site relying on cloudflare to terminate their ssl connections and most firefox users' dns) | 01:12 |
| clarkb | but your ISP has the same data set modulo the ssl content that cloudflare hosts | 01:12 |
| fungi | for a much smaller number of clients | 01:12 |
| fungi | why would a three-letter organization prefer to spend time getting my and numerous other isps to send them all that when they can probably just get most of it from a single place? | 01:13 |
| clarkb | ya that will depend on your ISP probably. My hunch is that comcast and maybe one or two others are in the same category | 01:14 |
| clarkb | fungi: because the isp has insight into every connection not just the ones that pass through a psecific cdn | 01:14 |
| clarkb | granted that cdn is popular and covers a lot of ground | 01:14 |
| fungi | yep, though the isp just knows the ip addresses you're communicating with, the protocols and some info about packet sizes/timing | 01:15 |
| fungi | assuming https traffic | 01:15 |
| clarkb | also domain names due to sni | 01:15 |
| fungi | yep, true, sni is prevalent now | 01:15 |
| fungi | cloudflare on the other hand technically has access to all plaintext for sites it's acting as an ssl terminating cdn at | 01:16 |
| openstackgerrit | Merged opendev/system-config master: zuul-user: add role to install system-config key https://review.opendev.org/709865 | 01:20 |
| openstackgerrit | sebastian marcet proposed opendev/system-config master: OpenStackId v3.0.3 Deployment https://review.opendev.org/709926 | 01:21 |
| openstackgerrit | Merged opendev/system-config master: static: add static.openstack.org/files.openstack.org https://review.opendev.org/709042 | 01:25 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: static: provide git services https://review.opendev.org/709403 | 01:28 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Remove files02.openstack.org and related puppet https://review.opendev.org/709639 | 01:28 |
| openstackgerrit | Merged opendev/system-config master: 404 periodic job : use executor only, add host key https://review.opendev.org/709874 | 01:31 |
| *** dychen has joined #openstack-infra | 01:36 | |
| fungi | clarkb: i've pushed up https://review.opendev.org/709927 to try to address remaining errors in the earlier zuul v3 conversion for that one job and also do the rest | 01:36 |
| fungi | curious to see if the laravel unit tests work | 01:37 |
| *** dangtrinhnt has joined #openstack-infra | 01:38 | |
| *** michael-beaver has quit IRC | 01:38 | |
| *** dchen has quit IRC | 01:39 | |
| clarkb | fungi: will be interesting to see if it is fine without the zuul legacy env vars | 01:42 |
| fungi | yup | 01:43 |
| clarkb | I've +2'dit assuming that is yhe case but dont necessarily expectit | 01:43 |
| fungi | i'm watching the log stream for the unit test job and it's gotten fairly far into php unit testing, so i suspect it may | 01:43 |
| fungi | OK (135 tests, 1366 assertions) | 01:46 |
| *** yamamoto has joined #openstack-infra | 01:47 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: 404 periodic job: fix host parameter https://review.opendev.org/709928 | 01:50 |
| *** gagehugo has quit IRC | 01:54 | |
| *** dingyichen has joined #openstack-infra | 01:56 | |
| *** dychen has quit IRC | 01:59 | |
| openstackgerrit | Merged opendev/system-config master: OpenStackId v3.0.3 Deployment https://review.opendev.org/709926 | 02:05 |
| *** ociuhandu has joined #openstack-infra | 02:06 | |
| *** yamamoto has quit IRC | 02:07 | |
| *** yamamoto has joined #openstack-infra | 02:10 | |
| *** ociuhandu has quit IRC | 02:11 | |
| *** gyee has quit IRC | 02:13 | |
| *** smarcet has left #openstack-infra | 02:16 | |
| *** ijw has quit IRC | 02:23 | |
| *** matt_kosut has joined #openstack-infra | 02:32 | |
| *** matt_kosut has quit IRC | 02:37 | |
| *** rlandy has quit IRC | 02:42 | |
| openstackgerrit | Merged opendev/system-config master: 404 periodic job: fix host parameter https://review.opendev.org/709928 | 03:01 |
| *** ijw has joined #openstack-infra | 03:07 | |
| ianw | "msg": "Data could not be sent to remote host \"static.opendev.org\". Make sure this host can be reached over ssh: Permission denied (publickey).\r\n" | 03:08 |
| ianw | clarkb: ^ progress ... i wonder if the per-project private key needs to be set in the connection explicitly? | 03:09 |
| ianw | "This key is added to the SSH agent for all jobs running in a post-review pipeline" | 03:11 |
| openstackgerrit | Merged opendev/system-config master: static: provide git services https://review.opendev.org/709403 | 03:16 |
| ianw | 2020-02-26 03:07:37,938 INFO zuul.ExecutorServer: [build: 30ce5ed328674de7bbb0b5b993bc9204] Added SSH Key opendev.org/opendev/system-config project key | 03:19 |
| ianw | wonder if it's my stuffup on the auth key | 03:20 |
| *** rlandy has joined #openstack-infra | 03:21 | |
| *** rlandy has quit IRC | 03:22 | |
| ianw | yes! somehow it's got a quote in there | 03:23 |
| fungi | score | 03:27 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: 404 periodic job: minor fixes https://review.opendev.org/709946 | 03:28 |
| *** bdodd has joined #openstack-infra | 03:36 | |
| *** rh-jelabarre has quit IRC | 03:36 | |
| *** hamerins has joined #openstack-infra | 03:37 | |
| *** hamerins has quit IRC | 03:39 | |
| *** hamerins has joined #openstack-infra | 03:41 | |
| *** hamerins has quit IRC | 03:42 | |
| *** ijw has quit IRC | 03:42 | |
| *** hongbin has joined #openstack-infra | 03:49 | |
| *** dangtrinhnt has quit IRC | 03:55 | |
| *** dangtrinhnt has joined #openstack-infra | 03:56 | |
| *** dangtrinhnt has quit IRC | 04:01 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Add CentOS 8 support https://review.opendev.org/684308 | 04:02 |
| openstackgerrit | Merged openstack/diskimage-builder master: Do not include efibootmgr and efivars for ppc architectures https://review.opendev.org/709811 | 04:02 |
| openstackgerrit | Merged openstack/diskimage-builder master: Change tgt pkg-map to target-restore CentOS/RHEL-8 https://review.opendev.org/709159 | 04:05 |
| openstackgerrit | Merged openstack/diskimage-builder master: fix iscsi-boot element exiting build even if dracut-regenerate used https://review.opendev.org/707340 | 04:05 |
| *** dangtrinhnt has joined #openstack-infra | 04:07 | |
| openstackgerrit | Merged opendev/system-config master: 404 periodic job: minor fixes https://review.opendev.org/709946 | 04:22 |
| *** factor has quit IRC | 04:31 | |
| *** factor has joined #openstack-infra | 04:31 | |
| *** hongbin has quit IRC | 04:39 | |
| *** imacdonn has quit IRC | 04:47 | |
| *** imacdonn has joined #openstack-infra | 04:47 | |
| ianw | AJaeger/clarkb: ta-da http://zuul.openstack.org/build/c95c1358192347ecaf91fbcefe6358a8/console#1/1/1/static.opendev.org :) | 04:55 |
| ianw | for sure the output could be better, save it as an artifact or whatever, or scrape more sites. but it basically works | 04:55 |
| ianw | i'll switch the git sites dns to static.opendev.org in the morning, not going to have time to monitor it now | 05:03 |
| ianw | but deployment looks good | 05:03 |
| *** raukadah is now known as chandankumar | 05:09 | |
| *** ykarel|away is now known as ykarel | 05:13 | |
| *** tetsuro has quit IRC | 05:20 | |
| *** tetsuro has joined #openstack-infra | 05:22 | |
| *** gagehugo has joined #openstack-infra | 05:23 | |
| AJaeger | ianw: good data - but difficult to find | 05:31 |
| AJaeger | ianw: I was looking at job-output.txt and could not find the data. Can we generate a separate file and show that, please? | 05:31 |
| *** evrardjp has quit IRC | 05:34 | |
| *** evrardjp has joined #openstack-infra | 05:35 | |
| *** tetsuro has quit IRC | 05:39 | |
| openstackgerrit | Merged zuul/zuul-jobs master: install-javascript-packages: add tox_constraints_file https://review.opendev.org/709414 | 05:40 |
| *** udesale has joined #openstack-infra | 05:41 | |
| *** udesale has quit IRC | 05:41 | |
| *** udesale has joined #openstack-infra | 05:41 | |
| *** ramishra has quit IRC | 05:42 | |
| *** ramishra has joined #openstack-infra | 05:50 | |
| *** larainema has joined #openstack-infra | 05:51 | |
| *** ramishra has quit IRC | 05:55 | |
| *** ramishra has joined #openstack-infra | 05:56 | |
| *** kozhukalov has joined #openstack-infra | 06:08 | |
| *** ociuhandu has joined #openstack-infra | 06:08 | |
| *** matt_kosut has joined #openstack-infra | 06:10 | |
| *** ociuhandu has quit IRC | 06:13 | |
| *** dangtrinhnt has quit IRC | 06:24 | |
| *** udesale has quit IRC | 06:24 | |
| *** udesale has joined #openstack-infra | 06:25 | |
| *** dangtrinhnt has joined #openstack-infra | 06:26 | |
| *** tetsuro has joined #openstack-infra | 06:31 | |
| *** roman_g has quit IRC | 06:38 | |
| *** lmiccini has joined #openstack-infra | 06:41 | |
| *** rcernin has quit IRC | 06:47 | |
| *** ociuhandu has joined #openstack-infra | 07:02 | |
| *** ociuhandu has quit IRC | 07:07 | |
| *** udesale has quit IRC | 07:12 | |
| *** udesale has joined #openstack-infra | 07:12 | |
| *** Lucas_Gray has joined #openstack-infra | 07:13 | |
| *** Lucas_Gray has quit IRC | 07:18 | |
| *** pgaxatte has joined #openstack-infra | 07:21 | |
| *** Lucas_Gray has joined #openstack-infra | 07:22 | |
| *** ociuhandu has joined #openstack-infra | 07:42 | |
| *** slaweq_ has joined #openstack-infra | 07:42 | |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Optimize canMerge using graphql https://review.opendev.org/709836 | 07:44 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Evaluate CODEOWNERS settings during canMerge check https://review.opendev.org/644557 | 07:44 |
| *** slaweq_ is now known as slaweq | 07:45 | |
| *** Lucas_Gray has quit IRC | 07:46 | |
| *** Lucas_Gray has joined #openstack-infra | 07:48 | |
| *** ociuhandu has quit IRC | 07:48 | |
| *** dciabrin has joined #openstack-infra | 07:54 | |
| *** ykarel is now known as ykarel|lunch | 08:03 | |
| *** Lucas_Gray has quit IRC | 08:05 | |
| *** ociuhandu has joined #openstack-infra | 08:05 | |
| *** tesseract has joined #openstack-infra | 08:06 | |
| *** Lucas_Gray has joined #openstack-infra | 08:07 | |
| *** jcapitao has joined #openstack-infra | 08:11 | |
| *** Lucas_Gray has quit IRC | 08:11 | |
| *** ociuhandu has quit IRC | 08:11 | |
| *** dingyichen has quit IRC | 08:17 | |
| *** udesale has quit IRC | 08:18 | |
| *** tosky has joined #openstack-infra | 08:20 | |
| *** iurygregory has joined #openstack-infra | 08:21 | |
| *** rcernin has joined #openstack-infra | 08:22 | |
| *** Lucas_Gray has joined #openstack-infra | 08:27 | |
| *** amoralej|off is now known as amoralej | 08:31 | |
| *** udesale has joined #openstack-infra | 08:39 | |
| *** Lucas_Gray has quit IRC | 08:40 | |
| *** jpena|off is now known as jpena | 08:46 | |
| *** ralonsoh has joined #openstack-infra | 08:53 | |
| *** tkajinam has quit IRC | 08:57 | |
| *** lennyb has quit IRC | 09:06 | |
| *** lennyb has joined #openstack-infra | 09:07 | |
| *** ykarel|lunch is now known as ykarel | 09:08 | |
| *** ociuhandu has joined #openstack-infra | 09:08 | |
| *** dangtrinhnt has quit IRC | 09:14 | |
| *** lucasagomes has joined #openstack-infra | 09:15 | |
| *** dangtrinhnt has joined #openstack-infra | 09:16 | |
| *** dangtrinhnt has quit IRC | 09:17 | |
| *** dangtrinhnt has joined #openstack-infra | 09:17 | |
| *** xek_ has joined #openstack-infra | 09:19 | |
| *** ociuhandu has quit IRC | 09:22 | |
| *** psachin has joined #openstack-infra | 09:25 | |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: Refactor `self.event_queues` in tests https://review.opendev.org/709990 | 09:26 |
| *** Lucas_Gray has joined #openstack-infra | 09:28 | |
| *** tesseract has quit IRC | 09:35 | |
| *** tesseract has joined #openstack-infra | 09:36 | |
| *** smarcet has joined #openstack-infra | 09:40 | |
| *** smarcet has quit IRC | 09:40 | |
| *** ociuhandu has joined #openstack-infra | 09:42 | |
| openstackgerrit | Felix Edel proposed zuul/zuul master: Dequeue items via buildset uuid https://review.opendev.org/709135 | 10:05 |
| *** pkopec has joined #openstack-infra | 10:07 | |
| *** ociuhandu has quit IRC | 10:11 | |
| *** roman_g has joined #openstack-infra | 10:15 | |
| *** dangtrinhnt has quit IRC | 10:18 | |
| *** dangtrinhnt has joined #openstack-infra | 10:19 | |
| *** ociuhandu has joined #openstack-infra | 10:21 | |
| *** dangtrinhnt has quit IRC | 10:24 | |
| *** ociuhandu has quit IRC | 10:31 | |
| *** Lucas_Gray has quit IRC | 10:48 | |
| *** Lucas_Gray has joined #openstack-infra | 10:54 | |
| *** ykarel is now known as ykarel|afk | 10:59 | |
| *** Lucas_Gray has quit IRC | 10:59 | |
| *** Lucas_Gray has joined #openstack-infra | 11:00 | |
| *** priteau has joined #openstack-infra | 11:01 | |
| *** ociuhandu has joined #openstack-infra | 11:07 | |
| *** tesseract has quit IRC | 11:08 | |
| *** tesseract has joined #openstack-infra | 11:11 | |
| *** ociuhandu has quit IRC | 11:12 | |
| evrardjp | clarkb: FYI the votes were there, and the time has passed enough without negative votes, so I have pressed the green light button on https://review.opendev.org/#/c/703134/ . Congrats! | 11:28 |
| evrardjp | goodbye my friends! | 11:30 |
| evrardjp | haha | 11:30 |
| *** ianychoi_ is now known as ianychoi | 11:32 | |
| *** jaosorior has joined #openstack-infra | 11:32 | |
| *** Lucas_Gray has quit IRC | 11:34 | |
| *** yamamoto has quit IRC | 11:49 | |
| *** ociuhandu has joined #openstack-infra | 11:51 | |
| *** ykarel|afk is now known as ykarel | 11:52 | |
| evrardjp | well | 11:53 |
| evrardjp | fun times ahead. | 11:53 |
| *** ociuhandu has quit IRC | 11:55 | |
| * ttx learns how to put the cork back on the champagne bottle | 12:00 | |
| *** nicolasbock has joined #openstack-infra | 12:02 | |
| *** TristanSullivan has quit IRC | 12:03 | |
| *** dangtrinhnt has joined #openstack-infra | 12:06 | |
| *** smarcet has joined #openstack-infra | 12:07 | |
| *** sshnaidm is now known as sshnaidm|bbl | 12:09 | |
| *** yamamoto has joined #openstack-infra | 12:09 | |
| *** jcapitao is now known as jcapitao_lunch | 12:10 | |
| *** Lucas_Gray has joined #openstack-infra | 12:13 | |
| *** psachin has quit IRC | 12:25 | |
| *** ociuhandu has joined #openstack-infra | 12:30 | |
| *** udesale_ has joined #openstack-infra | 12:34 | |
| *** jpena is now known as jpena|lunch | 12:34 | |
| * frickler waves goodbye | 12:36 | |
| frickler | likely we should all move over to #opendev , then? /me is still annoyed by all the duplicated gerritbot msgs all the time | 12:36 |
| *** udesale has quit IRC | 12:36 | |
| *** dangtrinhnt has quit IRC | 12:38 | |
| *** dSrinivas has joined #openstack-infra | 12:38 | |
| *** Goneri has joined #openstack-infra | 12:38 | |
| *** dangtrinhnt has joined #openstack-infra | 12:40 | |
| *** ociuhandu has quit IRC | 12:40 | |
| mordred | ttx: you can put corks back? I thought the answer was just that you had a bottle to drink now ... | 12:46 |
| AJaeger | frickler: put this on next week IRC meeting, I agree, the triple (in same cases) gerritbots are annoying and thus I'm staying away from #opendev | 12:50 |
| *** dangtrinhnt has quit IRC | 12:50 | |
| AJaeger | config-core, please review https://review.opendev.org/709809 | 12:51 |
| *** yamamoto has quit IRC | 12:51 | |
| *** dangtrinhnt has joined #openstack-infra | 12:52 | |
| *** dangtrinhnt has quit IRC | 12:55 | |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: Scheduler's pause/resume functionality https://review.opendev.org/709735 | 12:59 |
| *** rlandy has joined #openstack-infra | 13:00 | |
| frickler | AJaeger: good idea, done. | 13:04 |
| *** rh-jelabarre has joined #openstack-infra | 13:04 | |
| frickler | ttx: regarding xwiki, do I understand this correctly (after scanning some of xwiki.org/com), that the hosting offer comes from the xwiki company and not from the OSS organization? (not entirely sure about the governance details there) | 13:05 |
| *** psachin has joined #openstack-infra | 13:05 | |
| *** ociuhandu has joined #openstack-infra | 13:06 | |
| frickler | I'm mainly concerned about privacy for our users, we make great efforts to not publish access logs for e.g. docs.o.o, but would give them into the hands of a commercial third-party for the wiki? | 13:06 |
| ttx | frickler: yes the hosting comes from xwiki.com... it's a bit of a single-vendor project ("community" produces mainly plugins) | 13:08 |
| *** smarcet has quit IRC | 13:10 | |
| ttx | obviously third-party hosting comes with some trade-offs. Given that Xwiki-the-company is under French law, they have to abide to pretty drastic data collection/retention/communication laws | 13:10 |
| frickler | ttx: it also looks like an open-core project, they sell a non-open pro version with added features, right? that would IMO be another point against endorsing them with our presence | 13:11 |
| ttx | so personally I'm fine with the trade-off involved. | 13:11 |
| ttx | frickler: yeah... it's not perfect. Their open core model is relatively clean (through their plugin system). But the alternatives are a lot worse | 13:12 |
| ttx | https://xwiki.com/en/company/libre-software/manifesto | 13:13 |
| *** amoralej is now known as amoralej|lunch | 13:14 | |
| ttx | frickler: I'll make sure to raise those issues in the spec. | 13:14 |
| *** jcapitao_lunch is now known as jcapitao | 13:17 | |
| *** smarcet has joined #openstack-infra | 13:21 | |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: Scheduler's pause/resume functionality https://review.opendev.org/709735 | 13:22 |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: WIP: Store unparsed branch config in Zookeeper https://review.opendev.org/705716 | 13:25 |
| *** jpena|lunch is now known as jpena | 13:26 | |
| *** Goneri has quit IRC | 13:28 | |
| *** smarcet has quit IRC | 13:31 | |
| *** Lucas_Gray has quit IRC | 13:34 | |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Refactor github auth handling into its own class https://review.opendev.org/710034 | 13:35 |
| *** Lucas_Gray has joined #openstack-infra | 13:35 | |
| *** ykarel is now known as ykarel|afk | 13:36 | |
| *** nicolasbock has quit IRC | 13:40 | |
| *** nicolasbock has joined #openstack-infra | 13:40 | |
| *** Goneri has joined #openstack-infra | 13:42 | |
| *** matt_kosut has quit IRC | 13:44 | |
| *** dSrinivas has quit IRC | 13:44 | |
| *** matt_kos_ has joined #openstack-infra | 13:44 | |
| openstackgerrit | Sorin Sbarnea proposed zuul/zuul-jobs master: Tests ensure-tox on all-platforms https://review.opendev.org/708642 | 13:53 |
| *** jamesmcarthur has joined #openstack-infra | 13:53 | |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: WIP: Store unparsed branch config in Zookeeper https://review.opendev.org/705716 | 13:54 |
| *** amoralej|lunch is now known as amoralej | 13:59 | |
| *** Lucas_Gray has quit IRC | 13:59 | |
| *** Lucas_Gray has joined #openstack-infra | 14:00 | |
| *** ykarel|afk is now known as ykarel | 14:02 | |
| openstackgerrit | Sorin Sbarnea proposed zuul/zuul-jobs master: Tests bindep role on all-platforms https://review.opendev.org/708704 | 14:02 |
| *** slaweq has quit IRC | 14:05 | |
| *** Lucas_Gray has quit IRC | 14:05 | |
| *** Lucas_Gray has joined #openstack-infra | 14:07 | |
| *** slaweq has joined #openstack-infra | 14:09 | |
| fungi | frickler: also i think it's the same concerns we'll have to tackle with the new translation system we were talking about using the hosted version of rather than running ourselves | 14:18 |
| * fungi never can remember the name of that software | 14:19 | |
| *** yamamoto has joined #openstack-infra | 14:22 | |
| frickler | fungi: yes, though maybe that would affect only a smaller subgroup of users and thus could be evaluated differently | 14:24 |
| *** jamesmcarthur has quit IRC | 14:27 | |
| *** jamesmcarthur has joined #openstack-infra | 14:30 | |
| *** jamesmcarthur has quit IRC | 14:32 | |
| *** ociuhandu has quit IRC | 14:37 | |
| *** yamamoto has quit IRC | 14:48 | |
| *** iurygregory has quit IRC | 14:49 | |
| *** yamamoto has joined #openstack-infra | 14:50 | |
| *** yamamoto has quit IRC | 14:55 | |
| *** sshnaidm|bbl is now known as sshnaidm | 14:56 | |
| *** psachin has quit IRC | 15:05 | |
| *** ykarel is now known as ykarel|afk | 15:06 | |
| *** yamamoto has joined #openstack-infra | 15:10 | |
| *** ociuhandu has joined #openstack-infra | 15:11 | |
| *** Lucas_Gray has quit IRC | 15:14 | |
| *** Lucas_Gray has joined #openstack-infra | 15:15 | |
| *** ociuhandu has quit IRC | 15:16 | |
| *** mugsie has quit IRC | 15:20 | |
| *** mugsie has joined #openstack-infra | 15:22 | |
| openstackgerrit | Thierry Carrez proposed opendev/infra-specs master: Xwiki farm at wiki.opendev.org https://review.opendev.org/710057 | 15:27 |
| *** Lucas_Gray has quit IRC | 15:32 | |
| otherwiseguy | prometheanfire: question re: https://review.opendev.org/#/c/709737/ I see you +2+1'd, then removed, so now it is sitting at +2 verified w/ no other +2s. which is amusing. just curious as to why (neutron gate hits a bug fixed in this release relatively often) | 15:33 |
| *** Lucas_Gray has joined #openstack-infra | 15:34 | |
| *** iurygregory has joined #openstack-infra | 15:34 | |
| *** ociuhandu has joined #openstack-infra | 15:41 | |
| frickler | otherwiseguy: you may want to ask this in #openstack-requirements | 15:42 |
| *** ijw has joined #openstack-infra | 15:44 | |
| *** psachin has joined #openstack-infra | 15:46 | |
| openstackgerrit | Sean McGinnis proposed openstack/project-config master: Use noop job for devstack-plugin-bdd https://review.opendev.org/710062 | 15:47 |
| *** ijw has quit IRC | 15:48 | |
| otherwiseguy | frickler: will do. thx. | 15:49 |
| openstackgerrit | Sean McGinnis proposed openstack/openstack-zuul-jobs master: Remove legacy-tempest-dsvm-full-bdd job https://review.opendev.org/710063 | 15:50 |
| *** psachin has quit IRC | 15:57 | |
| *** iurygregory has quit IRC | 16:05 | |
| smcginnis | If anyone has a moment to look at https://review.opendev.org/#/c/709809/ - that could help with requirements update patches for new lib releases. | 16:09 |
| openstackgerrit | Sean McGinnis proposed openstack/project-config master: Use noop job for devstack-plugin-bdd https://review.opendev.org/710062 | 16:12 |
| *** pgaxatte has quit IRC | 16:13 | |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Add publish job for stackviz https://review.opendev.org/710072 | 16:16 |
| AJaeger | config-core, could I get some help with the change above ^ is that all correct? | 16:16 |
| *** smarcet has joined #openstack-infra | 16:17 | |
| *** eharney has quit IRC | 16:19 | |
| *** lmiccini has quit IRC | 16:21 | |
| *** udesale_ has quit IRC | 16:24 | |
| *** smarcet has quit IRC | 16:29 | |
| *** mattw4 has joined #openstack-infra | 16:33 | |
| openstackgerrit | Merged openstack/project-config master: Make update_constraints.sh aware of python_versions https://review.opendev.org/709809 | 16:35 |
| *** jamesmcarthur has joined #openstack-infra | 16:36 | |
| *** psachin has joined #openstack-infra | 16:36 | |
| *** smarcet has joined #openstack-infra | 16:37 | |
| *** ijw has joined #openstack-infra | 16:38 | |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Add publish job for stackviz https://review.opendev.org/710072 | 16:39 |
| *** yamamoto has quit IRC | 16:39 | |
| *** xek__ has joined #openstack-infra | 16:48 | |
| *** tesseract has quit IRC | 16:50 | |
| *** xek_ has quit IRC | 16:51 | |
| *** gyee has joined #openstack-infra | 16:52 | |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Add publish job for stackviz https://review.opendev.org/710072 | 16:52 |
| *** eharney has joined #openstack-infra | 16:55 | |
| *** jaosorior has quit IRC | 16:57 | |
| *** ykarel|afk is now known as ykarel|away | 17:00 | |
| *** lucasagomes has quit IRC | 17:01 | |
| *** ociuhandu has quit IRC | 17:03 | |
| *** mattw4 has quit IRC | 17:03 | |
| *** mattw4 has joined #openstack-infra | 17:04 | |
| openstackgerrit | Merged zuul/zuul master: Don't set untouched refs of the repo state twice. https://review.opendev.org/707857 | 17:05 |
| openstackgerrit | James E. Blair proposed opendev/base-jobs master: Move pull-from-intermediate-registry to docker build job https://review.opendev.org/710089 | 17:10 |
| corvus | mordred: ^ i think this is approach is plausible. the set of jobs i need to "fix" to implement this is pretty small. | 17:10 |
| *** yamamoto has joined #openstack-infra | 17:11 | |
| *** psachin has quit IRC | 17:12 | |
| *** TristanSullivan has joined #openstack-infra | 17:14 | |
| corvus | fungi: what's hard about running mediawiki? are the obstacles there something that could be addressed by containerized deployment? | 17:15 |
| corvus | was just browsing https://www.mediawiki.org/wiki/Docker | 17:16 |
| *** yamamoto has quit IRC | 17:17 | |
| *** jcoufal has joined #openstack-infra | 17:18 | |
| fungi | mostly the dozens of plugins | 17:24 |
| fungi | and 20-step upgrade process | 17:24 |
| fungi | and things like providing keyword searching means running an elasticsearch service | 17:25 |
| fungi | (which needs to remain secured) | 17:25 |
| corvus | it looks like "plugins" is maybe not something that their existing work has solved yet, so probably that would mean we would need to make our own container images with those plugins. however, that might be simpler in that we can just "splat" them in place in the image... | 17:26 |
| fungi | yeah, ultimately a lot of the work is in reverse-engineering the from-source deployment ryan set up years ago and working out how to modularize it all so that it doesn't depend on everything being splatted inside the mediawiki source tree | 17:27 |
| mordred | so a large portion of the issue might not be running mediawiki's in general as much as running our existing mediawiki | 17:28 |
| corvus | well, i think maybe if we change our perspective a bit -- containers let us create a modular/repeatable deployment *with* everything being splatted into the source tree | 17:28 |
| fungi | also the configuration for it is nontrivial to manage. our current Settings.php is 228 lines *after* filtering out commas and blank lines | 17:28 |
| mordred | and it's _possible_ that we could learn that we could run X mediawikis easily if we started from scratch | 17:28 |
| corvus | so if that's the easiest way to do it, then maybe that's an approach to take | 17:28 |
| mordred | (I agree, reverse engineering a direct-installed thing is a nightmare) | 17:29 |
| corvus | the 20-step upgrade process is worrisome -- but i wonder, is that something that needs to happen when you're upgrading something in-place, or, could you just shut down the old container, start up the new container, and have it automatically perform schema upgrades, etc? or would there still be upgrade steps needed between different container versions | 17:29 |
| fungi | the other challenge is finding volunteers to go through all the edits being made every day by new users and reversing any spam which makes it through the various layers of spam filtering we've got in place, which at the moment is only being done by me i think | 17:30 |
| corvus | that seems unlikely to be solved by containerization | 17:30 |
| fungi | perhaps i can be containerized | 17:30 |
| *** ociuhandu has joined #openstack-infra | 17:30 | |
| corvus | i feel certain there's a startup out there that would say otherwise though | 17:30 |
| corvus | does xwiki bring something new to the table wrt spam? | 17:31 |
| fungi | well, i'm skeptical that any wiki solution which allows someone to make edits without being vetted and approved first is going to run into this | 17:31 |
| mordred | their developers have a matrix channel | 17:32 |
| fungi | ttx says it has spam mitigation features, but i haven't looked at them yet (and for the record mediawiki has spam mitigation features too, but also originates in a community where there are hundreds of service admins handling the volume so is a little more tolerant of solutions which require quick human response) | 17:32 |
| *** mattw4 has quit IRC | 17:34 | |
| *** evrardjp has quit IRC | 17:34 | |
| *** evrardjp has joined #openstack-infra | 17:35 | |
| ttx | re:spam... requiring an openstackID account is kind of a good prevention | 17:36 |
| ttx | but I trust more the nestedpage concept | 17:36 |
| ttx | like if you end up with strong authorization by default | 17:37 |
| ttx | rather than free-for-all by default... | 17:37 |
| ttx | I see it more as lightweight structured documentation site than a "wiki" really. But that may be my hate of wikis talking | 17:38 |
| corvus | oh, didn't know that was a consideration | 17:38 |
| ttx | corvus: well it's up to each community really | 17:38 |
| ttx | but for example I would not allow anyone to modify the home page, or add a page to the navigation index | 17:39 |
| ttx | s/anyone/everyone | 17:39 |
| ttx | which would reduce the spam incentive dramatically | 17:39 |
| ttx | subwiki admins can easily create groups and add people to them | 17:39 |
| ttx | and then authZ propagates to nested pages | 17:40 |
| *** gfidente is now known as gfidente|afk | 17:40 | |
| *** jpena is now known as jpena|off | 17:40 | |
| ttx | but yeah, I guess we'll never know how efficient spammers are against xwikis until we try :) | 17:41 |
| *** smarcet has quit IRC | 17:41 | |
| ttx | (one more reason I want to PoC it over a single subwiki first) | 17:41 |
| fungi | most of what drives the spam on wiki.openstack.org is that we allow search engines to index it, and people are trying to use the ability to post content there to poison search results in major search engines | 17:43 |
| openstackgerrit | Merged zuul/zuul master: Don't fetch pull request twice for status event https://review.opendev.org/709149 | 17:43 |
| fungi | also note that to post content on wiki.openstack.org they have to first create an ubuntu one sso account so they can authenticate with its openid provider | 17:44 |
| ttx | fungi: ubuntuone has been a spam target for a loong time (see also: Lp spam) | 17:44 |
| *** mattw4 has joined #openstack-infra | 17:44 | |
| ttx | fungi: maybe we can limit indexing to "navigable" pages (pages manually added to teh navigation index by a subwiki admin) | 17:45 |
| ttx | if you comment on the spec mentioning that, I can add it to the open questions | 17:45 |
| fungi | and we reduce the spamming by having a gigantic list of forbidden words which cannot appear in wiki edits, rejecting uploading of indexable text-oriented files (particularly pdf), and force anyone who hasn't made verified legitimate edits (as judged by a human moderator) go through a proprietary google recaptcha, and even then we still manually inspect their posts until we confirm they're posting | 17:46 |
| fungi | legitimate edits | 17:46 |
| *** adriancz has quit IRC | 17:46 | |
| fungi | (as far as what we're doing on wiki.o.o right now, i mean) | 17:46 |
| fungi | and then manually bulk rollback any spam edits they make | 17:47 |
| fungi | luckily the spam volume has been fairly low lately. i only end up blocking and reversing edits for maybe one or two accounts a week now | 17:48 |
| fungi | oh, we also mostly block edits which include urls to external sites | 17:49 |
| fungi | oh, the other tactic i love is that some of them seem to post whatever site/phone phishing scams then contact the osf claiming to be a victim of the scam and demanding that we reimburse them for all their losses. LOVE those | 17:50 |
| fungi | baleeted | 17:50 |
| *** jamesmcarthur has quit IRC | 17:58 | |
| *** jamesmcarthur has joined #openstack-infra | 18:00 | |
| ttx | hah lol | 18:00 |
| openstackgerrit | James E. Blair proposed opendev/system-config master: Use explicit provides/requires for container jobs https://review.opendev.org/710106 | 18:04 |
| *** ociuhandu has quit IRC | 18:05 | |
| *** jamesmcarthur has quit IRC | 18:05 | |
| *** mattw4 has quit IRC | 18:05 | |
| *** ociuhandu has joined #openstack-infra | 18:05 | |
| mordred | corvus: those are seeming reasonable | 18:08 |
| *** ociuhandu has quit IRC | 18:11 | |
| *** Goneri has quit IRC | 18:11 | |
| *** Goneri has joined #openstack-infra | 18:12 | |
| *** jbryce has joined #openstack-infra | 18:13 | |
| *** smarcet has joined #openstack-infra | 18:18 | |
| *** jamesmcarthur has joined #openstack-infra | 18:21 | |
| *** chandankumar is now known as raukadah | 18:21 | |
| *** yamamoto has joined #openstack-infra | 18:22 | |
| *** ijw has quit IRC | 18:27 | |
| *** michael-beaver has joined #openstack-infra | 18:29 | |
| *** priteau has quit IRC | 18:32 | |
| *** amoralej is now known as amoralej|off | 18:33 | |
| *** ramishra has quit IRC | 18:34 | |
| *** jcapitao is now known as jcapitao_off | 18:35 | |
| AJaeger | fungi, storyboard has a release job legacy-puppet-storyboard-forge-upload - do we need this? It was never run in Zuul v3 according to http://zuul.opendev.org/t/openstack/builds?job_name=legacy-puppet-storyboard-forge-upload | 18:35 |
| *** mattw4 has joined #openstack-infra | 18:36 | |
| *** igordc has joined #openstack-infra | 18:37 | |
| mordred | AJaeger: nope | 18:37 |
| mordred | AJaeger: we don't do or need to do any uploading to puppetforge | 18:38 |
| AJaeger | great, let me cleanup... | 18:38 |
| fungi | yeah, i think all openstack-infra and opendev projects with puppetforge upload jobs can have them cleaned up | 18:39 |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Remove legacy-puppet-openstack-integration job https://review.opendev.org/710110 | 18:40 |
| AJaeger | fungi: ok, let me check for others... | 18:40 |
| *** roman_g has quit IRC | 18:43 | |
| *** igordc has quit IRC | 18:43 | |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Remove puppet-forge upload jobs from opendev https://review.opendev.org/710110 | 18:45 |
| AJaeger | fungi, mordred, updated ^ | 18:45 |
| *** rlandy is now known as rlandy|mtg | 18:46 | |
| *** ociuhandu has joined #openstack-infra | 18:46 | |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: Remove puppet-forge jobs https://review.opendev.org/710112 | 18:47 |
| AJaeger | and this is part two of the cleanup ^ | 18:47 |
| openstackgerrit | James E. Blair proposed opendev/storyboard master: Use explicit provides/requires for container jobs https://review.opendev.org/710113 | 18:49 |
| *** ociuhandu has quit IRC | 18:51 | |
| openstackgerrit | James E. Blair proposed zuul/nodepool master: Use explicit provides/requires for container jobs https://review.opendev.org/710115 | 18:52 |
| *** tosky has quit IRC | 18:56 | |
| *** Lucas_Gray has quit IRC | 18:57 | |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Use explicit provides/requires for container jobs https://review.opendev.org/710116 | 18:58 |
| openstackgerrit | James E. Blair proposed opendev/base-jobs master: Remove docker-image provides/requires https://review.opendev.org/710117 | 18:58 |
| corvus | okay that's the series -- there's some failing results i need to figure out | 18:58 |
| corvus | oh, er, it's maybe a legit image build failure | 19:01 |
| *** dpawlik has quit IRC | 19:01 | |
| AJaeger | fungi, could you review 710110 again, please? And please put https://review.opendev.org/709358 for elections on your review queue | 19:09 |
| *** mattw4 has quit IRC | 19:09 | |
| *** mattw4 has joined #openstack-infra | 19:17 | |
| *** dpawlik has joined #openstack-infra | 19:18 | |
| fungi | you bet | 19:27 |
| *** rlandy|mtg is now known as rlandy | 19:27 | |
| AJaeger | thanks | 19:28 |
| fungi | corvus: mordred: i approved 710089 since it seems to work for the storyboard job, but i can unapprove if you want to wait until any of the other build failures are researched | 19:29 |
| corvus | fungi: sounds safe | 19:30 |
| *** TristanSullivan has quit IRC | 19:31 | |
| fungi | cool, seemed so, just wanted to be sure | 19:31 |
| *** jamesmcarthur has quit IRC | 19:31 | |
| *** yamamoto has quit IRC | 19:31 | |
| *** ociuhandu has joined #openstack-infra | 19:34 | |
| openstackgerrit | Merged opendev/base-jobs master: Move pull-from-intermediate-registry to docker build job https://review.opendev.org/710089 | 19:35 |
| *** pkopec has quit IRC | 19:35 | |
| *** eharney has quit IRC | 19:38 | |
| *** jamesmcarthur has joined #openstack-infra | 19:40 | |
| *** ociuhandu has quit IRC | 19:40 | |
| openstackgerrit | Merged openstack/project-config master: Remove puppet-forge upload jobs from opendev https://review.opendev.org/710110 | 19:43 |
| *** TristanSullivan has joined #openstack-infra | 19:49 | |
| *** eharney has joined #openstack-infra | 19:51 | |
| fungi | gonna go grab late lunch/early dinner but will be back as soon as i'm able | 19:56 |
| *** jamesmcarthur has quit IRC | 19:58 | |
| openstackgerrit | sebastian marcet proposed opendev/system-config master: OpenStackId v3.0.4 Deployment https://review.opendev.org/710128 | 19:59 |
| *** yamamoto has joined #openstack-infra | 20:02 | |
| *** dheemanth has joined #openstack-infra | 20:08 | |
| *** yamamoto has quit IRC | 20:08 | |
| *** ociuhandu has joined #openstack-infra | 20:08 | |
| *** sshnaidm is now known as sshnaidm|afk | 20:11 | |
| *** ociuhandu has quit IRC | 20:12 | |
| *** jcapitao_off has quit IRC | 20:17 | |
| AJaeger | config-core, please review https://review.opendev.org/710072 | 20:18 |
| *** jamesmcarthur has joined #openstack-infra | 20:21 | |
| *** smarcet has quit IRC | 20:22 | |
| *** Lucas_Gray has joined #openstack-infra | 20:25 | |
| *** ociuhandu has joined #openstack-infra | 20:28 | |
| *** smarcet has joined #openstack-infra | 20:31 | |
| *** kozhukalov has quit IRC | 20:33 | |
| *** kozhukalov has joined #openstack-infra | 20:36 | |
| *** mattw4 has quit IRC | 20:42 | |
| *** mattw4 has joined #openstack-infra | 20:42 | |
| *** Lucas_Gray has quit IRC | 20:50 | |
| *** Lucas_Gray has joined #openstack-infra | 20:56 | |
| ianw | since everything seems quiet i plan to switch the git.<various> rax dns entires from https://review.opendev.org/#/c/709403/ soon to static.opendev.org | 20:59 |
| *** jcoufal has quit IRC | 20:59 | |
| *** eharney has quit IRC | 21:00 | |
| *** larainema has quit IRC | 21:03 | |
| mordred | ianw: I support this decision | 21:06 |
| openstackgerrit | Merged openstack/project-config master: Use noop job for devstack-plugin-bdd https://review.opendev.org/710062 | 21:08 |
| ianw | interesting, every page in the rackspace ui seems to be giving"We're sorry, but there was an error loading the page.Please refresh the page or try again later. " | 21:09 |
| ianw | the twitter is deprecated -> https://twitter.com/rackstatus?lang=en | 21:10 |
| ianw | and links to https://rackspace.service-now.com/system_status which fails to load with hsts failures in firefox | 21:10 |
| ianw | so, pretty much a typical morning :) | 21:11 |
| mordred | ianw: the status reporting system needs a status reporting system | 21:15 |
| ianw | ... ok rax is off the hook. i dnf upgraded last evening, and it looks like firefox updated and must have messed itself up. restarting my browser and things work | 21:15 |
| mordred | ianw: awesome. I was just going to tell you the service now is green | 21:16 |
| *** michael-beaver has quit IRC | 21:19 | |
| *** rcernin has quit IRC | 21:21 | |
| *** ralonsoh has quit IRC | 21:22 | |
| openstackgerrit | Ian Wienand proposed opendev/zone-zuul-ci.org master: git.zuul-ci.org : point to static.opendev.org https://review.opendev.org/710142 | 21:23 |
| *** Lucas_Gray has quit IRC | 21:23 | |
| *** bnemec has quit IRC | 21:23 | |
| corvus | mordred: does this mean anything to you? https://zuul.opendev.org/t/openstack/build/e890ef8b4be24c71bc77a1c17ea4352d | 21:23 |
| ianw | #status log git.openstack.org git.starlingx.io and git.airshipit.org updated to be CNAME to static.opendev.org (https://review.opendev.org/#/c/709403/) | 21:24 |
| openstackstatus | ianw: finished logging | 21:24 |
| corvus | ModuleNotFoundError: No module named 'distutils.util' in get-pip.py | 21:24 |
| ianw | i'll double check but i think that's it for files02.openstack.org; it's now static.opendev.org and all ansible, all the time | 21:25 |
| clarkb | corvus: that looks a lot like tge error I had on new status.o.o due to older setuptools | 21:25 |
| clarkb | however get-pip.py should bootstrap that itself I thought. Is an older setuptools present maybe? | 21:25 |
| *** priteau has joined #openstack-infra | 21:28 | |
| *** Lucas_Gray has joined #openstack-infra | 21:28 | |
| *** kozhukalov has quit IRC | 21:29 | |
| mordred | corvus, clarkb: need python-distutils package | 21:31 |
| mordred | or, rather, python3-distutils - based on the other packages | 21:32 |
| mordred | debian splits that into its own package even though it's part of core for reasons I cannot even come close to fathoming | 21:32 |
| *** slaweq has quit IRC | 21:32 | |
| corvus | mordred: i'm not trying to make a new job there or anything -- that's something that's an existing break? i don't really understand what's going on | 21:35 |
| *** adam_g has quit IRC | 21:36 | |
| *** jamesmcarthur has quit IRC | 21:36 | |
| mordred | corvus: ah - let me look deeper - might be | 21:36 |
| *** ociuhandu has quit IRC | 21:36 | |
| mordred | corvus: AH yeah | 21:36 |
| mordred | corvus: uh ... | 21:36 |
| *** jamesmcarthur has joined #openstack-infra | 21:36 | |
| *** adam_g has joined #openstack-infra | 21:37 | |
| *** ociuhandu has joined #openstack-infra | 21:37 | |
| mordred | corvus: docker build /home/zuul/src/opendev.org/opendev/jeepyb | 21:37 |
| mordred | I need to dig | 21:37 |
| mordred | corvus: I'm guessing this broke with pip the other day but we didnt' notice because we build that infrequently | 21:37 |
| corvus | mordred: oh wow i didn't notice that's the thing that broke | 21:38 |
| mordred | corvus: we have to install jeepyb into gerrit-base because of the gerrit hook scripts | 21:38 |
| openstackgerrit | Monty Taylor proposed opendev/system-config master: Use explicit provides/requires for container jobs https://review.opendev.org/710106 | 21:40 |
| mordred | corvus: I'm 99% certain that'll fix it ^^ | 21:40 |
| mordred | because this is the one place where we're not using the python base image and doing python things | 21:40 |
| mordred | corvus: we could also just switch to using python3-pip package there instead of get-pip ... it really shouldn't matter | 21:41 |
| *** ociuhandu has quit IRC | 21:41 | |
| *** jamesmcarthur has quit IRC | 21:44 | |
| *** jamesmcarthur has joined #openstack-infra | 21:45 | |
| mordred | WOW - python3-pip pulls in a massive amount of packages | 21:45 |
| corvus | mordred: thanks! | 21:45 |
| mordred | binutils build-essential cpp cpp-6 dpkg-dev fakeroot g++ g++-6 gcc gcc-6 libalgorithm-diff-perl libalgorithm-diff-xs-perl | 21:45 |
| mordred | libalgorithm-merge-perl libasan3 libatomic1 libc-dev-bin libc6-dev libcc1-0 libcilkrts5 libdpkg-perl libexpat1 libexpat1-dev libfakeroot | 21:45 |
| mordred | libfile-fcntllock-perl libgcc-6-dev libgomp1 libisl15 libitm1 liblocale-gettext-perl liblsan0 libmpc3 libmpfr4 libmpx2 libpython3-dev | 21:45 |
| mordred | libpython3.5 libpython3.5-dev libquadmath0 libstdc++-6-dev libtsan0 libubsan0 linux-libc-dev make manpages manpages-dev patch | 21:45 |
| mordred | python-pip-whl python3-dev python3-wheel python3-xdg python3.5-dev | 21:45 |
| corvus | mordred: you can pastebin :) | 21:46 |
| mordred | that's JUST from python3-pip | 21:46 |
| mordred | sorry | 21:46 |
| mordred | :) | 21:46 |
| corvus | mordred: i'm guessing that's so you can compile stuff | 21:46 |
| *** adam_g has quit IRC | 21:46 | |
| mordred | yeah. except ... I mean ... | 21:46 |
| mordred | ok. you install python and DON'T get python3-disutils - but you try to install pip and you get a whole c compile chain | 21:46 |
| mordred | even if what you were going to pip install doesn't need that | 21:47 |
| *** adam_g has joined #openstack-infra | 21:47 | |
| corvus | sure, but without that, "pip install foo" is a crapshoot | 21:47 |
| mordred | yup | 21:47 |
| corvus | if you install those things, then "pip install foo" is much more likely to work (though of course you may need further specific libraries) | 21:47 |
| mordred | totally - but it's a pretty heavyweight choice to make those required and not suggested | 21:48 |
| fungi | ianw: i wonder if the firefox name resolution default behavior change has resulted in an unanticipated denial of service against cloudflare's resolvers | 21:48 |
| mordred | especially in light of things like breaking venv into its own package | 21:48 |
| mordred | corvus: I may need to do another rev on that ... | 21:49 |
| corvus | k, all yours (i'm looking at other failures) | 21:49 |
| fungi | mordred: yes, pip itself has grown quite the corral of dependencies which it normally vendors directly but which distros understandably don't want to maintain multiple copies of | 21:49 |
| fungi | but also a lot of those are "you might use pip to install an sdist which has c extensions it will want to compile, here have the autotools toolchain" | 21:50 |
| *** ociuhandu has joined #openstack-infra | 21:50 | |
| mordred | fungi: yeah - it's the second thing that bothers me | 21:52 |
| mordred | fungi: the first thing I totally agree with | 21:52 |
| mordred | fungi: the second thing should be recommends I'd think. although - let me try no-recommends... maybe I'm making a bunch of bad noise | 21:52 |
| fungi | right, i haven't looked but they're likely recommends not depends | 21:53 |
| fungi | apt just installs recommends by default now on debian and most of its derivatives | 21:53 |
| mordred | fungi: yah - and we disable that on our images - which is nice | 21:56 |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Increase timeout in timeout test https://review.opendev.org/710146 | 21:56 |
| fungi | until you discover that folks in debianland have grown accustomed to pretty much all users installing recommends and slowly retool lots of packages to be basically useless without some of them | 21:57 |
| mordred | fungi: that's what bindep is for! | 21:58 |
| *** jamesmcarthur has quit IRC | 21:59 | |
| *** jamesmcarthur has joined #openstack-infra | 22:00 | |
| *** jamesmcarthur has quit IRC | 22:01 | |
| *** ociuhandu has quit IRC | 22:02 | |
| *** ociuhandu has joined #openstack-infra | 22:02 | |
| openstackgerrit | Monty Taylor proposed opendev/system-config master: Use explicit provides/requires for container jobs https://review.opendev.org/710106 | 22:04 |
| *** jamesmcarthur has joined #openstack-infra | 22:05 | |
| *** matt_kos_ has quit IRC | 22:06 | |
| mordred | fungi: yup. I stand down from my complaining | 22:06 |
| smcginnis | Howdy. I noticed a doc publishing job failed because https://git.openstack.org/cgit/openstack/requirements/plain/upper-constraints.txt now redirects to opendev.org instead of the full path to the new location for the file. | 22:06 |
| *** ociuhandu has quit IRC | 22:07 | |
| smcginnis | Pretty sure this has been working well for quite a while, so a little odd. But this is an older rocky branch, so probably one of the smaller set of places that have not been updated to the correct opendev location. | 22:07 |
| mordred | ianw: ^^ | 22:07 |
| mordred | ianw: something wrong with the new redirect perhaps? | 22:07 |
| smcginnis | It's also the newer publish-tox-docs-releases job, so possible something isn't passed in right there? | 22:08 |
| mordred | smcginnis: we just moved the apache serving the redirects to a new server | 22:08 |
| smcginnis | I thought it should get the upper constraints from a locally checked out requirements clone. | 22:08 |
| smcginnis | Ah, so maybe that's it. | 22:08 |
| mordred | so it's completely conceivable that there is an actual problem that got missed | 22:08 |
| smcginnis | We have had other releases go through fine, so maybe this is a first warning sign. | 22:08 |
| mordred | I agree with you on that redirect | 22:09 |
| *** priteau has quit IRC | 22:11 | |
| smcginnis | In case it helps, here are the logs - https://3889a6aa6ea3f28e18b7-a85364018f10e4ce6159c46d9b375288.ssl.cf1.rackcdn.com/ad26a73c05c882f1f9e49832fd9eb3c4911da352/release-post/publish-tox-docs-releases/be174b3/job-output.txt | 22:11 |
| *** rfolco has quit IRC | 22:12 | |
| *** tosky has joined #openstack-infra | 22:12 | |
| smcginnis | Oh, and sure enough, it was an early warning. Total of five jobs failed, all publish-tox-docs-releases. | 22:12 |
| smcginnis | All green until about 20 minutes ago - https://zuul.opendev.org/t/openstack/builds?job_name=publish-tox-docs-releases | 22:13 |
| mordred | fungi: what do you think we should do? revert the DNS change? or try to debug without revert for a bit | 22:13 |
| mordred | smcginnis: https://review.opendev.org/#/c/710142/ landed about 50 minutes ago - then had to do a cfg-mgmt pulse then a DNS refresh :) | 22:14 |
| mordred | smcginnis: so that sounds about right | 22:14 |
| smcginnis | Looks pretty suspicious. | 22:15 |
| mordred | ianw has been driving that - so he's really our man here | 22:15 |
| ianw | sorry back now, looking | 22:20 |
| ianw | curl --resolve git.openstack.org:443:23.253.125.17 https://git.openstack.org/cgit/openstack/requirements/plain/upper-constraints.txt | 22:22 |
| ianw | i agree this returns a different result to the new server | 22:22 |
| ianw | i'll undo the change and investigate | 22:23 |
| *** sshnaidm|afk has quit IRC | 22:23 | |
| ianw | ok, git.openstack.org CNAME is now returned to files.openstack.org | 22:24 |
| *** jamesmcarthur has quit IRC | 22:29 | |
| *** jamesmcarthur has joined #openstack-infra | 22:30 | |
| *** Goneri has quit IRC | 22:30 | |
| fungi | ianw: can you summarize the behavior difference? | 22:31 |
| *** eharney has joined #openstack-infra | 22:31 | |
| ianw | fungi: http://paste.openstack.org/show/790047/ | 22:32 |
| ianw | should be matching https://opendev.org/opendev/system-config/src/branch/master/playbooks/roles/static/templates/git-redirects.conf.j2#L23 ? | 22:33 |
| smcginnis | Those results are consistent with what the job complained about. | 22:33 |
| ianw | smcginnis: thanks for pointing it out ... the nice thing is we can fix it and now put in a test-case that runs against the redirector in our gate | 22:34 |
| *** jamesmcarthur has quit IRC | 22:35 | |
| *** jamesmcarthur has joined #openstack-infra | 22:35 | |
| ianw | fungi: this seems to be it's path through the regexes ... http://paste.openstack.org/show/790048/ | 22:35 |
| fungi | ianw: yeah, we must be failing to match on the right regex and falling through | 22:35 |
| openstackgerrit | James E. Blair proposed opendev/base-jobs master: Restore buildset-registry pre-run playbook https://review.opendev.org/710150 | 22:36 |
| corvus | fungi, mordred: ^ can you +3 this brown bag fix asap? | 22:36 |
| smcginnis | Glad it's a fairly easy fix. | 22:36 |
| corvus | fungi, mordred: actually, don't it has a typo | 22:37 |
| *** ijw has joined #openstack-infra | 22:37 | |
| openstackgerrit | James E. Blair proposed opendev/base-jobs master: Restore buildset-registry pre-run playbook https://review.opendev.org/710150 | 22:37 |
| corvus | fungi, mordred: there | 22:37 |
| ianw | smcginnis: oh, we haven't actually fixed it yet :) but when we do :) | 22:38 |
| smcginnis | No, but it's been identified, and sometimes that's the most difficult part. ;) | 22:39 |
| *** ociuhandu has joined #openstack-infra | 22:40 | |
| *** gagehugo has quit IRC | 22:41 | |
| ianw | fungi: looks to me it should hit ... https://opendev.org/opendev/system-config/src/branch/master/playbooks/roles/static/templates/git-redirects.conf.j2#L83 | 22:42 |
| ianw | applying pattern '^cgit/(.*?)/(.*?)/plain/?(.*)' to uri '/cgit/openstack/requirements/plain/upper-constraints.txt' | 22:42 |
| ianw | ... ohh, that' smissing a leading / | 22:43 |
| ianw | but https://opendev.org/opendev/system-config/src/branch/master/playbooks/roles/static/templates/git-redirects.conf.j2#L84 isn't??? | 22:43 |
| *** ociuhandu has quit IRC | 22:45 | |
| ianw | it's further down ... i think i got it https://opendev.org/opendev/system-config/src/branch/master/playbooks/roles/static/templates/git-redirects.conf.j2#L106 | 22:46 |
| *** rcernin has joined #openstack-infra | 22:49 | |
| *** jamesmcarthur has quit IRC | 22:49 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Remove files02.openstack.org and related puppet https://review.opendev.org/709639 | 22:50 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: static: fix git raw file redirect https://review.opendev.org/710151 | 22:50 |
| *** rosmaita has quit IRC | 22:53 | |
| *** tkajinam has joined #openstack-infra | 22:53 | |
| *** jamesmcarthur has joined #openstack-infra | 22:54 | |
| corvus | infra-root: i'm going to self-approve https://review.opendev.org/710150 which is an emergency fix to image building jobs | 22:54 |
| ianw | fungi: to your prior comment, i think that firefox dnshttps thing only applied to people in the US? | 22:57 |
| fungi | ianw: wow, one more reason for me to not want to trust it | 22:57 |
| *** rosmaita has joined #openstack-infra | 22:58 | |
| fungi | corvus: interestingly it wasn't exposed in child change 710113 until it hit the gate pipeline (if it's what i think i'm looking at) | 22:59 |
| openstackgerrit | Merged opendev/base-jobs master: Restore buildset-registry pre-run playbook https://review.opendev.org/710150 | 23:01 |
| corvus | fungi: base-jobs is non-speculative; i think 710113 in gate ran after the problem change merged | 23:02 |
| fungi | corvus: yeah, i'm realizing that now | 23:02 |
| fungi | for some reason i didn't consider that when reviewing. lesson (hopefully finally) learned | 23:02 |
| corvus | i figured we could roll the dice on this without a duplicate job change since the set of affected projects is small (us + swift); i've already made my apologies to the swift folks | 23:03 |
| corvus | but it's good to be reminded occasionally that if it's not tested it's broken | 23:03 |
| *** smarcet has quit IRC | 23:05 | |
| fungi | i wonder if there are jobs in opendev/base-jobs whichwe shoud eventually split out into a separate untrusted repo | 23:06 |
| fungi | geez my typing is getting bad. must be evening | 23:07 |
| corvus | if there are, we should, but this isn't one of them (it needs to be trusted due to its interaction with the intermediate registry) | 23:07 |
| fungi | aha, right. got it | 23:07 |
| fungi | secrets | 23:08 |
| corvus | and some shenanigans on the executor | 23:08 |
| corvus | something about socat :) | 23:08 |
| fungi | oh, i had tried really hard to forget about that proxy | 23:08 |
| * fungi sighs | 23:08 | |
| fungi | something something docker something | 23:09 |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Store build.error_detail in SQL https://review.opendev.org/709857 | 23:11 |
| *** jamesmcarthur has quit IRC | 23:15 | |
| *** bnemec has joined #openstack-infra | 23:18 | |
| *** rlandy is now known as rlandy|bbl | 23:18 | |
| *** admcleod has quit IRC | 23:19 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Remove files02.openstack.org and related puppet https://review.opendev.org/709639 | 23:25 |
| *** xek__ has quit IRC | 23:37 | |
| *** TristanSullivan has quit IRC | 23:44 | |
| *** dchen has joined #openstack-infra | 23:47 | |
| openstackgerrit | James E. Blair proposed opendev/base-jobs master: Revert "Move pull-from-intermediate-registry to docker build job" https://review.opendev.org/710156 | 23:48 |
| corvus | fungi, mordred: ^ i'm going to self-approve that and try again tomorrow | 23:49 |
| corvus | i think the secret needs to move. but i think at this point it's complex enough we should make a temporary second job | 23:49 |
| *** dchen has joined #openstack-infra | 23:55 | |
| openstackgerrit | Merged opendev/base-jobs master: Revert "Move pull-from-intermediate-registry to docker build job" https://review.opendev.org/710156 | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!