| *** jamesmcarthur has quit IRC | 00:01 | |
| *** rascasoft has quit IRC | 00:09 | |
| *** rascasoft has joined #openstack-infra | 00:09 | |
| *** jamesmcarthur has joined #openstack-infra | 00:21 | |
| *** markvoelker has joined #openstack-infra | 00:21 | |
| *** markvoelker has quit IRC | 00:27 | |
| *** jamesmcarthur has quit IRC | 00:52 | |
| *** yamamoto has joined #openstack-infra | 01:06 | |
| *** jamesmcarthur has joined #openstack-infra | 01:08 | |
| *** yamamoto has quit IRC | 01:11 | |
| *** markvoelker has joined #openstack-infra | 01:22 | |
| *** tonyb[m] has joined #openstack-infra | 01:23 | |
| *** markvoelker has quit IRC | 01:26 | |
| *** betherly has joined #openstack-infra | 01:39 | |
| *** betherly has quit IRC | 01:43 | |
| *** yamamoto has joined #openstack-infra | 01:53 | |
| *** betherly has joined #openstack-infra | 01:54 | |
| *** jamesmcarthur has quit IRC | 01:55 | |
| *** jamesmcarthur has joined #openstack-infra | 01:55 | |
| *** betherly has quit IRC | 01:59 | |
| *** jamesmcarthur has quit IRC | 02:00 | |
| *** markvoelker has joined #openstack-infra | 02:02 | |
| *** jamesmcarthur has joined #openstack-infra | 02:05 | |
| *** jamesmcarthur has quit IRC | 02:10 | |
| *** jamesmcarthur has joined #openstack-infra | 02:18 | |
| *** jamesmcarthur has quit IRC | 02:22 | |
| *** yamamoto has quit IRC | 02:23 | |
| *** jamesmcarthur has joined #openstack-infra | 02:24 | |
| *** markvoelker has quit IRC | 02:29 | |
| *** yamamoto has joined #openstack-infra | 02:29 | |
| *** jamesmcarthur has quit IRC | 02:32 | |
| *** yamamoto has quit IRC | 02:34 | |
| *** jamesmcarthur has joined #openstack-infra | 02:58 | |
| *** markvoelker has joined #openstack-infra | 03:01 | |
| *** markvoelker has quit IRC | 03:06 | |
| *** yamamoto has joined #openstack-infra | 03:07 | |
| *** slaweq has joined #openstack-infra | 03:11 | |
| *** slaweq has quit IRC | 03:15 | |
| *** factor has joined #openstack-infra | 03:18 | |
| *** jamesmcarthur has quit IRC | 03:31 | |
| *** jamesmcarthur_ has joined #openstack-infra | 03:31 | |
| *** yamamoto has quit IRC | 03:34 | |
| *** yamamoto has joined #openstack-infra | 03:47 | |
| *** jamesmcarthur_ has quit IRC | 04:01 | |
| *** yamamoto has quit IRC | 04:03 | |
| *** markvoelker has joined #openstack-infra | 04:07 | |
| *** markvoelker has quit IRC | 04:11 | |
| *** yamamoto has joined #openstack-infra | 04:14 | |
| *** jamesmcarthur has joined #openstack-infra | 04:21 | |
| *** yamamoto has quit IRC | 04:27 | |
| *** yamamoto has joined #openstack-infra | 04:31 | |
| *** yamamoto has quit IRC | 04:32 | |
| *** yamamoto has joined #openstack-infra | 04:45 | |
| *** zbr has quit IRC | 04:45 | |
| *** zbr has joined #openstack-infra | 04:46 | |
| *** markvoelker has joined #openstack-infra | 05:07 | |
| *** slaweq has joined #openstack-infra | 05:11 | |
| *** markvoelker has quit IRC | 05:12 | |
| *** slaweq has quit IRC | 05:15 | |
| AJaeger | infra-root, I see lots of "retry_limit" failures. | 05:20 |
|---|---|---|
| AJaeger | Following one job in Zuul, it ended with: "msg": "SSH Error: data could not be sent to remote host \"logs.openstack.org\". Make sure this host can be reached over ssh", | 05:21 |
| AJaeger | Looking at cacti.o.o for static.o.o: All graphs end around 1am. Example http://cacti.openstack.org/cacti/graph.php?action=zoom&local_graph_id=1055&rra_id=0&view_type=tree&graph_start=1564810010&graph_end=1564896410 | 05:28 |
| AJaeger | on the other hand I can access http://logs.openstack.org/ | 05:29 |
| * AJaeger sees it the SSH Error on multiple systems | 05:32 | |
| AJaeger | #status alert Our CI system has problems uploading job results to the log server and thus all jobs are failing. Do not recheck jobs until the situation is fixed. | 05:34 |
| openstackstatus | AJaeger: sending alert | 05:34 |
| -openstackstatus- NOTICE: Our CI system has problems uploading job results to the log server and thus all jobs are failing. Do not recheck jobs until the situation is fixed. | 05:37 | |
| *** ChanServ changes topic to "Our CI system has problems uploading job results to the log server and thus all jobs are failing. Do not recheck jobs until the situation is fixed." | 05:37 | |
| AJaeger | mmh, what is this? http://logs.openstack.org/help/ I guess it can be deleted... | 05:40 |
| AJaeger | lots of content here http://logs.openstack.org/lost+found/ | 05:41 |
| openstackstatus | AJaeger: finished sending alert | 05:41 |
| *** jamesmcarthur has quit IRC | 05:45 | |
| *** yamamoto has quit IRC | 05:46 | |
| *** Lucas_Gray has joined #openstack-infra | 06:04 | |
| *** yamamoto has joined #openstack-infra | 06:18 | |
| *** yamamoto has quit IRC | 06:23 | |
| *** jamesmcarthur has joined #openstack-infra | 06:23 | |
| *** whoami-rajat has joined #openstack-infra | 06:25 | |
| *** yamamoto has joined #openstack-infra | 06:31 | |
| *** yolanda has joined #openstack-infra | 06:33 | |
| *** jamesmcarthur has quit IRC | 06:36 | |
| mnaser | AJaeger: ouch. Lost and found is a result of where ext4 files end up | 07:07 |
| mnaser | When a fsck finds inodes that are lost | 07:08 |
| mnaser | I assume that was from the fsck on the 15th of last month according to dates. | 07:08 |
| mnaser | I'm gonna guess a file system lock up .. | 07:09 |
| *** slaweq has joined #openstack-infra | 07:11 | |
| *** slaweq has quit IRC | 07:16 | |
| *** yamamoto has quit IRC | 07:30 | |
| *** slaweq has joined #openstack-infra | 07:36 | |
| *** yamamoto has joined #openstack-infra | 07:37 | |
| *** markvoelker has joined #openstack-infra | 07:38 | |
| *** markvoelker has quit IRC | 07:44 | |
| *** jtomasek has joined #openstack-infra | 07:45 | |
| *** shachar has quit IRC | 07:51 | |
| *** shachar has joined #openstack-infra | 07:51 | |
| *** roman_g has joined #openstack-infra | 07:55 | |
| *** altlogbot_2 has quit IRC | 07:57 | |
| *** altlogbot_0 has joined #openstack-infra | 07:58 | |
| *** dpawlik has joined #openstack-infra | 08:01 | |
| *** roman_g has quit IRC | 08:04 | |
| *** jtomasek has quit IRC | 08:05 | |
| *** yamamoto has quit IRC | 08:13 | |
| *** markvoelker has joined #openstack-infra | 08:23 | |
| *** yamamoto has joined #openstack-infra | 08:38 | |
| *** markvoelker has quit IRC | 08:42 | |
| *** Lucas_Gray has quit IRC | 08:42 | |
| *** jtomasek has joined #openstack-infra | 08:54 | |
| *** whoami-rajat has quit IRC | 09:05 | |
| *** yamamoto has quit IRC | 09:07 | |
| *** yamamoto has joined #openstack-infra | 09:17 | |
| *** yamamoto has quit IRC | 09:27 | |
| *** jtomasek_ has joined #openstack-infra | 09:31 | |
| *** jtomasek has quit IRC | 09:31 | |
| yoctozepto | AJaeger, mnaser: any time estimate for CI regaining health? | 09:33 |
| *** rascasoft has quit IRC | 09:50 | |
| *** rascasoft has joined #openstack-infra | 09:51 | |
| *** markvoelker has joined #openstack-infra | 09:53 | |
| *** markvoelker has quit IRC | 09:58 | |
| *** yamamoto has joined #openstack-infra | 10:01 | |
| *** yamamoto has quit IRC | 10:02 | |
| *** jtomasek_ has quit IRC | 10:48 | |
| mordred | infra-root: I cannot log in over ssh - but in the rackspace emergency console there is a kernel stacktrace. I think we might want to reboot the machine via cloud api | 10:51 |
| mordred | I'm going to do that now | 10:54 |
| mordred | AJaeger, infra-root: the reboot seems to have fixed the can't log in issue | 10:56 |
| mordred | and the server seems to be ok now | 10:56 |
| *** markvoelker has joined #openstack-infra | 11:08 | |
| *** betherly has joined #openstack-infra | 11:14 | |
| *** whoami-rajat has joined #openstack-infra | 11:14 | |
| *** betherly has quit IRC | 11:19 | |
| *** Lucas_Gray has joined #openstack-infra | 11:27 | |
| *** Wryhder has joined #openstack-infra | 11:30 | |
| *** Lucas_Gray has quit IRC | 11:31 | |
| *** Wryhder is now known as Lucas_Gray | 11:31 | |
| *** rascasoft has quit IRC | 11:34 | |
| *** betherly has joined #openstack-infra | 11:34 | |
| *** markvoelker has quit IRC | 11:36 | |
| *** rascasoft has joined #openstack-infra | 11:36 | |
| *** yamamoto has joined #openstack-infra | 11:39 | |
| *** betherly has quit IRC | 11:39 | |
| *** dpawlik has quit IRC | 11:57 | |
| *** kmarc has quit IRC | 11:57 | |
| *** e0ne has joined #openstack-infra | 11:58 | |
| *** e0ne has quit IRC | 12:00 | |
| *** Wryhder has joined #openstack-infra | 12:01 | |
| *** Lucas_Gray has quit IRC | 12:01 | |
| *** Wryhder is now known as Lucas_Gray | 12:02 | |
| *** betherly has joined #openstack-infra | 12:05 | |
| *** markvoelker has joined #openstack-infra | 12:08 | |
| *** lbragstad has joined #openstack-infra | 12:08 | |
| *** kmarc has joined #openstack-infra | 12:08 | |
| *** kmarc has quit IRC | 12:09 | |
| *** betherly has quit IRC | 12:09 | |
| *** markvoelker has quit IRC | 12:12 | |
| *** kmarc has joined #openstack-infra | 12:16 | |
| AJaeger | thanks, mordred | 12:17 |
| AJaeger | want to give an all clear? | 12:17 |
| AJaeger | yeah, first jobs are succceeding... | 12:18 |
| AJaeger | #status ok log publishing is working again, you can recheck your jobs failed with "retry_limit" | 12:25 |
| openstackstatus | AJaeger: sending ok | 12:25 |
| AJaeger | yoctozepto: now ;) Note that this is very difficult to predict since it's weekend... | 12:26 |
| *** ChanServ changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs http://docs.openstack.org/infra/ | bugs https://storyboard.openstack.org/ | source https://opendev.org/opendev/ | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-infra/" | 12:28 | |
| -openstackstatus- NOTICE: log publishing is working again, you can recheck your jobs failed with "retry_limit" | 12:28 | |
| *** rascasoft has quit IRC | 12:29 | |
| *** rascasoft has joined #openstack-infra | 12:31 | |
| openstackstatus | AJaeger: finished sending ok | 12:32 |
| *** dpawlik has joined #openstack-infra | 12:38 | |
| *** markvoelker has joined #openstack-infra | 12:46 | |
| *** markvoelker has quit IRC | 12:51 | |
| *** rfolco|ruck has quit IRC | 12:58 | |
| *** lbragstad has quit IRC | 12:59 | |
| *** dpawlik has quit IRC | 13:04 | |
| *** yamamoto has quit IRC | 13:04 | |
| *** yamamoto has joined #openstack-infra | 13:05 | |
| *** dpawlik has joined #openstack-infra | 13:16 | |
| *** dpawlik has quit IRC | 13:20 | |
| *** yamamoto has quit IRC | 13:21 | |
| *** whoami-rajat has quit IRC | 13:24 | |
| fungi | thanks mordred! | 13:34 |
| *** betherly has joined #openstack-infra | 13:36 | |
| yoctozepto | AJaeger, mordred: thanks, guys | 13:39 |
| *** tosky has joined #openstack-infra | 13:40 | |
| *** betherly has quit IRC | 13:41 | |
| *** bhavikdbavishi has joined #openstack-infra | 13:43 | |
| *** BrentonPoke has joined #openstack-infra | 13:44 | |
| BrentonPoke | Would this be a decent channel for info about the nature of openstack distributions? | 13:45 |
| *** yamamoto has joined #openstack-infra | 13:47 | |
| fungi | BrentonPoke: likely not, since this is the channel where we collaborate on maintaining support infrastructure for the developer community (ci and code review systems, mailing lists servers, et cetera) | 13:52 |
| fungi | BrentonPoke: https://wiki.openstack.org/wiki/IRC has a list of channels with some descriptions, my recommendations would be #openstack, #openstack-operators or maybe #openstack-tc | 13:54 |
| fungi | or each of the official deployment projects also has an irc channel listed there | 13:54 |
| BrentonPoke | fungi Thanks for responding. I will check the main #openstack channel first. | 13:54 |
| *** markvoelker has joined #openstack-infra | 13:57 | |
| *** bhavikdbavishi has quit IRC | 13:59 | |
| *** phalmos has quit IRC | 13:59 | |
| *** markvoelker has quit IRC | 14:01 | |
| *** whoami-rajat has joined #openstack-infra | 14:05 | |
| *** niceplace has quit IRC | 14:15 | |
| *** niceplace has joined #openstack-infra | 14:15 | |
| *** niceplace has quit IRC | 14:17 | |
| *** niceplace has joined #openstack-infra | 14:18 | |
| *** niceplace has quit IRC | 14:20 | |
| *** niceplace has joined #openstack-infra | 14:20 | |
| *** niceplace has quit IRC | 14:21 | |
| *** niceplace has joined #openstack-infra | 14:21 | |
| *** niceplace has quit IRC | 14:21 | |
| *** niceplace has joined #openstack-infra | 14:21 | |
| *** Lucas_Gray has quit IRC | 14:23 | |
| *** Lucas_Gray has joined #openstack-infra | 14:31 | |
| *** betherly has joined #openstack-infra | 14:36 | |
| *** betherly has quit IRC | 14:41 | |
| *** dklyle has quit IRC | 14:54 | |
| *** e0ne has joined #openstack-infra | 14:55 | |
| *** betherly has joined #openstack-infra | 14:57 | |
| *** e0ne has quit IRC | 15:00 | |
| *** betherly has quit IRC | 15:01 | |
| *** slaweq has quit IRC | 15:05 | |
| *** markvoelker has joined #openstack-infra | 15:06 | |
| *** Goneri has joined #openstack-infra | 15:10 | |
| *** markvoelker has quit IRC | 15:11 | |
| *** markvoelker has joined #openstack-infra | 15:11 | |
| *** ricolin has joined #openstack-infra | 15:12 | |
| *** Lucas_Gray has quit IRC | 15:13 | |
| *** e0ne has joined #openstack-infra | 15:16 | |
| *** markvoelker has quit IRC | 15:16 | |
| *** factor has quit IRC | 15:26 | |
| *** factor has joined #openstack-infra | 15:27 | |
| *** icarusfactor has joined #openstack-infra | 15:29 | |
| *** factor has quit IRC | 15:31 | |
| *** betherly has joined #openstack-infra | 15:38 | |
| *** betherly has quit IRC | 15:43 | |
| *** Goneri has quit IRC | 15:43 | |
| corvus | mnaser: can you tell me what values i should use for the access_key and secret_key when using the s3 api in vexxhost? | 15:48 |
| *** yamamoto has quit IRC | 15:53 | |
| *** yamamoto has joined #openstack-infra | 15:54 | |
| *** yamamoto has quit IRC | 15:54 | |
| *** yamamoto has joined #openstack-infra | 15:54 | |
| *** yamamoto has quit IRC | 15:55 | |
| *** yamamoto has joined #openstack-infra | 15:55 | |
| *** yamamoto has quit IRC | 15:55 | |
| *** bhavikdbavishi has joined #openstack-infra | 15:56 | |
| *** yamamoto has joined #openstack-infra | 15:56 | |
| *** vesper11 has joined #openstack-infra | 15:58 | |
| *** e0ne has quit IRC | 16:00 | |
| *** yamamoto has quit IRC | 16:01 | |
| *** slaweq has joined #openstack-infra | 16:04 | |
| *** yamamoto has joined #openstack-infra | 16:06 | |
| *** jtomasek has joined #openstack-infra | 16:10 | |
| *** yamamoto has quit IRC | 16:10 | |
| *** jamesmcarthur has joined #openstack-infra | 16:19 | |
| *** jamesmcarthur has quit IRC | 16:19 | |
| *** betherly has joined #openstack-infra | 16:19 | |
| *** jamesmcarthur has joined #openstack-infra | 16:19 | |
| *** rascasoft has quit IRC | 16:21 | |
| *** betherly has quit IRC | 16:24 | |
| *** rascasoft has joined #openstack-infra | 16:24 | |
| *** niceplace has quit IRC | 16:29 | |
| *** markvoelker has joined #openstack-infra | 16:32 | |
| *** whoami-rajat has quit IRC | 16:35 | |
| *** markvoelker has quit IRC | 16:37 | |
| *** betherly has joined #openstack-infra | 16:40 | |
| *** jamesmcarthur has quit IRC | 16:44 | |
| *** betherly has quit IRC | 16:45 | |
| *** jamesmcarthur has joined #openstack-infra | 16:45 | |
| *** e0ne has joined #openstack-infra | 16:53 | |
| *** jamesmcarthur has quit IRC | 16:57 | |
| *** betherly has joined #openstack-infra | 17:00 | |
| *** ricolin has quit IRC | 17:03 | |
| *** betherly has quit IRC | 17:05 | |
| zbr | can I mirror from outside, like github to opendev.org? (opposite to mirroring openstack projects to github). i so how? | 17:10 |
| *** jamesmcarthur has joined #openstack-infra | 17:11 | |
| *** dklyle has joined #openstack-infra | 17:11 | |
| fungi | code review is the interface for updating source code in opendev | 17:12 |
| mordred | fungi: that's much more succinct than what I was about to try to say | 17:12 |
| fungi | our goal is not to provide a general-purpose source code hosting service, but to provide an software collaboration space with opinionated workflows requiring code review and gating | 17:13 |
| zbr | maybe i should have explained why I asked it, as it was 100% related to openstack/zuul. | 17:14 |
| fungi | yes, knowing the use case may help identify solutions | 17:15 |
| fungi | asking about specific solutions first is going about it from the wrong end | 17:15 |
| zbr | as you probably observed, others are adopting pre-commit tool, which *clones* few repos from outside (github, gitlab). If more projects will adopt it, we will start seeing build failures caused by rate limiting. | 17:16 |
| *** jamesmcarthur has quit IRC | 17:16 | |
| zbr | the alternative is to configure it to point to our own mirrors of these repos (very few of them). | 17:16 |
| fungi | fix pre-commit to not consume its plugins via git | 17:16 |
| fungi | consume released plugins | 17:16 |
| fungi | those are much easier to mirror | 17:17 |
| zbr | fungi: this will not change (i tried), it is git by design (and also have few good reasons for doing it) | 17:17 |
| zbr | for flake8 there is a workaround for there are few others which would not work the same, a git clone still being needed. | 17:18 |
| zbr | we have the power to point it to whichever fit repo we want. | 17:18 |
| zbr | i seen nova trying to adopt pre-commit, i like the idea, but not the infra implications, see https://review.opendev.org/#/c/665518/6/.pre-commit-config.yaml | 17:19 |
| zbr | i just want to help our developers use it, without risking to affect the stability of our builds. | 17:20 |
| *** betherly has joined #openstack-infra | 17:21 | |
| zbr | travis users do not have a problem because you can enable caching of ~/.cache/pre-commit across builds. but we do not have this luxury with zuul. | 17:21 |
| corvus | zuul can absolutely cache any repository in the world. whether the openstack project policy permits that is another question. | 17:22 |
| zbr | the tool knows only to clone from given URL, how could we tell it to "clone from this local path when you run on zuul"? | 17:24 |
| fungi | that sounds like a failing of pre-commit | 17:24 |
| fungi | if it doesn't allow you to configure urls | 17:24 |
| corvus | zbr: oh, were you thinking that if plugins were hosted on opendev.org, we could "git clone https://opendev.org/org/plugin" in jobs and that would be okay? | 17:25 |
| zbr | fungi: yeah, this is what I was thinking ~1 year go, in time i did understand few other things. | 17:25 |
| corvus | because that's not okay either | 17:26 |
| zbr | corvus: that was my question about: mirroring these plugins. | 17:26 |
| corvus | we're as uninterested in DOSing ourselves as we are DOSing github | 17:26 |
| *** betherly has quit IRC | 17:26 | |
| corvus | openstack test jobs aren't supposed to clone repos from *anywhere* | 17:26 |
| fungi | we pre-cache repositories on disk in our node images, and zuul executors push updates for them onto the nodes when jobs start | 17:27 |
| zbr | btw, what you call plugin is bit different, usually is the linting tool itself. making a linter a pre-commit plugin required you to commit only one YAML file in the root of the project. | 17:27 |
| corvus | they're supposed to use git repos that zuul prepares on disk before the job starts, or released software from mirrors. | 17:27 |
| zbr | this is how I made bashate and doc8, plugins. one file. | 17:27 |
| fungi | pre-commit sounds a lot more fragile than i realized, if it relies on performing git clone operations at runtime | 17:28 |
| fungi | are you sure that's the only way the authors intend it to be used? | 17:29 |
| zbr | fungi: it is fragile when it comes to *our* CI, not in general. from the author point of view is quite robust. works well on both local-devel, and CI (travis being an example). | 17:30 |
| corvus | these crazy "rules" i'm spouting aren't just because i'm grumpy -- these are *hard* lessons that we've learned running one of the highest volume open source projects that has ever existed. 'clone a git repo from github' is fine for small projects. it absolutely doesn't scale to the level we run at for openstack. the transient failure rate of cloning from github alone is high enough to | 17:30 |
| corvus | significantly reduce the overall throughput of our project. | 17:30 |
| zbr | i know few tricks, for flake8 there is a workaround, as you can see in the nova patch. | 17:30 |
| fungi | as long as you don't have problems doing a git clone | 17:30 |
| fungi | over the open internet | 17:31 |
| fungi | (every time you touch the network, it's another opportunity for your build to fail... and if you have to cross the internet then the failure rate rises sharply) | 17:31 |
| *** icarusfactor has quit IRC | 17:31 | |
| fungi | the internet is, simply put, not reliable | 17:32 |
| zbr | fungi: corvus: as you can see I am somewhere in the middle, between infra, devs and tool-author: what can we do to avoid issues? (keep in mind he is not really seeing the git cloning as a real issue) | 17:32 |
| fungi | use sanely-designed tools, or fork ones which have promise but their maintainers don't see eye-to-eye with your use case | 17:33 |
| zbr | the tool is robust because once it creates the first clone, it reuses it, so future builds do not even do a HTTP request. only first time is clones. | 17:33 |
| zbr | sadly for us, on zuul, first time = each time. | 17:33 |
| fungi | as long as you're not running it in a pristine system every time to test untrusted code | 17:33 |
| *** factor has joined #openstack-infra | 17:33 | |
| fungi | yes | 17:33 |
| fungi | i seriously doubt using it in travis-ci is any different in that regard | 17:34 |
| fungi | if github goes down, you can't run the tool on a new system until it comes back up | 17:34 |
| fungi | i expect this is of little concern to folks who do their development on github, since the canonical source for their projects is also offline when that happens | 17:35 |
| zbr | it never clones master, always using a revision (which can be a sha256). | 17:35 |
| *** Goneri has joined #openstack-infra | 17:35 | |
| zbr | true, but he will say that you can point it to whatever git server you want. that is why I was wondering if we could not achieve that independence by mirrors 2-3 repos on opendev. | 17:36 |
| corvus | how do you "point it at a git server"? | 17:37 |
| fungi | options i see: convince the pre-commit maintainers that alternatives to git clone at runtime are legitimately needed for some use cases, fork and patch to make your own version which meets the desired use case, or use another tool which lacks those problems | 17:37 |
| fungi | oh, if you *can* configure the git urls, then i expect file:// urls are probably also supported? | 17:37 |
| zbr | fungi: let me explain to you: pre-commit *happens* to be written in python but it works with non-python projects. you cannot create wheels for those. git was the only language-agnostic delivery method. | 17:37 |
| zbr | i am almost sure file:// will work, but it will be useless for developers cloning those projects. | 17:38 |
| fungi | http is also language-agnostic, but that's orthogonal to the point i think | 17:38 |
| corvus | yeah, we're going to disagree about whether, in the entire history of computing, the only language agnostic delivery method for programs is 'git'. but it's not important for this discussion. | 17:39 |
| fungi | are you saying that some pre-commit tests do the equivalent of `git clone ...;make` to build c projects? | 17:39 |
| zbr | :D | 17:39 |
| fungi | rather than consuming prebuilt binaries? | 17:40 |
| zbr | kinda of, most of those I used where python. but i used a nodejs one tool. | 17:40 |
| corvus | oh, you're saying that folks can put whatever git urls in the file they want, but it's just a static config that would be used in local dev and ci | 17:40 |
| fungi | which i guess does a grunt build and needs nodejs preinstalled? | 17:40 |
| zbr | fungi: mostly yes, but it does this on an isolated nodeenv. | 17:40 |
| zbr | in fact i think it can also boostrap node, if i remember well. | 17:41 |
| fungi | maybe we could include alternative pre-commit configs or assemble them at job runtime? | 17:42 |
| corvus | then, if i were tasked with making this work reliably in a zuul system, i would add the plugin repos to zuul's tenant config, then have a pre-playbook which rewrote the pre-commit config file with the zuul on-disk clones of those urls. | 17:42 |
| corvus | or fungi's similar thought | 17:42 |
| fungi | of course, all this assumes pre-commit can work with file:// clone urls | 17:43 |
| zbr | corvus: that could be done, not even very hard but it will not work. | 17:43 |
| fungi | or explicit local paths | 17:43 |
| zbr | it destroys the concept that requires: "tested code should never be altered during execution". In fact pre-commit itself will detect that and return a non zero exit code. | 17:43 |
| zbr | that is why "git status" should return no changes. | 17:44 |
| corvus | one of us doesn't understand the other, but i don't know which | 17:44 |
| fungi | can't pre-commit be pointed at an alternative configuration that isn't inside the git repo? | 17:44 |
| zbr | but there are alternatives: we can copy the file and run pre-commit with alternative config file, from outside repo. it should work, never tried. | 17:45 |
| *** e0ne has quit IRC | 17:45 | |
| zbr | can we put the zuul cache in a generic structure like: /cache/github.com/pre-commit/pre-commit-hooks.git ? | 17:46 |
| *** e0ne has joined #openstack-infra | 17:46 | |
| zbr | if so I think I could persuade the author to add an option that tells the tool to look for local clone. | 17:47 |
| zbr | it would be doable without having to make zuul job more complex. | 17:47 |
| corvus | it's zuul, you can do anything you want | 17:48 |
| mordred | zbr: zuul would cloneE to src/github.com/pre-commit/pre-commit-hooks, which is how go clones things. perhaps convince the author to accept a patch pointing to a local cache root dir underwhich things exist in a {host}/{repo} form (which cargo from rust supports already, btw) | 17:48 |
| corvus | zbr: here's how zuul sets up cloned repos: https://zuul-ci.org/docs/zuul/user/jobs.html#git-repositories | 17:49 |
| mordred | so it's really about convincing the tool author that there is a general use-case to look for locally cloned repos in a predictable scheme | 17:49 |
| zbr | ha! i think I found something even better, could be used to speed git for more things: git config --global url."http://gitcache:1234/".insteadOf https:// | 17:49 |
| corvus | zbr: that's golang style layout. so maybe you could argue for that. if that doesn't work, you can move them as needed. | 17:49 |
| zbr | if this works with our versions of git, we can avoid cloning from git. | 17:50 |
| *** jamesmcarthur has joined #openstack-infra | 17:52 | |
| corvus | i'd like to reiterate that while i'm interested in helping address how to run this well with zuul in general, i'm still very unsure whether this is appropriate for openstack projects. | 17:52 |
| *** e0ne has quit IRC | 17:55 | |
| *** markvoelker has joined #openstack-infra | 17:58 | |
| *** jamesmcarthur has quit IRC | 17:59 | |
| *** markvoelker has quit IRC | 18:09 | |
| *** markvoelker has joined #openstack-infra | 18:10 | |
| *** betherly has joined #openstack-infra | 18:12 | |
| *** tosky has quit IRC | 18:12 | |
| *** Goneri has quit IRC | 18:14 | |
| *** jamesmcarthur has joined #openstack-infra | 18:16 | |
| *** betherly has quit IRC | 18:17 | |
| *** markvoelker has quit IRC | 18:20 | |
| *** jamesmcarthur has quit IRC | 18:21 | |
| *** bhavikdbavishi has quit IRC | 18:25 | |
| *** jtomasek has quit IRC | 18:25 | |
| *** markvoelker has joined #openstack-infra | 18:25 | |
| *** markvoelker has quit IRC | 18:39 | |
| *** betherly has joined #openstack-infra | 18:43 | |
| *** rkukura has joined #openstack-infra | 18:48 | |
| *** betherly has quit IRC | 18:49 | |
| *** factor has quit IRC | 18:51 | |
| *** factor has joined #openstack-infra | 18:51 | |
| *** Lucas_Gray has joined #openstack-infra | 18:58 | |
| *** betherly has joined #openstack-infra | 19:04 | |
| *** markvoelker has joined #openstack-infra | 19:07 | |
| *** betherly has quit IRC | 19:09 | |
| *** markvoelker has quit IRC | 19:12 | |
| *** factor has quit IRC | 19:16 | |
| *** jtomasek has joined #openstack-infra | 19:19 | |
| *** jtomasek_ has joined #openstack-infra | 19:23 | |
| *** jtomasek has quit IRC | 19:24 | |
| *** pfallenop has quit IRC | 19:40 | |
| *** betherly has joined #openstack-infra | 19:45 | |
| *** betherly has quit IRC | 19:50 | |
| *** armax has joined #openstack-infra | 19:53 | |
| *** Lucas_Gray has quit IRC | 19:55 | |
| *** armax has quit IRC | 19:59 | |
| *** pfallenop has joined #openstack-infra | 20:00 | |
| *** Lucas_Gray has joined #openstack-infra | 20:01 | |
| *** markvoelker has joined #openstack-infra | 20:06 | |
| *** pfallenop has quit IRC | 20:09 | |
| *** pfallenop has joined #openstack-infra | 20:10 | |
| *** markvoelker has quit IRC | 20:12 | |
| zbr | fungi: you may want to vote on https://github.com/ansible/ansible-lint/issues/559 or even cross post into #ansible-devel - maybe we can persuade them to give it more attention. | 20:14 |
| fungi | i was about to reply on your review comment... i actually don't see it as urgent. we have the rule excluded, i just wanted to make it clear the change to undo that exclusion isn't viable until there's a new ansible-lint release (however long that takes) | 20:15 |
| *** jamesmcarthur has joined #openstack-infra | 20:18 | |
| *** slaweq has quit IRC | 20:26 | |
| *** Lucas_Gray has quit IRC | 20:42 | |
| *** Lucas_Gray has joined #openstack-infra | 20:43 | |
| *** jtomasek_ has quit IRC | 20:46 | |
| *** guoqiao has joined #openstack-infra | 20:52 | |
| *** jamesmcarthur has quit IRC | 20:54 | |
| *** Lucas_Gray has quit IRC | 20:57 | |
| *** markvoelker has joined #openstack-infra | 21:02 | |
| *** markvoelker has quit IRC | 21:07 | |
| *** e0ne has joined #openstack-infra | 21:13 | |
| *** xek has joined #openstack-infra | 21:17 | |
| *** xek has quit IRC | 21:21 | |
| *** tosky has joined #openstack-infra | 21:32 | |
| *** markvoelker has joined #openstack-infra | 21:45 | |
| *** e0ne has quit IRC | 21:45 | |
| *** markvoelker has quit IRC | 21:50 | |
| *** seongsoocho has quit IRC | 22:06 | |
| *** seongsoocho has joined #openstack-infra | 22:06 | |
| *** bgmccollum has quit IRC | 22:55 | |
| *** tkajinam has joined #openstack-infra | 22:56 | |
| *** bgmccollum has joined #openstack-infra | 22:57 | |
| *** markvoelker has joined #openstack-infra | 23:06 | |
| *** markvoelker has quit IRC | 23:11 | |
| *** rcernin has joined #openstack-infra | 23:19 | |
| *** tosky has quit IRC | 23:25 | |
| *** dchen has joined #openstack-infra | 23:35 | |
| *** panda is now known as panda|pubholiday | 23:41 | |
| *** jamesmcarthur has joined #openstack-infra | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!