*** DSpider has quit IRC | 00:27 | |
*** hamalq_ has quit IRC | 02:45 | |
*** el1x1r has joined #opendev | 03:19 | |
*** el1x1r has quit IRC | 03:25 | |
*** d34dh0r53 has quit IRC | 03:44 | |
*** ysandep|away is now known as ysandep|ruck | 03:52 | |
*** bhagyashris is now known as bhagyashris|sick | 05:09 | |
*** fressi has joined #opendev | 05:16 | |
*** fressi has quit IRC | 05:39 | |
*** marios has joined #opendev | 05:46 | |
*** Tengu has quit IRC | 06:03 | |
*** Tengu has joined #opendev | 06:05 | |
cgoncalves | ianw, kevinz: hey. any news on Linaro being down? | 06:13 |
---|---|---|
*** rpittau|afk is now known as rpittau | 06:21 | |
*** mkalcok has joined #opendev | 06:23 | |
*** ysandep|ruck is now known as ysandep|afk | 06:37 | |
*** eolivare has joined #opendev | 06:37 | |
*** slaweq has joined #opendev | 06:51 | |
*** ralonsoh has joined #opendev | 07:02 | |
*** andrewbonney has joined #opendev | 07:13 | |
*** icey has quit IRC | 07:17 | |
*** icey has joined #opendev | 07:19 | |
*** sboyron has joined #opendev | 07:20 | |
*** sboyron has quit IRC | 07:26 | |
*** ysandep|afk is now known as ysandep|ruck | 07:28 | |
*** roman_g has joined #opendev | 07:32 | |
*** tosky has joined #opendev | 07:36 | |
ysandep|ruck | #opendev hey i noticed some jobs are with mirror issues:- | 07:44 |
ysandep|ruck | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_7d5/756492/1/gate/tripleo-ci-centos-8-content-provider/7d526c8/job-output.txt | 07:44 |
ysandep|ruck | ~~~ | 07:44 |
ysandep|ruck | 2020-10-23 07:36:26.814749 | primary | Errors during downloading metadata for repository 'AppStream': | 07:44 |
ysandep|ruck | 2020-10-23 07:36:26.814847 | primary | - Status code: 403 for https://mirror.regionone.limestone.opendev.org/centos/8/AppStream/x86_64/os/repodata/repomd.xml (IP: 2607:ff68:100:54:f816:3eff:feb5:4635) | 07:44 |
ysandep|ruck | 2020-10-23 07:36:26.814939 | primary | Error: Failed to download metadata for repo 'AppStream': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried | 07:44 |
ysandep|ruck | ~~~ | 07:44 |
ysandep|ruck | fungi, clarkb ^^ fyi .. | 07:48 |
*** sboyron has joined #opendev | 07:49 | |
*** sboyron has quit IRC | 07:51 | |
*** sboyron has joined #opendev | 07:52 | |
*** ysandep|ruck is now known as ysandeep|ruck | 07:59 | |
*** DjeufackZane has joined #opendev | 08:00 | |
*** ysandeep|ruck is now known as ysandeep|lunch | 08:10 | |
*** Tengu has quit IRC | 08:34 | |
*** Tengu has joined #opendev | 08:45 | |
*** slaweq has quit IRC | 08:52 | |
*** slaweq has joined #opendev | 08:52 | |
*** marios has quit IRC | 08:54 | |
*** sboyron has quit IRC | 09:04 | |
*** ysandeep|lunch is now known as ysandeep|ruck | 09:18 | |
*** DjeufackZane has quit IRC | 09:28 | |
openstackgerrit | likui proposed openstack/diskimage-builder master: update tox https://review.opendev.org/759384 | 09:43 |
*** fressi has joined #opendev | 09:55 | |
*** marios has joined #opendev | 09:55 | |
yoctozepto | morning infra | 09:55 |
yoctozepto | is there a chance to get valid https on http://ptg.openstack.org/ ? | 09:56 |
*** sboyron has joined #opendev | 10:18 | |
*** sboyron has quit IRC | 10:23 | |
*** Eighth_Doctor has quit IRC | 10:24 | |
*** mordred has quit IRC | 10:24 | |
*** Eighth_Doctor has joined #opendev | 10:33 | |
frickler | yoctozepto: we can (and should IMO) do this, but I'm not sure we'll be able to finish that before the upcoming PTG | 10:37 |
*** ysandeep|ruck is now known as ysandep|ruck|afk | 10:38 | |
*** Tengu has quit IRC | 10:40 | |
*** Tengu has joined #opendev | 10:41 | |
*** mkalcok has quit IRC | 10:46 | |
*** mordred has joined #opendev | 10:49 | |
frickler | infra-root: I need to run to an appointment, but limestone mirror seems broken, we need to either fix it or disable the region for now | 10:59 |
*** mkalcok has joined #opendev | 11:18 | |
*** ysandep|ruck|afk is now known as ysandeep|ruck | 11:25 | |
yoctozepto | frickler: yeah, it's 2020 so it's obligatory TLS nowadays | 11:45 |
ysandeep|ruck | #opendev hello guys o/ , Intermittently some jobs are failing with retry_limit after mirror issues. | 11:45 |
ysandeep|ruck | Is this the right channel to this issue? | 11:45 |
ysandeep|ruck | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_7d5/756492/1/gate/tripleo-ci-centos-8-content-provider/7d526c8/job-output.txt | 11:45 |
ysandeep|ruck | ~~~ | 11:45 |
ysandeep|ruck | 2020-10-23 07:36:26.814749 | primary | Errors during downloading metadata for repository 'AppStream': | 11:45 |
ysandeep|ruck | 2020-10-23 07:36:26.814847 | primary | - Status code: 403 for https://mirror.regionone.limestone.opendev.org/centos/8/AppStream/x86_64/os/repodata/repomd.xml (IP: 2607:ff68:100:54:f816:3eff:feb5:4635) | 11:46 |
ysandeep|ruck | 2020-10-23 07:36:26.814939 | primary | Error: Failed to download metadata for repo 'AppStream': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried | 11:46 |
ysandeep|ruck | ~~~ | 11:46 |
ysandeep|ruck | Is this the right channel to report* this issue? | 11:46 |
yoctozepto | ysandeep|ruck: the problem is known, yes | 11:46 |
ysandeep|ruck | yoctozepto, good to know its already known issue, many thanks! , do we have any bug or patch for this issue? | 11:47 |
yoctozepto | ysandeep|ruck: waiting for infra-root for that | 11:48 |
ysandeep|ruck | yoctozepto, okay, thanks! | 11:48 |
yoctozepto | ysandeep|ruck: the mirror will be fixed or disabled | 11:48 |
yoctozepto | yoctozepto: you are welcome | 11:49 |
*** sboyron has joined #opendev | 11:51 | |
AJaeger | ysandeep|ruckyoctozepto, as discussed in #openstack-infra, the mirror has been rebooted. If you encounter problems with new jobs (starting now or later), please report again. | 11:55 |
ysandeep|ruck | AJaeger, awesome thanks! | 11:56 |
AJaeger | ysandeep|ruck: fungi did all the work ;) | 11:59 |
ysandeep|ruck | :) | 12:00 |
fungi | yep, sorry, was just waking up and checked #openstack-infra before here | 12:04 |
fungi | the console showed hung cpu tasks, i recorded a copy to ~fungi/limestone-mirror.console on bridge.o.o | 12:05 |
fungi | http://paste.openstack.org/show/799315 | 12:08 |
fungi | there you go | 12:08 |
fungi | logan-: ^ anything unusual going on in the limestone cloud around 09:00 utc yesterday? | 12:09 |
fungi | aha, more like 08:00 | 12:11 |
fungi | we have them in syslog in this case, it seems to have been able to log to disk just couldn't communicate over the network | 12:12 |
fungi | the first stall was logged at Oct 22 08:01:28 | 12:13 |
*** kleini has left #opendev | 12:38 | |
*** qchris has quit IRC | 12:49 | |
*** qchris has joined #opendev | 12:56 | |
*** fressi has quit IRC | 13:11 | |
*** DSpider has joined #opendev | 13:22 | |
*** eolivare_ has joined #opendev | 13:27 | |
*** diablo_rojo has quit IRC | 13:28 | |
*** eolivare has quit IRC | 13:28 | |
*** priteau has quit IRC | 13:28 | |
openstackgerrit | zbr proposed zuul/zuul-jobs master: Allow test-setup to perform a connection reset https://review.opendev.org/759424 | 13:33 |
*** manpreet has joined #opendev | 13:34 | |
*** d34dh0r53 has joined #opendev | 14:00 | |
*** rpittau is now known as rpittau|afk | 14:06 | |
*** ysandeep|ruck is now known as ysandeep|away | 14:07 | |
*** ricolin has joined #opendev | 14:14 | |
openstackgerrit | zbr proposed zuul/zuul-jobs master: Add test_setup_reset_connection setting https://review.opendev.org/653130 | 14:15 |
openstackgerrit | zbr proposed zuul/zuul-jobs master: Add test_setup_reset_connection setting https://review.opendev.org/653130 | 14:19 |
*** sboyron has quit IRC | 14:22 | |
kevinz | cgoncalve,ianw: our colo facilities are being maintained, will recover soon | 14:22 |
openstackgerrit | zbr proposed zuul/zuul-jobs master: Add test_setup_reset_connection setting https://review.opendev.org/653130 | 14:26 |
*** sboyron has joined #opendev | 14:37 | |
*** sboyron has quit IRC | 14:41 | |
clarkb | kevinz: thank you for the update | 14:49 |
openstackgerrit | Jeremy Stanley proposed openstack/project-config master: Use StoryBoard for sandbox repos https://review.opendev.org/759450 | 15:04 |
kevinz | clarkb: np | 15:04 |
*** adsy has joined #opendev | 15:10 | |
openstackgerrit | zbr proposed zuul/zuul-jobs master: Add test_setup_reset_connection setting https://review.opendev.org/653130 | 15:15 |
*** ralonsoh has quit IRC | 15:20 | |
*** ralonsoh has joined #opendev | 15:20 | |
*** Tengu has quit IRC | 15:23 | |
*** mkalcok has quit IRC | 15:25 | |
*** Tengu has joined #opendev | 15:25 | |
*** DjeufackZane has joined #opendev | 15:44 | |
*** dmellado has quit IRC | 15:46 | |
*** dmellado has joined #opendev | 15:47 | |
dmsimard | btw seeing what looks like timeouts when trying to submit logstash/subunit jobs http://paste.openstack.org/show/799329/ | 15:53 |
clarkb | dmsimard: we've had persistent issues with very large log files clogging up the works. Which causes gearman to backup and eventually fall over | 15:54 |
clarkb | melwitt is looking at having the tools automatically discard large log files so that it will be more reliable | 15:54 |
dmsimard | works for me, wanted to point it out in case it wasn't a known issue | 15:55 |
clarkb | thanks for checking | 15:56 |
*** adsy has quit IRC | 16:01 | |
melwitt | clarkb: I'm working on streaming the data instead of loading entire large file into memory as a first step. and then see how it does. if you think that won't be enough, I can stack another change on top to not send too large files for indexing (I don't yet know which part of this code initiates indexing tho) | 16:05 |
clarkb | melwitt: oh no I think thats great too | 16:06 |
clarkb | basically do our best to index the large logs and if it still fails figure it out from there | 16:07 |
melwitt | ++ | 16:07 |
clarkb | fungi: I'm trying to remember what the rough plan for jvbs was. I think we said we'd add one more for a total of two jvb hosts? | 16:11 |
clarkb | which would be 60% of previous ptg capacity (and it seemed we had plenty last time?) | 16:11 |
fungi | right, and we already run a jvb on the primary too yeah? | 16:12 |
fungi | so we'll end up with three jvb processes in total | 16:12 |
clarkb | yup so last time we had primary + 4 jvbs which is a total of 5 and this time adding one more would be total of 3 | 16:12 |
fungi | that matches my recollection of the discussion from the meeting a couple weeks ago | 16:12 |
clarkb | shoudl I start booting a jvb02 then? or does someone else want to give it a go? (I'm happy to do it but offering in case others are interested in seeing how meetpad is put together) | 16:13 |
openstackgerrit | zbr proposed zuul/zuul-jobs master: Add test_setup_reset_connection setting https://review.opendev.org/653130 | 16:28 |
*** eolivare_ has quit IRC | 16:29 | |
kevinz | clark, fungi: Linaro US nodepool recovered | 16:33 |
kevinz | please help to check if it works | 16:33 |
fungi | thanks kevinz!!! | 16:33 |
clarkb | nb03.opendev.org is up and running an image build | 16:33 |
kevinz | OK, np | 16:34 |
kevinz | Sorry for inconvenience | 16:34 |
clarkb | the other thing to check for is if jobs can run on that cloud again | 16:34 |
fungi | seems i can browse http://mirror.regionone.linaro-us.opendev.org/ | 16:35 |
clarkb | oh ya the mirror that too :) | 16:35 |
*** ralonsoh has quit IRC | 16:36 | |
clarkb | ok /me doesn't see anyone demanding to boot jvb02 :) I'll do that shortly | 16:38 |
*** marios is now known as marios|out | 16:43 | |
*** hillpd_ has joined #opendev | 16:50 | |
*** DjeufackZane has quit IRC | 16:51 | |
*** ianw has quit IRC | 16:51 | |
*** persia_ has joined #opendev | 16:51 | |
*** mordred has quit IRC | 16:57 | |
*** auristor has quit IRC | 16:57 | |
*** hillpd has quit IRC | 16:57 | |
*** persia has quit IRC | 16:57 | |
*** ajya has quit IRC | 16:57 | |
*** hillpd_ is now known as hillpd | 16:57 | |
clarkb | jvb02 server is booting now | 16:58 |
fungi | yep, sorry, as if one security problem wasn't enough, the rest of my afternoon is being spent trying to catch up on openstack vmt stuff i put off all week | 16:58 |
clarkb | no worries, I had intended on doing it was just checking no one else wanted to give it a go first | 16:59 |
clarkb | the scale up should be basically automagic at this point though since xmpp is used to coordinate | 16:59 |
*** mordred has joined #opendev | 17:04 | |
*** andrewbonney has quit IRC | 17:06 | |
*** marios|out has quit IRC | 17:06 | |
*** mlavalle has joined #opendev | 17:07 | |
*** hamalq has joined #opendev | 17:17 | |
*** hamalq_ has joined #opendev | 17:20 | |
*** hamalq has quit IRC | 17:23 | |
*** ianw has joined #opendev | 17:23 | |
openstackgerrit | melanie witt proposed opendev/puppet-log_processor master: Stream log files instead of loading full files into memory https://review.opendev.org/759492 | 17:31 |
openstackgerrit | Clark Boylan proposed opendev/system-config master: Add jvb02 prior to the PTG https://review.opendev.org/759494 | 17:33 |
clarkb | I'm sorting out sshfp records then will push up the dns update too | 17:35 |
melwitt | clarkb: ^ first intelligible pass at streaming log files. note that I did not fully test it in that I hacked main to create a LogRetriever and call _open_log_file_url and loop to _retrieve_log_line manually. I'm not sure how completely zuul will test it. if you think there's a better test I should do, lmk | 17:39 |
*** auristor has joined #opendev | 17:41 | |
clarkb | melwitt: I'm not sure zuul will test it, but what we can do is take one of the worker nodes out of config management and test it that way. Its not like things are functional in that system right now anyway | 17:41 |
clarkb | (we do have some logstash worker tests but not sure we test the file retrieval there) | 17:41 |
melwitt | cool, I wondered if we could do that. and I hope I don't have some dumb bug in the _handle_event method -_- | 17:42 |
melwitt | if I do, I apologize in advance | 17:42 |
fungi | well, there are 20 workers, so if one is buggy it's not the end of the world | 17:42 |
fungi | 20 worker servers i mean... with... 4? worker processes each | 17:42 |
openstackgerrit | Clark Boylan proposed opendev/zone-opendev.org master: Add jvb02 https://review.opendev.org/759497 | 17:43 |
clarkb | fungi: ya 4x20 | 17:43 |
clarkb | we've leaked ansible playbook processes again due to servers being unreachable and jobs timing out on bridge | 17:51 |
clarkb | I've rebooted the sad server (logstash worker04) and am cleaning up processes now | 17:51 |
clarkb | does anyone know if we can have a zuul timeout result in less leaking in our cd jobs? | 17:51 |
clarkb | and done | 17:58 |
*** roman_g has quit IRC | 17:59 | |
clarkb | infra-root https://review.opendev.org/759494 and https://review.opendev.org/759497 are two meetpad scale up changes to prep for next weeks PTG | 17:59 |
clarkb | reviews welcome | 17:59 |
melwitt | my change failed the legacy linter but I'm not sure whether it's related. it failed during some package installs and I don't see the words "puppet-log_processor" in it https://zuul.opendev.org/t/openstack/build/bf31e6704f494a9ea38736f69c7abbf1/log/job-output.txt#1226 | 18:09 |
clarkb | melwitt: its a puppet issue. I'll put a fix under your change | 18:10 |
melwitt | oh ok, thanks | 18:11 |
openstackgerrit | Clark Boylan proposed opendev/puppet-log_processor master: Stream log files instead of loading full files into memory https://review.opendev.org/759492 | 18:13 |
openstackgerrit | Clark Boylan proposed opendev/puppet-log_processor master: Fix puppet linter complaints about :: prefixes https://review.opendev.org/759503 | 18:13 |
clarkb | melwitt: if you're curious old puppet required the :: prefix to root the namespace scope. Newer puppet made it optional then at some point they decided that even though the old version is still correct it shouldn't be used :/ | 18:14 |
* clarkb finds lunch | 18:15 | |
melwitt | clarkb: a-ha, now the log file makes sense to me. thanks! | 18:17 |
fungi | pip 20.2.4 was just released, 20.3 will turn on the dep solver probably next week | 18:37 |
fungi | they're saying wednesday or thursday is likely for that | 18:37 |
fungi | now the beaker-rspec job doesn't like 759492 | 18:42 |
fungi | Gem::RemoteFetcher::UnknownHostError: timed out | 18:50 |
fungi | (https://rubygems.org/gems/unf-0.1.4.gem) | 18:51 |
fungi | looks like a connectivity problem, or maybe rubygems.org is having trouble | 18:51 |
fungi | i'll recheck it | 18:51 |
clarkb | fungi: thanks | 19:00 |
openstackgerrit | Merged opendev/puppet-log_processor master: Fix puppet linter complaints about :: prefixes https://review.opendev.org/759503 | 19:22 |
clarkb | fungi: I'm thinking we may not get a second reviewer for the jvb stuff today. Should we go ahead and approve it now or ask ianw to review during australia monday morning? | 19:24 |
fungi | clarkb: i figured i'd approve those in a little while if another infra-root doesn't happen along | 19:24 |
clarkb | thanks | 19:25 |
fungi | working on some stir fry now but will circle back around to those once i'm done | 19:28 |
clarkb | now I want stir fry | 19:33 |
fungi | it's deep-fry/stir-fry... i'm practicing my skills at doing mongolian beef | 19:35 |
clarkb | I had some leftover curry for lunch which was good | 19:37 |
*** cloudnull has quit IRC | 19:47 | |
*** cloudnull has joined #opendev | 19:47 | |
*** cloudnull has quit IRC | 19:49 | |
*** cloudnull has joined #opendev | 19:58 | |
*** cloudnull has quit IRC | 20:04 | |
*** cloudnull has joined #opendev | 20:05 | |
mordred | now I want stir-fry too | 20:07 |
corvus | fungi: hope you can keep up with all the orders! | 20:11 |
fungi | i actually can't | 20:21 |
fungi | dredging all the wafer-thin slices of steak is something i need to get faster at | 20:21 |
*** roman_g has joined #opendev | 20:24 | |
*** bhagyashris has joined #opendev | 20:47 | |
*** ianw has quit IRC | 20:50 | |
*** prometheanfire has quit IRC | 20:50 | |
*** bhagyashris|sick has quit IRC | 20:50 | |
*** SotK has quit IRC | 20:50 | |
*** ianw has joined #opendev | 20:50 | |
*** prometheanfire has joined #opendev | 20:50 | |
*** SotK has joined #opendev | 20:50 | |
*** roman_g has quit IRC | 20:50 | |
openstackgerrit | Merged opendev/zone-opendev.org master: Add jvb02 https://review.opendev.org/759497 | 20:57 |
clarkb | fungi looks like https://review.opendev.org/759494 failed on tox linters due toa timeout | 21:32 |
clarkb | should we reenqueue to the gate or just recheck? | 21:33 |
clarkb | (lookingat the timed out job it seems to have just been slow) | 21:33 |
* clarkb enqueues because running out of day | 21:33 | |
fungi | yeah, sorry, please do | 21:35 |
fungi | got sidetracked prepping pizza dough for tomorrow | 21:35 |
*** mlavalle has quit IRC | 21:48 | |
prometheanfire | are we still being scraped? | 21:54 |
* prometheanfire can't connect to gerrit via gertty | 21:54 | |
clarkb | did you set a new api token? | 21:55 |
prometheanfire | oh, that needed? ok | 21:56 |
prometheanfire | I need a new http-password set? | 21:57 |
clarkb | yes, we unset all of them | 21:57 |
prometheanfire | ah, kk done | 21:57 |
fungi | yeah, gerrit 2.13 still keeps them in plaintext in the db | 22:04 |
fungi | what we're upgrading to will put kdf (bcrypt) hashes in there instead | 22:04 |
fungi | downside is that gerrit will no longer be able to show you the key once set, other than ephemerally when it's generated | 22:05 |
fungi | so if you forget it you can't look it up, you'll just have to regenerate it | 22:05 |
fungi | ultimately much safer though | 22:06 |
prometheanfire | ya, I prefer that anyway :P | 22:06 |
fungi | so do we | 22:06 |
clarkb | I think that tox linters job may fail again | 22:08 |
clarkb | it takes 10 minutes just to run tox without any tests? that installs deps? | 22:08 |
clarkb | why is that so slow | 22:08 |
fungi | the times i watched, it looked like it was taking forever on ansible-lint | 22:10 |
clarkb | ya its slow there too | 22:10 |
clarkb | fungi: do you think we should just increase the timeout? I'm not sure how much slowness dbeugging I want to do right now | 22:17 |
clarkb | https://zuul.opendev.org/t/openstack/build/57e1cc82878b47aeaf632a6f355c2f80/log/tox/linters-1.log unfortunately doesn't have timing info for the pip install steps | 22:20 |
fungi | mmm, maybe | 22:25 |
openstackgerrit | Clark Boylan proposed opendev/system-config master: Add jvb02 prior to the PTG https://review.opendev.org/759494 | 22:28 |
clarkb | that bumps the tox-linters timeout | 22:28 |
fungi | maybe sometime soon we can figure out how to speed that up | 22:29 |
clarkb | supposedly not using find makes it go faster because then you don't have python startup overhead over and over | 22:30 |
clarkb | but in the past it hasn't found all the files when we did that so may need double checking | 22:30 |
fungi | i have a feeling this is part of the problem: https://opendev.org/opendev/system-config/src/branch/master/tox.ini#L33 | 22:30 |
fungi | yeah, what you just said | 22:31 |
fungi | we basically incur the startup overhead 300x | 22:31 |
fungi | and that multiplier is only going to continue to increase as we port more systems from puppet to ansible | 22:32 |
*** slaweq has quit IRC | 22:33 | |
fungi | https://review.opendev.org/712554 switched us back to using find in march, suggesting "ansible-lints ability to find ansible files is less than good" | 22:34 |
clarkb | ya we tried swithicng and it dind't work at all iirc | 22:34 |
clarkb | so we reverted | 22:34 |
*** qchris has quit IRC | 22:41 | |
*** qchris has joined #opendev | 22:55 | |
*** sean-k-mooney has quit IRC | 23:20 | |
*** sean-k-mooney has joined #opendev | 23:21 | |
*** whoami-rajat__ has quit IRC | 23:36 | |
openstackgerrit | Merged opendev/system-config master: Add jvb02 prior to the PTG https://review.opendev.org/759494 | 23:36 |
fungi | clarkb: ^ | 23:37 |
*** owalsh_ has joined #opendev | 23:40 | |
*** hamalq_ has quit IRC | 23:43 | |
*** owalsh has quit IRC | 23:43 | |
*** owalsh has joined #opendev | 23:45 | |
*** tosky has quit IRC | 23:46 | |
clarkb | checking ti see if ansible ran happily | 23:47 |
clarkb | oh it hasn't run yet because it updated inventory os runs all the jobs | 23:48 |
clarkb | I'll check on it a bit later then | 23:48 |
*** owalsh_ has quit IRC | 23:48 | |
fungi | yeah | 23:49 |
fungi | but at least it merged after upping the linters timeout | 23:49 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!