*** jamesmcarthur has quit IRC | 00:01 | |
*** jamesmcarthur has joined #zuul | 00:03 | |
*** sshnaidm|ruck is now known as sshnaidm|afk | 00:08 | |
*** tosky has quit IRC | 00:09 | |
*** jamesmcarthur has quit IRC | 00:15 | |
*** jamesmcarthur has joined #zuul | 00:15 | |
*** jamesmcarthur has quit IRC | 00:22 | |
*** jamesmcarthur has joined #zuul | 00:22 | |
*** jamesmcarthur has quit IRC | 00:27 | |
*** jamesmcarthur has joined #zuul | 00:28 | |
*** jamesmcarthur has quit IRC | 00:30 | |
*** jamesmcarthur has joined #zuul | 00:37 | |
*** jamesmcarthur has quit IRC | 00:38 | |
*** jamesmcarthur has joined #zuul | 00:38 | |
*** jamesmcarthur has quit IRC | 00:38 | |
*** jamesmcarthur has joined #zuul | 01:22 | |
*** jamesmcarthur has quit IRC | 01:23 | |
*** jamesmcarthur has joined #zuul | 01:23 | |
*** jamesmcarthur has quit IRC | 01:34 | |
*** jamesmcarthur has joined #zuul | 01:35 | |
*** hamalq has quit IRC | 02:24 | |
*** jamesmcarthur has quit IRC | 02:28 | |
*** jamesmcarthur has joined #zuul | 02:30 | |
*** jamesmcarthur has quit IRC | 02:35 | |
*** tflink_ is now known as tflink | 02:40 | |
*** jamesmcarthur has joined #zuul | 02:58 | |
*** ianw is now known as ianw_pto | 03:12 | |
*** bhavikdbavishi has joined #zuul | 03:22 | |
*** bhavikdbavishi1 has joined #zuul | 03:25 | |
*** bhavikdbavishi has quit IRC | 03:26 | |
*** bhavikdbavishi1 is now known as bhavikdbavishi | 03:26 | |
*** bhavikdbavishi has quit IRC | 03:38 | |
*** zenkuro has quit IRC | 03:40 | |
*** bhavikdbavishi has joined #zuul | 03:40 | |
*** bhavikdbavishi1 has joined #zuul | 03:43 | |
*** bhavikdbavishi has quit IRC | 03:45 | |
*** bhavikdbavishi1 is now known as bhavikdbavishi | 03:45 | |
*** bhavikdbavishi has quit IRC | 03:48 | |
*** bhavikdbavishi has joined #zuul | 04:00 | |
*** bhavikdbavishi1 has joined #zuul | 04:03 | |
*** jamesmcarthur has quit IRC | 04:03 | |
*** jamesmcarthur has joined #zuul | 04:03 | |
*** bhavikdbavishi has quit IRC | 04:04 | |
*** bhavikdbavishi1 is now known as bhavikdbavishi | 04:04 | |
*** bhavikdbavishi has quit IRC | 04:41 | |
*** vishalmanchanda has joined #zuul | 04:47 | |
*** ykarel has joined #zuul | 04:59 | |
*** evrardjp has quit IRC | 05:33 | |
*** evrardjp has joined #zuul | 05:33 | |
*** jamesmcarthur has quit IRC | 05:51 | |
*** jamesmcarthur has joined #zuul | 05:52 | |
*** jfoufas1 has joined #zuul | 05:53 | |
*** jamesmcarthur has quit IRC | 05:57 | |
*** jamesmcarthur has joined #zuul | 06:01 | |
*** jamesmcarthur has quit IRC | 06:01 | |
*** rpittau|afk is now known as rpittau | 07:34 | |
*** jcapitao has joined #zuul | 07:37 | |
*** hashar has joined #zuul | 07:41 | |
*** jamesmcarthur has joined #zuul | 08:02 | |
*** harrymichal has joined #zuul | 08:06 | |
*** jamesmcarthur has quit IRC | 08:06 | |
*** mgoddard has quit IRC | 08:11 | |
*** mgoddard has joined #zuul | 08:11 | |
openstackgerrit | Merged zuul/zuul-jobs master: Rename config repos file config for CentOS Stream https://review.opendev.org/c/zuul/zuul-jobs/+/770815 | 08:15 |
---|---|---|
*** tosky has joined #zuul | 08:44 | |
*** nils has joined #zuul | 08:50 | |
*** jpena|off is now known as jpena | 08:57 | |
*** jamesmcarthur has joined #zuul | 09:13 | |
*** dcastellani has quit IRC | 09:14 | |
*** iamweswilson has quit IRC | 09:14 | |
*** PrinzElvis has quit IRC | 09:14 | |
*** dcastellani has joined #zuul | 09:15 | |
*** iamweswilson has joined #zuul | 09:15 | |
*** PrinzElvis has joined #zuul | 09:15 | |
*** masterpe has quit IRC | 09:17 | |
*** jamesmcarthur has quit IRC | 09:20 | |
*** jamesmcarthur has joined #zuul | 09:21 | |
*** mordred has quit IRC | 09:21 | |
*** Eighth_Doctor has quit IRC | 09:21 | |
*** jamesmcarthur has quit IRC | 09:26 | |
tobiash | corvus: re nodepool optimization: looking at the sdk code nodepool is already using the correct method within the sdk and I think I can increase the cache duration directly via clouds.yaml if needed | 09:30 |
tobiash | corvus: however I've seen that also our providers that basically do nothing have a constant cpu usage of >50% so I'll switch the target and see if there is any improvement there | 09:34 |
*** Eighth_Doctor has joined #zuul | 10:08 | |
*** bhavikdbavishi has joined #zuul | 10:27 | |
*** mordred has joined #zuul | 10:29 | |
*** masterpe has joined #zuul | 10:29 | |
*** systemc is now known as systemb | 10:44 | |
*** hashar is now known as hasharAway | 10:44 | |
*** bhavikdbavishi has quit IRC | 10:48 | |
openstackgerrit | Tobias Henkel proposed zuul/nodepool master: Use libyaml parsing when available https://review.opendev.org/c/zuul/nodepool/+/771961 | 10:53 |
*** bhavikdbavishi has joined #zuul | 10:55 | |
openstackgerrit | Matthieu Huin proposed zuul/zuul master: zuul-client: test "show running-jobs" command https://review.opendev.org/c/zuul/zuul/+/771962 | 11:07 |
*** ykarel_ has joined #zuul | 11:08 | |
*** ykarel has quit IRC | 11:08 | |
*** bhavikdbavishi1 has joined #zuul | 11:12 | |
*** bhavikdbavishi has quit IRC | 11:13 | |
*** bhavikdbavishi1 is now known as bhavikdbavishi | 11:13 | |
*** harrymichal has quit IRC | 11:15 | |
*** ykarel__ has joined #zuul | 11:16 | |
*** harrymichal has joined #zuul | 11:16 | |
*** ykarel_ has quit IRC | 11:19 | |
*** jcapitao is now known as jcapitao_lunch | 11:23 | |
*** mgoddard has quit IRC | 11:30 | |
*** msuszko has quit IRC | 11:50 | |
*** msuszko has joined #zuul | 11:51 | |
*** zenkuro has joined #zuul | 11:54 | |
*** dry has joined #zuul | 12:19 | |
*** msuszko has quit IRC | 12:20 | |
*** rlandy has joined #zuul | 12:25 | |
openstackgerrit | Tobias Henkel proposed zuul/nodepool master: Handle ports exceeded error as quota error https://review.opendev.org/c/zuul/nodepool/+/771968 | 12:25 |
*** iurygregory_ has joined #zuul | 12:28 | |
*** iurygregory has quit IRC | 12:28 | |
*** iurygregory_ is now known as iurygregory | 12:29 | |
*** jpena is now known as jpena|lunch | 12:35 | |
*** bhavikdbavishi has quit IRC | 12:40 | |
*** bhavikdbavishi has joined #zuul | 12:42 | |
*** bhavikdbavishi has quit IRC | 12:47 | |
*** hasharAway is now known as hashar | 12:52 | |
*** AJaeger has joined #zuul | 12:54 | |
*** jcapitao_lunch is now known as jcapitao | 13:01 | |
*** bhavikdbavishi has joined #zuul | 13:28 | |
*** mgoddard has joined #zuul | 13:32 | |
*** jpena|lunch is now known as jpena | 13:34 | |
*** ykarel__ is now known as ykarel | 13:44 | |
*** AJaeger has quit IRC | 13:53 | |
openstackgerrit | Javier Peña proposed zuul/zuul-jobs master: Fix BaseOS repo file name for CentOS Stream https://review.opendev.org/c/zuul/zuul-jobs/+/771980 | 13:54 |
*** bhavikdbavishi has quit IRC | 14:00 | |
*** slaweq has joined #zuul | 14:03 | |
slaweq | hi zuul cores | 14:03 |
slaweq | I have a question about patch https://review.opendev.org/c/zuul/zuul-jobs/+/762650 to zuul-jobs | 14:03 |
slaweq | I neutron ovn jobs, where ovn and ovs is installed from source by devstack plugin we need to "restore" br-infra connectity between nodes | 14:04 |
slaweq | so I proposed that patch which creates simply script which will do exactly the same thing as ansible role is doing to configure connectivity through this br-infra bridge | 14:05 |
slaweq | but I recently had some feedback that it's now 2 places which are doing the same and can be quickly "not in sync" | 14:06 |
slaweq | so wdyt if I would change that zuul role so it would create script and call it then? I know it's not perfect ansible way solution but that was suggestion already | 14:06 |
mordred | slaweq: I was actually thinking that when you did your original patch - but probably an idea that should get more than one opinion on :) | 14:26 |
slaweq | mordred: Your opinion isn't the only one already :) | 14:27 |
mordred | \o. | 14:27 |
mordred | \o/ | 14:27 |
* mordred can't type | 14:27 | |
slaweq | :) | 14:27 |
slaweq | so if there's more than one voices to do it that way, I will update my patch :) | 14:28 |
slaweq | thx a lot | 14:28 |
*** jamesmcarthur has joined #zuul | 14:48 | |
openstackgerrit | Matthieu Huin proposed zuul/zuul master: zuul-client: test "show running-jobs" command https://review.opendev.org/c/zuul/zuul/+/771962 | 14:57 |
*** rpittau is now known as rpittau|afk | 14:58 | |
*** mugsie has joined #zuul | 15:09 | |
*** GomathiselviS has joined #zuul | 15:14 | |
*** vishalmanchanda has quit IRC | 15:15 | |
*** mugsie has quit IRC | 15:18 | |
*** maxamillion has joined #zuul | 15:21 | |
*** zbr3 has joined #zuul | 15:22 | |
*** zbr has quit IRC | 15:24 | |
*** zbr3 is now known as zbr | 15:24 | |
*** mugsie has joined #zuul | 15:51 | |
openstackgerrit | Matthieu Huin proposed zuul/zuul master: REST API: add api/tenant/{tenant}/jobs/running endpoint https://review.opendev.org/c/zuul/zuul/+/771648 | 16:02 |
openstackgerrit | Matthieu Huin proposed zuul/zuul master: zuul-client: test "show running-jobs" command https://review.opendev.org/c/zuul/zuul/+/771962 | 16:03 |
openstackgerrit | Javier Peña proposed zuul/zuul-jobs master: Fix repo files for CentOS Stream https://review.opendev.org/c/zuul/zuul-jobs/+/771980 | 16:22 |
openstackgerrit | Matthieu Huin proposed zuul/zuul-client master: Add show running-jobs subcommand https://review.opendev.org/c/zuul/zuul-client/+/771853 | 16:29 |
mhu | hello zuul-maint, thse two bug fixes just need the final +3: https://review.opendev.org/c/zuul/zuul/+/768312 and https://review.opendev.org/c/zuul/zuul/+/768229 | 16:33 |
*** armstrongs has joined #zuul | 16:40 | |
*** jfoufas1 has quit IRC | 16:40 | |
armstrongs | hey, I have enabled zookeeper encryption and have 3 vm nodes now and they are all accessible on http with the services running. However, the zuul dashboard now appears as a blank page on the load balancer i have in front of zuul. When i inspect the page it says Uncaught SyntaxError: Unexpected token '<' 2.1f35f3c2.chunk.js:1 | 16:43 |
armstrongs | so it looks like the static pages on each node maybe can't be accessed now zookeeper encryption is on? any help would be appreciated | 16:44 |
corvus | armstrongs: zk encryption shouldn't affect that (the web servers don't do anything with zk yet (but they will in the future). that sounds like a js error, so is likely completely in the domain of zuul-web or the load balancer | 16:45 |
*** ykarel has quit IRC | 16:47 | |
openstackgerrit | Javier Peña proposed zuul/zuul-jobs master: Fix repo files for CentOS Stream https://review.opendev.org/c/zuul/zuul-jobs/+/771980 | 16:47 |
armstrongs | corvus the weird thing is every web node individually is fine and i can access on http | 16:48 |
corvus | armstrongs: so maybe something getting munged by the load balancer? | 16:48 |
armstrongs | the dashboard loads ok on the servers. Its been running in production for 2 years now with no load balancer changes and the only difference is the zookeeper change thats why i reached out. its very odd. Have tried a couple of different load balancers as well. | 16:50 |
corvus | maybe just the upgrade or restart for the zk change triggered the behavior? | 16:51 |
armstrongs | we are pinned to a ref so code hasn't changed | 16:51 |
armstrongs | its when we have went from 2 to 3 nodes same config | 16:52 |
armstrongs | as we needed extra executors as we have added more jobs | 16:53 |
corvus | armstrongs: i don't have any suggestions other than to continue to dig into web side of things. maybe look at the content returned for various requests (maybe an error page is being returned instead of an actual js file). sorry i don't have more specific ideas. | 16:56 |
corvus | but at least, from where i sit now, i don't see how any zk related changes could have immediately caused this | 16:56 |
armstrongs | http://paste.openstack.org/show/801890/ thats my config incase anything glaring | 16:56 |
corvus | your web server is colocated on one of your zk servers? | 16:58 |
armstrongs | yeah have all services running on each node. 1 scheduler enabled on 1 box | 16:59 |
armstrongs | follows exactly zuul from scratch | 16:59 |
armstrongs | but automated | 16:59 |
corvus | armstrongs: are you running more than one zuul-web instance? | 17:01 |
corvus | and load balancing to all of them? | 17:01 |
*** reiterative has quit IRC | 17:01 | |
*** reiterative has joined #zuul | 17:02 | |
armstrongs | yes running 3 | 17:03 |
armstrongs | 1 web service on each of the 3 boxes | 17:03 |
armstrongs | with a config for web pointing at local ip | 17:03 |
armstrongs | so have 3 boxes behind the load balancer | 17:03 |
armstrongs | pointing to port 9000 on the ip | 17:03 |
armstrongs | serving on the https ssl cert for root | 17:03 |
*** harrymichal has quit IRC | 17:04 | |
armstrongs | yeah | 17:04 |
corvus | so line 28 is different for each of those boxes? | 17:05 |
armstrongs | yeah that matches the ip of each box | 17:06 |
armstrongs | and all of the dashboards work if i hit them on http not using the load balancer | 17:06 |
armstrongs | i just get a blank page and javascript issue when accessing them via the load balancer and i tried a couple | 17:07 |
corvus | armstrongs: the ks error said unexpected token in 2.1f35f3c2.chunk.js -- what happens if you look at the network tab in the browser tools and see the content for 2.1f35f3c2.chunk.js ? | 17:08 |
corvus | s/ks error/js error/ | 17:08 |
armstrongs | will check 2secs | 17:09 |
armstrongs | DevTools failed to load SourceMap: Could not parse content for https://zuul.paas.je-labs.com/static/js/2.f003d247.chunk.js.map: Unexpected token < in JSON at position 0 | 17:12 |
corvus | i don't know what a "js.map" file is; that doesn't show up in opendev's production site | 17:15 |
*** GomathiselviS has quit IRC | 17:15 | |
corvus | armstrongs: can you see the actual payload for that file? | 17:16 |
armstrongs | http://paste.openstack.org/show/801891/ | 17:17 |
*** jamesmcarthur has quit IRC | 17:17 | |
*** jamesmcarthur has joined #zuul | 17:18 | |
corvus | armstrongs: that looks like a different url, and it just looks like the headers, not the actual body. but i still see something interesting there: "Status Code: 200 (from disk cache)" which suggests something in your web setup has a cache. maybe that needs to be cleared? it may not be interacting well with the cach-busting urls generated by webpack? (that's what the '2.1f35f3c2' stuff is about) | 17:20 |
armstrongs | so the web setup is just following the zuul from scratch guide is there anything there that would be caching | 17:22 |
*** jamesmcarthur has quit IRC | 17:23 | |
corvus | armstrongs: no. i'd suggest looking closely at your load balancer. | 17:24 |
armstrongs | ok thanks for the help will have a look | 17:24 |
*** hashar has quit IRC | 17:25 | |
armstrongs | im using an alb with standard settings for reference | 17:26 |
armstrongs | if there is any gotchas there when you have more web nodes | 17:26 |
*** jamesmcarthur has joined #zuul | 17:29 | |
mordred | fwiw - js.map is a thing that webpack can produce to allow for in-browser debugging of minified code | 17:29 |
armstrongs | quick different question based on my config file that i provided corvus what would i require just to run additional executor services on their own in terms of zuul.conf? | 17:29 |
armstrongs | mordred thanks for the info | 17:30 |
*** harrymichal has joined #zuul | 17:33 | |
*** jamesmcarthur has quit IRC | 17:34 | |
corvus | armstrongs: the following sections: gearman, statsd, zookeeper, executor, connection* | 17:38 |
*** GomathiselviS has joined #zuul | 17:46 | |
armstrongs | thanks | 17:50 |
*** jamesmcarthur has joined #zuul | 17:50 | |
*** jpena is now known as jpena|off | 17:55 | |
*** jcapitao has quit IRC | 17:59 | |
*** harrymichal has quit IRC | 18:06 | |
*** jamesmcarthur has quit IRC | 18:10 | |
*** slaweq has quit IRC | 18:12 | |
*** ikhan has joined #zuul | 18:16 | |
*** jamesmcarthur has joined #zuul | 18:25 | |
openstackgerrit | Matthieu Huin proposed zuul/zuul master: zuul-client: test "show running-jobs" command https://review.opendev.org/c/zuul/zuul/+/771962 | 18:58 |
avass | corvus, armstrongs that can happen if the zuul-web services are different versions and you're requesting a file that exists in one version and not another | 19:16 |
avass | I think the main.js (?) has a slightly different name when react generates it | 19:18 |
avass | oh actually this: 2.1f35f3c2.chunk.js is different if you're running different versions | 19:18 |
*** nils has quit IRC | 19:25 | |
*** ikhan has quit IRC | 19:25 | |
*** jamesmcarthur has quit IRC | 19:28 | |
corvus | right, it does that for cache busting | 19:28 |
avass | which means requesting 2.1f35f3c2.chunk.js can give you a 404 most likely | 19:34 |
*** jamesmcarthur has joined #zuul | 19:43 | |
*** slaweq has joined #zuul | 19:46 | |
*** jamesmcarthur has quit IRC | 19:48 | |
openstackgerrit | Matthieu Huin proposed zuul/zuul master: zuul-client: test "show running-jobs" command https://review.opendev.org/c/zuul/zuul/+/771962 | 19:51 |
*** harrymichal has joined #zuul | 19:58 | |
*** jamesmcarthur has joined #zuul | 20:00 | |
*** slaweq has quit IRC | 20:01 | |
*** harrymichal has quit IRC | 20:01 | |
*** harrymichal has joined #zuul | 20:02 | |
openstackgerrit | Matthieu Huin proposed zuul/zuul master: zuul-client: test "show running-jobs" command https://review.opendev.org/c/zuul/zuul/+/771962 | 20:13 |
*** GomathiselviS has quit IRC | 20:22 | |
*** jamesmcarthur has quit IRC | 20:34 | |
*** jamesmcarthur has joined #zuul | 20:34 | |
*** jamesmcarthur has quit IRC | 20:48 | |
*** armstrongs has quit IRC | 21:01 | |
*** jamesmcarthur has joined #zuul | 21:15 | |
*** jamesmcarthur has quit IRC | 21:23 | |
*** jamesmcarthur has joined #zuul | 21:29 | |
*** rlandy has quit IRC | 21:40 | |
openstackgerrit | Artom Lifshitz proposed zuul/zuul-jobs master: WIP: Generate Zuul temp key in PEM format https://review.opendev.org/c/zuul/zuul-jobs/+/772122 | 21:52 |
*** jamesmcarthur has quit IRC | 22:16 | |
*** jamesmcarthur has joined #zuul | 22:17 | |
*** sduthil has quit IRC | 22:27 | |
*** akrpan-pure has joined #zuul | 22:39 | |
akrpan-pure | Guessing there isn't since it doesn't seem very "Traditional YAML"-y, but is there a way to refer to other variables in a job definition? e.g. to say that vars.val2 should have the value of vars.val1? | 22:40 |
akrpan-pure | Or I guess another way to ask it is "do ansible variable interpolations work in job variable definitions"? | 22:40 |
fungi | ansible doesn't have variable interpolations, you might be thinking of jinja2 substitution which ansible performs over its own yaml files, or you may be thinking of anchors/pointers in yaml which allow you to repeat the same data structure in additional locations within a single file | 22:45 |
fungi | er, i mean yaml doesn't have variable interpolations | 22:45 |
akrpan-pure | Yeah, I was thinking of jinja2. I'm guessing that won't work on job YAMLs? | 22:45 |
fungi | zuul job definitions aren't ansible playbooks | 22:45 |
fungi | so right, that won't work | 22:45 |
akrpan-pure | Heck | 22:46 |
akrpan-pure | Might have a workaround, doing more research | 22:46 |
fungi | the zuulish way to be DRY is to use inheritence | 22:46 |
fungi | if it's just a matter of avoiding lots of repeated patterns | 22:47 |
akrpan-pure | Basically, my two uses are 1. I need to generate a random name prefix for one variable, and 2. There's a few things I'd like to set in one place that have to go in multiple, or I'd at least like to give them more sane constants | 22:47 |
akrpan-pure | And this would definitely help job inheritance | 22:47 |
akrpan-pure | I'm gonna see if I can set them in a pre-run playbook | 22:47 |
fungi | yeah, generating a random value in a zuul job definition is something i can't think of an easy solution for. if possible punt that to a playbook/role/module | 22:48 |
akrpan-pure | Yeah, I had the same thing. I know how to do it in shell, just not in a job | 22:48 |
fungi | you could rely on fact caching between playbooks, yep | 22:48 |
akrpan-pure | I'm trying to set variables for the various devstack jobs is my end goal | 22:49 |
fungi | generate the value in a pre-run playbook, set it as a fact, then refer to that fact in run | 22:49 |
akrpan-pure | But I think since they're just variables, they get applied to the playbook before it's run? I need to find where they actually set them and generate the config file | 22:49 |
fungi | my ansible-fu is not strong, but you can probably assign the local variable in the playbook by referencing the fact you set in the earlier phase | 22:50 |
fungi | someone else in here almost certainly has a better grasp of how to go about that | 22:51 |
akrpan-pure | Well, time to make a mock playbook and see what happens | 22:53 |
fungi | yeah, you could likely mock it up locally just making sure fact caching is on, then running one playbook which sets a fact, followed by running another playbook which assigns that fact as a role variable value and then check the value in the role | 22:54 |
fungi | assuming i understand what it is you're trying to plumb | 22:54 |
fungi | akrpan-pure: these are what you're wanting to set mostly, right? https://docs.openstack.org/devstack/latest/zuul_roles.html#rolevar-write-devstack-local-conf.devstack_local_conf | 22:56 |
akrpan-pure | Oh! Actually, that's a good point, I forgot you could set vars in the playbook where you add the role, that actually nails exactly what I needed | 22:56 |
akrpan-pure | Yep, that looks like it | 22:56 |
corvus | also, just fyi ansible/jinja will often interpolate variables into other varibles, so you frequently can do var: "{{ othervar }}". zuul would pass that straight through to ansible. | 22:57 |
akrpan-pure | That's also super useful to know, thanks! | 22:58 |
fungi | useful, and yeah that's what i was thinking you could do with cached facts if you wanted to feed them into a rolevar | 22:58 |
fungi | but if you don't actually need to generate the values in a different phase, then all the easier | 22:59 |
akrpan-pure | Awesome, yeah, this should all simplify things. My goal was to have one "pure" dictionary variable that's the source of truth, and then all the other things are set based on those variables | 22:59 |
akrpan-pure | Which I think is in reach now | 22:59 |
*** ikhan has joined #zuul | 23:01 | |
fungi | i love it when a plan comes together | 23:02 |
*** paladox has quit IRC | 23:14 | |
*** paladox has joined #zuul | 23:17 | |
*** jamesmcarthur has quit IRC | 23:34 | |
*** paladox has quit IRC | 23:40 | |
*** paladox has joined #zuul | 23:55 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!