| clarkb | Shrews: corvus: somethign to think about, but when we retry boots in nodepool we reuse the same nodepool id. This makes it hard to figure out which of the retried boots leaked a neutron port for example since there could be up to three servers all with the same name | 00:20 |
|---|---|---|
| clarkb | maybe we can append an iteration value to the instance names? $nodepoolid-0 $nodepoolid-1 $nodepoolid-2 for example | 00:20 |
| clarkb | I want to say we can do this now without creating problems with subnodes since we changed how those work | 00:21 |
| clarkb | I'm getting by with timestamps for now so not sure it is urgent | 00:21 |
| *** harlowja has quit IRC | 01:09 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul-jobs master: Use readthedocs webhook to trigger build https://review.openstack.org/579434 | 01:49 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: Add ansible-lint job https://review.openstack.org/532083 | 02:13 |
| *** SpamapS has quit IRC | 02:15 | |
| ianw | can you set "vars:" for each of your entries in the templates: section? | 02:15 |
| openstackgerrit | Merged openstack-infra/zuul master: Remove redhat-rpm-config bindep https://review.openstack.org/581252 | 02:18 |
| openstackgerrit | Merged openstack-infra/zuul master: Fix github setup in zuul from scratch https://review.openstack.org/581253 | 02:18 |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul-jobs master: Add role to trigger readthedocs via authenticated endpoint https://review.openstack.org/579434 | 02:28 |
| tristanC | a new regression with master: https://storyboard.openstack.org/#!/story/2003026 | 02:40 |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul-jobs master: Remove trigger-readthedocs job https://review.openstack.org/583836 | 03:34 |
| *** jimi|ansible has joined #zuul | 03:50 | |
| *** jimi|ansible has joined #zuul | 03:50 | |
| *** harlowja has joined #zuul | 03:51 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: github: log the project name when getBranch fail https://review.openstack.org/583841 | 04:21 |
| *** harlowja has quit IRC | 04:22 | |
| *** pcaruana has joined #zuul | 04:23 | |
| *** pcaruana has quit IRC | 04:34 | |
| *** jimi|ansible has quit IRC | 05:19 | |
| *** nchakrab has joined #zuul | 05:22 | |
| *** quiquell|off is now known as quiquell | 05:26 | |
| *** robcresswell has quit IRC | 05:29 | |
| *** fdegir has quit IRC | 05:29 | |
| *** robcresswell has joined #zuul | 05:29 | |
| *** gundalow_ has joined #zuul | 05:29 | |
| *** gundalow_ has quit IRC | 05:29 | |
| *** gundalow_ has joined #zuul | 05:29 | |
| *** fdegir has joined #zuul | 05:29 | |
| *** LinuxJedi_ has joined #zuul | 05:30 | |
| *** portdirect_ has joined #zuul | 05:30 | |
| *** LinuxJedi has quit IRC | 05:30 | |
| *** mwhahaha has quit IRC | 05:30 | |
| *** portdirect has quit IRC | 05:30 | |
| *** LinuxJedi_ is now known as LinuxJedi | 05:30 | |
| *** portdirect_ is now known as portdirect | 05:30 | |
| *** mwhahaha has joined #zuul | 05:30 | |
| *** gundalow has quit IRC | 05:31 | |
| *** dvn has quit IRC | 05:31 | |
| *** jamielennox has quit IRC | 05:31 | |
| *** gundalow_ is now known as gundalow | 05:31 | |
| *** portdirect is now known as Guest72952 | 05:32 | |
| *** nchakrab has quit IRC | 05:43 | |
| *** threestrands has quit IRC | 05:49 | |
| *** LinuxJedi has quit IRC | 05:53 | |
| *** LinuxJedi has joined #zuul | 05:53 | |
| *** hashar has joined #zuul | 06:03 | |
| *** dvn has joined #zuul | 06:04 | |
| *** threestrands has joined #zuul | 06:09 | |
| *** threestrands has quit IRC | 06:09 | |
| *** threestrands has joined #zuul | 06:09 | |
| *** nchakrab has joined #zuul | 06:10 | |
| *** jamielennox has joined #zuul | 06:11 | |
| *** gundalow is now known as gundalow__ | 06:13 | |
| *** nchakrab_ has joined #zuul | 06:26 | |
| *** gundalow__ is now known as gundalow | 06:28 | |
| *** nchakrab has quit IRC | 06:30 | |
| *** magickris has quit IRC | 06:32 | |
| *** threestrands has quit IRC | 06:36 | |
| *** pcaruana has joined #zuul | 06:37 | |
| *** nchakrab_ has quit IRC | 06:52 | |
| *** openstackgerrit has quit IRC | 07:04 | |
| *** nchakrab has joined #zuul | 07:23 | |
| *** nchakrab has quit IRC | 07:23 | |
| *** nchakrab has joined #zuul | 07:24 | |
| *** electrofelix has joined #zuul | 08:51 | |
| *** sambetts|afk is now known as sambetts | 09:15 | |
| *** nchakrab_ has joined #zuul | 09:40 | |
| *** nchakrab has quit IRC | 09:43 | |
| *** nchakrab_ has quit IRC | 09:50 | |
| *** openstackgerrit has joined #zuul | 09:50 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul master: Add tenant yaml validation option to zuul client https://review.openstack.org/574265 | 09:50 |
| *** nchakrab has joined #zuul | 10:16 | |
| *** quiquell is now known as quiquell|lunch | 11:21 | |
| *** GonZo2000 has joined #zuul | 11:37 | |
| *** GonZo2000 has quit IRC | 11:58 | |
| *** jimi|ansible has joined #zuul | 12:09 | |
| *** jimi|ansible has joined #zuul | 12:09 | |
| *** GonZo2000 has joined #zuul | 12:10 | |
| *** GonZo2000 has joined #zuul | 12:10 | |
| *** dkranz has quit IRC | 12:22 | |
| *** nchakrab has quit IRC | 12:31 | |
| *** nchakrab has joined #zuul | 12:31 | |
| *** ssbarnea1 has quit IRC | 12:36 | |
| *** ssbarnea has joined #zuul | 12:38 | |
| *** rlandy has joined #zuul | 12:40 | |
| *** Guest72952 is now known as portdirect | 12:41 | |
| *** quiquell|lunch is now known as quiquell | 12:45 | |
| *** samccann has joined #zuul | 12:54 | |
| -openstackstatus- NOTICE: logs.openstack.org is offline, causing POST_FAILURE results from Zuul. Cause and resolution timeframe currently unknown. | 12:59 | |
| *** ChanServ changes topic to "logs.openstack.org is offline, causing POST_FAILURE results from Zuul. Cause and resolution timeframe currently unknown." | 12:59 | |
| *** dkranz has joined #zuul | 13:21 | |
| *** gundalow is now known as gundalow_____ | 13:33 | |
| *** gundalow_____ is now known as gundalow | 13:34 | |
| mordred | ianw: no - you can't apply vars to a template - although this is potentially a good example of a use case for such a thing | 13:40 |
| mordred | ianw: we've also discussed being able to set vars on a project itself - which this also might be a good example of a use case for | 13:40 |
| *** ChanServ changes topic to "Discussion of the project gating system Zuul | Website: https://zuul-ci.org/ | Docs: https://zuul-ci.org/docs/ | Source: https://git.zuul-ci.org/ | Channel logs: http://eavesdrop.openstack.org/irclogs/%23zuul/ | Weekly updates: https://etherpad.openstack.org/p/zuul-update-email" | 13:43 | |
| -openstackstatus- NOTICE: logs.openstack.org is back on-line. Changes with "POST_FAILURE" job results should be rechecked. | 13:43 | |
| *** gundalow is now known as gundalow___ | 13:45 | |
| *** gundalow___ is now known as gundalow | 13:46 | |
| *** nchakrab has quit IRC | 14:01 | |
| *** gundalow has quit IRC | 14:26 | |
| *** gundalow has joined #zuul | 14:27 | |
| *** quiquell is now known as quiquell|off | 14:32 | |
| *** nchakrab has joined #zuul | 14:33 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: Add a dequeue command to zuul client https://review.openstack.org/95035 | 14:45 |
| *** pcaruana has quit IRC | 15:12 | |
| *** sshnaidm|rover is now known as sshnaidm|afk | 15:24 | |
| *** GonZo2000 has quit IRC | 15:33 | |
| *** GonZo2000 has joined #zuul | 15:34 | |
| *** GonZo2000 has quit IRC | 15:54 | |
| rcarrillocruz | folks, is there a zuul var to tell the zuul user ? | 16:00 |
| rcarrillocruz | if not, do you introspect that from zuul src_dir or something ? if ever... | 16:00 |
| clarkb | rcarrillocruz: ansible_user: zuul ? | 16:01 |
| rcarrillocruz | ohhhhh | 16:01 |
| rcarrillocruz | didn't think about ansible vars | 16:01 |
| rcarrillocruz | ofc, thx! | 16:01 |
| rcarrillocruz | so zuul puts remote_user as ansible_user in the inventory then? | 16:01 |
| rcarrillocruz | the default_remote_user, can't remmeber the param name from zuul conf files | 16:02 |
| clarkb | I think so | 16:02 |
| rcarrillocruz | and if username is defined on node, i guess it plumbs from there | 16:02 |
| rcarrillocruz | cool | 16:02 |
| pabelanger | ansible_user is mostly what I use | 16:02 |
| pabelanger | and ansible_user_dir | 16:03 |
| *** sshnaidm|afk is now known as sshnaidm|rover | 16:11 | |
| *** nchakrab has quit IRC | 16:30 | |
| *** SpamapS has joined #zuul | 16:44 | |
| *** acozine1 has joined #zuul | 16:47 | |
| *** hashar is now known as hasharAway | 16:51 | |
| clarkb | kata has noticed that the details link from zuul on github PRs takes you to the status page rather than showing you logs. We provide log file links in the comments directly instead. I want to say spamaps was trying to update this? | 16:56 |
| SpamapS | Yes, it's not too hard. | 16:57 |
| SpamapS | You just have to rebuild the log schema in the pipeline def | 16:57 |
| *** elyezer has quit IRC | 16:57 | |
| SpamapS | status-url: .... | 16:57 |
| clarkb | SpamapS: and point it at the uuid prefix of the log path in our case I'm guessing | 16:58 |
| *** elyezer has joined #zuul | 16:58 | |
| mhu | tobiash, SpamapS pabelanger I think https://review.openstack.org/#/c/95035/ is ready (dequeue in CLI), would you mind having a look? | 17:00 |
| pabelanger | sure | 17:00 |
| clarkb | SpamapS: will that set the status url when jobs start? I think what we need is a way for it to be the dashboard link when jobs are running and he logs link when jobs are done? | 17:07 |
| pabelanger | mhu: left comments | 17:10 |
| clarkb | oh we set status-url for each report action so can set it only for success and failure | 17:11 |
| pabelanger | with new quota management in nodepool, could that be used to check if a provider has enough FIPs, before trying to boot a node? | 17:30 |
| clarkb | pabelanger: yes, though I don't think that is one of the quotas currently checked | 17:31 |
| clarkb | you'd also have to know if FIPs were required to produce working instacnes | 17:32 |
| pabelanger | yah, today we have cores, instances, ram | 17:32 |
| pabelanger | yah | 17:33 |
| *** sambetts is now known as sambetts|afk | 17:33 | |
| pabelanger | I don't think that will fix this issue we are having downstream, some reason failing to attach FIP to instances it seems | 17:33 |
| pabelanger | trying to first check if that is because no FIPs are available or some other networking issue | 17:34 |
| clarkb | SpamapS: corvus: working out a status-url we don't make the last two characters of the change number available to the item format call from what I can tell so I'm not sure openstack can format a valid url for its log path | 17:36 |
| clarkb | is that something that would be reasonable to add to Change() as number_suffix attribute? | 17:36 |
| corvus | wait back up | 17:37 |
| corvus | the log url is an opaque string to zuul. it should not be in the zuul config at all. it's something that the job gives back to zuul when it's complete. | 17:38 |
| clarkb | corvus: for specific jobs yes, but we want to have a github status url that goes to eg http://logs.openstack.org/91/91/df28eaf69b0fbb020a64daa6b8f483ed08d95d61/third-party-check/ instead of https://zuul.openstack.org/ once jobs are complete | 17:38 |
| clarkb | and that status-url is a setting in the pipeline config | 17:38 |
| corvus | the log urls are included in the report when the item reports, yeah? | 17:40 |
| clarkb | corvus: as a distinct comment yes | 17:40 |
| corvus | i think earlier we talked about making the status url a deep link to the status page with the change id | 17:41 |
| corvus | i don't think we've talked about having it be anything related to the logs | 17:41 |
| clarkb | ah | 17:41 |
| corvus | if it's just one url, i don't think we have an appropriate single thing to link to yet | 17:41 |
| clarkb | corvus: https://github.com/kata-containers/proxy/pull/91 scroll to the bottom and see the details link for openstack third party check | 17:42 |
| clarkb | it is a single url link | 17:42 |
| corvus | if we go down the path i wrote about in the email, we'll have 'build' pages in zuul-web. maybe we can also add a 'buildset' page, and then that would be a good thing to set as the status url. | 17:42 |
| clarkb | ok, I was just going off of spamaps comment that there was a reasonable thing to do today setting the status-url | 17:43 |
| clarkb | I could see the logs url example above being a reaonsble stand in for your suggestion until it is implemented | 17:43 |
| corvus | clarkb: i think if you did that, you'd lose the link to the status page | 17:43 |
| clarkb | possibly, though I can set it for succes/failure only and I think it will convert the link over only after all jobs are done running | 17:44 |
| clarkb | but I can't slice a string in a format template so would need zuul to set that value for me | 17:46 |
| corvus | clarkb: you can? which attribute are you looking at? | 17:46 |
| clarkb | change.number, specifically I need the last two digit of change.number for the first part of the log url | 17:47 |
| corvus | clarkb: no i'm asking how you set the status url on success or failure | 17:47 |
| corvus | i think you may be confusing status-url (a pipeline configuration) with success-url and failure-url (a job configuration) | 17:48 |
| clarkb | I could be | 17:48 |
| clarkb | corvus: the docs have it listed at pipeline.<reporter>.<github source>.status-url | 17:49 |
| corvus | status-url applies to the whole item, and doesn't change based on success/failure. success-url and failure-url are the log urls for the individual jobs (the things that show up in the report -- the pr comment in the case of github) | 17:49 |
| clarkb | https://zuul-ci.org/docs/zuul/admin/drivers/github.html#reporter-configuration | 17:50 |
| corvus | yeah, you can deep link to those: https://zuul-ci.org/docs/zuul/admin/drivers/github.html#attr-pipeline.%3Creporter%3E.%3Cgithub%20source%3E.status-url | 17:50 |
| clarkb | pipeline.success.github.status-url is the path I'm looking at | 17:50 |
| clarkb | success reporter, github github driver, status-url | 17:51 |
| clarkb | we do set status there already so I think things line up at least as far as the docs go | 17:51 |
| clarkb | then when all jobs are complete it will report success or failure and set the url to http://logs.openstack.org/91/91/df28eaf69b0fbb020a64daa6b8f483ed08d95d61/third-party-check/ | 17:52 |
| SpamapS | It works great for us. | 17:52 |
| SpamapS | Setting the status url on success, and not commenting, is a nice experience. | 17:53 |
| clarkb | except that I need to slice the change.number value | 17:53 |
| corvus | clarkb: so, today, you can either have that link to the status page, which admittedly doesn't make as much sense after the item has reported; or you can do what you're suggesting and link to the future expected location on the log server, which won't make sense until the job reports. i agree the situation isn't ideal, but until there's a real buildset page in zuul-web, there isn't really anything | 17:53 |
| corvus | appropriate to link to to summarise the report (the report is in the pr comment). given that otherwise there's no status page link, i think the most appropriate thing is to use the status page link. | 17:53 |
| clarkb | corvus: ok, but what I've described would be functional right? | 17:54 |
| corvus | clarkb: oh i see what you're saying; using different status-urls in start/success/failure reporters | 17:54 |
| clarkb | corvus: yes | 17:54 |
| *** electrofelix has quit IRC | 17:54 | |
| corvus | so you could set the status page in start, then something else in success/failure. yeah that should work. | 17:54 |
| clarkb | yup and my thought is to set it to the url above but that requires having access to the last two digits of the change number because you cannot slice in str.format() aiui | 17:55 |
| corvus | clarkb: i'd like to suggest in #openstack-infra why we shouldn't do that though. it's a very openstack-infra specific reason. :) | 17:55 |
| clarkb | if we don't want to do it anyway then probably don't need to modify model.Change | 17:55 |
| *** sshnaidm|rover is now known as sshnaidm|off | 17:57 | |
| corvus | i think the best long-term thing for zuul is to have the buildset page. i would not recommend using parallel construction of log urls for something like this -- it has served us very poorly in the past and that informed the design in v3 where we very explicitly decided to stop requiring it. it may work fine in some environments. i won't suggest that SpamapS shouldn't do it if it's working for him. :) | 17:58 |
| corvus | i think the buildset page idea will work for everyone | 17:58 |
| clarkb | corvus: I agree, but would this be an acceptable interim soltion to reduce confusion over why you get a status page without your change on it? | 17:58 |
| SpamapS | I'd love to have a build page to point at | 17:58 |
| SpamapS | the thing we have now is an nginx index page | 17:59 |
| clarkb | I think part of the problem here is github users don't look for distcint comments, they look at the ci details links | 17:59 |
| SpamapS | Yeah, comments are also spammy | 17:59 |
| corvus | well, github has a new ci reporting system. zuul doesn't use it yet, but should. i believe that would let us leave individual job log links in an appropriate non-comment place (the equivalent of gerrit's new reporting system) | 18:01 |
| corvus | i'm not aware of anyone having begun work on implementing that, but that's also likely a very important part of improving this experience | 18:02 |
| clarkb | corvus: ya the jenkins builds seem to use it on that PR example I gave earlier | 18:03 |
| clarkb | they are broken out as separate jobs with their own details | 18:03 |
| clarkb | (though that may be old system hackage too) | 18:03 |
| corvus | clarkb: where's the jenkins thing, i don't see it? | 18:04 |
| clarkb | corvus: jenkins-ci-centos-7-4 and jenkins-ci-fedora-27 and so on in that list | 18:04 |
| corvus | clarkb: the "checks" api is what i was thinking of: https://github.com/kata-containers/proxy/pull/91/checks | 18:04 |
| clarkb | ah | 18:04 |
| corvus | clarkb: i really don't see the word 'jenkins' on https://github.com/kata-containers/proxy/pull/91 | 18:05 |
| clarkb | if you scroll to the bottom with the some checks were not successful box they are in that and you ahve to scroll in that box | 18:06 |
| clarkb | that may be a case of jenkins reporting with old api but not aggregating results and reporting jobs individually | 18:06 |
| corvus | clarkb: are you logged in? | 18:06 |
| corvus | i don't see "some checks were not successful" | 18:07 |
| clarkb | yes I am | 18:07 |
| corvus | ok. well, anyway, i'm pretty sure the checks interface will also do what all of us want, and, it looks like nothing on that PR is using it, assuming https://github.com/kata-containers/proxy/pull/91/checks is also empty for your logged-in-self as it is for my non-logged-in-self :) | 18:08 |
| SpamapS | No I don't think those are the new system. | 18:08 |
| corvus | in fact, if you look at the example images there, it's got all the components of a zuul | 18:09 |
| corvus | -style report | 18:09 |
| SpamapS | "Checks" is the new system, "Statuses" is the old one. | 18:09 |
| SpamapS | and "Checks" can do line-item comments | 18:10 |
| SpamapS | https://help.github.com/articles/about-status-checks/ | 18:10 |
| corvus | so, anyone want to implement that? :) | 18:10 |
| SpamapS | want, yes | 18:10 |
| SpamapS | can... :( | 18:10 |
| clarkb | SpamapS: re noisy comments I'm the weirdo that expands all comments in gerrit reviews | 18:12 |
| corvus | i mean, at least zuul doesn't just draw a giant green box that takes up 1/4 of the screen. :) | 18:14 |
| pabelanger | ha | 18:14 |
| corvus | anyway, implementing the checks api would be a very welcome improvement if someone wants to do it. | 18:15 |
| corvus | don't worry about the line comments -- i'm plumbing those through zuul in a separate effort anyway. so the infrastructure will be there for checks to use. | 18:15 |
| clarkb | I'll admit I lost all patience for the github api ~6 years ago when I made the PR request closer | 18:16 |
| clarkb | (PRs didn't have a delete method you had to delete the issue that mapped to the PR except you can't list them that way and os you just make a leap of faith and it works!) | 18:17 |
| clarkb | er not delete, close | 18:17 |
| tobiash | The checks api is on my agenda but probably not within the next two months | 18:18 |
| SpamapS | clarkb: it's not the expanded comments, it's the emails, that people get all weird about. | 18:20 |
| SpamapS | The GitHub API is like a box of chocolates. You never know what version you're gonna get. | 18:21 |
| mordred | SpamapS: I'm guessing people are using the emails for conversation and don't like zuul comments showing up there because if conflics with the conversation usecase? | 18:40 |
| SpamapS | Yeah, though the failures are helpful as a "hey you have to do something". | 18:42 |
| SpamapS | So we comment on fail, but not success. | 18:42 |
| SpamapS | Most of the time on success nobody needs to read the logs. But if they do, it's set in the status url. | 18:42 |
| mordred | nod | 18:43 |
| mordred | newer gerrit also supports replying to emails and incorporating the reply into the comment stream ... and also has the new api for reporting results - so I could see a similar pattern being desired | 18:45 |
| clarkb | the email based commenting is still rudimentary based on conversations on their mailing list (at least that was my impression of it) | 18:45 |
| clarkb | but it is a long asked for feature so yay | 18:46 |
| mordred | yah | 18:46 |
| mordred | I mean, I don't want to use it myself- but I know there will be people who will | 18:46 |
| *** hasharAway is now known as hashar | 19:03 | |
| *** acozine1 has quit IRC | 19:19 | |
| *** myoung is now known as myoung|biab | 20:00 | |
| *** dkranz has quit IRC | 20:00 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: Add a dequeue command to zuul client https://review.openstack.org/95035 | 20:19 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: web: add /{tenant}/projects and /{tenant}/project/{project} routes https://review.openstack.org/550979 | 20:40 |
| *** samccann has quit IRC | 20:44 | |
| *** samccann has joined #zuul | 20:45 | |
| *** samccann has joined #zuul | 20:46 | |
| *** samccann has quit IRC | 20:49 | |
| *** samccann has joined #zuul | 20:52 | |
| *** samccann has quit IRC | 20:55 | |
| *** samccann has joined #zuul | 20:56 | |
| *** acozine1 has joined #zuul | 21:06 | |
| *** samccann has quit IRC | 21:09 | |
| mhu | tristanC, mordred do you have an ETA on the zuul-web-routes topic ? https://review.openstack.org/#/q/topic:zuul-web-routes+(status:open+OR+status:merged) | 21:15 |
| *** myoung|biab is now known as myoung | 21:16 | |
| mhu | I would like to rebase on these so that I can account for these extra routes in my web api patch | 21:16 |
| mhu | but if the topic needs more work I'll keep the patches independent | 21:17 |
| *** hashar has quit IRC | 21:55 | |
| *** goern_ has joined #zuul | 22:13 | |
| *** goern has quit IRC | 22:15 | |
| *** goern__ has joined #zuul | 22:15 | |
| *** goern_ has quit IRC | 22:18 | |
| *** harlowja has joined #zuul | 22:21 | |
| rcarrillocruz | folks | 22:49 |
| rcarrillocruz | https://livestream.com/accounts/1542415/events/8276281 | 22:49 |
| rcarrillocruz | zuul in slide, live :D | 22:50 |
| rcarrillocruz | corvus mordred pabelanger ^ | 22:50 |
| pabelanger | watching | 22:52 |
| pabelanger | rcarrillocruz: where is this happening? | 22:53 |
| rcarrillocruz | http://techfieldday.com/ | 22:53 |
| rcarrillocruz | silicon valley, not sure where | 22:53 |
| pabelanger | rcarrillocruz: neat | 22:55 |
| pabelanger | look like redhat office some place | 22:56 |
| pabelanger | somebody knew of zuul :) | 22:56 |
| *** acozine1 has quit IRC | 22:59 | |
| *** rlandy is now known as rlandy|bbl | 22:59 | |
| rcarrillocruz | heh | 23:06 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!