| *** holser_ has quit IRC | 00:04 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039 @ https://review.openstack.org/602248, (2 more messages) | 00:12 |
|---|---|---|
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039 @ https://review.openstack.org/602248, (2 more messages) | 02:12 |
| *** ykarel|away has joined #oooq | 03:11 | |
| *** ykarel|away is now known as ykarel | 03:17 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp- (2 more messages) | 04:12 |
| *** udesale has joined #oooq | 04:20 | |
| *** udesale has quit IRC | 04:39 | |
| *** udesale has joined #oooq | 04:41 | |
| *** ykarel is now known as ykarel|afk | 04:51 | |
| *** Tengu_ is now known as Tengu | 04:58 | |
| *** skramaja has joined #oooq | 05:11 | |
| *** dsneddon has joined #oooq | 05:19 | |
| *** ykarel|afk is now known as ykarel | 05:25 | |
| *** saneax has joined #oooq | 05:26 | |
| *** dsneddon has quit IRC | 05:33 | |
| *** udesale has quit IRC | 05:39 | |
| *** udesale has joined #oooq | 05:39 | |
| *** raukadah has quit IRC | 05:45 | |
| *** dsneddon has joined #oooq | 05:46 | |
| *** chandankumar has joined #oooq | 05:46 | |
| *** dsneddon has quit IRC | 05:50 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp- (2 more messages) | 06:12 |
| *** ratailor has joined #oooq | 06:14 | |
| *** dsneddon has joined #oooq | 06:17 | |
| *** apetrich has joined #oooq | 06:30 | |
| *** udesale has quit IRC | 06:46 | |
| *** udesale has joined #oooq | 06:47 | |
| *** quiquell|off is now known as quiquell | 07:03 | |
| *** udesale has quit IRC | 07:05 | |
| *** udesale has joined #oooq | 07:08 | |
| *** udesale has quit IRC | 07:09 | |
| *** udesale has joined #oooq | 07:09 | |
| *** jtomasek has joined #oooq | 07:31 | |
| marios | https://tree.taiga.io/project/tripleo-ci-board/task/800?kanban-status=1447276 quiquell copy/paste nit on the reviews? | 07:34 |
| quiquell | marios: yep let me fix | 07:37 |
| quiquell | marios: I prefer to merge this before that https://review.rdoproject.org/r/#/c/19064/ | 07:38 |
| marios | quiquell: ack i already looked there but forgot to post the comment ^ just did | 07:38 |
| quiquell | marios: ack, just check that the standalone job is doing reporting alright | 07:39 |
| quiquell | I see it's doing it | 07:39 |
| quiquell | marios: thanks, have to drop for a few now | 07:39 |
| chandankumar | marios: quiquell https://review.openstack.org/#/c/639651/ please have a look when free! | 07:41 |
| chandankumar | thanks! | 07:41 |
| quiquell | marios: commented https://code.engineering.redhat.com/gerrit/#/c/164288 | 07:42 |
| quiquell | marios: I can show you run if you want | 07:42 |
| quiquell | marios: it's easier to understand looking at zuul status | 07:43 |
| quiquell | marios: you just do recheck and see there | 07:43 |
| *** quiquell is now known as quiquell|brb | 07:43 | |
| quiquell|brb | chandankumar: ack | 07:43 |
| quiquell|brb | will do | 07:43 |
| marios | chandankumar: ack minor suggestion and a question | 07:48 |
| marios | quiquell|brb: k | 07:48 |
| chandankumar | marios: nice suggestion, thanks, I will add that :-) | 07:50 |
| chandankumar | will reply while updating the patch | 07:51 |
| marios | chandankumar: thanks | 07:52 |
| *** kopecmartin|off is now known as kopecmartin | 08:04 | |
| *** dsneddon has quit IRC | 08:09 | |
| *** bogdando has joined #oooq | 08:12 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp- (2 more messages) | 08:12 |
| *** panda|ruck|off is now known as panda|ruck | 08:12 | |
| panda|ruck | ZzzZz | 08:12 |
| *** amoralej|off is now known as amoralej | 08:18 | |
| *** quiquell|brb is now known as quiquell | 08:18 | |
| *** rascasoft has joined #oooq | 08:20 | |
| quiquell | marios: do you have a test review for https://review.rdoproject.org/r/#/c/19026/ | 08:27 |
| quiquell | marios: want to see the python-docker stuff with py3 | 08:27 |
| *** tosky has joined #oooq | 08:27 | |
| quiquell | humm is config project... | 08:29 |
| quiquell | marios: we have to test it on the reproducer | 08:29 |
| *** dsneddon has joined #oooq | 08:32 | |
| quiquell | marios: commented https://review.rdoproject.org/r/#/c/19026/ | 08:33 |
| marios | quiquell: thanks (yeah was waiting for the depends-on to merge and they have now) will check your comments thanks | 08:33 |
| *** dsneddon has quit IRC | 08:39 | |
| panda|ruck | quiquell: where does telegraf logs in the cockpit ? some graphs are empty | 08:40 |
| quiquell | panda|ruck: depends on the condition you are filtering | 08:41 |
| quiquell | panda|ruck: for example if there is no failures at noop the table will be empty | 08:41 |
| panda|ruck | something really bad is happening ... | 08:43 |
| *** dtantsur|afk is now known as dtantsur | 08:44 | |
| quiquell | panda|ruck: share the graph ç | 08:45 |
| quiquell | panda|ruck: btw they have issues at RDO nodes though | 08:45 |
| panda|ruck | yep the one from friday, thought it was only on some jobs | 08:46 |
| quiquell | panda|ruck: now looks massive | 08:47 |
| *** jpena|off is now known as jpena | 08:56 | |
| quiquell | ykarel: Can you merge this https://review.rdoproject.org/r/#/c/19064/ ? no job is using yet is for the baremetal stuff | 09:01 |
| quiquell | ykarel: is config project | 09:01 |
| quiquell | sshnaidm: ^ | 09:01 |
| *** udesale has quit IRC | 09:04 | |
| sshnaidm | quiquell, looking | 09:11 |
| *** chem has joined #oooq | 09:13 | |
| sshnaidm | quiquell, +w | 09:17 |
| quiquell | sshnaidm: thanks | 09:17 |
| sshnaidm | chandankumar, hi | 09:17 |
| *** ykarel is now known as ykarel|lunch | 09:21 | |
| *** dsneddon has joined #oooq | 09:25 | |
| *** d0ugal has quit IRC | 09:25 | |
| *** d0ugal has joined #oooq | 09:26 | |
| chandankumar | sshnaidm: Hello | 09:27 |
| *** dsneddon has quit IRC | 09:32 | |
| *** derekh has joined #oooq | 09:34 | |
| quiquell | sshnaidm: nit on the previous https://review.rdoproject.org/r/#/c/19076/ | 09:35 |
| *** holser_ has joined #oooq | 09:38 | |
| *** holser_ has quit IRC | 09:40 | |
| *** jaosorior has joined #oooq | 09:41 | |
| marios | needs votes please https://review.rdoproject.org/r/#/c/18975/ last one for the tripleo-ci-testing repo setup https://tree.taiga.io/project/tripleo-ci-board/task/773 | 09:43 |
| marios | thanks | 09:43 |
| sshnaidm | quiquell, merged | 09:47 |
| sshnaidm | chandankumar, so who should I ping to review/merge this? https://review.rdoproject.org/r/#/c/19074/ | 09:48 |
| sshnaidm | chandankumar, btw, do need to wait for promotion to get this? | 09:48 |
| quiquell | sshnaidm: thanks | 09:49 |
| *** gkadam has joined #oooq | 09:50 | |
| *** jbadiapa has quit IRC | 09:51 | |
| *** holser_ has joined #oooq | 09:55 | |
| *** dsneddon has joined #oooq | 10:05 | |
| *** ykarel|lunch is now known as ykarel | 10:10 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp- (2 more messages) | 10:12 |
| *** dsneddon has quit IRC | 10:12 | |
| *** jbadiapa has joined #oooq | 10:13 | |
| marios | quiquell: ok gonna make it py2 only for now then https://review.rdoproject.org/r/#/c/19026/6/playbooks/tripleo-ci-periodic-base/containers-push-registry-login.yaml | 10:16 |
| chandankumar | sshnaidm: I am waiting for the fs039 job to finish once done, i will fix the required person! | 10:16 |
| chandankumar | on rdo channel! | 10:16 |
| chandankumar | we also need ack on juan! | 10:16 |
| sshnaidm | chandankumar, great | 10:16 |
| quiquell | marios: hummm... we have already a f28 test review in place working ? (so we ensure that python2 works for them too) | 10:17 |
| marios | quiquell: we do? but this is in config? | 10:18 |
| quiquell | marios: I mean what it's already merged at config is python-docker | 10:18 |
| *** dtantsur has quit IRC | 10:18 | |
| quiquell | marios: If we run a f28 containers-build-push now we ensure that is using it | 10:18 |
| quiquell | marios: But don't remember if we have alredy do that | 10:18 |
| marios | quiquell: not following. we don't have f28 containers build push | 10:19 |
| marios | quiquell: it is added in that review | 10:19 |
| *** dtantsur has joined #oooq | 10:19 | |
| quiquell | ohh shit ok | 10:21 |
| quiquell | marios: let me ask at #zuul channel | 10:21 |
| quiquell | want to know what plan they have for ansible_python_interpreter | 10:22 |
| marios | quiquell: thanks, i'll update for now and will fix again if needed. we're running out of time. like we need to merge that, then merge more ontop to enable push to the registry etc (we talk on scrum this afternoon about it) | 10:25 |
| Tengu | hello folks! can anyone from oooq push that new validation? https://review.openstack.org/#/c/639926/ would be good to actually test it "for real" on a non-voting job :) | 10:25 |
| quiquell | marios: ack, python-docker will work for sure, we will fix it if needed for python3-docker | 10:26 |
| marios | thnks quiquell | 10:26 |
| quiquell | marios: np | 10:26 |
| quiquell | marios: any more reviews related to that ? | 10:26 |
| marios | quiquell: not yet but will have some later (similar to the centos ones i mean like https://review.rdoproject.org/r/19065 and https://review.rdoproject.org/r/19066 (enable push and then switch over) but first we need the job | 10:29 |
| marios | Tengu: o/ noted for my next reviews run if no one beats me to it | 10:30 |
| Tengu | marios: thanks :). for now there isn't any +2, so guess you have some time ;) | 10:31 |
| quiquell | marios: pytho3 + zuul -> have to merge this https://review.openstack.org/#/q/topic:python3-interpreter | 10:34 |
| marios | quiquell: cool thanks man (so py2 for now) | 10:35 |
| quiquell | marios: yep | 10:35 |
| marios | quiquell: updated thanks https://review.rdoproject.org/r/19026 | 10:36 |
| *** dsneddon has joined #oooq | 10:38 | |
| *** ykarel is now known as ykarel|mtg | 10:43 | |
| sshnaidm | chandankumar, need to fix yaml here https://review.openstack.org/#/c/639651/ | 10:44 |
| *** dsneddon has quit IRC | 10:47 | |
| chandankumar | sshnaidm: looking | 10:50 |
| *** ratailor has quit IRC | 10:51 | |
| *** ratailor has joined #oooq | 10:52 | |
| *** saneax has quit IRC | 10:52 | |
| *** udesale has joined #oooq | 11:15 | |
| *** dsneddon has joined #oooq | 11:20 | |
| *** dsneddon has quit IRC | 11:25 | |
| *** holser_ is now known as holser|lunch | 11:32 | |
| sshnaidm | chandankumar, added https://tree.taiga.io/project/tripleo-ci-board/task/825 | 11:38 |
| *** udesale has quit IRC | 11:52 | |
| *** udesale has joined #oooq | 11:53 | |
| *** chem has quit IRC | 12:09 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp- (2 more messages) | 12:12 |
| *** ykarel|mtg is now known as ykarel | 12:13 | |
| *** udesale has quit IRC | 12:20 | |
| *** udesale has joined #oooq | 12:21 | |
| *** saneax has joined #oooq | 12:29 | |
| arxcruz | YESSSS!!! | 12:37 |
| arxcruz | FINALLY! | 12:38 |
| arxcruz | https://review.openstack.org/#/c/634380/ | 12:38 |
| *** jpena is now known as jpena|lunch | 12:38 | |
| *** udesale has quit IRC | 12:38 | |
| chandankumar | arxcruz: cool! | 12:39 |
| *** udesale has joined #oooq | 12:41 | |
| *** amoralej is now known as amoralej|lunch | 12:47 | |
| *** zbr has quit IRC | 12:53 | |
| *** ratailor has quit IRC | 12:53 | |
| *** zbr|ssbarnea has joined #oooq | 12:53 | |
| *** ratailor has joined #oooq | 12:54 | |
| *** zbr|ssbarnea has quit IRC | 12:54 | |
| *** zbr has joined #oooq | 12:55 | |
| *** rlandy has joined #oooq | 12:57 | |
| quiquell | rlandy: o/ | 13:00 |
| *** holser|lunch is now known as holser_ | 13:00 | |
| rlandy | quiquell: hey | 13:06 |
| quiquell | rlandy: we need to sync regarding DLRN and semaphores | 13:07 |
| quiquell | rlandy: they are in good state now | 13:07 |
| rlandy | quiquell: ok | 13:08 |
| rlandy | waiting on two upstream reviews to merge | 13:08 |
| quiquell | sure no problem | 13:08 |
| rlandy | then I can merge my final job | 13:08 |
| quiquell | Let me know when you have idle cycle | 13:08 |
| rlandy | quiquell: we can talk now | 13:08 |
| quiquell | rlandy: ack | 13:08 |
| *** udesale has quit IRC | 13:08 | |
| rlandy | I know it's near day end for you soon | 13:08 |
| quiquell | rlandy: well we have the sprint | 13:09 |
| *** ratailor has quit IRC | 13:09 | |
| *** udesale has joined #oooq | 13:09 | |
| quiquell | weshay: can do a small pre meeting and share in the sprint | 13:09 |
| quiquell | I mean rlandy | 13:09 |
| rlandy | quiquell: sure - joining my blue | 13:09 |
| quiquell | ack | 13:09 |
| *** skramaja_ has joined #oooq | 13:13 | |
| *** skramaja has quit IRC | 13:13 | |
| *** saneax has quit IRC | 13:15 | |
| marios | quiquell: panda|ruck sshnaidm rfolco squashed into https://review.rdoproject.org/r/#/c/18975/ i'll talk about it on scrum thanks | 13:17 |
| marios | cc zbr sorry (re centos/f28 cont build stuff ^^) | 13:22 |
| *** dsneddon has joined #oooq | 13:22 | |
| quiquell | rlandy: https://zuul-ci.org/docs/zuul/admin/tenants.html | 13:22 |
| quiquell | rlandy: You can exclude | 13:23 |
| quiquell | pipeline | 13:23 |
| quiquell | job | 13:23 |
| quiquell | semaphore | 13:23 |
| quiquell | project | 13:23 |
| quiquell | project-template | 13:23 |
| quiquell | nodeset | 13:23 |
| quiquell | secret | 13:23 |
| rlandy | quiquell: thanks | 13:23 |
| quiquell | marios: Do we need new pipeline | 13:24 |
| quiquell | job | 13:24 |
| quiquell | semaphore | 13:24 |
| quiquell | project | 13:24 |
| quiquell | project-template | 13:24 |
| quiquell | nodeset | 13:24 |
| quiquell | secret | 13:24 |
| quiquell | damn | 13:24 |
| rlandy | quiquell: https://review.openstack.org/#/c/639722/ updated | 13:24 |
| quiquell | marios: I mean periodic-tripleo-centos-7-master-promote-consistent-to-tripleo-ci-testing | 13:24 |
| quiquell | rlandy: +w | 13:25 |
| rlandy | thanks | 13:25 |
| marios | quiquell: well consistent is what we take and tag as tripleo-ci-testing in order to promote to curre-tripleo | 13:25 |
| marios | so not sure what you mean tho | 13:25 |
| marios | quiquell: maybe talk in half hour? | 13:25 |
| marios | phone easier | 13:25 |
| quiquell | marios: yep but you have to promote fedora DLRN server too, or do we do this already at that job ? | 13:26 |
| quiquell | marios: Or I am all wrong | 13:26 |
| quiquell | marios: yep let's talk sorry | 13:26 |
| quiquell | marios: Will add a coment | 13:26 |
| marios | quiquell: no i mean if it passes upstream jobs then it is tripleo-ci-testiong and we try to promote on it | 13:26 |
| marios | quiquell: like take consistent build | 13:26 |
| marios | run jobs if pass then its tripleo-ci-testing | 13:26 |
| marios | quiquell: but i also may not follow what you mean man | 13:26 |
| marios | quiquell: and i am also likely to be wrong! | 13:26 |
| quiquell | marios: promotion is not an easy matter, let's talk in the scrum | 13:27 |
| quiquell | zbr: ansible trivia what is the fact subset I need to gather for ansible_user_dir ? | 13:27 |
| zbr | quiquell: you can mention the variable name if you want. i think it works. also "min" should work. but why to bother and not get all? | 13:28 |
| quiquell | zbr: I am geting all but it's not working :-/ | 13:29 |
| zbr | is few extra seconds but due to caching you save them later | 13:29 |
| quiquell | zbr: could be some zuul magic don't load the facts | 13:29 |
| quiquell | zbr: run.yaml at https://code.engineering.redhat.com/gerrit/#/c/164227/ | 13:30 |
| rlandy | quiquell: what should we do with this card? actually included in another user story https://tree.taiga.io/project/tripleo-ci-board/task/595 | 13:30 |
| panda|ruck | rfolco: save me. | 13:31 |
| panda|ruck | rlandy: come to my rescue | 13:31 |
| *** jpena|lunch is now known as jpena | 13:31 | |
| quiquell | rlandy: Maybe not needed, just runing at a periodic pipeline should be enough | 13:31 |
| quiquell | rlandy: toci magic | 13:31 |
| rlandy | panda|ruck: how so? | 13:31 |
| quiquell | rlandy: toci select correct release file depending on the pipeline name | 13:31 |
| quiquell | rlandy: and release file points to tripleo-ci-testing hash | 13:32 |
| rlandy | quiquell: yep - I added a periodic pipeline- so moving to done once your user story completes | 13:32 |
| *** dsneddon has quit IRC | 13:32 | |
| quiquell | rlandy: ack | 13:32 |
| quiquell | rlandy: yep maybe is just related to adding the periodic | 13:33 |
| panda|ruck | rlandy: sorry was for rfolco | 13:33 |
| *** udesale has quit IRC | 13:36 | |
| zbr | quiquell: i hope you are aware about what happens with ansible_user_dir when you sudo, right? | 13:36 |
| fultonj | panda|ruck: regarding https://bugs.launchpad.net/tripleo/+bug/1817688 | 13:36 |
| openstack | Launchpad bug 1817688 in tripleo "job that test ceph in periodic pipeline for stable branches are getting the wrong configuration" [Critical,Fix released] - Assigned to Gabriele Cerami (gcerami) | 13:36 |
| fultonj | is pike working or are we not paying attention to pike anymore? | 13:37 |
| chandankumar | marios: panda|ruck sshnaidm let's add telemetry tests https://review.openstack.org/#/c/604311/ to ci job it is running now :-) | 13:37 |
| chandankumar | http://logs.openstack.org/11/604311/13/check/tripleo-ci-centos-7-scenario002-standalone/8d78117/logs/tempest.html.gz -> telemetry results | 13:37 |
| *** skramaja_ has quit IRC | 13:38 | |
| quiquell | zbr: yep, there is no sudo involve though | 13:38 |
| marios | chandankumar: noted for later | 13:40 |
| *** chem has joined #oooq | 13:42 | |
| chandankumar | marios: sure :-) | 13:43 |
| chandankumar | sshnaidm: rdo patch is merged now, we need to wait for promotion, in order to get it in tempest container. | 13:44 |
| panda|ruck | fultonj: pike is not working, and I have not a clear answer on the importance yet | 13:44 |
| zbr | quiquell: send me link to the build logs where you have problemswith ansible_user_dir | 13:50 |
| rfolco | panda|ruck, I'm off today, carnival holiday | 13:50 |
| *** rfolco is now known as rfolco|pto | 13:50 | |
| quiquell | zbr: https://sf.hosted.upshift.rdu2.redhat.com/logs/27/164227/12/check/check-containers-build/69aae86/ | 13:50 |
| panda|ruck | rfolco|pto: ah. Ok. | 13:51 |
| *** amoralej|lunch is now known as amoralej | 13:51 | |
| rfolco|pto | panda|ruck, save me? are you in trouble? | 13:51 |
| panda|ruck | rfolco|pto: no worries. Go back to you parties :) | 13:51 |
| zbr | quiquell: this seems to be zuul specific issue: "Gather user dir". apparently it forbids you from doing anything on ansible controller host, or this is how i read it. | 13:53 |
| quiquell | zbr: yep | 13:53 |
| zbr | quiquell: look at the good side: finally zuul seems to become safer. | 13:54 |
| panda|ruck | fultonj: as you may have seen I'm swamped with the promotion blockers. Pike will have the lowest priority possible for me. I'll contact you when I have some time to change the release passing. | 13:54 |
| zbr | quiquell: ask on #zuul, i do not know. | 13:54 |
| fultonj | panda|ruck: i just want to know the plan | 13:56 |
| fultonj | panda|ruck: so your plan is to refactor the variable in the future? | 13:58 |
| *** dsneddon has joined #oooq | 13:59 | |
| panda|ruck | fultonj: yes, you'll need to rely on the release variable and not the zuul branch. So the plan is making the release variable available early in the process. | 13:59 |
| *** dsneddon has quit IRC | 14:05 | |
| *** dsneddon has joined #oooq | 14:06 | |
| panda|ruck | ykarel: you already looked at the failures in phase1 ? | 14:08 |
| ykarel | panda|ruck, just saw logs, didn't looked for the fix | 14:08 |
| panda|ruck | ykarel: ok, looking now, thanks | 14:10 |
| *** dsneddon has quit IRC | 14:10 | |
| ykarel | ack | 14:10 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp- (2 more messages) | 14:12 |
| panda|ruck | ykarel: where do you see the logs ? | 14:24 |
| ykarel | panda|ruck, phase1 tripleo rocky/master job's logs | 14:25 |
| panda|ruck | ykarel: I still see https://ci.centos.org/job/tripleo-quickstart-promote-rocky-rdo_trunk-minimal/114/artifact/console.txt.gz and it's missing | 14:25 |
| arxcruz | review.openstack.org/#/c/634380 | 14:25 |
| marios | https://tree.taiga.io/project/tripleo-ci-board/task/780?kanban-status=1447276 | 14:25 |
| arxcruz | https://review.openstack.org/#/c/634380 | 14:25 |
| arxcruz | yes | 14:25 |
| marios | yes | 14:26 |
| marios | :D | 14:26 |
| marios | arxcruz: (ack noted for next reviews) | 14:26 |
| ykarel | panda|ruck, i see by clicking full_logs in https://ci.centos.org/job/tripleo-quickstart-promote-rocky-rdo_trunk-minimal/114/ | 14:26 |
| arxcruz | marios: ευχαριστώ | 14:26 |
| panda|ruck | ykarel: ok I see it now | 14:27 |
| marios | arxcruz: i assume that was some greek swearing i only see ???????? | 14:27 |
| arxcruz | marios: efcharistó | 14:27 |
| marios | arxcruz: ah yeah :D thanks | 14:28 |
| marios | https://bugs.launchpad.net/tripleo/+bug/1818305 https://bugs.launchpad.net/tripleo/+bug/1818509 so far panda|ruck | 14:32 |
| openstack | Launchpad bug 1818305 in tripleo "overcloud-full image fails to build calling mkfs -t xfs, exec sudo failed" [Critical,Triaged] | 14:32 |
| openstack | Launchpad bug 1818509 in tripleo "All jobs in periodic pipeline failing to report to dlrn due to missing credentials" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 14:32 |
| marios | quiquell: where is the fix for +bug/1818509 did you say you posted | 14:33 |
| quiquell | marios: https://review.rdoproject.org/r/19083 going to add it | 14:33 |
| marios | quiquell: ty | 14:36 |
| marios | quiquell: please add the bug | 14:37 |
| *** ykarel is now known as ykarel|away | 14:37 | |
| quiquell | Added bug https://review.rdoproject.org/r/#/c/19083/ | 14:40 |
| panda|ruck | marios https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/c05e956/logs/undercloud/home/zuul/install-undercloud.log.txt.gz | 14:41 |
| panda|ruck | sshnaidm: ^ | 14:45 |
| rlandy | quiquell: panda|ruck: https://review.rdoproject.org/r/#/c/19083/ w'ed | 14:45 |
| panda|ruck | rlandy: thanks. | 14:45 |
| *** ykarel|away has quit IRC | 14:46 | |
| *** dsneddon has joined #oooq | 14:47 | |
| quiquell | rlandy: thanks | 14:47 |
| marios | zbr: mute pls :D | 14:48 |
| marios | i can hear you blink | 14:48 |
| sshnaidm | panda|ruck, ERROR neutron.service TypeError: __init__() got an unexpected keyword argument 'set_proctitle' | 14:50 |
| sshnaidm | panda|ruck, https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/c05e956/logs/undercloud/var/log/extra/errors.txt.txt.gz | 14:50 |
| panda|ruck | https://ci.centos.org/job/rdo_trunk-promote-rocky-current-tripleo/ | 14:52 |
| panda|ruck | https://ci.centos.org/job/tripleo-quickstart-promote-rocky-rdo_trunk-minimal/ | 14:52 |
| *** dsneddon has quit IRC | 14:53 | |
| panda|ruck | sshnaidm: ^ so it's not probably an infra issue ? | 14:59 |
| rlandy | panda|ruck: https://review.rdoproject.org/r/19086 | 14:59 |
| panda|ruck | rlandy: perfect thanks | 15:00 |
| sshnaidm | panda|ruck, seems so | 15:00 |
| sshnaidm | panda|ruck, I don't see reasons to fail introspection, while it works in ovb | 15:00 |
| rlandy | panda|ruck: ^^ looking at introspection failure | 15:01 |
| panda|ruck | sshnaidm: sorry was talking about the log above the one in ci.centos. THe undercloud install | 15:01 |
| rlandy | possible node clean error | 15:01 |
| *** dsneddon has joined #oooq | 15:01 | |
| sshnaidm | panda|ruck, did you mean undercloud installf failure in ovb? | 15:02 |
| panda|ruck | sshnaidm: yes | 15:02 |
| sshnaidm | panda|ruck, I'm not sure, there is clear neutron error, but it also can happen because of rdo cloud. It can fail in so vary and different ways.. better to rerun it | 15:03 |
| panda|ruck | sshnaidm: ok thanks. | 15:03 |
| sshnaidm | panda|ruck, I've already been wasting time om weird errors investigations while it was just another problem with rdo-cloud.. | 15:03 |
| *** fmount has quit IRC | 15:05 | |
| quiquell | panda|ruck, sshnaidm: Usually is better to wait for it to settle | 15:07 |
| panda|ruck | quiquell: ok | 15:07 |
| sshnaidm | yeah, what happened once - didn't happen | 15:08 |
| quiquell | Like good politicians :-) | 15:08 |
| panda|ruck | yeah, once is an exception, twice is pattern :) | 15:09 |
| panda|ruck | to me sometimes once is a pattern, that's why I worry so much all the time :P | 15:09 |
| *** dsneddon has quit IRC | 15:09 | |
| *** zul has joined #oooq | 15:11 | |
| rlandy | quiquell: panda|ruck: I added you guys to config-core - pls check you have +2 permissions on config and rdo-jobs repos now | 15:17 |
| rlandy | zbr: ^^ | 15:17 |
| quiquell | rlandy: yep | 15:17 |
| *** dsneddon has joined #oooq | 15:17 | |
| rlandy | zbr: extend rdo-ci-core membership is a different question actually | 15:18 |
| rlandy | will check with weshay on that one | 15:18 |
| rlandy | quiquell:k - welcome to the config-core family | 15:18 |
| quiquell | \o/ ! | 15:19 |
| panda|ruck | rlandy: lol, gertty now on config allows me to vote only positive number. I have +2 but missing -1 . Trying on web | 15:21 |
| rlandy | quiquell: so you have that issue ^^ | 15:21 |
| rlandy | do | 15:22 |
| marios | quiquell: panda|ruck congrats ! sorry for not voting btw rlandy but i discovered i wasn't even subscribed o_O well at least now i am | 15:22 |
| zbr | rlandy: at least we have a ticket for it which we cant watch. | 15:22 |
| marios | quiquell: and thanks for forwarding that mail | 15:22 |
| marios | err rlandy ^ | 15:22 |
| rlandy | np | 15:22 |
| marios | sorry for more noise quiquell | 15:22 |
| zbr | marios: you are not the only one that was not subscribed.... these lists are missing from our joining team docs. | 15:23 |
| panda|ruck | marios: thanks, I'm not sure your vote to get other cores means something if you're not core. | 15:23 |
| marios | ack thanks zbr :D | 15:23 |
| marios | right panda|ruck | 15:23 |
| marios | indeed | 15:23 |
| marios | but no need to be like that about it | 15:24 |
| marios | panda|ruck: | 15:24 |
| marios | :D | 15:24 |
| marios | panda|ruck: i mean you could just let me vote | 15:24 |
| panda|ruck | rlandy: working thanks. | 15:24 |
| rlandy | panda|ruck: cool | 15:24 |
| marios | and it just gets ignored | 15:24 |
| marios | panda|ruck: and silently mock me | 15:24 |
| marios | panda|ruck: rather than being like that about it | 15:24 |
| rlandy | panda|ruck: wrt introspection error - can we try setting undercloud node cleaning to false? | 15:24 |
| *** dsneddon has quit IRC | 15:25 | |
| panda|ruck | marios: for you it's "your honour" now. | 15:25 |
| rlandy | and your undercloud is running now | 15:25 |
| rlandy | panda|ruck: in europe, I thought the term was 'my lord'? | 15:25 |
| panda|ruck | rlandy: where do you set to hold the node ? | 15:26 |
| rlandy | 'your honour' is an american thing | 15:26 |
| rlandy | panda|ruck: can't in upstream zuul unless you ask admins | 15:26 |
| panda|ruck | rlandy: I think I'll stick to my favourite then "my liege" | 15:26 |
| marios | overlord? | 15:26 |
| panda|ruck | quiquell: with greap power comes great resposibility | 15:26 |
| panda|ruck | marios: too close to painful memories | 15:27 |
| quiquell | panda|ruck: more stuff to review more or less :-) | 15:27 |
| chandankumar | sshnaidm: I think rdo spec file depends on does not work in rdo ci jobs https://logs.rdoproject.org/49/18749/15/check/tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039/7801fdc/logs/ara_oooq/result/ac3eab2e-0132-4957-a7d3-2b9920b75a18/ | 15:27 |
| panda|ruck | quiquell: yes, we mainly have more responsibility without the power | 15:27 |
| chandankumar | sshnaidm: rdo spec changes are not picked up | 15:27 |
| panda|ruck | :D | 15:27 |
| sshnaidm | chandankumar, that's bad, I think it was supported in some point. Worth to submit a bug. | 15:28 |
| chandankumar | sshnaidm: yes I will dig tomorrow! | 15:28 |
| rlandy | panda|ruck: in that case, my liege, pls ask kieran to hold the node for you | 15:28 |
| sshnaidm | chandankumar, can we just merge it and continue? | 15:28 |
| sshnaidm | chandankumar, I'd like not to block on it.. | 15:28 |
| chandankumar | sshnaidm: I think so, we are good to go | 15:28 |
| sshnaidm | chandankumar, cool! | 15:28 |
| rlandy | arxcruz; pls post the review you want us to look at | 15:29 |
| arxcruz | rlandy: https://review.openstack.org/#/c/634380 | 15:29 |
| * chandankumar is done for the day see ya tomorrow | 15:32 | |
| *** chandankumar is now known as raukadah | 15:32 | |
| panda|ruck | raukadah: raukadah ? | 15:35 |
| raukadah | panda|ruck: ''.join([i for i in 'chandankumar' if i not in 'chandankumar'[-3::-3]])[::-1] | 15:38 |
| panda|ruck | raukadah: https://memegenerator.net/img/instances/72539910/but-why.jpg | 15:40 |
| raukadah | panda|ruck: chandan kumar is pretty common, 1 in 10 people in india has this name, so developed alternative nick | 15:41 |
| raukadah | panda|ruck: all are grouped under freenode under chandankumar | 15:43 |
| *** quiquell is now known as quiquell|off | 15:47 | |
| *** zul has quit IRC | 15:48 | |
| panda|ruck | raukadah: ok, thanks for the explanation. | 15:48 |
| rlandy | marios: while I am still in merging mode, anything else need to do in? | 15:49 |
| marios | rlandy: good for now thanks rlandy ! | 15:50 |
| * rlandy changes modes | 15:50 | |
| marios | rlandy: merge office hours closing in 10 mins? ppp | 15:50 |
| marios | oh i see . done. | 15:50 |
| marios | ;) | 15:50 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp- (2 more messages) | 16:12 |
| rlandy | panda|ruck: ping me when you can chat about introspection errors | 16:17 |
| marios | panda|ruck: rlandy quiquell|off re f28 we discussed on scrum for the f28 promotion pipeline and someone mentioned it might be done/was looked at | 16:19 |
| marios | i found https://tree.taiga.io/project/tripleo-ci-board/us/447?milestone=215191 | 16:19 |
| marios | from sprint 4 | 16:19 |
| marios | fyi | 16:19 |
| marios | trying to understand whats missing/left | 16:20 |
| * rlandy looks | 16:22 | |
| marios | fyiperiodic-tripleo-centos-7-rocky-promote-consistent-to-tripleo-ci-testing | 16:22 |
| marios | sorry.. so lets try again | 16:23 |
| panda|ruck | marios: reboot yourself :) | 16:23 |
| marios | rlandy: i think we still need the fedora 28 equivalent for periodic-tripleo-centos-7-rocky-promote-consistent-to-tripleo-ci-testing | 16:23 |
| marios | rlandy: afaics https://review.rdoproject.org/r/#/c/17740/ actually adds a f28 container build (currently using rdo kolla build) and a f28 standalone job as periodics with the standalone depending on the contianer build | 16:23 |
| marios | BUT | 16:24 |
| marios | not adding the f28 equivalent for periodic-tripleo-centos-7-rocky-promote-consistent-to-tripleo-ci-testing | 16:24 |
| panda|ruck | rlandy: phase1 job are reported on launchpad too ? all the jobs there are failing, not only that one, with weird error on missing VMs | 16:24 |
| rlandy | panda|ruck; ack - re: launchpad reporting - upstream errors | 16:24 |
| marios | rlandy: sorry not the rocky ones but hopefully it makes at least some sense ;) | 16:24 |
| * marios reboots me | 16:25 | |
| * rlandy read back | 16:25 | |
| panda|ruck | marios: there should already be a job that builds containers for fedora-28, even if it fails, does it depend on anything ? | 16:25 |
| marios | rlandy: i mean this one i.e. there is no f28 equivalent of periodic-tripleo-centos-7-master-promote-consistent-to-tripleo-ci-testing | 16:25 |
| marios | panda|ruck: thats what weshay said on friday we are fine to break that job | 16:25 |
| marios | panda|ruck: no there is no dependency | 16:25 |
| rlandy | marios; ack - it is my understanding that we create a completely separate pipeline | 16:25 |
| rlandy | so ... | 16:26 |
| marios | rlandy: k yeah so we'll need that bit its missing | 16:26 |
| rlandy | https://review.rdoproject.org/r/#/c/17738/16/zuul.d/tripleo.yaml not enough | 16:26 |
| panda|ruck | marios: ok, then, yes we need to create the dependency for it with the clone of the centos-7 one | 16:26 |
| rlandy | marios: I ma trying to find the review you had with the pipeline work | 16:28 |
| rlandy | it looks like a lot of the cards still point to the review we merged | 16:29 |
| marios | rlandy: you mean https://review.rdoproject.org/r/#/c/18975 perhaps | 16:29 |
| rlandy | no - you had a review with the build job added as a dependency everywhere | 16:29 |
| marios | rlandy: oh sec | 16:30 |
| marios | rlandy: is on taiga https://tree.taiga.io/project/tripleo-ci-board/task/818?kanban-status=1447275 https://review.rdoproject.org/r/#/c/19066/ | 16:31 |
| rlandy | marios: yep - this one https://review.rdoproject.org/r/#/c/19066/1/zuul.d/tripleo.yaml | 16:32 |
| rlandy | I think that becomes a new pipeline | 16:32 |
| marios | rlandy: but that's the centos one | 16:32 |
| rlandy | where is the equivalent to periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-master-upload? | 16:32 |
| rlandy | fedora upload | 16:32 |
| *** dsneddon has joined #oooq | 16:32 | |
| marios | rlandy: and that switches the depends on from the current build job to the new build job based on upstream but for centos | 16:33 |
| marios | rlandy: so we want the same but for fedora. and specifically the thing that job depends on, i.e. https://github.com/rdo-infra/review.rdoproject.org-config/blob/e1d81ff7a4e1f19eb4ce1577f0f370acec3e0adc/zuul.d/tripleo.yaml#L106-L108 | 16:33 |
| marios | rlandy: so we need some equivalent for the dependency of the build job, i.e. the thing that makes consistent into tripleo-ci-testing periodic-tripleo-centos-7-master-promote-consistent-to-tripleo-ci-testing | 16:34 |
| marios | panda|ruck: correct me please? overlord sire your highness oh great one ^^ | 16:34 |
| * marios deep bow | 16:34 | |
| rlandy | marios: maybe we should chat for five with panda|ruck "my liege" | 16:35 |
| marios | rlandy: sure can do am around for a little longer | 16:35 |
| marios | rlandy: i mean right now is fine for me but panda|ruck around? | 16:35 |
| panda|ruck | I am | 16:36 |
| marios | panda|ruck: wana blue? about the periodic thing 5 mins with rlandy? | 16:36 |
| panda|ruck | marios: sure | 16:36 |
| marios | https://redhat.bluejeans.com/7661925373/ | 16:36 |
| marios | joining | 16:36 |
| rlandy | joining | 16:37 |
| marios | https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul.d/tripleo.yaml rlandy | 16:41 |
| marios | https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul.d/tripleo.yaml#L83 | 16:41 |
| *** dsneddon has quit IRC | 16:42 | |
| panda|ruck | marios: rlandy https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/playbooks/tripleo-ci-base-promote-consistent-to-tripleo-ci-testing/run.yaml | 16:45 |
| panda|ruck | marios: rlandy https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/playbooks/tripleo-ci-base-promote-consistent-to-tripleo-ci-testing/run.yaml#L37 | 16:45 |
| *** holser_ has quit IRC | 16:46 | |
| panda|ruck | rlandy: https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo_trunk-promote-rocky-current-tripleo/ | 16:52 |
| *** dsneddon has joined #oooq | 17:00 | |
| *** kopecmartin is now known as kopecmartin|off | 17:04 | |
| marios | panda|ruck: rlandy https://tree.taiga.io/project/tripleo-ci-board/task/827 | 17:05 |
| marios | panda|ruck: rlandy just moved that to story 651 instead which is specifically about the periodic work around f28 container build | 17:06 |
| *** bogdando has quit IRC | 17:07 | |
| panda|ruck | rlandy: e89a3e4dd82cfab836db0aa8ae339a9904475182 | 17:11 |
| *** agopi has joined #oooq | 17:15 | |
| panda|ruck | rlandy: a0236872041babd84e6b7e3cd7eca558e746e602 | 17:17 |
| panda|ruck | rlandy: https://pypi.org/project/networking-baremetal/ | 17:17 |
| *** saneax has joined #oooq | 17:28 | |
| *** dtantsur is now known as dtantsur|afk | 17:29 | |
| *** holser_ has joined #oooq | 17:33 | |
| rlandy | panda|ruck: "$OPT_ADDITIONAL_PARAMETERS -e undercloud_clean_nodes=false | 17:40 |
| panda|ruck | if tomorrow looks like today I'll take a raincheck. | 18:00 |
| panda|ruck | rlandy: thanks for you help, created https://bugs.launchpad.net/tripleo/+bug/1818554, now going off | 18:00 |
| openstack | Launchpad bug 1818554 in tripleo "Phase 1 tripleo-quickstart-promote-rocky-rdo_trunk-minimal job fail on master and rocky. Introspection failed to run hardware-detect utility" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 18:00 |
| panda|ruck | oh wait. The weirdo stuff | 18:01 |
| panda|ruck | what a beatiful day. | 18:02 |
| *** derekh has quit IRC | 18:05 | |
| *** dsneddon has quit IRC | 18:05 | |
| *** holser_ is now known as holser|away | 18:05 | |
| *** jfrancoa has joined #oooq | 18:06 | |
| *** jfrancoa has quit IRC | 18:07 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp- (2 more messages) | 18:12 |
| *** saneax has quit IRC | 18:25 | |
| *** jpena is now known as jpena|off | 18:27 | |
| *** amoralej is now known as amoralej|off | 18:30 | |
| *** panda|ruck is now known as panda|ruck|off | 18:41 | |
| *** dsneddon has joined #oooq | 18:46 | |
| *** vinaykns has joined #oooq | 19:11 | |
| *** agopi has quit IRC | 19:18 | |
| *** agopi_ has joined #oooq | 19:18 | |
| *** agopi_ is now known as agopi | 19:50 | |
| rlandy | agopi: https://code.engineering.redhat.com/gerrit/#/c/164398/ | 19:51 |
| rlandy | agopi: this should remove only our jobs | 19:51 |
| rlandy | pls review | 19:51 |
| rlandy | agopi: we have moved our jobs to zuul | 19:52 |
| agopi | on it rlandy | 19:55 |
| rlandy | thanks | 19:56 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp- (2 more messages) | 20:12 |
| *** jtomasek has quit IRC | 20:48 | |
| *** fultonj has quit IRC | 21:43 | |
| *** rnoriega has quit IRC | 21:52 | |
| *** rnoriega has joined #oooq | 21:52 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp- (2 more messages) | 22:12 |
| *** agopi has quit IRC | 22:44 | |
| *** rascasoft has quit IRC | 23:10 | |
| *** tosky has quit IRC | 23:28 | |
| *** rlandy has quit IRC | 23:45 | |
| *** fultonj has joined #oooq | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
