*** tosky has quit IRC | 00:00 | |
*** saneax has quit IRC | 00:20 | |
*** rlandy has quit IRC | 00:29 | |
*** rodrigods has quit IRC | 00:39 | |
*** apetrich has quit IRC | 03:09 | |
*** gouthamr has quit IRC | 03:14 | |
*** gouthamr has joined #oooq | 03:24 | |
*** ykarel|away has joined #oooq | 03:46 | |
*** bhagyashris has joined #oooq | 04:05 | |
*** ykarel|away has quit IRC | 04:18 | |
*** skramaja has joined #oooq | 04:26 | |
*** ykarel|away has joined #oooq | 04:35 | |
*** bhagyashris has quit IRC | 04:47 | |
*** bhagyashris has joined #oooq | 04:47 | |
*** epoojad1 has joined #oooq | 04:49 | |
*** holser has joined #oooq | 04:54 | |
*** ykarel|away is now known as ykarel | 05:00 | |
*** whoami-rajat__ has joined #oooq | 05:03 | |
*** holser has quit IRC | 05:34 | |
*** soniya29 has joined #oooq | 05:55 | |
*** raukadah is now known as chkumar|rover | 05:58 | |
*** surpatil has joined #oooq | 05:59 | |
*** whoami-rajat__ has quit IRC | 06:07 | |
*** SurajPatil has joined #oooq | 06:09 | |
*** surpatil has quit IRC | 06:12 | |
*** ksambor has quit IRC | 06:17 | |
*** ksambor has joined #oooq | 06:17 | |
*** saneax has joined #oooq | 06:24 | |
*** SurajPatil has quit IRC | 06:25 | |
*** surpatil has joined #oooq | 06:26 | |
*** marios|ruck has joined #oooq | 06:36 | |
*** whoami-rajat__ has joined #oooq | 06:37 | |
*** jfrancoa has joined #oooq | 06:52 | |
*** TrevorV has joined #oooq | 07:23 | |
*** TrevorV has quit IRC | 07:23 | |
marios|ruck | chkumar|rover: \o/ | 07:25 |
---|---|---|
chkumar|rover | marios|ruck: \o/ | 07:25 |
marios|ruck | :) | 07:25 |
chkumar|rover | marios|ruck: Added notes on etherpad, consistent to toci testing broken | 07:27 |
marios|ruck | chkumar|rover: again? so we need a bug for it. but the test job was green | 07:27 |
chkumar|rover | marios|ruck: it is timing out twice | 07:27 |
marios|ruck | chkumar|rover: on the good news we got at least one good run yesterday (with https://review.rdoproject.org/r/24211 for full-tempest rerun) & promoted | 07:27 |
chkumar|rover | awesome | 07:28 |
marios|ruck | chkumar|rover: (master promoted) | 07:28 |
marios|ruck | chkumar|rover: so https://bugs.launchpad.net/tripleo/+bug/1856723 is not consistent looks like :/ | 07:28 |
openstack | Launchpad bug 1856723 in tripleo "periodic-tripleo-ci-centos-7-standalone-full-tempest-master fails during tempest run ImagesTestJSON:test_delete_saving_image" [Critical,Triaged] | 07:28 |
marios|ruck | i mean it passed on test | 07:28 |
marios|ruck | chkumar|rover: i'll update those in a bit going though ether now | 07:28 |
chkumar|rover | it is a timeout issue, but the test needs improvement, I asked soniya29 to work with glance people to get aproper fix | 07:29 |
marios|ruck | chkumar|rover: k, like we tested it yesterday there rembmer https://bugs.launchpad.net/tripleo/+bug/1856723 | 07:29 |
openstack | Launchpad bug 1856723 in tripleo "periodic-tripleo-ci-centos-7-standalone-full-tempest-master fails during tempest run ImagesTestJSON:test_delete_saving_image" [Critical,Triaged] | 07:29 |
marios|ruck | oops wrong paste :/ | 07:29 |
marios|ruck | chkumar|rover: there https://review.rdoproject.org/r/#/c/24224/ | 07:29 |
chkumar|rover | sweet :-) | 07:30 |
marios|ruck | chkumar|rover: yeah but just means its inconcistent if it happens again today | 07:30 |
chkumar|rover | yes, it might happen | 07:30 |
marios|ruck | chkumar|rover: something merged last few days maybe rlandy knows we can ask later (she was merging stuff last night too) | 07:30 |
chkumar|rover | https://review.rdoproject.org/r/#/c/24236/ merged right now, checking whether it fixes or not | 07:31 |
*** holser has joined #oooq | 07:31 | |
*** ccamacho has joined #oooq | 07:38 | |
marios|ruck | chkumar|rover: man still not a single green on that m*****r f*****r https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001 | 07:40 |
marios|ruck | chkumar|rover: lets see i rechecked that https://review.rdoproject.org/r/#/c/23919/ based on https://bugs.launchpad.net/tripleo/+bug/1853652/comments/32 | 07:45 |
openstack | Launchpad bug 1853652 in tripleo "openstack overcloud node provide --all-manageable timing out and failing periodic rhel-8-ovb-3ctlr_1comp-featureset001-master" [Critical,Fix committed] - Assigned to Cédric Jeanneret (cjeanner) | 07:45 |
chkumar|rover | ok | 07:45 |
chkumar|rover | brb for food | 07:45 |
marios|ruck | chkumar|rover: take your time | 07:45 |
*** ykarel is now known as ykarel|lunch | 07:47 | |
*** whoami-rajat__ is now known as whoami-rajat|lun | 07:48 | |
*** kopecmartin|off is now known as kopecmartin | 07:53 | |
marios|ruck | chkumar|rover: when back can you check https://bugs.launchpad.net/tripleo/+bug/1853978/comments/24 | 08:05 |
openstack | Launchpad bug 1853978 in tripleo "periodic train rhel8 ovb overcloud deployment failed with Could not find class ::tripleo::profile::base::neutron::ovn_metadata_agent_wrappers" [Critical,Triaged] | 08:05 |
*** soniya29 has quit IRC | 08:09 | |
*** amoralej|off is now known as amoralej | 08:14 | |
*** tosky has joined #oooq | 08:18 | |
*** jpena|off is now known as jpena | 08:22 | |
*** SurajPatil has joined #oooq | 08:29 | |
*** surpatil has quit IRC | 08:30 | |
*** surpatil has joined #oooq | 08:31 | |
*** tosky has quit IRC | 08:32 | |
*** SurajPatil has quit IRC | 08:34 | |
chkumar|rover | marios|ruck: I think I got the issue https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/roles/promote-hash/tasks/promote-secondary-distro.yaml#L7 | 08:36 |
chkumar|rover | bash -xe {{ ci_config_repo }}/ci-scripts/tripleo-upstream/promote-hash.sh is not there in https://github.com/rdo-infra/ci-config/tree/master/ci-scripts | 08:36 |
marios|ruck | ack chkumar|rover thanks, gonna file a bug for the consistent issue now cos it completely blew the master pipeline | 08:37 |
marios|ruck | lucky we got master promoted yesterday ;) | 08:37 |
chkumar|rover | https://review.rdoproject.org/r/#/c/18184/ got removed long time ago need to check what is happening there | 08:38 |
chkumar|rover | ok | 08:39 |
marios|ruck | chkumar|rover: agree on skip that then? https://bugs.launchpad.net/tripleo/+bug/1856723/comments/3 | 08:52 |
openstack | Launchpad bug 1856723 in tripleo "periodic-tripleo-ci-centos-7-standalone-full-tempest-master fails during tempest run ImagesTestJSON:test_delete_saving_image" [Critical,Triaged] | 08:52 |
chkumar|rover | yes agreed | 08:57 |
*** soniya29 has joined #oooq | 09:11 | |
chkumar|rover | marios|ruck: seen this issye OSError: [Errno 13] Permission denied: '/dlrnapi_venv' | 09:14 |
*** tosky has joined #oooq | 09:16 | |
marios|ruck | chkumar|rover: https://bugs.launchpad.net/tripleo/+bug/1856830 for the consistent issue fyi | 09:16 |
openstack | Launchpad bug 1856830 in tripleo "master-promote-consistent-to-tripleo-ci-testing times out blocks master pipeline" [Critical,Triaged] | 09:16 |
marios|ruck | chkumar|rover: hmm not sure about that seems familiar but i don't have somethign to point to for the venv thing didn't we see soemthign like that yesterday ? checking the etherpad | 09:16 |
soniya29 | chkumar|rover, marios|ruck, this bug:- https://bugs.launchpad.net/tripleo/+bug/1856723 may be a network issue as well, since it is not failing consistently. | 09:23 |
openstack | Launchpad bug 1856723 in tripleo "periodic-tripleo-ci-centos-7-standalone-full-tempest-master fails during tempest run ImagesTestJSON:test_delete_saving_image" [Critical,Triaged] | 09:23 |
marios|ruck | soniya29: ack thanks please add note on the bug if you dig there | 09:24 |
marios|ruck | soniya29: chkumar|rover: either way since this blocks master promotion we should skip with https://review.opendev.org/#/c/699624/ until the test is more stable or improved depending on the root | 09:24 |
soniya29 | chkumar|rover, marios|ruck, according to glance people the issue isn't with glance. | 09:25 |
marios|ruck | soniya29: yeah see https://bugs.launchpad.net/tripleo/+bug/1856723/comments/1 and https://bugs.launchpad.net/tempest/+bug/1713163/comments/5 | 09:27 |
openstack | Launchpad bug 1856723 in tripleo "periodic-tripleo-ci-centos-7-standalone-full-tempest-master fails during tempest run ImagesTestJSON:test_delete_saving_image" [Critical,Triaged] | 09:27 |
openstack | Launchpad bug 1713163 in tempest "test_delete_saving_image fails because image hasn't transitioned to SAVING" [Medium,Confirmed] | 09:27 |
*** apetrich has joined #oooq | 09:27 | |
marios|ruck | chkumar|rover: so... lets do it ourselves :/ posted master just now lets see https://review.rdoproject.org/r/24241 | 09:35 |
chkumar|rover | marios|ruck: ok, i am still looking into it why it is timing out | 09:36 |
chkumar|rover | consistent to tripleo ci promotoon | 09:36 |
marios|ruck | chkumar|rover: yeah maybe we get lucky | 09:36 |
marios|ruck | chkumar|rover: on the testproject but forgot sthing updating it now | 09:36 |
*** derekh has joined #oooq | 09:37 | |
marios|ruck | chkumar|rover: (consistent thing was green yesterday at https://review.rdoproject.org/r/#/c/24211/ for exmple | 09:39 |
chkumar|rover | yes it is broken tonight | 09:40 |
marios|ruck | sounds like a love song | 09:40 |
* marios|ruck re-coffee brb | 09:40 | |
*** bhagyashris has quit IRC | 09:41 | |
marios|ruck | chkumar|rover: https://review.rdoproject.org/zuul/stream/65444c6f81a04d719b8452b04b77d66c?logfile=console.log | 09:43 |
marios|ruck | chkumar|rover: gonna time out :/ | 09:43 |
marios|ruck | booooo | 09:44 |
*** ykarel|lunch is now known as ykarel | 09:44 | |
chkumar|rover | yes | 09:44 |
chkumar|rover | I donot know what is going on there | 09:44 |
*** whoami-rajat|lun is now known as whoami-rajat | 09:44 | |
*** fmount has quit IRC | 09:53 | |
*** apetrich has quit IRC | 09:58 | |
*** fmount has joined #oooq | 10:02 | |
*** tosky has quit IRC | 10:02 | |
*** tosky has joined #oooq | 10:03 | |
chkumar|rover | marios|ruck: rdo current is not consistent that's why it is happening | 10:24 |
*** bhagyashris has joined #oooq | 10:24 | |
chkumar|rover | marios|ruck: we need to improve the tooling which promotes from consisitent to current | 10:25 |
chkumar|rover | *toci testing | 10:25 |
ykarel | chkumar|rover, which release is not consistent? | 10:26 |
ykarel | it looks like all realeases are consistent to me | 10:26 |
ykarel | i checked centos7 one | 10:26 |
ykarel | ohhk rhel8-master is not consistent | 10:27 |
chkumar|rover | ykarel: it is for RHEL8 | 10:27 |
marios|ruck | ykarel: see https://bugs.launchpad.net/tripleo/+bug/1856830 | 10:27 |
openstack | Launchpad bug 1856830 in tripleo "master + train promote-consistent-to-tripleo-ci-testing times out blocks master+train pipeline" [Critical,Triaged] | 10:27 |
marios|ruck | thanks chkumar|rover | 10:27 |
ykarel | chkumar|rover, yup got it | 10:27 |
ykarel | i doubted on it | 10:27 |
chkumar|rover | ykarel: i wasted my whole morning and afternoon in that figyring out what is going on | 10:28 |
ykarel | :) | 10:28 |
ykarel | it should have straight forward, chkumar|rover logs were missing? | 10:28 |
chkumar|rover | marios|ruck: may be it would be a good rfe for rlandy or foloco | 10:28 |
chkumar|rover | ykarel: the job got timed out | 10:28 |
chkumar|rover | ykarel: http://logs.rdoproject.org/41/24241/2/check/periodic-tripleo-centos-7-master-promote-consistent-to-tripleo-ci-testing/65444c6/job-output.txt | 10:29 |
ykarel | chkumar|rover, and no logs? | 10:29 |
chkumar|rover | yes no logs after at that step | 10:29 |
ykarel | chkumar|rover, ack ^^ is bad, log should contain some info | 10:29 |
ykarel | otherwise manual check is needed | 10:29 |
ykarel | looks like there are some recent changes in that job | 10:30 |
ykarel | iirc earlier it used to print details | 10:30 |
ykarel | that commit is not found | 10:30 |
chkumar|rover | ykarel: the script is still same, just moved the script to role | 10:31 |
ykarel | or it's possible timeout of job < timeout of comparison check | 10:31 |
chkumar|rover | marios|ruck: rechecking this patch https://review.rdoproject.org/r/#/c/24241/ | 10:32 |
marios|ruck | ack chkumar|rover | 10:39 |
*** holser has quit IRC | 10:50 | |
*** holser__ has joined #oooq | 10:50 | |
ykarel | chkumar|rover, http://logs.rdoproject.org/openstack-periodic-latest-released/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-7-train-promote-consistent-to-tripleo-ci-testing/4a91560/job-output.txt | 10:51 |
ykarel | and job timedout is 2000, while that check for hash is 40 * 60=2400 | 10:52 |
ykarel | https://github.com/rdo-infra/review.rdoproject.org-config/commit/b24bc86af75611dddd3654d4e3f1a97f6d1f9d8b | 10:52 |
ykarel | https://github.com/rdo-infra/review.rdoproject.org-config/blob/adb546793c1ccc627a61faa531b52c1e74a68d9b/zuul.d/tripleo-rdo-base.yaml#L240 | 10:52 |
*** soniya29 has quit IRC | 10:53 | |
*** bhagyashris has quit IRC | 10:54 | |
chkumar|rover | added | 10:56 |
*** bhagyashris has joined #oooq | 10:58 | |
*** soniya29 has joined #oooq | 10:58 | |
*** ykarel is now known as ykarel|afk | 11:20 | |
*** holser__ has quit IRC | 11:21 | |
*** holser has joined #oooq | 11:22 | |
marios|ruck | rfolco: you might want to push the retro back 1 hour then for the meet&greet | 11:22 |
*** ykarel|afk has quit IRC | 11:30 | |
marios|ruck | so vote chkumar|rover please ? https://review.opendev.org/#/c/699624/ | 11:31 |
marios|ruck | anyone else ^^ | 11:31 |
*** jfrancoa has quit IRC | 11:32 | |
chkumar|rover | marios|ruck: done | 11:33 |
chkumar|rover | sshnaidm: marios|ruck https://review.rdoproject.org/r/#/c/24244/ vote please | 11:33 |
marios|ruck | chkumar|rover: so do we know what's blocking the rdo consistent build | 11:38 |
marios|ruck | chkumar|rover: for https://bugs.launchpad.net/tripleo/+bug/1856830 | 11:39 |
openstack | Launchpad bug 1856830 in tripleo "master + train promote-consistent-to-tripleo-ci-testing times out blocks master+train pipeline" [Critical,Triaged] | 11:39 |
marios|ruck | chkumar|rover: checking the review you point to now | 11:39 |
marios|ruck | chkumar|rover: you think timeout will help? | 11:39 |
marios|ruck | chkumar|rover: merged | 11:39 |
marios|ruck | jpena: is there something known blocking the consistent build wrt https://bugs.launchpad.net/tripleo/+bug/1856830 | 11:41 |
openstack | Launchpad bug 1856830 in tripleo "master + train promote-consistent-to-tripleo-ci-testing times out blocks master+train pipeline" [Critical,Triaged] | 11:41 |
marios|ruck | jpena: we've seen that timeout for more than a day now | 11:41 |
jpena | marios|ruck: yes, there was a build in rhel8-master that failed (oslo-rootwrap) due to a unit test timeout. It was fixed earlier today | 11:42 |
*** apetrich has joined #oooq | 11:42 | |
marios|ruck | thank you jpena | 11:44 |
*** jfrancoa has joined #oooq | 11:47 | |
*** bhagyashris has quit IRC | 11:52 | |
*** bhagyashris has joined #oooq | 11:58 | |
*** epoojad1 is now known as epoojad1|afk | 11:59 | |
*** sshnaidm has quit IRC | 12:04 | |
*** epoojad1|afk has quit IRC | 12:04 | |
chkumar|rover | jpena: still not picked byt the job | 12:09 |
jpena | chkumar|rover: hm, which hashes is it trying to pick? | 12:09 |
*** bhagyashris_ has joined #oooq | 12:09 | |
chkumar|rover | jpena: http://logs.rdoproject.org/41/24241/2/check/periodic-tripleo-centos-7-master-promote-consistent-to-tripleo-ci-testing/a9439f4/job-output.txt | 12:10 |
chkumar|rover | jpena: 9de2e41f64593017fa9ec21902356abbc88d67af for centos | 12:10 |
chkumar|rover | jpena: for RHEL it is not showing anything | 12:10 |
jpena | chkumar|rover: ok, that hash was not consistent just yet. If you check https://trunk.rdoproject.org/rhel8-master/report.html, you will see that oslo-rootwrap is just the following one | 12:12 |
jpena | so the next commit in master will be ok | 12:12 |
*** bhagyashris has quit IRC | 12:12 | |
chkumar|rover | jpena: ok | 12:12 |
jpena | (once rhel8-master builds python-hardware) | 12:13 |
*** bhagyashris_ has quit IRC | 12:13 | |
chkumar|rover | jpena: train is also not consistent https://trunk.rdoproject.org/rhel8-train/report.html | 12:14 |
chkumar|rover | https://trunk.rdoproject.org/rhel8-train/a4/f6/a4f6185f76e130b2f61f840050467bf37199d141_4450dbca/rpmbuild.log | 12:14 |
jpena | chkumar|rover: it is. There's a later openstack-selinux commit that was successfully built | 12:14 |
chkumar|rover | yes saw that | 12:14 |
rfolco | marios|ruck, I just saw meet&greet now. I'll move one hour later, retro should be shorter this time. | 12:15 |
rfolco | marios|ruck, done. | 12:16 |
rfolco | pushed 1h later and shrunk it to 2h | 12:17 |
chkumar|rover | rfolco: Hello | 12:17 |
rfolco | chkumar|rover, its me | 12:17 |
marios|ruck | rfolco: acketty | 12:17 |
chkumar|rover | rfolco: I merged one of your patch to fix one fo the timeout issye | 12:17 |
chkumar|rover | rfolco: https://bugs.launchpad.net/tripleo/+bug/1856830 | 12:18 |
openstack | Launchpad bug 1856830 in tripleo "master + train promote-consistent-to-tripleo-ci-testing times out blocks master+train pipeline" [Critical,Triaged] | 12:18 |
rfolco | chkumar|rover, my patch ? which one? or you mean rlandy? | 12:19 |
chkumar|rover | rfolco: https://review.rdoproject.org/r/#/c/24236/ | 12:20 |
*** ykarel|afk has joined #oooq | 12:21 | |
marios|ruck | chkumar|rover: ok now? https://review.rdoproject.org/r/#/c/24211/ | 12:35 |
marios|ruck | chkumar|rover: sorry | 12:35 |
marios|ruck | chkumar|rover: that is from yesterday | 12:35 |
* marios|ruck going job crazy | 12:35 | |
chkumar|rover | marios|ruck: not yet | 12:36 |
marios|ruck | chkumar|rover: rechecked https://review.rdoproject.org/r/#/c/24241/ | 12:36 |
chkumar|rover | ok | 12:36 |
marios|ruck | chkumar|rover: if the pipeline starts running i can worfklow -A to kill it assuming it works | 12:36 |
chkumar|rover | yes | 12:37 |
chkumar|rover | few hours left now | 12:37 |
marios|ruck | chkumar|rover: T - 23 mins and counting | 12:37 |
marios|ruck | \o/ | 12:37 |
marios|ruck | chkumar|rover: we will enter calls and emerge with new nicks | 12:37 |
marios|ruck | \o/ | 12:37 |
chkumar|rover | yup yup | 12:37 |
weshay | good morning / afternoon .. hey folks :) is there an issue w/ the upstream gate? | 12:39 |
marios|ruck | not that am aware of weshay | 12:40 |
weshay | k k | 12:40 |
marios|ruck | chkumar|rover: ? 14:39 < weshay> good morning / afternoon .. hey folks :) is there an issue w/ the upstream gate? | 12:40 |
marios|ruck | weshay: why you see something? | 12:40 |
*** jpena is now known as jpena|lunch | 12:41 | |
weshay | just noticed a lot of gate failures and the queue is at 15hr which is unusual these days | 12:41 |
chkumar|rover | marios|ruck: in the morning, upstream gate queue was very high 9 hrs | 12:41 |
marios|ruck | o.k. | 12:41 |
chkumar|rover | I thought it went done, people still approving patches :-( | 12:42 |
chkumar|rover | *down | 12:42 |
weshay | meet and greet in 18 min.. you can add questions to https://docs.google.com/document/d/1mXCT4N4hpjPXKZwuGoArMuD0C_vZV5ij0dkawDYK9zg/edit#heading=h.gtig1khwjqzx | 12:42 |
marios|ruck | 2019-12-18 09:27:39,826 6410 INFO promoter Promoting the container images for dlrn hash 80dcc19695f84819aec46fb3a600eca2bd90861e on stein to current-tripleo | 12:44 |
marios|ruck | chkumar|rover: \o/ stein | 12:44 |
marios|ruck | stein is very stable lately | 12:44 |
chkumar|rover | \o/ | 12:45 |
marios|ruck | chkumar|rover: rocky should follow https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-wednesday-weekend | 12:46 |
marios|ruck | chkumar|rover: but for queens it is blocked until we activate the new promoter code we should discuss on call today/handover | 12:46 |
chkumar|rover | ok | 12:46 |
chkumar|rover | marios|ruck: increasing timedout worked https://review.rdoproject.org/r/#/c/24208/ | 12:53 |
chkumar|rover | and i think we have a bug there | 12:53 |
chkumar|rover | "msg": "Unsupported parameters for (command) module: environment Supported parameters include: _raw_params, _uses_shell, argv, chdir, creates, executable, removes, stdin, warn, zuul_log_id" | 12:54 |
marios|ruck | chkumar|rover: cool... but still what changed since yesterday. well.. don't see how timeout has to do with consistent build delay | 12:54 |
chkumar|rover | marios|ruck: https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/roles/promote-hash/tasks/promote-secondary-distro.yaml#L26 and https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/roles/promote-hash/tasks/promote-secondary-distro.yaml#L46 | 12:55 |
chkumar|rover | retries and delay | 12:55 |
*** rlandy has joined #oooq | 12:57 | |
*** sshnaidm has joined #oooq | 12:58 | |
*** Goneri has quit IRC | 12:58 | |
*** marios|ruck is now known as marios|ruck|call | 13:00 | |
weshay | rfolco, can you help round folks up | 13:01 |
weshay | please | 13:01 |
*** sshnaidm has quit IRC | 13:02 | |
rfolco | weshay, joining | 13:02 |
*** sshnaidm has joined #oooq | 13:03 | |
rfolco | rlandy, sshnaidm marios|ruck|call panda arxcruz|pto zbr | 13:04 |
rfolco | https://bluejeans.com/4113567798?src=calendarLink | 13:04 |
rfolco | CI greet & meet ^ | 13:04 |
*** amoralej is now known as amoralej|lunch | 13:09 | |
*** udesale has joined #oooq | 13:11 | |
*** holser has quit IRC | 13:17 | |
*** jbadiapa has joined #oooq | 13:17 | |
*** holser has joined #oooq | 13:18 | |
*** ssbarnea has quit IRC | 13:22 | |
*** ykarel|afk is now known as ykarel | 13:36 | |
*** jpena|lunch is now known as jpena | 13:45 | |
*** Goneri has joined #oooq | 13:46 | |
*** amoralej|lunch is now known as amoralej | 13:51 | |
*** fmount has quit IRC | 13:53 | |
chkumar|rover | marios|ruck|call: How to pull all the jobs which are timing out from graphana? | 13:53 |
*** fmount has joined #oooq | 13:54 | |
marios|ruck|call | chkumar|rover: dont know | 13:56 |
sshnaidm | rfolco, weshay I will join mtg in 40 mins, sorry, need to go offline | 14:01 |
rfolco | sshnaidm, ack | 14:02 |
*** sshnaidm has quit IRC | 14:02 | |
*** udesale has quit IRC | 14:02 | |
rfolco | retro starts now at https://meet.google.com/mce-cnhy-gmk | 14:06 |
*** marios|ruck|call is now known as marios | 14:07 | |
*** marios is now known as marios|call | 14:07 | |
*** chkumar|rover is now known as chandankumar | 14:07 | |
chandankumar | times up! | 14:08 |
marios|call | chandankumar: (^^ insert coin to continue? ) | 14:08 |
chandankumar | rfolco: rlandy https://bugs.launchpad.net/tripleo/+bug/1856830 | 14:08 |
openstack | Launchpad bug 1856830 in tripleo "master + train promote-consistent-to-tripleo-ci-testing times out blocks master+train pipeline" [Critical,Triaged] | 14:08 |
rfolco | https://hackmd.io/IhMCTNMBSF6xtqiEd9Z0Kw?both | 14:10 |
rfolco | https://trello.com/b/0VFswmht/rdo-infra-retrospective?menu=filter&filter=label:UniSprint19 | 14:10 |
*** soniya29 has quit IRC | 14:17 | |
marios|call | rfolco: chandankumar: rlandy: just one question what about the cix calls then? | 14:28 |
marios|call | ;) | 14:28 |
marios|call | there is one in an hour. i will join it rlandy rfolco chandankumar | 14:28 |
*** surpatil has quit IRC | 14:29 | |
rfolco | marios|call, ack | 14:29 |
chandankumar | rlandy: http://logs.rdoproject.org/08/24208/3/check/periodic-tripleo-centos-7-master-promote-consistent-to-tripleo-ci-testing/d625814/job-output.txt | 14:38 |
chandankumar | rfolco: https://review.rdoproject.org/r/#/c/24208/ | 14:39 |
chandankumar | sorry | 14:39 |
chandankumar | rlandy: https://review.rdoproject.org/r/#/c/24208/ | 14:39 |
chandankumar | rlandy: https://review.rdoproject.org/r/#/c/24244/ | 14:40 |
chandankumar | marios|call: now it's time to open the mozito and beer | 14:42 |
chandankumar | marios|call: thank man! | 14:42 |
* chandankumar headed home | 14:42 | |
marios|call | chandankumar: thanks to you too | 14:43 |
marios|call | chandankumar: have a good one | 14:43 |
*** jrist has joined #oooq | 14:44 | |
*** marios|call is now known as marios | 14:45 | |
rlandy | https://review.rdoproject.org/r/24246 Fix spacing on secondary promote | 14:47 |
rlandy | marios: ^^ chandankumar | 14:47 |
rlandy | rfolco: ^^ | 14:49 |
rfolco | +1 | 14:49 |
rfolco | chandankumar, ^ | 14:49 |
rfolco | or marios ^ | 14:49 |
marios | rfolco: want me to merge that? | 14:50 |
marios | rlandy: rather ^ | 14:50 |
rlandy | marios: sure | 14:52 |
rlandy | chandankumar: going to rerun your testproject job | 14:52 |
rlandy | after merge | 14:52 |
*** sshnaidm has joined #oooq | 14:53 | |
*** TrevorV has joined #oooq | 14:55 | |
rlandy | marios: chandankumar: rfolco: promote secondary is fixed ... http://logs.rdoproject.org/08/24208/3/check/periodic-tripleo-centos-7-train-promote-consistent-to-tripleo-ci-testing/a891981/job-output.txt | 15:05 |
rlandy | sorry about that | 15:06 |
rfolco | nice | 15:06 |
rfolco | \o/ | 15:06 |
marios | thanks rlandy | 15:06 |
*** jfrancoa has quit IRC | 15:08 | |
*** ykarel is now known as ykarel|away | 15:11 | |
rlandy | marios: chandankumar: can I close the CIX out? | 15:12 |
marios | rlandy: which one | 15:13 |
marios | rlandy: for consistent? | 15:13 |
marios | rlandy: would like to see it run first | 15:13 |
marios | rlandy: did we have green already | 15:13 |
rlandy | marios: just in testproject - will wait until we have a pipeline run | 15:14 |
marios | rlandy: ah on my test in fact https://review.rdoproject.org/r/#/c/24241/ | 15:14 |
marios | rlandy: didn't report yet but green | 15:14 |
marios | rlandy: ack | 15:14 |
marios | rlandy: too soon to close cix but worth a comment if you wantt | 15:14 |
rlandy | marios: on https://review.rdoproject.org/r/#/c/24208/ | 15:15 |
rlandy | but you can recheck your patch | 15:15 |
marios | rlandy: already did it is still running but that one finished | 15:15 |
marios | rlandy: http://logs.rdoproject.org/41/24241/2/check/periodic-tripleo-centos-7-master-promote-consistent-to-tripleo-ci-testing/9ccab39/ | 15:15 |
marios | green ^ | 15:15 |
rlandy | marios: deceptive - still a timeout in your patch | 15:16 |
rlandy | 2019-12-18 13:18:36.804647 | rdo-centos-7 | "msg": "Unsupported parameters for (command) module: environment Supported parameters include: _raw_params, _uses_shell, argv, chdir, creates, executable, removes, stdin, warn, zuul_log_id" | 15:17 |
rlandy | whatever - the next run should be fine | 15:17 |
*** udesale has joined #oooq | 15:17 | |
*** whoami-rajat has quit IRC | 15:19 | |
chandankumar | rlandy: wat was the fix? | 15:23 |
rlandy | chandankumar: I messed up the spacing on secondary promote role | 15:23 |
chandankumar | rlandy: cool | 15:23 |
rlandy | https://review.rdoproject.org/r/24246 Fix spacing on secondary promote | 15:23 |
rlandy | fix ^^ | 15:23 |
rlandy | chandankumar: marios: am I attending the CIX call now or you guys? | 15:24 |
chandankumar | rlandy: I think marios is attending the call? | 15:24 |
*** jfrancoa has joined #oooq | 15:24 | |
rlandy | I will join anyways so I know what's happening for monday | 15:24 |
*** udesale has quit IRC | 15:25 | |
*** udesale has joined #oooq | 15:25 | |
rlandy | if I'm going, just need a heads up on status of https://trello.com/c/r8g1gG41/1270-cixlp1856278tripleociproa-rhel8-scenario-1-standalone-deployment-failed-with-the-following-containers-failed-validations-and-wer | 15:25 |
chandankumar | sshnaidm: rlandy: please donot approve patches, gates in bad state | 15:28 |
rlandy | chandankumar: something wrong or just backed up? | 15:29 |
chandankumar | sshnaidm: timeout | 15:29 |
chandankumar | rlandy: timeout, random jobs | 15:29 |
*** marios is now known as marios|call | 15:29 | |
sshnaidm | chandankumar, example? | 15:29 |
chandankumar | sshnaidm: minion ones check #tripleo channel | 15:30 |
*** panda has quit IRC | 15:31 | |
*** panda has joined #oooq | 15:33 | |
chandankumar | sshnaidm: rlandy https://bugs.launchpad.net/tripleo/+bug/1856864 | 15:34 |
openstack | Launchpad bug 1856864 in tripleo "Not all firewall rules are applied, leading to timeouts" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 15:34 |
sshnaidm | so it's still firewall module.. | 15:37 |
EmilienM | no | 15:40 |
*** holser has quit IRC | 15:40 | |
EmilienM | it's THT | 15:40 |
*** holser has joined #oooq | 15:40 | |
EmilienM | firewall module brought it up because https://review.opendev.org/699692 is needed I think | 15:40 |
rlandy | ok collect logs people ... | 15:48 |
rlandy | chandankumar: ^^ I eventually managed to sanitize the logs for redhat.com and download links ... | 15:49 |
rlandy | https://review.opendev.org/#/c/691994/ | 15:50 |
rlandy | it's WIP right now | 15:50 |
rlandy | I'll change that | 15:50 |
rlandy | think it's ready to go - see sanitized logs in https://sf.hosted.upshift.rdu2.redhat.com/logs/61/187961/1/check/tripleo-ci-rhel-8-standalone-rhos-16/f985d1a/logs/undercloud/etc/yum.repos.d/rhos-release-16-trunk.repo.txt.gz | 15:51 |
rlandy | sshnaidm: rfolco: marios|call: ^^ fyi | 15:51 |
chandankumar | rlandy: cool, will check that | 15:51 |
rlandy | chandankumar: thanks, no major rush | 15:52 |
chandankumar | tomorrow will be my last day of year here, anything to pick up? | 15:52 |
rlandy | dlrnapi --url https://trunk.rdoproject.org/api-rhel8-train --username review_rdoproject_org repo-promote --commit-hash 80cc8ed4b1d2e10e7c4a518dd4ca1a5305ed8ede --distro-hash a18d663b61419140a86d912c4c9545e8f76ff36c --promote-name tripleo-ci-testing | 15:52 |
rlandy | working now | 15:53 |
chandankumar | \o/ | 15:53 |
chandankumar | we might see master and train promotion tomorrow | 15:53 |
*** marios|call is now known as marios | 15:54 | |
rlandy | hopefully | 15:54 |
chandankumar | for master it will be needed https://review.opendev.org/#/c/699624/ | 15:54 |
chandankumar | rlandy: ^^, but gate is in bad state | 15:54 |
rlandy | chandankumar: well I'll +2 it in the mean time | 15:55 |
rlandy | no w+ | 15:55 |
chandankumar | aye | 15:55 |
rlandy | tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020 still fails | 15:55 |
*** udesale has quit IRC | 15:56 | |
chandankumar | rlandy: may be race issue | 15:56 |
chandankumar | testtools.matchers._impl.MismatchError: <bound method type.create_image_from_server of <class 'tempest.api.compute.images.test_images_oneserver_negative.ImagesOneServerNegativeTestJSON'>> returned {} | 15:57 |
marios | chandankumar: yes it is a race | 16:04 |
marios | chandankumar: its on the bug | 16:04 |
marios | chandankumar: like the state didn't finish transition to dlete yet or something | 16:05 |
marios | chandankumar: per https://bugs.launchpad.net/tripleo/+bug/1856723/comments/3 i mean or you talking about sthing else | 16:05 |
openstack | Launchpad bug 1856723 in tripleo "periodic-tripleo-ci-centos-7-standalone-full-tempest-master fails during tempest run ImagesTestJSON:test_delete_saving_image" [Critical,Triaged] | 16:05 |
chandankumar | marios: it is the same test but negative | 16:06 |
marios | chandankumar: so add it to https://review.opendev.org/#/c/699624/ | 16:06 |
chandankumar | yup | 16:06 |
*** ksambor has quit IRC | 16:07 | |
chandankumar | ok time's up see ya tomorrow | 16:10 |
chandankumar | marios: take some good sleep please ! | 16:10 |
marios | chandankumar: have a good one me almost out too | 16:10 |
marios | chandankumar: you too mate | 16:10 |
*** chandankumar is now known as raukadah | 16:10 | |
raukadah | rlandy: thank you for taking the charge | 16:10 |
*** marios is now known as marios|out | 16:15 | |
rlandy | k - I'll add that test | 16:19 |
*** marios|out has quit IRC | 16:26 | |
sshnaidm | rlandy, what does sanitize_lines valie look like? | 16:39 |
rlandy | sshnaidm: see example https://code.engineering.redhat.com/gerrit/#/c/184172/11/config/release/rhos-16.yml | 16:40 |
rlandy | could really be anything | 16:40 |
rlandy | was just experimenting with the ability to sanitize log strings | 16:40 |
sshnaidm | rlandy, ack, can you please add it to readme? | 16:40 |
rlandy | yep - will do | 16:40 |
rlandy | raukadah: updated skip list to add second failing test ... https://review.opendev.org/699624 | 16:44 |
*** kopecmartin is now known as kopecmartin|off | 16:58 | |
*** dtrainor has quit IRC | 17:08 | |
*** dtrainor has joined #oooq | 17:08 | |
rfolco | rlandy, https://review.rdoproject.org/r/24250 | 17:16 |
rfolco | rlandy, fix yaml criteria loading | 17:16 |
rfolco | for promote to current-tripleo | 17:16 |
rlandy | need to run out for a few - will look when I get back | 17:17 |
rlandy | rfolco: ^^ | 17:17 |
*** rlandy is now known as rlandy|brb | 17:17 | |
rfolco | k | 17:18 |
*** ykarel|away has quit IRC | 17:26 | |
*** jpena is now known as jpena|off | 17:36 | |
*** panda has quit IRC | 17:36 | |
*** panda has joined #oooq | 17:39 | |
raukadah | rfolco: can you point me the standlone job running in component promotion? | 17:39 |
*** ssbarnea has joined #oooq | 17:40 | |
rfolco | raukadah, https://review.rdoproject.org/zuul/builds?pipeline=openstack-component-compute | 17:41 |
rfolco | raukadah, https://review.rdoproject.org/zuul/builds?pipeline=openstack-component-keystone | 17:41 |
raukadah | rfolco: ah good, we need to fix the tempest tests there | 17:43 |
rfolco | raukadah, cool | 17:44 |
*** rlandy|brb is now known as rlandy | 17:46 | |
rlandy | raukadah: pls check https://review.opendev.org/#/c/699624/ | 17:47 |
raukadah | rlandy: done | 17:48 |
rlandy | rerunning the train failures | 17:49 |
rlandy | hopefully we get a rhel train promotion | 17:49 |
raukadah | rlandy: yes | 17:49 |
raukadah | rlandy: if fs01 is excluded, fs01 master /train was a nightmare for me and marios | 17:50 |
rlandy | raukadah: let's see how that one goes | 17:50 |
rlandy | periodic-tripleo-ci-rhel-8-scenario001-standalone-train | 17:50 |
rlandy | ^^ rerunning | 17:50 |
raukadah | rdo people added c8 based jobs for packstack, we will be picking in new year | 17:51 |
rlandy | "The following containers failed validations and were not started: collectd" | 17:51 |
rlandy | 2019-12-18 16:56:25 | ] | 17:51 |
raukadah | rlandy: awesome | 17:51 |
rlandy | ^^ that may be real error | 17:51 |
rlandy | from CIX | 17:52 |
raukadah | rlandy: https://review.opendev.org/#/c/699438/ | 17:52 |
raukadah | is the fix hunted down due to gate issue | 17:52 |
rlandy | raukadah: k - let's recheck that | 17:52 |
raukadah | our friend Tengu is fixing a lot of selinux issue, he is our selinux expert after daniel walsh in tripleo land | 17:53 |
rlandy | raukadah: restoring https://review.opendev.org/#/c/699438/ | 17:53 |
raukadah | cool | 17:53 |
rlandy | the scenario 1 failure is https://trello.com/c/r8g1gG41/1270-cixlp1856278tripleociproa-rhel8-scenario-1-standalone-deployment-failed-with-the-following-containers-failed-validations-and-wer | 17:54 |
rlandy | ok - so no promotion | 17:55 |
rlandy | sorry | 17:55 |
*** chem_ has quit IRC | 17:55 | |
raukadah | fs01 train rhel8 is a circle | 17:56 |
rlandy | when we get that fix, it should be ok | 17:57 |
raukadah | no idea | 17:57 |
rlandy | at least it's not my fault this time | 17:58 |
raukadah | rfolco: rlandy sshnaidm : Did you stocked mozitoo and beer for holiday celebration? | 17:58 |
sshnaidm | raukadah, for Hanukkah? | 17:59 |
rlandy | raukadah: not much of a drinker, sorry | 17:59 |
rlandy | raukadah: it's more like an eating holiday for us | 17:59 |
raukadah | I am emptying my freeze today as I will not drink at home as my sister will kill me | 17:59 |
rlandy | lots of oil | 17:59 |
raukadah | sshnaidm: yes | 17:59 |
raukadah | rlandy: oil? | 18:00 |
raukadah | you mean in fish or chicken or veggy? | 18:00 |
sshnaidm | we drink from HeBrewery | 18:01 |
rlandy | traditionally olive oil | 18:01 |
rlandy | but these days mostly donuts | 18:02 |
raukadah | I love oil when it comes to this https://en.wikipedia.org/wiki/Puri_(food) | 18:02 |
raukadah | I love a lot | 18:02 |
raukadah | sshnaidm: HeBrewery ? | 18:02 |
raukadah | Does brewery have a gender? | 18:03 |
sshnaidm | raukadah, hebrew brewery :) | 18:03 |
raukadah | sshnaidm: :-) | 18:03 |
rlandy | ha - fs01 rhel train is on tempest tests | 18:04 |
raukadah | sshnaidm: it is a beer, not wine | 18:04 |
*** derekh has quit IRC | 18:04 | |
sshnaidm | raukadah, yeah | 18:04 |
* raukadah will ask for the same in wine shop tomorrow evening | 18:04 | |
sshnaidm | rlandy, one more reason to celebrate.. | 18:04 |
sshnaidm | nes hanukkah :) | 18:05 |
raukadah | rlandy: does not say tempest failed on fs01 | 18:05 |
rlandy | it's still running | 18:05 |
*** rfolco has quit IRC | 18:07 | |
raukadah | sshnaidm: by the way, contributing to podman is fun, they believe a lot on contributors | 18:07 |
raukadah | last systemd does not fixed the issye, there is an issue with makefile find string still | 18:07 |
raukadah | I realized late | 18:08 |
sshnaidm | raukadah, is it issue with building rpm? | 18:08 |
raukadah | there is no issue just the message | 18:09 |
sshnaidm | I see | 18:09 |
raukadah | sshnaidm: https://github.com/containers/libpod/blob/master/Makefile#L45 | 18:09 |
rlandy | waiting for log collection is like watching a pot boil | 18:10 |
raukadah | may be above makefile issue | 18:10 |
raukadah | rlandy: write a async bot to deal with finger protocol | 18:10 |
raukadah | idea is nice, /me thinking how to parse finger stdout in runtime to remind at particular failure | 18:12 |
raukadah | sshnaidm: this holiday I want to work on this https://github.com/containers/libpod/issues/713 may be it will solve rlandy rfolco and marios issue | 18:14 |
rlandy | which issue? | 18:15 |
sshnaidm | raukadah, nice | 18:16 |
sshnaidm | raukadah, it's weird no gerrit plugins with job finish notifications | 18:16 |
raukadah | rlandy: manifest one https://github.com/containers/libpod/issues/713 buildah has support for that | 18:16 |
raukadah | sshnaidm: tweet gerrrit review they are quite responsive | 18:16 |
*** yolanda__ is now known as yolanda | 18:18 | |
rlandy | what happened to rfolco? | 18:18 |
rlandy | he run away | 18:19 |
rlandy | right when I am ready to merge his work | 18:19 |
raukadah | sshnaidm: regarding docker compose review on reproducer , you are using kompose to comnvert docker-compose.yaml to k8s yaml to work with podman as I saw some shell scripts | 18:19 |
raukadah | ? | 18:19 |
sshnaidm | raukadah, we tried kompose, didn't work in our case :( so we use podman pods | 18:19 |
sshnaidm | raukadah, and podman pod config you can dump to k8s with "generate-kube" or kind of | 18:20 |
raukadah | sshnaidm: I used to know few kompose devs but nolonger work in RH | 18:20 |
sshnaidm | raukadah, there is also podman-compose, but it doesn't work as well.. | 18:20 |
* raukadah not looked at podman-compose, will poke on that | 18:21 | |
raukadah | rlandy: regarding current promote hash shell script I was thinking to use this https://nox.thea.codes/en/stable/ | 18:22 |
raukadah | activate dlrn venv part basically | 18:23 |
*** tosky has quit IRC | 18:23 | |
rlandy | raukadah: I am not breaking promotions again this year - nice idea for next time | 18:23 |
raukadah | sshnaidm: thanks :-) | 18:23 |
raukadah | rlandy: sshnaidm next year is going to be fun as zuul + jenkins stuff | 18:24 |
raukadah | from downstream CI | 18:25 |
rlandy | raukadah: periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-train success | 18:25 |
raukadah | w00t | 18:25 |
sshnaidm | raukadah, I hope we'll use our downstream Zuul more and more | 18:25 |
rlandy | waiting on the master run | 18:25 |
raukadah | rlandy: Tengu will be happy by seeing this | 18:26 |
rlandy | sshnaidm: just fyi - wrote this over thanksgiving to get rid of rhel containers on docker https://review.rdoproject.org/r/#/c/23894/ | 18:27 |
rlandy | tox failure due to my commenting out | 18:27 |
rlandy | been waiting for weshay to approve it | 18:27 |
*** Goneri has quit IRC | 18:28 | |
rlandy | ok - we have a gate queue again | 18:28 |
raukadah | sshnaidm: rlandy I got the permission from dwalsh, let;s implement and use it and then curse podman more | 18:28 |
weshay | rlandy, this one? https://review.rdoproject.org/r/#/c/23894/2/ci-scripts/infra-cleanup/container-trimming.py | 18:28 |
raukadah | manifest one | 18:28 |
rlandy | oh hey weshay is alive | 18:28 |
weshay | 0/ | 18:28 |
raukadah | weshay: \o/ | 18:28 |
rlandy | weshay: git more urgtent stuff for you to look at | 18:28 |
rlandy | urgent | 18:28 |
weshay | rlandy, point at what you need | 18:28 |
sshnaidm | rlandy, nice! did you run it? | 18:28 |
raukadah | weshay: I will be spending some cycle on this https://github.com/containers/libpod/issues/713 to get rid of docker | 18:29 |
rlandy | sshnaidm: yeah - without the delete so it just prints out what it deletes | 18:29 |
sshnaidm | raukadah, implement what? | 18:29 |
raukadah | sshnaidm: https://github.com/containers/libpod/issues/713 | 18:29 |
rlandy | weshay: downstream pipeline in action | 18:29 |
weshay | rlandy, oh nice! | 18:29 |
rlandy | weshay: got the log sanitize working | 18:29 |
rlandy | so we are ready to work on reporting | 18:30 |
rlandy | ie: downstream cockpit | 18:30 |
rlandy | weshay: you back on friday? | 18:30 |
weshay | aye | 18:30 |
rlandy | weshay: ok - will chat then | 18:30 |
weshay | ah cool! | 18:30 |
rlandy | need to confirm which strings to get rid of | 18:30 |
rlandy | and then add reports | 18:31 |
rlandy | https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?pipeline=openstack-component-compute | 18:31 |
rlandy | https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?pipeline=openstack-component-keystone | 18:31 |
raukadah | weshay: I like podman, we as a team can make to impact there and make tripleo and friends awesome, if you allow | 18:31 |
weshay | nice work rlandy++ | 18:32 |
weshay | raukadah, /me reads through that | 18:32 |
raukadah | rlandy: is it possible to send downstream job status to upstream cockpit? | 18:34 |
rlandy | raukadah: that is my next move | 18:34 |
rlandy | we need to get the log sanitize patch through first | 18:35 |
rlandy | working on it | 18:35 |
*** amoralej is now known as amoralej|off | 18:44 | |
*** rfolco has joined #oooq | 18:52 | |
*** sshnaidm is now known as sshnaidm|afk | 18:58 | |
*** chem_ has joined #oooq | 19:12 | |
*** chem_ has quit IRC | 19:18 | |
*** chem_ has joined #oooq | 19:21 | |
*** holser has quit IRC | 19:24 | |
*** chem_ has quit IRC | 19:26 | |
*** chem_ has joined #oooq | 19:27 | |
*** jbadiapa has quit IRC | 19:31 | |
*** Goneri has joined #oooq | 19:37 | |
*** chem_ has quit IRC | 19:52 | |
*** chem_ has joined #oooq | 19:57 | |
Tengu | raukadah: no way I can be compared to Dan for SELinux o_O | 20:12 |
Tengu | raukadah: I'm just playing around and gnawing some dry bones ^^' | 20:13 |
*** rf0lc0 has joined #oooq | 20:15 | |
*** rfolco has quit IRC | 20:17 | |
*** rf0lc0 has quit IRC | 20:41 | |
rlandy | Tengu: we appreciate those willing to gnaw at dry selinux bones to fix bugs | 20:52 |
*** holser has joined #oooq | 20:54 | |
*** rf0lc0 has joined #oooq | 21:26 | |
*** rf0lc0 has quit IRC | 21:26 | |
rlandy | train is promoting | 21:27 |
weshay | woot | 21:31 |
*** saneax has quit IRC | 21:55 | |
*** TrevorV has quit IRC | 22:10 | |
*** jfrancoa has quit IRC | 22:10 | |
*** chem_ has quit IRC | 22:11 | |
*** saneax has joined #oooq | 22:54 | |
*** holser has quit IRC | 23:09 | |
*** rlandy is now known as rlandy|bbl | 23:11 | |
*** ccamacho has quit IRC | 23:23 | |
*** saneax has quit IRC | 23:24 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!