rdogerrit | rdo-trunk proposed rdoinfo master: Bump rdoinfo pike tags to latest upper-constraints https://review.rdoproject.org/r/14649 | 00:06 |
---|---|---|
rdogerrit | rdo-trunk proposed rdoinfo master: Bump rdoinfo rocky-uc tags to latest upper-constraints https://review.rdoproject.org/r/14650 | 00:06 |
*** imcsk8 has quit IRC | 00:07 | |
rdogerrit | rdo-trunk created rdoinfo master: Promote CBS tags update for pike-testing https://review.rdoproject.org/r/14774 | 00:07 |
*** imcsk8 has joined #rdo | 00:07 | |
rdogerrit | rdo-trunk created rdoinfo master: Promote CBS tags update for ocata-testing https://review.rdoproject.org/r/14775 | 00:07 |
rdogerrit | rdo-trunk proposed rdoinfo master: Promote CBS tags update for queens-testing https://review.rdoproject.org/r/14698 | 00:08 |
*** imcsk8 has quit IRC | 00:20 | |
*** imcsk8 has joined #rdo | 00:20 | |
*** agopi has quit IRC | 00:34 | |
*** pradk has joined #rdo | 00:39 | |
*** rnoriega has quit IRC | 01:02 | |
rdogerrit | Merged config master: Do not allow jobs to inherit config-update job https://review.rdoproject.org/r/14769 | 01:03 |
*** Amita has joined #rdo | 01:03 | |
*** lhinds has quit IRC | 01:04 | |
*** edmondsw has joined #rdo | 01:05 | |
*** faceman has quit IRC | 01:05 | |
*** edmondsw has quit IRC | 01:09 | |
*** agopi has joined #rdo | 01:12 | |
*** rnoriega has joined #rdo | 01:16 | |
*** faceman has joined #rdo | 01:17 | |
*** lhinds has joined #rdo | 01:19 | |
*** rpioso is now known as rpioso|afk | 01:19 | |
*** kgiusti has joined #rdo | 01:24 | |
*** kgiusti has left #rdo | 01:24 | |
*** paragan has quit IRC | 01:40 | |
*** Amita has quit IRC | 01:40 | |
*** mmercer has quit IRC | 01:42 | |
*** dneary has joined #rdo | 02:09 | |
*** rh-jelabarre has joined #rdo | 02:21 | |
*** imcsk8 has quit IRC | 02:28 | |
*** imcsk8 has joined #rdo | 02:28 | |
*** rlandy|bbl has quit IRC | 02:30 | |
*** paragan has joined #rdo | 02:38 | |
*** rh-jelabarre has quit IRC | 02:42 | |
*** paragan has quit IRC | 02:45 | |
*** edmondsw has joined #rdo | 02:53 | |
*** edmondsw has quit IRC | 02:57 | |
*** paragan has joined #rdo | 02:58 | |
*** noslzzp has quit IRC | 02:58 | |
*** eck` is now known as eck`gone | 02:59 | |
*** akrivoka has quit IRC | 03:02 | |
*** akrivoka has joined #rdo | 03:03 | |
*** dneary has quit IRC | 03:09 | |
*** sshnaidm|bbl has quit IRC | 03:16 | |
*** Son_Goku has joined #rdo | 03:22 | |
*** sshnaidm|bbl has joined #rdo | 03:29 | |
*** lkuchlan has joined #rdo | 03:36 | |
*** ramishra has joined #rdo | 03:39 | |
*** cshastri has joined #rdo | 03:40 | |
*** udesale has joined #rdo | 03:49 | |
*** ykarel|away has joined #rdo | 03:56 | |
*** Amita has joined #rdo | 03:58 | |
*** ramishra has quit IRC | 03:59 | |
*** ykarel|away is now known as ykarel | 04:00 | |
ykarel | sshnaidm|bbl, 2018-07-11 02:04:56.429436 | tripleo-ovb-centos-7 | Permission denied (publickey,gssapi-keyex,gssapi-with-mic). | 04:01 |
ykarel | looks like either key is changed or is wrong | 04:01 |
ykarel | all jobs for queens/master reporting success, so it would attempt false promotion(without images) | 04:07 |
ykarel | https://trunk.rdoproject.org/api-centos-queens/api/civotes_detail.html?commit_hash=f84ce61bb1e7f9cd62c73cc8c14f01644989c279&distro_hash=1346e2175b5ec58f1fabb08ded575146837f7116 | 04:07 |
ykarel | https://trunk-primary.rdoproject.org/api-centos-master-uc/api/civotes_detail.html?commit_hash=e0c5c24e3bca25349894b8055589d88a16f4b894&distro_hash=0d0d3bed9a284009a1f15598bc52cfffc044f0ae | 04:08 |
*** shreshtha_ has joined #rdo | 04:08 | |
ykarel | chkumar|ruck, ^^ | 04:08 |
*** shreshtha_ has quit IRC | 04:08 | |
*** shreshtha has joined #rdo | 04:09 | |
*** Son_Goku has quit IRC | 04:18 | |
*** ykarel is now known as ykarel|afk | 04:31 | |
*** ykarel|afk has quit IRC | 04:35 | |
*** lkuchlan has quit IRC | 04:37 | |
*** ramishra has joined #rdo | 04:51 | |
*** imcsk8 has quit IRC | 04:52 | |
*** imcsk8 has joined #rdo | 04:52 | |
*** kopecmartin has joined #rdo | 04:56 | |
*** imcsk8 has quit IRC | 04:59 | |
*** imcsk8 has joined #rdo | 05:00 | |
*** Eran_Kuris has quit IRC | 05:00 | |
*** links has joined #rdo | 05:03 | |
*** ykarel|afk has joined #rdo | 05:03 | |
*** hamzy has quit IRC | 05:17 | |
*** gvrangan has joined #rdo | 05:30 | |
*** colonwq has quit IRC | 05:31 | |
*** colonwq has joined #rdo | 05:33 | |
*** janki has joined #rdo | 05:37 | |
*** hamzy has joined #rdo | 05:40 | |
*** holser_ has joined #rdo | 05:44 | |
chkumar|ruck | ykarel|afk: Are we going to use the same bug or different one for this one? | 05:44 |
*** ykarel|afk is now known as ykarel | 05:44 | |
ykarel | chkumar|ruck, i guess it's same as it's not fixed yet | 05:45 |
chkumar|ruck | ykarel: http://logs.rdoproject.org/openstack-periodic-24hr/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-pike-upload/59f55e6/logs/undercloud/home/zuul/overcloud_image_build.log.txt.gz | 05:48 |
chkumar|ruck | ykarel: 1:facter-2.4.4-4.el7.x86_64: [Errno 256] No more mirrors to try. | 05:48 |
*** Amita has quit IRC | 05:49 | |
ykarel | looks like a mirror issue, as this package is available | 05:49 |
chkumar|ruck | ykarel: it is a failure from 24 hour periodic one | 05:49 |
chkumar|ruck | ykarel: do we need to track or report? | 05:49 |
*** rbartal has joined #rdo | 05:50 | |
rdogerrit | Yatin Karel created openstack/cinder-distgit rpm-master: Enabled doc build and add sphinxcontrib-apidoc BR https://review.rdoproject.org/r/14776 | 05:52 |
ykarel | chkumar|ruck, may be there is already a bug for it | 05:52 |
chkumar|ruck | ykarel: http://logs.openstack.org/85/564285/29/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/003d01b/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-07-11_01_27_19 | 05:53 |
chkumar|ruck | it is from noop gate jobs | 05:53 |
ykarel | chkumar|ruck, no idea, | 05:54 |
ykarel | but similar issues have been earlier also | 05:54 |
ykarel | may be ceph deployment | 05:55 |
ykarel | u need to dig in logs | 05:55 |
*** mosulica has joined #rdo | 05:56 | |
*** brault has quit IRC | 05:57 | |
chkumar|ruck | ykarel: got that http://logs.openstack.org/85/564285/29/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/003d01b/logs/undercloud/var/log/mistral/ceph-install-workflow.log.txt.gz#_2018-07-11_01_26_34_125 | 05:58 |
rdogerrit | Yatin Karel created openstack/keystone-distgit rpm-master: Enabled doc build and add sphinxcontrib-apidoc BR https://review.rdoproject.org/r/14777 | 05:58 |
ykarel | chkumar|ruck, hmm, which release job is this | 05:58 |
chkumar|ruck | ykarel: it is for stable/pike | 05:59 |
chkumar|ruck | ykarel: https://bugs.launchpad.net/tripleo/+bug/1752874 | 06:00 |
openstack | Launchpad bug 1752874 in tripleo ""Get https://registry-1.docker.io/v2/: dial tcp: lookup registry-1.docker.io on 127.0.0.1:53: server misbehaving" while Trying to pull repository docker.io/ceph/daemon " [Critical,Fix released] - Assigned to John Trowbridge (trown) | 06:00 |
*** ianw is now known as ianw_pto | 06:00 | |
ykarel | chkumar|ruck, looks same | 06:01 |
*** jtomasek has quit IRC | 06:01 | |
*** mosulica has quit IRC | 06:02 | |
*** mosulica has joined #rdo | 06:03 | |
*** mosulica has joined #rdo | 06:05 | |
ykarel | chkumar|ruck, --set "ceph_namespace=docker.io/ceph" \ | 06:05 |
ykarel | as per that patch it should be local registry | 06:05 |
chkumar|ruck | ykarel: but it is not happening here | 06:07 |
*** ksambor has joined #rdo | 06:08 | |
ykarel | docker_ceph_namespace should be set correctly | 06:09 |
*** Eran_Kuris has joined #rdo | 06:10 | |
*** sbulage has joined #rdo | 06:10 | |
*** radeks has joined #rdo | 06:11 | |
rdogerrit | Yatin Karel proposed openstack/keystone-distgit rpm-master: Enabled doc build and add sphinxcontrib-apidoc BR https://review.rdoproject.org/r/14777 | 06:14 |
*** jchhatbar has joined #rdo | 06:14 | |
ykarel | chkumar|ruck, do you who takes care for dashboards and xstatic- dependencies in fedora, heat-dashboard added new requirements:- https://review.openstack.org/#/c/551288/14/requirements.txt | 06:16 |
ykarel | and puppet ci is failing | 06:16 |
*** quiquell has joined #rdo | 06:17 | |
*** janki has quit IRC | 06:18 | |
*** agurenko has joined #rdo | 06:18 | |
ykarel | number80, ^^ | 06:18 |
*** egonzalez has joined #rdo | 06:20 | |
*** florianf has joined #rdo | 06:25 | |
*** cylopez has joined #rdo | 06:27 | |
*** med__ has joined #rdo | 06:27 | |
*** hamzy has quit IRC | 06:27 | |
*** hamzy_ has joined #rdo | 06:27 | |
*** medberry has quit IRC | 06:27 | |
*** brault has joined #rdo | 06:31 | |
*** cNilesh has joined #rdo | 06:32 | |
*** pkovar has joined #rdo | 06:34 | |
*** dhill_ has quit IRC | 06:39 | |
*** udesale has quit IRC | 06:40 | |
*** lvdombrkr has joined #rdo | 06:41 | |
*** hseipp has joined #rdo | 06:42 | |
*** udesale has joined #rdo | 06:42 | |
*** jfrancoa has joined #rdo | 06:44 | |
*** aufi has joined #rdo | 06:45 | |
quiquell | pabelanger: Good morning | 06:47 |
quiquell | pabelanger: How do I get permissions to put graphs here ? https://review.rdoproject.org/grafana/dashboard/db/tripleo-ci-monitoring?orgId=1 | 06:47 |
*** Amita has joined #rdo | 06:49 | |
chkumar|ruck | ykarel: xstatic was handled by MrAbaddon earlier, I donot know the current owner | 06:49 |
chkumar|ruck | sorry | 06:49 |
chkumar|ruck | mrunge_: | 06:49 |
mrunge_ | chkumar|ruck: hmm? | 06:50 |
mrunge_ | chkumar|ruck: best person to ask re xstatic is rdopiera these days. | 06:50 |
mrunge_ | ykarel^^ | 06:50 |
chkumar|ruck | mrunge_: thanks :-) | 06:50 |
*** mrunge_ is now known as mrunge | 06:50 | |
*** dhill_ has joined #rdo | 06:53 | |
*** tshefi has joined #rdo | 06:53 | |
ykarel | mrunge, ack | 06:57 |
*** mosulica has quit IRC | 07:02 | |
*** ccamacho has joined #rdo | 07:02 | |
*** shardy has joined #rdo | 07:02 | |
*** shardy has quit IRC | 07:03 | |
*** shardy has joined #rdo | 07:04 | |
*** rbartal has quit IRC | 07:04 | |
chkumar|ruck | ykarel: https://github.com/openstack/tripleo-quickstart-extras/commit/b3794ff03ab841bbbc15a339e35a7ec02b193111 this commit changed the stuff | 07:06 |
ykarel | chkumar|ruck, ack | 07:08 |
*** mosulica has joined #rdo | 07:10 | |
*** jlibosva has joined #rdo | 07:11 | |
*** tesseract has joined #rdo | 07:12 | |
*** lkuchlan has joined #rdo | 07:16 | |
*** jmlowe has quit IRC | 07:17 | |
*** peereb has joined #rdo | 07:17 | |
*** gkadam has joined #rdo | 07:20 | |
*** jcoufal has joined #rdo | 07:25 | |
*** lkuchlan has quit IRC | 07:29 | |
*** lkuchlan has joined #rdo | 07:29 | |
*** lkuchlan is now known as lkuchlan_wfh | 07:29 | |
*** emalikov has joined #rdo | 07:33 | |
*** amoralej|off is now known as amoralej | 07:34 | |
amoralej | good morning | 07:34 |
ykarel | o/ | 07:37 |
*** tosky has joined #rdo | 07:37 | |
quiquell | hello there | 07:37 |
quiquell | amoralej: Do you know how to write grafan stuff here https://review.rdoproject.org/grafana/dashboard/db/tripleo-ci-monitoring?orgId=1 | 07:38 |
amoralej | quiquell, i don't but there may be some examples in review.r.o | 07:40 |
amoralej | let me check | 07:40 |
*** jchhatbar has quit IRC | 07:40 | |
*** janki has joined #rdo | 07:40 | |
quiquell | amoralej: It just go there by commits, or we can also have write permissions to experment stuff ? | 07:40 |
amoralej | i dunno | 07:41 |
amoralej | i didn't play with it | 07:41 |
quiquell | amoralej: Will wait for pabelanger | 07:41 |
quiquell | amoralej: thanks | 07:41 |
amoralej | maybe tristanC knows about | 07:41 |
quiquell | tristanC: You there ? | 07:42 |
quiquell | amoralej: Also I see there is a moderm grafana here https://softwarefactory-project.io/grafana/ | 07:42 |
quiquell | This is not related to RDO ? | 07:42 |
amoralej | wdym? | 07:43 |
*** holser_ has quit IRC | 07:43 | |
quiquell | amoralej: Don't know... just checking what grafanas we have | 07:43 |
amoralej | grafana is included in softwarefactory | 07:44 |
amoralej | but the version of softwarefactory in review.r.o and in sf.io are different | 07:44 |
amoralej | sf.io is newer | 07:44 |
*** ykarel is now known as ykarel|lunch | 07:49 | |
quiquell | amoralej: The plan is moving review.r.o to sf.io ? or update review.r.o ? | 07:50 |
amoralej | quiquell, we have moved zuul and nodepool already | 07:51 |
*** abregman has joined #rdo | 07:51 | |
amoralej | but we are keeping gerrit in review.r.o and i guess grafana also | 07:51 |
amoralej | about updating it, i'm not sure about the plan | 07:51 |
*** fbo|off is now known as fbo | 07:53 | |
rdogerrit | Merged rdoinfo master: Add local dep to python-flask-restful https://review.rdoproject.org/r/14756 | 07:56 |
*** jpich has joined #rdo | 07:56 | |
*** holser_ has joined #rdo | 07:57 | |
*** MrAbaddon has quit IRC | 07:58 | |
*** pkovar has quit IRC | 07:59 | |
amoralej | number80, fyi i got a failed build in x86_64 in python-kubernetes https://koji.fedoraproject.org/koji/taskinfo?taskID=28122507 | 08:00 |
amoralej | with the same issue of multithreading | 08:00 |
*** rdopiera has joined #rdo | 08:01 | |
*** rcernin has quit IRC | 08:03 | |
*** apevec has joined #rdo | 08:03 | |
*** apevec has quit IRC | 08:03 | |
*** apevec has joined #rdo | 08:03 | |
tristanC | amoralej: quiquell: rdoproject is using sf-2.7 which doesn't support user define grafs. To update https://review.rdoproject.org/grafana/dashboard you'll have to ask an admin to crete new graphs | 08:03 |
tristanC | amoralej: quiquell: then, when we update rdoproject to sf-3.1, you'll be able to manage grafs from the config repo, e.g.: https://softwarefactory-project.io/cgit/config/tree/metrics/job.yaml.example | 08:04 |
quiquell | tristanC: Do you know if we are going to be able to use plugins ? | 08:05 |
amoralej | thanks tristanC | 08:05 |
*** racedo has joined #rdo | 08:09 | |
*** pkovar has joined #rdo | 08:09 | |
rdogerrit | rdo-trunk created openstack/monascaclient-distgit rpm-master: python-monascaclient: failed to build f0be78d https://review.rdoproject.org/r/14778 | 08:17 |
*** derekh has joined #rdo | 08:21 | |
rdogerrit | Merged rdoinfo master: Promote CBS tags update for pike-testing https://review.rdoproject.org/r/14774 | 08:23 |
*** ktibi has joined #rdo | 08:23 | |
*** paramite has joined #rdo | 08:27 | |
*** ragiman has joined #rdo | 08:31 | |
*** fbo has quit IRC | 08:33 | |
*** fbo has joined #rdo | 08:34 | |
*** shreshtha has quit IRC | 08:35 | |
*** shreshtha_ has joined #rdo | 08:35 | |
*** fbo has quit IRC | 08:37 | |
*** fbo has joined #rdo | 08:38 | |
*** panda|off is now known as panda | 08:40 | |
rdogerrit | Alfredo Moralejo proposed rdoinfo master: Promote CBS tags update for queens-testing https://review.rdoproject.org/r/14698 | 08:42 |
*** fbo has quit IRC | 08:43 | |
*** fbo has joined #rdo | 08:43 | |
*** fbo has quit IRC | 08:44 | |
*** fbo has joined #rdo | 08:44 | |
number80 | amoralej: same multiprocessing.pool leak issue | 08:45 |
amoralej | yes | 08:45 |
number80 | should be rarer to have it on x86_64 though | 08:45 |
amoralej | yes | 08:46 |
amoralej | i hit it just once | 08:46 |
amoralej | and fewer tests failed | 08:46 |
*** quiquell is now known as alfread | 08:47 | |
amoralej | i wonder if we could limit the number of threads in a pool | 08:47 |
*** alfread is now known as quiquell | 08:47 | |
*** ykarel|lunch is now known as ykarel | 08:47 | |
*** gvrangan has quit IRC | 08:50 | |
*** jtomasek has joined #rdo | 08:51 | |
number80 | You can, but it'd be faster to fix the pools leak | 08:51 |
number80 | tests do not close the pool they create at teardown | 08:51 |
*** pblaho has joined #rdo | 08:53 | |
*** rbartal has joined #rdo | 09:01 | |
*** gvrangan has joined #rdo | 09:02 | |
*** MrAbaddon has joined #rdo | 09:03 | |
*** gvrangan has quit IRC | 09:03 | |
*** pkovar has quit IRC | 09:03 | |
*** gvrangan has joined #rdo | 09:04 | |
*** gvrangan has quit IRC | 09:05 | |
*** gvrangan has joined #rdo | 09:06 | |
*** gvrangan has quit IRC | 09:07 | |
*** avivgt has joined #rdo | 09:07 | |
*** gvrangan has joined #rdo | 09:08 | |
*** Goneri has joined #rdo | 09:09 | |
rdogerrit | Moisés Guimarães de Medeiros created rdoinfo master: Promote python-flask-restful to -testing https://review.rdoproject.org/r/14779 | 09:10 |
chkumar|ruck | sshnaidm|bbl: Hey, Please have a look at this one https://bugs.launchpad.net/tripleo/+bug/1780726 permission denied issue | 09:30 |
openstack | Launchpad bug 1780726 in tripleo "[master][queens][pike][ocata] Base periodic jobs are broken after zuul v3 migration " [Critical,Fix released] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 09:30 |
*** sbulage is now known as sbulage|mtg | 09:33 | |
*** mosulica has quit IRC | 09:36 | |
*** mosulica has joined #rdo | 09:37 | |
*** gvrangan_odl has joined #rdo | 09:39 | |
*** gvrangan_odl has quit IRC | 09:40 | |
*** gvrangan_odl has joined #rdo | 09:41 | |
*** gvrangan has quit IRC | 09:41 | |
*** gvrangan_odl has quit IRC | 09:42 | |
*** gvrangan_odl has joined #rdo | 09:43 | |
*** gvrangan_odl has quit IRC | 09:44 | |
*** gvrangan_odl has joined #rdo | 09:44 | |
*** sshnaidm|bbl is now known as sshnaidm|rover | 09:45 | |
sshnaidm|rover | chkumar|ruck, not sure, but maybe it was revoked.. | 09:47 |
*** jmlowe has joined #rdo | 09:50 | |
*** sbulage|mtg is now known as sbulage | 09:54 | |
*** assassin has joined #rdo | 09:56 | |
*** paragan has quit IRC | 09:57 | |
*** sbulage is now known as sbulage|mtg | 10:04 | |
*** dneary has joined #rdo | 10:06 | |
*** jmlowe has quit IRC | 10:11 | |
*** dneary has quit IRC | 10:12 | |
*** pradk has quit IRC | 10:27 | |
rdogerrit | Arx Cruz created rdoinfo master: Add stackviz package https://review.rdoproject.org/r/14780 | 10:36 |
rdogerrit | Arx Cruz proposed rdoinfo master: Add stackviz package https://review.rdoproject.org/r/14780 | 10:40 |
panda | amoralej: who are the cores for https://review.rdoproject.org/r/config ? | 10:44 |
rdogerrit | Arx Cruz proposed rdoinfo master: Add stackviz package https://review.rdoproject.org/r/14780 | 10:45 |
panda | amoralej: I need to ask if something is acceptable to have there | 10:46 |
*** Guest67898 is now known as rook | 10:48 | |
*** Son_Goku has joined #rdo | 10:48 | |
chkumar|ruck | amoralej: Do we package stuff in RDO? which does not have upstream release? | 10:48 |
*** aufi_ has joined #rdo | 10:49 | |
*** aufi has quit IRC | 10:52 | |
*** morazi has quit IRC | 10:59 | |
*** sbulage|mtg is now known as sbulage | 11:01 | |
rdogerrit | Gabriele Cerami created config master: [WIP] create a base job to replace te-broker infra server https://review.rdoproject.org/r/14781 | 11:05 |
*** atoth has quit IRC | 11:09 | |
*** mosulica has quit IRC | 11:14 | |
*** sbulage is now known as sbulage|brb | 11:15 | |
*** paragan has joined #rdo | 11:16 | |
*** shreshtha_ has quit IRC | 11:20 | |
*** maufart__ has joined #rdo | 11:20 | |
*** shreshtha_ has joined #rdo | 11:20 | |
*** aufi_ has quit IRC | 11:23 | |
*** aufi_ has joined #rdo | 11:25 | |
*** ktibi has quit IRC | 11:25 | |
*** pradk has joined #rdo | 11:27 | |
*** maufart__ has quit IRC | 11:27 | |
*** udesale has quit IRC | 11:29 | |
mrunge | amoralej, or number80, is one of you there to fix a setup issue with the latest zuul3 change for opstools? | 11:30 |
mrunge | someone messed up credential setup :( | 11:30 |
number80 | Ha, you should be able to do it :) | 11:32 |
*** ramishra has quit IRC | 11:32 | |
mrunge | number80: hmm, actually not funny. | 11:32 |
mrunge | ;-) | 11:32 |
mrunge | how do *I* do it? | 11:32 |
amoralej | mrunge, what's the problem? | 11:32 |
number80 | mrunge: I learnt how to do it last week, I'm searching for the review as an example | 11:32 |
mrunge | number80: I see https://cbs.centos.org/koji/packageinfo?packageID=2212 | 11:32 |
mrunge | last built was tried by "rdobuilder" instead of "mrunge" | 11:33 |
amoralej | mmmm | 11:33 |
mrunge | so: no idea who and where is the change | 11:33 |
mrunge | who did and where is... | 11:33 |
mrunge | rdobuilder has no tag rights in opstools, which is correct | 11:34 |
number80 | https://review.rdoproject.org/r/#/c/14679/ | 11:34 |
amoralej | mrunge, secrets are declared in https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul.d/secrets.yaml | 11:34 |
number80 | you'll need that script to generate encrypted block => https://github.com/openstack-infra/zuul/blob/master/tools/encrypt_secret.py | 11:35 |
mrunge | apparently, the change broke opstools then | 11:35 |
mrunge | or where would I place this? I mean, I still haven't seen any docs | 11:36 |
mrunge | this is like poking in the dark | 11:36 |
number80 | mrunge: yes, gimme a sec | 11:36 |
*** EvilienM is now known as EmilienM | 11:36 | |
number80 | basically, you need to fix in zuul.d/jobs.yaml all the opstools jobs to use a different secret than koji_centos | 11:37 |
*** leanderthal has joined #rdo | 11:37 | |
number80 | if you want, I can create placeholder review where you only need to put later your encrypted certificate | 11:37 |
mrunge | that would certainly be helpful, yes | 11:38 |
number80 | ok, I'll do it | 11:38 |
amoralej | mrunge, number80 but the cert that was before that change was apevec's one | 11:38 |
amoralej | so previous builds were done with apevec user? | 11:39 |
mrunge | amoralej: for opstools, we always used mine | 11:39 |
mrunge | nope, there were my personal certificate used | 11:39 |
amoralej | mrunge, i mean after v3 migration before https://review.rdoproject.org/r/#/c/14679/3/zuul.d/secrets.yaml | 11:39 |
amoralej | i'm trying to understand why https://review.rdoproject.org/r/#/c/14679 broke it | 11:39 |
amoralej | or maybe never worked with v3? | 11:39 |
mrunge | I don't remember, when zull v3 happened to us | 11:40 |
apevec | amoralej, my CBS account doesn't have opstools permission | 11:41 |
apevec | so yeah, we need separate cert for opstools CBS builds | 11:42 |
mrunge | we should have it | 11:42 |
mrunge | all previous opstools builds were done with my personal certificate | 11:42 |
apevec | mrunge, let's have bot builder account for each SIG | 11:42 |
mrunge | it must have been stored there | 11:42 |
apevec | i.e. not use your personal one | 11:43 |
mrunge | apevec: actually, I have one | 11:43 |
*** sbulage|brb is now known as sbulage | 11:43 | |
mrunge | but didn't got the setup changed | 11:43 |
*** racedo has quit IRC | 11:43 | |
rdogerrit | hguemar created config master: Fix opstools CBS jobs to use opstools distinct credentials https://review.rdoproject.org/r/14782 | 11:43 |
number80 | mrunge: ^ | 11:43 |
apevec | ok, so step 1 is to encrypt the opstools cert | 11:43 |
mrunge | apevec: I must admit I was a bit lazy, since the bot builder account has no longer valid cert | 11:44 |
number80 | step 2: update the latest changeset to include them | 11:44 |
mrunge | that was denied | 11:44 |
mrunge | ack, thank you number80 | 11:44 |
*** ramishra has joined #rdo | 11:44 | |
apevec | mrunge, now it's good opportunity to switch to that bot account | 11:45 |
number80 | I'll also update RDO credentials name to make the difference clear | 11:45 |
mrunge | right | 11:45 |
amoralej | mrunge, number80 you need to also add a pre playbook to install the certs similar to https://github.com/rdo-infra/review.rdoproject.org-config/blob/724578028a20e417d025d75a6fe89584c9ffb9c4/playbooks/distgit-cbs-validate/pre.yaml | 11:46 |
amoralej | and add it to the jobs | 11:46 |
number80 | amoralej: ah right | 11:47 |
number80 | will do | 11:47 |
amoralej | update all lines as https://github.com/rdo-infra/review.rdoproject.org-config/blob/7e2d9a436d6e15a37a8bccf5a5369a862fe1e6bc/zuul.d/jobs.yaml#L110 | 11:47 |
amoralej | and point to the new pre | 11:47 |
*** pchavva has joined #rdo | 11:48 | |
*** rh-jelabarre has joined #rdo | 11:49 | |
number80 | done | 11:53 |
rdogerrit | hguemar proposed config master: Fix opstools CBS jobs to use opstools distinct credentials https://review.rdoproject.org/r/14782 | 11:53 |
number80 | (thanks git grep) | 11:54 |
*** rfolco has joined #rdo | 11:55 | |
*** gvrangan_odl has quit IRC | 11:55 | |
*** maufart__ has joined #rdo | 11:56 | |
*** lkuchlan_wfh has quit IRC | 11:56 | |
*** morazi has joined #rdo | 11:56 | |
*** panda is now known as panda|lunch | 11:57 | |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ci-config master: Add role to deploy ruck-rover-cockpit https://review.rdoproject.org/r/14632 | 11:57 |
*** aufi_ has quit IRC | 11:59 | |
*** jayg|g0n3 is now known as jayg | 12:00 | |
*** hseipp has quit IRC | 12:00 | |
ykarel | sshnaidm|rover, hi | 12:05 |
sshnaidm|rover | ykarel, hey | 12:06 |
ykarel | sshnaidm|rover, u checked the key issue in -upload jobs? | 12:06 |
ykarel | seems only this blocking us | 12:07 |
ykarel | to promote | 12:07 |
sshnaidm|rover | ykarel, well, I have another idea to try.. | 12:07 |
ykarel | okk cool | 12:07 |
rdogerrit | Sagi Shnaidman created rdo-infra/ci-config master: Check permission of key file https://review.rdoproject.org/r/14783 | 12:07 |
sshnaidm|rover | ykarel, ^^ | 12:07 |
sshnaidm|rover | but not sure it will help | 12:07 |
sshnaidm|rover | apevec, ping | 12:07 |
apevec | sshnaidm|rover, did you generate new key? the exposed one was disabled yesterday | 12:08 |
ykarel | sshnaidm|rover, but it looks ssh issue | 12:08 |
sshnaidm|rover | apevec, damn, that's why it fails | 12:08 |
apevec | (on call, will look at it) | 12:08 |
amoralej | number80, i have a patch to python-kubernetes to close all leaked pools in tearDown | 12:08 |
amoralej | :) | 12:08 |
apevec | sshnaidm|rover, email me new pubkey, I'll install it | 12:09 |
number80 | amoralej: cool | 12:09 |
*** lkuchlan_wfh has joined #rdo | 12:09 | |
sshnaidm|rover | apevec, the key is private, not public. We use private key to connect to upload server | 12:10 |
apevec | I mean, send me pub part | 12:10 |
sshnaidm|rover | apevec, ok | 12:10 |
*** amuller has joined #rdo | 12:12 | |
*** atoth has joined #rdo | 12:12 | |
*** rbartal has quit IRC | 12:13 | |
rdogerrit | Arx Cruz proposed rdoinfo master: Add stackviz package https://review.rdoproject.org/r/14780 | 12:14 |
sshnaidm|rover | apevec, sent you | 12:14 |
rdogerrit | Sagi Shnaidman created config master: Fix uploader key https://review.rdoproject.org/r/14784 | 12:15 |
*** jmlowe has joined #rdo | 12:16 | |
*** ktibi has joined #rdo | 12:17 | |
rdogerrit | Matthias Runge proposed config master: Fix opstools CBS jobs to use opstools distinct credentials https://review.rdoproject.org/r/14782 | 12:17 |
rdogerrit | Sagi Shnaidman proposed config master: Fix uploader key https://review.rdoproject.org/r/14784 | 12:17 |
sshnaidm|rover | ykarel, when is the next run? | 12:19 |
ykarel | sshnaidm|rover, 12:05 UTC | 12:19 |
*** racedo has joined #rdo | 12:19 | |
ykarel | sshnaidm|rover, already started | 12:20 |
sshnaidm|rover | ok | 12:20 |
*** amoralej is now known as amoralej|lunch | 12:20 | |
sshnaidm|rover | ykarel, let's hope apevec will put the key in the next hour :) | 12:21 |
rdogerrit | Merged config master: Fix uploader key https://review.rdoproject.org/r/14784 | 12:21 |
*** agopi has quit IRC | 12:21 | |
rdogerrit | Matthias Runge proposed config master: Fix opstools CBS jobs to use opstools distinct credentials https://review.rdoproject.org/r/14782 | 12:22 |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ci-config master: Add role to deploy ruck-rover-cockpit https://review.rdoproject.org/r/14632 | 12:22 |
ykarel | sshnaidm|rover, yup, but i can't get what changed this time. This key will again be revoked | 12:23 |
ykarel | sshnaidm|rover, if reason is same:- https://review.rdoproject.org/r/#/c/14754/ | 12:23 |
sshnaidm|rover | ykarel, meanwhile I'll work on more sage solution.. | 12:24 |
sshnaidm|rover | s/sage/safe | 12:24 |
ykarel | sshnaidm|rover, okk good | 12:24 |
sshnaidm|rover | ykarel, it was leaked because patch, it's not leaked in usual work | 12:24 |
*** ragiman has quit IRC | 12:24 | |
sshnaidm|rover | in the same way we could leak it the whole previous year | 12:25 |
ykarel | ack | 12:26 |
*** dprince has joined #rdo | 12:26 | |
*** edmondsw has joined #rdo | 12:27 | |
*** racedo has quit IRC | 12:30 | |
*** rlandy has joined #rdo | 12:30 | |
*** udesale has joined #rdo | 12:31 | |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ci-config master: Add role to deploy ruck-rover-cockpit https://review.rdoproject.org/r/14632 | 12:32 |
*** eharney has joined #rdo | 12:32 | |
*** udesale_ has joined #rdo | 12:35 | |
*** udesale_ has quit IRC | 12:36 | |
*** udesale has quit IRC | 12:36 | |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ci-config master: Add role to deploy ruck-rover-cockpit https://review.rdoproject.org/r/14632 | 12:36 |
*** ragiman has joined #rdo | 12:39 | |
leanderthal | who did i accidentally borrow the pine64 from? i brought it back to the brno office.... | 12:42 |
leanderthal | i realize that's quite... vague. | 12:42 |
apevec | sshnaidm|rover, key installed, can you test it manually with ssh -v ? | 12:44 |
number80 | leanderthal: I'd also try internal irc channel (or the brno dedicated one) | 12:44 |
*** kgiusti has joined #rdo | 12:44 | |
leanderthal | number80, there's a reason why you're the smart one. | 12:45 |
number80 | leanderthal: I'd just realize not seeing this on internal irc ;-) | 12:45 |
*** mcornea has joined #rdo | 12:46 | |
sshnaidm|rover | apevec, works fine | 12:48 |
sshnaidm|rover | apevec, thanks! | 12:48 |
apevec | ok, we made it in time before uploads started | 12:50 |
*** ragiman has quit IRC | 12:51 | |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ci-config master: Add role to deploy ruck-rover-cockpit https://review.rdoproject.org/r/14632 | 12:53 |
*** panda|lunch is now known as panda | 12:53 | |
*** jchhatbar has joined #rdo | 12:53 | |
*** trown|outtypewww is now known as trown | 12:55 | |
*** janki has quit IRC | 12:55 | |
rdogerrit | rdo-trunk created openstack/castellan-distgit rpm-master: python-castellan: failed to build 1695612 https://review.rdoproject.org/r/14785 | 12:55 |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ci-config master: Add role to deploy ruck-rover-cockpit https://review.rdoproject.org/r/14632 | 12:57 |
*** eck`gone is now known as eck` | 12:58 | |
*** openstack has joined #rdo | 13:03 | |
*** ChanServ sets mode: +o openstack | 13:03 | |
*** lkuchlan_wfh has quit IRC | 13:03 | |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ci-config master: [WIP] Add role to deploy ruck-rover-cockpit https://review.rdoproject.org/r/14632 | 13:04 |
*** dneary has joined #rdo | 13:05 | |
*** agurenko has joined #rdo | 13:05 | |
*** egonzalez has quit IRC | 13:06 | |
*** mosulica has joined #rdo | 13:06 | |
*** aludwar has quit IRC | 13:06 | |
*** aludwar has joined #rdo | 13:08 | |
*** janki has joined #rdo | 13:09 | |
*** jchhatbar has quit IRC | 13:09 | |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ci-config master: [WIP] Add role to deploy ruck-rover-cockpit https://review.rdoproject.org/r/14632 | 13:12 |
*** amoralej|lunch is now known as amoralej | 13:13 | |
*** mosulica has quit IRC | 13:14 | |
*** lkuchlan_wfh has joined #rdo | 13:17 | |
*** racedo has joined #rdo | 13:19 | |
*** mjturek has joined #rdo | 13:19 | |
*** Son_Goku has quit IRC | 13:20 | |
*** marrusl has quit IRC | 13:20 | |
*** alexpilotti has quit IRC | 13:23 | |
*** Son_Goku has joined #rdo | 13:25 | |
*** agurenko has quit IRC | 13:32 | |
*** lkuchlan_wfh has quit IRC | 13:32 | |
pabelanger | apevec: sshnaidm|rover: We cannot just change the private key and enable images.r.o again, https://logs.rdoproject.org/68/14768/3/check/hello-world/67b527a/job-output.txt.gz#_2018-07-11_13_33_43_431065 has exposed it again | 13:35 |
pabelanger | apevec: sshnaidm|rover: the needs to be an actual change to the job to prevent an attacker from just stealing it | 13:35 |
*** cylopez has left #rdo | 13:35 | |
sshnaidm|rover | pabelanger, if you didn't recheck, it wouldn't exposed, right? | 13:35 |
pabelanger | as I said yesterday, one fix is to use ssh-add then sred the key | 13:36 |
pabelanger | sshnaidm|rover: yes, I did recheck | 13:36 |
sshnaidm|rover | pabelanger, can you please give us some time to resolve this and get promotion as well? | 13:36 |
pabelanger | we cannot safely do a promotion with a leaked SSH key, this is a security issue now | 13:37 |
*** agopi has joined #rdo | 13:37 | |
sshnaidm|rover | pabelanger, if you don't recheck it, we could not change it every run | 13:37 |
sshnaidm|rover | pabelanger, ok, got it | 13:37 |
sshnaidm|rover | weshay, ^^ | 13:37 |
pabelanger | you can update your pre.yaml to do the first 4 tasks: http://git.openstack.org/cgit/openstack-infra/zuul-jobs/tree/roles/add-fileserver/tasks/main.yaml | 13:38 |
*** ramishra has quit IRC | 13:38 | |
pabelanger | that will however leak the SSH session, and a job could rsync to images.r.o | 13:38 |
pabelanger | so, to fix that, you can move the upload part into a post-run in the config project | 13:39 |
pabelanger | and only add the SSH-add / upload in the same playbook, then ssh-add -D when finished | 13:39 |
*** shailesh has joined #rdo | 13:41 | |
pabelanger | sshnaidm|rover: apevec: weshay: Here is what needs to be done: https://etherpad.openstack.org/p/tg2F2zw9cd | 13:43 |
ykarel | RDO meeting in next 1 hr 15 minutes, add your agenda here:- https://etherpad.openstack.org/p/RDO-Meeting | 13:44 |
*** ragiman has quit IRC | 13:46 | |
*** lkuchlan_wfh has joined #rdo | 13:46 | |
*** Eran_Kuris has quit IRC | 13:50 | |
weshay | pabelanger, k.. thanks going through it w/ sshnaidm|rover now | 13:53 |
*** shailesh has quit IRC | 13:54 | |
*** shailesh has joined #rdo | 13:55 | |
*** jistr is now known as jistr|mtg | 13:56 | |
*** baha has joined #rdo | 13:56 | |
*** shailesh has quit IRC | 13:57 | |
*** eharney has quit IRC | 13:58 | |
*** shailesh has joined #rdo | 14:02 | |
*** shailesh has quit IRC | 14:02 | |
*** shailesh has joined #rdo | 14:03 | |
pabelanger | weshay: I'm just doing some expenses this morning, but send a ping once the change is up | 14:04 |
*** Amita has quit IRC | 14:05 | |
*** lkuchlan_wfh has quit IRC | 14:10 | |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ci-config master: [WIP] Add role to deploy ruck-rover-cockpit https://review.rdoproject.org/r/14632 | 14:11 |
*** zaneb has joined #rdo | 14:12 | |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ci-config master: [WIP] Add role to deploy ruck-rover-cockpit https://review.rdoproject.org/r/14632 | 14:12 |
*** akrivoka has quit IRC | 14:12 | |
*** akrivoka has joined #rdo | 14:14 | |
*** holser_ has quit IRC | 14:14 | |
*** janki has quit IRC | 14:15 | |
*** holser_ has joined #rdo | 14:16 | |
*** alexpilotti has joined #rdo | 14:16 | |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ci-config master: [WIP] Add role to deploy ruck-rover-cockpit https://review.rdoproject.org/r/14632 | 14:19 |
*** ykarel has quit IRC | 14:19 | |
weshay | sshnaidm|rover, | 14:19 |
weshay | 06:31:54 [periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-master-upload] $ /bin/sh -xe /tmp/hudson2557584468914455944.sh | 14:19 |
weshay | 06:31:54 + export RELEASE=master | 14:19 |
weshay | 06:31:54 + RELEASE=master | 14:19 |
*** quiquell is now known as quiquell|off | 14:20 | |
weshay | sshnaidm|rover, https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-master-upload/359/consoleFull | 14:20 |
*** alexpilotti has quit IRC | 14:21 | |
*** alexpilotti has joined #rdo | 14:22 | |
*** lkuchlan_wfh has joined #rdo | 14:24 | |
*** alexpilotti has quit IRC | 14:26 | |
*** alexpilotti has joined #rdo | 14:28 | |
rdogerrit | Merged rdoinfo master: Promote CBS tags update for queens-testing https://review.rdoproject.org/r/14698 | 14:30 |
rdogerrit | Merged rdoinfo master: Promote python-flask-restful to -testing https://review.rdoproject.org/r/14779 | 14:30 |
panda | pabelanger: do you know who could answer the questions on this https://review.rdoproject.org/r/14781 ? | 14:30 |
*** hseipp has joined #rdo | 14:30 | |
*** Son_Goku has quit IRC | 14:30 | |
*** zaneb has quit IRC | 14:31 | |
*** zaneb has joined #rdo | 14:31 | |
pabelanger | panda: what is the question? | 14:32 |
panda | pabelanger: there are three in the commit message | 14:32 |
*** maufart__ has quit IRC | 14:32 | |
pabelanger | ac | 14:32 |
pabelanger | ack* | 14:32 |
panda | pabelanger: 1 and 2 can be easily resolved, but 3 is actually very critical | 14:33 |
rdogerrit | Sagi Shnaidman created config master: Use ssh key for upload in post playbook https://review.rdoproject.org/r/14786 | 14:33 |
pabelanger | panda: where is 3 today? | 14:33 |
rdogerrit | Sagi Shnaidman created rdo-jobs master: Remove upload from run playbook https://review.rdoproject.org/r/14787 | 14:34 |
panda | pabelanger: in the te-broker | 14:34 |
pabelanger | external server? | 14:34 |
*** dustins has joined #rdo | 14:34 | |
pabelanger | https://github.com/cybertron/openstack-virtual-baremetal you mean | 14:34 |
panda | pabelanger: yes, the repo is cloned there, pinned, and used to create all the test environment for ovb | 14:35 |
panda | pabelanger: with this method, the repo would need to be cloned int the ansible executor, and python scripts there should be run too | 14:36 |
pabelanger | should be fine, but could either A import it into RDO if critical of testing B) have them do a stable release to pypi | 14:36 |
*** richm has quit IRC | 14:36 | |
amoralej | rdopiera, some new xstatic packages have been added to heat horizon plugin https://review.openstack.org/#/c/551288/14/requirements.txt | 14:36 |
sshnaidm|rover | pabelanger, https://review.rdoproject.org/r/14787 https://review.rdoproject.org/r/14786 | 14:36 |
amoralej | rdopiera, it's blocking promotion | 14:36 |
pabelanger | panda: it wouldn't be zuul-executor, but nodepool node, which is fine | 14:36 |
amoralej | rdopiera, https://centos.logs.rdoproject.org/weirdo-generic-puppet-openstack-scenario003/5739/weirdo-project/puppet.txt.gz | 14:37 |
panda | pabelanger: it's not a nodepool node, that job creates the node that we need, and we are not requesting any node from nodepool, because we don't use them. | 14:37 |
pabelanger | panda: no, the playbooks will run on a nodepool node, not directly on zuul-executor | 14:38 |
panda | pabelanger: that's news to me, I thought all the playbooks specified in pre-run and post-run were run in the executor anyway, occasionally pointing tasks to nodepool node but only if they are requested. | 14:40 |
*** lkuchlan_wfh has quit IRC | 14:40 | |
panda | pabelanger: if we're running in an host that has no possibility to interfere with the other, it's probably better, but that's not what I understood | 14:41 |
*** richm has joined #rdo | 14:41 | |
pabelanger | panda: well, I mean, ansible-playbook will run from zuul-executor, but usually need a node from nodepool to run against. In this case, I would first have zuul-executor run ansible-playbook on the remove node, and ensure this all works as expected, then if we can run this directly from the executor, we can drop the need to have nodepool launch a node first to create OVB stacks | 14:42 |
*** ykarel has joined #rdo | 14:42 | |
pabelanger | by first doing it directly from zuul-executor, I think you'll run into a bunch of issues, and logs will not be exposed to you to properly debug | 14:42 |
ykarel | rdopiera, hi | 14:43 |
panda | pabelanger: understood, I didn't want to use a nodepool node because each job will then waste an entire node to just run ansible playbooks. | 14:44 |
ykarel | rdopiera, do you look after xstatic-* | 14:44 |
panda | pabelanger: so you suggest at leat for debugging, to use a nodepool node | 14:44 |
panda | pabelanger: still the question remains, it will ever be accepted, to use an external repo in the executor directly ? | 14:44 |
ykarel | rdopiera, after heat-dashboard added new xstatic- deps we hit: https://trello.com/c/pQiFF4vs | 14:45 |
ykarel | amoralej, ^^ | 14:45 |
pabelanger | panda: right, first step use nodepool, next remove it | 14:45 |
ykarel | RDO Meeting in next 15 minutes, please add agenda here:- https://etherpad.openstack.org/p/RDO-Meeting | 14:45 |
amoralej | thanks ykarel for some reason i didn't see it and was about to create a new one | 14:46 |
pabelanger | panda: yes, but you cannot clone directly like you are doing, we need to add the repo to zuuls main.yaml so we can use required-project | 14:46 |
amoralej | we probably need to escalate it | 14:46 |
pabelanger | panda: once we do that, it is fine | 14:46 |
ykarel | amoralej, should i move to production-chain, or u moving? | 14:46 |
amoralej | let's wait for a while | 14:47 |
pabelanger | sshnaidm|rover: -1 on 14787 but is right step forward | 14:47 |
amoralej | i want to check if oooq jobs also fail ykarel | 14:47 |
ykarel | amoralej, ack | 14:47 |
ykarel | is heat-dashboard installed in oooq | 14:47 |
amoralej | i think it was added to the horizon container, yes | 14:48 |
ykarel | may be not because today's run didn't fail at least in promotion jobs | 14:48 |
*** kopecmartin has quit IRC | 14:48 | |
panda | pabelanger: ok, doing all you suggested in the next patch set | 14:48 |
rdogerrit | Alfredo Moralejo proposed rdoinfo master: Bump rdoinfo rocky-uc tags to latest upper-constraints https://review.rdoproject.org/r/14650 | 14:49 |
rdogerrit | Alfredo Moralejo proposed rdoinfo master: Bump rdoinfo pike tags to latest upper-constraints https://review.rdoproject.org/r/14649 | 14:49 |
sshnaidm|rover | pabelanger, sorry, I don't understand your comment to 14787 | 14:50 |
pabelanger | panda: apevec: I actually think we should just pull https://github.com/cybertron/openstack-virtual-baremetal into rdo infra, who can make that call? | 14:50 |
sshnaidm|rover | pabelanger, please show an example | 14:50 |
sshnaidm|rover | pabelanger, bnemec wanted it to be upstream project iirc | 14:50 |
pabelanger | sshnaidm|rover: https://review.rdoproject.org/r/gitweb?p=config.git;a=blob;f=zuul.d/jobs.yaml;h=8edcd084c63a204dfb748cdec6712aa23e593735;hb=HEAD#l259 | 14:51 |
pabelanger | sshnaidm|rover: bnemec: okay, maybe we can get an official release to pypi so we can stop using git | 14:51 |
amoralej | apevec, https://review.openstack.org/#/c/581412/ is not accepted | 14:52 |
bnemec | pabelanger: Making it work from a package is going to be non-trivial, which is why it hasn't happened yet. | 14:52 |
bnemec | I'm open to the idea though. | 14:52 |
amoralej | i think we can propose to bump 2.1.4-2 which has the patch in distgit to pike and queens | 14:52 |
*** lkuchlan_wfh has joined #rdo | 14:53 | |
*** ksambor has quit IRC | 14:53 | |
pabelanger | bnemec: k | 14:54 |
*** jistr|mtg is now known as jistr | 14:54 | |
sshnaidm|rover | pabelanger, do you mean to use "vars: " in job definition? | 14:54 |
rdopiera | ykarel: looking | 14:55 |
number80 | https://review.rdoproject.org/r/#/c/14782/ | 14:57 |
number80 | ^ amoralej pabelanger are you fine with this? | 14:57 |
pabelanger | sshnaidm|rover: yes, we've use that for other jobs that need to access it via multiple playbook runs | 14:57 |
*** emalikov has quit IRC | 14:57 | |
*** cshastri has quit IRC | 14:58 | |
*** eharney has joined #rdo | 14:58 | |
*** rpioso|afk is now known as rpioso | 14:58 | |
*** morazi has quit IRC | 14:59 | |
*** alexpilotti has quit IRC | 14:59 | |
*** shailesh has quit IRC | 14:59 | |
*** alexpilotti has joined #rdo | 15:00 | |
*** shailesh has joined #rdo | 15:00 | |
*** alexpilotti has quit IRC | 15:00 | |
sshnaidm|rover | pabelanger, I don't like it, it's even more hackish than I did | 15:00 |
ykarel | rdopiera, Thanks | 15:00 |
sshnaidm|rover | pabelanger, we need to know the branch it runs with, what is best practice to do it? | 15:00 |
ykarel | meeting time | 15:01 |
pabelanger | sshnaidm|rover: branch is {{ zuul.branch }} | 15:01 |
mjturek | o/ | 15:01 |
ykarel | #startmeeting RDO meeting - 2018-07-11 | 15:01 |
openstack | Meeting started Wed Jul 11 15:01:43 2018 UTC and is due to finish in 60 minutes. The chair is ykarel. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:01 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:01 |
*** openstack changes topic to " (Meeting topic: RDO meeting - 2018-07-11)" | 15:01 | |
openstack | The meeting name has been set to 'rdo_meeting___2018_07_11' | 15:01 |
leanderthal | o/ | 15:01 |
ykarel | #chair leanderthal mjturek | 15:01 |
openstack | Current chairs: leanderthal mjturek ykarel | 15:01 |
number80 | o/ | 15:02 |
ykarel | Please add last minute agenda here:- https://etherpad.openstack.org/p/RDO-Meeting | 15:02 |
amoralej | o/ | 15:02 |
ykarel | #chair number80 amoralej | 15:02 |
openstack | Current chairs: amoralej leanderthal mjturek number80 ykarel | 15:02 |
*** holser_ has quit IRC | 15:02 | |
baha | o/ | 15:02 |
ykarel | #chair baha | 15:03 |
*** morazi has joined #rdo | 15:03 | |
openstack | Current chairs: amoralej baha leanderthal mjturek number80 ykarel | 15:03 |
ykarel | So let's start with the agenda | 15:03 |
ykarel | #topic Proof of concept job for building ppc64le containers | 15:04 |
*** openstack changes topic to "Proof of concept job for building ppc64le containers (Meeting topic: RDO meeting - 2018-07-11)" | 15:04 | |
ykarel | mjturek, ^^ | 15:04 |
ykarel | baha, ^^ | 15:04 |
mjturek | thanks - hey | 15:04 |
rdogerrit | Alfredo Moralejo created rdoinfo master: Promote python-amqp-2.1.4-2.el7 to pike and queens testing https://review.rdoproject.org/r/14788 | 15:04 |
mjturek | so we're getting a PoC job going for the containers | 15:04 |
mjturek | the missing piece right now is a test-day-tools job that provides a ppc node | 15:05 |
jruzicka | o/ | 15:05 |
ykarel | #chair jruzicka | 15:05 |
openstack | Current chairs: amoralej baha jruzicka leanderthal mjturek number80 ykarel | 15:05 |
mjturek | planning on doing this https://review.rdoproject.org/r/#/c/14739/3 | 15:05 |
mjturek | (ignore ps4, was testing something) | 15:05 |
mjturek | is there any issue with this? Does anyone have a preferred approach? | 15:05 |
mjturek | the goal is to get the PoC job going so we can iterate a bit and eventually turn on an actual job on ci.centos.org | 15:06 |
amoralej | mjturek, one question is | 15:08 |
rdogerrit | Arx Cruz proposed rdoinfo master: Add stackviz package https://review.rdoproject.org/r/14780 | 15:08 |
amoralej | what's that rdo-tet-day-tools job? | 15:08 |
amoralej | i'm a bit confused with that | 15:08 |
mjturek | amoralej: it's a barebones job that grabs a node from duffy and adds it as an ansible host | 15:09 |
mjturek | just a way to play with duffy nodes | 15:09 |
amoralej | ok | 15:09 |
*** florianf has quit IRC | 15:09 | |
amoralej | so, that's just a job to test that the get cico nodes works fine with ppc64 arch? | 15:09 |
mjturek | that getting the node works, and that building the containers on cico nodes works | 15:10 |
mjturek | (we explicitly turn off pushing) | 15:10 |
baha | The hope is that after we get to a point where we can pull in ppc nodes, we'll update that test-day-tools job to run the build on one | 15:10 |
amoralej | but that job is not building containers, right? | 15:10 |
baha | Since we have it working just fine for x86 duffy nodes | 15:10 |
amoralej | ok | 15:10 |
mjturek | amoralej: our patch triggers a job that does build the containers | 15:11 |
mjturek | let me grab that patch | 15:11 |
*** holser_ has joined #rdo | 15:11 | |
amoralej | this has something to do with test day ? | 15:11 |
amoralej | that's what confuses me :) | 15:11 |
mjturek | https://review.rdoproject.org/r/#/c/14502/ | 15:11 |
mjturek | amoralej: it doesn't, we're just leveraging existing configs. It fit our problem space well | 15:11 |
baha | And it was a convenient way to put it somewhere that it didn't seem like it'd bug anyone while we were trying different solutions. | 15:12 |
*** lkuchlan_wfh has quit IRC | 15:12 | |
amoralej | ok, when it's tested and we are close to the final solution, let's renae | 15:12 |
amoralej | rename | 15:12 |
amoralej | other than that, ok | 15:12 |
number80 | *nods* | 15:13 |
amoralej | i think last PS is not working fine | 15:13 |
mjturek | sure isn't :) | 15:13 |
amoralej | it seems my idea of doing the export before the include-raw is not working | 15:13 |
mjturek | PS5 should be a better solution | 15:13 |
mjturek | yeah unfortunately :-\ | 15:13 |
mjturek | once I have a solution up, I'll ping you amoralej | 15:14 |
amoralej | ok | 15:14 |
amoralej | so, once we merge the job | 15:14 |
amoralej | i can run it to test | 15:14 |
*** florianf has joined #rdo | 15:14 | |
*** holser_ has quit IRC | 15:15 | |
ykarel | mjturek, would like to mention about to opstools and ceph luminous containers build, u added that in agenda | 15:15 |
mjturek | yes! sorry for taking up so much time | 15:15 |
*** holser_ has joined #rdo | 15:15 | |
ykarel | #link https://buildlogs.centos.org/centos/7/storage/ppc64le/ceph-luminous/ | 15:16 |
*** dneary has quit IRC | 15:16 | |
*** links has quit IRC | 15:16 | |
mjturek | ykarel: basically those aren't published, and since the repo file is built based on published containers our current approach is to just remove any references to the packages | 15:16 |
ykarel | may be ^^ is periodically uplished | 15:16 |
*** dneary has joined #rdo | 15:16 | |
*** holser_ has quit IRC | 15:16 | |
ykarel | mjturek, can't u use that repo for testing | 15:17 |
mjturek | ykarel: I think so | 15:17 |
*** holser_ has joined #rdo | 15:17 | |
*** holser_ has quit IRC | 15:17 | |
mjturek | hamzy_ was using it I believe for his builds | 15:17 |
mjturek | once we can iterate with the test-day-tools jobs, our next goal will be adding those repos | 15:18 |
*** holser_ has joined #rdo | 15:18 | |
ykarel | mjturek, Okk | 15:18 |
ykarel | so should we move to next topic | 15:18 |
mjturek | thanks ykarel | 15:18 |
ykarel | #topic the CentOS Cloud SIG (special interest group) meets Thursdays 1500 UTC if you're keen | 15:18 |
*** openstack changes topic to "the CentOS Cloud SIG (special interest group) meets Thursdays 1500 UTC if you're keen (Meeting topic: RDO meeting - 2018-07-11)" | 15:18 | |
ykarel | leanderthal, ^^ | 15:18 |
rdogerrit | Sagi Shnaidman proposed rdo-jobs master: Remove upload from run playbook https://review.rdoproject.org/r/14787 | 15:19 |
ykarel | This meeting makes sense for people that are involved in packaging OpenStack for CentOS and for people that are packaging OTHER cloud infra thingies (OpenNebula, CloudStack, Euca, etc) for CentOS. | 15:20 |
ykarel | leanderthal, would you like to add something ^^ | 15:20 |
leanderthal | hello! oh, yes. okay, so ykarel said everything ;-) | 15:20 |
rdogerrit | Sagi Shnaidman proposed config master: Use ssh key for upload in post playbook https://review.rdoproject.org/r/14786 | 15:21 |
ykarel | any questions on this? | 15:21 |
leanderthal | for example, mjturek , if you were keen to have other cloud infrastructures collaborate on your project, then i'd recommend you bring it to the CCS mtg as well | 15:21 |
mjturek | leanderthal: cool! | 15:22 |
leanderthal | any questions? | 15:22 |
*** lvdombrkr has quit IRC | 15:22 | |
ykarel | leanderthal, where it's held, on IRC, which channel? | 15:23 |
leanderthal | ykarel, brilliant! irc freenode #centos-devel | 15:23 |
leanderthal | aaaaaaaaaaaaaaaaaaaaand lemme find the etherpad | 15:23 |
rdogerrit | Sagi Shnaidman proposed rdo-jobs master: Remove upload from run playbook https://review.rdoproject.org/r/14787 | 15:23 |
leanderthal | https://etherpad.openstack.org/p/centos-cloud-sig | 15:23 |
leanderthal | #link https://etherpad.openstack.org/p/centos-cloud-sig | 15:23 |
*** dyasny__ has quit IRC | 15:23 | |
ykarel | Great | 15:23 |
mjturek | leanderthal: this is a new meeting? I was under the impression this meeting had gone away | 15:23 |
*** dyasny__ has joined #rdo | 15:24 | |
leanderthal | this is a meeting that we're trying to rebuild? | 15:24 |
mjturek | ahhh got it | 15:24 |
mjturek | very cool! | 15:24 |
leanderthal | it's to encourage more cross project polination | 15:24 |
number80 | yeah | 15:24 |
number80 | Sent a reminder on centos-devel list | 15:24 |
leanderthal | thx so much number80 | 15:24 |
ykarel | #action leanderthal to sent reminder to centos-devel list for the meeting | 15:25 |
ykarel | ok already sent? | 15:25 |
leanderthal | yar | 15:25 |
number80 | yeah, earlier this (CET) afternoon | 15:25 |
ykarel | #undo | 15:25 |
openstack | Removing item from minutes: #action leanderthal to sent reminder to centos-devel list for the meeting | 15:25 |
ykarel | number80, Thanks | 15:25 |
rdogerrit | Sagi Shnaidman proposed config master: Use ssh key for upload in post playbook https://review.rdoproject.org/r/14786 | 15:25 |
ykarel | #topic next week's chair | 15:26 |
*** openstack changes topic to "next week's chair (Meeting topic: RDO meeting - 2018-07-11)" | 15:26 | |
leanderthal | me! | 15:26 |
ykarel | #action leanderthal would be chairing next week | 15:26 |
ykarel | leanderthal, Thanks | 15:26 |
leanderthal | happy to, ykarel | 15:26 |
number80 | :) | 15:26 |
*** dyasny__ has quit IRC | 15:26 | |
ykarel | #topic open floor | 15:26 |
*** openstack changes topic to "open floor (Meeting topic: RDO meeting - 2018-07-11)" | 15:26 | |
*** dyasny__ has joined #rdo | 15:27 | |
leanderthal | we are doing *something* to celebrate openstack birthday this month; is anyone keen to join a streaming video next week on the 17th? | 15:27 |
ykarel | ahh i remember the cake thing :) Cake as a Service | 15:28 |
leanderthal | YESSSSSSS | 15:28 |
leanderthal | very important | 15:28 |
*** jmlowe has quit IRC | 15:28 | |
leanderthal | i know there's a streaming thing on tuesday next week, but i don't know what time or other details | 15:28 |
leanderthal | but also, i'm going to gather pics / messages from community members and put together a blog post | 15:28 |
leanderthal | which may be easier / more accessible for people | 15:29 |
ykarel | leanderthal, nice | 15:29 |
leanderthal | is anyone particularly keen / opinionated either way? | 15:29 |
ykarel | leanderthal, would be good if u send reminder when u get the timings | 15:30 |
ykarel | and other details | 15:30 |
leanderthal | will do | 15:31 |
ykarel | Ok Thanks | 15:31 |
leanderthal | i'll send to both lists as soon as i have more information and also put together a blog post | 15:31 |
*** kopecmartin has joined #rdo | 15:31 | |
ykarel | Ok Great | 15:31 |
leanderthal | that's it for me | 15:31 |
ykarel | Any other thing to discuss? please bring it now | 15:33 |
*** jcoufal has quit IRC | 15:35 | |
ykarel | so let's close then, everyone get's back 25 minutes | 15:35 |
ykarel | Thanks everyone for joining | 15:35 |
*** abhishekk has joined #rdo | 15:35 | |
ykarel | #endmeeting | 15:36 |
*** openstack changes topic to "RDO: An OpenStack Distribution for CentOS/RHEL | Community meeting is held here every Wednesday at 15:00UTC | Please read our IRC community guidelines: https://www.rdoproject.org/community/irc-etiquette/ | Logged at http://eavesdrop.openstack.org/irclogs/%23rdo/" | 15:36 | |
openstack | Meeting ended Wed Jul 11 15:36:01 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:36 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/rdo_meeting___2018_07_11/2018/rdo_meeting___2018_07_11.2018-07-11-15.01.html | 15:36 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/rdo_meeting___2018_07_11/2018/rdo_meeting___2018_07_11.2018-07-11-15.01.txt | 15:36 |
openstack | Log: http://eavesdrop.openstack.org/meetings/rdo_meeting___2018_07_11/2018/rdo_meeting___2018_07_11.2018-07-11-15.01.log.html | 15:36 |
*** abhishekk is now known as abhishekk{mbl} | 15:37 | |
pabelanger | bnemec: sshnaidm|rover: with OVB jobs, we are using 3 images for ironic today right? or do we have wholedisk images | 15:39 |
leanderthal | thx ykarel for chairing the meeting! | 15:39 |
*** leanderthal has quit IRC | 15:39 | |
PagliaccisCloud | i'm terrible at keeping meetings, but as @leanderthal said we're having a virtual bday party next tuesday! | 15:41 |
*** radeks has quit IRC | 15:42 | |
mrunge | could we please get back to https://review.rdoproject.org/r/#/c/14782/ ? number80, amoralej, apevec? | 15:43 |
amoralej | let me check | 15:44 |
number80 | mrunge: yeah, I asked ppl before the meeting otherwise I was tom erge it | 15:45 |
*** ykarel is now known as ykarel|away | 15:46 | |
amoralej | mrunge, merging it | 15:46 |
mrunge | thank you number80, amoralej! | 15:46 |
rdogerrit | Merged config master: Fix opstools CBS jobs to use opstools distinct credentials https://review.rdoproject.org/r/14782 | 15:46 |
*** peereb has quit IRC | 15:46 | |
amoralej | mrunge, do you have some review to test? | 15:46 |
mrunge | do we have a bot here for cookies/beer/stickers? | 15:47 |
mrunge | amoralej: yes, just a sec | 15:47 |
number80 | mrunge: zodbot is still around but muted :) | 15:47 |
*** zaneb has quit IRC | 15:47 | |
mrunge | number80++ | 15:47 |
mrunge | amoralej++ | 15:47 |
pabelanger | mrunge: amoralej: number80: we should push on getting kerberos auth on CBS, so we can remove the dependencies on SSL certs. Would help protect a little on potential leaks | 15:47 |
*** zaneb has joined #rdo | 15:48 | |
pabelanger | since we need to write SSL certs to disk | 15:48 |
mrunge | hmm, seems to be totally muted. fedora messages did not get the message | 15:48 |
mrunge | pabelanger: yes, that sounds like a good idea. | 15:48 |
*** maufart__ has joined #rdo | 15:49 | |
pabelanger | I have no idea who we'd ask in that case? | 15:49 |
pabelanger | apevec: ^ | 15:49 |
number80 | bstinson, alphacc ^ | 15:49 |
number80 | pabelanger: I just ping the right ppl that maintains CBS :) | 15:49 |
pabelanger | number80: thanks! | 15:52 |
rdogerrit | Alfredo Moralejo created rdoinfo master: Promote ovs-2.9.0 to all releases since newton https://review.rdoproject.org/r/14789 | 15:53 |
amoralej | pabelanger, did you have a chance to check the issue with jobs in openstack-post pipeline? | 15:53 |
*** morazi has quit IRC | 15:57 | |
*** morazi has joined #rdo | 15:58 | |
mrunge | number80: amoralej, unfortunately, the recently merged patch did not help with the wrong user for cbs | 16:00 |
amoralej | mmm | 16:00 |
amoralej | weird | 16:00 |
mrunge | I still see a user "rdobuilder" being used | 16:01 |
*** tesseract has quit IRC | 16:01 | |
amoralej | mrunge, i think it's a different error no | 16:02 |
amoralej | now | 16:02 |
amoralej | "msg": "The task includes an option with an undefined variable. The error was: 'cbs_optools' is undefined\n\nThe error appears to have been in '/tmp/3ed02efcb5954f0999c8ef401193d4be/trusted/project_0/review.rdoproject.org/config/playbooks/opstools-common-distgit-cbs-validate/pre.yaml': line 13, column 7, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n - name: Create | 16:02 |
amoralej | koji centos server ca\n ^ here\n" | 16:02 |
amoralej | let me re-read the review | 16:02 |
amoralej | seems a typo | 16:02 |
mrunge | hmmm | 16:02 |
number80 | ha typo | 16:03 |
mrunge | I just went to the build on cbs | 16:03 |
number80 | optools opstools, I always make that one | 16:03 |
mrunge | #metoo | 16:03 |
amoralej | yes | 16:03 |
amoralej | that's the issue | 16:03 |
amoralej | number80, are you sending the fix? | 16:03 |
*** dmsimard has quit IRC | 16:04 | |
*** jfrancoa has quit IRC | 16:04 | |
number80 | amoralej: yep | 16:04 |
rdogerrit | hguemar created config master: Fix typo on opstools cred in pre.yaml https://review.rdoproject.org/r/14790 | 16:04 |
number80 | no more traces of optools according git grep so I hope it will work | 16:05 |
*** dmsimard has joined #rdo | 16:05 | |
bstinson | pabelanger, number80: fyi, kerberized services are not on our roadmap anywhere at this point | 16:08 |
pabelanger | amoralej: I'll dive more into it again today | 16:08 |
*** tshefi has quit IRC | 16:08 | |
number80 | bstinson: thanks for the heads-up :) | 16:08 |
*** panda is now known as panda|off | 16:11 | |
rdogerrit | Merged config master: Fix typo on opstools cred in pre.yaml https://review.rdoproject.org/r/14790 | 16:12 |
*** jpich has quit IRC | 16:13 | |
*** cNilesh has quit IRC | 16:14 | |
rdogerrit | hguemar created openstack/castellan-distgit rpm-master: Move tests suite execution to stestr https://review.rdoproject.org/r/14791 | 16:14 |
amoralej | mandre, could you do any progress on kolla containers for py3 and fedora? | 16:16 |
rdogerrit | hguemar proposed openstack/castellan-distgit rpm-master: Move tests suite execution to stestr https://review.rdoproject.org/r/14785 | 16:16 |
*** ykarel|away is now known as ykarel | 16:18 | |
*** Goneri has quit IRC | 16:19 | |
*** hseipp has quit IRC | 16:20 | |
number80 | Damn RETRY_LIMIT! | 16:20 |
*** sbulage is now known as sbulage|afk | 16:24 | |
*** racedo has quit IRC | 16:27 | |
*** dneary has quit IRC | 16:29 | |
*** radeks has joined #rdo | 16:31 | |
*** florianf has quit IRC | 16:34 | |
*** shailesh has quit IRC | 16:34 | |
*** hseipp has joined #rdo | 16:37 | |
*** sbulage|afk has quit IRC | 16:37 | |
*** hseipp has quit IRC | 16:37 | |
rdogerrit | Merged rdoinfo master: Bump rdoinfo rocky-uc tags to latest upper-constraints https://review.rdoproject.org/r/14650 | 16:40 |
apevec | number80, you were tom erge ? :) | 16:40 |
apevec | sounds like cartoon character | 16:40 |
weshay | amoralej, what's up w/ the ceph-release packages https://bugs.launchpad.net/openstack-infra/+bug/1781255 | 16:41 |
openstack | Launchpad bug 1781255 in openstack-infra/networking-spp-ci ""Error: centos-release-ceph-luminous conflicts with centos-release-ceph-jewel-1.0-1.el7.centos.noarch" [Undecided,New] | 16:41 |
number80 | apevec: I type too fast :) | 16:41 |
rdogerrit | Merged rdo-jobs master: Remove upload from run playbook https://review.rdoproject.org/r/14787 | 16:41 |
weshay | amoralej, do they really intend to have versions conflict? | 16:41 |
weshay | amoralej, I had to fix that in tripleo here https://review.openstack.org/#/c/576597/ | 16:42 |
weshay | however this is an infra role now | 16:42 |
weshay | that is failing | 16:42 |
weshay | rlandy, fyi ^ | 16:42 |
pabelanger | apevec: number80: amoralej: fbo: I'd like to change Strategy on config project to Merge if Necessary today, this will stop the need to un needed rebasing of the project all the time. Does anybody have a concern? | 16:42 |
amoralej | mmm, i'm not sure | 16:42 |
amoralej | ^ about weshay question, not config change strategy | 16:43 |
rdogerrit | Sagi Shnaidman proposed config master: Use ssh key for upload in post playbook https://review.rdoproject.org/r/14786 | 16:44 |
amoralej | weshay, let me check who owns ceph release packages | 16:44 |
weshay | amoralej++ | 16:44 |
*** masonjoyers has quit IRC | 16:44 | |
weshay | thank you sir | 16:44 |
sshnaidm|rover | pabelanger, i have required projects in parent job, why do I need it here? https://review.rdoproject.org/r/#/c/14786/3/zuul.d/jobs.yaml | 16:44 |
amoralej | it's gfidente | 16:46 |
weshay | amoralej, k.. /me grabs him | 16:46 |
pabelanger | sshnaidm|rover: okay, mostly readability missed that | 16:46 |
amoralej | i can't find him around | 16:46 |
rdogerrit | Sagi Shnaidman proposed config master: Use ssh key for upload in post playbook https://review.rdoproject.org/r/14786 | 16:46 |
*** maufart__ has quit IRC | 16:46 | |
sshnaidm|rover | pabelanger, also as amoralej pointed we need to execute it only if main job passed, how to do it? | 16:47 |
*** zaneb has quit IRC | 16:47 | |
pabelanger | sshnaidm|rover: when: zuul_success | 16:47 |
*** zaneb has joined #rdo | 16:47 | |
sshnaidm|rover | pabelanger, where? | 16:47 |
*** baha has quit IRC | 16:48 | |
amoralej | weshay, i'm asking alphacc too about https://bugs.launchpad.net/openstack-infra/+bug/1781255 | 16:49 |
openstack | Launchpad bug 1781255 in tripleo ""Error: centos-release-ceph-luminous conflicts with centos-release-ceph-jewel-1.0-1.el7.centos.noarch" [Undecided,New] | 16:49 |
pabelanger | sshnaidm|rover: on the tasks you want to skip | 16:49 |
amoralej | i think he's also involved in storagesig | 16:49 |
pabelanger | sshnaidm|rover: https://zuul-ci.org/docs/zuul/user/jobs.html?highlight=zuul_success#var-zuul_success | 16:49 |
weshay | amoralej, thank | 16:51 |
amoralej | weshay, that's in upgrade job, right? | 16:51 |
weshay | amoralej, no.. | 16:52 |
weshay | it's an infra role to setup multinode | 16:52 |
*** paramite has quit IRC | 16:53 | |
weshay | amoralej, this breaks infra code.. pabelanger will tell ya :) | 16:53 |
amoralej | but this role is executed before repo_setup.sh, isn't it? | 16:53 |
*** masonjoyers has joined #rdo | 16:53 | |
*** racedo has joined #rdo | 16:54 | |
amoralej | well if https://review.openstack.org/#/c/576597/1/config/release/trunk/master.yml fixed it | 16:54 |
rdogerrit | Sagi Shnaidman proposed config master: Use ssh key for upload in post playbook https://review.rdoproject.org/r/14786 | 16:54 |
sshnaidm|rover | pabelanger, this way? ^^ | 16:54 |
amoralej | i must be wrong | 16:54 |
pabelanger | sshnaidm|rover: no, replied | 16:54 |
*** ykarel has quit IRC | 16:57 | |
sshnaidm|rover | pabelanger, but is "when: " in right place? | 16:59 |
*** derekh has quit IRC | 17:00 | |
*** tshefi has joined #rdo | 17:00 | |
pabelanger | sshnaidm|rover: yes: https://docs.ansible.com/ansible/2.5/user_guide/playbooks_blocks.html | 17:00 |
rdogerrit | Sagi Shnaidman proposed config master: Use ssh key for upload in post playbook https://review.rdoproject.org/r/14786 | 17:01 |
*** avivgt has quit IRC | 17:02 | |
sshnaidm|rover | pabelanger, ^^ | 17:02 |
*** imacdonn has quit IRC | 17:03 | |
pabelanger | sshnaidm|rover: yes, now just rotate secret and should be good to test | 17:03 |
*** imacdonn has joined #rdo | 17:03 | |
*** amoralej is now known as amoralej|off | 17:05 | |
*** holser_ has quit IRC | 17:06 | |
*** paragan has quit IRC | 17:06 | |
*** zaneb has quit IRC | 17:06 | |
*** zaneb has joined #rdo | 17:06 | |
pabelanger | sshnaidm|rover: sorry, -1 another thing to help protect ssh key | 17:07 |
pabelanger | then we are good | 17:07 |
rdogerrit | Sagi Shnaidman proposed config master: Use ssh key for upload in post playbook https://review.rdoproject.org/r/14786 | 17:07 |
sshnaidm|rover | pabelanger, can you please be more explainful in your comments?\ | 17:08 |
*** trown is now known as trown|lunch | 17:08 | |
pabelanger | sshnaidm|rover: see: https://docs.ansible.com/ansible/2.5/user_guide/playbooks_blocks.html#error-handling | 17:09 |
pabelanger | we want to add an always handler to the block, so we do ssh-add -D if we hit an exception for some reason | 17:09 |
pabelanger | because, this doesn't 100% make this job secure, since it is possible for somebody to attack the ssh-agent session. | 17:10 |
pabelanger | sshnaidm|rover: apevec: weshay: http://lists.openstack.org/pipermail/openstack-infra/2017-October/005606.html is the correct way to fix this, which I am going to push on upstream | 17:10 |
sshnaidm|rover | pabelanger, ok, I'll be back later, please review it again if you see something incorrect, because this way we can continue into night | 17:11 |
*** sshnaidm|rover is now known as sshnaidm|bbl | 17:12 | |
weshay | pabelanger, hrm.. I have concerns about the timing, not the content | 17:13 |
*** zaneb has quit IRC | 17:13 | |
weshay | pabelanger, if we don't refresh tripleo w/ a promotion shortly.. that is badf | 17:13 |
weshay | bad | 17:13 |
*** zaneb has joined #rdo | 17:13 | |
*** MrAbaddon has quit IRC | 17:15 | |
weshay | pabelanger? | 17:15 |
rdogerrit | Merged openstack/os-net-config-distgit rpm-master: Adding dependency for pyudev https://review.rdoproject.org/r/14760 | 17:16 |
pabelanger | weshay: https://review.rdoproject.org/r/#/c/14786/7/playbooks/legacy-tripleo-ci-periodic-base-upload/post.yaml@31 should be last step | 17:19 |
weshay | pabelanger, ok.. that is fine, so break that into it's own task.. and make it the last task.. | 17:20 |
weshay | pabelanger, I can update that review if sshnaidm|bbl has stepped away | 17:21 |
pabelanger | weshay: exactly, we always want it to run | 17:21 |
weshay | pabelanger, assuming sshnaidm|bbl's two reviews are good as a 1/2 step, until we're all ready to move forward w/ your upstream proposal | 17:21 |
weshay | oh.. that is a block | 17:21 |
weshay | so finally: | 17:22 |
weshay | k | 17:22 |
weshay | pabelanger, will do | 17:22 |
weshay | sec | 17:22 |
pabelanger | no | 17:22 |
pabelanger | always | 17:22 |
weshay | right | 17:22 |
weshay | k | 17:22 |
pabelanger | https://docs.ansible.com/ansible/2.5/user_guide/playbooks_blocks.html#error-handling | 17:22 |
pabelanger | but ya, this isn't 100% safe, but is better then what we have now | 17:22 |
apevec | weshay, we also need a new key, pubkey part sent to me so I can install it on images.r.o and privkey encrypted and added to secrets | 17:23 |
weshay | apevec, don't you guys host the file server? | 17:24 |
weshay | in this case.. the connection is from a job --> the file server | 17:24 |
weshay | apevec, why do you need me to create a key for that? | 17:24 |
*** zbitter has joined #rdo | 17:26 | |
weshay | apevec, I would think my team should have nothing to do w/ it | 17:26 |
apevec | pubkey is uploaded to server, correct, but I think job owner should own the key itself | 17:26 |
weshay | other than using the secret.. that is my understanding | 17:26 |
apevec | hmm | 17:26 |
*** zaneb has quit IRC | 17:26 | |
weshay | apevec, that does not compute to me | 17:26 |
apevec | pabelanger, ^ how does that work upstream, infra generates keypairs? | 17:26 |
*** racedo has quit IRC | 17:27 | |
weshay | basically it should be infra's key, as you guys grant access to the file server | 17:27 |
weshay | apevec, If I were smart.. I'd give you a key.. then I could actually get on the file server | 17:27 |
weshay | myself | 17:27 |
weshay | :) | 17:27 |
apevec | I'm pretty sure previous key centos@promote-server was generated on the promoter machine | 17:28 |
*** racedo has joined #rdo | 17:28 | |
pabelanger | right, this is the whole reason this approach is wrong. It means job users need to move around public / private keys. So who ever generated the new secret needs to send apevec the public key | 17:28 |
pabelanger | however, apevec could just generate it and update the secret himself | 17:28 |
pabelanger | that is the safe way | 17:29 |
apevec | alright then | 17:29 |
pabelanger | then nobody in tripleo know the key | 17:29 |
weshay | apevec, oh that is true.. the promoter server does need to rsync to the file server | 17:29 |
*** chkumar|ruck is now known as chandankumar | 17:29 | |
apevec | ah, so it's not just from the job? | 17:29 |
weshay | apevec, ya.. ur right ;) | 17:29 |
apevec | ok, then we might have separate keys, one as secret in the job and the other for promoter | 17:30 |
number80 | mrunge: can you retry collectd build without +W? According logs the koji task fails because NVR was already built (task failed at tagging) | 17:30 |
number80 | so I'd like to test if it will pick up credentials in scratch build | 17:30 |
mrunge | hmm ./ | 17:30 |
number80 | if it works, you can just merge and fix the tag manually | 17:31 |
mrunge | will do, after the meeting | 17:31 |
weshay | apevec, that sounds better.. two keys | 17:31 |
*** kgiusti has left #rdo | 17:31 | |
*** akrivoka has quit IRC | 17:32 | |
*** racedo_ has joined #rdo | 17:32 | |
weshay | apevec, pabelanger so it's just doing this https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/promote-images.sh | 17:33 |
weshay | so I assume the public key on the box is still valid as was not compromised | 17:33 |
weshay | cat id_rsa.pub | 17:34 |
weshay | ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLZN5VzPLMVpNYHlTi556eflK5chVlb5R9PhbEuGbe7MPlYicJDh+Ot6TwJPpF9+pdhc0to8An4r0xtjjCy6HhiDJUzWHrj53LGANXjQ9vLWRcamrst/yJhgmlSnRAD8NPloVlHkB2UF5X8DGpt+/WfqwBrHb+/So0OgbXhspAlA3T6KQXfF2KJ4tsUj40abYjah693WR5uIAETLVk7XeYwp9hvqqPjdZ+HHBc8uDr+IGTYyaCzTOwOcBHFM2k2wSOqJbJCIs9m4PIfkDH2h4fVuj83m0gfvfx4TWkEFzh2+xsgsuu/HHpOSmRnmmSXmWM4iPFVMVQaMeQ37xoPncl | 17:34 |
*** kgiusti has joined #rdo | 17:35 | |
pabelanger | weshay: we actually don't need that any more with zuulv3. We could totally right a native zuulv3 job to this now very easy from rdo zuul | 17:36 |
apevec | weshay, that's the one which was revoked yesterday | 17:36 |
pabelanger | and it would be much more secuire | 17:36 |
pabelanger | secure* | 17:36 |
weshay | pabelanger, it's more complicated than you think man | 17:36 |
weshay | pabelanger, we can talk about it.. but we need a design | 17:36 |
weshay | it's not just the image | 17:36 |
pabelanger | right | 17:36 |
*** baha has joined #rdo | 17:36 | |
pabelanger | but we could start with them | 17:37 |
weshay | ya | 17:37 |
weshay | totally | 17:37 |
weshay | pabelanger, at the same time.. we need to promote master | 17:37 |
apevec | Sagi just uploaded https://review.rdoproject.org/r/#/c/14786/8/zuul.d/secrets.yaml - what's the pubkey part for that one? | 17:37 |
pabelanger | weshay: yes, land your change to get promotion, then we can write a new job to do new promotion and validate | 17:37 |
pabelanger | then switch | 17:37 |
*** jatanmalde has quit IRC | 17:37 | |
number80 | 359318 | 17:38 |
weshay | aye | 17:38 |
chandankumar | number80: I think it is ubikey :-) | 17:39 |
number80 | chandankumar: indeed, I hate the nano for that :) | 17:39 |
apevec | weshay, are you uploading PS9 with always: ? | 17:39 |
weshay | yes | 17:40 |
weshay | sec | 17:40 |
weshay | weird issue w/ sublime | 17:40 |
apevec | nooo, proprietary text editor!? | 17:41 |
number80 | ed is the one true ed-itor | 17:41 |
rdogerrit | wes hayutin proposed config master: Use ssh key for upload in post playbook https://review.rdoproject.org/r/14786 | 17:43 |
weshay | proprietary | 17:44 |
weshay | geez | 17:44 |
apevec | weshay, need something to poke at you :) Back to topic: where is pubkey part of the key added in secrets in that review? | 17:45 |
weshay | :) | 17:45 |
weshay | plenty of better material | 17:45 |
*** sshnaidm|bbl is now known as sshnaidm|rover | 17:45 | |
sshnaidm|rover | apevec, sent you pub key | 17:45 |
sshnaidm|rover | pabelanger, did you finish the review? | 17:47 |
apevec | sshnaidm|rover, weshay - new key ready on server | 17:48 |
rdogerrit | Sagi Shnaidman proposed config master: Use ssh key for upload in post playbook https://review.rdoproject.org/r/14786 | 17:48 |
sshnaidm|rover | apevec, thanks | 17:49 |
pabelanger | sshnaidm|rover: comment, should noop but safer to remove | 17:50 |
sshnaidm|rover | pabelanger, why is it safer? | 17:50 |
rdogerrit | wes hayutin proposed config master: Use ssh key for upload in post playbook https://review.rdoproject.org/r/14786 | 17:51 |
weshay | ha.. sorry | 17:51 |
pabelanger | sshnaidm|rover: not sure if ssh-add -D with exit 1 if nothing to do | 17:51 |
pabelanger | I am assuming it is a noop | 17:51 |
pabelanger | return 0 | 17:51 |
sshnaidm|rover | pabelanger, why will it exit with -1 | 17:52 |
sshnaidm|rover | ? | 17:52 |
weshay | I like it in always: w/ the block | 17:52 |
weshay | good form | 17:52 |
pabelanger | sshnaidm|rover: I don't know, i an say it may if nothing to delete | 17:53 |
pabelanger | I haven't tested | 17:53 |
pabelanger | and no, return 0 | 17:53 |
pabelanger | just tested | 17:53 |
pabelanger | so, duplicate is fine just not needed | 17:54 |
apevec | it'd be confusing to leave it twice | 17:54 |
sshnaidm|rover | pabelanger, yeah, it's logical | 17:54 |
sshnaidm|rover | it's works like rm | 17:54 |
*** shailesh has joined #rdo | 17:54 | |
pabelanger | okay, +1 but needs rebased | 17:54 |
pabelanger | that should be better | 17:55 |
rdogerrit | Sagi Shnaidman proposed config master: Use ssh key for upload in post playbook https://review.rdoproject.org/r/14786 | 17:55 |
sshnaidm|rover | why need to rebase it every minute.. | 17:56 |
sshnaidm|rover | pabelanger, can you please take a last look that it's ok? | 17:56 |
pabelanger | yes, working to fix the rebase thing, it is annoying | 17:56 |
pabelanger | sshnaidm|rover: yes, look correct | 17:57 |
sshnaidm|rover | pabelanger, ok | 17:57 |
*** kopecmartin has quit IRC | 17:57 | |
*** zaneb has joined #rdo | 17:58 | |
*** zbitter has quit IRC | 17:58 | |
rdogerrit | Merged config master: Use ssh key for upload in post playbook https://review.rdoproject.org/r/14786 | 17:59 |
*** racedo_ has quit IRC | 18:01 | |
*** racedo has quit IRC | 18:02 | |
*** morazi has quit IRC | 18:05 | |
*** edmondsw has quit IRC | 18:07 | |
*** agopi is now known as agopi|lunch | 18:07 | |
*** edmondsw has joined #rdo | 18:07 | |
*** pkovar has joined #rdo | 18:11 | |
*** abhishekk{mbl} has quit IRC | 18:11 | |
*** assassin has quit IRC | 18:18 | |
*** sshnaidm|rover is now known as sshnaidm|off | 18:19 | |
pabelanger | dmsimard: finally getting around to test ara-report on logs.r.o, any ideas? https://logs.rdoproject.org/92/14792/1/check/hello-world/d06941c/ara-report/ | 18:20 |
*** morazi has joined #rdo | 18:21 | |
rdogerrit | rdo-trunk created openstack/openstackclient-distgit rpm-master: python-openstackclient: failed to build e4bbc3c https://review.rdoproject.org/r/14793 | 18:22 |
*** Schepeers has quit IRC | 18:23 | |
*** pkovar has quit IRC | 18:27 | |
number80 | https://review.rdoproject.org/r/#/c/14760/ should have waited upstream change to be accepted | 18:30 |
*** dneary has joined #rdo | 18:31 | |
*** trown|lunch is now known as trown | 18:32 | |
*** morazi has quit IRC | 18:35 | |
*** zul has quit IRC | 18:43 | |
*** zul has joined #rdo | 18:43 | |
*** dhill_ has quit IRC | 18:44 | |
*** dyasny__ has quit IRC | 18:44 | |
*** dyasny__ has joined #rdo | 18:45 | |
*** dhill_ has joined #rdo | 18:45 | |
*** Caterpillar2 has joined #rdo | 18:46 | |
*** Caterpillar has quit IRC | 18:47 | |
rdogerrit | pabelanger created config master: Sync openstack-post trigger with upstream https://review.rdoproject.org/r/14794 | 18:48 |
pabelanger | amoralej|off: ^ might help fix openstack-post | 18:48 |
pabelanger | I am unsure why jobs are failing to enqueue | 18:48 |
*** Caterpillar2 has quit IRC | 18:50 | |
pabelanger | weshay: apevec: btw: we have a new pipeline in zuul: https://zuul-ci.org/docs/zuul/user/config.html#value-pipeline.manager.supercedent which I think will make promotion for tripleo much faster, basic idea is we create a new pipeline that is always enqueue changes on timer and post, to get much close to CD for promotions. The trick, is ensuring we have enough resources to CD promotions and rdo jobs | 18:59 |
* weshay looks | 18:59 | |
pabelanger | we first need to patch zuul due to a bug: https://review.openstack.org/581553/ but once landed, there cost to do it on zuul side is minimal | 18:59 |
weshay | pabelanger, so wait.. the changes between drln hash $1 and dlrn hash $2 would be broken down and tested w/ a bunch of jobs? | 19:00 |
*** agopi|lunch is now known as agopi | 19:01 | |
pabelanger | weshay: broken down? | 19:01 |
weshay | pabelanger, is supercedent used to test say.. each openstack component | 19:02 |
pabelanger | no, it works like check and periodic does today | 19:03 |
pabelanger | gate would be dependant | 19:03 |
weshay | k | 19:03 |
weshay | pabelanger, OH.. | 19:04 |
pabelanger | the idea is, supercedent would continuously enqueue tripleo-ci jobs every x minutes, to a max of current and next. When it triggered again, nothing would be added to the pipeline | 19:04 |
pabelanger | so, you could continuously deploy promotions safely without backing jobs in the pipeline | 19:04 |
weshay | so for unmerged changes on puppet-tripleo say.. 5 of them are in queue | 19:04 |
weshay | this tests all 5 at once? | 19:04 |
weshay | pabelanger, I don't think so bro | 19:04 |
weshay | pabelanger, join my blue | 19:04 |
pabelanger | weshay: url | 19:05 |
weshay | https://bluejeans.com/u/whayutin/ | 19:05 |
*** dciabrin has quit IRC | 19:07 | |
*** dciabrin has joined #rdo | 19:07 | |
*** puzzled has quit IRC | 19:11 | |
*** dneary has quit IRC | 19:11 | |
*** dneary has joined #rdo | 19:12 | |
*** radeks has quit IRC | 19:12 | |
*** atoth has quit IRC | 19:14 | |
rdogerrit | Ronelle Landy proposed config master: WIP: Add Browbeat jobs https://review.rdoproject.org/r/14772 | 19:18 |
*** Caterpillar has joined #rdo | 19:23 | |
*** dyasny__ has quit IRC | 19:25 | |
rdogerrit | Ronelle Landy proposed config master: WIP: Add Browbeat jobs https://review.rdoproject.org/r/14772 | 19:26 |
*** amuller has quit IRC | 19:27 | |
*** jmlowe has joined #rdo | 19:30 | |
*** ktibi has quit IRC | 19:34 | |
*** dyasny has joined #rdo | 19:42 | |
*** edmondsw has quit IRC | 19:42 | |
*** tshefi has quit IRC | 19:42 | |
*** edmondsw has joined #rdo | 19:43 | |
*** gkadam has quit IRC | 19:54 | |
*** tshefi has joined #rdo | 19:56 | |
*** zaneb has quit IRC | 19:59 | |
*** zaneb has joined #rdo | 20:00 | |
number80 | pabelanger: I +2+w https://review.rdoproject.org/r/#/c/14794/ | 20:01 |
number80 | let's try it | 20:01 |
number80 | big soccer game right now, do not expect much presence from EMEA :0 | 20:02 |
rdogerrit | Merged config master: Sync openstack-post trigger with upstream https://review.rdoproject.org/r/14794 | 20:02 |
rdogerrit | Ronelle Landy proposed config master: WIP: Add Browbeat jobs https://review.rdoproject.org/r/14772 | 20:03 |
*** dneary has quit IRC | 20:04 | |
*** pchavva has quit IRC | 20:04 | |
*** alexpilotti has joined #rdo | 20:05 | |
*** mjturek has quit IRC | 20:13 | |
*** jlibosva has quit IRC | 20:14 | |
pabelanger | number80: thanks | 20:15 |
*** dprince has quit IRC | 20:16 | |
*** holser_ has joined #rdo | 20:21 | |
*** eharney has quit IRC | 20:21 | |
*** rdopiera has quit IRC | 20:26 | |
*** mjturek has joined #rdo | 20:27 | |
*** shreshtha_ has quit IRC | 20:27 | |
*** mjturek has quit IRC | 20:28 | |
*** shreshtha_ has joined #rdo | 20:34 | |
*** kgiusti has left #rdo | 20:35 | |
*** mjturek has joined #rdo | 20:36 | |
amoralej|off | congrats apevec , well done croatia! | 20:42 |
apevec | yeah, mhu, fbo - your team better be ready :) | 20:44 |
mhu | apevec, with one extra day of resting + the fact that Croatia pretty much played an extra game's worth in overtime ... I think France should be ready ;) | 20:45 |
*** zul has quit IRC | 20:47 | |
*** mjturek has quit IRC | 20:50 | |
*** mjturek has joined #rdo | 20:53 | |
*** akhilaki has joined #rdo | 20:56 | |
rdogerrit | User mjturek proposed rdo-infra/ci-config master: Add test-day-tools-ppc64le job https://review.rdoproject.org/r/14739 | 21:01 |
*** trown is now known as trown|outtypewww | 21:03 | |
*** baha has quit IRC | 21:03 | |
*** tvignaud has joined #rdo | 21:05 | |
*** mjturek has quit IRC | 21:08 | |
*** ccamacho has quit IRC | 21:19 | |
*** jtomasek has quit IRC | 21:20 | |
*** mjturek has joined #rdo | 21:24 | |
*** mjturek has quit IRC | 21:25 | |
*** mjturek has joined #rdo | 21:27 | |
*** jmlowe has quit IRC | 21:29 | |
*** athomas has quit IRC | 21:37 | |
*** jayg is now known as jayg|g0n3 | 21:39 | |
*** agopi is now known as agopi|off | 21:39 | |
*** holser_ has quit IRC | 21:42 | |
*** agopi|off has quit IRC | 21:44 | |
*** brault has quit IRC | 21:45 | |
*** jmlowe has joined #rdo | 21:45 | |
akhilaki | looking to write a spec file for rpm, any suggestions for resources to go about writing a spec? | 21:47 |
*** mjturek has quit IRC | 21:49 | |
*** morazi has joined #rdo | 21:50 | |
*** mjturek has joined #rdo | 21:52 | |
alphacc | pabelanger: we can discuss koji/kerberos at next cbs on Monday. I am not sure what we can do at this time, afaik there is no kerberos realm for centos infra, but let's bring it up to the meeting and see. | 21:52 |
*** jcoufal has joined #rdo | 21:55 | |
*** rh-jelabarre has quit IRC | 21:56 | |
*** brault has joined #rdo | 22:00 | |
*** brault has quit IRC | 22:05 | |
*** Schepeers has joined #rdo | 22:10 | |
*** zul has joined #rdo | 22:13 | |
*** mjturek has quit IRC | 22:15 | |
*** rcernin has joined #rdo | 22:15 | |
*** agopi has joined #rdo | 22:19 | |
*** jcoufal has quit IRC | 22:22 | |
*** holser_ has joined #rdo | 22:23 | |
*** dustins has quit IRC | 22:31 | |
*** agopi has quit IRC | 22:32 | |
*** jcoufal has joined #rdo | 22:34 | |
*** Son_Goku has joined #rdo | 22:35 | |
*** owalsh_ has joined #rdo | 22:39 | |
*** sasha2 has quit IRC | 22:42 | |
*** owalsh has quit IRC | 22:43 | |
*** owalsh has joined #rdo | 22:47 | |
*** owalsh_ has quit IRC | 22:48 | |
*** ddmitriev has quit IRC | 22:49 | |
*** ddmitriev has joined #rdo | 22:50 | |
*** mcornea has quit IRC | 22:58 | |
*** apevec has quit IRC | 23:00 | |
*** Son_Goku has quit IRC | 23:03 | |
*** rlandy has quit IRC | 23:10 | |
*** edmondsw has quit IRC | 23:12 | |
*** edmondsw has joined #rdo | 23:13 | |
*** sasha2 has joined #rdo | 23:15 | |
*** edmondsw has quit IRC | 23:17 | |
*** jcoufal has quit IRC | 23:18 | |
*** jcoufal has joined #rdo | 23:25 | |
*** tosky has quit IRC | 23:35 | |
*** holser_ has quit IRC | 23:37 | |
*** rpioso is now known as rpioso|afk | 23:44 | |
*** akhilaki has quit IRC | 23:50 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!