| *** threestrands has joined #rdo | 00:03 | |
| *** threestrands has quit IRC | 00:03 | |
| *** threestrands has joined #rdo | 00:03 | |
| rdogerrit | rdo-trunk proposed rdoinfo master: Bump rdoinfo rocky-uc tags to latest upper-constraints https://review.rdoproject.org/r/14650 | 00:09 |
|---|---|---|
| *** dyasny_ has joined #rdo | 00:35 | |
| *** toddnni_ has joined #rdo | 00:36 | |
| *** toddnni has quit IRC | 00:36 | |
| *** chasmo77 has quit IRC | 00:37 | |
| *** toddnni_ is now known as toddnni | 00:37 | |
| *** chasmo77 has joined #rdo | 00:37 | |
| *** dyasny has quit IRC | 00:38 | |
| *** bandini has quit IRC | 00:41 | |
| *** bandini has joined #rdo | 00:42 | |
| *** Son_Goku has joined #rdo | 00:54 | |
| *** edmondsw has joined #rdo | 01:04 | |
| *** edmondsw has quit IRC | 01:08 | |
| *** dmacpher has quit IRC | 01:12 | |
| *** dmacpher has joined #rdo | 01:13 | |
| *** Son_Goku has quit IRC | 01:15 | |
| *** threestrands_ has joined #rdo | 01:18 | |
| *** threestrands_ has quit IRC | 01:19 | |
| *** threestrands_ has joined #rdo | 01:20 | |
| *** threestrands_ has quit IRC | 01:21 | |
| *** threestrands_ has joined #rdo | 01:21 | |
| *** threestrands_ has quit IRC | 01:21 | |
| *** threestrands_ has joined #rdo | 01:21 | |
| *** threestrands has quit IRC | 01:21 | |
| *** Son_Goku has joined #rdo | 01:39 | |
| *** paragan has joined #rdo | 01:41 | |
| *** Son_Goku has quit IRC | 02:04 | |
| *** Son_Goku has joined #rdo | 02:24 | |
| *** edmondsw has joined #rdo | 02:52 | |
| *** edmondsw has quit IRC | 02:57 | |
| *** ramishra has joined #rdo | 03:20 | |
| *** atoth has quit IRC | 03:35 | |
| *** lkuchlan has joined #rdo | 03:55 | |
| *** shreshtha has joined #rdo | 03:57 | |
| *** Son_Goku has quit IRC | 04:28 | |
| *** ykarel|away has joined #rdo | 04:35 | |
| *** Amita has joined #rdo | 04:38 | |
| *** ykarel|away is now known as ykarel | 04:39 | |
| ykarel | tristanC, hi | 04:39 |
| ykarel | tristanC, can you review pike/ocata ones https://review.rdoproject.org/r/#/q/topic:fix-openstack-periodic-dlrnapi-password | 04:39 |
| *** edmondsw has joined #rdo | 04:40 | |
| *** Amita has quit IRC | 04:41 | |
| *** Amita has joined #rdo | 04:41 | |
| tristanC | ykarel: looks good to me, do you want it merged now or can we wait for javier? | 04:43 |
| *** edmondsw has quit IRC | 04:44 | |
| ykarel | tristanC, it would be good if you merge. so i can test some jobs to see if we move forward | 04:44 |
| tristanC | ykarel: sure, i +3 the changes. | 04:45 |
| ykarel | tristanC, Thanks | 04:45 |
| rdogerrit | Merged config master: Import promote-consistent job from rdo-jobs to use dlrnapi secret https://review.rdoproject.org/r/14694 | 04:48 |
| *** cshastri has joined #rdo | 04:48 | |
| tristanC | ykarel: i think we still have a bug with gerrit hosted at a subpath, 14695 should have been automatically moved to the gate... | 04:52 |
| tristanC | ykarel: i mean thank you for doing the recheck, but that seems like a bug and it shouldn't be needed | 04:53 |
| ykarel | tristanC, i have seen earlier also it doesn't move automatically | 04:53 |
| ykarel | i think i have seen this in upstream zuul and gerrit as well | 04:53 |
| tristanC | ykarel: oh? i thought it would have been fixed by https://review.openstack.org/#/c/579086/, but maybe it's something else then | 04:54 |
| rdogerrit | TristanCacqueray proposed rdo-jobs master: Remove pike/ocata promote-consistent job https://review.rdoproject.org/r/14695 | 04:55 |
| ykarel | tristanC, not sure, so ^^(gerrit url change) is required? | 04:56 |
| tristanC | ykarel: it shouldn't, it's just a test | 04:56 |
| ykarel | okk | 04:56 |
| tristanC | well as long as depends-on prevent merge until parent is merged, it's more of an annoyance :) | 04:57 |
| ykarel | hmm | 04:57 |
| rdogerrit | Merged rdo-jobs master: Remove pike/ocata promote-consistent job https://review.rdoproject.org/r/14695 | 04:59 |
| *** links has joined #rdo | 05:00 | |
| *** chandankumar has joined #rdo | 05:08 | |
| *** chandankumar is now known as chkumar|ruck | 05:08 | |
| *** lkuchlan has quit IRC | 05:08 | |
| *** sbulage has joined #rdo | 05:09 | |
| rdogerrit | Yatin Karel created config master: Import containers-build from rdo-jobs to use rdo_registry secret https://review.rdoproject.org/r/14699 | 05:12 |
| rdogerrit | Yatin Karel proposed config master: Import containers-build from rdo-jobs to use rdo_registry secret https://review.rdoproject.org/r/14699 | 05:13 |
| ykarel | chkumar|ruck, ^^ | 05:13 |
| chkumar|ruck | ykarel, we need this one first https://review.rdoproject.org/r/#/c/14693/ | 05:15 |
| rdogerrit | Yatin Karel proposed config master: Import containers-build from rdo-jobs to use rdo_registry secret https://review.rdoproject.org/r/14699 | 05:15 |
| ykarel | chkumar|ruck, yup added depends on that | 05:15 |
| rdogerrit | Yatin Karel created rdo-jobs master: Remove containers-build jobs https://review.rdoproject.org/r/14700 | 05:21 |
| *** s1061123 has quit IRC | 05:24 | |
| ykarel | tristanC, hi | 05:25 |
| ykarel | tristanC, can i test this config project change: https://review.rdoproject.org/r/#/c/14699/ | 05:26 |
| tristanC | ykarel: are those moved from rdo-jobs? | 05:29 |
| ykarel | tristanC, yes | 05:29 |
| tristanC | yep, i see | 05:29 |
| *** DV has quit IRC | 05:32 | |
| tristanC | ykarel: i guess those jobs aren't working, so i'm fine with merging them. let me know if you need a +3 | 05:33 |
| tristanC | aren't working atm* | 05:33 |
| ykarel | tristanC, yup they are not working | 05:33 |
| ykarel | so good to test them them | 05:33 |
| *** flg has joined #rdo | 05:33 | |
| tristanC | let me try to update the depends-on url format before approving the parent | 05:33 |
| ykarel | tristanC, these can only be tested after merge? | 05:33 |
| ykarel | tristanC, okk | 05:34 |
| rdogerrit | TristanCacqueray proposed config master: Import containers-build from rdo-jobs to use rdo_registry secret https://review.rdoproject.org/r/14699 | 05:34 |
| tristanC | ykarel: yes, jobs that uses secrets are only executed after merge, this is to prevent a change to dump a secret for example | 05:34 |
| ykarel | tristanC, okk | 05:34 |
| *** DV has joined #rdo | 05:35 | |
| tristanC | this is call "non-speculative" state, as oposed to untrusted-projects that are executed speculatively | 05:35 |
| ykarel | tristanC, Okk | 05:35 |
| chkumar|ruck | tristanC, hey | 05:36 |
| chkumar|ruck | tristanC, http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-centos-7-queens-promote-consistent-to-tripleo-ci-testing/f20f5c9/job-output.txt.gz | 05:36 |
| chkumar|ruck | tristanC, 2018-07-09 04:52:03.289977 | primary | Output suppressed because no_log was given | 05:36 |
| chkumar|ruck | tristanC, http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-centos-7-master-promote-consistent-to-tripleo-ci-testing/707cd31/job-output.txt.gz | 05:36 |
| chkumar|ruck | this one is also hitting | 05:36 |
| rdogerrit | Merged config master: Add secret for RDO Registry token https://review.rdoproject.org/r/14693 | 05:37 |
| ykarel | tristanC, ^^ one is the parent job for containers job | 05:37 |
| ykarel | so need to look at this first | 05:37 |
| chkumar|ruck | tristanC, How we can enable hyperlinks with timestamps in rdoproject logs? | 05:38 |
| tristanC | chkumar|ruck: we'll have to install os-loganalyze, not sure what's going on with logs.rdoproject.org | 05:39 |
| rdogerrit | Merged config master: Import containers-build from rdo-jobs to use rdo_registry secret https://review.rdoproject.org/r/14699 | 05:40 |
| *** holser_ has joined #rdo | 05:40 | |
| ykarel | chkumar|ruck, tristanC so legacy-periodic-tripleo-centos-7-queens-promote-consistent-to-tripleo-ci-testing passed once https://review.rdoproject.org/zuul3/builds.html | 05:41 |
| chkumar|ruck | ykarel, 2018-07-06T10:49:32 it is hitting post filaure | 05:42 |
| chkumar|ruck | ykarel, https://review.rdoproject.org/zuul3/builds.html?job_name=legacy-periodic-tripleo-centos-7-queens-promote-consistent-to-tripleo-ci-testing | 05:43 |
| rdogerrit | TristanCacqueray created config master: tripleo-ci-periodic-base: remove no_log from post task https://review.rdoproject.org/r/14701 | 05:43 |
| tristanC | chkumar|ruck: 14701 ^ should remove the no_log, though we verify the script doesn't output the password when we merge this | 05:43 |
| tristanC | we need* to verify | 05:44 |
| ykarel | chkumar|ruck, need to clear FTBFS:- https://review.rdoproject.org/r/#/c/14682/ | 05:47 |
| chkumar|ruck | ykarel, link of ftbfs | 05:48 |
| chkumar|ruck | ykarel, this one is merged | 05:48 |
| chkumar|ruck | ykarel, https://review.rdoproject.org/r/#/c/14648/ | 05:49 |
| chkumar|ruck | ykarel, fedora dlrn builder is failing | 05:49 |
| chkumar|ruck | ykarel, 2018-07-06 16:55:37.763393 | rdo-fedora-28 | 2018-07-06 16:55:37,763 INFO:dlrn-build-mock:No matching package to install: 'python2-distro' | 05:49 |
| chkumar|ruck | 2018-07-06 16:55:37.763472 | rdo-fedora-28 | 2018-07-06 16:55:37,763 INFO:dlrn-build-mock:No matching package to install: 'python2-gunicorn' | 05:49 |
| *** kopecmartin has joined #rdo | 05:50 | |
| *** avivgt has quit IRC | 05:51 | |
| *** janki has joined #rdo | 05:53 | |
| *** quiquell|off is now known as quiquell | 05:53 | |
| *** avivgt has joined #rdo | 05:53 | |
| ykarel | chkumar|ruck, those needs to be added to fedora-stbale | 05:55 |
| ykarel | i mean fedora-stable-base | 05:56 |
| chkumar|ruck | ykarel, https://review.rdoproject.org/r/#/c/14648/2 please vote it | 05:56 |
| chkumar|ruck | ykarel, done | 05:57 |
| ykarel | chkumar|ruck, Okk | 05:57 |
| *** mosulica has joined #rdo | 05:58 | |
| *** avivgt has quit IRC | 05:58 | |
| *** jfrancoa has joined #rdo | 06:04 | |
| chkumar|ruck | tristanC, how to verify this one https://review.rdoproject.org/r/#/c/14701/ ? | 06:05 |
| rdogerrit | Merged openstack/octavia-distgit rpm-master: Add python-distro as a requirement https://review.rdoproject.org/r/14648 | 06:05 |
| *** iranzo has joined #rdo | 06:05 | |
| *** iranzo has quit IRC | 06:05 | |
| *** iranzo has joined #rdo | 06:05 | |
| chkumar|ruck | tristanC, Do we directly merge it and rretrigger the failed jobs? | 06:07 |
| tristanC | chkumar|ruck: yes, we have to merge config change to make them effective | 06:08 |
| tristanC | chkumar|ruck: though we should probably wait for amoralej|off and jpena|off before +3 14701... i don't want to look dlrnapi secret by mistake | 06:08 |
| chkumar|ruck | tristanC, sure | 06:09 |
| *** ksambor has joined #rdo | 06:09 | |
| *** nyechiel_ has joined #rdo | 06:09 | |
| *** cylopez has joined #rdo | 06:09 | |
| *** matbu has joined #rdo | 06:11 | |
| *** paramite has joined #rdo | 06:11 | |
| *** cylopez has left #rdo | 06:13 | |
| *** egonzalez has joined #rdo | 06:14 | |
| *** tshefi has joined #rdo | 06:14 | |
| *** holser_ has quit IRC | 06:19 | |
| *** rbartal has joined #rdo | 06:19 | |
| *** quiquell is now known as quiquell|bbl | 06:19 | |
| rdogerrit | Yatin Karel created rdo-infra/fedora-stable-config master: Add packages required by octavia https://review.rdoproject.org/r/14702 | 06:22 |
| ykarel | hmm looks like fedora is failing from long for dependencies other than python2-distro | 06:24 |
| *** agurenko has joined #rdo | 06:27 | |
| ykarel | chkumar|ruck, hmm jpena|off is on PTO so let's wait for amoralej|off | 06:28 |
| *** edmondsw has joined #rdo | 06:28 | |
| ykarel | tristanC, so what happens until https://review.rdoproject.org/r/#/c/14700/ merges | 06:29 |
| ykarel | as same job exist at two places | 06:29 |
| tristanC | ykarel: it generates an errors, atm you can see them by manually checking https://review.rdoproject.org/zuul3/api/config-errors | 06:30 |
| tristanC | (note that fbo has a patch to render them in the ui: https://review.openstack.org/#/c/554652/ ) | 06:31 |
| tristanC | so that means the job is not loaded from rdo-jobs | 06:31 |
| tristanC | and you can confirm that on this page: https://review.rdoproject.org/zuul3/job.html?job_name=legacy-periodic-tripleo-centos-7-master-containers-build (see the panel-heading) | 06:32 |
| tristanC | or on the job list: https://review.rdoproject.org/zuul3/jobs.html , by clicking the "location" button next to the job | 06:32 |
| *** edmondsw has quit IRC | 06:33 | |
| ykarel | tristanC, Okk Thanks | 06:35 |
| tristanC | ykarel: you're welcome | 06:36 |
| ykarel | so you can you vote https://review.rdoproject.org/r/#/c/14700/ | 06:36 |
| *** egonzalez has quit IRC | 06:37 | |
| rdogerrit | Yatin Karel proposed rdo-infra/fedora-stable-config master: Add packages required by octavia https://review.rdoproject.org/r/14702 | 06:38 |
| rdogerrit | chkumar246 proposed rdo-infra/ci-config master: Remove 'Result' field from Failing check jobs (noop) https://review.rdoproject.org/r/14598 | 06:39 |
| *** ccamacho has joined #rdo | 06:39 | |
| *** aufi has joined #rdo | 06:39 | |
| *** cNilesh has joined #rdo | 06:43 | |
| *** cNilesh is now known as cNilesh|wfh | 06:45 | |
| *** hseipp has joined #rdo | 06:48 | |
| *** sbulage is now known as sbulage|brb | 06:50 | |
| *** rdopiera has joined #rdo | 06:51 | |
| rdogerrit | Yatin Karel proposed rdoinfo master: CBS tags sync with uc for rocky-candidate https://review.rdoproject.org/r/14173 | 06:53 |
| *** jtomasek has joined #rdo | 06:53 | |
| *** cshastri has quit IRC | 06:54 | |
| *** cshastri has joined #rdo | 06:55 | |
| *** radeks has joined #rdo | 06:55 | |
| *** jpich has joined #rdo | 06:58 | |
| *** emalikov has joined #rdo | 06:59 | |
| *** nyechiel has joined #rdo | 07:00 | |
| *** nyechiel_ has quit IRC | 07:01 | |
| *** jlibosva has joined #rdo | 07:04 | |
| *** peereb has joined #rdo | 07:05 | |
| *** florianf has joined #rdo | 07:06 | |
| *** tesseract has joined #rdo | 07:06 | |
| *** rcernin has quit IRC | 07:08 | |
| *** ragiman has joined #rdo | 07:13 | |
| *** apevec has joined #rdo | 07:14 | |
| *** apevec has quit IRC | 07:14 | |
| *** apevec has joined #rdo | 07:14 | |
| *** fbo|off is now known as fbo | 07:15 | |
| chkumar|ruck | ykarel, https://bugs.launchpad.net/tripleo/+bug/1780726 | 07:15 |
| openstack | Launchpad bug 1780726 in tripleo "[master][queens][pike][ocata] Base periodic jobs are broken after zuul v3 migration " [Critical,Triaged] | 07:15 |
| *** cylopez has joined #rdo | 07:15 | |
| *** ragiman has quit IRC | 07:15 | |
| ykarel | chkumar|ruck, ack | 07:15 |
| *** cylopez has left #rdo | 07:17 | |
| *** ragiman has joined #rdo | 07:20 | |
| *** amoralej|off is now known as amoralej | 07:21 | |
| amoralej | good morning | 07:21 |
| ykarel | o/ | 07:22 |
| chkumar|ruck | amoralej, please have a look on this https://review.rdoproject.org/r/#/c/14701/ | 07:23 |
| *** sbulage|brb is now known as sbulage|afk | 07:23 | |
| chkumar|ruck | amoralej, related bz https://bugs.launchpad.net/tripleo/+bug/1780726 | 07:23 |
| openstack | Launchpad bug 1780726 in tripleo "[master][queens][pike][ocata] Base periodic jobs are broken after zuul v3 migration " [Critical,Triaged] | 07:23 |
| apevec | 14701 is missing WHY in the commit msg | 07:24 |
| apevec | tristanC, ^ | 07:24 |
| *** tesseract has quit IRC | 07:25 | |
| amoralej | let me check | 07:25 |
| apevec | chkumar|ruck, 14701 is not mentioned in lp 1780726 ? | 07:25 |
| openstack | Launchpad bug 1780726 in tripleo "[master][queens][pike][ocata] Base periodic jobs are broken after zuul v3 migration " [Critical,Triaged] https://launchpad.net/bugs/1780726 | 07:25 |
| chkumar|ruck | apevec, added, thanks :-) | 07:27 |
| *** tesseract has joined #rdo | 07:27 | |
| amoralej | approved | 07:28 |
| amoralej | it's the same we did for current-ci-testing and worked | 07:28 |
| apevec | so why is that? | 07:29 |
| rdogerrit | Merged config master: tripleo-ci-periodic-base: remove no_log from post task https://review.rdoproject.org/r/14701 | 07:29 |
| amoralej | i'm not sure, but adding DLRNAPI_PASSWORD to the environment instead of in the export seems much cleaner | 07:29 |
| *** DV has quit IRC | 07:30 | |
| *** jparrill has quit IRC | 07:30 | |
| amoralej | last friday we merged https://review.rdoproject.org/r/#/c/14673/ and fixed it | 07:30 |
| apevec | yeah, that part is fine, I wonder about removing no_log | 07:30 |
| *** DV has joined #rdo | 07:30 | |
| apevec | is it just to make debugging easier? | 07:30 |
| ykarel | yes | 07:30 |
| chkumar|ruck | ykarel, apevec https://review.rdoproject.org/r/#/c/14646/ | 07:31 |
| *** jparrill has joined #rdo | 07:31 | |
| *** DV has quit IRC | 07:32 | |
| *** d0ugal_ has quit IRC | 07:33 | |
| *** d0ugal has joined #rdo | 07:33 | |
| *** d0ugal has quit IRC | 07:33 | |
| *** d0ugal has joined #rdo | 07:33 | |
| *** avivgt has joined #rdo | 07:33 | |
| apevec | amoralej, there's test-amoralej in rdo-nodepool, do you still need it or can you delete it so we can clean up that tenant? | 07:34 |
| amoralej | no, let me delete it | 07:34 |
| *** tosky has joined #rdo | 07:35 | |
| amoralej | done | 07:35 |
| *** DV has joined #rdo | 07:35 | |
| ykarel | amoralej, i think we need to rearrange parent for tripleo-ci-testing jobs, it's running ci-scripts/tripleo-upstream/promote-hash.sh twice once in job and once in post of parent job:- legacy-tripleo-ci-periodic-base | 07:36 |
| amoralej | mmm | 07:36 |
| apevec | amoralej, thanks | 07:37 |
| ykarel | amoralej, so parent one is failing, which has missing secret, should be ok after https://review.rdoproject.org/r/#/c/14701 | 07:38 |
| ykarel | i think this will pass this time | 07:38 |
| ykarel | as secret are added there | 07:38 |
| amoralej | ykarel, i think we are not running promote-hash.sh twice | 07:41 |
| tristanC | apevec: oops, it was to help debug post failure | 07:41 |
| amoralej | we are running it one in job post and in legacy-tripleo-ci-periodic-base we just run dlrnapi_report.sh | 07:41 |
| rdogerrit | Yatin Karel created config master: Reschedule openstack-periodic https://review.rdoproject.org/r/14704 | 07:41 |
| ykarel | amoralej, to run in next 18 minutes ^^ | 07:42 |
| *** nyechiel_ has joined #rdo | 07:42 | |
| *** nyechiel has quit IRC | 07:42 | |
| *** quiquell|bbl is now known as quiquell | 07:43 | |
| *** cNilesh|wfh has quit IRC | 07:43 | |
| *** cNilesh|wfh has joined #rdo | 07:44 | |
| ykarel | amoralej, yeah correct i misslooked that was dlrnapi_report.sh | 07:44 |
| ykarel | so we are good | 07:44 |
| amoralej | yeah | 07:44 |
| ykarel | let's rerun the pipeline | 07:45 |
| rdogerrit | Merged config master: Reschedule openstack-periodic https://review.rdoproject.org/r/14704 | 07:45 |
| ykarel | amoralej, also have a look at https://review.rdoproject.org/r/#/c/14700/ | 07:45 |
| ykarel | amoralej, tristanC config-update post not yet started:- https://review.rdoproject.org/zuul3/status.html | 07:52 |
| ykarel | is it waiting for node? | 07:52 |
| amoralej | afaik in zuulv3 no config-update post is needed | 07:53 |
| amoralej | but tristanC knows it much better that me | 07:53 |
| *** cshastri has quit IRC | 07:54 | |
| tristanC | apevec: added a comment to the review | 07:54 |
| tristanC | ykarel: amoralej: config-update is still needed with zuulv3, it's the same job as before, it will create resources on gerrit if needed | 07:54 |
| tristanC | it doesn't need a node as it run directly from the executor | 07:55 |
| ykarel | tristanC, Okk. it's running now | 07:55 |
| tristanC | it was just stuck waiting for merger job. On the the ui, when you click a change, if the job list doesn't appear, that means noderequest hasn't even started | 07:55 |
| tristanC | zuul needs to schedule a merger job to check in-repo configuration to generate the job list and schedule job execution | 07:56 |
| *** abregman has joined #rdo | 07:56 | |
| rdogerrit | Merged rdo-jobs master: Remove containers-build jobs https://review.rdoproject.org/r/14700 | 07:56 |
| *** abregman has quit IRC | 07:57 | |
| ykarel | tristanC, Okk Thanks | 07:57 |
| *** rpittau has joined #rdo | 07:57 | |
| *** abregman has joined #rdo | 07:58 | |
| *** egonzalez has joined #rdo | 08:00 | |
| *** lkuchlan has joined #rdo | 08:01 | |
| *** racedo has joined #rdo | 08:01 | |
| *** zigo has quit IRC | 08:03 | |
| *** zigo has joined #rdo | 08:05 | |
| *** ykarel is now known as ykarel|lunch | 08:08 | |
| ykarel|lunch | amoralej, new error:- "msg": "The task includes an option with an undefined variable. The error was: 'toci_jobtype' is undefined | 08:11 |
| *** athomas has joined #rdo | 08:11 | |
| ykarel|lunch | ok not new, detected from removeal of no_log | 08:12 |
| apevec | that sounds familiar, sshnaidm was talking to Paul about that last week | 08:12 |
| *** threestrands_ has quit IRC | 08:12 | |
| *** dbecker has joined #rdo | 08:15 | |
| *** athomas has quit IRC | 08:15 | |
| *** edmondsw has joined #rdo | 08:16 | |
| *** athomas has joined #rdo | 08:20 | |
| *** edmondsw has quit IRC | 08:21 | |
| *** racedo_ has joined #rdo | 08:21 | |
| *** panda|off is now known as panda | 08:26 | |
| *** derekh has joined #rdo | 08:29 | |
| *** akrivoka has joined #rdo | 08:29 | |
| rdogerrit | hguemar proposed openstack/oslo-config-distgit rpm-master: Add oslo-log as BR https://review.rdoproject.org/r/14539 | 08:31 |
| chkumar|ruck | amoralej, I want to install os-loganalyze on logs.rdoproject.org how to do that or where to send patch? Currently problem with logs.rdoproject.org, I cannot hyperlink against the timestamp | 08:34 |
| amoralej | chkumar|ruck, no idea at all tbh | 08:37 |
| *** jatanmalde has joined #rdo | 08:37 | |
| rdogerrit | Merged openstack/oslo-config-distgit rpm-master: Add oslo-log as BR https://review.rdoproject.org/r/14539 | 08:38 |
| *** ramishra has quit IRC | 08:39 | |
| *** derekh has quit IRC | 08:39 | |
| *** derekh has joined #rdo | 08:40 | |
| *** holser_ has joined #rdo | 08:43 | |
| *** gvrangan has joined #rdo | 08:45 | |
| *** ramishra has joined #rdo | 08:45 | |
| chkumar|ruck | amoralej, number80 https://review.rdoproject.org/r/#/c/14702/2 | 08:47 |
| *** ykarel|lunch is now known as ykarel | 08:49 | |
| ykarel | apevec, amoralej this was the patch for toci_jobtype, need to fix consistent-to-tripleo-ci-testing one | 08:55 |
| apevec | chkumar|ruck, re. logs.rdo - add comment in https://bugzilla.redhat.com/show_bug.cgi?id=1543518 - we'll need to include it into rdo-infra playbooks | 08:56 |
| openstack | bugzilla.redhat.com bug 1543518 in Infrastructure "Add config required to support a README file as a footer in the tripleo ci logs" [Medium,New] - Assigned to jpena | 08:56 |
| apevec | it will wait for Javier to come back from pto, unless it's urgent | 08:57 |
| amoralej | yes, let's wait for jpena if possible | 08:57 |
| apevec | we need to review the whole infra backlog in https://bugzilla.redhat.com/buglist.cgi?component=Infrastructure&product=RDO | 08:57 |
| *** sshnaidm|off is now known as sshnaidm|rover | 09:02 | |
| *** cshastri has joined #rdo | 09:03 | |
| *** ktibi has joined #rdo | 09:05 | |
| *** ktibi has quit IRC | 09:05 | |
| *** racedo_ has quit IRC | 09:06 | |
| ykarel | amoralej, we don't need dlrnapi-report.sh in consistent-to-tripleo-ci-testing:- https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/jobs/tripleo-upstream.yml#L190-L202 | 09:07 |
| sshnaidm|rover | ykarel, hi, where is the error with toci_jobtype? | 09:07 |
| ykarel | sshnaidm|rover, https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-centos-7-queens-promote-consistent-to-tripleo-ci-testing/fcdd388/job-output.txt.gz | 09:08 |
| ykarel | sshnaidm|rover, it's using base job which runs dlrnapi_report.sh but we don't need in this job | 09:08 |
| ykarel | https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/jobs/tripleo-upstream.yml#L190-L202 | 09:08 |
| *** Goneri has joined #rdo | 09:08 | |
| sshnaidm|rover | ykarel, right, we don't need it | 09:08 |
| ykarel | so we need to change parent | 09:09 |
| *** sbulage|afk is now known as sbulage | 09:09 | |
| *** nyechiel_ has quit IRC | 09:09 | |
| amoralej | ykarel, but we may lost something we need from base | 09:10 |
| amoralej | wouldn't it be easier to set some toci_jobtype? | 09:10 |
| ykarel | amoralej, yes need to find suitable base | 09:10 |
| sshnaidm|rover | where is it in base? | 09:12 |
| ykarel | parent:- playbooks/legacy-tripleo-ci-periodic-base/post.yaml | 09:14 |
| amoralej | sshnaidm|rover, https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/playbooks/legacy-tripleo-ci-periodic-base/post.yaml | 09:14 |
| ykarel | so with legacy-dsvm-base + dlrnapi secret we should be good | 09:14 |
| *** ramishra has quit IRC | 09:15 | |
| ykarel | sshnaidm|rover, should i push change | 09:17 |
| *** ramishra has joined #rdo | 09:17 | |
| sshnaidm|rover | ykarel, sure, thanks | 09:17 |
| *** d0ugal has quit IRC | 09:17 | |
| *** nyechiel_ has joined #rdo | 09:19 | |
| rdogerrit | Yatin Karel created config master: Switch to legacy-dsvm-base for consistent promote jobs https://review.rdoproject.org/r/14705 | 09:19 |
| ykarel | sshnaidm|rover, amoralej ^^ | 09:20 |
| sshnaidm|rover | does anybody know if we can still run jobs as parents/childs in zuulv3? | 09:22 |
| ykarel | sshnaidm|rover, you mean dependent, then yes | 09:22 |
| sshnaidm|rover | ykarel, yeah | 09:22 |
| ykarel | if base job fails, child are skipped | 09:22 |
| *** d0ugal has joined #rdo | 09:23 | |
| ykarel | sshnaidm|rover, ex. for periodic https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul.d/tripleo.yaml#L701-L779 | 09:24 |
| *** moguimar has joined #rdo | 09:25 | |
| *** vnogin has joined #rdo | 09:28 | |
| apevec | ykarel, amoralej - Octavia requires mercurial ?! | 09:32 |
| amoralej | i didn't check, tbh the only important is that we don't build octavia in fedora | 09:33 |
| ykarel | apevec, mercurial is dependency for golang-bin | 09:33 |
| apevec | wait, Octavia is written in Go?? | 09:35 |
| chkumar|ruck | apevec, octavia tempest plugin uses go script in run time | 09:35 |
| ykarel | amoralej, 2018-07-09 09:32:32.753502 | primary | TASK [rdo-kolla-build : Login to Docker registry] ****************************** | 09:35 |
| ykarel | 2018-07-09 09:32:35.208932 | primary | fatal: [localhost]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} | 09:35 |
| ykarel | 2018-07-09 09:32:35.211424 | primary | to retry, use: --limit @/home/zuul/workspace/playbook.retry | 09:35 |
| chkumar|ruck | apevec, https://github.com/openstack/octavia-tempest-plugin/blob/master/octavia_tempest_plugin/contrib/httpd/httpd.go | 09:36 |
| ykarel | amoralej, while testing container build:- https://review.rdoproject.org/r/#/c/13943/ | 09:36 |
| apevec | chkumar|ruck, oh, really | 09:36 |
| ykarel | sshnaidm|rover, ^^ | 09:36 |
| apevec | ykarel, that job cannot access secrets? | 09:37 |
| *** pblaho has joined #rdo | 09:37 | |
| ykarel | apevec, we added secret this morning, | 09:37 |
| chkumar|ruck | apevec, https://github.com/rdo-packages/octavia-tempest-plugin-distgit/blob/rpm-master/python-octavia-tests-tempest.spec#L31 | 09:38 |
| apevec | ykarel, chkumar|ruck - so it's for octavia tempest plugin, not Octavia itself | 09:38 |
| ykarel | apevec, it says Login to Docker registry, but i think secrets were for rdo registyr | 09:38 |
| ykarel | checking | 09:38 |
| ykarel | apevec, https://review.rdoproject.org/r/#/c/14699/ | 09:39 |
| apevec | ykarel, hmm, so your test job would upload to the actual registry | 09:39 |
| chkumar|ruck | apevec, yup for plugin | 09:39 |
| ykarel | apevec, looks like | 09:40 |
| ykarel | it will | 09:40 |
| apevec | ykarel, so that's maybe something we do not want outside promotion | 09:40 |
| *** MrAbaddon has quit IRC | 09:41 | |
| apevec | containers-build is kind of special, it should not be possible to trigger it just like that https://review.rdoproject.org/r/#/c/13943/11/.zuul.yaml | 09:42 |
| apevec | in any random project | 09:42 |
| *** gvrangan has quit IRC | 09:42 | |
| ykarel | apevec, ack. | 09:42 |
| ykarel | apevec, last time(without secret) login to docker registry task was skipped:- https://logs.rdoproject.org/43/13943/9/check/legacy-periodic-tripleo-centos-7-master-containers-build/a22de66/job-output.txt.gz#_2018-07-06_14_56_10_522478 | 09:43 |
| Goneri | hi all, could a root on the registry run https://review.rdoproject.org/r/#/c/13681/2/renew-certificates.yml | 09:44 |
| *** cNilesh_ has joined #rdo | 09:44 | |
| Goneri | otherwise the registry.distributed-ci.io certification will expire tomorrow :-/ | 09:45 |
| apevec | Goneri, when does it expire? | 09:45 |
| Goneri | spotz, ^ | 09:45 |
| apevec | dmsimard, ^ | 09:45 |
| Goneri | Oops, spotz wrong nickname, sorry. | 09:45 |
| *** cNilesh|wfh has quit IRC | 09:47 | |
| rdogerrit | Moisés Guimarães de Medeiros proposed rdoinfo master: Add local dep to python-aniso8601 https://review.rdoproject.org/r/14532 | 09:48 |
| rdogerrit | Merged config master: Switch to legacy-dsvm-base for consistent promote jobs https://review.rdoproject.org/r/14705 | 09:50 |
| amoralej | chkumar|ruck, i'm a bit lost | 09:51 |
| amoralej | the last log you posted | 09:51 |
| chkumar|ruck | amoralej, which one? | 09:51 |
| amoralej | ykarel, ^ | 09:51 |
| amoralej | not for you chkumar|ruck :) | 09:51 |
| amoralej | is passing the login to docker | 09:51 |
| *** brault has joined #rdo | 09:52 | |
| rdogerrit | Yatin Karel created config master: Reschedule openstack-periodic https://review.rdoproject.org/r/14706 | 09:52 |
| rdogerrit | Moisés Guimarães de Medeiros created rdoinfo master: Add local dep to python-flask-restful https://review.rdoproject.org/r/14707 | 09:52 |
| ykarel | amoralej, sshnaidm|rover chkumar|ruck in next 13 min ^^ | 09:52 |
| ykarel | https://review.rdoproject.org/r/#/c/14706/ | 09:52 |
| *** gvrangan has joined #rdo | 09:52 | |
| amoralej | ykarel, have we fixed something to test again? | 09:53 |
| *** aufi has quit IRC | 09:53 | |
| ykarel | amoralej, yes https://review.rdoproject.org/r/#/c/14705/ | 09:53 |
| *** gvrangan has quit IRC | 09:53 | |
| amoralej | ok, let's see | 09:54 |
| *** gvrangan has joined #rdo | 09:54 | |
| *** MrAbaddon has joined #rdo | 09:54 | |
| *** gvrangan has quit IRC | 09:55 | |
| *** nyechiel_ has quit IRC | 09:56 | |
| *** gvrangan has joined #rdo | 09:56 | |
| *** aufi has joined #rdo | 09:58 | |
| rdogerrit | Merged config master: Reschedule openstack-periodic https://review.rdoproject.org/r/14706 | 09:58 |
| sshnaidm|rover | ykarel, cool, thanks, crossing fingers | 09:59 |
| chkumar|ruck | amoralej, ykarel https://review.rdoproject.org/zuul3/status.html under openstack-periodic dist-git jobs are running | 10:07 |
| chkumar|ruck | is it expected? | 10:08 |
| amoralej | wth | 10:08 |
| amoralej | i don't think so.... | 10:08 |
| amoralej | they just disapeared | 10:09 |
| amoralej | maybe it's something of zuulv3 | 10:09 |
| chkumar|ruck | amoralej, yup not seeing right now | 10:09 |
| ykarel | amoralej, chkumar|ruck yes that's a bug in zuul tristanC said that | 10:09 |
| ykarel | chkumar|ruck, amoralej <tristanC> ykarel: that's a bug in zuul, it tries to merge all the project defined to check if there are .zuul.yaml updates... | 10:10 |
| *** nyechiel_ has joined #rdo | 10:10 | |
| ykarel | amoralej, chkumar|ruck sshnaidm|rover consistent-to-tripleo-ci-testing job passed, let's see how containers-build goes | 10:14 |
| amoralej | ok | 10:14 |
| chkumar|ruck | ack | 10:14 |
| sshnaidm|rover | cool | 10:14 |
| rdogerrit | Merged rdoinfo master: Add local dep to python-aniso8601 https://review.rdoproject.org/r/14532 | 10:15 |
| *** Son_Goku has joined #rdo | 10:22 | |
| rdogerrit | Merged openstack/oslo-vmware-distgit rpm-master: Switch to stestr https://review.rdoproject.org/r/14614 | 10:28 |
| *** sbulage is now known as sbulage|brb | 10:30 | |
| *** s1061123 has joined #rdo | 10:31 | |
| *** vnogin has quit IRC | 10:32 | |
| rdogerrit | Yatin Karel created rdoinfo master: [python-webob] CBS tags sync with uc for rocky-candidate https://review.rdoproject.org/r/14708 | 10:32 |
| ykarel | amoralej, Done ^^ | 10:32 |
| *** vnogin has joined #rdo | 10:34 | |
| *** vnogin has quit IRC | 10:34 | |
| *** mburned has quit IRC | 10:39 | |
| *** mosulica has quit IRC | 10:41 | |
| *** mburned has joined #rdo | 10:41 | |
| *** joelinux has joined #rdo | 10:41 | |
| *** paramite has quit IRC | 10:43 | |
| *** mosulica has joined #rdo | 10:43 | |
| *** sanjay__u has joined #rdo | 10:44 | |
| *** paramite has joined #rdo | 10:44 | |
| *** sbulage|brb is now known as sbulage | 10:46 | |
| chkumar|ruck | sshnaidm|rover, it is again failing at login to docker registru | 10:52 |
| chkumar|ruck | container-build | 10:52 |
| *** mosulica has quit IRC | 10:54 | |
| *** shreshtha_ has joined #rdo | 10:54 | |
| rdogerrit | Sagi Shnaidman created config master: Remove legacy from job names https://review.rdoproject.org/r/14709 | 10:58 |
| sshnaidm|rover | weshay, ykarel, amoralej please review ^^ | 10:58 |
| *** shreshtha has quit IRC | 10:58 | |
| Tengu | 11:05 | |
| Tengu | grmbl. network doing funky things -.- | 11:05 |
| sshnaidm|rover | Login to Docker registry failed | 11:09 |
| sshnaidm|rover | need to check secrets.. | 11:09 |
| *** nyechiel_ has quit IRC | 11:13 | |
| *** nyechiel_ has joined #rdo | 11:13 | |
| *** cNilesh_ has quit IRC | 11:14 | |
| ykarel | sshnaidm|rover, can you validate if secrets defined are correct | 11:15 |
| ykarel | sshnaidm|rover, https://review.rdoproject.org/r/#/c/14693/3/zuul.d/secrets.yaml | 11:15 |
| Tengu | can someone point me the Dockerfile for the centos-binary-ironic-inspector container? | 11:16 |
| ykarel | tristanC, ^^ | 11:16 |
| ykarel | Tengu, it's in kolla | 11:16 |
| Tengu | ykarel: ah. will dig into its repositories then | 11:16 |
| spotz | Goneri: No prob:) | 11:16 |
| ykarel | Tengu, https://github.com/openstack/kolla/blob/master/docker/ironic-inspector/Dockerfile.j2 | 11:16 |
| *** cNilesh_ has joined #rdo | 11:17 | |
| Tengu | ykarel: thank you :). faster than I | 11:17 |
| Tengu | hmm. than *me | 11:17 |
| *** cNilesh__ has joined #rdo | 11:18 | |
| *** nyechiel_ has quit IRC | 11:18 | |
| *** cNilesh__ has quit IRC | 11:19 | |
| *** cNilesh_ has quit IRC | 11:21 | |
| apevec | amoralej, does it sound familiar? Something is missing in ppc64le buildroot for Rocky http://cbs.centos.org/kojifiles/work/tasks/4549/474549/root.log | 11:25 |
| *** jayg|g0n3 has joined #rdo | 11:25 | |
| *** MrAbaddon has quit IRC | 11:25 | |
| apevec | (it's for ovs 2.9.2 w/ separate dpdk) | 11:26 |
| apevec | I'll try now in queens | 11:26 |
| amoralej | mmm | 11:29 |
| amoralej | apevec, yes, i've seen that before iirc | 11:29 |
| *** nyechiel_ has joined #rdo | 11:30 | |
| *** morazi has quit IRC | 11:31 | |
| *** sasha2 has joined #rdo | 11:36 | |
| *** atoth has joined #rdo | 11:39 | |
| *** MrAbaddon has joined #rdo | 11:40 | |
| *** slagle has quit IRC | 11:43 | |
| chkumar|ruck | amoralej, please have a look on this http://logs.openstack.org/76/580776/1/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/5a57fb9/logs/delorean_logs/ab/aa/abaaf9e687a5609568661fc4175f1aac9687be8f_dev/rpmbuild.log.txt.gz | 11:43 |
| chkumar|ruck | Error: No Package found for python-d2to1 | 11:43 |
| amoralej | mmm | 11:44 |
| *** slagle has joined #rdo | 11:44 | |
| chkumar|ruck | amoralej, https://github.com/rdo-packages/tripleo-heat-templates-distgit/blob/rpm-master/openstack-tripleo-heat-templates.spec#L17 | 11:45 |
| amoralej | d2to1 comes from deps repo | 11:45 |
| amoralej | nop, from cloud7-openstack-rocky-el7-build | 11:46 |
| amoralej | it seems it's missing the buildreqs repo? | 11:47 |
| amoralej | it's weird it didn't fail before | 11:47 |
| chkumar|ruck | amoralej, it is always a non-voting job so nodody looked it | 11:48 |
| chkumar|ruck | amoralej, I am looking it right now | 11:48 |
| amoralej | if you check http://logs.openstack.org/76/580776/1/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/5a57fb9/logs/delorean_logs/ab/aa/abaaf9e687a5609568661fc4175f1aac9687be8f_dev/rpmbuild.log.txt.gz | 11:48 |
| amoralej | it's missing the https://trunk.rdoproject.org/centos7-master/build-deps/latest/ repo in mock config | 11:48 |
| chkumar|ruck | amoralej, checking | 11:50 |
| *** jayg|g0n3 is now known as jayg | 11:52 | |
| *** rh-jelabarre has joined #rdo | 11:52 | |
| chkumar|ruck | amoralej, you mean here https://github.com/openstack/tripleo-quickstart-extras/blob/86af808281b706895e7f97e91c73aafbf5c877a1/roles/build-test-packages/tasks/main.yml#L79 ? | 11:53 |
| chkumar|ruck | here it is getting enabled | 11:54 |
| *** avivgta has joined #rdo | 11:55 | |
| *** avivgt has quit IRC | 11:56 | |
| rdogerrit | Alfredo Moralejo created openstack/networking-ovn-distgit queens-rdo: python-networking-ovn-4.0.2-1 https://review.rdoproject.org/r/14710 | 11:57 |
| chkumar|ruck | sshnaidm|rover, ^^ | 11:58 |
| rdogerrit | Alfredo Moralejo created openstack/tripleo-heat-templates-distgit queens-rdo: openstack-tripleo-heat-templates-8.0.4-1 https://review.rdoproject.org/r/14711 | 11:58 |
| rdogerrit | Alfredo Moralejo created openstack/tripleo-ui-distgit queens-rdo: openstack-tripleo-ui-8.3.2-1 https://review.rdoproject.org/r/14712 | 11:58 |
| amoralej | ajo ^ | 11:58 |
| rdogerrit | Alfredo Moralejo created openstack/os-net-config-distgit queens-rdo: os-net-config-8.4.3-1 https://review.rdoproject.org/r/14713 | 11:59 |
| *** mcornea has joined #rdo | 11:59 | |
| rdogerrit | Alfredo Moralejo created openstack/instack-undercloud-distgit queens-rdo: instack-undercloud-8.4.3-1 https://review.rdoproject.org/r/14714 | 11:59 |
| ajo | oh right amoralej | 12:00 |
| ajo | thanks a lot!!! | 12:00 |
| rdogerrit | Alfredo Moralejo created puppet/puppet-tripleo-distgit queens-rdo: puppet-tripleo-8.3.4-1 https://review.rdoproject.org/r/14715 | 12:00 |
| rdogerrit | Alfredo Moralejo created openstack/tripleo-common-distgit queens-rdo: openstack-tripleo-common-8.6.3-1 https://review.rdoproject.org/r/14716 | 12:01 |
| rdogerrit | Alfredo Moralejo created openstack/tripleoclient-distgit queens-rdo: python-tripleoclient-9.2.3-1 https://review.rdoproject.org/r/14717 | 12:01 |
| *** amoralej is now known as amoralej|lunch | 12:03 | |
| rdogerrit | Alfredo Moralejo created openstack/tripleo-common-distgit pike-rdo: openstack-tripleo-common-7.6.14-1 https://review.rdoproject.org/r/14718 | 12:03 |
| *** hseipp has quit IRC | 12:03 | |
| rdogerrit | Alfredo Moralejo created openstack/tripleoclient-distgit pike-rdo: python-tripleoclient-7.3.11-1 https://review.rdoproject.org/r/14719 | 12:04 |
| rdogerrit | Alfredo Moralejo created openstack/tripleo-puppet-elements-distgit pike-rdo: openstack-tripleo-puppet-elements-7.0.8-1 https://review.rdoproject.org/r/14720 | 12:04 |
| rdogerrit | Alfredo Moralejo created openstack/tripleo-heat-templates-distgit pike-rdo: openstack-tripleo-heat-templates-7.0.14-1 https://review.rdoproject.org/r/14721 | 12:05 |
| rdogerrit | Alfredo Moralejo created openstack/instack-undercloud-distgit pike-rdo: instack-undercloud-7.4.13-1 https://review.rdoproject.org/r/14722 | 12:05 |
| rdogerrit | Alfredo Moralejo created puppet/puppet-tripleo-distgit pike-rdo: puppet-tripleo-7.4.14-1 https://review.rdoproject.org/r/14723 | 12:06 |
| *** d0ugal has quit IRC | 12:06 | |
| rdogerrit | Alfredo Moralejo created openstack/ironic-distgit pike-rdo: openstack-ironic-9.1.5-1 https://review.rdoproject.org/r/14724 | 12:07 |
| ykarel | pabelanger, tristanC u there? | 12:07 |
| rdogerrit | Alfredo Moralejo created openstack/ironic-inspector-distgit pike-rdo: openstack-ironic-inspector-6.0.3-1 https://review.rdoproject.org/r/14725 | 12:07 |
| *** sshnaidm|rover is now known as sshnaidm|afk | 12:08 | |
| *** julim has quit IRC | 12:08 | |
| *** d0ugal has joined #rdo | 12:09 | |
| *** jistr is now known as jistr|mtg | 12:12 | |
| *** amuller has joined #rdo | 12:17 | |
| *** thrash|g0ne is now known as thrash | 12:20 | |
| rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ci-config master: Add role to deploy ruck-rover-cockpit https://review.rdoproject.org/r/14632 | 12:21 |
| *** pkovar has joined #rdo | 12:22 | |
| *** edmondsw has joined #rdo | 12:24 | |
| *** trown|outtypewww is now known as trown | 12:26 | |
| *** Eran_Kuris has quit IRC | 12:27 | |
| *** leanderthal has joined #rdo | 12:27 | |
| *** quiquell is now known as quiquell|off | 12:28 | |
| *** edmondsw has quit IRC | 12:29 | |
| chkumar|ruck | amoralej|lunch, ykarel weshay sshnaidm|afk https://review.openstack.org/581025 for tripleo upgrade package build failure | 12:29 |
| ykarel | chkumar|ruck, queens? | 12:29 |
| ykarel | it was for master | 12:30 |
| *** pradk has quit IRC | 12:30 | |
| chkumar|ruck | ykarel, oh, I need to add for queens-deps | 12:30 |
| chkumar|ruck | sorry | 12:30 |
| ykarel | chkumar|ruck, you need to update master onew | 12:30 |
| *** Eran_Kuris has joined #rdo | 12:30 | |
| *** edmondsw has joined #rdo | 12:31 | |
| ykarel | chkumar|ruck, but for queen we don't have build-deps | 12:31 |
| ykarel | you need to set for master | 12:31 |
| ykarel | the logs you shared http://logs.openstack.org/76/580776/1/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/5a57fb9/logs/delorean_logs/ab/aa/abaaf9e687a5609568661fc4175f1aac9687be8f_dev/rpmbuild.log.txt.gz were for master | 12:31 |
| *** dougbtv has joined #rdo | 12:33 | |
| *** rlandy has joined #rdo | 12:34 | |
| *** leanderthal has quit IRC | 12:34 | |
| weshay | rasca, can you say something | 12:35 |
| weshay | not sure if we can hear oyu | 12:35 |
| weshay | you | 12:35 |
| *** edmondsw has quit IRC | 12:35 | |
| *** fultonj has joined #rdo | 12:35 | |
| *** edmondsw has joined #rdo | 12:37 | |
| *** dprince has joined #rdo | 12:37 | |
| *** dbecker has quit IRC | 12:37 | |
| *** dbecker has joined #rdo | 12:40 | |
| weshay | pabelanger, fyi https://bugs.launchpad.net/tripleo/+bug/1780726 | 12:40 |
| openstack | Launchpad bug 1780726 in tripleo "[master][queens][pike][ocata] Base periodic jobs are broken after zuul v3 migration " [Critical,Triaged] | 12:40 |
| weshay | pabelanger, you need help w/ this ya | 12:40 |
| apevec | there were multiple issues, some were resolved earlier today | 12:41 |
| *** edmondsw has quit IRC | 12:42 | |
| *** assassin has joined #rdo | 12:42 | |
| apevec | chkumar|ruck, amoralej|lunch, ykarel ^ what is the latest issue with v3 periodics? | 12:42 |
| apevec | Last I saw here was about registry secret? | 12:42 |
| ykarel | apevec, authentication issue | 12:42 |
| ykarel | yes | 12:42 |
| ykarel | apevec, can you verify if secrets are correct:- https://review.rdoproject.org/r/#/c/14693/3/zuul.d/secrets.yaml | 12:43 |
| ykarel | apevec, and why there are two in the list? | 12:44 |
| *** jmlowe has quit IRC | 12:45 | |
| ykarel | apevec, secrets are used as https://review.rdoproject.org/r/#/c/14699/5/playbooks/legacy-periodic-tripleo-centos-7-master-containers-build/run.yaml@143 | 12:45 |
| *** edmondsw has joined #rdo | 12:45 | |
| weshay | apevec, question for you re: rdo-release rpms | 12:46 |
| weshay | is that something that will continue to be used and updated? rlandy found a bug related to ovs | 12:47 |
| rdogerrit | Merged openstack/tripleo-heat-templates-distgit pike-rdo: openstack-tripleo-heat-templates-7.0.14-1 https://review.rdoproject.org/r/14721 | 12:47 |
| rdogerrit | Merged openstack/tripleo-common-distgit queens-rdo: openstack-tripleo-common-8.6.3-1 https://review.rdoproject.org/r/14716 | 12:47 |
| apevec | weshay, yes, what is the bug? | 12:47 |
| weshay | apevec, rlandy will be sending it shortly | 12:48 |
| *** leanderthal has joined #rdo | 12:49 | |
| weshay | apevec, can we make one for master that just points to current-tripleo-rdo and the deps repo? | 12:49 |
| rdogerrit | Merged openstack/tripleo-heat-templates-distgit queens-rdo: openstack-tripleo-heat-templates-8.0.4-1 https://review.rdoproject.org/r/14711 | 12:49 |
| rdogerrit | Merged openstack/instack-undercloud-distgit pike-rdo: instack-undercloud-7.4.13-1 https://review.rdoproject.org/r/14722 | 12:49 |
| *** edmondsw has quit IRC | 12:49 | |
| rdogerrit | Merged puppet/puppet-tripleo-distgit pike-rdo: puppet-tripleo-7.4.14-1 https://review.rdoproject.org/r/14723 | 12:49 |
| apevec | weshay, a-ha, for master... we were creating it at RC, but yeah, let's file the issue and discuss there | 12:50 |
| apevec | weshay, rlandy - here https://github.com/rdo-infra/rdo-release/issues | 12:51 |
| *** edmondsw has joined #rdo | 12:51 | |
| weshay | apevec, rlandy we'll link in a lp there | 12:51 |
| apevec | ok thanks | 12:51 |
| rdogerrit | Merged puppet/puppet-tripleo-distgit queens-rdo: puppet-tripleo-8.3.4-1 https://review.rdoproject.org/r/14715 | 12:51 |
| rlandy | ok - I am creating a launchpad bug - yep - will link there | 12:52 |
| rdogerrit | Merged openstack/os-net-config-distgit queens-rdo: os-net-config-8.4.3-1 https://review.rdoproject.org/r/14713 | 12:52 |
| *** toure|gone is now known as toure | 12:52 | |
| *** edmondsw has quit IRC | 12:53 | |
| *** quiquell|off is now known as quiquell | 12:53 | |
| rdogerrit | Merged openstack/tripleo-puppet-elements-distgit pike-rdo: openstack-tripleo-puppet-elements-7.0.8-1 https://review.rdoproject.org/r/14720 | 12:53 |
| *** mgariepy has quit IRC | 12:53 | |
| *** edmondsw has joined #rdo | 12:53 | |
| *** matbu has quit IRC | 12:54 | |
| rdogerrit | Merged openstack/instack-undercloud-distgit queens-rdo: instack-undercloud-8.4.3-1 https://review.rdoproject.org/r/14714 | 12:55 |
| *** chuck_ has joined #rdo | 12:55 | |
| rdogerrit | Merged openstack/tripleoclient-distgit queens-rdo: python-tripleoclient-9.2.3-1 https://review.rdoproject.org/r/14717 | 12:55 |
| rdogerrit | Merged openstack/tripleoclient-distgit pike-rdo: python-tripleoclient-7.3.11-1 https://review.rdoproject.org/r/14719 | 12:55 |
| *** matbu has joined #rdo | 12:56 | |
| *** dustins has joined #rdo | 12:57 | |
| rdogerrit | Merged openstack/tripleo-ui-distgit queens-rdo: openstack-tripleo-ui-8.3.2-1 https://review.rdoproject.org/r/14712 | 12:58 |
| *** zul has quit IRC | 12:58 | |
| weshay | apevec, so upstream infra seems to working quite well, so thank you to you and pabelanger :) | 12:58 |
| *** chuck_ is now known as zul | 12:58 | |
| weshay | the changes I saw were | 12:58 |
| weshay | https://review.openstack.org/#/c/580676/ | 12:58 |
| weshay | https://review.openstack.org/579970 | 12:58 |
| weshay | anything else that was done to help from the infra side of things? | 12:58 |
| weshay | quiquell, ^ fyi | 12:58 |
| *** chem` has joined #rdo | 12:59 | |
| *** mgariepy has joined #rdo | 12:59 | |
| *** chem` is now known as chem | 13:00 | |
| *** Goneri has left #rdo | 13:00 | |
| *** Goneri has joined #rdo | 13:00 | |
| *** dneary has joined #rdo | 13:01 | |
| *** chkumar|ruck has quit IRC | 13:01 | |
| apevec | weshay, afaik it was the first one fixing caching | 13:01 |
| apevec | but also one more to increase cache to 70G | 13:02 |
| *** chandankumar has joined #rdo | 13:02 | |
| weshay | ya | 13:02 |
| *** chandankumar is now known as chkumar|ruck | 13:02 | |
| *** ykarel is now known as ykarel|away | 13:02 | |
| *** mvk has quit IRC | 13:03 | |
| rlandy | apevec; weshay: panda; https://github.com/rdo-infra/rdo-release/issues/10 referencing https://bugs.launchpad.net/tripleo/+bug/1780780 | 13:03 |
| openstack | Launchpad bug 1780780 in tripleo "multi-node-bridge role in zuul-jobs uses a released OVS package " [High,Triaged] | 13:03 |
| weshay | apevec, we'll continue to monitor things.. just fyi we have not had a gate failure since friday | 13:03 |
| *** abhishekk{zzz} has joined #rdo | 13:03 | |
| weshay | apevec, the upstream zuul queue is at the lowest wait time I've seen in months | 13:04 |
| weshay | rlandy++ | 13:04 |
| *** abhishekk{zzz} is now known as abhishekk | 13:04 | |
| weshay | rlandy, I'd still like to put in a change to update that role, and not pull from rdo-release. Maybe pabelanger can weigh in on that | 13:05 |
| *** julim has joined #rdo | 13:05 | |
| rdogerrit | Alfredo Moralejo created openstack/tripleo-heat-templates-distgit ocata-rdo: openstack-tripleo-heat-templates-6.2.15-1 https://review.rdoproject.org/r/14726 | 13:05 |
| *** Eran_Kuris has quit IRC | 13:05 | |
| rlandy | weshay: ack - I thought about that - was going to bring the topic up in the team meeting | 13:06 |
| rlandy | there are some concerns | 13:06 |
| rdogerrit | Alfredo Moralejo created openstack/instack-undercloud-distgit ocata-rdo: instack-undercloud-6.1.8-1 https://review.rdoproject.org/r/14727 | 13:06 |
| *** egonzalez has quit IRC | 13:06 | |
| rlandy | and yes, I think we'd benefit from pabelanger's wisdom here | 13:06 |
| rdogerrit | Alfredo Moralejo created puppet/puppet-tripleo-distgit ocata-rdo: puppet-tripleo-6.5.14-1 https://review.rdoproject.org/r/14728 | 13:07 |
| *** morazi has joined #rdo | 13:07 | |
| rlandy | using any released version in an integration test is not expected | 13:07 |
| *** vpickard has joined #rdo | 13:07 | |
| rdogerrit | Alfredo Moralejo created openstack/os-net-config-distgit ocata-rdo: os-net-config-6.1.5-1 https://review.rdoproject.org/r/14729 | 13:07 |
| weshay | rlandy, ya.. my expectation is that it would use the current-tripleo versions | 13:07 |
| weshay | maybe amoralej|lunch will weigh in there too | 13:08 |
| weshay | essentially we're running master jobs w/ an ocata version of ovs apevec | 13:08 |
| weshay | due to an upstream infra role, and rdo release files | 13:08 |
| rdogerrit | Alfredo Moralejo created openstack/ironic-distgit ocata-rdo: openstack-ironic-7.0.5-1 https://review.rdoproject.org/r/14730 | 13:08 |
| *** kgiusti has joined #rdo | 13:09 | |
| *** dukebarman_ has joined #rdo | 13:09 | |
| *** vpickard has quit IRC | 13:09 | |
| rlandy | weshay: current-tripleo would be far better than ocata - but may not be the exactly compatible change. | 13:10 |
| weshay | rlandy, well it | 13:10 |
| weshay | it's coming from deps | 13:10 |
| weshay | so it would be interesting to see what amoralej|lunch has configured to check/gate changes to ovs at this time | 13:10 |
| weshay | ykarel|away, do you know | 13:11 |
| weshay | bah | 13:11 |
| *** amoralej|lunch is now known as amoralej | 13:11 | |
| *** vpickard has joined #rdo | 13:11 | |
| weshay | amoralej, you have a minute sir? | 13:11 |
| amoralej | i'm in a meeting right now | 13:11 |
| rlandy | who let ykarel|away leave his computer???? | 13:11 |
| weshay | right | 13:11 |
| weshay | amoralej, what check jobs do we have in place for ovs? | 13:11 |
| * ykarel|away read back, | 13:11 | |
| amoralej | weshay, what release? | 13:12 |
| weshay | rlandy, we should just add scenario007 to that | 13:12 |
| weshay | amoralej, master right rlandy ? | 13:12 |
| amoralej | are we updating? | 13:12 |
| rlandy | master, yes | 13:12 |
| weshay | amoralej, context https://bugs.launchpad.net/tripleo/+bug/1780780 | 13:12 |
| openstack | Launchpad bug 1780780 in tripleo "multi-node-bridge role in zuul-jobs uses a released OVS package " [High,Triaged] | 13:12 |
| rlandy | https://github.com/rdo-infra/rdo-release/issues/10 - if you prefer | 13:12 |
| amoralej | we have FS016 | 13:12 |
| weshay | amoralej, k.. let's add another job | 13:13 |
| amoralej | and we have packstack ans p-o-i all scenarios | 13:13 |
| amoralej | weshay, which one? | 13:13 |
| amoralej | one with ovn? | 13:13 |
| *** dukebarman has quit IRC | 13:13 | |
| amoralej | scenario007 is ok with multinode? | 13:13 |
| weshay | rlandy, it's fs30 or fs28? | 13:14 |
| rlandy | fs30, I think - confirming ... | 13:14 |
| numans | weshay, its f30 (for containers) | 13:14 |
| weshay | k | 13:14 |
| *** leanderthal has quit IRC | 13:14 | |
| *** jistr|mtg is now known as jistr | 13:14 | |
| rlandy | export TOCI_JOBTYPE=multinode-1ctlr-featureset030 | 13:14 |
| rlandy | ^^ scenario007 | 13:15 |
| amoralej | that's containerized, right? | 13:15 |
| weshay | amoralej, for that job you can probably replace fs016 w/ 30 if you wanted to | 13:15 |
| rlandy | weshay: 007 and 008 failed with different traces | 13:15 |
| amoralej | yes | 13:15 |
| rlandy | so we could hit diff problems in each one there | 13:15 |
| weshay | rlandy, hrm.. maybe we need both 007/008 to check changes | 13:15 |
| rlandy | weshay: depends on our tolerance for adding more jobs | 13:16 |
| amoralej | weshay, rlandy which is the review to bump https://review.rdoproject.org/r/#/c/13839 right? | 13:16 |
| rlandy | or amoralej's tolerance :) | 13:16 |
| weshay | rlandy, well sure.. however jobs to find errors in ovs would be VERY handy | 13:16 |
| weshay | imho | 13:16 |
| *** trozet|off has quit IRC | 13:17 | |
| amoralej | we can temporarily run two jobs for master if needed | 13:17 |
| rlandy | if you can, that would save us trouble later | 13:18 |
| weshay | amoralej, hrm | 13:18 |
| weshay | amoralej, not deps | 13:18 |
| *** trozet has joined #rdo | 13:18 | |
| weshay | amoralej, the spec file changes for ovs | 13:18 |
| weshay | or that is not openstack / rdo that is linux foundation | 13:19 |
| weshay | so it's just deps :( | 13:19 |
| weshay | am I understanding that correctly? | 13:19 |
| weshay | amoralej, so the only time we can run a check job re changes to ovs.. would be against deps.yaml right? | 13:20 |
| amoralej | yes | 13:20 |
| weshay | amoralej, seems slightly terrible | 13:20 |
| weshay | amoralej, and atm.. no check jobs run against deps | 13:20 |
| rdogerrit | Merged rdoinfo master: [python-webob] CBS tags sync with uc for rocky-candidate https://review.rdoproject.org/r/14708 | 13:21 |
| amoralej | slightly terrible sounds contradictory :) | 13:21 |
| amoralej | wdy m by "no check jobs run againts deps" ? | 13:21 |
| weshay | amoralej, anything deploying tripleo | 13:21 |
| amoralej | when bumping deps? | 13:22 |
| weshay | ya | 13:22 |
| amoralej | we are running oooq FS016 | 13:22 |
| amoralej | that's what i meant before | 13:22 |
| weshay | amoralej, ok.. where is that logged? https://review.rdoproject.org/r/#/c/13839 | 13:22 |
| ykarel|away | only for master, currently not running for queens | 13:22 |
| apevec | so why is https://github.com/openstack-infra/zuul-jobs/blob/master/roles/multi-node-bridge/vars/RedHat.yaml#L4 ocata? | 13:22 |
| amoralej | weshay, it's nested under validate-buildsys-tags | 13:22 |
| amoralej | which is failing | 13:23 |
| weshay | ah k | 13:23 |
| weshay | amoralej, thanks for walking me through that | 13:23 |
| apevec | master deps repos are https://trunk.rdoproject.org/centos7-master/delorean-deps.repo | 13:23 |
| *** dukebarman_ has quit IRC | 13:23 | |
| apevec | is ooo not using that? | 13:23 |
| *** cNilesh has joined #rdo | 13:24 | |
| amoralej | apevec, not, they build the repos config iirc | 13:24 |
| apevec | hmm, how do we keep that in sync then? | 13:24 |
| * ykarel|away leaving for home | 13:24 | |
| * chkumar|ruck headed for nephew's home, will be online from there | 13:25 | |
| chkumar|ruck | s/for/to | 13:25 |
| *** Eran_Kuris has joined #rdo | 13:25 | |
| amoralej | apevec, i'll check after the call | 13:28 |
| *** ykarel|away has quit IRC | 13:29 | |
| *** MrAbaddon has quit IRC | 13:29 | |
| *** gvrangan has quit IRC | 13:29 | |
| *** pchavva has joined #rdo | 13:31 | |
| *** jmlowe has joined #rdo | 13:34 | |
| *** eharney has joined #rdo | 13:35 | |
| *** jistr is now known as jistr|mtg | 13:36 | |
| *** agurenko has quit IRC | 13:37 | |
| *** abregman has quit IRC | 13:38 | |
| *** agurenko has joined #rdo | 13:38 | |
| *** mjturek has joined #rdo | 13:42 | |
| *** sshnaidm|afk is now known as sshnaidm|rover | 13:42 | |
| *** pradk has joined #rdo | 13:46 | |
| rdogerrit | Merged openstack/tripleo-heat-templates-distgit ocata-rdo: openstack-tripleo-heat-templates-6.2.15-1 https://review.rdoproject.org/r/14726 | 13:47 |
| rdogerrit | Merged openstack/os-net-config-distgit ocata-rdo: os-net-config-6.1.5-1 https://review.rdoproject.org/r/14729 | 13:47 |
| *** Eran_Kuris has quit IRC | 13:48 | |
| rdogerrit | Merged openstack/instack-undercloud-distgit ocata-rdo: instack-undercloud-6.1.8-1 https://review.rdoproject.org/r/14727 | 13:48 |
| rdogerrit | Merged puppet/puppet-tripleo-distgit ocata-rdo: puppet-tripleo-6.5.14-1 https://review.rdoproject.org/r/14728 | 13:48 |
| rdogerrit | Merged openstack/ironic-distgit ocata-rdo: openstack-ironic-7.0.5-1 https://review.rdoproject.org/r/14730 | 13:49 |
| rdogerrit | Merged openstack/ironic-distgit pike-rdo: openstack-ironic-9.1.5-1 https://review.rdoproject.org/r/14724 | 13:51 |
| *** cylopez has joined #rdo | 13:54 | |
| *** artom has joined #rdo | 13:55 | |
| *** baha has joined #rdo | 14:00 | |
| *** jistr|mtg is now known as jistr | 14:05 | |
| rdogerrit | Merged openstack/networking-ovn-distgit queens-rdo: python-networking-ovn-4.0.2-1 https://review.rdoproject.org/r/14710 | 14:08 |
| *** rpioso|afk is now known as rpioso | 14:11 | |
| *** med_ has quit IRC | 14:15 | |
| *** cshastri has quit IRC | 14:15 | |
| *** janki has quit IRC | 14:15 | |
| *** janki has joined #rdo | 14:16 | |
| *** med_ has joined #rdo | 14:16 | |
| *** med_ has quit IRC | 14:16 | |
| *** med_ has joined #rdo | 14:16 | |
| *** med_ has quit IRC | 14:16 | |
| *** med_ has joined #rdo | 14:16 | |
| *** links has quit IRC | 14:18 | |
| *** mvk_ has joined #rdo | 14:20 | |
| sshnaidm|rover | amoralej, do you know maybe where is this "encrypt_secret.py" that zuul uses for periodic jobs..? | 14:23 |
| amoralej | sshnaidm|rover, nop | 14:23 |
| sshnaidm|rover | pabelanger, ^^ | 14:23 |
| sshnaidm|rover | pabelanger, do you know? ^^ | 14:24 |
| *** Son_Goku has quit IRC | 14:24 | |
| *** ykarel|away has joined #rdo | 14:24 | |
| *** rbartal has quit IRC | 14:24 | |
| amoralej | dlrn is failing with UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position | 14:25 |
| amoralej | http://logs.rdoproject.org/18/14718/1/check/legacy-DLRN-rpmbuild/7c3fff3/job-output.txt.gz | 14:25 |
| amoralej | that rings me a bell | 14:25 |
| amoralej | is it familiar for anyone? | 14:25 |
| amoralej | ykarel|away, chkumar|ruck number80 ^ | 14:25 |
| ykarel|away | amoralej, changelog? | 14:27 |
| amoralej | probably | 14:27 |
| sshnaidm|rover | amoralej, maybe somebody has non ascii name in commit message :) | 14:27 |
| amoralej | but it passed | 14:27 |
| amoralej | in previews reviews | 14:27 |
| amoralej | changelog is generated automatically and it passed for other ones | 14:28 |
| pabelanger | amoralej: sshnaidm|rover: https://docs.openstack.org/infra/zuul/user/encryption.html has more info about it, is in zuul source code | 14:29 |
| ykarel|away | hmm, then it's something else | 14:29 |
| sshnaidm|rover | pabelanger, I read it, that's why I'm asking - where can I find it? It's not clear | 14:30 |
| *** jcoufal has joined #rdo | 14:30 | |
| pabelanger | https://git.zuul-ci.org/cgit/zuul/tree/tools/encrypt_secret.py | 14:30 |
| sshnaidm|rover | ykarel|away, which key did you use for encrypting? | 14:30 |
| sshnaidm|rover | pabelanger, I need the key | 14:30 |
| pabelanger | which key? | 14:31 |
| amoralej | it's the '"' in number80 name | 14:31 |
| ykarel|away | sshnaidm|rover, jpena added https://review.rdoproject.org/r/#/c/14693/3/zuul.d/secrets.yaml | 14:31 |
| *** ykarel|away is now known as ykarel | 14:31 | |
| *** pabelanger has quit IRC | 14:33 | |
| *** pabelanger has joined #rdo | 14:33 | |
| ykarel | but i can't get is there some difference in difining token/password, why there are two in the list, is there some doc about it | 14:33 |
| *** janki has quit IRC | 14:34 | |
| ykarel | ok for large values list is used | 14:35 |
| apevec | amoralej, " where?? | 14:35 |
| *** tshefi has quit IRC | 14:35 | |
| apevec | sshnaidm|rover, I used encrypt_secret.py --tenant rdoproject.org --infile ~/.centos.cert --outfile centos.cert.secret https://softwarefactory-project.io/zuul config | 14:36 |
| apevec | to encrypt CBS cert | 14:36 |
| *** lkuchlan has quit IRC | 14:36 | |
| amoralej | apevec, https://github.com/rdo-packages/tripleo-common-distgit/blob/pike-rdo/openstack-tripleo-common.spec#L208 | 14:36 |
| amoralej | Haïkel | 14:36 |
| sshnaidm|rover | apevec, thanks | 14:37 |
| *** jcoufal has quit IRC | 14:39 | |
| *** whooligan has joined #rdo | 14:39 | |
| apevec | amoralej, so that's old changelog and it started failing now? | 14:39 |
| amoralej | apevec, yes | 14:39 |
| amoralej | i think it's because of some issue in the image | 14:39 |
| amoralej | jpena was investigating it | 14:39 |
| amoralej | i think it only fails in dlrn in ci env | 14:40 |
| apevec | is environment is set to LANG=C now? | 14:40 |
| apevec | it's not explicitly set by job, so yeah something in the image | 14:41 |
| *** DV has quit IRC | 14:44 | |
| sshnaidm|rover | apevec, pabelanger mm.. and what will be url and project for periodic jobs repo for encrypt script? | 14:45 |
| rdogerrit | Alfredo Moralejo created rdo-jobs master: Specify LANG=C in DLRN rpmbuild jobs https://review.rdoproject.org/r/14731 | 14:46 |
| rdogerrit | Alfredo Moralejo proposed openstack/tripleo-common-distgit pike-rdo: openstack-tripleo-common-7.6.14-1 https://review.rdoproject.org/r/14718 | 14:47 |
| *** nyechiel_ has quit IRC | 14:47 | |
| *** cylopez has left #rdo | 14:47 | |
| sshnaidm|rover | pabelanger, sorry for questions, it's blocking periodic jobs now | 14:48 |
| sshnaidm|rover | pabelanger, and zuul doc completely ignores this | 14:49 |
| *** DV has joined #rdo | 14:50 | |
| pabelanger | sshnaidm|rover: see apevec paste above | 14:51 |
| sshnaidm|rover | pabelanger, I saw | 14:51 |
| pabelanger | project is config | 14:51 |
| pabelanger | url is https://review.rdoproject.org/zuul | 14:51 |
| sshnaidm|rover | pabelanger, is this url right for periodic jobs https://softwarefactory-project.io/zuul ? | 14:51 |
| pabelanger | no | 14:51 |
| pabelanger | wait | 14:52 |
| pabelanger | yes | 14:52 |
| pabelanger | sorry | 14:52 |
| pabelanger | that is the right URL | 14:52 |
| pabelanger | need coffee | 14:52 |
| sshnaidm|rover | pabelanger, sure? | 14:52 |
| pabelanger | yes, that is correct url | 14:52 |
| *** sbulage is now known as sbulage|brb | 14:52 | |
| pabelanger | sf.io is running zuulv3 | 14:53 |
| pabelanger | what is the issue? | 14:53 |
| sshnaidm|rover | pabelanger, I think zuul docs should be fixed, totally unclear about this point | 14:53 |
| ykarel | pabelanger, so can't we test is the already defined secret is correct: https://review.rdoproject.org/r/#/c/14693/3/zuul.d/secrets.yaml | 14:53 |
| pabelanger | sshnaidm|rover: yes, if confusing, I recommend we push up a change to make it clear | 14:53 |
| rdogerrit | Sagi Shnaidman created config master: Fix rdo_registry password https://review.rdoproject.org/r/14732 | 14:54 |
| sshnaidm|rover | pabelanger, ^^ | 14:54 |
| ykarel | sshnaidm|rover, a query:- how it was identified that password was wrong? | 14:54 |
| pabelanger | yes, can you expand commit message | 14:55 |
| pabelanger | I'm not up to speed of the issue | 14:55 |
| *** radeks has quit IRC | 14:55 | |
| sshnaidm|rover | ykarel, login was failed | 14:55 |
| ykarel | sshnaidm|rover,ok so how you verified the current proposed token | 14:56 |
| *** julim has quit IRC | 14:56 | |
| *** abhishekk has quit IRC | 14:56 | |
| sshnaidm|rover | ykarel, I don't think I can.. only zuul can decrypt it | 14:56 |
| ykarel | so if we can verify login to docker registry before running job it would be good | 14:56 |
| sshnaidm|rover | pabelanger, right? ^^ | 14:56 |
| apevec | sshnaidm|rover, url and project is the same as in example line I paste you | 14:56 |
| sshnaidm|rover | ykarel, only possible if we log in to host that runs this job and evaluate this env variable | 14:57 |
| pabelanger | right, only zuul has private keys to decrypt a secret | 14:57 |
| apevec | sshnaidm|rover, yes, only those with access to zuul private keys can decrypt | 14:57 |
| *** julim has joined #rdo | 14:57 | |
| apevec | ykarel, you verify the source before encrypting :) | 14:57 |
| sshnaidm|rover | pabelanger, and who can root access to running host :) | 14:57 |
| ykarel | apevec, i meant that if we can test the way zuul test the encrypted key | 14:58 |
| *** lon|home has quit IRC | 14:58 | |
| pabelanger | no, root users won't manually decrypt the secret | 14:58 |
| ykarel | as at some place we define password, some token, | 14:58 |
| *** quiquell is now known as quiquell|off | 14:58 | |
| apevec | ykarel, what would you test there? | 14:58 |
| apevec | encrypt works fine | 14:59 |
| ykarel | apevec, what is REGISTRY_PASSWORD when we do rdo_registry.token | 14:59 |
| rdogerrit | Merged config master: Fix rdo_registry password https://review.rdoproject.org/r/14732 | 14:59 |
| apevec | it will be whatever was source for https://review.rdoproject.org/r/#/c/14732/1/zuul.d/secrets.yaml | 14:59 |
| ykarel | i just wanted to understand why it didn't worked last time with jpena created secret | 15:00 |
| ykarel | apevec, ^^ | 15:00 |
| ykarel | so if we know we don't get to same situation again | 15:00 |
| apevec | I guess he pulled the wrong one from jenkins, dunno | 15:00 |
| sshnaidm|rover | ykarel, not sure it's wrong, we can see only now | 15:00 |
| *** beekneemech is now known as bnemec | 15:00 | |
| ykarel | okk, let's see how the current one goes | 15:00 |
| sshnaidm|rover | ykarel, if the job fails now, the problem is not with password | 15:01 |
| ykarel | yes, let's see | 15:01 |
| *** Son_Goku has joined #rdo | 15:01 | |
| *** hseipp has joined #rdo | 15:01 | |
| sshnaidm|rover | ykarel, we can reveal registry password to see if everything ok, but then we'll need to change it urgently, because it's opened | 15:01 |
| pabelanger | no | 15:02 |
| pabelanger | do not do that | 15:02 |
| sshnaidm|rover | pabelanger, I would like not | 15:02 |
| pabelanger | if you think there is an issue with encryption, create a fake password and secret in untrusted project | 15:02 |
| pabelanger | then echo it | 15:02 |
| *** janki has joined #rdo | 15:02 | |
| pabelanger | you'll see it works | 15:02 |
| *** peereb has quit IRC | 15:03 | |
| sshnaidm|rover | pabelanger, what is purpose of no_log there? if it's not in debug mode, it won't print any sensitive info, right/ | 15:03 |
| ykarel | encryption should work out of the box, but with no_log we are not seeing | 15:03 |
| *** ksambor has quit IRC | 15:03 | |
| pabelanger | sshnaidm|rover: right, was just to help protect secret | 15:06 |
| pabelanger | propose keep it and just pipe output of scripts to a file over stdout | 15:06 |
| *** artom has quit IRC | 15:06 | |
| sshnaidm|rover | pabelanger, offtop - is 2000 jobs in periodic queue ok? https://review.rdoproject.org/zuul3/status.html | 15:07 |
| *** lon has joined #rdo | 15:08 | |
| pabelanger | sshnaidm|rover: yes, they are not really 2000 jobs, zuul need to enqueue them to check configuration now, on branches. Will take a few minutes to search for the correct project to keep | 15:08 |
| pabelanger | a bug in zuul we need to clean up | 15:09 |
| sshnaidm|rover | pabelanger, oh, ok.. was wondering what is going on.. | 15:09 |
| *** ykarel is now known as ykarel|away | 15:09 | |
| pabelanger | sshnaidm|rover: yah, zuul mergers need to actually be involved to look at the branch configuration, so from status page, it does look like 2000 job in the pipeline, however they soon get kicked out of pipeline when configuration is not found | 15:10 |
| *** agurenko has quit IRC | 15:13 | |
| rdogerrit | Alfredo Moralejo proposed rdo-jobs master: Specify LANG=C in DLRN rpmbuild jobs https://review.rdoproject.org/r/14731 | 15:15 |
| *** cNilesh has quit IRC | 15:17 | |
| *** iranzo has quit IRC | 15:17 | |
| rdogerrit | Sagi Shnaidman created rdo-infra/ansible-role-rdo-kolla-build master: Remove temporary no_log to investigate job failure https://review.rdoproject.org/r/14733 | 15:19 |
| sshnaidm|rover | pabelanger, ykarel|away apevec in case we hit problem again ^^ | 15:20 |
| *** dyasny_ has quit IRC | 15:20 | |
| *** dyasny_ has joined #rdo | 15:21 | |
| *** mjturek_ has joined #rdo | 15:23 | |
| *** rfolco is now known as rfolcOUT | 15:23 | |
| *** mjturek has quit IRC | 15:24 | |
| rdogerrit | Alfredo Moralejo proposed rdo-jobs master: Specify LANG=C in DLRN rpmbuild jobs https://review.rdoproject.org/r/14731 | 15:24 |
| *** dyasny_ has quit IRC | 15:25 | |
| *** dyasny_ has joined #rdo | 15:26 | |
| amoralej | apevec, setting LANG=en_US_UTF-8 works | 15:28 |
| amoralej | https://review.rdoproject.org/r/#/c/14731/3/playbooks/legacy/DLRN-rpmbuild/run.yaml | 15:28 |
| tosky | maybe en_US.UTF-8 | 15:28 |
| amoralej | pabelanger, ^ setting LANG should be something to do at image level? | 15:28 |
| amoralej | yeah tosky, i did a typo | 15:29 |
| *** avivgta has quit IRC | 15:31 | |
| pabelanger | amoralej: I want to say DIB does setup a default locale | 15:32 |
| amoralej | it seems a wrong one | 15:33 |
| amoralej | pabelanger, https://pastebin.com/2Br5xN5K that's default locale | 15:34 |
| ykarel|away | sshnaidm|rover, wouldn't be better to hold the node and debug in case issue is hit? | 15:34 |
| pabelanger | amoralej: which image is that? | 15:34 |
| amoralej | mmm | 15:34 |
| pabelanger | oh, rdo | 15:34 |
| pabelanger | hmm, i wonder if sf.io elements are doing something | 15:35 |
| sshnaidm|rover | ykarel|away, of course, but not sure if it's possible.. pabelanger - could we hold a node for logging in and debug? | 15:36 |
| pabelanger | which job? | 15:37 |
| ykarel|away | pabelanger, https://review.rdoproject.org/zuul3/stream.html?uuid=c85ff4700ef54397b0eda18e8242158a&logfile=console.log | 15:37 |
| sshnaidm|rover | pabelanger, legacy-periodic-tripleo-centos-7-master-containers-build | 15:38 |
| *** Son_Goku has quit IRC | 15:38 | |
| pabelanger | mhu: fbo: apevec: ^needs an autohold created for zuul on sf.io, | 15:41 |
| *** emalikov has quit IRC | 15:42 | |
| mhu | pabelanger, which patch ? | 15:42 |
| pabelanger | mhu: no patch, is periodic job | 15:43 |
| mhu | pabelanger, so IIRC I need the project and oldrev | 15:44 |
| pabelanger | mhu: tripleo-ci is the project | 15:44 |
| *** hseipp has quit IRC | 15:48 | |
| rdogerrit | Alfredo Moralejo proposed rdo-jobs master: Specify LANG=C in DLRN rpmbuild jobs https://review.rdoproject.org/r/14731 | 15:48 |
| pabelanger | amoralej: ^commit message is now wrong | 15:50 |
| amoralej | pabelanger, yes, that's just to test with https://review.rdoproject.org/r/#/c/14718/ | 15:51 |
| fbo | pabelanger: project ? job ? | 15:52 |
| sshnaidm|rover | fbo, job legacy-periodic-tripleo-centos-7-master-containers-build | 15:52 |
| fbo | thanks | 15:52 |
| *** jlibosva has quit IRC | 15:53 | |
| sshnaidm|rover | fbo, running on openstack-infra/tripleo-ci in openstack-periodic pipeline | 15:53 |
| sshnaidm|rover | ykarel|away, pabelanger well, I see job passed this step \o/ | 15:54 |
| apevec | so new secret works? | 15:57 |
| fbo | sshnaidm|rover: autohold rule is set now | 15:58 |
| mhu | sshnaidm|rover, pabelanger : rdoproject.org | git.openstack.org/openstack-infra/tripleo-ci | legacy-periodic-tripleo-centos-7-master-containers-build | b5b979f34a3f53d6a662d78c19c60468439f99a7 | 15:58 |
| sshnaidm|rover | apevec, yep | 15:58 |
| mhu | ie nodes will hold if the job fails on this ref | 15:58 |
| sshnaidm|rover | fbo, mhu so it will be hold only if it fails, right? | 15:58 |
| mhu | sshnaidm|rover, yes | 15:59 |
| sshnaidm|rover | great, thanks | 15:59 |
| *** sbulage|brb is now known as sbulage|afk | 15:59 | |
| pabelanger | mhu: ref shouldn't have been needed. Thanks | 16:00 |
| sshnaidm|rover | mhu, fbo so should I call you guys every time I need autohold or there is a process> | 16:01 |
| sshnaidm|rover | ? | 16:01 |
| mhu | sshnaidm|rover, for now it's manual, but I'm working on patches upstream to allow delegation of such actions like reenqueue or autoholding | 16:02 |
| sshnaidm|rover | mhu, great | 16:02 |
| mhu | sshnaidm|rover, your next action should the job fail is to let us know when the node can be destroyed | 16:02 |
| sshnaidm|rover | mhu, ack | 16:03 |
| fbo | SF 3.2 will probably have those patches even not merged upstream | 16:03 |
| *** akhilaki has joined #rdo | 16:03 | |
| mhu | we will add a default "TTL" for nodes of 24 hours, but I'm not sure it'll apply to your node | 16:03 |
| pabelanger | fbo: apevec: mhu: I'd like to have the discussion about SF not included out of tree patches up unmerged code upstream. Maybe we can schedule a topic with tristanC | 16:04 |
| rdogerrit | Oliver Walsh created openstack/tripleo-heat-templates-distgit rpm-master: Add docker_config_scripts directory https://review.rdoproject.org/r/14734 | 16:05 |
| *** pradk- has joined #rdo | 16:05 | |
| mhu | pabelanger, we can discuss that during our incoming review/retro this thursday | 16:06 |
| *** aufi has quit IRC | 16:06 | |
| pabelanger | mhu: when are we scheduled for 3.2 release? | 16:06 |
| *** ragiman has quit IRC | 16:07 | |
| rdogerrit | Alfredo Moralejo proposed rdo-jobs master: Specify LANG=C in DLRN rpmbuild jobs https://review.rdoproject.org/r/14731 | 16:08 |
| *** pradk has quit IRC | 16:08 | |
| rdogerrit | Alfredo Moralejo proposed rdo-jobs master: Specify LANG=en_US.UTF-8 in DLRN rpmbuild jobs https://review.rdoproject.org/r/14731 | 16:09 |
| mhu | pabelanger, we still have to release 3.1: https://tree.taiga.io/project/morucci-software-factory/us/1332?milestone=193851 | 16:09 |
| mhu | IIRC we haven't discussed what to put in 3.2 yet but scoped autohold/enqueue via web api should be part of it | 16:10 |
| pabelanger | yah, don't mind the autohold / enqueue features, just we should be landing that upstream first over merging and release SF using unreleased code of zuul. | 16:13 |
| fbo | pabelanger: that's the ideal situation | 16:13 |
| *** ramishra has quit IRC | 16:15 | |
| *** dyasny_ has quit IRC | 16:16 | |
| pabelanger | fbo: yup, I'd like to see out come up with a policy to prevent us from doing a official release of SF if packaging contains unmerged code of zuul / nodepool (any upstream really). I can understand security, but we really should be following rdo lead here on packaging as it applies to openstack | 16:16 |
| *** dyasny_ has joined #rdo | 16:17 | |
| pabelanger | I understand we cannot fix that today, because of some web / container patches, but would like to stop adding more | 16:17 |
| *** trown is now known as trown|lunch | 16:20 | |
| ykarel|away | sshnaidm|rover, Good | 16:21 |
| pabelanger | dmsimard: I'd like to continue on with your work with ara-report for rdoproject, code is merged how do we deploy? | 16:21 |
| dmsimard | pabelanger: I think it's already set up for sf.io, tristanC gave me https://softwarefactory-project.io/logs/59/12859/2/check/config-check/02d535b/ara-report/ the other day | 16:24 |
| *** jayg is now known as jayg|g0n3 | 16:24 | |
| *** nyechiel_ has joined #rdo | 16:24 | |
| *** florianf has quit IRC | 16:24 | |
| pabelanger | dmsimard: great, so I guess we need it on logs.r.o | 16:25 |
| dmsimard | pabelanger: it's already set up | 16:25 |
| pabelanger | oh | 16:25 |
| pabelanger | kk, let me test | 16:25 |
| dmsimard | has been for months | 16:26 |
| pabelanger | wait | 16:26 |
| dmsimard | the constraint was setting up sf.io to automatically do it (our logserver isn't managed by sf) | 16:26 |
| pabelanger | months? | 16:26 |
| *** jayg|g0n3 is now known as jayg | 16:26 | |
| dmsimard | pabelanger: the support wasn't there for sf, it was something custom we did basically | 16:27 |
| pabelanger | dmsimard: okay, I thought logs.r.o didn't have it, but if already setup, then zuulv3 base jobs for rdoproject could have used it day one. | 16:28 |
| pabelanger | will try in base-test | 16:28 |
| *** derekh has quit IRC | 16:28 | |
| rdogerrit | pabelanger created config master: Enable ara-report for base-test https://review.rdoproject.org/r/14735 | 16:30 |
| pabelanger | dmsimard: number80: amoralej: ^change for base-test to try using ara-report for rdo jobs | 16:30 |
| number80 | ack | 16:30 |
| dmsimard | pabelanger: are jobs uploading to logs.r.o or the sf.io log server ? | 16:31 |
| *** kopecmartin has quit IRC | 16:32 | |
| pabelanger | dmsimard: logs.r.o | 16:33 |
| *** mvk_ has quit IRC | 16:33 | |
| dmsimard | hmm, did we not fill up the sf.io log server the other day ? | 16:34 |
| pabelanger | not sure | 16:35 |
| pabelanger | but rdojobs are uploading to logs.r.o | 16:35 |
| dmsimard | fwiw, we might want to stand up a standardized "software factory" log server for review.rdo | 16:35 |
| pabelanger | https://logs.rdoproject.org/35/14735/1/check/tox-linters/d19ad5e/ | 16:35 |
| dmsimard | the one we have right now is customized to host logs from downstream third party jobs as well as ci.centos.org jobs | 16:35 |
| pabelanger | dmsimard: which downstream job? internal redhat? | 16:36 |
| dmsimard | pabelanger: https://thirdparty.logs.rdoproject.org/ | 16:37 |
| mloza | Hi, when I launch an instance it gets stuck in BUILD state. This is what I got from the logs `HypervisorUnavailable: Connection to the hypervisor is broken on host: controller-node` | 16:37 |
| pabelanger | yah, they should be using their own infra, same with ci.centos.org jobs. Once we land zuul_return patch for zuul.child_jobs, ci.centos.org will be zuulv3, so that isn't an issue | 16:38 |
| *** hseipp has joined #rdo | 16:39 | |
| *** florianf has joined #rdo | 16:40 | |
| ykarel|away | sshnaidm|rover, something is wrong with periodic jobs they succeed in few minutes | 16:42 |
| ykarel|away | container-builds passed | 16:42 |
| chkumar|ruck | ykarel|away: but ILD CONTAINERS IMAGES COMPLETED showing | 16:43 |
| ykarel|away | chkumar|ruck, i meant child jobs, like fs001 etc | 16:43 |
| *** artom has joined #rdo | 16:44 | |
| *** MrAbaddon has joined #rdo | 16:44 | |
| chkumar|ruck | ykarel|away: http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens/4613932/job-output.txt.gz yes | 16:44 |
| chkumar|ruck | here fs001 is not invoked | 16:45 |
| *** sbulage|afk has quit IRC | 16:45 | |
| chkumar|ruck | TASK [Create nodepool primary file] | 16:45 |
| chkumar|ruck | 2018-07-09 16:39:10.934433 | tripleo-ovb-centos-7 | skipping: Conditional result was False | 16:45 |
| chkumar|ruck | from here it is skipped | 16:45 |
| sshnaidm|rover | ykarel|away, yeah, seems like they don't start actually.. | 16:45 |
| sshnaidm|rover | pabelanger, can you take a look? https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-queens-upload/ea99838/job-output.txt.gz#_2018-07-09_16_41_14_937240 | 16:46 |
| sshnaidm|rover | pabelanger, I don't see anything runs | 16:46 |
| *** dyasny_ has quit IRC | 16:48 | |
| *** abhishekk has joined #rdo | 16:48 | |
| *** dyasny_ has joined #rdo | 16:48 | |
| pabelanger | sshnaidm|rover: https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens/4613932/ara/file/fdd68ba9-23f2-413a-b492-0c875d4877cb/#line-1 needs to be all | 16:48 |
| pabelanger | for run and post playbooks for ovb jobs | 16:48 |
| pabelanger | looks like we made a typo | 16:49 |
| sshnaidm|rover | pabelanger, why "all"? | 16:49 |
| ykarel|away | sshnaidm|rover, hmm nodeset issue | 16:50 |
| ykarel|away | tripleo-ovb-centos-7 is set | 16:50 |
| ykarel|away | while in playbooks it;s refereing primary | 16:50 |
| ykarel|away | good to check for multinode ones as well | 16:51 |
| sshnaidm|rover | ykarel|away, where is nodeset set? | 16:51 |
| *** dciabrin has quit IRC | 16:51 | |
| *** jpich has quit IRC | 16:52 | |
| *** dciabrin has joined #rdo | 16:52 | |
| ykarel|away | sshnaidm|rover, https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/zuul-legacy-jobs.yaml#L677 | 16:52 |
| ykarel|away | sshnaidm|rover, and definition https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/nodesets.yaml#L31-L35 | 16:53 |
| *** holser_ has quit IRC | 16:53 | |
| sshnaidm|rover | pabelanger, so primary should be on multinode jobs only, the ovb jobs should have tripleo-ovb-centos-7 - right? | 16:56 |
| sshnaidm|rover | ykarel|away, ^^ | 16:56 |
| *** holser_ has joined #rdo | 16:57 | |
| ykarel|away | sshnaidm|rover, may be good to adjust playbooks or nodesets | 16:57 |
| sshnaidm|rover | or "all" on ovb is good enough | 16:57 |
| pabelanger | sshnaidm|rover: right | 16:58 |
| pabelanger | all on ovb should be good enough | 16:58 |
| pabelanger | since a single node job | 16:58 |
| *** vpickard has left #rdo | 16:59 | |
| mjturek_ | dmsimard: any chance you could take a look at https://review.rdoproject.org/r/#/c/14696/ I think we're gonna need it for ppc64le container builds with duffy | 17:01 |
| dmsimard | mjturek_: +3, you're going to need the plumbing for job -> builder -> script though | 17:02 |
| mjturek_ | my goodness, that was fast | 17:02 |
| mjturek_ | dmsimard: yep, current thought is to propose a test-day-tools job that exports ARCH=ppc64le | 17:02 |
| rdogerrit | Sagi Shnaidman created rdo-jobs master: Fix OVB hosts parameter https://review.rdoproject.org/r/14736 | 17:02 |
| *** imacdonn has joined #rdo | 17:03 | |
| rdogerrit | Adam Kimball proposed rdo-infra/test-day-tools master: Run tripleo container builds with duffy nodes https://review.rdoproject.org/r/14502 | 17:03 |
| sshnaidm|rover | pabelanger, ykarel|away https://review.rdoproject.org/r/#/c/14736/ | 17:03 |
| mjturek_ | dmsimard: does that make sense? or should we be taking a different path | 17:03 |
| dmsimard | mjturek_: that's not going to work, the export would occur after the node has already been requested | 17:04 |
| dmsimard | your code runs after the node has been requested | 17:04 |
| rdogerrit | Merged rdo-infra/ci-config master: Allow arch to be specified for cicoclient in cico-node-get-to-ansible.sh https://review.rdoproject.org/r/14696 | 17:04 |
| mjturek_ | dmsimard: ah you're right. | 17:04 |
| *** shreshtha_ has quit IRC | 17:04 | |
| sshnaidm|rover | amoralej, dmsimard we need to stop anyhow current periodic jobs so that we won't promote now, how can we do it? | 17:05 |
| *** florianf has quit IRC | 17:05 | |
| dmsimard | pabelanger: ^ | 17:05 |
| amoralej | jobs can't be aborted in zuulv3 afaik | 17:05 |
| amoralej | we need to log in and kill something i think | 17:06 |
| pabelanger | right, no abort switch on periodic jobs | 17:06 |
| pabelanger | if you land playbook changes, unrun jobs will get it | 17:06 |
| sshnaidm|rover | pabelanger, because ovb "passed", we can't take risk it will be promoted | 17:06 |
| sshnaidm|rover | pabelanger, are the posted changed ok? | 17:07 |
| sshnaidm|rover | what is "unrun" job? | 17:07 |
| pabelanger | yes, looks fine | 17:07 |
| pabelanger | sshnaidm|rover: enqueue job, which hasn't run yet | 17:07 |
| pabelanger | if you land config change, before those jobs run, they will pick up new patch | 17:08 |
| sshnaidm|rover | pabelanger, the problem is not that jobs didn't run, they ran and "passed" | 17:08 |
| pabelanger | but no way to abort | 17:08 |
| sshnaidm|rover | pabelanger, it didn't run any playbook and job has a success, that what I mean.. | 17:08 |
| pabelanger | right, I understand. New jobs will run and hope they fail, other wise we wait | 17:09 |
| pabelanger | right now, only way to clear periodic job is to stop / start zuul or maybe kill ansible-playbook task from executor, but that will just requeue job | 17:09 |
| pabelanger | is there no roll back feature in dlrn? | 17:10 |
| rdogerrit | Merged rdo-jobs master: Fix OVB hosts parameter https://review.rdoproject.org/r/14736 | 17:10 |
| pabelanger | how have you aborted jobs in the past? | 17:10 |
| sshnaidm|rover | pabelanger, I didn't, amoralej has a way with zuulv2 I think | 17:11 |
| *** paragan has quit IRC | 17:11 | |
| *** assassin has quit IRC | 17:12 | |
| pabelanger | interested to know more, can't think of a way to abort right now in zuulv2 | 17:12 |
| pabelanger | unless killing jenkins node | 17:12 |
| amoralej | pabelanger, there is a way with sfmanager | 17:13 |
| amoralej | i think it aborts jobs at jenkins level | 17:13 |
| *** Goneri has quit IRC | 17:14 | |
| pabelanger | right, if you ssh into a running node then reboot it, when run / post playbook happens, job should fail | 17:14 |
| * amoralej looks for documentation | 17:14 | |
| pabelanger | I don't have SSH key myself | 17:14 |
| amoralej | you mean in v2 or v3? | 17:14 |
| amoralej | that ssh procedure is for v3, right? | 17:14 |
| pabelanger | zuulv3 | 17:14 |
| pabelanger | https://review.openstack.org/95035/ is actually fix to this, but we haven't landed it upstream | 17:15 |
| amoralej | ah, ok | 17:15 |
| *** tesseract has quit IRC | 17:15 | |
| sshnaidm|rover | pabelanger, why is it at all tripleo-ovb-centos-7 exists?? it should be the same as in multinode | 17:17 |
| amoralej | sshnaidm|rover, what's the problem with current periodic execution? | 17:17 |
| sshnaidm|rover | amoralej, well, some jobs passed without running, but I think because of other bug (haha) it should be fine, because they can't report their success | 17:18 |
| amoralej | :) | 17:18 |
| amoralej | let me ask if someone can abort | 17:18 |
| sshnaidm|rover | is the gerrit died? | 17:18 |
| amoralej | nop afaik | 17:18 |
| amoralej | which one? | 17:18 |
| sshnaidm|rover | rfo | 17:19 |
| sshnaidm|rover | rdo | 17:19 |
| amoralej | i'm in | 17:19 |
| rdogerrit | Sagi Shnaidman created config master: Fix hosts parameter in post periodic task https://review.rdoproject.org/r/14737 | 17:19 |
| pabelanger | sshnaidm|rover: because we only run OVB jobs in a single nodepool provider, upstream-centos-7 can run in any nodepool provider. When we add another cloud (at some point) upstream-centos-7 nodes will run there | 17:20 |
| sshnaidm|rover | oh, finally.. | 17:20 |
| pabelanger | sshnaidm|rover: also, tripleo-ovb-centos-7 nodes live in a shared tenant with tripleo-ci team. we don't want them to live in sf.io nodepool tenant for security reasons | 17:20 |
| sshnaidm|rover | pabelanger, ok, I suppose we need something like that too: https://review.rdoproject.org/r/14737 | 17:20 |
| pabelanger | sshnaidm|rover: yah, that should be okay | 17:21 |
| sshnaidm|rover | pabelanger, ykarel|away need to think how to handle this hosts issue more friendly later.. | 17:22 |
| *** trown|lunch is now known as trown | 17:23 | |
| pabelanger | yes, I personally want to see ovb nodeset go away, but that is more work | 17:23 |
| rdogerrit | Merged config master: Fix hosts parameter in post periodic task https://review.rdoproject.org/r/14737 | 17:23 |
| sshnaidm|rover | amoralej, ok, ping me please if you know how to abort, this run anyway doesn't have a chance | 17:24 |
| weshay | pabelanger, question re: https://review.openstack.org/#/c/580518/1/roles/multi-node-bridge/vars/RedHat.yaml | 17:28 |
| weshay | why would we want to hardcode ovs to ocata? | 17:28 |
| *** dustins has quit IRC | 17:29 | |
| pabelanger | weshay: because always been like that, we've actually asked for OVS to have a sane release schedule outside of openstack, but rejected | 17:29 |
| pabelanger | weshay: there is a discussion to change to use centos-release I think | 17:29 |
| weshay | pabelanger, rlandy's testing would indicate it's not working | 17:29 |
| pabelanger | weshay: since when? | 17:29 |
| pabelanger | we've been using it upstream for a long time | 17:30 |
| weshay | https://bugs.launchpad.net/tripleo/+bug/1780780 | 17:30 |
| openstack | Launchpad bug 1780780 in tripleo "multi-node-bridge role in zuul-jobs uses a released OVS package " [High,Triaged] | 17:30 |
| weshay | rlandy, I wonder what happens if we just update ovs to the right release | 17:30 |
| weshay | pabelanger, so if it's installed from infra using rdo-release | 17:31 |
| weshay | then updated via dlrn-deps | 17:31 |
| weshay | what's the point.. why not just start w/ dlrn-deps | 17:31 |
| weshay | pabelanger, why is it in dlrn-deps at all | 17:32 |
| pabelanger | weshay: good question | 17:32 |
| pabelanger | we've asked for it to be its own repo outside of openstack | 17:32 |
| pabelanger | but always rejected | 17:32 |
| weshay | why is it not tested when we update deps.yaml | 17:32 |
| *** holser_ has quit IRC | 17:33 | |
| weshay | w/ a scenario that exercises it | 17:33 |
| pabelanger | tested where? | 17:33 |
| weshay | so many questions | 17:33 |
| pabelanger | I don't know dlrn testing side | 17:33 |
| *** holser_ has joined #rdo | 17:33 | |
| pabelanger | but if we want to bump zuul-jobs, we need to use latest released version, not something from DLRN | 17:33 |
| pabelanger | what ever ships with centos | 17:33 |
| *** cylopez has joined #rdo | 17:35 | |
| *** cylopez has left #rdo | 17:36 | |
| weshay | pabelanger, https://review.rdoproject.org/r/#/c/13839 | 17:36 |
| weshay | https://review.rdoproject.org/jenkins/job/rdoinfo-DLRN-check/5468/ | 17:36 |
| weshay | pabelanger, ok.. so in this case.. we may need to bypass an infra role until we figure this out | 17:36 |
| *** mloza has quit IRC | 17:36 | |
| *** mloza has joined #rdo | 17:36 | |
| *** slagle has quit IRC | 17:37 | |
| weshay | pabelanger, either the ocata version of ovs *IS* the version we use across all the upstream jobs | 17:37 |
| weshay | or it isn't | 17:37 |
| weshay | and that needs to be figured out | 17:37 |
| pabelanger | weshay: yes, ocata version is what we use across all upstream centos-7 jobs | 17:38 |
| pabelanger | if we are using the multi-node role | 17:38 |
| pabelanger | where is the failure? | 17:38 |
| *** slagle has joined #rdo | 17:38 | |
| weshay | pabelanger, http://logs.openstack.org/53/579653/3/check/tripleo-ci-centos-7-scenario008-multinode-oooq-container/5e299dc/logs/undercloud/home/zuul/tempest/tempest.html.gz | 17:38 |
| weshay | rlandy, do you have the scenario007 error? | 17:39 |
| rdogerrit | Merged config master: Enable ara-report for base-test https://review.rdoproject.org/r/14735 | 17:39 |
| *** pkovar has quit IRC | 17:39 | |
| weshay | pabelanger, /me needs to get the scenario007 logs that has ovn failures | 17:41 |
| *** Eran_Kuris has joined #rdo | 17:42 | |
| *** morazi has quit IRC | 17:42 | |
| pabelanger | weshay: when did this start failing? | 17:43 |
| pabelanger | weshay: has tripleo made any changes to zuulv3 base jobs upstream? | 17:43 |
| *** brault has quit IRC | 17:44 | |
| *** jfrancoa has quit IRC | 17:44 | |
| weshay | pabelanger, when we switched over to use the upstream infra role | 17:45 |
| rlandy | weshay, http://logs.openstack.org/53/579653/3/check/tripleo-ci-centos-7-scenario008-multinode-oooq-container/5e299dc/logs/undercloud/home/zuul/tempest/tempest.html.gz | 17:45 |
| weshay | to establish the connection between the nodes | 17:45 |
| weshay | rlandy, scenario007? | 17:46 |
| weshay | rlandy, it's my understanding when rlandy uses queens openvswitch, the test passes | 17:46 |
| rlandy | http://logs.openstack.org/53/579653/3/check/tripleo-ci-centos-7-scenario008-multinode-oooq-container/ad33190/logs/tempest.html.gz\ | 17:46 |
| weshay | however rlandy what I don't know is why isn't the ocata version of ovs getting updated during the run? | 17:46 |
| weshay | or is that part of the issue.. it updates but doen't work after the update | 17:47 |
| pabelanger | so, we could propose a bump to never OVS release to fix the jobs | 17:47 |
| pabelanger | where is the old code where OVS was setup for tripleo | 17:48 |
| pabelanger | where were you getting OVS for that? | 17:48 |
| amoralej | sshnaidm|rover, i hope we have aborted two jobs | 17:48 |
| amoralej | one for master and other for queens | 17:48 |
| amoralej | i need to leave now | 17:48 |
| sshnaidm|rover | amoralej, cool, thanks | 17:48 |
| rlandy | old set up was here ... | 17:48 |
| *** amoralej is now known as amoralej|off | 17:49 | |
| rlandy | https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/undercloud-setup/templates/vxlan_networking.sh.j2 | 17:49 |
| *** jatanmalde has quit IRC | 17:49 | |
| pabelanger | right, that should be the same a new ansible role | 17:50 |
| pabelanger | unless you configured a newer repo for OVS before that script ran | 17:50 |
| pabelanger | so, fix is to update: https://review.openstack.org/580518 to use centos-release-openstack, then wait for apevec new ovs SIG and pull from it | 17:52 |
| rlandy | we di d- we ran repo-setup role | 17:52 |
| pabelanger | that will get us ovs 2.9.0 | 17:52 |
| *** fbo is now known as fbo|off | 17:52 | |
| weshay | pabelanger, not for nothin.. but suppose the initial bridge is created w/ just ocata, then we move on to install the update from queens and master | 17:52 |
| weshay | does the package update and restart correctly? | 17:52 |
| rlandy | 2.9 works according to my local test | 17:52 |
| weshay | imho | 17:52 |
| pabelanger | weshay: right, that would also be a way to move forward | 17:53 |
| weshay | everything should be at 2.9 | 17:53 |
| amuller | +1, newton+ should be on 2.9 now | 17:53 |
| weshay | yup | 17:53 |
| weshay | pabelanger, one version, pull it out of deps | 17:53 |
| rlandy | weshay: you can compare the two versions of ovs in the two logs | 17:53 |
| rlandy | one in 2.6 | 17:53 |
| rlandy | the other is 2.9 | 17:53 |
| weshay | it's just craziness | 17:53 |
| rlandy | the job with the tempest failure ... | 17:54 |
| rlandy | http://logs.openstack.org/53/579653/3/check/tripleo-ci-centos-7-scenario008-multinode-oooq-container/ad33190/logs/undercloud/var/log/openvswitch/ovs-vswitchd.log.txt.gz | 17:57 |
| rlandy | vs - the passing job ... | 17:57 |
| *** Eran_Kuris has quit IRC | 17:57 | |
| rlandy | http://logs.openstack.org/35/580235/2/check/tripleo-ci-centos-7-scenario007-multinode-oooq-container/bc15d16/logs/undercloud/var/log/openvswitch/ovs-vswitchd.log.txt.gz | 17:57 |
| rlandy | ovs version 2.6.1 vs 2.9.0 | 17:57 |
| *** Eran_Kuris has joined #rdo | 17:57 | |
| *** janki has quit IRC | 17:58 | |
| weshay | rlandy, I don't see a significant diff between those two... can you highlight or point out what the issue is between the two? | 17:59 |
| rlandy | 2018-07-03T16:58:04.568Z|00007|bridge|INFO|ovs-vswitchd (Open vSwitch) 2.6.1 | 18:00 |
| rlandy | vs | 18:00 |
| rlandy | 2018-07-06T15:05:12.667Z|00007|bridge|INFO|ovs-vswitchd (Open vSwitch) 2.9.0 | 18:00 |
| weshay | oh heh | 18:00 |
| rlandy | somehow highlighting is not working for me - but about 5 lines down | 18:00 |
| weshay | k | 18:00 |
| *** Son_Goku has joined #rdo | 18:01 | |
| weshay | rlandy, so delineating the job setup.. the bridge from the infra role.. vs.. what is installed and tested later on | 18:01 |
| weshay | rlandy, I would suspect the ovs is updated prior to tempest running | 18:01 |
| weshay | Jul 03 16:58:01 Installed: 1:openvswitch-2.6.1-10.1.git20161206.el7.x86_64 | 18:02 |
| weshay | Jul 03 17:06:41 Updated: 1:openvswitch-2.9.0-3.el7.x86_64 | 18:02 |
| weshay | http://logs.openstack.org/53/579653/3/check/tripleo-ci-centos-7-scenario008-multinode-oooq-container/ad33190/logs/undercloud/var/log/yum.log.txt.gz | 18:02 |
| weshay | and the update of the package is not working | 18:02 |
| weshay | or causing part of the pain | 18:02 |
| weshay | we have a ovs package that probably doesnt pass TPS testing | 18:03 |
| weshay | but probably should be updated to begin with | 18:03 |
| rlandy | well that or once the setup is done, you can't update what was not set up originally? | 18:03 |
| * weshay wonders what's in the rhel7 channel | 18:03 | |
| rlandy | we can update the package prior to tempest - try that in reproducer | 18:03 |
| *** dustins has joined #rdo | 18:06 | |
| weshay | pabelanger, can you jump on my bluejeans | 18:09 |
| weshay | https://bluejeans.com/u/whayutin/ | 18:09 |
| rdogerrit | User mjturek created rdo-infra/ci-config master: Add test-day-tools-ppc64le job https://review.rdoproject.org/r/14739 | 18:15 |
| mjturek_ | probably overlooking something but I thought it would be as simple as this dmsimard https://review.rdoproject.org/r/#/c/14739/ | 18:17 |
| *** ykarel|away has quit IRC | 18:24 | |
| *** pradk- has quit IRC | 18:27 | |
| *** MrAbaddon has quit IRC | 18:34 | |
| *** pradk- has joined #rdo | 18:41 | |
| *** atoth has quit IRC | 18:53 | |
| *** mburned is now known as mburned_out | 18:56 | |
| *** mburned_out is now known as mburned | 18:57 | |
| rdogerrit | Adam Kimball proposed rdo-infra/test-day-tools master: Run tripleo container builds with duffy nodes https://review.rdoproject.org/r/14502 | 18:58 |
| *** dprince has quit IRC | 19:08 | |
| *** rdopiera has quit IRC | 19:12 | |
| *** marrusl has joined #rdo | 19:12 | |
| *** brault has joined #rdo | 19:15 | |
| *** hseipp has quit IRC | 19:16 | |
| *** MrAbaddon has joined #rdo | 19:16 | |
| *** abhishekk has quit IRC | 19:20 | |
| *** tosky has quit IRC | 19:23 | |
| *** amuller has quit IRC | 19:24 | |
| rdogerrit | Adam Kimball proposed rdo-infra/test-day-tools master: Run tripleo container builds with duffy nodes https://review.rdoproject.org/r/14502 | 19:26 |
| rdogerrit | Alfredo Moralejo proposed rdo-jobs master: Specify LANG=en_US.UTF-8 in DLRN rpmbuild jobs https://review.rdoproject.org/r/14731 | 19:28 |
| *** dprince has joined #rdo | 19:33 | |
| rdogerrit | Adam Kimball proposed rdo-infra/test-day-tools master: Run tripleo container builds with duffy nodes https://review.rdoproject.org/r/14502 | 19:50 |
| *** Son_Goku has quit IRC | 19:57 | |
| *** mvk_ has joined #rdo | 20:02 | |
| *** imcsk8 has quit IRC | 20:04 | |
| *** pchavva has quit IRC | 20:05 | |
| *** pradk- has quit IRC | 20:11 | |
| *** imcsk8 has joined #rdo | 20:11 | |
| *** thrash is now known as thrash|g0ne | 20:12 | |
| *** apevec has quit IRC | 20:14 | |
| *** eharney has quit IRC | 20:16 | |
| *** jmlowe has quit IRC | 20:20 | |
| *** kgiusti has left #rdo | 20:28 | |
| *** abregman has joined #rdo | 20:33 | |
| *** julim has quit IRC | 20:37 | |
| rdogerrit | Dustin Schoenbrun created openstack/manila-distgit rpm-master: Update description for python-manila-tests package https://review.rdoproject.org/r/14740 | 20:42 |
| *** rbowen has quit IRC | 20:44 | |
| *** brault has quit IRC | 20:48 | |
| *** pradk has joined #rdo | 20:52 | |
| *** mjturek_ has quit IRC | 20:59 | |
| *** baha has quit IRC | 21:02 | |
| *** jayg is now known as jayg|g0n3 | 21:11 | |
| *** flg has quit IRC | 21:12 | |
| *** pradk has quit IRC | 21:19 | |
| *** jtomasek has quit IRC | 21:37 | |
| *** akhilaki_ has joined #rdo | 21:38 | |
| *** akhilaki has quit IRC | 21:40 | |
| *** holser_ has quit IRC | 21:58 | |
| *** paramite has quit IRC | 22:04 | |
| *** dustins has quit IRC | 22:06 | |
| *** numans has quit IRC | 22:14 | |
| *** numans has joined #rdo | 22:19 | |
| *** rcernin has joined #rdo | 22:20 | |
| *** threestrands_ has joined #rdo | 22:20 | |
| *** jappleii__ has joined #rdo | 22:23 | |
| *** jappleii__ has quit IRC | 22:24 | |
| *** jappleii__ has joined #rdo | 22:25 | |
| *** threestrands_ has quit IRC | 22:26 | |
| *** mcornea has quit IRC | 22:26 | |
| *** dprince has quit IRC | 22:33 | |
| *** mjturek has joined #rdo | 22:48 | |
| *** brault has joined #rdo | 22:48 | |
| *** mjturek has quit IRC | 22:51 | |
| *** brault has quit IRC | 22:53 | |
| *** mjturek has joined #rdo | 22:54 | |
| *** mjturek has quit IRC | 23:02 | |
| *** mjturek has joined #rdo | 23:06 | |
| *** mjturek has quit IRC | 23:07 | |
| *** whooliganface has joined #rdo | 23:21 | |
| *** zodbot_ has joined #rdo | 23:21 | |
| *** zodbot has quit IRC | 23:21 | |
| *** dyasny__ has joined #rdo | 23:22 | |
| *** chuck_ has joined #rdo | 23:22 | |
| *** dmacpher_ has joined #rdo | 23:22 | |
| *** dmacpher has quit IRC | 23:22 | |
| *** Schepeers has quit IRC | 23:22 | |
| *** zul has quit IRC | 23:22 | |
| *** zodbot_ is now known as zodbot | 23:22 | |
| *** rook has quit IRC | 23:22 | |
| *** toddnni has quit IRC | 23:23 | |
| *** Schepeers has joined #rdo | 23:23 | |
| *** toddnni has joined #rdo | 23:24 | |
| *** whooligan has quit IRC | 23:24 | |
| *** dyasny_ has quit IRC | 23:24 | |
| *** rook has joined #rdo | 23:25 | |
| *** rook is now known as Guest67898 | 23:25 | |
| *** edmondsw has quit IRC | 23:26 | |
| *** bandini has quit IRC | 23:27 | |
| *** safchain has quit IRC | 23:27 | |
| *** safchain has joined #rdo | 23:27 | |
| *** bandini has joined #rdo | 23:28 | |
| *** mjturek has joined #rdo | 23:28 | |
| *** mjturek has quit IRC | 23:34 | |
| *** rpioso is now known as rpioso|afk | 23:42 | |
| *** MrAbaddon has quit IRC | 23:46 | |
| *** MrAbaddon has joined #rdo | 23:46 | |
| *** akhilaki_ has quit IRC | 23:48 | |
| *** dmacpher_ has quit IRC | 23:53 | |
| *** MrAbaddon has quit IRC | 23:54 | |
| *** masonjoyers_ has quit IRC | 23:57 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!