Wednesday, 2020-04-29

*** jmasud has joined #oooq00:04
*** rfolco has quit IRC00:24
*** jmasud has quit IRC01:09
*** apetrich has quit IRC02:09
*** jmasud has joined #oooq02:40
*** jmasud has quit IRC02:49
*** jmasud has joined #oooq03:01
*** Tengu has quit IRC03:21
*** saneax has joined #oooq03:22
*** Tengu has joined #oooq03:23
*** jmasud has quit IRC03:56
*** jmasud has joined #oooq04:47
*** ykarel|away is now known as ykarel04:51
*** skramaja has joined #oooq04:55
*** ratailor has joined #oooq05:00
*** jfrancoa has joined #oooq05:10
*** jmasud has quit IRC05:15
*** jmasud has joined #oooq05:32
*** ysandeep|away is now known as ysandeep05:45
*** ysandeep is now known as ysandeep|brb05:55
*** udesale has joined #oooq06:10
*** jmasud has quit IRC06:17
*** marios has joined #oooq06:18
*** jmasud has joined #oooq06:19
*** bogdando has joined #oooq06:19
*** jmasud has quit IRC06:23
*** jmasud has joined #oooq06:26
*** ysandeep|brb is now known as ysandeep06:51
*** dpawlik has joined #oooq06:59
*** amoralej|off is now known as amoralej07:02
*** jmasud has quit IRC07:03
*** yolanda has joined #oooq07:19
*** apetrich has joined #oooq07:24
*** tosky has joined #oooq07:29
*** ykarel is now known as ykarel|afk07:29
*** ysandeep is now known as ysandeep|lunch07:42
*** jpena|off is now known as jpena07:55
*** ccamacho has joined #oooq08:05
*** ykarel|afk is now known as ykarel08:21
*** ysandeep|lunch is now known as ysandeep08:26
arxcruzchandankumar: the job replacing fs020 is periodic-tripleo-ci-centos-7-standalone-full-tempest-master correct ?08:35
*** ykarel is now known as ykarel|lunch08:35
arxcruzand the api one08:36
chandankumararxcruz: I think yes08:39
*** jaosorior has quit IRC08:45
*** jmasud has joined #oooq08:45
*** jbadiapa has joined #oooq08:52
*** dtantsur|afk is now known as dtantsur09:24
*** ykarel|lunch is now known as ykarel09:44
*** udesale has quit IRC10:03
*** udesale has joined #oooq10:03
*** jmasud has quit IRC11:23
*** ysandeep is now known as ysandeep|coffee11:29
*** derekh has joined #oooq11:30
*** jpena is now known as jpena|lunch11:32
*** jschlueter has joined #oooq11:45
weshay|ruckchandankumar, ovb check jobs are still configured to download the overcloud image?11:58
chandankumarweshay|ruck: in master we download it, for train I need to check11:59
weshay|ruckchandankumar, they are building12:02
chandankumarweshay|ruck: which release ?12:03
*** amoralej is now known as amoralej|lunch12:07
weshay|ruckchandankumar, going to write up an issue w/ overcloud image build in periodic12:09
weshay|ruckpanda|ruck,12:09
chandankumarweshay|ruck: ok12:09
panda|ruckweshay|ruck:12:09
weshay|ruckhttps://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-latest-released12:10
weshay|ruckchandankumar, did you remove the centos image build jobs?12:10
chandankumarweshay|ruck: periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-train-upload it is here12:11
rlandymarios: hey - can we meet half an hour earlier - that slot clashes with prod chain meeting12:11
weshay|ruckpanda|ruck, we're going to have to promote train together today12:14
panda|ruckweshay|ruck: ok12:14
mariosrlandy: ack np moving12:14
*** rfolco has joined #oooq12:14
weshay|ruckpanda|ruck, akahat|ruck let's sync at the bottom of the hour12:15
weshay|ruckchandankumar, images may be good.. after further review :)12:15
chandankumarweshay|ruck: I am not sure what was the issue12:17
chandankumarrlandy: in this review https://review.rdoproject.org/r/#/c/26920/ and https://logserver.rdoproject.org/20/26920/8/check/periodic-tripleo-centos-8-train-promote-consistent-to-tripleo-ci-testing/975a954/job-output.txt12:17
weshay|ruckchandankumar, did you make any headway w/ collectd?12:17
chandankumarci-config changes depends-on is not working12:17
chandankumarrlandy: please have a look12:18
chandankumarweshay|ruck: still stuck at same place https://review.opendev.org/724265 and https://review.opendev.org/724266 will fix opstools issue12:18
weshay|ruckhttps://review.opendev.org/#/c/724266/1/container-images/tripleo_kolla_template_overrides.j2 NICE12:19
weshay|rucknice12:19
weshay|ruckchandankumar++ so .. is it centos-release-opstools or centos-opstools?12:19
chandankumarcentos-release-opstools12:20
weshay|ruckchandankumar, how do we know that?12:20
weshay|ruckchandankumar, /me wondering if there is a diff between centos7 and centos812:21
chandankumarweshay|ruck: it is just opstools https://logserver.rdoproject.org/20/26920/8/check/periodic-tripleo-centos-8-buildimage-overcloud-full-train/be48812/yum.repos.d/delorean-train-testing.repo12:22
*** Goneri has joined #oooq12:22
weshay|ruckchandankumar, k.. /me looks.. take a look at https://0eba3fd793605134a75d-564304a9de90443921717306641e66e8.ssl.cf1.rackcdn.com/724265/1/check/tripleo-build-containers-centos-8/2582a47/etc/yum.repos.d/12:23
weshay|ruckchandankumar, opstools is not included by default and will need to be added via tripleo-repos12:23
weshay|ruckOH12:23
weshay|ruckit's in deps12:23
rlandychandankumar: looking12:25
*** derekh has quit IRC12:26
weshay|ruckchandankumar, maybe the rdo guys can rename that centos-release-opstools?12:27
weshay|ruckso it's consistent?12:27
chandankumarykarel: ^^12:27
ykarelchandankumar, weshay|ruck delorean-deps will be cleaned up once centos-release-opstools or centos opstools mirror repos are used is used at all the places12:29
ykarelif we change both to same name, we will don't know which repo is used12:29
ykarelwhen both are configured12:29
weshay|ruckah... ya let me look at my centos8 box12:30
chandankumarsoniya29: arxcruz meeting12:31
weshay|ruck[centos-opstools]12:31
weshay|ruckname=CentOS-8 - OpsTools - collectd12:31
weshay|ruckmirrorlist=http://mirrorlist.centos.org/?arch=$basearch&release=$releasever&repo=opstools-collectd-512:31
weshay|ruck#baseurl=http://mirror.centos.org/$contentdir/$releasever/opstools/$basearch/collectd-5/12:31
weshay|ruckgpgcheck=112:31
weshay|ruckenabled=112:31
weshay|ruckskip_if_unavailable=112:31
weshay|ruckykarel, ^12:31
*** jpena|lunch is now known as jpena12:32
weshay|ruckykarel, chandankumar so.. kolla says... centos-release-opstools, the release rpm says.. centos-opstools and dlrn-deps says opstools12:32
weshay|ruckso ...12:32
ykarelweshay|ruck, kolla just install centos-release-opstools, which configure centos-opstools repo like ^^12:34
ykarelthe tripleo-common  patch is just cleanup12:34
weshay|ruckcleanup?12:34
weshay|ruckit's not enabling the repo for the container build?12:34
ykarelissue currently is built images are not used in job, so old images with old repo are used in job12:34
ykareltripleo-ci-testing for train centos8 is outdated12:35
ykarelweshay|ruck, repo is already enabled in kolla https://github.com/openstack/kolla/commit/8a6aa9e5959990a88e7eacd95cb3a833e5971f5912:35
rlandychandankumar: left some comments on that job12:36
ykarelin tripleo-common we added that hack as at that time we didn't had that rpm, so now cleaning up12:36
weshay|ruckykarel, chandankumar so the repo is not default in centos8.. right... so chandankumar let's add an install of centos-release-opstools12:38
weshay|ruckchandankumar, and we may need update https://review.opendev.org/#/c/717697/5/docker/collectd/Dockerfile.j212:38
weshay|ruckfor train12:38
ykarelweshay|ruck, yes right, opstools is not default in centos8, neither it was default in centos7, so needs to enable explicitly wherever required12:40
ykareldidn't get what needs update in https://review.opendev.org/#/c/717697/5/docker/collectd/Dockerfile.j212:41
weshay|ruckykarel, the build is failing on two packages... so it may clear up once centos-release-opstools rpm is installed.. but it also may not and the packages will need to be explicitly added12:42
weshay|ruckpanda|ruck, akahat|ruck https://meet.google.com/sgp-krvp-ixa?authuser=112:42
ykarelweshay|ruck, it's installed, reason is <ykarel> issue currently is built images are not used in job, so old images with old repo are used in job12:43
akahat|ruckweshay|ruck, we are already on the call.. you can join here: https://meet.google.com/iyt-qzwv-xtk12:43
ykarel^^ is reason of missing packages12:43
ykarelso if u rerun after updating tripleo-ci-testing train centos8 it should clear12:43
ykareli still don't know why built images are not used in that job, and already published images on trunk registry are used12:44
weshay|ruckakahat|ruck, panda|ruck https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-wednesday-weekend12:48
weshay|ruckakahat|ruck, panda|ruck https://logserver.rdoproject.org/openstack-periodic-wednesday-weekend/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset010-queens/cca03e3/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz12:51
weshay|ruckhttps://logserver.rdoproject.org/openstack-periodic-wednesday-weekend/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset010-queens/cca03e3/logs/subnode-1/var/log/extra/journal.txt.gz12:56
* ykarel out for sometime12:58
*** ykarel is now known as ykarel|afk12:58
weshay|ruckpanda|ruck, akahat|ruck https://logserver.rdoproject.org/openstack-periodic-wednesday-weekend/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset010-queens/cca03e3/logs/subnode-1/var/lib/heat-config/tripleo-config-download/12:59
chandankumarweshay|ruck: rlandy I am stepping out for a bit, back in an hour or 213:00
rlandychandankumar: ack13:02
weshay|ruckhttps://opendev.org/openstack/tripleo-heat-templates/src/branch/master/overcloud.j2.yaml#L59613:02
*** derekh has joined #oooq13:12
*** amoralej|lunch is now known as amoralej13:13
rfolcochandankumar, weshay|ruck buildcontainers_rpm_setup_config: "http://172.17.0.1/delorean.repo,http://172.17.0.1/delorean-master-testing.repo" did not work.... probably this is not the ip of the host.... ideas ? maybe a set_fact: hostvars[primary].ipv4_address ?13:16
*** ratailor has quit IRC13:16
rfolcoah nm --> https://trunk.rdoproject.org/centos8-ussuri/delorean-deps.repo renamed13:16
rfolcothis should be enough13:17
*** udesale_ has joined #oooq13:24
*** udesale has quit IRC13:27
*** ykarel|afk is now known as ykarel13:46
*** TrevorV has joined #oooq13:52
*** matbu has quit IRC13:54
*** matbu has joined #oooq13:55
mariosrlandy: forgot to mention earlier fyi moved done https://tree.taiga.io/project/tripleo-ci-board/task/1656 move back if you disagree/something else there14:02
rlandymarios: ack - thanks for taking care of that14:02
mariosrlandy: drag/drop isn't too tiring ;)14:04
rlandymarios: at least you don't need permission from the govt to make that move14:05
mariosrlandy: indeed...14:05
*** dpawlik has quit IRC14:28
rlandymarios: why isn't the container build job running https://github.com/openstack/tripleo-ci/blob/master/playbooks/tripleo-buildcontainers/pre.yaml?14:29
rlandyit's parented off tripleo-build-containers-base-noreposetup-rhel814:29
rlandywhich runs :14:29
rlandy    run: playbooks/tripleo-buildcontainers/run.yaml14:29
rlandy    post-run: playbooks/tripleo-buildcontainers/post.yaml14:29
rlandybut not the pre.yaml14:29
rlandymaybe we don;t need it?14:29
mariosrlandy: we added pre_rhel814:29
rlandymarios: I assume that covers the functionality in:14:30
rlandy    - name: Run build containers pre tasks14:30
rlandy      include_role:14:30
rlandy        name: build-containers14:30
rlandytasks_from: pre14:30
mariosrlandy: https://code.engineering.redhat.com/gerrit/#/c/196858/75/zuul.d/tripleo-build-containers.yaml@614:30
mariosrlandy: the job itself parents from tripleo-build-containers-base-noreposetup-rhel8 i.e. upstream14:31
mariosrlandy: which doesn't run the pre tasks as we have them d/stream14:32
rlandymarios: ack - that if the difference I am tracing ...14:32
rlandylooking at the parenting from upstream14:32
rlandythose jobs parent off tripleo-build-containers-base14:32
marioshttps://github.com/openstack/tripleo-ci/blob/master/zuul.d/base.yaml#L380 rlandy no pre14:32
rlandywhich runs playbooks/tripleo-buildcontainers/pre.yaml14:32
mariosrlandy: no it does not14:33
-openstackstatus- NOTICE: Zuul had to be restarted, all changes submitted or approved between 14:00 UTC to 14:30 need to be rechecked, we queued already those running at 14:0014:33
rlandymarios: sorry - I am comparing the rdo jobs14:33
marios17:32 < marios> https://github.com/openstack/tripleo-ci/blob/master/zuul.d/base.yaml#L380 rlandy no pre14:34
mariosrlandy: there ^^^14:34
rlandymarios: don't we need that functionality?14:34
mariosrlandy: we have it in d/stream pre which includes all our hacks pre_rhel8.yaml14:34
mariosrlandy: mainly cos we don't want the upstream reposetup14:35
* rlandy looks 14:35
marioshttps://code.engineering.redhat.com/gerrit/#/c/196858/75/playbooks/tripleo-buildcontainers/pre_rhel8.yaml@13514:35
mariosrlandy: ^14:35
mariosrlandy: so in the end all that is left in the pre is install buildah/setup registry for local push14:35
rlandymarios: ok - ack - I see you extracted just the parts we needed14:36
rlandymarios: thanks - just trying to untangle what needs to go into the push job14:36
mariosrlandy: ack np14:38
weshay|ruckpanda|ruck, akahat|ruck resync?14:58
weshay|ruckpanda|ruck, this was the change for the sanity job https://review.rdoproject.org/r/#/c/26461/15:01
weshay|ruckbut it's abandoned15:01
weshay|ruckhelloooo?15:03
panda|ruckI'll be there after hydration and sugar intake dose15:03
weshay|ruckk :)15:04
akahat|ruckweshay|ruck, yes.15:04
weshay|ruckpanda|ruck, akahat|ruck https://meet.google.com/otm-vdbh-ycu?authuser=1 when ur avail15:04
akahat|ruckweshay|ruck, joining in 5 mins.15:04
weshay|ruckk.. thanks :)15:04
*** ykarel is now known as ykarel|away15:06
rlandyweshay|ruck: 1-on-1 or you want to skip?15:07
weshay|ruckrlandy, moved it a bit15:09
akahat|ruckweshay|ruck, https://logserver.rdoproject.org/openstack-periodic-wednesday-weekend/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset030-queens/4509c32/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz15:10
akahat|ruckweshay|ruck, https://bugs.launchpad.net/tripleo/+bug/187584615:10
openstackLaunchpad bug 1875846 in tripleo "Overcloud stack creation failed because of failed dependencies." [Critical,Incomplete] - Assigned to amolkahat (amolkahat)15:10
akahat|ruckweshay|ruck, https://bugs.launchpad.net/tripleo/+bug/187583315:14
openstackLaunchpad bug 1875833 in tripleo "The WebSocket timed out before the Workflow completed in rocky/stain jobs" [Critical,New] - Assigned to amolkahat (amolkahat)15:14
weshay|ruckakahat|ruck, https://logserver.rdoproject.org/openstack-periodic-wednesday-weekend/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-queens/3136791/logs/undercloud/var/log/mistral/engine.log.txt.gz15:20
weshay|ruckpanda|ruck, ssh zuul@38.145.33.1515:23
weshay|ruckakahat|ruck, add https://github.com/weshayutin.keys15:24
weshay|ruckto zuul/authorized_keys15:24
weshay|ruckpanda|ruck, https://review.rdoproject.org/r/#/c/26461/15:37
*** jaosorior has joined #oooq15:44
*** jmasud has joined #oooq15:49
*** TrevorV has quit IRC15:59
* marios shutdown 16:04
rlandyweshay|ruck: 1-on-1 moved again?16:06
weshay|ruckpanda|ruck, fyi. .this is incoming https://review.opendev.org/#/c/723824/16:09
weshay|ruckrlandy, ya.. let's chat16:09
*** ysandeep|coffee is now known as ysandeep|away16:12
*** bogdando has quit IRC16:16
*** jmasud has quit IRC16:18
*** marios has quit IRC16:19
*** jmasud has joined #oooq16:30
*** dtantsur is now known as dtantsur|afk16:36
rfolcochandankumar, wth EXCEPTION in https://review.opendev.org/#/c/72184216:40
weshay|ruckpanda|ruck, akahat|ruck bandini is working on a patch and will update me soon16:46
weshay|ruck:)16:46
zbrhttps://review.opendev.org/#/c/720168/ anyone?16:56
*** jpena is now known as jpena|off17:14
*** amoralej is now known as amoralej|off17:22
*** apetrich has quit IRC17:22
rfolcoweshay|ruck, chandankumar ussuri containers pushed to rdo registry17:32
weshay|rucknice..17:32
rfolconow we have a problem: docker.io tripleoussuri ....17:32
rfolcowe need a new namespace....17:32
rfolcoor maybe it was created by someone else in redhat... ask in the list ?17:32
weshay|ruckrfolco, see if we can push to it.. manually17:32
rfolcok17:33
weshay|ruckrfolco, try it.. it may work :/17:33
rfolcok k17:33
*** skramaja has quit IRC17:36
*** udesale_ has quit IRC17:42
weshay|ruckrlandy, can I see the tripleo-common-container-overrides executed in the logs anywhere?17:49
weshay|ruckya.. in base17:50
weshay|rucknevermind17:50
rfolcoweshay|ruck, failed :(17:55
rfolcodenied: requested access to the resource is denied17:55
weshay|ruckrfolco, can you email docker.io support17:55
weshay|ruckrfolco, let's see if we can get it nuked.. so we can recreate it17:56
rfolcothere is nothing in there17:56
rfolcook lets try17:56
weshay|ruckrfolco, https://success.docker.com/article/how-do-i-claim-an-inactive-docker-id17:57
*** jmasud has quit IRC17:58
rfolcoweshay|ruck, chandankumar rlandy panda|ruck zbr: reviews required urgently please: 1) https://review.rdoproject.org/r/#/c/26800/ 2) https://review.rdoproject.org/r/#/c/26907/ 3) https://review.rdoproject.org/r/#/c/26908/ and 4) https://review.rdoproject.org/r/#/c/26909/18:20
rfolcoadding the sequence above to the hackmd to ease reviews and give context18:20
zbrlooking...18:21
zbrrfolco: first change depends on https://review.opendev.org/#/c/721842 which fail18:22
rfolcozbr, rechecked... have you seen this EXCEPTION on zuul result ?18:23
zbryes, on other changes, "recheck"18:23
zbrrfolco: don't we want different files for each release for integration-pipeline, so we can diff them? https://review.rdoproject.org/r/#/c/26908/5/zuul.d/integration-pipeline.yaml18:25
rfolcozbr, its a fair point18:25
zbrif we keep all releases in a single gile it becames very hard to maintain.18:26
rfolcolet me fix this before depends-on report green18:26
zbrhow do I guess that a specific job was added/removed from one release?18:26
rfolcozbr++18:26
rlandyweshay|ruck: kolla uses that18:33
rlandycan check the container build logs18:33
rlandyweshay|ruck: have 5 mins? would you like to show you something in the deploy order18:35
kopecmartinweshay|ruck: zbr , can you have a look at this, please? https://review.opendev.org/#/c/724350/18:36
*** derekh has quit IRC18:36
*** jmasud has joined #oooq18:41
zbrdone.18:41
*** jbadiapa has quit IRC18:42
kopecmartinzbr: thank you18:46
weshay|ruckrlandy, if ur avail https://meet.google.com/kmv-ewtz-teq?authuser=119:01
rlandyweshay|ruck: joining19:02
weshay|ruckrlandy, you have any conerns?19:25
rlandyweshay|ruck: sounds ok19:25
rlandyweshay|ruck: same deal19:25
rlandyas we are doing now19:26
*** yolanda has quit IRC19:36
*** jmasud has quit IRC19:48
*** jmasud has joined #oooq19:51
*** jmasud has quit IRC19:51
*** jmasud has joined #oooq19:54
rlandyrfolco: looking20:15
*** ccamacho has quit IRC20:59
*** jmasud has quit IRC21:07
*** jmasud has joined #oooq21:13
*** jfrancoa has quit IRC21:18
*** jmasud has quit IRC22:04
*** hamzy_ has joined #oooq22:11
*** hamzy has quit IRC22:13
*** jmasud has joined #oooq22:22
*** jmasud has quit IRC22:38
*** jmasud has joined #oooq22:43
*** jmasud has quit IRC23:02
*** tosky has quit IRC23:11
*** Tengu has quit IRC23:23
*** Tengu has joined #oooq23:25
rlandyweshay|ruck: ok to merge https://review.opendev.org/#/c/723759/?23:35
*** rlandy has quit IRC23:51
*** chem has quit IRC23:56
*** Tengu has quit IRC23:56
*** chem has joined #oooq23:57
*** Tengu has joined #oooq23:58

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!