Monday, 2020-03-09

*** jmasud has joined #oooq00:00
*** jmasud has quit IRC00:20
*** jmasud has joined #oooq00:24
*** jmasud has quit IRC00:36
*** radez has joined #oooq02:56
*** bhagyashris_ has joined #oooq03:07
*** bhagyashris_ has quit IRC03:08
*** bhagyashris_ has joined #oooq03:08
*** bhagyashris_ has quit IRC03:09
*** bhagyashris_ has joined #oooq03:10
*** bhagyashris_ has quit IRC03:12
*** ykarel|away is now known as ykarel04:24
*** jmasud has joined #oooq04:25
*** ratailor has joined #oooq04:35
*** jmasud has quit IRC04:54
*** jmasud has joined #oooq04:56
*** skramaja has joined #oooq05:42
*** jbadiapa has joined #oooq05:44
*** marios has joined #oooq06:14
*** ratailor has quit IRC06:15
*** dpawlik has joined #oooq07:23
*** ykarel is now known as ykarel|lunch07:39
*** ratailor has joined #oooq07:51
*** tesseract has joined #oooq08:12
*** tosky has joined #oooq08:15
arxcruz|roverykarel|lunch++ :)08:24
*** amoralej|off is now known as amoralej08:26
*** jfrancoa has joined #oooq08:31
*** jpena|off is now known as jpena08:31
*** dtantsur|afk is now known as dtantsur08:35
*** bogdando has joined #oooq08:44
*** jfrancoa has quit IRC08:50
*** jmasud has quit IRC08:52
*** jmasud has joined #oooq08:56
*** ykarel|lunch is now known as ykarel08:59
*** yolanda has quit IRC09:11
*** yolanda has joined #oooq09:11
*** derekh has joined #oooq09:37
*** apetrich has joined #oooq09:46
*** akahat has joined #oooq09:46
*** dsneddon has joined #oooq09:53
*** owalsh^ is now known as owalsh10:00
*** zbr|pto is now known as zbr10:20
zbro/10:21
zbri am back, what did I mis?10:27
*** sshnaidm|afk is now known as sshnaidm10:27
zbr(other than an s)10:27
sshnaidmpanda, any ideas how to fix http://38.102.83.109/redhat8_train.log ?10:28
*** holser has joined #oooq10:33
pandasshnaidm: yes10:37
sshnaidmpanda, ok, tell me when you have the patch, I can apply on a new promoter10:40
*** holser has quit IRC10:42
*** holser has joined #oooq10:43
pandasshnaidm: https://review.rdoproject.org/r/2577410:43
chandankumarmarios, sshnaidm, fs020 is getting tested here https://review.rdoproject.org/r/25771 and https://review.rdoproject.org/zuul/stream/5eea3811bd524e3f883a6d00d6a51755?logfile=console.log it got failed11:00
chandankumarmarios, can you rebase this https://review.opendev.org/#/c/711507/11:03
chandankumarmarios, need rebase this one also https://review.rdoproject.org/r/#/c/25746/ it will clear ovn standalone11:05
marioschandankumar: rebase onto which one11:05
chandankumarmarios from master11:05
marioschandankumar: ack gimme few will do11:06
arxcruz|roverykarel: the periodic-tripleo-centos-8-buildimage-ironic-python-agent-master failure today, was due the packages missing am i right ?11:12
chandankumarykarel, https://logserver.rdoproject.org/71/25771/2/check/periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-master/5eea381/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz11:13
chandankumarykarel, https://logserver.rdoproject.org/27/25727/6/check/distgit-tripleo-master-testing-centos-8-ovb-3ctlr_1comp-featureset001/4e8fb7c/logs/undercloud/home/zuul/undercloud_install.log.txt.gz11:14
ykarelarxcruz|rover, missing component repos at http://trunk.rdoproject.org/centos8-master/tripleo-ci-testing/delorean.repo11:15
ykarelonly 4 there, should be 1511:15
chandankumararxcruz|rover, can you open a bug for this https://logserver.rdoproject.org/27/25727/6/check/distgit-tripleo-master-testing-centos-8-ovb-3ctlr_1comp-featureset001/4e8fb7c/logs/undercloud/home/zuul/undercloud_install.log.txt.gz11:19
chandankumar  usage: mistral-db-manage [-h] [--config-dir DIR] [--config-file PATH]11:20
*** ykarel is now known as ykarel|afk11:26
*** sshnaidm has quit IRC11:36
*** sshnaidm has joined #oooq11:40
mariosbiab11:44
mariosexit11:44
*** marios has quit IRC11:44
weshay0/11:46
weshaypanda, 0/11:48
pandaweshay: hi11:48
*** jpena is now known as jpena|lunch11:48
pandaweshay: I'll probably have to skip thee meet on the unpinning, need to bring daughter to the doc. I could follow in the mobile, but I don't see a meeting URL11:49
weshaypanda, nah.. no worries.. I'm probably just discussing things you already know11:50
*** sshnaidm has quit IRC11:53
* chandankumar headed home, will connect from there11:53
*** sshnaidm has joined #oooq11:54
weshayarxcruz|rover, how you doin?11:54
arxcruz|roverchandankumar: ack, luckly, i have apetrich sitting right on my side11:54
*** weshay is now known as weshay|ruck11:54
arxcruz|roverweshay|ruck: fine and you?11:54
* weshay|ruck waves to apetrich 11:54
weshay|ruckgood..11:55
* apetrich waves back11:55
*** ratailor has quit IRC11:57
arxcruz|roverchandankumar: https://bugs.launchpad.net/tripleo/+bug/186662111:57
openstackLaunchpad bug 1866621 in tripleo "Can't run container mistral_db_sync" [High,Triaged]11:57
weshay|ruckkopecmartin, 0/11:58
weshay|ruckkopecmartin, you prepared to informally summerize the latest results etc?11:58
*** rlandy has joined #oooq11:58
*** panda is now known as panda|bbl12:07
arxcruz|roverchandankumar: apetrich is taking a look right now12:08
*** ykarel|afk is now known as ykarel12:17
rlandychandankumar: https://review.rdoproject.org/r/25775 Change the standout comparison to be a string12:18
rlandythe original review merged checked the wrong query12:18
rlandyoops - updating12:20
*** jpena|lunch is now known as jpena12:31
*** Goneri has joined #oooq12:40
chandankumarrlandy, ah ok, thanks!12:43
ykarelarxcruz|rover, wrt https://bugs.launchpad.net/tripleo/+bug/1865574/comments/10, this is different than kernel panic i mentioned in call12:52
openstackLaunchpad bug 1865574 in tripleo "centos-8 multinode and undercloud jobs are hanging on the undercloud install " [Critical,Triaged]12:52
ykarelwhen there is kernel panic, job just stucks and there no logs collected12:52
chandankumarrlandy, marios ovn patches are ready to go12:52
arxcruz|roverykarel: can you comment on the bug? I was just checking12:52
ykarelarxcruz|rover, i think commenting there will side track the issue12:53
*** jmasud has quit IRC12:53
ykarelu can check tripleo-container-image-prepare.log to get more data12:53
ykarelwrt async timeout in 720012:53
ykarelas it stuck at that point12:54
chandankumarrlandy, weshay|ruck I have started working on fs020 also12:54
*** jmasud has joined #oooq12:56
weshay|ruckykarel, would you like me to break out the additional issues you found into additional bugs?12:56
*** marios has joined #oooq12:57
weshay|rucksounds like we have 3 bugs.. 1 of which was previously known in osp12:57
chandankumarweshay|ruck, few more are coming soon, we are running here https://review.rdoproject.org/r/#/c/25727/12:58
ykarelweshay|ruck, yes better to have seperate bugs12:58
weshay|ruckThe shinnin https://meet.google.com/myx-wjxw-onk?authuser=112:58
weshay|ruckscrum starts here folks https://meet.google.com/myx-wjxw-onk?authuser=112:59
weshay|ruckykarel, if you want to chat unpinning https://meet.google.com/myx-wjxw-onk?authuser=113:00
ykareljoining13:02
chandankumarweshay|ruck, https://review.rdoproject.org/r/#/c/25612/16/tags/ussuri-uc.yml@31813:07
chandankumarweshay|ruck, https://bugs.launchpad.net/tripleo/+bug/186662113:08
openstackLaunchpad bug 1866621 in tripleo "Can't run container mistral_db_sync" [High,Triaged]13:08
*** sshnaidm has quit IRC13:08
*** sshnaidm has joined #oooq13:09
*** sshnaidm has quit IRC13:10
mariosamoralej: generally speaking we always add things to gate + promotion criteria together13:12
*** sshnaidm has joined #oooq13:18
*** sshnaidm has quit IRC13:18
*** TrevorV has joined #oooq13:19
*** sshnaidm has joined #oooq13:19
rlandyzbr: panda: scrum13:33
*** ykarel is now known as ykarel|afk13:33
*** amoralej is now known as amoralej|lunch13:34
rlandyarxcruz|rover: scrum if you can join13:34
zbrfyi: i still have a "cold", so I am no operating at 100% capacity13:35
*** skramaja has quit IRC13:36
*** jfrancoa has joined #oooq13:36
panda|bblzbr: can you please speak 1 meter from your microphone ? Thanks.13:37
*** panda|bbl is now known as panda13:37
*** apetrich has quit IRC13:37
chandankumarweshay|ruck, https://bugs.launchpad.net/tripleo/+bug/186662113:40
openstackLaunchpad bug 1866621 in tripleo "Can't run container mistral_db_sync" [High,Triaged]13:40
chandankumarrlandy, https://logserver.rdoproject.org/71/25771/2/check/periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-master/9d0bbad/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz13:44
chandankumarsshnaidm, ^^13:44
chandankumarykarel|afk, https://logserver.rdoproject.org/27/25727/8/check/rdoinfo-DLRN-check-centos8/c4ccade/job-output.txt13:46
chandankumarykarel|afk, please have a look at neutron lib issiue13:46
weshay|ruckzbr, https://review.opendev.org/#/c/711535/13:49
chandankumarrlandy, weshay|ruck https://review.opendev.org/#/c/711894/ +2 and +w13:50
*** jfrancoa has quit IRC13:51
*** ykarel|afk is now known as ykarel14:07
rlandymarios: who should we ping wrt updates?14:08
ykarelchandankumar, looks mirror related https://logserver.rdoproject.org/27/25727/8/check/rdoinfo-DLRN-check-centos8/c4ccade/buildset/centos-rpm-master/repos/component/network/6f/3f/6f3fb7fc8199b8c374e6e97a2e5a617a47b30671_dev/mock.log14:08
ykarelbaseos mising14:08
marioschandankumar: a WAN party?14:09
mariosrlandy: not sure lemme check roster or maybe matbu or ccamacho can tell us 16:08 < rlandy> marios: who should we ping wrt updates?14:10
mariosrlandy: they have since split into subgroups so not sure who drives updates these day s14:10
chandankumarmarios, yes, wide area network then yes14:10
ccamachohey marios o/14:10
marioschandankumar: ;)14:11
ccamachorlandy anyone on #rhos-upgrades14:11
mariosccamacho: who can we ask to check about centos8 update job14:11
marios                * https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_a62/710876/8/check/tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates/a62c543/logs/undercloud/home/zuul/overcloud_update_prepare.log14:11
marios                * 2020-03-06 16:51:49 | 2020-03-06 16:51:49.608 134656 ERROR openstack tripleoclient.exceptions.DeploymentError: No entry for undercloud.ctlplane in /etc/hosts14:11
rlandychandankumar: where do I see the failure here? https://logserver.rdoproject.org/openstack-component-network/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario007-standalone-network-master/d7e3183/logs/undercloud/home/zuul/tempest/tempest.log.txt.gz14:11
mariosccamacho: seen there         * https://review.opendev.org/#/c/710876/814:11
rlandyccamacho: thanks14:11
mariosccamacho: ack will paste into chan14:11
ccamachomarios xD awesome, jfrancoa chem lbezdick holser ^ jistr14:12
mariosrlandy: will you join?14:12
rlandymarios: ack14:12
rlandyjoined channel14:12
*** sshnaidm has quit IRC14:15
*** amoralej|lunch is now known as amoralej14:15
rlandymarios: also added you to review for testing fs030 https://review.rdoproject.org/r/#/c/25550/14:16
rlandyjust rebased and rekicked that14:16
mariosack rlandy14:19
rlandyhttp://zuul.openstack.org/builds?job_name=tripleo-buildimage-overcloud-full-centos-814:20
rlandywe git a build-image failure in gate14:20
rlandyarxcruz|rover: chandankumar: ^^ is that related to packages?14:21
chandankumarrlandy, if missing packages, yes known14:21
arxcruz|roverrlandy: yup14:21
rlandyok14:21
ykarelrlandy, isn't tripleo component repo not used in those jobs build jobs?14:24
ykarelcurrent repo should be good with pacakges for tripleo14:25
rlandyykarel: which jobs are you referring to? buildimage?14:25
ykarelrlandy, yes14:25
rlandyhttps://2c24c6d5ad85ea6a734c-2577420e766b653c3ec089b9602cc4a1.ssl.cf5.rackcdn.com/709616/9/check/tripleo-buildimage-overcloud-full-centos-8/4387193/yum.repos.d/delorean.repo14:26
rlandyykarel: so tripleo component should be available from ^^14:27
rlandythe failure started today with tripleo-buildimage-overcloud-full-centos-814:27
ykarelrlandy, ^^ are promoted component i.e current-tripleo14:28
ykarelfor currently, generally there is delorean-current.repo14:28
ykarels/currently/current14:28
*** sshnaidm has joined #oooq14:28
ykarelok so it's not there https://2c24c6d5ad85ea6a734c-2577420e766b653c3ec089b9602cc4a1.ssl.cf5.rackcdn.com/709616/9/check/tripleo-buildimage-overcloud-full-centos-8/4387193/yum.repos.d/14:29
ykarelso issue is related to missing packages https://bugs.launchpad.net/tripleo/+bug/1866543,14:30
openstackLaunchpad bug 1866543 in tripleo "All CentOS-8 jobs fail on missing various packages from component repos" [Critical,Triaged]14:30
ykarelas these jobs don't have current repo used, it's seen in these jobs14:31
*** sshnaidm has quit IRC14:35
mariospanda: https://review.rdoproject.org/r/25782 left the last one out but see the rest first and we can discuss the last one14:35
weshay|ruckarxcruz|rover, let me know before you go if you need to hand off anything14:47
arxcruz|roverweshay|ruck: everything is in the hackmd, and besides the package issue, we don't have too much14:48
arxcruz|rovermaybe we have, but the package issue is blocking other issues lol14:48
weshay|ruckk.. :)14:48
weshay|ruckthanks14:48
*** sshnaidm has joined #oooq14:50
*** sshnaidm_ has joined #oooq14:52
*** sshnaidm has quit IRC14:54
*** sshnaidm_ is now known as sshnaidm14:56
pandamarios: ok, when will you have time to discuss ?14:57
mariospanda: sec lemme see whats happening with rlandy and holser14:58
rlandymarios: k - picking up discussion here15:03
rlandymarios: we could try a depends on or run in chandankumar unpinned patch15:04
rlandylet's try the depends-on trick15:04
mariosrlandy: yeah so does what i said make sense? i think we would include a new build of tripleoclient as soon as it comes in from master, assuming it ends up in tripleo-ci-testing after a good build15:04
mariosrlandy: sure, i mean it should be safe since it *is* already merged15:04
rlandycheck package includes ... when was the last run?15:05
*** ykarel is now known as ykarel|away15:05
chandankumarrlandy, sorry, scrolling back15:10
holsermarios the issue is in data15:11
chandankumarmarios, you can use current repo directly via this repo https://review.opendev.org/#/c/711731/15:11
mariospanda: want to talk?15:16
mariosholser: you mean something other than https://review.opendev.org/#/c/711595/215:16
holsermarios that's it15:16
holserwe need to revert it15:16
mariosplot twist rlandy ^ c15:17
pandamarios: ok, be sure to be prepared to log in to the promoter-server and share.15:18
mariospanda: k then let me get some coffee15:18
pandawow, no st.patrick's this year.15:19
rlandymarios: so depends-on  https://review.opendev.org/#/c/711731/15:20
mariospanda: blue/meet?15:22
pandamarios: meet, you create ....15:23
mariospanda: ack pvt15:25
chandankumarrlandy, re tempest failure appears to be an infra issue15:26
chandankumarmarios, going to poke at fs03515:26
rlandychandankumar" k - will rerun15:27
chandankumarrlandy, weshay|ruck when free, please have a look at this patch https://review.rdoproject.org/r/#/c/25726/15:34
rlandymarios: when you are done, pls ping15:35
rlandyoops15:39
rlandy RuntimeError: Failed to retrieve repo file from http://mirror.gra1.ovh.openstack.org:8080/rdo/centos8-master/previous-current-tripleo/delorean.repo.md5 after 20 retries15:39
holserbogdando marios https://review.opendev.org/71193715:42
rlandypanda: weshay|ruck: ping re: previous-current-tripleo for centos 815:44
weshay|ruckrlandy, ya15:44
weshay|rucknot there .. that's from the promotion server15:44
weshay|ruckrlandy, what's up?15:44
*** apetrich has joined #oooq15:45
weshay|ruckrlandy, do we have a bug on tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates https://review.opendev.org/#/c/710876/15:46
rlandyweshay|ruck: we are not sure what the bug is yet15:47
rlandythere are a few patches flying around15:47
weshay|ruckrlandy, do we need to rerun.. only 14min in15:48
rlandyweshay|ruck: wrt the issue of the missing previous-current-tripleo15:48
weshay|ruckah.. this https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_a62/710876/8/check/tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates/a62c543/logs/undercloud/home/zuul/overcloud_update_prepare.log15:48
weshay|ruckrlandy, OH ya15:48
rlandycan we just link that?15:48
weshay|ruckrlandy, ya.. let's chat about this job for a sec15:48
rlandyok15:49
weshay|ruckhttps://meet.google.com/crw-reuc-iih?authuser=115:49
*** marios is now known as marios|call15:53
chandankumarrlandy, weshay|ruck If I donot respond back, keep an eye on upinning ironic patch, fs020 and fs03515:55
rlandyok15:55
chandankumaror better take over15:55
weshay|rucksshnaidm, you haven't migrated the hostname for the promoter in vex yet have you?15:58
weshay|ruckso [whayutin@localhost ~]$ ssh promoter.rdoproject.org15:58
weshay|ruckis the rdo one right?15:58
weshay|rucksshnaidm, nevermind you haven't15:58
weshay|rucksshnaidm, please let us know BEFORE he changes that :)15:59
sshnaidmweshay|ruck, I didn't know we have hostname for promoter :)15:59
weshay|ruckk k.. :)15:59
weshay|rucksshnaidm, thanks15:59
*** marios|call is now known as marios16:19
mariosthanks panda16:19
chandankumarrlandy, weshay|ruck arxcruz|rover https://review.opendev.org/#/c/710769/ Revert "[CentOS-8] Install ansible 2.8" has arrived any issue, let me and ykarel|away know about that16:34
weshay|ruckk16:36
chandankumarsshnaidm, if still around need some help on https://review.opendev.org/#/c/683126/ on tripleo job retry limit16:38
chandankumarit is c8 based job16:38
sshnaidmchandankumar, what is the issue there?16:38
chandankumarsshnaidm, https://13a95272ec083063167c-333846024fbe3cd00d8d8f9166c680e2.ssl.cf1.rackcdn.com/683126/25/check/tobiko-tripleo-multinode-containers/f0b03b8/logs/undercloud/home/zuul/overcloud_deploy.logs16:40
chandankumarsshnaidm, 2020-03-09 14:20:32 | Error: The following files were not found: /usr/share/openstack-tripleo-heat-templates/ci/environments/scenario001-multinode.yaml16:40
sshnaidmchandankumar, is tht installed?16:40
chandankumarsshnaidm, not looked in more details, but helped as much as possible16:41
chandankumarweshay|ruck, rlandy https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_348/710176/3/gate/tripleo-buildimage-overcloud-full-centos-8/3486e38/overcloud-full.log16:41
chandankumarmore packages missing16:41
rlandychandankumar: yep :( we know16:41
rlandysee #rhos-ops16:41
chandankumarrlandy, now in gate16:42
chandankumarrlandy, on it16:42
mariospanda updated https://review.rdoproject.org/r/2578216:50
mariospanda: please review and i can update tomorrow thanks16:50
mariospanda: (review tomorrow if you are busy i won't check before then anyway16:50
pandamarios: ok16:52
*** apetrich has quit IRC16:54
chandankumarrlandy, weshay|ruck sshnaidm O am logging out now keep an eye on these reviews https://review.rdoproject.org/r/25727 https://review.rdoproject.org/r/25771 https://review.rdoproject.org/r/25784 I will try to check out tomorrow sometime16:55
mariospanda: (minor update again)16:58
mariospanda: v3 just posted fyi16:58
chandankumar@all, we can make Happy CentOS-8 day, some day :-)16:58
*** bogdando has quit IRC17:00
chandankumarHappy Holi in advance, Life is full of colors, let it come, we know how to paint, we all are artists, and We will make that happen. Painting is going to be amazing  looking forward see ya on wednesday :-)17:00
*** chandankumar is now known as raukadah17:00
rlandyraukadah: happy holidays - see you wednesday17:01
rlandyweshay|ruck: kicking testproject for master pipeline17:02
weshay|ruckrlandy, rock17:02
rlandyhttps://review.rdoproject.org/r/#/c/24995/17:02
weshay|rucksee it watching..17:03
weshay|ruckthanks17:03
* marios shutdown sequence17:03
zbrweshay|ruck: https://review.opendev.org/#/c/710111/ before it will require a rebase17:05
weshay|ruckdone.. thansk17:06
*** marios is now known as marios|out17:12
*** marios|out has quit IRC17:17
*** jmasud has quit IRC17:18
*** jmasud has joined #oooq17:18
*** ccamacho has quit IRC17:22
*** dtantsur is now known as dtantsur|afk17:30
*** apetrich has joined #oooq17:31
*** jpena is now known as jpena|off17:33
zbrweshay|ruck: where are we supposed to get hiera from?17:34
zbrdo we miss it on centos-8?17:34
zbrI see that on c7 we get it from  delorean-master-testing17:35
weshay|ruckzbr, https://trunk.rdoproject.org/centos8-master/deps/latest/noarch/17:36
rlandyweshay|ruck: and in other exciting news ... the image server was not fixed ... back on that now17:39
weshay|ruckugh17:39
rlandythe image jobs do pass now17:39
weshay|ruckrlandy, see that.. need help?17:39
rlandyhttps://images.rdoproject.org/centos8/master/rdo_trunk/17:39
rlandyweshay|ruck: so removing archive didn't work - I reverted that17:40
rlandywill have to rethink the solution here17:40
rlandyweshay|ruck: help - sure - let's finish this17:40
weshay|ruckk17:40
*** apetrich has quit IRC17:41
*** ccamacho has joined #oooq18:00
*** derekh has quit IRC18:00
*** chem has quit IRC18:17
*** chem has joined #oooq18:18
*** amoralej is now known as amoralej|off18:31
weshay|ruckrlandy, 2020-03-09 18:48:07.979358 | primary | 2020-03-09 18:48:07.832 124361 ERROR tempest TypeError: option values must be strings18:59
weshay|ruckrlandy, https://bugs.launchpad.net/tripleo/+bug/186575419:00
openstackLaunchpad bug 1865754 in tripleo "tripleo-ci-centos-8-scenario001-standalone tempest-conf fails 500 PUT http://192.168.24.1:9292/v2/images/ RADOS invalid argument" [Critical,Triaged]19:00
weshay|ruckrlandy, https://logserver.rdoproject.org/95/24995/30/check/periodic-tripleo-ci-centos-8-scenario001-standalone-master/538e8aa/job-output.txt19:01
rlandyweshay|ruck: https://opendev.org/openstack/python-tempestconf/src/branch/master/config_tempest/services/share.py19:03
rlandyarxcruz|rover: ^^ you still around??19:05
mjturekdo the centos8 container build jobs use docker?19:06
*** holser has quit IRC19:20
rlandythey should use podman19:25
rlandybuildah etc.19:26
rlandyhttps://bugs.launchpad.net/tripleo/+bug/186669619:26
openstackLaunchpad bug 1866696 in tripleo "promoted-components dirs get reaped and the top-level file does not contain all components" [High,Triaged]19:26
rlandyweshay|ruck: ^^19:26
rlandymarked promotion-blocker19:26
weshay|ruckthanks19:26
weshay|ruckrlandy, looks perfect.. well described19:27
rlandyadded to hackmd19:27
weshay|ruckrlandy, ok.. fs010 passed, waiting on 719:30
rlandygood19:30
*** tesseract has quit IRC19:33
rlandyweshay|ruck: component pipeline reruns - scenario001 is killing us https://review.rdoproject.org/r/#/c/25412/19:34
weshay|ruckrlandy, I'd rather turn tempest off for that job.. than to not run it19:35
weshay|ruckcould do that19:35
weshay|ruckrlandy, I would assume though arx could fix that tomorrow19:36
rlandyweshay|ruck: k - one day19:37
weshay|ruckrlandy, ok.. promote ready for promote current-tripleo -> previous-current-tripleo and promote tripleo-ci-testing -> current-tripleo?19:42
rlandysec19:42
weshay|ruckk19:42
rlandyok  image builds in progress - let's do this19:44
rlandyweshay|ruck: ^^19:44
weshay|ruckk19:44
weshay|ruckrlandy, tmate19:44
weshay|ruckrlandy, sorry.. tmux on prmoter19:44
rlandyok19:45
rlandyweshay|ruck: let's check if all components have current-tripleo19:46
weshay|ruckrlandy, nope19:47
rlandyweshay|ruck: use tripleo-ci-testing19:47
rlandyto go to current-tripleo19:47
rlandyto go to previous19:47
weshay|ruckoh k19:47
rlandyweshay|ruck: that might break if it updates backwards but we'll find out19:48
rlandyweshay|ruck: k - cool19:49
rlandynow baremetal has a current-tripleo19:49
weshay|ruckrlandy, I think it's fine.. it's just a dumb yum update operation across nodes driven by the tripleo upgrade tools.. and it also changes out containers19:49
rlandynow you can make that previous19:49
weshay|rucketc19:49
rlandyhack, hack, hack19:50
weshay|ruckrlandy, looks good.. moving on to previous19:52
rlandyweshay|ruck: go4it19:52
weshay|ruckrlandy, ack to +2 wf https://review.opendev.org/#/c/710876/ when the commit message changes19:53
rlandyweshay|ruck: let's run it again19:53
rlandyweshay|ruck: it could hit multiple other issue19:54
weshay|ruckrlandy, oh k19:54
rlandyalso, I need to fine luke's patch19:54
rlandywe need a new build of tripleo-client20:01
arxcruz|roverrlandy: https://review.opendev.org/#/c/711976/20:12
arxcruz|rovertosky: still around? can we have this merged asap, to fix centos8 scenario001? ^20:13
rlandyarxcruz|rover: thanks20:13
toskyarxcruz|rover: sure; is it in any tagged release?20:22
weshay|ruckarxcruz|rover, /me looks20:22
weshay|ruckthanks20:22
arxcruz|rovertosky: nope, on mastes, kopecmartin already checked20:23
weshay|ruckarxcruz|rover++20:23
arxcruz|rovertosky: but take a look if you're okay20:23
toskyarxcruz|rover: does it mean we have a cinder or manila multibackend tripleo job somewhere?20:24
arxcruz|rovertosky: that only rlandy and weshay|ruck can answer for you, these are new jobs...20:24
arxcruz|rovernew centos8 job, but regardless, the code is wrong20:24
weshay|rucktosky, omg.. it's tosky20:25
rlandyarxcruz|rover: ack - shows up in centos8 jobs20:25
weshay|ruckhe's ALIVE20:25
tosky... I'm always on this channel20:25
weshay|rucktosky, yes light coverage20:25
* weshay|ruck just messin20:25
toskyo.o20:25
toskyweshay|ruck: so cinder? LVM + Ceph?20:25
toskyI guess I need to check the job definition, if I don't get lost in the matrices20:26
toskymatrixes?20:26
toskyuhm20:26
weshay|rucksomething like that20:26
weshay|ruckthanks kopecmartin tosky arxcruz|rover20:29
*** ccamacho has quit IRC20:29
rlandyweshay|ruck: http://zuul.openstack.org/stream/1d9354f3bd664e24b78d11c5486847c1?logfile=console.log installing undercloud20:34
weshay|ruckrock20:35
rlandygoing to run scenario001 with arxcruz|rover's change20:35
arxcruz|roverrlandy: i'll stay around if you need something from my side20:36
rlandyarxcruz|rover: it's fie - will leave you email if we need anything20:36
rlandyhave a good night20:36
*** sshnaidm is now known as sshnaidm|afk20:40
*** jmasud has quit IRC20:54
*** jmasud has joined #oooq20:55
rlandyweshay|ruck: wrt https://review.opendev.org/#/c/710876/ - you want to merge the job non-voting even if it's failing?20:56
rlandyoh - and I have to make scenario004 voting and gating - coming up ...20:57
weshay|ruckrlandy, yup20:58
rlandyok20:59
*** TrevorV has quit IRC21:35
weshay|ruckrlandy, am I missing something stupid here:? https://review.opendev.org/#/c/711982/21:36
rlandyweshay|ruck: what's next? still battling the image server?21:36
weshay|ruckfor ovb https://review.rdoproject.org/r/#/c/25332/21:36
weshay|ruckrlandy, no... not sure what to do about that tbh21:36
weshay|ruckon the sync tomorrow maybe21:36
rlandyweshay|ruck: want to try the rsync patch?21:37
rlandyhmmmm ... I feel like there was an atop patch earlier today21:37
rlandyoh https://review.opendev.org/#/c/711894/ was abandoned21:38
weshay|ruckfyi https://review.opendev.org/71198821:42
weshay|ruckrlandy, ya.. it's not ci.. let's NUKE IT21:43
rlandyweshay|ruck: you sure voting/gating? http://zuul.openstack.org/builds?job_name=tripleo-ci-centos-8-scenario001-standalone21:44
rlandyya - we definitely made the promote-components issue worse ... https://trunk.rdoproject.org/centos8-master/component/cloudops/21:45
rlandyskipped promotion - correctly so21:45
rlandypinned - no content change - no hash change21:46
rlandyweshay|ruck: fyi ... tempest results ... https://review.rdoproject.org/r/#/c/24995/ - going to put in a patch to increase timeout21:52
rlandymay get us by21:53
* weshay|ruck looks21:53
weshay|ruckrlandy, +121:53
weshay|ruckrlandy, missing something 2020-03-09 21:50:36.755643 | primary |     "reason": "Could not find or access '/home/zuul/workspace/.quickstart/playbooks/atop.yml' on the Ansible Controller."21:57
weshay|ruckhttps://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_f90/711982/2/check/tripleo-ci-centos-8-standalone/f90e130/job-output.txt21:57
weshay|ruckrlandy, ah I see it21:58
rlandyweshay|ruck: you removed it21:58
*** dpawlik has quit IRC22:00
*** jbadiapa has quit IRC22:00
rlandyweshay|ruck: chat re: what's left to do today?22:06
weshay|ruckrlandy, meh22:07
weshay|ruckrlandy, me just updating the hackmd22:07
rlandyweshay|ruck: worried re: images22:08
weshay|ruckya..22:09
rlandytry the permission patch or no?22:09
weshay|ruckrlandy, ya sure22:12
rlandyweshay|ruck: ok - will try and revert22:14
weshay|ruckrlandy, I mean.. --archive may be needed if we get the perms right.. unclear22:17
weshay|ruckworth the time to experiment22:17
rlandyweshay|ruck: well, the alternative is to chmod the images before we rsync22:19
weshay|ruckyup22:19
* rlandy investigates22:19
rlandyweshay|ruck: another approach ... https://review.opendev.org/711996 DNM: Testing changing image file permissions22:50
rlandywe can test this one in testproject22:50
rlandythoughts?22:51
weshay|rucklooking23:01
weshay|ruckrlandy,  just use one call.. on line 75.. "chmod 0755 *.tar23:02
weshay|ruck"23:02
rlandylooking23:04
*** rlandy is now known as rlandy|bbl23:05
*** tosky has quit IRC23:30
*** apetrich has joined #oooq23:33

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!