*** jmasud has joined #oooq | 00:00 | |
*** jmasud has quit IRC | 00:20 | |
*** jmasud has joined #oooq | 00:24 | |
*** jmasud has quit IRC | 00:36 | |
*** radez has joined #oooq | 02:56 | |
*** bhagyashris_ has joined #oooq | 03:07 | |
*** bhagyashris_ has quit IRC | 03:08 | |
*** bhagyashris_ has joined #oooq | 03:08 | |
*** bhagyashris_ has quit IRC | 03:09 | |
*** bhagyashris_ has joined #oooq | 03:10 | |
*** bhagyashris_ has quit IRC | 03:12 | |
*** ykarel|away is now known as ykarel | 04:24 | |
*** jmasud has joined #oooq | 04:25 | |
*** ratailor has joined #oooq | 04:35 | |
*** jmasud has quit IRC | 04:54 | |
*** jmasud has joined #oooq | 04:56 | |
*** skramaja has joined #oooq | 05:42 | |
*** jbadiapa has joined #oooq | 05:44 | |
*** marios has joined #oooq | 06:14 | |
*** ratailor has quit IRC | 06:15 | |
*** dpawlik has joined #oooq | 07:23 | |
*** ykarel is now known as ykarel|lunch | 07:39 | |
*** ratailor has joined #oooq | 07:51 | |
*** tesseract has joined #oooq | 08:12 | |
*** tosky has joined #oooq | 08:15 | |
arxcruz|rover | ykarel|lunch++ :) | 08:24 |
---|---|---|
*** amoralej|off is now known as amoralej | 08:26 | |
*** jfrancoa has joined #oooq | 08:31 | |
*** jpena|off is now known as jpena | 08:31 | |
*** dtantsur|afk is now known as dtantsur | 08:35 | |
*** bogdando has joined #oooq | 08:44 | |
*** jfrancoa has quit IRC | 08:50 | |
*** jmasud has quit IRC | 08:52 | |
*** jmasud has joined #oooq | 08:56 | |
*** ykarel|lunch is now known as ykarel | 08:59 | |
*** yolanda has quit IRC | 09:11 | |
*** yolanda has joined #oooq | 09:11 | |
*** derekh has joined #oooq | 09:37 | |
*** apetrich has joined #oooq | 09:46 | |
*** akahat has joined #oooq | 09:46 | |
*** dsneddon has joined #oooq | 09:53 | |
*** owalsh^ is now known as owalsh | 10:00 | |
*** zbr|pto is now known as zbr | 10:20 | |
zbr | o/ | 10:21 |
zbr | i am back, what did I mis? | 10:27 |
*** sshnaidm|afk is now known as sshnaidm | 10:27 | |
zbr | (other than an s) | 10:27 |
sshnaidm | panda, any ideas how to fix http://38.102.83.109/redhat8_train.log ? | 10:28 |
*** holser has joined #oooq | 10:33 | |
panda | sshnaidm: yes | 10:37 |
sshnaidm | panda, ok, tell me when you have the patch, I can apply on a new promoter | 10:40 |
*** holser has quit IRC | 10:42 | |
*** holser has joined #oooq | 10:43 | |
panda | sshnaidm: https://review.rdoproject.org/r/25774 | 10:43 |
chandankumar | marios, sshnaidm, fs020 is getting tested here https://review.rdoproject.org/r/25771 and https://review.rdoproject.org/zuul/stream/5eea3811bd524e3f883a6d00d6a51755?logfile=console.log it got failed | 11:00 |
chandankumar | marios, can you rebase this https://review.opendev.org/#/c/711507/ | 11:03 |
chandankumar | marios, need rebase this one also https://review.rdoproject.org/r/#/c/25746/ it will clear ovn standalone | 11:05 |
marios | chandankumar: rebase onto which one | 11:05 |
chandankumar | marios from master | 11:05 |
marios | chandankumar: ack gimme few will do | 11:06 |
arxcruz|rover | ykarel: the periodic-tripleo-centos-8-buildimage-ironic-python-agent-master failure today, was due the packages missing am i right ? | 11:12 |
chandankumar | ykarel, https://logserver.rdoproject.org/71/25771/2/check/periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-master/5eea381/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 11:13 |
chandankumar | ykarel, https://logserver.rdoproject.org/27/25727/6/check/distgit-tripleo-master-testing-centos-8-ovb-3ctlr_1comp-featureset001/4e8fb7c/logs/undercloud/home/zuul/undercloud_install.log.txt.gz | 11:14 |
ykarel | arxcruz|rover, missing component repos at http://trunk.rdoproject.org/centos8-master/tripleo-ci-testing/delorean.repo | 11:15 |
ykarel | only 4 there, should be 15 | 11:15 |
chandankumar | arxcruz|rover, can you open a bug for this https://logserver.rdoproject.org/27/25727/6/check/distgit-tripleo-master-testing-centos-8-ovb-3ctlr_1comp-featureset001/4e8fb7c/logs/undercloud/home/zuul/undercloud_install.log.txt.gz | 11:19 |
chandankumar | usage: mistral-db-manage [-h] [--config-dir DIR] [--config-file PATH] | 11:20 |
*** ykarel is now known as ykarel|afk | 11:26 | |
*** sshnaidm has quit IRC | 11:36 | |
*** sshnaidm has joined #oooq | 11:40 | |
marios | biab | 11:44 |
marios | exit | 11:44 |
*** marios has quit IRC | 11:44 | |
weshay | 0/ | 11:46 |
weshay | panda, 0/ | 11:48 |
panda | weshay: hi | 11:48 |
*** jpena is now known as jpena|lunch | 11:48 | |
panda | weshay: I'll probably have to skip thee meet on the unpinning, need to bring daughter to the doc. I could follow in the mobile, but I don't see a meeting URL | 11:49 |
weshay | panda, nah.. no worries.. I'm probably just discussing things you already know | 11:50 |
*** sshnaidm has quit IRC | 11:53 | |
* chandankumar headed home, will connect from there | 11:53 | |
*** sshnaidm has joined #oooq | 11:54 | |
weshay | arxcruz|rover, how you doin? | 11:54 |
arxcruz|rover | chandankumar: ack, luckly, i have apetrich sitting right on my side | 11:54 |
*** weshay is now known as weshay|ruck | 11:54 | |
arxcruz|rover | weshay|ruck: fine and you? | 11:54 |
* weshay|ruck waves to apetrich | 11:54 | |
weshay|ruck | good.. | 11:55 |
* apetrich waves back | 11:55 | |
*** ratailor has quit IRC | 11:57 | |
arxcruz|rover | chandankumar: https://bugs.launchpad.net/tripleo/+bug/1866621 | 11:57 |
openstack | Launchpad bug 1866621 in tripleo "Can't run container mistral_db_sync" [High,Triaged] | 11:57 |
weshay|ruck | kopecmartin, 0/ | 11:58 |
weshay|ruck | kopecmartin, you prepared to informally summerize the latest results etc? | 11:58 |
*** rlandy has joined #oooq | 11:58 | |
*** panda is now known as panda|bbl | 12:07 | |
arxcruz|rover | chandankumar: apetrich is taking a look right now | 12:08 |
*** ykarel|afk is now known as ykarel | 12:17 | |
rlandy | chandankumar: https://review.rdoproject.org/r/25775 Change the standout comparison to be a string | 12:18 |
rlandy | the original review merged checked the wrong query | 12:18 |
rlandy | oops - updating | 12:20 |
*** jpena|lunch is now known as jpena | 12:31 | |
*** Goneri has joined #oooq | 12:40 | |
chandankumar | rlandy, ah ok, thanks! | 12:43 |
ykarel | arxcruz|rover, wrt https://bugs.launchpad.net/tripleo/+bug/1865574/comments/10, this is different than kernel panic i mentioned in call | 12:52 |
openstack | Launchpad bug 1865574 in tripleo "centos-8 multinode and undercloud jobs are hanging on the undercloud install " [Critical,Triaged] | 12:52 |
ykarel | when there is kernel panic, job just stucks and there no logs collected | 12:52 |
chandankumar | rlandy, marios ovn patches are ready to go | 12:52 |
arxcruz|rover | ykarel: can you comment on the bug? I was just checking | 12:52 |
ykarel | arxcruz|rover, i think commenting there will side track the issue | 12:53 |
*** jmasud has quit IRC | 12:53 | |
ykarel | u can check tripleo-container-image-prepare.log to get more data | 12:53 |
ykarel | wrt async timeout in 7200 | 12:53 |
ykarel | as it stuck at that point | 12:54 |
chandankumar | rlandy, weshay|ruck I have started working on fs020 also | 12:54 |
*** jmasud has joined #oooq | 12:56 | |
weshay|ruck | ykarel, would you like me to break out the additional issues you found into additional bugs? | 12:56 |
*** marios has joined #oooq | 12:57 | |
weshay|ruck | sounds like we have 3 bugs.. 1 of which was previously known in osp | 12:57 |
chandankumar | weshay|ruck, few more are coming soon, we are running here https://review.rdoproject.org/r/#/c/25727/ | 12:58 |
ykarel | weshay|ruck, yes better to have seperate bugs | 12:58 |
weshay|ruck | The shinnin https://meet.google.com/myx-wjxw-onk?authuser=1 | 12:58 |
weshay|ruck | scrum starts here folks https://meet.google.com/myx-wjxw-onk?authuser=1 | 12:59 |
weshay|ruck | ykarel, if you want to chat unpinning https://meet.google.com/myx-wjxw-onk?authuser=1 | 13:00 |
ykarel | joining | 13:02 |
chandankumar | weshay|ruck, https://review.rdoproject.org/r/#/c/25612/16/tags/ussuri-uc.yml@318 | 13:07 |
chandankumar | weshay|ruck, https://bugs.launchpad.net/tripleo/+bug/1866621 | 13:08 |
openstack | Launchpad bug 1866621 in tripleo "Can't run container mistral_db_sync" [High,Triaged] | 13:08 |
*** sshnaidm has quit IRC | 13:08 | |
*** sshnaidm has joined #oooq | 13:09 | |
*** sshnaidm has quit IRC | 13:10 | |
marios | amoralej: generally speaking we always add things to gate + promotion criteria together | 13:12 |
*** sshnaidm has joined #oooq | 13:18 | |
*** sshnaidm has quit IRC | 13:18 | |
*** TrevorV has joined #oooq | 13:19 | |
*** sshnaidm has joined #oooq | 13:19 | |
rlandy | zbr: panda: scrum | 13:33 |
*** ykarel is now known as ykarel|afk | 13:33 | |
*** amoralej is now known as amoralej|lunch | 13:34 | |
rlandy | arxcruz|rover: scrum if you can join | 13:34 |
zbr | fyi: i still have a "cold", so I am no operating at 100% capacity | 13:35 |
*** skramaja has quit IRC | 13:36 | |
*** jfrancoa has joined #oooq | 13:36 | |
panda|bbl | zbr: can you please speak 1 meter from your microphone ? Thanks. | 13:37 |
*** panda|bbl is now known as panda | 13:37 | |
*** apetrich has quit IRC | 13:37 | |
chandankumar | weshay|ruck, https://bugs.launchpad.net/tripleo/+bug/1866621 | 13:40 |
openstack | Launchpad bug 1866621 in tripleo "Can't run container mistral_db_sync" [High,Triaged] | 13:40 |
chandankumar | rlandy, https://logserver.rdoproject.org/71/25771/2/check/periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-master/9d0bbad/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 13:44 |
chandankumar | sshnaidm, ^^ | 13:44 |
chandankumar | ykarel|afk, https://logserver.rdoproject.org/27/25727/8/check/rdoinfo-DLRN-check-centos8/c4ccade/job-output.txt | 13:46 |
chandankumar | ykarel|afk, please have a look at neutron lib issiue | 13:46 |
weshay|ruck | zbr, https://review.opendev.org/#/c/711535/ | 13:49 |
chandankumar | rlandy, weshay|ruck https://review.opendev.org/#/c/711894/ +2 and +w | 13:50 |
*** jfrancoa has quit IRC | 13:51 | |
*** ykarel|afk is now known as ykarel | 14:07 | |
rlandy | marios: who should we ping wrt updates? | 14:08 |
ykarel | chandankumar, looks mirror related https://logserver.rdoproject.org/27/25727/8/check/rdoinfo-DLRN-check-centos8/c4ccade/buildset/centos-rpm-master/repos/component/network/6f/3f/6f3fb7fc8199b8c374e6e97a2e5a617a47b30671_dev/mock.log | 14:08 |
ykarel | baseos mising | 14:08 |
marios | chandankumar: a WAN party? | 14:09 |
marios | rlandy: not sure lemme check roster or maybe matbu or ccamacho can tell us 16:08 < rlandy> marios: who should we ping wrt updates? | 14:10 |
marios | rlandy: they have since split into subgroups so not sure who drives updates these day s | 14:10 |
chandankumar | marios, yes, wide area network then yes | 14:10 |
ccamacho | hey marios o/ | 14:10 |
marios | chandankumar: ;) | 14:11 |
ccamacho | rlandy anyone on #rhos-upgrades | 14:11 |
marios | ccamacho: who can we ask to check about centos8 update job | 14:11 |
marios | * https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_a62/710876/8/check/tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates/a62c543/logs/undercloud/home/zuul/overcloud_update_prepare.log | 14:11 |
marios | * 2020-03-06 16:51:49 | 2020-03-06 16:51:49.608 134656 ERROR openstack tripleoclient.exceptions.DeploymentError: No entry for undercloud.ctlplane in /etc/hosts | 14:11 |
rlandy | chandankumar: where do I see the failure here? https://logserver.rdoproject.org/openstack-component-network/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario007-standalone-network-master/d7e3183/logs/undercloud/home/zuul/tempest/tempest.log.txt.gz | 14:11 |
marios | ccamacho: seen there * https://review.opendev.org/#/c/710876/8 | 14:11 |
rlandy | ccamacho: thanks | 14:11 |
marios | ccamacho: ack will paste into chan | 14:11 |
ccamacho | marios xD awesome, jfrancoa chem lbezdick holser ^ jistr | 14:12 |
marios | rlandy: will you join? | 14:12 |
rlandy | marios: ack | 14:12 |
rlandy | joined channel | 14:12 |
*** sshnaidm has quit IRC | 14:15 | |
*** amoralej|lunch is now known as amoralej | 14:15 | |
rlandy | marios: also added you to review for testing fs030 https://review.rdoproject.org/r/#/c/25550/ | 14:16 |
rlandy | just rebased and rekicked that | 14:16 |
marios | ack rlandy | 14:19 |
rlandy | http://zuul.openstack.org/builds?job_name=tripleo-buildimage-overcloud-full-centos-8 | 14:20 |
rlandy | we git a build-image failure in gate | 14:20 |
rlandy | arxcruz|rover: chandankumar: ^^ is that related to packages? | 14:21 |
chandankumar | rlandy, if missing packages, yes known | 14:21 |
arxcruz|rover | rlandy: yup | 14:21 |
rlandy | ok | 14:21 |
ykarel | rlandy, isn't tripleo component repo not used in those jobs build jobs? | 14:24 |
ykarel | current repo should be good with pacakges for tripleo | 14:25 |
rlandy | ykarel: which jobs are you referring to? buildimage? | 14:25 |
ykarel | rlandy, yes | 14:25 |
rlandy | https://2c24c6d5ad85ea6a734c-2577420e766b653c3ec089b9602cc4a1.ssl.cf5.rackcdn.com/709616/9/check/tripleo-buildimage-overcloud-full-centos-8/4387193/yum.repos.d/delorean.repo | 14:26 |
rlandy | ykarel: so tripleo component should be available from ^^ | 14:27 |
rlandy | the failure started today with tripleo-buildimage-overcloud-full-centos-8 | 14:27 |
ykarel | rlandy, ^^ are promoted component i.e current-tripleo | 14:28 |
ykarel | for currently, generally there is delorean-current.repo | 14:28 |
ykarel | s/currently/current | 14:28 |
*** sshnaidm has joined #oooq | 14:28 | |
ykarel | ok so it's not there https://2c24c6d5ad85ea6a734c-2577420e766b653c3ec089b9602cc4a1.ssl.cf5.rackcdn.com/709616/9/check/tripleo-buildimage-overcloud-full-centos-8/4387193/yum.repos.d/ | 14:29 |
ykarel | so issue is related to missing packages https://bugs.launchpad.net/tripleo/+bug/1866543, | 14:30 |
openstack | Launchpad bug 1866543 in tripleo "All CentOS-8 jobs fail on missing various packages from component repos" [Critical,Triaged] | 14:30 |
ykarel | as these jobs don't have current repo used, it's seen in these jobs | 14:31 |
*** sshnaidm has quit IRC | 14:35 | |
marios | panda: https://review.rdoproject.org/r/25782 left the last one out but see the rest first and we can discuss the last one | 14:35 |
weshay|ruck | arxcruz|rover, let me know before you go if you need to hand off anything | 14:47 |
arxcruz|rover | weshay|ruck: everything is in the hackmd, and besides the package issue, we don't have too much | 14:48 |
arxcruz|rover | maybe we have, but the package issue is blocking other issues lol | 14:48 |
weshay|ruck | k.. :) | 14:48 |
weshay|ruck | thanks | 14:48 |
*** sshnaidm has joined #oooq | 14:50 | |
*** sshnaidm_ has joined #oooq | 14:52 | |
*** sshnaidm has quit IRC | 14:54 | |
*** sshnaidm_ is now known as sshnaidm | 14:56 | |
panda | marios: ok, when will you have time to discuss ? | 14:57 |
marios | panda: sec lemme see whats happening with rlandy and holser | 14:58 |
rlandy | marios: k - picking up discussion here | 15:03 |
rlandy | marios: we could try a depends on or run in chandankumar unpinned patch | 15:04 |
rlandy | let's try the depends-on trick | 15:04 |
marios | rlandy: yeah so does what i said make sense? i think we would include a new build of tripleoclient as soon as it comes in from master, assuming it ends up in tripleo-ci-testing after a good build | 15:04 |
marios | rlandy: sure, i mean it should be safe since it *is* already merged | 15:04 |
rlandy | check package includes ... when was the last run? | 15:05 |
*** ykarel is now known as ykarel|away | 15:05 | |
chandankumar | rlandy, sorry, scrolling back | 15:10 |
holser | marios the issue is in data | 15:11 |
chandankumar | marios, you can use current repo directly via this repo https://review.opendev.org/#/c/711731/ | 15:11 |
marios | panda: want to talk? | 15:16 |
marios | holser: you mean something other than https://review.opendev.org/#/c/711595/2 | 15:16 |
holser | marios that's it | 15:16 |
holser | we need to revert it | 15:16 |
marios | plot twist rlandy ^ c | 15:17 |
panda | marios: ok, be sure to be prepared to log in to the promoter-server and share. | 15:18 |
marios | panda: k then let me get some coffee | 15:18 |
panda | wow, no st.patrick's this year. | 15:19 |
rlandy | marios: so depends-on https://review.opendev.org/#/c/711731/ | 15:20 |
marios | panda: blue/meet? | 15:22 |
panda | marios: meet, you create .... | 15:23 |
marios | panda: ack pvt | 15:25 |
chandankumar | rlandy, re tempest failure appears to be an infra issue | 15:26 |
chandankumar | marios, going to poke at fs035 | 15:26 |
rlandy | chandankumar" k - will rerun | 15:27 |
chandankumar | rlandy, weshay|ruck when free, please have a look at this patch https://review.rdoproject.org/r/#/c/25726/ | 15:34 |
rlandy | marios: when you are done, pls ping | 15:35 |
rlandy | oops | 15:39 |
rlandy | RuntimeError: Failed to retrieve repo file from http://mirror.gra1.ovh.openstack.org:8080/rdo/centos8-master/previous-current-tripleo/delorean.repo.md5 after 20 retries | 15:39 |
holser | bogdando marios https://review.opendev.org/711937 | 15:42 |
rlandy | panda: weshay|ruck: ping re: previous-current-tripleo for centos 8 | 15:44 |
weshay|ruck | rlandy, ya | 15:44 |
weshay|ruck | not there .. that's from the promotion server | 15:44 |
weshay|ruck | rlandy, what's up? | 15:44 |
*** apetrich has joined #oooq | 15:45 | |
weshay|ruck | rlandy, do we have a bug on tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates https://review.opendev.org/#/c/710876/ | 15:46 |
rlandy | weshay|ruck: we are not sure what the bug is yet | 15:47 |
rlandy | there are a few patches flying around | 15:47 |
weshay|ruck | rlandy, do we need to rerun.. only 14min in | 15:48 |
rlandy | weshay|ruck: wrt the issue of the missing previous-current-tripleo | 15:48 |
weshay|ruck | ah.. this https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_a62/710876/8/check/tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates/a62c543/logs/undercloud/home/zuul/overcloud_update_prepare.log | 15:48 |
weshay|ruck | rlandy, OH ya | 15:48 |
rlandy | can we just link that? | 15:48 |
weshay|ruck | rlandy, ya.. let's chat about this job for a sec | 15:48 |
rlandy | ok | 15:49 |
weshay|ruck | https://meet.google.com/crw-reuc-iih?authuser=1 | 15:49 |
*** marios is now known as marios|call | 15:53 | |
chandankumar | rlandy, weshay|ruck If I donot respond back, keep an eye on upinning ironic patch, fs020 and fs035 | 15:55 |
rlandy | ok | 15:55 |
chandankumar | or better take over | 15:55 |
weshay|ruck | sshnaidm, you haven't migrated the hostname for the promoter in vex yet have you? | 15:58 |
weshay|ruck | so [whayutin@localhost ~]$ ssh promoter.rdoproject.org | 15:58 |
weshay|ruck | is the rdo one right? | 15:58 |
weshay|ruck | sshnaidm, nevermind you haven't | 15:58 |
weshay|ruck | sshnaidm, please let us know BEFORE he changes that :) | 15:59 |
sshnaidm | weshay|ruck, I didn't know we have hostname for promoter :) | 15:59 |
weshay|ruck | k k.. :) | 15:59 |
weshay|ruck | sshnaidm, thanks | 15:59 |
*** marios|call is now known as marios | 16:19 | |
marios | thanks panda | 16:19 |
chandankumar | rlandy, weshay|ruck arxcruz|rover https://review.opendev.org/#/c/710769/ Revert "[CentOS-8] Install ansible 2.8" has arrived any issue, let me and ykarel|away know about that | 16:34 |
weshay|ruck | k | 16:36 |
chandankumar | sshnaidm, if still around need some help on https://review.opendev.org/#/c/683126/ on tripleo job retry limit | 16:38 |
chandankumar | it is c8 based job | 16:38 |
sshnaidm | chandankumar, what is the issue there? | 16:38 |
chandankumar | sshnaidm, https://13a95272ec083063167c-333846024fbe3cd00d8d8f9166c680e2.ssl.cf1.rackcdn.com/683126/25/check/tobiko-tripleo-multinode-containers/f0b03b8/logs/undercloud/home/zuul/overcloud_deploy.logs | 16:40 |
chandankumar | sshnaidm, 2020-03-09 14:20:32 | Error: The following files were not found: /usr/share/openstack-tripleo-heat-templates/ci/environments/scenario001-multinode.yaml | 16:40 |
sshnaidm | chandankumar, is tht installed? | 16:40 |
chandankumar | sshnaidm, not looked in more details, but helped as much as possible | 16:41 |
chandankumar | weshay|ruck, rlandy https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_348/710176/3/gate/tripleo-buildimage-overcloud-full-centos-8/3486e38/overcloud-full.log | 16:41 |
chandankumar | more packages missing | 16:41 |
rlandy | chandankumar: yep :( we know | 16:41 |
rlandy | see #rhos-ops | 16:41 |
chandankumar | rlandy, now in gate | 16:42 |
chandankumar | rlandy, on it | 16:42 |
marios | panda updated https://review.rdoproject.org/r/25782 | 16:50 |
marios | panda: please review and i can update tomorrow thanks | 16:50 |
marios | panda: (review tomorrow if you are busy i won't check before then anyway | 16:50 |
panda | marios: ok | 16:52 |
*** apetrich has quit IRC | 16:54 | |
chandankumar | rlandy, weshay|ruck sshnaidm O am logging out now keep an eye on these reviews https://review.rdoproject.org/r/25727 https://review.rdoproject.org/r/25771 https://review.rdoproject.org/r/25784 I will try to check out tomorrow sometime | 16:55 |
marios | panda: (minor update again) | 16:58 |
marios | panda: v3 just posted fyi | 16:58 |
chandankumar | @all, we can make Happy CentOS-8 day, some day :-) | 16:58 |
*** bogdando has quit IRC | 17:00 | |
chandankumar | Happy Holi in advance, Life is full of colors, let it come, we know how to paint, we all are artists, and We will make that happen. Painting is going to be amazing looking forward see ya on wednesday :-) | 17:00 |
*** chandankumar is now known as raukadah | 17:00 | |
rlandy | raukadah: happy holidays - see you wednesday | 17:01 |
rlandy | weshay|ruck: kicking testproject for master pipeline | 17:02 |
weshay|ruck | rlandy, rock | 17:02 |
rlandy | https://review.rdoproject.org/r/#/c/24995/ | 17:02 |
weshay|ruck | see it watching.. | 17:03 |
weshay|ruck | thanks | 17:03 |
* marios shutdown sequence | 17:03 | |
zbr | weshay|ruck: https://review.opendev.org/#/c/710111/ before it will require a rebase | 17:05 |
weshay|ruck | done.. thansk | 17:06 |
*** marios is now known as marios|out | 17:12 | |
*** marios|out has quit IRC | 17:17 | |
*** jmasud has quit IRC | 17:18 | |
*** jmasud has joined #oooq | 17:18 | |
*** ccamacho has quit IRC | 17:22 | |
*** dtantsur is now known as dtantsur|afk | 17:30 | |
*** apetrich has joined #oooq | 17:31 | |
*** jpena is now known as jpena|off | 17:33 | |
zbr | weshay|ruck: where are we supposed to get hiera from? | 17:34 |
zbr | do we miss it on centos-8? | 17:34 |
zbr | I see that on c7 we get it from delorean-master-testing | 17:35 |
weshay|ruck | zbr, https://trunk.rdoproject.org/centos8-master/deps/latest/noarch/ | 17:36 |
rlandy | weshay|ruck: and in other exciting news ... the image server was not fixed ... back on that now | 17:39 |
weshay|ruck | ugh | 17:39 |
rlandy | the image jobs do pass now | 17:39 |
weshay|ruck | rlandy, see that.. need help? | 17:39 |
rlandy | https://images.rdoproject.org/centos8/master/rdo_trunk/ | 17:39 |
rlandy | weshay|ruck: so removing archive didn't work - I reverted that | 17:40 |
rlandy | will have to rethink the solution here | 17:40 |
rlandy | weshay|ruck: help - sure - let's finish this | 17:40 |
weshay|ruck | k | 17:40 |
*** apetrich has quit IRC | 17:41 | |
*** ccamacho has joined #oooq | 18:00 | |
*** derekh has quit IRC | 18:00 | |
*** chem has quit IRC | 18:17 | |
*** chem has joined #oooq | 18:18 | |
*** amoralej is now known as amoralej|off | 18:31 | |
weshay|ruck | rlandy, 2020-03-09 18:48:07.979358 | primary | 2020-03-09 18:48:07.832 124361 ERROR tempest TypeError: option values must be strings | 18:59 |
weshay|ruck | rlandy, https://bugs.launchpad.net/tripleo/+bug/1865754 | 19:00 |
openstack | Launchpad bug 1865754 in tripleo "tripleo-ci-centos-8-scenario001-standalone tempest-conf fails 500 PUT http://192.168.24.1:9292/v2/images/ RADOS invalid argument" [Critical,Triaged] | 19:00 |
weshay|ruck | rlandy, https://logserver.rdoproject.org/95/24995/30/check/periodic-tripleo-ci-centos-8-scenario001-standalone-master/538e8aa/job-output.txt | 19:01 |
rlandy | weshay|ruck: https://opendev.org/openstack/python-tempestconf/src/branch/master/config_tempest/services/share.py | 19:03 |
rlandy | arxcruz|rover: ^^ you still around?? | 19:05 |
mjturek | do the centos8 container build jobs use docker? | 19:06 |
*** holser has quit IRC | 19:20 | |
rlandy | they should use podman | 19:25 |
rlandy | buildah etc. | 19:26 |
rlandy | https://bugs.launchpad.net/tripleo/+bug/1866696 | 19:26 |
openstack | Launchpad bug 1866696 in tripleo "promoted-components dirs get reaped and the top-level file does not contain all components" [High,Triaged] | 19:26 |
rlandy | weshay|ruck: ^^ | 19:26 |
rlandy | marked promotion-blocker | 19:26 |
weshay|ruck | thanks | 19:26 |
weshay|ruck | rlandy, looks perfect.. well described | 19:27 |
rlandy | added to hackmd | 19:27 |
weshay|ruck | rlandy, ok.. fs010 passed, waiting on 7 | 19:30 |
rlandy | good | 19:30 |
*** tesseract has quit IRC | 19:33 | |
rlandy | weshay|ruck: component pipeline reruns - scenario001 is killing us https://review.rdoproject.org/r/#/c/25412/ | 19:34 |
weshay|ruck | rlandy, I'd rather turn tempest off for that job.. than to not run it | 19:35 |
weshay|ruck | could do that | 19:35 |
weshay|ruck | rlandy, I would assume though arx could fix that tomorrow | 19:36 |
rlandy | weshay|ruck: k - one day | 19:37 |
weshay|ruck | rlandy, ok.. promote ready for promote current-tripleo -> previous-current-tripleo and promote tripleo-ci-testing -> current-tripleo? | 19:42 |
rlandy | sec | 19:42 |
weshay|ruck | k | 19:42 |
rlandy | ok image builds in progress - let's do this | 19:44 |
rlandy | weshay|ruck: ^^ | 19:44 |
weshay|ruck | k | 19:44 |
weshay|ruck | rlandy, tmate | 19:44 |
weshay|ruck | rlandy, sorry.. tmux on prmoter | 19:44 |
rlandy | ok | 19:45 |
rlandy | weshay|ruck: let's check if all components have current-tripleo | 19:46 |
weshay|ruck | rlandy, nope | 19:47 |
rlandy | weshay|ruck: use tripleo-ci-testing | 19:47 |
rlandy | to go to current-tripleo | 19:47 |
rlandy | to go to previous | 19:47 |
weshay|ruck | oh k | 19:47 |
rlandy | weshay|ruck: that might break if it updates backwards but we'll find out | 19:48 |
rlandy | weshay|ruck: k - cool | 19:49 |
rlandy | now baremetal has a current-tripleo | 19:49 |
weshay|ruck | rlandy, I think it's fine.. it's just a dumb yum update operation across nodes driven by the tripleo upgrade tools.. and it also changes out containers | 19:49 |
rlandy | now you can make that previous | 19:49 |
weshay|ruck | etc | 19:49 |
rlandy | hack, hack, hack | 19:50 |
weshay|ruck | rlandy, looks good.. moving on to previous | 19:52 |
rlandy | weshay|ruck: go4it | 19:52 |
weshay|ruck | rlandy, ack to +2 wf https://review.opendev.org/#/c/710876/ when the commit message changes | 19:53 |
rlandy | weshay|ruck: let's run it again | 19:53 |
rlandy | weshay|ruck: it could hit multiple other issue | 19:54 |
weshay|ruck | rlandy, oh k | 19:54 |
rlandy | also, I need to fine luke's patch | 19:54 |
rlandy | we need a new build of tripleo-client | 20:01 |
arxcruz|rover | rlandy: https://review.opendev.org/#/c/711976/ | 20:12 |
arxcruz|rover | tosky: still around? can we have this merged asap, to fix centos8 scenario001? ^ | 20:13 |
rlandy | arxcruz|rover: thanks | 20:13 |
tosky | arxcruz|rover: sure; is it in any tagged release? | 20:22 |
weshay|ruck | arxcruz|rover, /me looks | 20:22 |
weshay|ruck | thanks | 20:22 |
arxcruz|rover | tosky: nope, on mastes, kopecmartin already checked | 20:23 |
weshay|ruck | arxcruz|rover++ | 20:23 |
arxcruz|rover | tosky: but take a look if you're okay | 20:23 |
tosky | arxcruz|rover: does it mean we have a cinder or manila multibackend tripleo job somewhere? | 20:24 |
arxcruz|rover | tosky: that only rlandy and weshay|ruck can answer for you, these are new jobs... | 20:24 |
arxcruz|rover | new centos8 job, but regardless, the code is wrong | 20:24 |
weshay|ruck | tosky, omg.. it's tosky | 20:25 |
rlandy | arxcruz|rover: ack - shows up in centos8 jobs | 20:25 |
weshay|ruck | he's ALIVE | 20:25 |
tosky | ... I'm always on this channel | 20:25 |
weshay|ruck | tosky, yes light coverage | 20:25 |
* weshay|ruck just messin | 20:25 | |
tosky | o.o | 20:25 |
tosky | weshay|ruck: so cinder? LVM + Ceph? | 20:25 |
tosky | I guess I need to check the job definition, if I don't get lost in the matrices | 20:26 |
tosky | matrixes? | 20:26 |
tosky | uhm | 20:26 |
weshay|ruck | something like that | 20:26 |
weshay|ruck | thanks kopecmartin tosky arxcruz|rover | 20:29 |
*** ccamacho has quit IRC | 20:29 | |
rlandy | weshay|ruck: http://zuul.openstack.org/stream/1d9354f3bd664e24b78d11c5486847c1?logfile=console.log installing undercloud | 20:34 |
weshay|ruck | rock | 20:35 |
rlandy | going to run scenario001 with arxcruz|rover's change | 20:35 |
arxcruz|rover | rlandy: i'll stay around if you need something from my side | 20:36 |
rlandy | arxcruz|rover: it's fie - will leave you email if we need anything | 20:36 |
rlandy | have a good night | 20:36 |
*** sshnaidm is now known as sshnaidm|afk | 20:40 | |
*** jmasud has quit IRC | 20:54 | |
*** jmasud has joined #oooq | 20:55 | |
rlandy | weshay|ruck: wrt https://review.opendev.org/#/c/710876/ - you want to merge the job non-voting even if it's failing? | 20:56 |
rlandy | oh - and I have to make scenario004 voting and gating - coming up ... | 20:57 |
weshay|ruck | rlandy, yup | 20:58 |
rlandy | ok | 20:59 |
*** TrevorV has quit IRC | 21:35 | |
weshay|ruck | rlandy, am I missing something stupid here:? https://review.opendev.org/#/c/711982/ | 21:36 |
rlandy | weshay|ruck: what's next? still battling the image server? | 21:36 |
weshay|ruck | for ovb https://review.rdoproject.org/r/#/c/25332/ | 21:36 |
weshay|ruck | rlandy, no... not sure what to do about that tbh | 21:36 |
weshay|ruck | on the sync tomorrow maybe | 21:36 |
rlandy | weshay|ruck: want to try the rsync patch? | 21:37 |
rlandy | hmmmm ... I feel like there was an atop patch earlier today | 21:37 |
rlandy | oh https://review.opendev.org/#/c/711894/ was abandoned | 21:38 |
weshay|ruck | fyi https://review.opendev.org/711988 | 21:42 |
weshay|ruck | rlandy, ya.. it's not ci.. let's NUKE IT | 21:43 |
rlandy | weshay|ruck: you sure voting/gating? http://zuul.openstack.org/builds?job_name=tripleo-ci-centos-8-scenario001-standalone | 21:44 |
rlandy | ya - we definitely made the promote-components issue worse ... https://trunk.rdoproject.org/centos8-master/component/cloudops/ | 21:45 |
rlandy | skipped promotion - correctly so | 21:45 |
rlandy | pinned - no content change - no hash change | 21:46 |
rlandy | weshay|ruck: fyi ... tempest results ... https://review.rdoproject.org/r/#/c/24995/ - going to put in a patch to increase timeout | 21:52 |
rlandy | may get us by | 21:53 |
* weshay|ruck looks | 21:53 | |
weshay|ruck | rlandy, +1 | 21:53 |
weshay|ruck | rlandy, missing something 2020-03-09 21:50:36.755643 | primary | "reason": "Could not find or access '/home/zuul/workspace/.quickstart/playbooks/atop.yml' on the Ansible Controller." | 21:57 |
weshay|ruck | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_f90/711982/2/check/tripleo-ci-centos-8-standalone/f90e130/job-output.txt | 21:57 |
weshay|ruck | rlandy, ah I see it | 21:58 |
rlandy | weshay|ruck: you removed it | 21:58 |
*** dpawlik has quit IRC | 22:00 | |
*** jbadiapa has quit IRC | 22:00 | |
rlandy | weshay|ruck: chat re: what's left to do today? | 22:06 |
weshay|ruck | rlandy, meh | 22:07 |
weshay|ruck | rlandy, me just updating the hackmd | 22:07 |
rlandy | weshay|ruck: worried re: images | 22:08 |
weshay|ruck | ya.. | 22:09 |
rlandy | try the permission patch or no? | 22:09 |
weshay|ruck | rlandy, ya sure | 22:12 |
rlandy | weshay|ruck: ok - will try and revert | 22:14 |
weshay|ruck | rlandy, I mean.. --archive may be needed if we get the perms right.. unclear | 22:17 |
weshay|ruck | worth the time to experiment | 22:17 |
rlandy | weshay|ruck: well, the alternative is to chmod the images before we rsync | 22:19 |
weshay|ruck | yup | 22:19 |
* rlandy investigates | 22:19 | |
rlandy | weshay|ruck: another approach ... https://review.opendev.org/711996 DNM: Testing changing image file permissions | 22:50 |
rlandy | we can test this one in testproject | 22:50 |
rlandy | thoughts? | 22:51 |
weshay|ruck | looking | 23:01 |
weshay|ruck | rlandy, just use one call.. on line 75.. "chmod 0755 *.tar | 23:02 |
weshay|ruck | " | 23:02 |
rlandy | looking | 23:04 |
*** rlandy is now known as rlandy|bbl | 23:05 | |
*** tosky has quit IRC | 23:30 | |
*** apetrich has joined #oooq | 23:33 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!