*** holser has joined #oooq | 00:00 | |
*** jmasud has joined #oooq | 00:06 | |
*** jmasud has quit IRC | 00:16 | |
*** jmasud has joined #oooq | 00:16 | |
*** jmasud has quit IRC | 00:20 | |
*** tosky has quit IRC | 00:23 | |
*** jmasud has joined #oooq | 00:48 | |
*** holser has quit IRC | 00:56 | |
*** holser has joined #oooq | 00:57 | |
*** holser has quit IRC | 01:08 | |
*** sanjayu_ has joined #oooq | 01:08 | |
*** jmasud has quit IRC | 01:21 | |
*** jmasud has joined #oooq | 01:21 | |
*** jmasud has quit IRC | 01:29 | |
*** jmasud has joined #oooq | 01:30 | |
*** rlandy has quit IRC | 01:31 | |
*** jmasud has joined #oooq | 01:53 | |
*** jmasud has quit IRC | 02:05 | |
*** jmasud has joined #oooq | 02:10 | |
*** sanjayu_ has quit IRC | 02:35 | |
*** jmasud has quit IRC | 02:36 | |
*** ysandeep|away is now known as ysandeep | 03:47 | |
*** skramaja has joined #oooq | 04:37 | |
*** ratailor has joined #oooq | 04:40 | |
*** ykarel has joined #oooq | 04:53 | |
*** udesale has joined #oooq | 05:00 | |
*** jmasud has joined #oooq | 05:31 | |
*** sanjayu_ has joined #oooq | 06:32 | |
*** skramaja has quit IRC | 06:37 | |
*** skramaja_ has joined #oooq | 06:37 | |
*** marios has joined #oooq | 06:57 | |
*** jmasud has quit IRC | 07:02 | |
marios | zuul.openstack down looks like | 08:11 |
---|---|---|
marios | aaaand its back | 08:15 |
*** skramaja_ is now known as skramaja | 08:19 | |
soniya29 | kopecmartin, arxcruz, bhagyashris, pojadhav, Do you anything to discuss in today's tempest meeting? | 08:45 |
*** ysandeep is now known as ysandeep|lunch | 08:46 | |
*** ysandeep|lunch is now known as ysandeep | 09:40 | |
pojadhav|rover | soniya29, nope :) | 09:43 |
arxcruz | soniya29: nope | 09:43 |
*** derekh has joined #oooq | 09:48 | |
ysandeep | bhagyashris, do we have retro today? | 10:23 |
bhagyashris | ysandeep, no | 10:23 |
bhagyashris | soniya29, nope | 10:24 |
ysandeep | bhagyashris, is retro planned for tomorrow ? | 10:24 |
ysandeep | or its next week? | 10:25 |
bhagyashris | ysandeep, no, there will be no retro meeting this sprint . we will have direct planing meeting | 10:25 |
ysandeep | bhagyashris, ack thank you! | 10:25 |
marios | bhagyashris: planning meeting today or tomorrow? | 10:28 |
marios | bhagyashris: can't see a calendar event | 10:28 |
marios | ysandeep: we had a retro before christmas | 10:29 |
ysandeep | marios: thanks, now i recall :D | 10:33 |
*** dtantsur|afk is now known as dtantsur | 10:35 | |
bhagyashris | marios, tomorrow | 10:36 |
marios | bhagyashris: thanks | 10:37 |
bhagyashris | marios, i will send invite to all by EOD | 10:38 |
marios | thanks bhagyashris | 10:41 |
*** rfolco has joined #oooq | 10:43 | |
soniya29 | kopecmartin, arxcruz, bhagyashris, pojadhav, chandankumar, weshay|ruck, akahat, so let's cancel the meeting for today | 10:44 |
pojadhav|rover | soniya29, ack | 10:45 |
* pojadhav|rover brb | 10:45 | |
chandankumar | soniya29: ack | 10:46 |
*** jmasud has joined #oooq | 10:46 | |
*** udesale_ has joined #oooq | 10:54 | |
*** udesale has quit IRC | 10:57 | |
ysandeep | zbr, Hi, I am trying to setup gri tool.. but i am hitting an authentication issue. | 11:21 |
ysandeep | ~~~ | 11:21 |
ysandeep | ERROR 401 Client Error: Unauthorized for url: https://review.rdoproject.org/r/a/changes/?q=reviewer:self+status:open&o=LABELS&o=COMMIT_FOOTERS | 11:21 |
ysandeep | ~~~ | 11:21 |
ysandeep | I don't have direct login credentials for review.rdoproject.org, I login in with github.. Is there a way to login redirecting with github when using gri/.netrc file? | 11:21 |
arxcruz | ysandeep: sec, i know the problem | 11:42 |
arxcruz | ysandeep: https://review.rdoproject.org/sf/user_settings.html | 11:42 |
arxcruz | ysandeep: there's an API key | 11:43 |
arxcruz | use that | 11:43 |
ysandeep | arxcruz++ savior | 11:43 |
arxcruz | ;) | 11:44 |
zbr | ysandeep: yes, a line that looks like: machine api.github.com login ssbarnea password <TOKEN> | 11:46 |
zbr | there is no real password, only tokens, for both gerrit and github. | 11:47 |
ysandeep | arxcruz, zbr, thank you! it worked :D | 11:47 |
zbr | i am glad to see others than weshay|ruck trying the tool. | 11:48 |
ysandeep | zbr, thanks for the great effort in writing this tool :D | 11:49 |
zbr | usually I disable the github integration as it is much slower than gerrit, but for gerrit is f... fast. | 11:49 |
bhagyashris | zbr, i have added the enable pylint stuff here https://hackmd.io/8339lqSwSEeXxuk0LfxCwA#Other-items-discussed-and-in-the-background plz update if you have more updates on it | 11:50 |
* ysandeep looking where we can generate token in opendev | 11:53 | |
* ysandeep found it - HTTP Credentials - "GENERATE NEW PASSWORD" | 12:01 | |
*** ratailor has quit IRC | 12:14 | |
*** tosky has joined #oooq | 12:15 | |
*** jmasud has quit IRC | 12:17 | |
*** rlandy has joined #oooq | 12:53 | |
rlandy | bhagyashris: hi - do we have a sprint/planning meeting today? I see one for tomorrow | 12:54 |
bhagyashris | rlandy, no we dont have planning meeting today we have tomorrow and fllow up meeting on 11th Jan | 12:55 |
rlandy | bhagyashris: k - thanks | 12:55 |
bhagyashris | i will sent meeting invite soon by my EOD | 12:55 |
*** ysandeep is now known as ysandeep|afk | 12:57 | |
pojadhav|rover | weshay|ruck, 0/ | 12:58 |
weshay|ruck | hey pojadhav|rover how you feeling | 12:58 |
pojadhav|rover | feeling good now | 12:58 |
pojadhav|rover | weshay|ruck, want discuss about the yatin's comment : https://review.opendev.org/c/openstack/tripleo-ci/+/765297/1/zuul.d/multinode-jobs.yaml | 12:59 |
pojadhav|rover | He is asking about the plan for this change | 12:59 |
rlandy | weshay|ruck: we had the first run of the train/ussuri/victoria branches on centos8 stream: https://review.rdoproject.org/zuul/builds?pipeline=openstack-dependencies-centos8stream | 13:00 |
weshay|ruck | pojadhav|rover, /me reads | 13:00 |
pojadhav|rover | weshay|ruck, ack | 13:00 |
weshay|ruck | rlandy, aye.. so train/ussuri .. let's highlight it at prod-chain and see how folks want us to handle that.. I suspect missing backports | 13:01 |
weshay|ruck | zbr, what are you doing on this call? | 13:01 |
weshay|ruck | it's the worst mtg ever | 13:02 |
weshay|ruck | rlandy, 2021-01-05 20:08:03.583109 | primary | time="2021-01-05T20:08:03Z" level=error msg="CNI network \"podman\" not found" | 13:03 |
weshay|ruck | ? | 13:03 |
weshay|ruck | that's odd | 13:03 |
marios | rfolco: zbr: rlandy: weshay|ruck: please check when you have time and let's merge? https://review.opendev.org/c/openstack/tripleo-ci/+/761188 | 13:03 |
rlandy | weshay|ruck: we've seen that before | 13:03 |
weshay|ruck | marios, ack to merge from me | 13:04 |
rlandy | marios: ack - merging that | 13:04 |
marios | thanks rlandy weshay|ruck | 13:04 |
rlandy | weshay|ruck: need to look back at where we dealt with that error before | 13:04 |
weshay|ruck | pojadhav|rover, /me reading | 13:08 |
pojadhav|rover | ok | 13:08 |
*** ysandeep|afk is now known as ysandeep | 13:33 | |
rlandy | sshnaidm: what happened with the 16.1 tempest error? | 13:48 |
sshnaidm | rlandy, I think it's the same..? | 13:48 |
sshnaidm | Last run failed bc of same error | 13:49 |
rlandy | sshnaidm: yep - we were going to escalate | 13:49 |
rlandy | error happened even with selinux set to permissive | 13:49 |
arxcruz | chandankumar: weshay|ruck i'm taking a look now on https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/746509 | 13:50 |
arxcruz | the os_tempest everywhere | 13:50 |
chandankumar | arxcruz: ok thanks! | 13:50 |
sshnaidm | rlandy, yep | 13:51 |
sshnaidm | rlandy, how do we escalate it? | 13:51 |
rlandy | sshnaidm: BZ | 13:52 |
rlandy | we can run it by QE also and see how their jobs are working | 13:53 |
sshnaidm | acl | 13:56 |
sshnaidm | ack | 13:56 |
weshay|ruck | akahat, can start early.. I'm in | 13:57 |
akahat | weshay|ruck, joining. | 13:57 |
weshay|ruck | rfolco, can you add ur awesome report to internal container builds.. rlandy can point you at the jobs | 14:28 |
rlandy | ack | 14:28 |
*** TrevorV has joined #oooq | 14:37 | |
*** holser has joined #oooq | 14:41 | |
sshnaidm | weshay|ruck, logstash: http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22at%20destination%3A%20failed%20to%20read%20from%20destination%20repository%5C%22 | 14:46 |
*** skramaja has quit IRC | 15:19 | |
*** derekh has quit IRC | 15:27 | |
*** spotz has quit IRC | 15:44 | |
weshay|ruck | sshnaidm, 0/ hey you have a quick second.. /me needs to run something by you re: sova | 15:52 |
sshnaidm | weshay|ruck, 5 min | 15:55 |
weshay|ruck | k | 15:55 |
sshnaidm | weshay|ruck, ready | 15:59 |
weshay|ruck | sshnaidm, https://meet.google.com/nhh-ojad-sqq?authuser=1 | 15:59 |
rlandy | sshnaidm: this is the train backport we need for container builds in standalone? https://review.opendev.org/c/openstack/tripleo-ansible/+/769364 | 16:18 |
rlandy | I checked the version of tripleo-ansible | 16:18 |
rlandy | it's correct | 16:18 |
sshnaidm | rlandy, yep | 16:18 |
sshnaidm | rlandy, then I don't understand how the master code got there.. ¯\_(ツ)_/¯ | 16:19 |
rlandy | sneaky master | 16:21 |
rlandy | sshnaidm: ok - so I need a downstream backport of that when it merges in train | 16:22 |
sshnaidm | rlandy, yeah, there is a dependency on https://review.opendev.org/c/openstack/tripleo-ansible/+/769478 | 16:23 |
sshnaidm | it fixes some job in train to get the backport in | 16:24 |
weshay|ruck | rfolco, you there? | 16:26 |
*** ykarel has quit IRC | 16:30 | |
rfolco | weshay|ruck, sorry, was on meeting when you pinged me earlier, still out on lunch prep as my wife is nursing in-law at the hospital. | 16:38 |
weshay|ruck | rfolco, np.. oy | 16:39 |
rfolco | weshay|ruck, I can try adding to internal jobs, but still did not fix the log issue for ussuri and train | 16:39 |
weshay|ruck | rfolco, would it be possible to get the container build reports added to the internal container builds for 16.2 and 17? | 16:39 |
rfolco | weshay|ruck, will try | 16:40 |
weshay|ruck | rfolco, k.. ping if you want extra eyes on the log issue | 16:40 |
rfolco | weshay|ruck, k will ping you soon | 16:40 |
weshay|ruck | thanks | 16:46 |
*** ysandeep is now known as ysandeep|away | 16:56 | |
*** marios is now known as marios|out | 16:57 | |
*** marios|out has quit IRC | 17:00 | |
*** udesale_ has quit IRC | 17:04 | |
*** jmasud has joined #oooq | 17:26 | |
rlandy | weshay|ruck: 1-on1? | 17:31 |
weshay|ruck | aye | 17:31 |
*** holser has quit IRC | 18:12 | |
rfolco | weshay|ruck, need more eyes on the log issue | 18:15 |
weshay|ruck | k.. chatting w/ rlandy .. will be there soon | 18:19 |
*** dtantsur is now known as dtantsur|afk | 18:27 | |
weshay|ruck | rfolco, ok | 18:47 |
weshay|ruck | let's have a look | 18:48 |
weshay|ruck | rfolco, https://meet.google.com/zsp-cuhe-eku?authuser=1 | 18:48 |
rfolco | https://review.opendev.org/c/openstack/tripleo-ci/+/767591 | 18:49 |
weshay|ruck | rfolco, http://git.app.eng.bos.redhat.com/git/openstack/tripleo-ci-internal-config.git/ http://git.app.eng.bos.redhat.com/git/openstack/tripleo-ci-internal-jobs.git/ | 19:18 |
weshay|ruck | rfolco, http://git.app.eng.bos.redhat.com/git/openstack/tripleo-ci-internal-jobs.git/tree/zuul.d/tripleo-build-containers.yaml | 19:20 |
*** holser has joined #oooq | 19:27 | |
*** sanjayu_ has quit IRC | 19:33 | |
*** holser has quit IRC | 19:46 | |
rfolco | weshay|ruck, I have tested build-report w/ 16.2 already --> https://sf.hosted.upshift.rdu2.redhat.com/logs/52/221752/1/check/tripleo-build-containers-ubi-8-internal-rhel-8-rhos-16.2/364933a/logs/report.html | 20:05 |
rfolco | will see why 17 did not run, but it should work (no effort needed) | 20:05 |
rfolco | weshay|ruck, my memory is a POS | 20:05 |
weshay|ruck | rfolco, hey | 20:21 |
* weshay|ruck reads | 20:21 | |
rfolco | weshay|ruck, report should be working without any change... I am running a test here https://code.engineering.redhat.com/gerrit/#/c/221752/ | 20:23 |
weshay|ruck | OH.. maybe I was just looking in the wrong place | 20:23 |
weshay|ruck | rfolco, duh.. ya | 20:24 |
weshay|ruck | https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-rhos-17/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-build-containers-ubi-8-internal-rhel-8-build-push-upload-rhos-17/a4f785a/logs/report.html | 20:24 |
weshay|ruck | rfolco++ | 20:24 |
weshay|ruck | done and done | 20:24 |
rfolco | nutz | 20:24 |
weshay|ruck | log? | 20:24 |
rfolco | the log ... yeah... | 20:25 |
rfolco | working on it | 20:25 |
weshay|ruck | :) | 20:26 |
rfolco | weshay|ruck, do you know which role is that https://github.com/openstack/tripleo-quickstart-extras/blob/master/playbooks/collect-logs.yml#L21 | 20:36 |
weshay|ruck | sec.. at the car shop.. I think they block some sites | 20:37 |
weshay|ruck | jebus | 20:37 |
weshay|ruck | rfolco, that's ansible-role-collect-logs | 20:39 |
rfolco | weshay|ruck, hmm iof I just could blacklist worskpace/logs/container-builds from that role, I think it would fix it | 20:40 |
weshay|ruck | rfolco, go for it | 20:41 |
weshay|ruck | rfolco, add me, sagi as a reviewer | 20:41 |
rfolco | ok ... its an idea, I don't know how to do it lol | 20:41 |
rfolco | k | 20:41 |
weshay|ruck | rfolco, so when the container fails.. is ther ALWAYS a log.. there may not be... | 20:43 |
weshay|ruck | https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-rhos-17/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-build-containers-ubi-8-internal-rhel-8-build-push-upload-rhos-17/a4f785a/logs/report.html | 20:43 |
weshay|ruck | and that's master equiv | 20:44 |
*** jmasud has quit IRC | 20:45 | |
rfolco | weshay|ruck, it's a bug :( | 20:46 |
weshay|ruck | rfolco, in containers-build or ci? | 20:46 |
rfolco | weshay|ruck, in the report code | 20:46 |
rfolco | weshay|ruck, the logs are there I assume? let me check | 20:46 |
weshay|ruck | no | 20:46 |
weshay|ruck | I don't think so | 20:46 |
weshay|ruck | check it out | 20:47 |
rfolco | oh no | 20:47 |
rfolco | its working as designed | 20:47 |
rfolco | no logs for failed ones | 20:47 |
rfolco | \o/ | 20:47 |
rfolco | build.log is not very verbose | 20:50 |
rfolco | needs improvements long term I guess | 20:50 |
weshay|ruck | right | 20:54 |
weshay|ruck | :) | 20:54 |
weshay|ruck | rfolco, /me wonders what stops the build attempt | 20:55 |
weshay|ruck | would think it would come up as skipped | 20:55 |
weshay|ruck | if there is no log | 20:55 |
weshay|ruck | meh | 20:55 |
weshay|ruck | rlandy, you still around by chance? | 20:55 |
rfolco | don't hide crime evidences | 20:56 |
weshay|ruck | heh | 20:56 |
rlandy | weshay|ruck: ack - around until 6:30pm | 20:56 |
rlandy | not protesting at the capital if that if what you are asking | 20:56 |
weshay|ruck | rlandy, bah.. I'm at the car shop.. my email is blocked... can you cix / email rhos-dev w/ https://bugzilla.redhat.com/show_bug.cgi?id=1913475 https://bugzilla.redhat.com/show_bug.cgi?id=1913476 please | 20:56 |
openstack | bugzilla.redhat.com bug 1913475 in openstack-dashboard-theme "openstack-dashboard fails to install and build horizon container" [Urgent,New] - Assigned to rhos-maint | 20:56 |
openstack | bugzilla.redhat.com bug 1913476 in ceph "cephadm is not built for osp-17" [Urgent,New] - Assigned to gfidente | 20:56 |
rlandy | weshay|ruck: ack | 20:57 |
weshay|ruck | thank you!! | 20:57 |
*** jmasud has joined #oooq | 20:58 | |
weshay|ruck | rlandy, btw.. pita here.. it's possible we could promote 16.2 we have 1 tempest failure in integration.. fs020 but standalone passed.. and 1 tempest failure in infrared both in 16.2 integration | 21:00 |
weshay|ruck | may be worth emailing ysandeep, attila to see if they would like to waive and promote vs... hold | 21:01 |
weshay|ruck | man.. a manager w/ blocked email is useless | 21:01 |
rlandy | weshay|ruck: CIX email sent | 21:02 |
weshay|ruck | thank you :) | 21:02 |
rlandy | weshay|ruck: emailing sandeep and attila | 21:03 |
rlandy | looks close to promoting | 21:03 |
weshay|ruck | dang.. drive is blocked too... I'm on the vpn.. this is weird | 21:03 |
weshay|ruck | rlandy, ya.. just 1 tempest test.. in tripleo-ci / infrared each | 21:04 |
weshay|ruck | probably worth promoting | 21:04 |
rlandy | weshay|ruck: ok- we can promote it tomorrow | 21:04 |
weshay|ruck | ++ | 21:04 |
rlandy | worth rerunning? | 21:04 |
rlandy | fs020 | 21:04 |
weshay|ruck | perhaps.. | 21:05 |
weshay|ruck | rlandy, it worked here https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-16.2/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-standalone-full-tempest-scenario-rhos-16.2/5f5ae09/logs/undercloud/var/log/tempest/stestr_results.html | 21:06 |
weshay|ruck | but failed in 020 | 21:06 |
weshay|ruck | so... meh | 21:06 |
rlandy | weshay|ruck: k - so I'll rerun | 21:07 |
weshay|ruck | I think we can just waive.. more concenred w/ the one failing test in the infrared job | 21:07 |
rlandy | if no joy by eod, will email | 21:07 |
weshay|ruck | actually | 21:07 |
rlandy | or we can waive | 21:07 |
weshay|ruck | let me look at criteria | 21:07 |
rlandy | weshay|ruck: can you reach the criteria? | 21:07 |
* rlandy can copy | 21:07 | |
weshay|ruck | rlandy, http://git.app.eng.bos.redhat.com/git/tripleo-environments.git/tree/ci-scripts/dlrnapi_promoter/config/RedHat-8/rhos-16.2.ini#n21 | 21:08 |
weshay|ruck | rlandy, they only have the one job | 21:08 |
weshay|ruck | so.. | 21:08 |
weshay|ruck | heh.. and fs020 is not in it | 21:08 |
rlandy | weshay|ruck: right | 21:08 |
weshay|ruck | let's promote.. and then i'll adjust critiera | 21:08 |
rlandy | but that is just the last time we update | 21:08 |
rlandy | weshay|ruck: k - I'll promote | 21:08 |
rlandy | and rerun | 21:09 |
weshay|ruck | k | 21:09 |
*** holser has joined #oooq | 21:09 | |
weshay|ruck | thanks | 21:09 |
rlandy | np - how's the car? | 21:09 |
weshay|ruck | meh.. cars are expensive | 21:11 |
rlandy | weshay|ruck: k - on your tmux on the promoter | 21:11 |
weshay|ruck | ++ | 21:11 |
rlandy | bash -x wes-promote-rhos-16.2.sh in action | 21:11 |
weshay|ruck | don't tell everyone our secrets :) | 21:11 |
weshay|ruck | wes_rlandy_promoter.sh | 21:11 |
rlandy | I don't think anyone else cares | 21:12 |
weshay|ruck | TRUE | 21:12 |
rlandy | but we care | 21:12 |
rlandy | and that's important :) | 21:12 |
weshay|ruck | WE CARE ABOUT THIS WORLD!!! | 21:12 |
* rlandy reruns fs020 in case | 21:13 | |
weshay|ruck | that test can be flaky | 21:13 |
weshay|ruck | they do have the BEST cheesy music here | 21:13 |
weshay|ruck | huey lewis rockin | 21:14 |
rlandy | https://code.engineering.redhat.com/gerrit/#/c/207510/ | 21:14 |
rlandy | rerun | 21:14 |
rlandy | weshay|ruck: k - all done - need anything else? | 21:15 |
weshay|ruck | I have coffee, hewie lewis.. I'm great :) | 21:16 |
weshay|ruck | lolz | 21:16 |
* weshay|ruck runs | 21:16 | |
weshay|ruck | thanks for the help | 21:16 |
rlandy | sure | 21:16 |
*** jmasud has quit IRC | 21:19 | |
*** jmasud has joined #oooq | 21:21 | |
*** TrevorV has quit IRC | 21:50 | |
rlandy | weshay|ruck: still at car shop? | 22:17 |
rlandy | https://review.opendev.org/c/openstack/tripleo-ansible/+/769581 | 22:17 |
rlandy | tripleo-ansible-centos-8-molecule-tripleo_podman https://zuul.opendev.org/t/openstack/build/4bff2d7ada6149e88b8f3f50eca984e3 : FAILURE in 10m 13s | 22:17 |
rlandy | that test hasn't passed in ages | 22:18 |
rlandy | do we own it? | 22:18 |
*** holser has quit IRC | 22:18 | |
rlandy | sshnaidm: ^^ ci owns this or df? | 22:19 |
sshnaidm | df | 22:20 |
rlandy | ok - will ping tomorrow | 22:22 |
rlandy | late for everyone | 22:22 |
*** jmasud has quit IRC | 22:41 | |
*** holser has joined #oooq | 22:44 | |
*** rfolco has quit IRC | 22:50 | |
weshay|ruck | rlandy, ya | 22:56 |
*** jmasud has joined #oooq | 22:57 | |
*** rlandy has quit IRC | 23:20 | |
*** jmasud has quit IRC | 23:49 | |
*** jmasud has joined #oooq | 23:51 | |
*** tosky has quit IRC | 23:51 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!