*** rlandy|bbl is now known as rlandy | 00:17 | |
*** rlandy is now known as rlandy|out | 00:20 | |
*** dviroel|out is now known as dviroel | 01:56 | |
*** dviroel is now known as dviroel|out | 02:18 | |
*** ysandeep|holiday is now known as ysandeep | 04:14 | |
jm1 | moin :) | 05:47 |
---|---|---|
*** ysandeep is now known as ysandeep|afk | 06:31 | |
*** amoralej|off is now known as amoralej | 07:13 | |
*** ysandeep|afk is now known as ysandeep | 07:59 | |
*** soniya29|ruck is now known as soniya29|ruck|lunch | 08:35 | |
*** soniya29|ruck|lunch is now known as soniya29|ruck | 08:55 | |
chandankumar | soniya29|ruck: merged https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43758 if you see any promotion issue let me know! | 09:14 |
soniya29|ruck | chandankumar, ack | 09:19 |
soniya29|ruck | chandankumar, 2022-07-12 09:30:33.415348 | fa163e29-0616-80d4-ca44-0000000012b5 | FATAL | Container image prepare | undercloud | error={"changed": false, "error": "401 Client Error: UNAUTHORIZED for url: https://quay.rdoproject.org/v2/tripleowallaby/openstack-neutron-server/manifests/04583b672d6b28a59747882b8f62b9a9", "msg": "Error running container image prepare: 401 Client Error: UNAUTHORIZED for url: | 10:08 |
soniya29|ruck | https://quay.rdoproject.org/v2/tripleowallaby/openstack-neutron-server/manifests/04583b672d6b28a59747882b8f62b9a9", "params": {}, "success": false} | 10:08 |
soniya29|ruck | chandankumar, is this issue related to the patch merged above? | 10:09 |
*** soniya29|ruck is now known as soniya29|ruck|afk | 10:18 | |
*** rlandy|out is now known as rlandy | 10:27 | |
rlandy | bhagyashris: hello ... | 10:29 |
rlandy | we need to move the tc/uz sync | 10:29 |
rlandy | ua | 10:29 |
rlandy | too early for dariusz | 10:29 |
rlandy | bhagyashris: 3:30 utc? | 10:30 |
rlandy | soniya29|ruck|afk: hello ... | 10:30 |
rlandy | thank you for filling out the hackmd | 10:30 |
rlandy | pls ping when you are back | 10:31 |
chandankumar | soniya29|ruck|afk: checking | 10:31 |
chandankumar | soniya29|ruck|afk: can you pass me the logs? | 10:31 |
rlandy | frenzy_friday: hi - what's the status of the namespace? | 10:34 |
rlandy | let's merge one of those patches to fix check | 10:34 |
frenzy_friday | rlandy, testproj for https://review.opendev.org/c/openstack/tripleo-quickstart/+/849112 passed | 10:35 |
frenzy_friday | testproj for https://review.opendev.org/c/openstack/tripleo-quickstart/+/849110 failed but on unrelated stuff | 10:35 |
frenzy_friday | The quay pull stage passed I think | 10:36 |
rlandy | frenzy_friday: chandankumar: marios: maybe we can sync for a few at usual review time slot but today - and chose one of these | 10:37 |
rlandy | I would like to get this sorted | 10:37 |
frenzy_friday | https://logserver.rdoproject.org/54/43954/3/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-network-wallaby/740a05f/logs/undercloud/home/zuul/containers-prepare-parameter.yaml.txt.gz | 10:37 |
frenzy_friday | yep sure | 10:37 |
rlandy | I think the second is more correct but more risky | 10:37 |
rlandy | chandankumar: marios; pls ping if you are around and can sync for a few | 10:38 |
soniya29|ruck|afk | rlandy, hello | 10:40 |
*** soniya29|ruck|afk is now known as soniya29|ruck | 10:40 | |
soniya29|ruck | chandankumar, https://logserver.rdoproject.org/22/849222/2/openstack-check/tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001/200df74/logs/undercloud/home/zuul/undercloud_install.log.txt.gz | 10:41 |
chandankumar | rlandy: sure | 10:41 |
soniya29|ruck | chandankumar, https://logserver.rdoproject.org/38/846338/4/openstack-check/tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001/ef89a03/logs/undercloud/home/zuul/undercloud_install.log.txt.gz | 10:41 |
rlandy | soniya29|ruck: one sec | 10:42 |
rlandy | chandankumar: frenzy_friday: https://meet.google.com/kbm-fyop-ryd?pli=1&authuser=0 | 10:42 |
soniya29|ruck | rlandy, should i join this or we would meet afterwards? | 10:44 |
rlandy | soniya29|ruck; hey - was just a sync about a patch | 10:58 |
marios | rlandy: o/ sorry distracted by the mixed-os stuff reading back | 10:58 |
rlandy | marios: no worries - we sorted it | 10:58 |
marios | trying to understand what we're choosing :) | 10:58 |
* marios goes back | 10:59 | |
soniya29|ruck | rlandy, shall we sync? | 11:00 |
rlandy | soniya29|ruck: ack https://meet.google.com/hgy-sxgs-jqr?pli=1&authuser=0 | 11:01 |
rlandy | soniya29|ruck: https://review.opendev.org/c/openstack/tripleo-quickstart/+/849110 | 11:08 |
soniya | rlandy, rejoining | 11:20 |
*** dviroel|out is now known as dviroel|rover | 11:29 | |
bhagyashris | rlandy, hey i haven't added dasm | 11:32 |
bhagyashris | rlandy, may be will add dasm from next meeting | 11:32 |
rlandy | bhagyashris: I think that meeting is also a clash for ysandeep | 11:46 |
rlandy | podified | 11:46 |
bhagyashris | rlandy, ysandeep is it ok to shift to 2:00 PM UTC then | 11:47 |
ysandeep | bhagyashris, 02:00pm sounds good so that dasm can also join | 11:48 |
*** ysandeep is now known as ysandeep|break | 11:59 | |
rlandy | ysandeep|break: bhagyashris; 2pm is a clash for me but you can all meet | 12:06 |
rlandy | the only item I have to add is the component pipeline epic for 17.2 | 12:06 |
rlandy | 17.1 | 12:06 |
bhagyashris | rlandy, ack | 12:08 |
bhagyashris | i will add | 12:08 |
rlandy | bhagyashris: there are a few stories we could close/drop | 12:12 |
rlandy | bhagyashris: Update coverage against rhos-release - has one task | 12:12 |
rlandy | do we still need it? | 12:13 |
rlandy | bhagyashris: and dasm has a new task under baremetal jobs | 12:14 |
rlandy | to qualify IBM cloud for ovb | 12:14 |
jpodivin | dviroel|rover: eh, hate to bother you about this but ... have you seen any 402 errors lately? | 12:26 |
dviroel|rover | rlandy: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43966 | 12:27 |
dviroel|rover | jpodivin: hey, i have seen lot of errors lately :( | 12:28 |
dviroel|rover | jpodivin: which error you talking about? | 12:28 |
rlandy | jpodivin: if you mean the post failures, please see #opendev | 12:29 |
jpodivin | rlandy: yep, that's it. Opendev wants bakshish | 12:32 |
bhagyashris | rlandy, i think we dont need | 12:33 |
bhagyashris | rlandy, ack will check with dasm | 12:34 |
jpodivin | rlandy: thanks | 12:35 |
*** amoralej is now known as amoralej|lunch | 12:40 | |
*** ysandeep|break is now known as ysandeep | 12:46 | |
dviroel|rover | rlandy: i think you missed my ping about https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43966 | 12:50 |
rlandy | dviroel|rover: sorry - w+'ed | 12:51 |
dviroel|rover | ty | 12:51 |
rlandy | all downstream components are clear now | 12:54 |
dviroel|rover | ++ | 12:55 |
*** dasm|off is now known as dasm | 13:02 | |
dasm | o/ | 13:02 |
dviroel|rover | soniya29: rlandy: hard to tell what is happening with fs001-train, but I see a common pymysql error, so I will open a bug against it | 13:13 |
rlandy | dviroel|rover: ok - do the same tests fail each time> | 13:13 |
soniya29 | dviroel|rover, ack | 13:13 |
dviroel|rover | rlandy: 2 overcloud deploy failures, and one tempest test that also points to a mysql error | 13:14 |
dviroel|rover | 3 jobs ^ | 13:14 |
dviroel|rover | still investigation 2 jobs that failed on volume detach, not sure root cause of those | 13:15 |
rlandy | ok | 13:16 |
rlandy | dviroel|rover: will ping you after all the meetings to discuss OVB investigation | 13:29 |
bhagyashris | https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/849425 | 13:38 |
*** amoralej|lunch is now known as amoralej | 13:41 | |
bhagyashris | dasm, chandankumar hey should we meet for UA/TC/PM sync? | 13:45 |
bhagyashris | now | 13:45 |
chandankumar | yes | 13:46 |
dasm | ack | 13:46 |
dasm | bhagyashris: chandankumar i don't see anyone. | 13:47 |
dasm | am i in the right call? | 13:47 |
bhagyashris | ysandeep, https://meet.google.com/rsi-ydoz-whi?authuser=0 | 13:48 |
bhagyashris | https://hackmd.io/P5sTPMSBREe5kBS_4jDhIg#2022-07-12-tcuapm-planning-for-sprint-65 | 13:48 |
bhagyashris | soniya29, ^ | 13:48 |
dviroel|rover | abregman: hi o/ - I joined in the middle of your topic | 13:53 |
dviroel|rover | abregman: I think that I'm the last one that worked on a dependency pipeline job | 13:54 |
dviroel|rover | abregman: if you have questions about it, feel free to ask - we can schedule a meeting if needed or talk about in next community calls | 13:54 |
bhagyashris | hey soniya29 you joined i just saw while you left | 13:59 |
bhagyashris | you have any topic from tempest side | 13:59 |
abregman | dviroel|rover: thanks, appreciate it. at some point we'll start the work on OSPCRE-275 and then I'll probably contact you for more details. In the meantime I was just collecting some information as to whether it's operational and what is covered there | 13:59 |
bhagyashris | in case if you have plz add into the hackmd | 13:59 |
soniya29 | bhagyashris, not a problem :) | 13:59 |
soniya29 | bhagyashris, ack | 13:59 |
ykarel | Hi | 14:26 |
ykarel | noticed too many post failures in tripleo gate | 14:26 |
ykarel | https://zuul.opendev.org/t/openstack/builds?result=POST_FAILURE&skip=0 | 14:26 |
rlandy | ykarel: pls see #opendev | 14:27 |
rlandy | fungi> rlandy: hrw noticed that we've suddenly started getting errors from ovh's swift about the account needing payment, that may be the cause. i'm looking into it now | 14:27 |
ykarel | rlandy, ok good it's known, Thanks | 14:27 |
rlandy | ykarel: yep - we're behind on paying accounts :) | 14:27 |
ykarel | :D | 14:27 |
ykarel | rlandy, may be good to have channel status updated for no recheck | 14:31 |
ykarel | or mailing list update | 14:31 |
rlandy | ykarel: should be cleared now ... | 14:32 |
ykarel | That's fast, thanks will recheck | 14:32 |
rlandy | log Temporarily disabled log uploads to OVH's Swift while we look into an account | 14:33 |
soniya29 | dviroel|rover, rlandy, full-tempest-api master passed closing the bug:- https://bugs.launchpad.net/tripleo/+bug/1981424 | 14:35 |
soniya29 | dviroel|rover, rlandy, fs35 master is failing on tempest tests with error:- tempest.exceptions.BuildErrorException: Server 4dde6d2a-140c-4a01-a6da-a900ab25d2c1 failed to build and is in ERROR status | 14:47 |
soniya29 | i am filing a bug for it | 14:48 |
dviroel|rover | soniya29: thanks I can take a look afterwards | 14:52 |
* dviroel|rover on fips meeting | 14:52 | |
soniya29 | dviroel|rover, ack | 14:57 |
* soniya29 leaving for the day | 14:57 | |
*** soniya29 is now known as soniya29|out | 14:58 | |
chandankumar | see ya! | 15:04 |
*** ysandeep is now known as ysandeep|out | 15:05 | |
* ysandeep|out out as well, see everyone tomorrow | 15:05 | |
dviroel|rover | o/ | 15:06 |
ysandeep|out | rlandy, marios dviroel|rover dasm I have shared one doc with you all about operator workflow process, Please add your comments/questions. | 15:06 |
marios | thanks ysandeep|out | 15:06 |
ysandeep|out | we can discuss more on doc/ on a mtg (if there is a need) | 15:07 |
dviroel|rover | ysandeep|out++ | 15:07 |
dasm | ack, thx | 15:20 |
*** marios is now known as marios|out | 15:35 | |
* dviroel|rover lunch | 15:36 | |
*** dviroel|rover is now known as dviroel|rover|biab | 15:36 | |
*** dviroel|rover|biab is now known as dviroel|rover | 16:42 | |
*** amoralej is now known as amoralej|off | 16:54 | |
rlandy | dviroel|rover: hey - how are things with ovb investigation? | 17:46 |
rlandy | dasm: hello | 17:48 |
rlandy | how far out are we from moving to ovb master branch? | 17:48 |
dasm | rlandy: o/ | 17:48 |
rlandy | pls see hardware prov chat | 17:48 |
dasm | checking | 17:49 |
dasm | > I think to get CI to try it we still need to tackle getting master CI jobs using master OVB first | 17:49 |
rlandy | I uploaded a new image for steve but he needs OVB master | 17:49 |
rlandy | ack | 17:49 |
rlandy | dasm: ^^ need help there? | 17:49 |
dasm | it's up to our team when we're gonna enable that | 17:49 |
dasm | https://review.rdoproject.org/r/c/config/+/43166 | 17:49 |
dasm | i mentioned it few times, still no consensus. Harald seems to be onboard with the change | 17:50 |
dasm | I'm currently going through places wrt what and how is gonna be affected | 17:50 |
rlandy | dasm: ok - let's pick that up at review time | 17:50 |
rlandy | and decide | 17:50 |
dasm | ack | 17:50 |
rlandy | I'm ok with adding it to testing as per the patch | 17:51 |
rlandy | dasm: only thing missing there is wallaby c9 | 17:51 |
rlandy | there is w c8 | 17:52 |
rlandy | and master | 17:52 |
rlandy | no wallaby c9 | 17:52 |
dasm | i see | 17:52 |
dviroel|rover | rlandy: i see 3 types of issues on fs001 train, one of them we might be able to skip e open a CIX, it is very similar to https://bugs.launchpad.net/tripleo/+bug/1960310 | 17:54 |
dviroel|rover | creating a new LP for this one ^ | 17:56 |
dviroel|rover | rlandy: guess what happened | 18:04 |
dviroel|rover | 2022-07-12 18:01:14.272253 | primary | "success": true, | 18:04 |
dviroel|rover | 2022-07-12 18:01:14.272263 | primary | "timestamp": 1657648872, | 18:04 |
dviroel|rover | 2022-07-12 18:01:14.272273 | primary | "url": "https://logserver.rdoproject.org/63/41063/4/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-tripleo-train/f971861" | 18:04 |
dviroel|rover | rlandy: forget about it, ^ it is tripleo component :( | 18:07 |
rlandy | dviroel|rover: ok - do you want to discuss findings now or at review time? | 18:08 |
rlandy | your choice | 18:08 |
* dviroel|rover was happy for a moment | 18:08 | |
dasm | dviroel|rover: qq, i see this: https://review.rdoproject.org/r/c/config/+/43166/2/zuul.d/tripleo.yaml#b109 but neither tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset039 nor tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset039-wallaby are running | 18:09 |
dasm | how those are running/not running during checks? | 18:09 |
dasm | example: https://review.opendev.org/c/openstack/openstack-virtual-baremetal/+/842441 / Zull Summary | 18:09 |
dviroel|rover | rlandy: we can use review time, works for me | 18:11 |
rlandy | k | 18:11 |
rlandy | we need to close our current bug and open a one the reveals the real situation now | 18:12 |
dasm | hmm... we have "periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-wallaby" which is not a child of "tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-wallaby" hence latter doesn't run at all | 18:17 |
dviroel|rover | rlandy: yeah, the most recent issue is overcloud deploy failing with keystone | 18:21 |
dviroel|rover | I don't see another bug open for fs001-train | 18:22 |
rlandy | ugh | 18:22 |
rcastillo | have to run to the vet. biab | 18:26 |
dasm | rlandy: you should be able to make image "shared" and that should be sufficient | 18:31 |
rlandy | dasm: I did - steve can't access it | 18:31 |
dasm | ack | 18:31 |
rlandy | will try chat with him when he is on line | 18:31 |
dasm | hmm. "RDO Third Party CI" is not running all jobs assigned to it. Especially "tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-wallaby" | 18:33 |
dasm | https://review.rdoproject.org/r/plugins/gitiles/config/+/refs/heads/master/zuul.d/tripleo.yaml#173 | 18:33 |
dasm | tbf, it runs only cs9 jobs: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/847419 | 18:34 |
rlandy | lunch - back in a few | 18:40 |
rlandy | rcastillo: dviroel|rover: review time | 19:00 |
dasm | https://review.rdoproject.org/r/c/testproject/+/42319 | 19:01 |
jm1 | reviewbot: add https://review.opendev.org/c/openstack/tripleo-ci/+/849500 | 19:12 |
jm1 | rlandy, rcastillo: just added another patch for review time to merge ;) | 19:13 |
* jm1 😴 ... have a nice evening! | 19:42 | |
rcastillo | back | 19:43 |
dviroel|rover | rlandy: https://bugs.launchpad.net/tripleo/+bug/1981478 | 19:53 |
rlandy | thanks | 20:33 |
*** rlandy is now known as rlandy|bbl | 21:59 | |
dasm | rlandy|bbl: tomorrow we have a town hall with Matt and Paul at the same time as Retro. Do we want to postpone retro till Thu? | 22:02 |
* dasm => offline | 22:14 | |
*** dasm is now known as dasm|off | 22:14 | |
*** rlandy|bbl is now known as rlandy|out | 23:47 | |
*** ysandeep|out is now known as ysandeep | 23:58 | |
ysandeep | dasm|off, +1 to move retro for townhall | 23:59 |
ysandeep | bhagyashris, ^^ | 23:59 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!