Tuesday, 2022-07-12

*** rlandy|bbl is now known as rlandy00:17
*** rlandy is now known as rlandy|out00:20
*** dviroel|out is now known as dviroel01:56
*** dviroel is now known as dviroel|out02:18
*** ysandeep|holiday is now known as ysandeep04:14
jm1moin :)05:47
*** ysandeep is now known as ysandeep|afk06:31
*** amoralej|off is now known as amoralej07:13
*** ysandeep|afk is now known as ysandeep07:59
*** soniya29|ruck is now known as soniya29|ruck|lunch08:35
*** soniya29|ruck|lunch is now known as soniya29|ruck08:55
chandankumarsoniya29|ruck: merged https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43758 if you see any promotion issue let me know!09:14
soniya29|ruckchandankumar, ack09:19
soniya29|ruckchandankumar, 2022-07-12 09:30:33.415348 | fa163e29-0616-80d4-ca44-0000000012b5 |      FATAL | Container image prepare | undercloud | error={"changed": false, "error": "401 Client Error: UNAUTHORIZED for url: https://quay.rdoproject.org/v2/tripleowallaby/openstack-neutron-server/manifests/04583b672d6b28a59747882b8f62b9a9", "msg": "Error running container image prepare: 401 Client Error: UNAUTHORIZED for url: 10:08
soniya29|ruckhttps://quay.rdoproject.org/v2/tripleowallaby/openstack-neutron-server/manifests/04583b672d6b28a59747882b8f62b9a9", "params": {}, "success": false}10:08
soniya29|ruckchandankumar, is this issue related to the patch merged above?10:09
*** soniya29|ruck is now known as soniya29|ruck|afk10:18
*** rlandy|out is now known as rlandy10:27
rlandybhagyashris: hello ...10:29
rlandywe need to move the tc/uz sync10:29
rlandyua10:29
rlandytoo early for dariusz10:29
rlandybhagyashris: 3:30 utc?10:30
rlandysoniya29|ruck|afk: hello ...10:30
rlandythank you for filling out the hackmd10:30
rlandypls ping when you are back10:31
chandankumarsoniya29|ruck|afk: checking10:31
chandankumarsoniya29|ruck|afk: can you pass me the logs?10:31
rlandyfrenzy_friday: hi - what's the status of the namespace?10:34
rlandylet's merge one of those patches to fix check10:34
frenzy_fridayrlandy, testproj for https://review.opendev.org/c/openstack/tripleo-quickstart/+/849112 passed10:35
frenzy_fridaytestproj for https://review.opendev.org/c/openstack/tripleo-quickstart/+/849110 failed but on unrelated stuff10:35
frenzy_fridayThe quay pull stage passed I think10:36
rlandyfrenzy_friday: chandankumar: marios: maybe we can sync for a few at usual review time slot but today - and chose one of these10:37
rlandyI would like to get this sorted10:37
frenzy_fridayhttps://logserver.rdoproject.org/54/43954/3/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-network-wallaby/740a05f/logs/undercloud/home/zuul/containers-prepare-parameter.yaml.txt.gz10:37
frenzy_fridayyep sure10:37
rlandyI think the second is more correct but more risky10:37
rlandychandankumar: marios; pls ping if you are around and can sync for a few 10:38
soniya29|ruck|afkrlandy, hello10:40
*** soniya29|ruck|afk is now known as soniya29|ruck10:40
soniya29|ruckchandankumar, https://logserver.rdoproject.org/22/849222/2/openstack-check/tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001/200df74/logs/undercloud/home/zuul/undercloud_install.log.txt.gz10:41
chandankumarrlandy: sure10:41
soniya29|ruckchandankumar, https://logserver.rdoproject.org/38/846338/4/openstack-check/tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001/ef89a03/logs/undercloud/home/zuul/undercloud_install.log.txt.gz10:41
rlandysoniya29|ruck: one sec10:42
rlandychandankumar: frenzy_friday: https://meet.google.com/kbm-fyop-ryd?pli=1&authuser=010:42
soniya29|ruckrlandy, should i join this or we would meet afterwards?10:44
rlandysoniya29|ruck; hey - was just a sync about a patch10:58
mariosrlandy: o/ sorry distracted by the mixed-os stuff reading back 10:58
rlandymarios: no worries - we sorted it10:58
mariostrying to understand what we're choosing :)10:58
* marios goes back 10:59
soniya29|ruckrlandy, shall we sync?11:00
rlandysoniya29|ruck: ack https://meet.google.com/hgy-sxgs-jqr?pli=1&authuser=011:01
rlandysoniya29|ruck: https://review.opendev.org/c/openstack/tripleo-quickstart/+/84911011:08
soniyarlandy, rejoining11:20
*** dviroel|out is now known as dviroel|rover11:29
bhagyashrisrlandy, hey i haven't added dasm11:32
bhagyashrisrlandy, may be will add dasm from next meeting11:32
rlandybhagyashris: I think that meeting is also a clash for ysandeep 11:46
rlandypodified11:46
bhagyashrisrlandy, ysandeep is it ok to shift to 2:00 PM UTC then11:47
ysandeepbhagyashris, 02:00pm sounds good so that dasm can also join11:48
*** ysandeep is now known as ysandeep|break11:59
rlandyysandeep|break: bhagyashris; 2pm is a clash for me but you can all meet12:06
rlandythe only item I have to add is the component pipeline epic for 17.212:06
rlandy17.112:06
bhagyashrisrlandy, ack12:08
bhagyashrisi will add12:08
rlandybhagyashris: there are a few stories we could close/drop12:12
rlandybhagyashris: Update coverage against rhos-release - has one task12:12
rlandydo we still need it?12:13
rlandybhagyashris: and dasm has a new task under baremetal jobs12:14
rlandyto qualify IBM cloud for ovb12:14
jpodivindviroel|rover: eh, hate to bother you about this but ... have you seen any 402 errors lately? 12:26
dviroel|roverrlandy: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/4396612:27
dviroel|roverjpodivin: hey, i have seen lot of errors lately :(12:28
dviroel|roverjpodivin: which error you talking about? 12:28
rlandyjpodivin: if you mean the post failures, please see #opendev12:29
jpodivinrlandy: yep, that's it. Opendev wants bakshish12:32
bhagyashrisrlandy, i think we dont need 12:33
bhagyashrisrlandy, ack will check with dasm12:34
jpodivinrlandy: thanks 12:35
*** amoralej is now known as amoralej|lunch12:40
*** ysandeep|break is now known as ysandeep12:46
dviroel|roverrlandy: i think you missed my ping about https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43966 12:50
rlandydviroel|rover: sorry  - w+'ed12:51
dviroel|roverty12:51
rlandyall downstream components are clear now12:54
dviroel|rover++12:55
*** dasm|off is now known as dasm13:02
dasmo/13:02
dviroel|roversoniya29: rlandy: hard to tell what is happening with fs001-train, but I see a common pymysql error, so I will open a bug against it13:13
rlandydviroel|rover: ok - do the same tests fail each time>13:13
soniya29dviroel|rover, ack13:13
dviroel|roverrlandy: 2 overcloud deploy failures, and one tempest test that also points to a mysql error13:14
dviroel|rover3 jobs ^13:14
dviroel|roverstill investigation 2 jobs that failed on volume detach, not sure root cause of those13:15
rlandyok13:16
rlandydviroel|rover: will ping you after all the meetings to discuss OVB investigation13:29
bhagyashrishttps://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/84942513:38
*** amoralej|lunch is now known as amoralej13:41
bhagyashrisdasm, chandankumar hey should we meet for UA/TC/PM sync?13:45
bhagyashrisnow13:45
chandankumaryes13:46
dasmack13:46
dasmbhagyashris: chandankumar i don't see anyone.13:47
dasmam i in the right call?13:47
bhagyashrisysandeep, https://meet.google.com/rsi-ydoz-whi?authuser=013:48
bhagyashrishttps://hackmd.io/P5sTPMSBREe5kBS_4jDhIg#2022-07-12-tcuapm-planning-for-sprint-6513:48
bhagyashrissoniya29, ^13:48
dviroel|roverabregman: hi o/ - I joined in the middle of your topic13:53
dviroel|roverabregman: I think that I'm the last one that worked on a dependency pipeline job13:54
dviroel|roverabregman: if you have questions about it, feel free to ask - we can schedule a meeting if needed or talk about in next community calls13:54
bhagyashrishey soniya29 you joined i just saw while you left13:59
bhagyashrisyou have any topic from tempest side13:59
abregmandviroel|rover: thanks, appreciate it. at some point we'll start the work on OSPCRE-275 and then I'll probably contact you for more details. In the meantime I was just collecting some information as to whether it's operational and what is covered there13:59
bhagyashrisin case if you have plz add into the hackmd13:59
soniya29bhagyashris, not a problem :)13:59
soniya29bhagyashris, ack13:59
ykarelHi14:26
ykarelnoticed too many post failures in tripleo gate14:26
ykarelhttps://zuul.opendev.org/t/openstack/builds?result=POST_FAILURE&skip=014:26
rlandyykarel: pls see #opendev14:27
rlandyfungi> rlandy: hrw noticed that we've suddenly started getting errors from ovh's swift about the account needing payment, that may be the cause. i'm looking into it now14:27
ykarelrlandy, ok good it's known, Thanks14:27
rlandyykarel: yep - we're behind on paying accounts :)14:27
ykarel:D14:27
ykarelrlandy, may be good to have channel status updated for no recheck14:31
ykarelor mailing list update14:31
rlandyykarel: should be cleared now ...14:32
ykarelThat's fast, thanks will recheck14:32
rlandylog Temporarily disabled log uploads to OVH's Swift while we look into an account 14:33
soniya29dviroel|rover, rlandy, full-tempest-api master passed closing the bug:- https://bugs.launchpad.net/tripleo/+bug/198142414:35
soniya29dviroel|rover, rlandy, fs35 master is failing on tempest tests with error:- tempest.exceptions.BuildErrorException: Server 4dde6d2a-140c-4a01-a6da-a900ab25d2c1 failed to build and is in ERROR status14:47
soniya29i am filing a bug for it14:48
dviroel|roversoniya29: thanks I can take a look afterwards14:52
* dviroel|rover on fips meeting14:52
soniya29dviroel|rover, ack14:57
* soniya29 leaving for the day14:57
*** soniya29 is now known as soniya29|out14:58
chandankumarsee ya!15:04
*** ysandeep is now known as ysandeep|out15:05
* ysandeep|out out as well, see everyone tomorrow15:05
dviroel|rovero/15:06
ysandeep|outrlandy, marios dviroel|rover dasm I have shared one doc with you all about operator workflow process, Please add your comments/questions.15:06
mariosthanks ysandeep|out 15:06
ysandeep|outwe can discuss more on doc/ on a mtg (if there is a need)15:07
dviroel|roverysandeep|out++15:07
dasmack, thx15:20
*** marios is now known as marios|out15:35
* dviroel|rover lunch15:36
*** dviroel|rover is now known as dviroel|rover|biab15:36
*** dviroel|rover|biab is now known as dviroel|rover16:42
*** amoralej is now known as amoralej|off16:54
rlandydviroel|rover: hey  - how are things with ovb investigation?17:46
rlandydasm: hello17:48
rlandyhow far out are we from moving to ovb master branch?17:48
dasmrlandy: o/17:48
rlandypls see hardware prov chat17:48
dasmchecking17:49
dasm>  I think to get CI to try it we still need to tackle getting master CI jobs using master OVB first17:49
rlandyI uploaded a new image for steve but he needs OVB master17:49
rlandyack17:49
rlandydasm: ^^ need help there?17:49
dasmit's up to our team when we're gonna enable that17:49
dasmhttps://review.rdoproject.org/r/c/config/+/4316617:49
dasmi mentioned it few times, still no consensus. Harald seems to be onboard with the change17:50
dasmI'm currently going through places wrt what and how is gonna be affected17:50
rlandydasm: ok - let's pick that up at review time17:50
rlandyand decide17:50
dasmack17:50
rlandyI'm ok with adding it to testing as per the patch17:51
rlandydasm: only thing missing there is wallaby c917:51
rlandythere is w c817:52
rlandyand master 17:52
rlandyno wallaby c917:52
dasmi see17:52
dviroel|roverrlandy: i see 3 types of issues on fs001 train, one of them we might be able to skip e open a CIX, it is very similar to https://bugs.launchpad.net/tripleo/+bug/196031017:54
dviroel|rovercreating a new LP for this one ^17:56
dviroel|roverrlandy: guess what happened18:04
dviroel|rover2022-07-12 18:01:14.272253 | primary |   "success": true,18:04
dviroel|rover2022-07-12 18:01:14.272263 | primary |   "timestamp": 1657648872,18:04
dviroel|rover2022-07-12 18:01:14.272273 | primary |   "url": "https://logserver.rdoproject.org/63/41063/4/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-tripleo-train/f971861"18:04
dviroel|roverrlandy: forget about it, ^ it is tripleo component :(18:07
rlandydviroel|rover: ok - do you want to discuss findings now or at review time?18:08
rlandyyour choice18:08
* dviroel|rover was happy for a moment18:08
dasmdviroel|rover: qq, i see this: https://review.rdoproject.org/r/c/config/+/43166/2/zuul.d/tripleo.yaml#b109 but neither tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset039 nor tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset039-wallaby are running18:09
dasmhow those are running/not running during checks?18:09
dasmexample: https://review.opendev.org/c/openstack/openstack-virtual-baremetal/+/842441 / Zull Summary18:09
dviroel|roverrlandy: we can use review time, works for me18:11
rlandyk18:11
rlandywe need to close our current bug and open a one the reveals the real situation now18:12
dasmhmm... we have "periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-wallaby" which is not a child of "tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-wallaby" hence latter doesn't run at all18:17
dviroel|roverrlandy: yeah, the most recent issue is overcloud deploy failing with keystone18:21
dviroel|roverI don't see another bug open for fs001-train18:22
rlandyugh18:22
rcastillohave to run to the vet. biab18:26
dasmrlandy: you should be able to make image "shared" and that should be sufficient18:31
rlandydasm: I did - steve can't access it18:31
dasmack18:31
rlandywill try chat with him when he is on line18:31
dasmhmm. "RDO Third Party CI" is not running all jobs assigned to it. Especially "tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-wallaby"18:33
dasmhttps://review.rdoproject.org/r/plugins/gitiles/config/+/refs/heads/master/zuul.d/tripleo.yaml#17318:33
dasmtbf, it runs only cs9 jobs: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/84741918:34
rlandylunch - back in a few18:40
rlandyrcastillo: dviroel|rover: review time19:00
dasmhttps://review.rdoproject.org/r/c/testproject/+/4231919:01
jm1reviewbot: add https://review.opendev.org/c/openstack/tripleo-ci/+/84950019:12
jm1rlandy, rcastillo: just added another patch for review time to merge ;) 19:13
* jm1 😴 ... have a nice evening!19:42
rcastilloback19:43
dviroel|roverrlandy: https://bugs.launchpad.net/tripleo/+bug/198147819:53
rlandythanks20:33
*** rlandy is now known as rlandy|bbl21:59
dasmrlandy|bbl: tomorrow we have a town hall with Matt and Paul at the same time as Retro. Do we want to postpone retro till Thu?22:02
* dasm => offline22:14
*** dasm is now known as dasm|off22:14
*** rlandy|bbl is now known as rlandy|out23:47
*** ysandeep|out is now known as ysandeep23:58
ysandeepdasm|off, +1 to move retro for townhall 23:59
ysandeepbhagyashris, ^^23:59

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!