Tuesday, 2021-09-21

*** pojadhav- is now known as pojadhav03:59
*** pojadhav is now known as pojadhav|off04:06
*** ysandeep|away is now known as ysandeep05:38
bhagyashrisfolks plz add into your review list https://review.rdoproject.org/r/c/rdo-jobs/+/35433 thanks :)06:31
chandankumarHello #tripleo-ci, I am back now :-)06:56
ysandeepchandankumar: o/ 07:00
mariosHEY EVERYBODY ! chandankumar is back \o/ :D07:03
marios:)07:03
chandankumarmarios: ysandeep \o, thanks :-)07:04
chandankumarI missed you people so that I should come back early :D07:04
chandankumar*so that I thought07:05
bhagyashrischandankumar, 0/07:18
*** amoralej|off is now known as amoralej07:20
*** jpena|off is now known as jpena07:28
*** ykarel is now known as ykarel|away07:34
*** ysandeep is now known as ysandeep|lunch07:48
soniya29chandankumar, o/08:17
bhagyashrishey soniya29 08:24
bhagyashris is it possible to shift tempest meeting half hr earlier than the regular time08:24
bhagyashrisonly for this week08:35
*** ysandeep|lunch is now known as ysandeep09:09
soniya29bhagyashris, yeah, i replied to this yesterday but it was late :)09:40
soniya29bhagyashris, sure, we can shift half hr early09:40
ysandeepbhagyashris, i think that mtg got cancelled09:41
ysandeepI mean the open forum mtg 09:42
ysandeepbhagyashris: pm09:42
ysandeepWe can go as per current plan for retro09:43
anbanerj|ruckHey chandankumar, when you get some time pls lemme know if https://review.opendev.org/c/openstack/tripleo-quickstart/+/810175 would work09:50
ysandeepfolks reviews please: https://review.opendev.org/c/openstack/tripleo-ci/+/80793710:20
*** ykarel|away is now known as ykarel10:26
*** frenzy_friday is now known as anbanerj|ruck10:36
ysandeepakahat, chandankumar: fyi.. Correct overcloud delete fail condition | https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/81018211:11
bhagyashrishello folks this week Open forum meeting has been canceled so we don't need to change our retro meeting time11:17
bhagyashrismail subject - Cancelling this weeks scheduled open forum11:17
bhagyashrismarios, soniya29|afk ^11:18
mariosack thanls bhagyashris 11:19
mariosthanks :)11:19
*** jpena is now known as jpena|lunch11:24
*** dviroel|out is now known as dviroel11:31
*** ysandeep is now known as ysandeep|afk11:47
marioso/ tripleo-ci need reviews please easy one just adds the centos7 instance for molecule tests 11:59
mariosthere :) https://review.opendev.org/c/openstack/tripleo-repos/+/809628 11:59
mariosthank you 11:59
soniya29bhagyashris, ack12:01
chandankumarysandeep|afk: anbanerj|ruck thanks :-)12:02
*** amoralej is now known as amoralej|lunch12:05
*** jpena|lunch is now known as jpena12:22
*** ysandeep|afk is now known as ysandeep12:39
*** amoralej|lunch is now known as amoralej13:00
bhagyashrisarxcruz, sshnaidm, rlandy, marios, ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat, weshay|ruck , chandankumar, frenzy_friday, dviroel anbanerj|ruck 13:21
bhagyashrisTripleO CI community meeting in 9 mins13:21
bhagyashrisAdd topic under agenda section https://hackmd.io/MMg4WDbYSqOQUhU2Kj8zNg?both#2021-09-21-Community-Call **@ line number 32**13:22
bhagyashrishttps://meet.google.com/bqx-xwht-wky?authuser=013:22
bhagyashrisysandeep soniya29 ^13:30
weshay|ruckanbanerj|ruck, fyi https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/35702 https://code.engineering.redhat.com/gerrit/c/openstack/rrcockpit/+/27511713:37
dviroelteam, need reviews on this https://review.opendev.org/c/openstack/tripleo-repos/+/804306 - i have another one that depends on this get merged first. If minor details need to be fixed, i can work in the change that follows13:58
weshay|ruckanbanerj|ruck, need anything?14:02
erbotRequired files not ready after 300.62649178504944s for distgit-cbs-validate-centos8-stream 35585,1,1dbfa9cbb0574871afbed7960e7dbe1714:24
erbotRequired files not ready after 300.5754063129425s for distgit-cbs-validate-centos8-stream 35565,1,33ecbaba38cf417b953e67eed4ab012714:33
erbotRequired files not ready after 301.1322410106659s for distgit-cbs-validate-centos8-stream 35626,1,736164ca8b3d43eeb572ffc3d54b4ceb14:38
dviroelysandeep: hi, around?14:45
ysandeepdviroel, hey o/14:45
dviroelysandeep: looking at this testproject https://review.rdoproject.org/r/c/testproject/+/35121 - to debug an issue14:46
* ysandeep looking14:50
dviroelysandeep: https://review.rdoproject.org/r/c/testproject/+/35121/22/.zuul.yaml sets 'fips: false' but the output.txt  show as undefined. 14:50
anbanerj|ruckweshay|ruck, where can I find the cron definition of when the integration lines run?14:50
weshay|ruckit's in the zuul definition of the pipeline .. so codesearch the name of the pipeline14:51
anbanerj|ruckI got till here https://github.com/rdo-infra/rdo-jobs/tree/master/zuul.d14:52
dviroelysandeep: tripleo-ci-centos-8-content-provider is failing because of that, and we want fips enabled only on featureset002 14:53
ysandeepdviroel, content-provider job failing on TASK [build-test-packages : Run DLRN] 14:54
ysandeepdviroel, Have you tried running content-provider in rdo, even without fip: false and depends-on, afair they works out of box on rdo testproject14:55
ysandeepchandankumar: Will content-provider job work in rdo testproject? for ex: https://review.rdoproject.org/r/c/testproject/+/35121 14:56
chandankumarysandeep: I think it should14:57
chandankumarysandeep: in above patch dlrn build is failing14:57
chandankumarhttps://logserver.rdoproject.org/21/35121/22/check/tripleo-ci-centos-8-content-provider/c8bb74e/logs/delorean_logs/component/tempest/25/b3/25b3c699f722dd5d2c74abc5c7951051ff1d34e3_dev/rpmbuild.log.txt.gz14:57
dviroelchandankumar: ysandeep according with ade_lee, it is failing onDLRN build cause fips is enabled14:58
dviroelthats why rlandy was setting it to 'false' in vars.14:58
dviroelbut if you search in the logs, will see that fips is undefined14:59
dviroel"Original fips var value: Undefined, New FIPS var value: true"15:00
ysandeepdviroel, atleast zuul var is correctly set: https://logserver.rdoproject.org/21/35121/22/check/tripleo-ci-centos-8-content-provider/c8bb74e/zuul-info/inventory.yaml 15:00
ysandeep      fips: false15:00
dviroelhttps://review.opendev.org/c/openstack/tripleo-ci/+/808215/14/playbooks/tripleo-ci/enable-fips.yml15:01
ade_leedviroel, here15:03
dviroelade_lee: we can see fips set to false here https://logserver.rdoproject.org/21/35121/22/check/tripleo-ci-centos-8-content-provider/c8bb74e/zuul-info/inventory.yaml 15:03
chandankumarI have invited myself to the party https://review.opendev.org/c/openstack/tripleo-ci/+/80821515:04
dviroel++15:05
ade_leechandankumar, the more the merrier :)15:06
ade_leedviroel, yeah - looks like its set to false in two places there15:06
chandankumarade_lee: https://review.opendev.org/c/openstack/tempest/+/807465/8#message-c27824e429cc4f9011f7fd7083b5e9b5dc439f5015:07
chandankumarif we get the sphinx build fixed it will build the rpm15:07
ade_leechandankumar, so thats what the fips: false flag is supposed to work around15:08
chandankumarok15:08
ade_leechandankumar, the sphinx build is fixed, but only i a versionof sphinx that is much more recent than the one that is available.15:09
chandankumarade_lee: for testing, let me disable the doc build on master in rdo side15:09
ade_leewhat we do in the upstream patch is sets fips to false only for the content-provider build ..15:10
ade_leeyeah - definitely less try that15:10
ade_leelets15:10
chandankumarhttps://review.rdoproject.org/r/c/openstack/tempest-distgit/+/3570915:14
ysandeepdviroel: I don't have an explanation on why we are getting -> "Original fips var value: Undefined, New FIPS var value: true" even though fips: false is set in vars.15:14
dviroelysandeep: yeah :/15:15
dviroelweird15:15
chandankumarsetting vars in job does not get passed in dlrn build15:15
ade_leedviroel, chandankumar ysandeep I might have something on that ..15:17
ade_leeI think its probably 'false' instead of false15:17
ade_leeI looked at the case where it worked ..15:17
ade_leethis is where it worked -- https://zuul.opendev.org/t/openstack/build/18d3d5a639af4d4da1cc90d2eb30c4f615:19
ade_leehttps://zuul.opendev.org/t/openstack/build/18d3d5a639af4d4da1cc90d2eb30c4f6/log/zuul-info/inventory.yaml15:20
ade_leewhich has to come from here -- https://review.opendev.org/c/openstack/tripleo-ci/+/808215/14/zuul.d/layout.yaml15:20
ade_leeI think we can make it work if we change rlandy|testbox patch to use 'false' instead15:21
ade_leedviroel, chandankumar , ysandeep ^^15:21
dviroelworth trying15:21
dviroeldo you want to update the testproject?15:22
chandankumarade_lee: dviroel can we wait till https://review.rdoproject.org/r/c/openstack/tempest-distgit/+/35709 get merges?15:22
dviroelchandankumar: sure15:22
dviroelso.. /me lunch15:23
*** dviroel is now known as dviroel|lunch15:23
ysandeepack o/15:23
*** ysandeep is now known as ysandeep|dinner15:23
ade_leechandankumar, sure15:23
chandankumarade_lee: dviroel|lunch good to update the testproject15:48
*** ykarel is now known as ykarel|away15:49
*** ysandeep|dinner is now known as ysandeep15:56
*** marios is now known as marios|out15:59
ade_leechandankumar, cool - let me try16:02
*** amoralej is now known as amoralej|off16:14
*** jpena is now known as jpena|off16:25
*** dviroel|lunch is now known as dviroel16:28
dviroelade_lee: it is now working "Original fips var value: false, New FIPS var value: false"16:37
dviroellets wait 'tripleo-ci-centos-8-scenario002-standalone' start to request node hold16:37
ade_leedviroel, yup - so that seems to have done the trick16:37
ade_leecool16:38
ysandeepdviroel: what changed? false to 'false'17:09
dviroelysandeep: yes17:09
ysandeep:) 17:09
*** ysandeep is now known as ysandeep|away17:13
*** sshnaidm is now known as sshnaidm|off17:22
dviroelade_lee: asking on #rhos-ops for node holding17:32
*** ysandeep|away is now known as ysandeep17:44
ade_leedviroel, thanks - please let me know when you've got a node17:45
ade_leedviroel, hey - any update from cshwede on the other job?17:49
dviroelade_lee: he is working on a local reproducer, since he didn't found anything on the published logs17:51
ade_leedviroel, great thanks17:55
ysandeepchandankumar, weshay|ruck In 17 only fs035 is failing on tempest failures, https://sf.hosted.upshift.rdu2.redhat.com/logs/94/211494/56/check/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset035-internal-rhos-17/be56853/logs/undercloud/var/log/tempest/stestr_results.html.gz 18:22
weshay|ruckysandeep, k.. I'll testproject.. GO AWAY18:23
ysandeepI am filing a bz.. Should we hold 17 promotions on ^^ , Or open bz/add skiplist and promote 1718:23
weshay|ruckis it consistent? like I should NOT testproject?18:23
ysandeepweshay|ruck, testproject running right now also failed on same error: https://code.engineering.redhat.com/gerrit/c/testproject/+/190672 18:23
weshay|ruckk.. 18:24
weshay|ruckI can bug it18:24
ysandeepweshay|ruck++ thanks! 18:24
ysandeepTo me looks like failing test is swift related, Not sure why we don't see swift logs dir anymore: https://sf.hosted.upshift.rdu2.redhat.com/logs/94/211494/56/check/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset035-internal-rhos-17/be56853/logs/overcloud-controller-0/var/log/containers/18:25
ysandeepweshay|ruck: confirmation: Should we also block 17 promotion on this failure?18:29
weshay|ruckysandeep, for now yes18:30
weshay|rucklet's dig at it tomorrow18:30
ysandeepanbanerj|ruck, ^^ fyi.. 17 is also blocked (for yoor program call status)18:31
ysandeepanbanerj|ruck, weshay|ruck will bug it, otherwise i can tomorrow 18:31
ysandeepyour*18:31
*** ysandeep is now known as ysandeep|out18:32
* ysandeep|out leaves see you tomorrow 18:33
weshay|ruckanbanerj|ruck, you want to take a crack at that? and call me in if needed? ^18:33
anbanerj|ruckchecking18:35
anbanerj|ruckhey weshay|ruck, for wallaby promotion does tripleo-quickstart-promote-wallaby-current-tripleo-delorean-minimal need to pass? It is here http://promoter.rdoproject.org/config/CentOS-8/wallaby.yaml but I dont see it in the ruck rover script18:39
anbanerj|ruckAnd how can I rerun that? It does not work in testproject18:40
weshay|ruckanbanerj|ruck, ya.. I think wallaby hasn't run yet.. don't worry about it18:40
weshay|ruckanbanerj|ruck, that's a current-tripleo-rdo promotion NOT current-tripleo18:40
anbanerj|ruckoh ok18:40
weshay|ruckanbanerj|ruck, https://jenkins-cloudsig-ci.apps.ocp.ci.centos.org/view/phase-1-pipelines/18:41
anbanerj|ruckweshay|ruck, ysandeep|out I'll check the failure in periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset035-internal-rhos-17 tomorrow and create a bug18:55
anbanerj|ruck^ this will go in bugzilla right?18:55
weshay|ruckanbanerj|ruck, yes18:56
anbanerj|ruckweshay|ruck, I am leaving for the day. There is a testP running for victoria. Ussuri and wallaby shows no failed job, so they should promote. c7 train died yesterday mid run because of  trunk.rdoproject outage, should I wait for the next automatic run or testproject the failed jobs?19:05
weshay|ruckanbanerj|ruck, https://review.opendev.org/c/openstack/tripleo-quickstart/+/81031019:16
weshay|ruckanbanerj|ruck, 0/19:17
*** dviroel is now known as dviroel|out21:07

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!