Tuesday, 2021-08-31

*** ysandeep|away is now known as ysandeep06:12
ysandeepchandankumar: Good morning, Are we still using old promoter server for downstream promotion, I want to promote 16.2 06:15
ysandeeppromoted 16.2 with old downstream promoter server06:32
chandankumarysandeep: Good morning, we can use this one http://10.0.11.190/06:38
chandankumarI got confused with the old name since we have two old promoter for downstream06:39
chandankumaryou already promoted it, thanks :-)06:40
ysandeepchandankumar, thanks! yes used http://10.0.11.190/promoter_logs/redhat8_osp16-2.log to promote, it worked fine.. You and amol were working last week to deploy new promoter server.. so i mentioned ^^ as old :D06:41
chandankumar:-)06:41
*** amoralej|off is now known as amoralej07:13
*** jpena|off is now known as jpena07:51
*** ysandeep is now known as ysandeep|lunch08:10
amoralejhi, i'm hitting an issue when building container images in mistral-base08:10
amoralejhttps://logserver.rdoproject.org/81/35181/1/check/rdoinfo-tripleo-victoria-release-centos-8-scenario001-standalone/adb3dfa/logs/undercloud/home/zuul/container-builds/6981d669-6303-40c9-9758-ad6b9e4c9f7b/base/os/mistral-base/mistral-base-build.log.txt.gz08:10
amoralej  file /etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release from install of containers-common-2:1-2.module_el8.5.0+890+6b136101.noarch conflicts with file from package redhat-release-8.4-0.6.el8.x86_6408:10
amoralejis that a known issue?08:11
chandankumaramoralej: I think I have seen it somewhere08:17
chandankumaramoralej: let me find out the fix08:17
chandankumaramoralej: https://bugs.launchpad.net/tripleo/+bug/1939674 and https://review.opendev.org/q/topic:%221939674%22+(status:open%20OR%20status:merged)08:18
amoralejthanks chandankumar i'll check what happens in rdo jobs08:19
amoralejthanks chandankumar for the info, it has been useful08:29
chandankumaramoralej: for c9 redhat-release is a utility comes from centos-stream package08:30
chandankumarit might be useful for you08:30
chandankumaramoralej: please have a look at this bug https://bugs.launchpad.net/tripleo/+bug/194207808:32
chandankumarwhen free, thanks!08:32
*** ysandeep|lunch is now known as ysandeep09:03
zbro/ i am back, please ping me about any pending work09:25
chandankumarysandeep: please have a look at this review https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/805951 when free, thanks!09:52
ysandeepchandankumar: ack 09:53
*** bhagyashris_ is now known as bhagyashris10:07
*** ysandeep is now known as ysandeep|afk11:01
*** jpena is now known as jpena|lunch11:38
*** rlandy is now known as rlandy|rover11:38
rlandy|roverchandankumar: hey - can we chat for a few?11:40
chandankumarrlandy|rover: yes11:41
rlandy|roverhttps://meet.google.com/mpk-apim-ims?pli=1&authuser=011:41
sshnaidmchandankumar, hi, do you know if we have containers for c9 in rdo registry?11:55
ysandeep|afk111:56
*** ysandeep|afk is now known as ysandeep11:58
weshay|ruckmorning11:59
chandankumarrlandy|rover: https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_promoter/config_environments/rdo/defaults.yaml#L3712:27
chandankumarcentos-binary-12:28
ysandeeprlandy|rover, fyi.. I have promoted 16.2 today12:28
rlandy|roverysandeep: perfect - thanks12:29
rlandy|roverwill look at components today again12:29
chandankumarsshnaidm: hello12:36
chandankumarsshnaidm: we have not yet pushed containers to registry12:37
chandankumarsshnaidm: I am working on the job https://review.rdoproject.org/r/c/testproject/+/1895312:37
chandankumarsshnaidm:  but stuck at a place https://logserver.rdoproject.org/53/18953/98/check/tripleo-build-containers-stream9-development/d89174a/job-output.txt 12:38
chandankumarin pre container login12:38
rlandy|roverchandankumar: hmmm http://promoter.rdoproject.org/promoter_logs/centos7_train.log12:39
rlandy|roverstill missing containers12:39
rlandy|roverFAILED! => {"changed": false, "msg": "There are missing containers"}12:40
chandankumarrlandy|rover: looking once again12:40
*** jpena|lunch is now known as jpena12:41
chandankumarakahat: rlandy|rover here is the required config https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3522112:46
chandankumarfor c712:46
chandankumari hope it will work12:46
rlandy|roverchandankumar: dviroel|out: ysandeep: https://review.opendev.org/c/openstack/tripleo-ci/+/806645 Enable supported container-tools before login12:50
akahatchandankumar, commented.12:50
chandankumarakahat: commit hash is used there that I think will take care of that12:50
rlandy|roverakahat: chandankumar: when you guys agree, pls ping - and let's get on the promoter and fix the settings there12:51
rlandy|roverthanks12:51
arxcruzis it only rdo ?12:55
arxcruzops12:55
akahatchandankumar, yeah.. it will point overcloud-contaienrs. it make seance. 12:56
akahatthanks12:56
akahatchandankumar, let me try your patch on promoter server.12:58
chandankumarack12:58
ysandeepchandankumar, rlandy|rover bhagyashris soniya29 tc/ua/pm sync13:00
soniya29ysandeep, yeah13:01
chandankumarysandeep: https://docs.openstack.org/tripleo-quickstart/latest/feature-configuration.html13:03
chandankumarysandeep: https://opendev.org/openstack/tripleo-quickstart/src/branch/master/fs-matrix.py13:05
akahatC7 train promoting: http://promoter.rdoproject.org/promoter_logs/centos7_train.log13:06
*** amoralej is now known as amoralej|off13:08
*** amoralej|off is now known as amoralej|lunch13:08
bhagyashrisarxcruz, zbr, sshnaidm, rlandy, marios, ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat, weshay, chandankumar, frenzy_friday, dviroel13:30
arxcruzbhagyashris: you're late :P 13:30
bhagyashrisrlandy|rover, 13:30
bhagyashrisTripleo community call 13:30
bhagyashrisakahat, zbr 13:32
bhagyashriscommunity call13:32
sshnaidmweshay|ruck, rdo_trunk - with underscore13:39
weshay|ruckrlandy|rover, fyi... I just ssh'd to promoter.. and ssh'd in as uploader w/ the uploader key13:40
rlandy|roverweshay|ruck: k - I can ssh directly from my box13:40
weshay|ruckk13:41
zbroops,13:49
chandankumarsshnaidm: https://review.rdoproject.org/r/c/testproject/+/3116513:51
chandankumarzbr: hello, want to dig into ansible-collection installation13:54
chandankumarfor tripleo-quickstart13:55
zbrchandankumar: super, we really need to do that one.13:55
arxcruzweshay|ruck: zbr rlandy|rover https://review.opendev.org/c/opendev/elastic-recheck/+/806739 13:55
arxcruzneed to make some updates after talk with frenzy_friday but please add to your review list 13:55
rlandy|roverakahat: hey ... https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/35221 - you have a +1 and a comment13:56
rlandy|roveris this config ok to put on promoter or we should update with your comment?13:56
*** amoralej|lunch is now known as amoralej14:02
rlandy|roverarxcruz: ack - thanks14:11
chandankumarzbr: let me grab the dinner, will ping back on collection14:13
akahatrlandy|rover, i've already put that config on promoter. I'll update comment on review. 14:20
rlandy|roverakahat: and it's restarted?14:22
akahatyup14:22
rlandy|rover  File "/home/promoter/promoter_venv/lib64/python3.6/site-packages/paramiko/sftp_client.py", line 894, in _convert_status14:22
rlandy|rover    raise IOError(errno.ENOENT, text)14:22
rlandy|roverFileNotFoundError: [Errno 2] No such file14:22
rlandy|rover2021-08-31 14:09:33,882 3294435 ERROR    promoter No images found14:23
rlandy|roverakahat: ^^14:23
akahatrlandy|rover, looking14:23
rlandy|roverakahat: for c7, 14:24
rlandy|roverhttps://review.rdoproject.org/zuul/buildset/af9dacc5d0b34223a249888791f06b0b14:24
rlandy|roverno images14:24
akahatlooks like we need to add 14:25
akahatthat is reason for failures ??14:25
akahatbecause it's failed on qcow images promotion/14:25
rlandy|roverakahat: or skip image client14:25
rlandy|roverweshay|ruck: ^^ we are not expecting c7 overcloud images, right?14:26
rlandy|roverthere is no images build jobs14:26
rlandy|roverakahat: what was the old c7 promoter doing?14:26
rlandy|rovermy guess is it was skipping qcow client14:26
rlandy|roverwe just need containers and dlrn14:27
akahatrlandy|rover, okay. I'll update config file.14:28
akahatjust dlrn and containers14:28
rlandy|roverakahat: thanks14:28
* rlandy|rover checks image server14:29
rlandy|roverakahat: https://images.rdoproject.org/centos7/train/rdo_trunk/14:29
rlandy|roverlast time we push images was 05/0114:29
*** ysandeep is now known as ysandeep|afk14:31
akahatupdate config: http://promoter.rdoproject.org/config/CentOS-7/train.yaml14:33
rlandy|roverakahat: ack - let's try it14:34
zbrchandankumar: lets join a meet session when you can, it should make it easier14:37
chandankumarrlandy|rover: can you take care of EL9 stuff?14:38
chandankumarI need to hopin with zbr for tripleo-repos14:39
chandankumars/stuff/meeting14:39
rlandy|roverchandankumar: sure14:40
rlandy|roverwill report your status14:41
rlandy|roverakahat++14:42
rlandy|roverpushing containers14:42
rlandy|roverdviroel|out: chasing master https://review.rdoproject.org/r/c/testproject/+/3512114:53
weshay|rucknot sure what you mean by not expecting c7 images14:53
weshay|ruckovercloud images14:53
weshay|ruckoh.. because we disabled ovb14:53
weshay|ruckya14:53
weshay|rucknot needed14:53
rlandy|roverweshay|ruck: ack - checked the last date we pushed - was 05/0114:56
* akahat back in 2 hrs15:03
rlandy|roverakahat: thanks15:12
rlandy|roverafter 1 month, we promoted train c715:12
rlandy|roverysandeep|afk: chandankumar: dviroel|out: weshay|ruck: pls review https://review.opendev.org/c/openstack/tripleo-ci/+/80664515:13
rlandy|rovertrain/ussuri blocker15:13
weshay|ruckrlandy|rover, can we note that as a line item for the new tripleo-repos modules15:14
rlandy|roverweshay|ruck: in commit message15:15
weshay|ruckmaybe a TO-DO15:15
weshay|ruckor FIX-ME15:15
rlandy|roverTO-DO15:15
rlandy|roverupdating15:15
weshay|ruckthanks15:16
chandankumarrlandy|rover: do we have a test project?15:21
rlandy|roverchandankumar: ack https://review.rdoproject.org/r/c/testproject/+/3511115:28
rlandy|roverchandankumar: will do a test run on master as well15:29
rlandy|roverchandankumar: testing don't mess up master https://review.rdoproject.org/r/c/testproject/+/3512215:36
*** amoralej is now known as amoralej|off15:43
rlandy|roverysandeep|afk; hi - are you still waiting on reviews from me on anything?15:52
*** jpena is now known as jpena|off16:02
akahatchandankumar, https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/35008 ready to review16:03
akahatrlandy|rover, weshay|ruck ^^16:03
akahatbhagyashris, ^16:03
weshay|ruckakahat, comment16:04
*** ysandeep|afk is now known as ysandeep16:05
* ysandeep reading back16:05
ysandeepweshay|ruck, o/ hey i think you have voted against review priority instead of code-review on https://review.opendev.org/c/openstack/tripleo-ci/+/806645 by mistake16:07
weshay|ruckysandeep, I swear those flip flop sometimes.16:09
weshay|ruckysandeep, fixed16:09
ysandeeprlandy|rover: I am good now, yesterday I pinged regarding reviews on operator patches, I +w them today as they already have three +2 now and hanging in queue from more than a week, testprojects are green.. But in any case if some things break we can fix/revert accordingly.16:09
rlandy|roverysandeep: yep - sorry16:10
ysandeepnw, I know you are dealing with lots of stuff lately.16:11
rlandy|roverhttps://review.opendev.org/c/openstack/tripleo-ci/+/80664516:13
rlandy|roverweshay|ruck: ^^ did you intend to change review priority to w+?16:13
weshay|ruckwho cares what the review-priority is?16:18
rlandy|roverapparently you do - you set it16:27
weshay|rucklolz.. :)16:35
weshay|ruckfair enough16:35
rlandy|roverlunch - brb16:47
*** dviroel|out is now known as dviroel|ruck16:54
dviroel|ruckhey o/16:54
* dviroel|ruck reads everything missed so far16:55
weshay|ruckdviroel|ruck, howdy16:55
sshnaidmweshay|ruck, can you change name there to rdo_trunk? https://images.rdoproject.org/centos9/master/17:10
sshnaidmto be consistent17:10
weshay|ruckya17:10
weshay|rucksshnaidm, done17:12
sshnaidmweshay|ruck, thanks17:12
rlandy|roverdviroel|ruck: how are you feeling?17:25
dviroel|ruckrlandy|rover: good. recovered :) 17:38
dviroel|rucktks for asking :)17:38
dviroel|ruckso we are depending on https://review.opendev.org/c/openstack/tripleo-ci/+/806645 for train and ussuri17:41
dviroel|ruckchasing master already..17:42
dviroel|ruckwill check scenario001 then, create the revert dor skiplist and testproject it17:43
rlandy|roverdviroel|ruck: yep - waiting for zuul to vote on https://review.opendev.org/c/openstack/tripleo-ci/+/80664517:45
rlandy|roverdviroel|ruck: train c7 promoted \o/17:45
rlandy|roverdviroel|ruck: yeah and master may be having issues 17:45
rlandy|rovernot sue17:45
rlandy|roversure17:45
rlandy|roverI stupidly abandoned my testproject patch in the middle17:46
rlandy|roverso that's in recheck17:46
rlandy|roverpinged rdo guys about failing ci,centos jobs17:46
rlandy|rover"rlandy|rover, in master, fix is https://review.opendev.org/c/x/packstack/+/806105"17:46
dviroel|ruckah ok, lets follow up17:46
rlandy|roverneed to promote new content17:47
rlandy|roverdviroel|ruck; think that was all you missed17:47
rlandy|rover16.2 promoted17:47
rlandy|rovergoing to check components downstream ahead of program call tomorrow17:47
rlandy|roveryou ok to present?17:47
rlandy|roverI will update the doc info17:47
dviroel|ruckrlandy|rover: sure :)17:48
rlandy|roverthank you17:48
dviroel|ruckalso need to do some manila review at the end of the day, we are in feature freeze week17:50
rlandy|roverdviroel|ruck: k- np 17:51
rlandy|roverjust let me know and I'll keep watch so you can put in your reviews17:52
dviroel|ruckk, thks17:52
*** ysandeep is now known as ysandeep|away17:54
dviroel|ruckrlandy|rover: in order to have fmount fix testing other components (cinder, common, glance) we need to promote master first, right?18:21
rlandy|roverdviroel|ruck: fix is in tripleo?18:22
rlandy|roverif so, not really18:22
rlandy|rovera certain amount of tripleo is taken from current18:22
dviroel|ruckyes, these https://review.opendev.org/q/topic:%22disable_cephadm%22+(status:open%20OR%20status:merged)18:22
dviroel|rucki'm looking these failures https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-scenario001-standalone-common-master18:23
rlandy|roverTHT should be in current18:25
rlandy|roverdviroel|ruck: in quick meeting18:25
rlandy|roverwe should check what version of THT is installed18:25
dviroel|ruckok18:25
dviroel|ruckyep, corrent, using tripleo-curent: openstack-tripleo-heat-templates.noarch     15.0.1-0.20210830230759.0835d2a.el8       @delorean-current                  18:28
dviroel|ruckcorrect*18:28
dviroel|rucktripleo-ansible also has the commit: tripleo-ansible.noarch                      4.0.1-0.20210830145414.c002777.el8        @delorean-current18:32
dviroel|ruckwe may be hitting another issue, will rerun all jobs in the skiplist18:32
rlandy|roverdviroel|ruck: k18:42
rlandy|roverso there is a list of rpms we pick up from current18:42
rlandy|roveryou can see that list in the release file18:43
dviroel|ruckoh, nice18:50
rlandy|roverhmmm ... may have a fs001 problem18:55
rlandy|roverhttps://logserver.rdoproject.org/21/35121/4/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master/f44599d/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz18:55
* rlandy|rover checks18:55
rlandy|roverhttps://review.rdoproject.org/zuul/stream/40b0e870ce7f407e96b0f6bb952a606d?logfile=console.log doing ok18:56
rlandy|rovermaybe we'll just go with that  hash18:56
rlandy|rovermater current line is better18:56
rlandy|roverhttps://zuul.opendev.org/t/openstack/builds18:57
rlandy|rovertripleo-build-containers-centos-7-buildah-stein18:57
rlandy|rovergoing to fail the train job18:57
rlandy|roverweshay|ruck: ^^ fyi - removing stein job18:59
weshay|ruck++18:59
weshay|ruckw/ force18:59
rlandy|roverwith fire18:59
rlandy|roverk - better19:04
rlandy|roverdviroel|ruck: please revote https://review.opendev.org/c/openstack/tripleo-ci/+/806645/19:04
rlandy|roverthanks19:04
* rlandy|rover tries to promote some downstream components19:11
rlandy|rovernot too bad20:03
rlandy|rovertripleo component upstream and downstream old20:03
dviroel|ruckrlandy|rover: these errors https://review.rdoproject.org/r/c/testproject/+/35120 might be related with buildcontainers issue, right? Since this job depends on periodic-tripleo-ci-build-containers-ubi-8-push-ussuri20:26
dviroel|ruckit might trying to retrieve containers that weren't build properly?20:26
* rlandy|rover looks20:38
dviroel|ruckforgot to add the error20:39
rlandy|roverundercould install20:39
dviroel|ruck"FATAL | Run tripleo_container_image_prepare logged"20:39
dviroel|ruckyes20:39
rlandy|rover_container_image_prepare logged to: /var/log/tripleo-container-image-prepare.log | 31.80s20:39
rlandy|roverlikely20:39
dviroel|rucklots of 40420:40
rlandy|rovernot worth working on ussuri or train until we get that patch in20:40
rlandy|roverand the lines rerun20:40
rlandy|roverwe'll just spin20:40
dviroel|ruck+120:40
rlandy|roverugh- wallaby fail fs03520:40
* rlandy|rover checks if in criteria still20:41
rlandy|rover    # - periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-wallaby20:41
rlandy|roverout ok20:41
rlandy|roverwallaby shoudl promote20:41
* rlandy|rover waiting on master20:41
rlandy|roverdviroel|ruck: we should be ok here if you want to work on manila20:43
dviroel|ruck> wallaby shoudl promote20:51
dviroel|ruck\o/20:51
dviroel|ruckrlandy|rover: ok20:51
* dviroel|ruck start with a 3.5k lines change :/20:59
rlandy|rovergood luck21:02
rlandy|roverupdated program call doc21:02
rlandy|roverdviroel|ruck: should also get master promotion today21:03
dviroel|ruck\o/21:03
sshnaidmrlandy|rover, weshay|ruck https://images.rdoproject.org/centos9/master/rdo_trunk/current-tripleo/21:45
rlandy|roversshnaidm++ nice21:54
rlandy|roverthanks21:54
rlandy|roverdviroel|ruck: need to step out - will check back later - have a good night22:16
*** rlandy|rover is now known as rlandy|rover|bbl22:16
dviroel|ruckok22:49
*** sshnaidm is now known as sshnaidm|afk23:34

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!