Monday, 2022-01-03

*** ysandeep|out is now known as ysandeep03:39
ysandeepHappy new year folks o/ 03:39
marioso/ happy new year tripleo-ci 09:03
mariosplease add to your reviews when you next have time https://review.opendev.org/c/openstack/tripleo-ci/+/822482/5#message-5c40a312480c4096fed0034a36acf2e16f9d2e77 09:04
mariosthank you :)09:04
mariosarxcruz: o/09:04
marioshey09:04
arxcruzmarios: hey, happy new year :) 09:04
mariosdo you have any idea what jakob irc nick is? i have not met him before. 09:04
mariosarxcruz: o/ :) ^^ 09:04
mariosarxcruz: o/ hey hope you had a good break mate09:05
mariosi was also out last week 09:05
arxcruzmarios: yeah, i just did nothing the whole day 09:06
mariosarxcruz: nice i had like 2/3 of those days last week ;) was great 09:08
mariosarxcruz: add to your reviews https://review.opendev.org/c/openstack/tripleo-ci/+/822482/5#message-5c40a312480c4096fed0034a36acf2e16f9d2e77 09:08
mariosarxcruz: when you next have time... we merged the undercloud upgrade patch (see the commit message of T^^^)09:08
mariosarxcruz: and that one is for minor update09:08
mariosarxcruz: i changed it quite a bit in the way the content provider branches were passed to the python side09:09
frenzy_fridayHappy new year everyone!09:58
jbadiapaHappy new year!!!!09:59
marioso/ frenzy_friday jbadiapa 10:09
arxcruzhey you guys10:11
marioswelcome jm1 o/ 10:29
jm1Frohes Neues :)11:02
*** rlandy is now known as rlandy|ruck11:12
rlandy|ruckhello all!11:13
marioso/ 11:14
dviroelhellop o/11:14
rlandy|ruckmarios: dviroel: hey - happy new yeae11:14
rlandy|ruckyear11:14
mariossame 2 u 11:14
rlandy|ruckdviroel: I think you are rucking this week?11:15
dviroelrlandy|ruck: yes11:15
rlandy|ruckwith akahat|PTO11:15
*** dviroel is now known as dviroel|rover11:15
rlandy|ruckplease join bhagyashris__ and me on ruck/rover sync 11:15
rlandy|ruckmeet.google.com/erz-oqiw-xyf at half past the hour11:16
rlandy|ruckakahat|PTO: ^^11:16
dviroel|roverack11:16
rlandy|rucklet's get status on what's going down11:16
rlandy|ruckI think w missed chandankumar already11:16
rlandy|ruckjm1: welcome!!!!11:17
rlandy|ruckjm1: happy to see you on channel11:17
rlandy|ruckjm1: have shared some docs with you 11:18
rlandy|ruckbhagyashris__: you around today?11:20
rlandy|ruckchandankumar left a note that it's a public holiday in india11:20
rlandy|ruckarxcruz: hi11:29
rlandy|ruckhappy new year11:29
dviroel|roverarxcruz: welcome back11:32
jm1rlandy|ruck: thank you, i'm reading through the docs..11:47
rlandy|ruckamoralej: hi ... happy new year... 11:47
amoralejhappy new year rlandy|ruck 11:47
rlandy|ruckamoralej: reading though the bugs left over shutdown ... per rabi's comment on https://bugs.launchpad.net/tripleo/+bug/1956083, we need to bump rdoinfo ...11:48
rlandy|ruckhttps://github.com/redhat-openstack/rdoinfo/blob/master/buildsys-tags/cloud8-openstack-victoria-release.yml#L127011:48
rlandy|ruckcould you help with that?11:48
amoralejlemme check11:48
rlandy|ruckamoralej: thanks - probably same needed on train, ussuri?11:49
rlandy|ruckper https://bugs.launchpad.net/tripleo/+bug/195608511:49
amoraleji need to remember11:50
rlandy|ruckamoralej: remember :)?11:55
amoralejyes, we did some changes for tls iirc11:55
amoraleji need to check if it was only that one11:55
* dviroel|rover coffee - back in 511:59
arxcruzdviroel|rover: hey! Happy new year12:01
arxcruzrlandy|ruck: hi! 12:01
mariosrlandy|ruck: o/ call ? 12:02
dviroel|roverchasing master failed ones12:55
dviroel|roverperiodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-master just passed12:56
rlandy|ruckdviroel|rover: thanks13:03
rlandy|ruckdviroel|rover: rekicked train c713:19
rlandy|ruckdviroel|rover: chasing wallaby failures13:19
rlandy|ruckrekicked ci.centos lines13:19
dviroel|rovergreat, thks13:19
rcastilloo/ hi everyone!13:23
dviroel|roverrcastillo: o/ happy new year13:23
rcastillohappy new year!13:23
rlandy|ruckmarios: hey - are we still waiting on https://trello.com/c/pDFmZ0cq/2262-cixlp1954456tripleociproa-fs02-overcloud-node-provision-timeout-waiting-for-provisioned-nodes-to-become-available?13:31
mariosrlandy|ruck: i think the patch is good (latest run is good looks like https://review.rdoproject.org/zuul/status#36267)13:31
mariosrlandy|ruck: i think chandankumar had success for fs2 as well13:31
mariosrlandy|ruck: so waiting for patch merge13:31
mariosrlandy|ruck: i'll comment on the patch and +2 it once that reports ^^ 13:32
mariosrlandy|ruck: that https://review.opendev.org/c/openstack/diskimage-builder/+/821772 13:32
rlandy|ruckmarios: thanks13:33
*** amoralej is now known as amoralej|lunch13:38
rlandy|rucksshnaidm: pls w+ https://review.opendev.org/c/openstack/tripleo-ansible/+/82314713:41
rlandy|ruckthanks13:41
sshnaidmrlandy|ruck, done13:42
rlandy|rucksshnaidm: thank you13:42
rlandy|ruckdviroel|rover: not taking holiday13:54
dviroel|roverrlandy|ruck: :)13:55
rlandy|ruckno point, I'll just worry about all the broken stuff13:55
rlandy|ruckmight as well fix it13:56
rlandy|ruckdviroel|rover: wrt ntp ... https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/30102013:58
rlandy|ruckmerging htat13:58
rlandy|ruckthat13:58
rlandy|ruckhttps://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/822566/13:59
rlandy|ruckneed to merge that first13:59
rlandy|ruckarxcruz: https://issues.redhat.com/secure/RapidBoard.jspa?rapidView=11751&projectKey=TRIPLEOCI&view=detail&selectedIssue=TRIPLEOCI-74214:05
rlandy|ruckhttps://review.rdoproject.org/r/c/testproject/+/3738014:05
rlandy|ruckhttps://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-config/+/30098214:08
*** amoralej|lunch is now known as amoralej14:13
rlandy|ruckmarios: hey for victoria, are we using release file for containers build?14:29
rlandy|ruckor just master14:29
mariosrlandy|ruck: just master centos914:29
mariosrlandy|ruck: not centos8 any branch including master14:29
mariosrlandy|ruck: let me know if you want me to dig further there 14:34
mariosrlandy|ruck: fwiw example there from experiments before we decided to use release file for c9 https://review.opendev.org/c/openstack/tripleo-repos/+/818118/2/plugins/module_utils/tripleo_repos/main.py 14:34
mariosrlandy|ruck: (that was for adding c9 support into that workaroundT^) 14:35
dviroel|roverrlandy|ruck: are you going to create triple-repos change? or want me to do it?14:36
rlandy|ruckdviroel|rover: on it - we'll need the same change in the release file - maybe? for the OVB test itself14:39
rlandy|ruckkind of guessing where this takes effect14:39
rlandy|ruckdviroel|rover: you can go ahead and add the release file change14:39
dviroel|roverrlandy|ruck: ack14:39
rlandy|ruckvictoria14:39
rlandy|ruckintegration line one14:39
dviroel|roverrlandy|ruck: https://review.opendev.org/c/openstack/tripleo-quickstart/+/823315/1/config/release/tripleo-ci/CentOS-8/victoria.yml - also setting higher priority14:49
rlandy|ruckA priority of 1 is the highest setting, and 99 is the lowest.14:51
rlandy|ruckdviroel|rover: ^^14:51
rlandy|ruckhttps://docs.fedoraproject.org/en-US/Fedora/14/html/Musicians_Guide/sect-Musicians_Guide-CCRMA_Repository_Priorities.html14:51
rlandy|ruck  sudo sed -i -e "s|priority=1|priority=20|g" /etc/yum.repos.d/temp-cloud8s-openstack-victoria-testing.repo14:51
rlandy|ruckshould stay at 1, no?14:52
dviroel|roverrlandy|ruck: yeah, my mistake, will remove14:53
rlandy|ruckdviroel|rover: let's chat quickly to coordinate this14:53
rlandy|ruckdviroel|rover: https://meet.google.com/kaw-npfo-tfr14:53
marioswow sorry i missed scrum :)15:01
mariosi thought it was now 15:02
mariosbut it was 1 hour ago ...15:02
mariosi've only been away 1 week :D like I forgot (i confused it with thursday i guess that is the one we pushed back)15:02
mariosrlandy|ruck: i just tried to join :) ^^ 15:02
rlandy|ruckmarios: no worries15:02
mariosguess it was pretty quiet lots folks out 15:03
rlandy|ruckyeah15:04
dviroel|roverrlandy|ruck: https://review.rdoproject.org/r/c/testproject/+/36356 - please - sanity check15:19
rlandy|ruckdviroel|rover: you want https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/CentOS-8/promotion-testing-hash-victoria.yml15:22
rlandy|ruckand https://review.rdoproject.org/r/c/testproject/+/36356/5/.zuul.yaml15:23
rlandy|ruckcontainers push15:23
rlandy|ruckshould be force_periodic: true15:23
dviroel|roverok15:24
dviroel|roverdone, done15:29
* dviroel|rover will be out for lunch15:30
*** dviroel|rover is now known as dviroel|rover|lunch15:30
rlandy|ruckdviroel|rover|lunch: thanks - made one last edit15:33
rlandy|ruckdviroel|rover|lunch; also ... https://jenkins-cloudsig-ci.apps.ocp.ci.centos.org/view/phase-1-pipelines/15:33
rlandy|rucka bunch of those lines passed15:33
rlandy|ruckwe should check the cockpit date to see if we are getting promotions15:33
dviroel|rover|lunch\o/15:34
dviroel|rover|lunchok15:34
rlandy|ruckdviroel|rover|lunch: not so happy is ... periodic-tripleo-ci-centos-8-standalone-full-tempest-scenario-master - will check in with you after lunch15:37
rlandy|ruckchecking errors there15:39
rlandy|ruckconsistent failure15:40
rlandy|ruckcurrent-tripleo-rdo/2021-12-28 20:45 15:46
rlandy|ruckcentos7_train15:46
rlandy|ruck11 days agotraincurrent-tripleo-rdocentos-78 hours ago15:46
rlandy|ruckcockpit data is wrong15:46
rlandy|ruckcreating bug for master failure15:47
jpodivinI'm having a tripleo-ci-centos-8-undercloud-containers failing during DLRN build, repository metadata not being available. Seems to be only happening to validations-libs, and AFAIK the links are up.16:13
jpodivinThought it might be intermittent, but it's two times in a row. Are we tracking it? 16:14
*** dviroel|rover|lunch is now known as dviroel|rover16:30
rlandy|ruckarxcruz: hey - on call16:31
arxcruzrlandy|ruck: me too 16:31
rlandy|ruckcan you hear me?16:31
arxcruzno 16:31
*** marios is now known as marios|out16:33
rlandy|ruckarxcruz: https://hackmd.io/gONRxsVRTFGw2pZIWLxTPA?both16:34
rlandy|ruckdviroel|rover: fyi https://bugs.launchpad.net/tripleo/+bug/195623316:51
dviroel|roverrlandy|ruck: ack. it seems that our tripleo-repos patch didn't work. We may need to move under "if distro == 'centos8'"16:53
dviroel|roverrlandy|ruck: checking containers-build logs16:53
rlandy|ruckdviroel|rover; ok - 16:53
rlandy|ruckif that doesn;t work16:53
rlandy|ruckwe can just ask amoralej to merge16:53
rlandy|ruckand hope for the best16:53
dviroel|roverack16:53
amoralejrlandy|ruck, dviroel|rover actually we did it already :)16:54
amoralejso the updates are in the deps repo already16:54
rlandy|ruckamoralej: ah - thanks16:54
rlandy|ruckdviroel|rover: so we can probably just run as is now16:54
dviroel|roverrlandy|ruck: ok, so will rerun without the depends-on patces16:55
dviroel|roverpatches16:55
dviroel|roveramoralej: thanks16:55
rlandy|ruckdviroel|rover: ack16:56
rlandy|rucklet's try that16:56
amoralejlet me know the result of the jobs, please16:56
dviroel|roversure16:56
rlandy|ruckamoralej: will do - thank you16:56
rlandy|ruckhttps://jenkins-cloudsig-ci.apps.ocp.ci.centos.org/view/phase-1-pipelines/16:58
rlandy|rucklooking better16:58
*** chem is now known as Guest1015317:00
dviroel|roverrlandy|ruck: also affected https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-master17:01
dviroel|roverwill add a comment in LP17:01
dviroel|roversame tempest failure17:01
rlandy|ruckdviroel|rover: ack thanks - will ask akahat|PTO to ping slaweq tomorrow17:01
dviroel|roverok17:01
rlandy|rucka couple of possible patches merged17:01
rlandy|ruckbetween the passing and failing jobs17:02
rlandy|ruckdviroel|rover: and c9: https://logserver.rdoproject.org/openstack-periodic-integration-main-cs9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-standalone-full-tempest-scenario-master/81c96bd/logs/undercloud/var/log/tempest/stestr_results.html.gz17:03
dviroel|rover+117:04
rlandy|ruckhttps://review.rdoproject.org/zuul/builds?pipeline=%09openstack-periodic-integration-main-cs9%0917:05
rlandy|ruckrest of that line looks ok17:05
dviroel|roverrlandy|ruck: should we skip it? or wait 17:06
rlandy|ruckdviroel|rover: let's give it one day17:07
dviroel|roverack17:07
rlandy|ruckask akahat|PTO  to try get a solution tomorrow17:07
rlandy|ruckmaster is 5 days out17:07
rlandy|rucknot so bad17:07
dviroel|roverrlandy|ruck: rdo-promotios cockpit is up to date for some branches17:08
rlandy|ruckdviroel|rover: also there are some patches we could possibly revert and try17:08
dviroel|roveryes17:08
rlandy|ruckbut unless we have a good idea, may not be worth it17:08
rlandy|ruckto randomly revert17:08
rlandy|ruckdviroel|rover: ack on rdo promotions17:09
rlandy|rucklooking better17:09
rlandy|ruck:)17:09
rlandy|ruckdviroel|rover: trying to merge all the ntp patches17:09
rlandy|ruckI think we may need one for the scenario010 on downstream17:10
rlandy|ruckie: the master job that kicks downstream17:10
rlandy|ruckhttps://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/822858/17:12
rlandy|ruckthen https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/30102017:13
rlandy|ruck^^ that for scenraio01017:13
rlandy|ruckhttps://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?job_name=periodic-tripleo-ci-centos-8-scenario010-kvm-internal-standalone-master17:15
rlandy|ruckmaybe not17:15
rlandy|ruckok so far17:15
dviroel|roverack, and the parent one https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/822566 too17:15
rlandy|ruckdviroel|rover: quick lunch - then will look at downstream failures17:16
dviroel|roverok17:16
*** rlandy|ruck is now known as rlandy|ruck|lunch17:24
*** amoralej is now known as amoralej|off17:43
*** rlandy|ruck|lunch is now known as rlandy|ruck17:49
rlandy|ruckhttps://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-17/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-build-containers-ubi-8-internal-rhel-8-build-push-upload-rhos-17/e685ad9/logs/container-builds/7c71f9cc-14a2-4a35-bd88-4404dfc67a0e/base/ovn-base/ovn-base-build.log18:13
rlandy|ruckcontainer build failure18:13
rlandy|ruckovn-2021-21.09.1-24.el8fdp.x86_64.rpm18:15
dviroel|roveryes, there is only src.rpm there18:19
rlandy|ruckdviroel|rover: k - leaving notes for ysandeep tomorrow18:34
rlandy|ruckwe need to know where to get that rpm18:35
rlandy|ruckdoesn't exist in any repos we have access to now18:35
rlandy|ruckpromoter Running: env ANSIBLE_LOG_PATH=/home/promoter/web/promoter_logs/container-push/20220103-182005.log ANSIBLE_DEBUG=False ansible-playbook -v -e @/tmp/tmpdpjoo5q6.yaml /home/promoter/ci-config/ci-scripts/container-push/container-push.yml18:57
rlandy|ruckc7 promoting18:58
dviroel|rover\o/18:58
dviroel|roverfirst tripleo-ci promotion of the year18:59
rlandy|ruckyay19:49
rlandy|ruckdviroel|rover: https://review.opendev.org/c/openstack/tripleo-ci/+/82279219:49
dviroel|roverrlandy|ruck: ack, you updated the dependency, nice19:52
rlandy|ruckdviroel|rover: let's see if it works19:53
rlandy|ruckneed to merge the downstream one afterwards as well19:53
rlandy|ruckchecking the trigger reviews19:54
* dviroel|rover will be afk, will be back to check some results20:07
*** dviroel|rover is now known as dviroel|rover|afk20:07
rlandy|ruckdviroel|rover|afk: thanks - see you20:16
rlandy|ruckhttps://code.engineering.redhat.com/gerrit/q/topic:%22bug%252F2024898%22+(status:open%20OR%20status:merged)20:16
rlandy|ruckto fix20:16
rlandy|ruckdownstream20:16
rlandy|rucktesting20:16
rlandy|ruckdviroel|rover|afk: amoralej|off: periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-victoriatestprojectmastercheck36356,821:39
rlandy|ruck3 hrs 33 mins 14 secs2022-01-03 17:59:41SUCCESS21:39
rlandy|ruckworks!!21:39
rlandy|ruckvictoria promoting21:53
*** dviroel|rover|afk is now known as dviroel|rover22:37
dviroel|roverrlandy|ruck: \o/22:38
*** dviroel|rover is now known as dviroel|rover|dinner22:54

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!