Thursday, 2022-05-19

*** rlandy|bbl is now known as rlandy|out00:45
*** ykarel_ is now known as ykarel04:51
*** ysandeep|out is now known as ysandeep|rover04:52
*** pojadhav|afk is now known as pojadhav05:10
ysandeep|roverreviewbot please add in review list: https://review.opendev.org/c/openstack/tripleo-ci/+/842356 05:31
ysandeep|roverfrenzy_friday: where is our reviewbot ? :D05:32
*** ysandeep|rover is now known as ysandeep|rover|brb05:51
*** ysandeep|rover|brb is now known as ysandeep|rover05:56
pojadhavysandeep|rover, thanks for rechecking my patch :) I was looking the same.06:00
ysandeep|rover:) my pleasure, Its my duty as ruck/rover to clear patches blocked in gate06:02
marioso/ morning tripleo-ci :)06:03
ysandeep|roverhey marios good morning o/06:03
*** jm1|ruck is now known as jm1|rover07:14
ysandeep|rovermarios, chandankumar we are not really isolating our component because of delorean-current repo, as soon as some issues merges via tripleo repos - it affect everything - all component and integration line.07:25
ysandeep|roverI am thinking should we really keep delorean-current in component line07:26
mariosysandeep|rover: interesting thought. it kind of brings into question the value of the tripleo component (actually what is it testing in that case - or do we do something special for delorean-current there?). worth some thought and discussion though 07:28
ysandeep|roverI can bring the discussion in today's scrum call07:28
ysandeep|roverwe are not disabling delorean-current even in tripleo component: https://logserver.rdoproject.org/openstack-component-tripleo/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-tripleo-master/da3e7d7/logs/undercloud/etc/yum.repos.d/ 07:30
mariosysandeep|rover: well the component repo has higher priority there maybe thats why?07:36
*** jpena|off is now known as jpena07:36
ysandeep|roveryeah for tripleo component I think that's okay if it have higher priority but for other components for ex. security - delorean-current (tripleo repos latest patches) can still slips in.07:40
jm1arxcruz, frenzy_friday, rcastillo: updated our miro board for next monday :) added some extra questions to lead us through the meeting https://miro.com/app/board/uXjVO0ysP2Y=/08:10
jm1ysandeep|rover: looks like the unpinning of wallaby did not work08:12
jm1ysandeep|rover: apparently it did work for the osp17 bug on cix, but it did not fix our lp bugs #1960310 and #196066108:26
ysandeep|roverjm1: ack, bit occupied with master bug atm but please left notes on cix/bug with details.08:27
jm1ysandeep|rover: sure08:28
jpodivinjm1: hi, we talked about the CI couple of days ago. I have to say you have been a great help. But I'm having bit of a trouble with the DLRN builds 08:41
jpodivinthe overrides for branches don't seem to propagate into the role building packages. Is there a trick to do that? 08:42
jm1jpodivin: which role building packages?08:49
jpodivinbuild-test-packages in ooq-extras08:50
jpodivinAt one point it performs a series of substitutions in the ini file to get right distgit repo from RDO08:51
jpodivinAnd that's where things go wrong because it looks for 1.6-rdo branch, which isn't there. 08:51
jpodivinso it grabs master-rpm and that leads to build error as some packages aren't available with the right version 08:52
jpodivinhttps://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/build-test-packages/tasks/dlrn-build.yml#L4308:53
jm1jpodivin: no idea, never used that role08:55
jpodivinjm1: np. I'm testing couple of approaches right now. I just didn't want to reinvent the wheel .08:57
jpodivinykarel: hi, could you give +w to the https://review.rdoproject.org/r/c/rdoinfo/+/41638 ? It's got the votes I believe and matbu resolved the issues. 09:06
ykareljpodivin, looking09:07
jpodivinykarel: thanks09:07
ykarelDone09:07
jpodivinykarel: thank you very much 09:07
*** ysandeep|rover is now known as ysandeep|rover|lunch09:31
*** ysandeep|rover|lunch is now known as ysandeep|rover10:09
*** rlandy|out is now known as rlandy10:27
rlandyysandeep|rover: jm1|rover: hello - time to sync?10:29
* ysandeep|rover fetching headphones10:30
rlandyhttps://meet.google.com/mgx-zqtu-nkx?pli=1&authuser=010:31
ysandeep|roverrlandy, https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/4297710:49
jm1rlandy: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/84221811:02
*** dviroel|out is now known as dviroel11:26
*** rlandy is now known as rlandy|mtg11:26
chandankumarrlandy|mtg: alternative registry meeting in another 2 mins11:28
rlandy|mtgack11:28
chandankumarrlandy|mtg: waiting for you11:31
*** ysandeep|rover is now known as ysandeep|rover|afk11:33
* jm1 lunch11:46
rlandy|mtgysandeep|rover|afk: leaving notes in hackmd - on reproducible master failure is scenario010-kvm11:57
rlandy|mtgrest passed on this run11:57
*** rlandy|mtg is now known as rlandy12:02
rlandychandankumar++ nicely done12:02
arxcruzrlandy bhagyashris i have to attend a fathers meeting at my daughter school, not sure if i'll be able to join scrum meeting 12:19
rlandyarxcruz: k - pls update your cards before monday's meeting - thanks12:23
*** ysandeep|rover|afk is now known as ysandeep|rover12:26
chandankumaranyone around tomorrow here?12:39
rlandychandankumar: ack - dasm|off wants to work tomorrow and switch out day12:40
rlandyhe will watch queues - if you need something12:41
chandankumarok cool, nothing needed12:41
chandankumarI will go over the CI in the morning12:42
marioschandankumar: i'll be around on a slow day so will help keep an eye too 12:45
chandankumarcool, I got company :-)12:45
marios you bring breakfast i'll bring coffee & tea ;)12:46
jm1rlandy, ysandeep|rover: we had this mysql error on several ci jobs before, is there any lp bug for that?12:46
rlandyjm1: diff from https://trello.com/c/jYWgTdwE/2491-cixlp1971465tripleociproa-fs001-and-fs035-ovb-jobs-failing-tempest-identity-haproxy-connection-errors?12:47
rlandywe had a victoris bug ... getting12:47
ysandeep|roverjm1: so far that is randomly failing and I pinged luca(#rhos-pidone) about that - he says its due to slow node12:48
jm1rlandy, ysandeep|rover: ack, thx. looks like victoria jobs keep failing because of these sql issues https://logserver.rdoproject.org/78/42978/1/check/periodic-tripleo-ci-centos-8-standalone-full-tempest-api-victoria/5aca676/logs/undercloud/var/log/containers/cinder/cinder-volume.log.txt.gz12:50
rlandysoniya logged something on victoria12:50
rlandywhich ysandeep|rover and I closed out earlier this week12:51
rlandyysandeep|rover: wrt kvm job - it's the traffic tempest failure again12:51
rlandysame one we saw earlier12:51
rlandyugh 12:51
rlandyboth are back12:51
rlandyand it's in rdo and internal runs12:52
jm1rlandy: this one? https://bugs.launchpad.net/tripleo/+bug/197146512:52
ysandeep|roverrlandy, ack will check... trying to see debug perf issue on vexx to see if I can get some clue from iostat/dstat12:53
ysandeep|rovertrying to debug*12:53
rlandyjm1: we clpse out a victoria specific one12:53
rlandysonya is not here otherwise would ask her to point to it12:54
chandankumarmarios: sure sure, I am at home now :-)12:54
rlandysorry - just tracking down octavia bug12:54
chandankumarwill text the picture tomorrow12:54
rlandyhttps://trello.com/c/TP9yQsFM/2513-cixlp1973223tripleociproa-master-sc010-kvm-job-is-failing-on-octavia-related-tempest-test-octaviatempestplugintestsscenariov2tes12:54
rlandyreopened https://bugs.launchpad.net/tripleo/+bug/197322313:00
rlandybhagyashris: hi - are you out?13:01
rlandyakahat: scrum13:02
chandankumarrlandy: akahat is on PTO today13:02
mariosfrenzy_friday: one wallaby two wallabies? ;) 13:05
marios(you said 'the wallabies' at some point)13:06
frenzy_fridayyeah :D both c8 c9 push jobs are now running in the integration line, the tripleoci and quickstart patches are pending for both13:06
frenzy_fridaywallaby wallabo ? XD13:07
marios:)13:07
mariosdasm|off: see https://github.com/openstack/openstack-virtual-baremetal/compare/stable/2.0...master 13:15
mariosrlandy: ^ 13:15
dasm|offmarios: thanks13:21
*** dasm|off is now known as dasm13:21
dasmo/13:21
dviroel1. https://review.rdoproject.org/r/c/rdo-jobs/+/4293113:22
dviroel2. https://review.rdoproject.org/r/c/rdo-jobs/+/4294413:22
dviroel3. https://review.rdoproject.org/r/c/config/+/4294513:22
ysandeep|roverchandankumar, fyi.. this was the bug: https://bugs.launchpad.net/tripleo/+bug/1974134 , hit security component as well because of delorean-current 13:55
chandankumarysandeep|rover: thanks, will take a look13:57
jm1ysandeep|rover: can you run them on downstream ci hardware as well? https://review.rdoproject.org/r/c/testproject/+/4297814:17
ysandeep|roverchandankumar, rlandy didn't merged yet https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/40983414:19
mariosysandeep|rover: frenzy_friday: 14:29
marioshttps://codesearch.opendev.org/?q=dstat&repos=openstack/tripleo-ansible,openstack/tripleo-ci,openstack/tripleo-common,openstack/tripleo-common-tempest-plugin,openstack/tripleo-docs,openstack/tripleo-ha-utils,openstack/tripleo-heat-templates,openstack/tripleo-image-elements,openstack/tripleo-ipsec,openstack/tripleo-operator-ansible,openstack/tripleo-puppet-elements,openstack/tripleo-quickstart,openstack/triple14:29
marioso-quickstart-extras,openstack/tripleo-repos,openstack/tripleo-specs,openstack/tripleo-upgrade,openstack/tripleo-validations,openstack/python-tripleoclient,openstack/puppet-tripleo 14:29
marioshttps://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/playbooks/multinode-validate.yml 14:29
ysandeep|roverfrenzy_friday, https://review.rdoproject.org/r/c/config/+/42360/1/playbooks/scenario010-kvm-trigger.yaml 14:35
ysandeep|roverfrenzy_friday, https://review.rdoproject.org/r/c/rdo-jobs/+/42331/4/zuul.d/integration-jobs-cs9-master.yaml fyi.. an example14:37
frenzy_fridayysandeep|rover, thanks, checking in a bit14:38
ysandeep|roverfrenzy_friday, i think something like this will work: http://pastebin.test.redhat.com/1053013 14:38
frenzy_fridayhey folks, need some help with https://review.opendev.org/c/openstack/tripleo-ci/+/842551/1/toci-quickstart/config/testenv/multinode-psi.yml#52 - there is most definitely a better way to do this but I could not figure out how14:50
chandankumarfrenzy_friday: in downstream we have jobs running on centos starting from train14:51
chandankumarfor this one {%- if release in ["master", "wallaby"] or (release in ["train"] and ansible_distribution | lower in ["centos"] and ansible_distribution_major_version == "8")  -%}14:52
chandankumarif release not in ['train', 'victoria']14:53
chandankumarlet me rethink the condition14:54
jm1ysandeep|rover, frenzy_friday, rlandy: rekicked victoria jobs again because two have passed, 3 have failed again. 14:55
rlandyjm1: thanks14:57
chandankumarfrenzy_friday: {%- if (release not in ["victoria"] and ansible_distribution|lower in ['centos']) -%} something like this14:58
frenzy_fridaychandankumar, but train c7 also runs right? 14:59
chandankumarwe need to use RDO quay on centos distro and on master, wallaby and train14:59
chandankumarfrenzy_friday: train c7 is gone now I think14:59
frenzy_fridaychandankumar, also this is on upstream right? https://review.opendev.org/c/openstack/tripleo-ci/+/839323/7/toci-quickstart/config/testenv/multinode-rdocloud.yml#53 In upstream we still have train c7 15:01
chandankumarfrenzy_friday: https://github.com/rdo-infra/review.rdoproject.org-config/commit/c739ae59f5fc051cd6b65e69ab24c24c0fa749a615:01
jm1frenzy_friday: in case victoria integration line has still not promoted on monday, you might want to rekick this https://review.rdoproject.org/r/c/testproject/+/4297815:02
frenzy_fridayoooh, nice. Then I'll only check for not victoria and is centos15:02
chandankumaryup15:02
jm1frenzy_friday: testproject and my investigation into those failing jobs is in rr notes for this week15:02
ysandeep|roverrlandy, can I merge them https://code.engineering.redhat.com/gerrit/q/topic:rhel-9-ga on Monday morning?15:07
rlandyysandeep|rover: I am testing them first today15:07
ysandeep|roverack15:07
rlandyif they are ok - then I will remove my w-115:07
rlandyand you can merge in your morning15:08
rlandyysandeep|rover: ^^ if my w-1 is removed, then they are tested15:08
ysandeep|roverthanks! will check on my Monday morning15:08
chandankumarrlandy: frenzy_friday please leave notes anything I can take care in the morning15:09
rlandychandankumar: will probably leave you the trigger stuff to merge15:11
rlandywill start that this afternoon if frenzy_friday has not done it15:11
chandankumarrlandy: ok 15:11
rlandyfrenzy_friday: pls ping when you are EoD ... I am on meeting until 5pm UTC15:13
frenzy_fridayrlandy, yep sure. I am finishing up the quay patch first15:13
*** dviroel is now known as dviroel|lunch15:26
ysandeep|roverhappy recharge day everyone, see you next week o/15:29
*** ysandeep|rover is now known as ysandeep|out15:29
chandankumarsee ya!15:35
jm1ysandeep|out: have a nice weekend :)15:39
frenzy_fridayhey rlandy, should I create a new playbook like https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/playbooks/scenario010-kvm-trigger.yaml for fs001 and 035 ? Or can i change the name of this playbook to a generic one and change the syntax of file created to have a filed call jobs_name?15:48
rlandyshould be able to use the same playbooks15:49
frenzy_fridayack15:49
rlandyif generic is possible, that is better than dupliactes15:50
rlandycan look more after meetings15:50
frenzy_fridayrlandy, when you get some time pl lemme know how https://review.rdoproject.org/r/c/rdo-jobs/+/42986 looks. meanwhile working to the rest of the trigger patches16:07
*** marios is now known as marios|out16:14
* jm1 out for today16:17
jm1team, have a nice recharge day and enjoy your looong weekend ^^16:17
*** dviroel|lunch is now known as dviroel16:25
*** jpena is now known as jpena|off16:31
frenzy_fridayhttps://review.rdoproject.org/r/c/rdo-jobs/+/42986, https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-config/+/41076916:37
* frenzy_friday tea break16:44
rlandyperiodic-tripleo-ci-centos-9-scenario010-kvm-internal-standalone-mastertripleo-downstream-trigger-nested-virtmastercheck-rdo42970,116:45
rlandy1 hr 21 mins 57 secs2022-05-19 15:07:31SUCCESS16:45
rlandyworked now16:45
rlandyhttps://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?job_name=periodic-tripleo-ci-centos-9-scenario010-kvm-internal-standalone-master&skip=016:45
rlandypassing again16:45
dviroelhttps://openinfra.dev/ptg/16:55
dviroelOctober 17-20, 202216:55
dviroelColumbus, Ohio16:55
dviroelin-person PTG :)16:55
frenzy_fridayrlandy, hey, I will be eod in ~30 mins16:56
rlandysorry - should be off call soon16:56
frenzy_fridayadded 2 patches for the trigger jobs: https://review.rdoproject.org/r/c/rdo-jobs/+/42986, https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-config/+/41076916:56
rlandyfrenzy_friday: ok - I'll work from those16:57
rlandyfrenzy_friday: thanks for starting that 16:57
dasmdviroel: /victory17:18
dasm\( ゚ヮ゚)/17:18
rlandychandankumar: hey - you still around?18:56
rlandyhttps://code.engineering.redhat.com/gerrit/gitweb?p=openstack/tripleo-ci-internal-jobs.git18:56
rlandylooks to be merged - https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/409834 - not in the repo18:57
rlandydviroel: rcastillo: do you want to join review time?19:02
dviroelsure19:02
dasmhttps://review.opendev.org/c/openstack/openstack-virtual-baremetal/+/842441/1/bin/install_openstackbmc.sh19:03
dasmhttps://review.rdoproject.org/r/c/testproject/+/4088119:04
dasmhttps://opendev.org/openstack/openstack-virtual-baremetal/src/branch/master/templates/bmc.yaml#L16119:07
dasmhttps://review.opendev.org/c/openstack/tripleo-quickstart/+/84253119:23
dasmhttps://review.rdoproject.org/r/c/rdo-infra/ci-config/+/4266819:25
dasmhttps://opendev.org/openstack/tripleo-ci/src/branch/master/zuul.d/multinode-jobs.yaml#L9119:31
dasmhttps://review.opendev.org/c/openstack/tripleo-quickstart/+/84235419:38
dasmhttps://review.rdoproject.org/r/c/rdo-jobs/+/4253819:39
dasmhttps://review.rdoproject.org/r/c/rdo-jobs/+/4253919:39
dasmhttps://review.rdoproject.org/r/c/rdo-jobs/+/4295119:40
dviroeldasm: W+1 the revert ones19:53
dasmthx20:09
dasmdviroel: if you could, there is one more: https://review.rdoproject.org/r/c/rdo-jobs/+/4254020:16
dviroeldasm: sone20:17
dviroeldone20:17
dasmthx20:17
dasm\( ゚ヮ゚)/20:17
dasmstep by step and we're out of woods with uefi :)20:18
dviroeloh - testproject frankenstein just worked20:42
* dviroel time to recharge - have a great friday and weekend team o/20:44
*** dviroel is now known as dviroel|out20:45
dasmo/ dviroel|out 20:54
* dasm disappears in thin air.21:25
dasmsee you! have fun over the weekend21:25
*** dasm is now known as dasm|off21:26
rcastilloleaving as well21:28
rcastilloenjoy your weekend21:28
rlandyhappy recharge22:11

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!