*** rlandy|bbl is now known as rlandy|out | 00:45 | |
*** ykarel_ is now known as ykarel | 04:51 | |
*** ysandeep|out is now known as ysandeep|rover | 04:52 | |
*** pojadhav|afk is now known as pojadhav | 05:10 | |
ysandeep|rover | reviewbot please add in review list: https://review.opendev.org/c/openstack/tripleo-ci/+/842356 | 05:31 |
---|---|---|
ysandeep|rover | frenzy_friday: where is our reviewbot ? :D | 05:32 |
*** ysandeep|rover is now known as ysandeep|rover|brb | 05:51 | |
*** ysandeep|rover|brb is now known as ysandeep|rover | 05:56 | |
pojadhav | ysandeep|rover, thanks for rechecking my patch :) I was looking the same. | 06:00 |
ysandeep|rover | :) my pleasure, Its my duty as ruck/rover to clear patches blocked in gate | 06:02 |
marios | o/ morning tripleo-ci :) | 06:03 |
ysandeep|rover | hey marios good morning o/ | 06:03 |
*** jm1|ruck is now known as jm1|rover | 07:14 | |
ysandeep|rover | marios, chandankumar we are not really isolating our component because of delorean-current repo, as soon as some issues merges via tripleo repos - it affect everything - all component and integration line. | 07:25 |
ysandeep|rover | I am thinking should we really keep delorean-current in component line | 07:26 |
marios | ysandeep|rover: interesting thought. it kind of brings into question the value of the tripleo component (actually what is it testing in that case - or do we do something special for delorean-current there?). worth some thought and discussion though | 07:28 |
ysandeep|rover | I can bring the discussion in today's scrum call | 07:28 |
ysandeep|rover | we are not disabling delorean-current even in tripleo component: https://logserver.rdoproject.org/openstack-component-tripleo/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-tripleo-master/da3e7d7/logs/undercloud/etc/yum.repos.d/ | 07:30 |
marios | ysandeep|rover: well the component repo has higher priority there maybe thats why? | 07:36 |
*** jpena|off is now known as jpena | 07:36 | |
ysandeep|rover | yeah for tripleo component I think that's okay if it have higher priority but for other components for ex. security - delorean-current (tripleo repos latest patches) can still slips in. | 07:40 |
jm1 | arxcruz, frenzy_friday, rcastillo: updated our miro board for next monday :) added some extra questions to lead us through the meeting https://miro.com/app/board/uXjVO0ysP2Y=/ | 08:10 |
jm1 | ysandeep|rover: looks like the unpinning of wallaby did not work | 08:12 |
jm1 | ysandeep|rover: apparently it did work for the osp17 bug on cix, but it did not fix our lp bugs #1960310 and #1960661 | 08:26 |
ysandeep|rover | jm1: ack, bit occupied with master bug atm but please left notes on cix/bug with details. | 08:27 |
jm1 | ysandeep|rover: sure | 08:28 |
jpodivin | jm1: hi, we talked about the CI couple of days ago. I have to say you have been a great help. But I'm having bit of a trouble with the DLRN builds | 08:41 |
jpodivin | the overrides for branches don't seem to propagate into the role building packages. Is there a trick to do that? | 08:42 |
jm1 | jpodivin: which role building packages? | 08:49 |
jpodivin | build-test-packages in ooq-extras | 08:50 |
jpodivin | At one point it performs a series of substitutions in the ini file to get right distgit repo from RDO | 08:51 |
jpodivin | And that's where things go wrong because it looks for 1.6-rdo branch, which isn't there. | 08:51 |
jpodivin | so it grabs master-rpm and that leads to build error as some packages aren't available with the right version | 08:52 |
jpodivin | https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/build-test-packages/tasks/dlrn-build.yml#L43 | 08:53 |
jm1 | jpodivin: no idea, never used that role | 08:55 |
jpodivin | jm1: np. I'm testing couple of approaches right now. I just didn't want to reinvent the wheel . | 08:57 |
jpodivin | ykarel: hi, could you give +w to the https://review.rdoproject.org/r/c/rdoinfo/+/41638 ? It's got the votes I believe and matbu resolved the issues. | 09:06 |
ykarel | jpodivin, looking | 09:07 |
jpodivin | ykarel: thanks | 09:07 |
ykarel | Done | 09:07 |
jpodivin | ykarel: thank you very much | 09:07 |
*** ysandeep|rover is now known as ysandeep|rover|lunch | 09:31 | |
*** ysandeep|rover|lunch is now known as ysandeep|rover | 10:09 | |
*** rlandy|out is now known as rlandy | 10:27 | |
rlandy | ysandeep|rover: jm1|rover: hello - time to sync? | 10:29 |
* ysandeep|rover fetching headphones | 10:30 | |
rlandy | https://meet.google.com/mgx-zqtu-nkx?pli=1&authuser=0 | 10:31 |
ysandeep|rover | rlandy, https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/42977 | 10:49 |
jm1 | rlandy: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/842218 | 11:02 |
*** dviroel|out is now known as dviroel | 11:26 | |
*** rlandy is now known as rlandy|mtg | 11:26 | |
chandankumar | rlandy|mtg: alternative registry meeting in another 2 mins | 11:28 |
rlandy|mtg | ack | 11:28 |
chandankumar | rlandy|mtg: waiting for you | 11:31 |
*** ysandeep|rover is now known as ysandeep|rover|afk | 11:33 | |
* jm1 lunch | 11:46 | |
rlandy|mtg | ysandeep|rover|afk: leaving notes in hackmd - on reproducible master failure is scenario010-kvm | 11:57 |
rlandy|mtg | rest passed on this run | 11:57 |
*** rlandy|mtg is now known as rlandy | 12:02 | |
rlandy | chandankumar++ nicely done | 12:02 |
arxcruz | rlandy bhagyashris i have to attend a fathers meeting at my daughter school, not sure if i'll be able to join scrum meeting | 12:19 |
rlandy | arxcruz: k - pls update your cards before monday's meeting - thanks | 12:23 |
*** ysandeep|rover|afk is now known as ysandeep|rover | 12:26 | |
chandankumar | anyone around tomorrow here? | 12:39 |
rlandy | chandankumar: ack - dasm|off wants to work tomorrow and switch out day | 12:40 |
rlandy | he will watch queues - if you need something | 12:41 |
chandankumar | ok cool, nothing needed | 12:41 |
chandankumar | I will go over the CI in the morning | 12:42 |
marios | chandankumar: i'll be around on a slow day so will help keep an eye too | 12:45 |
chandankumar | cool, I got company :-) | 12:45 |
marios | you bring breakfast i'll bring coffee & tea ;) | 12:46 |
jm1 | rlandy, ysandeep|rover: we had this mysql error on several ci jobs before, is there any lp bug for that? | 12:46 |
rlandy | jm1: diff from https://trello.com/c/jYWgTdwE/2491-cixlp1971465tripleociproa-fs001-and-fs035-ovb-jobs-failing-tempest-identity-haproxy-connection-errors? | 12:47 |
rlandy | we had a victoris bug ... getting | 12:47 |
ysandeep|rover | jm1: so far that is randomly failing and I pinged luca(#rhos-pidone) about that - he says its due to slow node | 12:48 |
jm1 | rlandy, ysandeep|rover: ack, thx. looks like victoria jobs keep failing because of these sql issues https://logserver.rdoproject.org/78/42978/1/check/periodic-tripleo-ci-centos-8-standalone-full-tempest-api-victoria/5aca676/logs/undercloud/var/log/containers/cinder/cinder-volume.log.txt.gz | 12:50 |
rlandy | soniya logged something on victoria | 12:50 |
rlandy | which ysandeep|rover and I closed out earlier this week | 12:51 |
rlandy | ysandeep|rover: wrt kvm job - it's the traffic tempest failure again | 12:51 |
rlandy | same one we saw earlier | 12:51 |
rlandy | ugh | 12:51 |
rlandy | both are back | 12:51 |
rlandy | and it's in rdo and internal runs | 12:52 |
jm1 | rlandy: this one? https://bugs.launchpad.net/tripleo/+bug/1971465 | 12:52 |
ysandeep|rover | rlandy, ack will check... trying to see debug perf issue on vexx to see if I can get some clue from iostat/dstat | 12:53 |
ysandeep|rover | trying to debug* | 12:53 |
rlandy | jm1: we clpse out a victoria specific one | 12:53 |
rlandy | sonya is not here otherwise would ask her to point to it | 12:54 |
chandankumar | marios: sure sure, I am at home now :-) | 12:54 |
rlandy | sorry - just tracking down octavia bug | 12:54 |
chandankumar | will text the picture tomorrow | 12:54 |
rlandy | https://trello.com/c/TP9yQsFM/2513-cixlp1973223tripleociproa-master-sc010-kvm-job-is-failing-on-octavia-related-tempest-test-octaviatempestplugintestsscenariov2tes | 12:54 |
rlandy | reopened https://bugs.launchpad.net/tripleo/+bug/1973223 | 13:00 |
rlandy | bhagyashris: hi - are you out? | 13:01 |
rlandy | akahat: scrum | 13:02 |
chandankumar | rlandy: akahat is on PTO today | 13:02 |
marios | frenzy_friday: one wallaby two wallabies? ;) | 13:05 |
marios | (you said 'the wallabies' at some point) | 13:06 |
frenzy_friday | yeah :D both c8 c9 push jobs are now running in the integration line, the tripleoci and quickstart patches are pending for both | 13:06 |
frenzy_friday | wallaby wallabo ? XD | 13:07 |
marios | :) | 13:07 |
marios | dasm|off: see https://github.com/openstack/openstack-virtual-baremetal/compare/stable/2.0...master | 13:15 |
marios | rlandy: ^ | 13:15 |
dasm|off | marios: thanks | 13:21 |
*** dasm|off is now known as dasm | 13:21 | |
dasm | o/ | 13:21 |
dviroel | 1. https://review.rdoproject.org/r/c/rdo-jobs/+/42931 | 13:22 |
dviroel | 2. https://review.rdoproject.org/r/c/rdo-jobs/+/42944 | 13:22 |
dviroel | 3. https://review.rdoproject.org/r/c/config/+/42945 | 13:22 |
ysandeep|rover | chandankumar, fyi.. this was the bug: https://bugs.launchpad.net/tripleo/+bug/1974134 , hit security component as well because of delorean-current | 13:55 |
chandankumar | ysandeep|rover: thanks, will take a look | 13:57 |
jm1 | ysandeep|rover: can you run them on downstream ci hardware as well? https://review.rdoproject.org/r/c/testproject/+/42978 | 14:17 |
ysandeep|rover | chandankumar, rlandy didn't merged yet https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/409834 | 14:19 |
marios | ysandeep|rover: frenzy_friday: | 14:29 |
marios | https://codesearch.opendev.org/?q=dstat&repos=openstack/tripleo-ansible,openstack/tripleo-ci,openstack/tripleo-common,openstack/tripleo-common-tempest-plugin,openstack/tripleo-docs,openstack/tripleo-ha-utils,openstack/tripleo-heat-templates,openstack/tripleo-image-elements,openstack/tripleo-ipsec,openstack/tripleo-operator-ansible,openstack/tripleo-puppet-elements,openstack/tripleo-quickstart,openstack/triple | 14:29 |
marios | o-quickstart-extras,openstack/tripleo-repos,openstack/tripleo-specs,openstack/tripleo-upgrade,openstack/tripleo-validations,openstack/python-tripleoclient,openstack/puppet-tripleo | 14:29 |
marios | https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/playbooks/multinode-validate.yml | 14:29 |
ysandeep|rover | frenzy_friday, https://review.rdoproject.org/r/c/config/+/42360/1/playbooks/scenario010-kvm-trigger.yaml | 14:35 |
ysandeep|rover | frenzy_friday, https://review.rdoproject.org/r/c/rdo-jobs/+/42331/4/zuul.d/integration-jobs-cs9-master.yaml fyi.. an example | 14:37 |
frenzy_friday | ysandeep|rover, thanks, checking in a bit | 14:38 |
ysandeep|rover | frenzy_friday, i think something like this will work: http://pastebin.test.redhat.com/1053013 | 14:38 |
frenzy_friday | hey folks, need some help with https://review.opendev.org/c/openstack/tripleo-ci/+/842551/1/toci-quickstart/config/testenv/multinode-psi.yml#52 - there is most definitely a better way to do this but I could not figure out how | 14:50 |
chandankumar | frenzy_friday: in downstream we have jobs running on centos starting from train | 14:51 |
chandankumar | for this one {%- if release in ["master", "wallaby"] or (release in ["train"] and ansible_distribution | lower in ["centos"] and ansible_distribution_major_version == "8") -%} | 14:52 |
chandankumar | if release not in ['train', 'victoria'] | 14:53 |
chandankumar | let me rethink the condition | 14:54 |
jm1 | ysandeep|rover, frenzy_friday, rlandy: rekicked victoria jobs again because two have passed, 3 have failed again. | 14:55 |
rlandy | jm1: thanks | 14:57 |
chandankumar | frenzy_friday: {%- if (release not in ["victoria"] and ansible_distribution|lower in ['centos']) -%} something like this | 14:58 |
frenzy_friday | chandankumar, but train c7 also runs right? | 14:59 |
chandankumar | we need to use RDO quay on centos distro and on master, wallaby and train | 14:59 |
chandankumar | frenzy_friday: train c7 is gone now I think | 14:59 |
frenzy_friday | chandankumar, also this is on upstream right? https://review.opendev.org/c/openstack/tripleo-ci/+/839323/7/toci-quickstart/config/testenv/multinode-rdocloud.yml#53 In upstream we still have train c7 | 15:01 |
chandankumar | frenzy_friday: https://github.com/rdo-infra/review.rdoproject.org-config/commit/c739ae59f5fc051cd6b65e69ab24c24c0fa749a6 | 15:01 |
jm1 | frenzy_friday: in case victoria integration line has still not promoted on monday, you might want to rekick this https://review.rdoproject.org/r/c/testproject/+/42978 | 15:02 |
frenzy_friday | oooh, nice. Then I'll only check for not victoria and is centos | 15:02 |
chandankumar | yup | 15:02 |
jm1 | frenzy_friday: testproject and my investigation into those failing jobs is in rr notes for this week | 15:02 |
ysandeep|rover | rlandy, can I merge them https://code.engineering.redhat.com/gerrit/q/topic:rhel-9-ga on Monday morning? | 15:07 |
rlandy | ysandeep|rover: I am testing them first today | 15:07 |
ysandeep|rover | ack | 15:07 |
rlandy | if they are ok - then I will remove my w-1 | 15:07 |
rlandy | and you can merge in your morning | 15:08 |
rlandy | ysandeep|rover: ^^ if my w-1 is removed, then they are tested | 15:08 |
ysandeep|rover | thanks! will check on my Monday morning | 15:08 |
chandankumar | rlandy: frenzy_friday please leave notes anything I can take care in the morning | 15:09 |
rlandy | chandankumar: will probably leave you the trigger stuff to merge | 15:11 |
rlandy | will start that this afternoon if frenzy_friday has not done it | 15:11 |
chandankumar | rlandy: ok | 15:11 |
rlandy | frenzy_friday: pls ping when you are EoD ... I am on meeting until 5pm UTC | 15:13 |
frenzy_friday | rlandy, yep sure. I am finishing up the quay patch first | 15:13 |
*** dviroel is now known as dviroel|lunch | 15:26 | |
ysandeep|rover | happy recharge day everyone, see you next week o/ | 15:29 |
*** ysandeep|rover is now known as ysandeep|out | 15:29 | |
chandankumar | see ya! | 15:35 |
jm1 | ysandeep|out: have a nice weekend :) | 15:39 |
frenzy_friday | hey rlandy, should I create a new playbook like https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/playbooks/scenario010-kvm-trigger.yaml for fs001 and 035 ? Or can i change the name of this playbook to a generic one and change the syntax of file created to have a filed call jobs_name? | 15:48 |
rlandy | should be able to use the same playbooks | 15:49 |
frenzy_friday | ack | 15:49 |
rlandy | if generic is possible, that is better than dupliactes | 15:50 |
rlandy | can look more after meetings | 15:50 |
frenzy_friday | rlandy, when you get some time pl lemme know how https://review.rdoproject.org/r/c/rdo-jobs/+/42986 looks. meanwhile working to the rest of the trigger patches | 16:07 |
*** marios is now known as marios|out | 16:14 | |
* jm1 out for today | 16:17 | |
jm1 | team, have a nice recharge day and enjoy your looong weekend ^^ | 16:17 |
*** dviroel|lunch is now known as dviroel | 16:25 | |
*** jpena is now known as jpena|off | 16:31 | |
frenzy_friday | https://review.rdoproject.org/r/c/rdo-jobs/+/42986, https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-config/+/410769 | 16:37 |
* frenzy_friday tea break | 16:44 | |
rlandy | periodic-tripleo-ci-centos-9-scenario010-kvm-internal-standalone-mastertripleo-downstream-trigger-nested-virtmastercheck-rdo42970,1 | 16:45 |
rlandy | 1 hr 21 mins 57 secs2022-05-19 15:07:31SUCCESS | 16:45 |
rlandy | worked now | 16:45 |
rlandy | https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?job_name=periodic-tripleo-ci-centos-9-scenario010-kvm-internal-standalone-master&skip=0 | 16:45 |
rlandy | passing again | 16:45 |
dviroel | https://openinfra.dev/ptg/ | 16:55 |
dviroel | October 17-20, 2022 | 16:55 |
dviroel | Columbus, Ohio | 16:55 |
dviroel | in-person PTG :) | 16:55 |
frenzy_friday | rlandy, hey, I will be eod in ~30 mins | 16:56 |
rlandy | sorry - should be off call soon | 16:56 |
frenzy_friday | added 2 patches for the trigger jobs: https://review.rdoproject.org/r/c/rdo-jobs/+/42986, https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-config/+/410769 | 16:56 |
rlandy | frenzy_friday: ok - I'll work from those | 16:57 |
rlandy | frenzy_friday: thanks for starting that | 16:57 |
dasm | dviroel: /victory | 17:18 |
dasm | \( ゚ヮ゚)/ | 17:18 |
rlandy | chandankumar: hey - you still around? | 18:56 |
rlandy | https://code.engineering.redhat.com/gerrit/gitweb?p=openstack/tripleo-ci-internal-jobs.git | 18:56 |
rlandy | looks to be merged - https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/409834 - not in the repo | 18:57 |
rlandy | dviroel: rcastillo: do you want to join review time? | 19:02 |
dviroel | sure | 19:02 |
dasm | https://review.opendev.org/c/openstack/openstack-virtual-baremetal/+/842441/1/bin/install_openstackbmc.sh | 19:03 |
dasm | https://review.rdoproject.org/r/c/testproject/+/40881 | 19:04 |
dasm | https://opendev.org/openstack/openstack-virtual-baremetal/src/branch/master/templates/bmc.yaml#L161 | 19:07 |
dasm | https://review.opendev.org/c/openstack/tripleo-quickstart/+/842531 | 19:23 |
dasm | https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/42668 | 19:25 |
dasm | https://opendev.org/openstack/tripleo-ci/src/branch/master/zuul.d/multinode-jobs.yaml#L91 | 19:31 |
dasm | https://review.opendev.org/c/openstack/tripleo-quickstart/+/842354 | 19:38 |
dasm | https://review.rdoproject.org/r/c/rdo-jobs/+/42538 | 19:39 |
dasm | https://review.rdoproject.org/r/c/rdo-jobs/+/42539 | 19:39 |
dasm | https://review.rdoproject.org/r/c/rdo-jobs/+/42951 | 19:40 |
dviroel | dasm: W+1 the revert ones | 19:53 |
dasm | thx | 20:09 |
dasm | dviroel: if you could, there is one more: https://review.rdoproject.org/r/c/rdo-jobs/+/42540 | 20:16 |
dviroel | dasm: sone | 20:17 |
dviroel | done | 20:17 |
dasm | thx | 20:17 |
dasm | \( ゚ヮ゚)/ | 20:17 |
dasm | step by step and we're out of woods with uefi :) | 20:18 |
dviroel | oh - testproject frankenstein just worked | 20:42 |
* dviroel time to recharge - have a great friday and weekend team o/ | 20:44 | |
*** dviroel is now known as dviroel|out | 20:45 | |
dasm | o/ dviroel|out | 20:54 |
* dasm disappears in thin air. | 21:25 | |
dasm | see you! have fun over the weekend | 21:25 |
*** dasm is now known as dasm|off | 21:26 | |
rcastillo | leaving as well | 21:28 |
rcastillo | enjoy your weekend | 21:28 |
rlandy | happy recharge | 22:11 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!