*** ysandeep|out is now known as ysandeep | 06:30 | |
*** ysandeep is now known as ysandeep|lunch | 08:29 | |
marios | morning akahat|rover soniya29|ruck do we have any updates on https://bugs.launchpad.net/tripleo/+bug/1950916 ? cc jbadiapa | 08:48 |
---|---|---|
marios | jbadiapa: you can help to review that https://review.opendev.org/c/openstack/tripleo-quickstart/+/818043 :) | 08:49 |
marios | jbadiapa: ah looks like ykarel is still testing so hold on that for now i guess | 08:50 |
marios | jbadiapa: i expect if we don't find a resolution by this afternoon we will consider skipping those tests to unblock | 08:50 |
marios | ykarel: so you think it is to do with some conflicting versions of those packages ? coming from different repos? | 08:55 |
ykarel | marios, i just think it's those newver versions that caused the issue, the proposed fix is just workaround to clear gates until actual fix available | 08:56 |
ykarel | based on some of my local tests this should clear the ci | 08:57 |
ykarel | just waiting for ci result, but i believe it will pass | 08:57 |
marios | ykarel: ah right that makes sense - but can we maybe pin as a faster workaround? with your patch instead of appstreams where would they get it from base.repo>? | 08:57 |
marios | ykarel: and we should see the containers-multinode on that patch i mean if it passes there then we are good | 08:59 |
ykarel | marios, sorry pin where? | 08:59 |
marios | ykarel: rdo | 08:59 |
ykarel | marios, those are from base repos and we don't manage it in rdo | 09:00 |
ykarel | but advanced repo come from delorean-deps.repo there it could have been done but i avoided there as the issue only affecting tripleo jobs | 09:00 |
marios | ykarel: k - if you fix the linter (commented it doesn't like the *) we can see if multinode job passes on your patch | 09:02 |
ykarel | marios, i think those failure from previous ps | 09:03 |
marios | ykarel: ah k is it running now /me check zuul | 09:03 |
marios | great | 09:03 |
ykarel | also i see standalone passed | 09:03 |
ykarel | Playbook run of multinode-standalone.yml passed successfully | 09:03 |
marios | thanks ykarel what will we do when you leave us ! :/ | 09:03 |
ykarel | https://zuul.openstack.org/stream/87079c9c917d4a0892f6ed934615608a?logfile=console.log | 09:03 |
*** ykarel is now known as ykarel|lunch | 09:10 | |
*** ysandeep|lunch is now known as ysandeep | 09:44 | |
marios | ysandeep: can you vote there please https://review.opendev.org/c/openstack/tripleo-quickstart/+/818043/ | 10:13 |
marios | zuul will report in a bit and we can workflow it | 10:13 |
marios | akahat|rover: soniya29|ruck: ^^^ | 10:13 |
ysandeep | marios, yes its in my radar.. will vote once zuul reports | 10:14 |
marios | ack ysandeep fyi https://zuul.openstack.org/status#818043 waiting for the last provider to finish | 10:14 |
akahat|rover | marios, ysandeep voted. | 10:15 |
ysandeep | marios, we got +1 from zuul.. i have +wed it | 10:15 |
marios | ysandeep: thanks | 10:16 |
marios | thanks akahat|rover | 10:16 |
soniya29|ruck | marios, ack | 10:26 |
*** ykarel|lunch is now known as ykarel | 10:26 | |
soniya29|ruck | marios, voted | 10:27 |
akahat|rover | soniya29|ruck, o/ | 10:33 |
soniya29|ruck | akahat|rover, hello | 10:33 |
akahat|rover | soniya29|ruck, we got some tempest failures on train side, please open bug for it. https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-train | 10:34 |
soniya29|ruck | akahat|rover, okay | 10:34 |
*** rlandy is now known as rlandy|ruck | 10:52 | |
ysandeep | rlandy|ruck, workaround for upstream check is in gate https://review.opendev.org/c/openstack/tripleo-quickstart/+/818043 , thanks to ykarel | 10:54 |
rlandy|ruck | ykarel: thanks for following up on this | 10:54 |
rlandy|ruck | much appreciated!! | 10:54 |
ysandeep | rlandy|ruck, do you want to meet for few mins to sort downstream situation.. | 10:54 |
rlandy|ruck | ysandeep: need to talk to alan now - urgent | 10:55 |
rlandy|ruck | will ping you later | 10:55 |
ysandeep | ack | 10:55 |
ykarel | rlandy|ruck, just added more details for the issue wrt root cause https://bugs.launchpad.net/tripleo/+bug/1950916/comments/15 | 11:00 |
ykarel | would need someone from compute to check | 11:01 |
ysandeep | rlandy|ruck, In upstream as well we are pulling "Red Hat Universal Base Image 8" repos - so I think we can remove those from both upstream and downstream | 11:01 |
rlandy|ruck | ykarel: thanks - was dealing with compute yesterday | 11:01 |
rlandy|ruck | you can see their notes in the bug | 11:02 |
rlandy|ruck | they mentioned the libvirt version | 11:02 |
rlandy|ruck | will ping artom when he is in | 11:02 |
ykarel | ok | 11:02 |
ysandeep | upstream logs: https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-build-containers-ubi-8-push/502c58b/logs/container-builds/c42ec6d0-bbe9-4896-83f7-660c2e093b6a/base/rsyslog/rsyslog-build.log | 11:03 |
rlandy|ruck | ysandeep: hold on - pls | 11:03 |
rlandy|ruck | will be with you in a few | 11:03 |
ysandeep | sure, thanks! | 11:04 |
*** ysandeep is now known as ysandeep|brb | 11:07 | |
soniya29|ruck | akahat|rover, rlandy|ruck https://bugs.launchpad.net/tripleo/+bug/1951092 | 11:07 |
rlandy|ruck | soniya29|ruck: k - wil chat in a bit - pls more details into that bug | 11:10 |
rlandy|ruck | and make the title more specific | 11:11 |
rlandy|ruck | is this something you want to raise as a CIX? | 11:11 |
rlandy|ruck | sshnaidm: hi - you around? | 11:11 |
*** ysandeep|brb is now known as ysandeep | 11:13 | |
rlandy|ruck | soniya29|ruck: akahat|rover: rdo zuul is stuck | 11:15 |
rlandy|ruck | for 11 hrs | 11:15 |
rlandy|ruck | ykarel just reported it | 11:15 |
ykarel | rlandy|ruck, newer jobs/patches working fine | 11:15 |
rlandy|ruck | yeah - integration line is stuck | 11:15 |
akahat|rover | rlandy|ruck, checking | 11:15 |
rlandy|ruck | ykarel: wow - thank you for digging us out of everything this morning | 11:16 |
dviroel | o/ | 11:20 |
sshnaidm | hi, yep | 11:23 |
marios | o/ dviroel ping me when you've had some coffee so we can catchup on the stream9 & picking up chkumar work (been digging at the s/compose -> stream mirrors work today ) | 11:24 |
* marios fetches coffee | 11:24 | |
rlandy|ruck | ssh | 11:25 |
rlandy|ruck | sshnaidm: https://meet.google.com/kaj-wqnx-pyd?pli=1&authuser=0 | 11:25 |
ysandeep | #folks we have community call today(~2 hours later), If you have topics please add under agenda: https://hackmd.io/MMg4WDbYSqOQUhU2Kj8zNg?both#2021-11-16-Community-Call | 11:25 |
*** amoralej|off is now known as amoralej | 11:28 | |
dviroel | marios: ready when you are | 11:29 |
marios | dviroel: o/ starting meet | 11:34 |
marios | dviroel: https://meet.google.com/vvq-nbhn-srt?authuser=0 | 11:35 |
marios | dviroel: https://review.opendev.org/c/openstack/tripleo-ci/+/817341 | 11:42 |
rlandy|ruck | sshnaidm: adding you to conversation on rhos-ops | 11:44 |
sshnaidm | rlandy|ruck, ack | 11:44 |
amoralej | hi, a oooq job is failing consistently in https://review.opendev.org/c/openstack/puppet-nova/+/817952/ | 11:46 |
amoralej | it fails in tempest run https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_162/817952/3/check/puppet-nova-tripleo-standalone/1625020/logs/undercloud/var/log/tempest/stestr_results.html | 11:46 |
amoralej | i'd say that an instance is created but os is not booting | 11:47 |
amoralej | maybe an issue with image or something like that | 11:47 |
amoralej | may i get some help to troubleshoot it? | 11:47 |
amoralej | it's change required for CS9 | 11:47 |
marios | amoralej: looks like it may be same as https://bugs.launchpad.net/tripleo/+bug/1950916 ? cc akahat|rover soniya29|ruck ^^^ | 11:49 |
amoralej | yes, look similar.. | 11:50 |
akahat|rover | amoralej, ykarel posted fix https://review.opendev.org/c/openstack/tripleo-quickstart/+/818043 waiting to merge. | 11:51 |
amoralej | mmm | 11:51 |
amoralej | so qemu-kvm is newer in virt:rhel that in advanced-virt | 11:53 |
soniya29|ruck | rlandy|ruck, akahat|rover: stepping out for half hr. Need to meet doctor :) | 11:54 |
*** soniya29|ruck is now known as soniya29|ruck|afk | 11:54 | |
amoralej | also libvirt | 11:54 |
ykarel | amoralej, yes both are newver in virt module | 11:55 |
rlandy|ruck | amoralej: pls leave comments in the bug if needed | 11:55 |
amoralej | ykarel, you checked if we have same versions everywhere? | 11:55 |
amoralej | i mean in all containers | 11:55 |
amoralej | the problem are the new packages or some mix between old and new? | 11:56 |
ykarel | amoralej, not checked all but only some | 11:56 |
ykarel | but considering how those are created all should have same versions | 11:56 |
amoralej | ykarel, iiuc those images passed promotion | 11:56 |
amoralej | so worked with newer version? | 11:57 |
ykarel | amoralej, issue happening with q35 machine types which is being set in tripleo jobs with newer qemu-kvm packages | 11:57 |
arxcruz | marios: i need your insight here https://review.rdoproject.org/r/c/testproject/+/36715 | 11:57 |
amoralej | or are we updating the containers? | 11:57 |
arxcruz | marios: it's not getting the tripleo-ci change | 11:57 |
ykarel | amoralej, actually those containers are built, promotion ones are not used | 11:57 |
rlandy|ruck | ysandeep: ok - let's chat - also about https://review.opendev.org/c/openstack/tripleo-quickstart/+/818010 | 11:57 |
amoralej | ok, so this is blocking promotion | 11:57 |
amoralej | right? | 11:57 |
ykarel | amoralej, content-provider is used in upstream ci, ovb jobs are using the promoted ones | 11:57 |
rlandy|ruck | yes - blocking everything | 11:57 |
amoralej | but also check? | 11:58 |
ykarel | amoralej, yeap blocking everything | 11:58 |
marios | arxcruz: is it not because of that? https://review.rdoproject.org/r/c/testproject/+/36715/2#message-35a3ff74454ec12cd931e197ab3708987d3c37c4 | 11:58 |
amoralej | those containers are updated/created on every job? | 11:58 |
ykarel | amoralej, yes for each patch containers are created in content-provider jobs and all other child jobs uses those containers | 11:58 |
rlandy|ruck | there are some jobs run w/o content provider | 11:59 |
rlandy|ruck | in rdo we don't use content provider | 11:59 |
ysandeep | rlandy|ruck, so same redhat ubi repos exists in upstream as well, but just because centos-stream repo have rpm content > ubi repos we don't face any issue. | 11:59 |
rlandy|ruck | and you can kick jobs that will run with pulled containers | 11:59 |
ysandeep | rlandy|ruck, so i think we should get rid of ubi repos everywhere not just in downstream | 11:59 |
rlandy|ruck | ysandeep: https://meet.google.com/iru-jdbk-ogb?pli=1&authuser=0 | 12:00 |
rlandy|ruck | faster | 12:00 |
dviroel | rlandy|ruck: marios ysandeep we need a W+1 here, to unblock following patch to merge https://review.opendev.org/c/openstack/tripleo-repos/+/816211 - please do when you have some time, thanks! | 12:01 |
marios | dviroel: done | 12:01 |
rlandy|ruck | akahat|rover: hey - pls see https://bugs.launchpad.net/tripleo/+bug/1950815 | 12:12 |
rlandy|ruck | slaweq has a fix there | 12:12 |
ysandeep | pojadhav, hey o/ want to meet to sort that ipv6 issue? | 12:12 |
rlandy|ruck | let's watch that after ykarel's patch merges | 12:12 |
akahat|rover | rlandy|ruck, ack | 12:12 |
pojadhav | ysandeep, yup | 12:12 |
arxcruz | marios: but i'm using the master version of upgrade | 12:13 |
ysandeep | pojadhav, meet.google.com/pbd-wqap-wur | 12:13 |
rlandy|ruck | dviroel: hey - wrt https://trello.com/c/dq5p9sZ6/2227-cixlp1950528tripleociproa-undercloud-install-fails-because-gateway-is-not-pingable | 12:14 |
rlandy|ruck | looks like master merged | 12:14 |
rlandy|ruck | wallaby backport is mentioned | 12:14 |
rlandy|ruck | no backport listed | 12:14 |
rlandy|ruck | what's the correct status there? | 12:15 |
dviroel | rlandy|ruck: hi o/ | 12:15 |
* dviroel looks | 12:15 | |
dviroel | rlandy|ruck: yes, need to backport to wallaby or https://review.opendev.org/c/openstack/tripleo-ansible/+/816968 will break ci again | 12:16 |
dviroel | rlandy|ruck: let me create the backport patch, one minute | 12:17 |
rlandy|ruck | dviroel: thanks | 12:17 |
marios | arxcruz: sec putting some pointers in the bug | 12:18 |
marios | arxcruz: i mean in the testproject | 12:18 |
arxcruz | marios: no, the patch is getting on but it seems that the job zuul variable is not defined | 12:19 |
marios | arxcruz: the patch is not being included | 12:19 |
arxcruz | marios: it is | 12:19 |
arxcruz | 2021-11-16 11:41:40.276440 | primary | + ZUUL_CHANGES='openstack/tripleo-ci:master:refs/changes/91/816991/2^testproject:master:refs/changes/36/36136/6' | 12:19 |
marios | arxcruz: yes but then find the 'artg_change_list' | 12:19 |
marios | arxcruz: it is not | 12:19 |
marios | arxcruz: grep for "Print out the change list" | 12:20 |
marios | arxcruz: it gets filtered out because of https://opendev.org/openstack/tripleo-quickstart-extras/src/commit/e423bb068a96ed919ead08226f9447b2cdfc0332/roles/build-test-packages/tasks/main.yml#L200 | 12:20 |
arxcruz | :/ | 12:20 |
arxcruz | i don't know what to do to be honest | 12:20 |
marios | arxcruz: https://review.rdoproject.org/r/c/testproject/+/36715/2#message-c9aff88a30937258c32d78d3f3f6b4e4c2728114 | 12:21 |
marios | arxcruz: worst case we tidy up and inspect the change as best we can and then try it | 12:21 |
rlandy|ruck | amoralej: hello - talking with sshnaidm about ansible 2.11 | 12:22 |
marios | arxcruz: but worth staring at the build-test-packages code might be able to just override it for your test | 12:22 |
marios | arxcruz: it is a useful thing to be able to do, not just for this fix/bug but in general | 12:22 |
rlandy|ruck | in downstream tests we are pulling ansible from http://git.app.eng.bos.redhat.com/git/tripleo-environments.git/tree/config/release/rhos-17.yml#n94 | 12:22 |
rlandy|ruck | amoralej: moving to #rdo | 12:22 |
amoralej | rlandy|ruck, fyi i left a comment about this issue https://bugs.launchpad.net/tripleo/+bug/1950916/comments/16 | 12:23 |
rlandy|ruck | thanks | 12:23 |
dviroel | rlandy|ruck: the bug doesn't exists in wallaby, cause that code didn't merge yet, so we can close the bug and cix card and make sure that we merge https://review.opendev.org/c/openstack/tripleo-heat-templates/+/816969 with the fix on it | 12:28 |
rlandy|ruck | dviroel: k - pls comment with those details on the card | 12:30 |
rlandy|ruck | and ping harold to merge that | 12:31 |
rlandy|ruck | when we have a functional gate :) | 12:31 |
dviroel | rlandy|ruck: done, you can move the card to done if you want. bug is already fix released. | 12:38 |
rlandy|ruck | dviroel: awesome thanks | 12:38 |
dviroel | o/ | 12:38 |
ysandeep | commu#folks we have community call today in ~50 min, If you have topics please add under agenda: https://hackmd.io/MMg4WDbYSqOQUhU2Kj8zNg?both#2021-11-16-Community-Call | 12:42 |
ysandeep | #folks we have community call today in ~50 min, If you have topics please add under agenda: https://hackmd.io/MMg4WDbYSqOQUhU2Kj8zNg?both#2021-11-16-Community-Call | 12:42 |
rlandy|ruck | ysandeep: https://code.engineering.redhat.com/gerrit/c/openstack-tripleo-common/+/290958/7/container-images/tcib/base/base.yaml updated | 12:45 |
rlandy|ruck | in rerun | 12:45 |
ysandeep | rlandy|ruck, ack | 12:52 |
rlandy|ruck | marios: dviroel: are you guys all set with c9 and moving to mirrored content? | 12:56 |
marios | rlandy|ruck: we had a call earlier, i am digging at the mirror move and dviroel is digging at wiring up the dlrn/deps repos with https://review.opendev.org/c/openstack/tripleo-ci/+/817341 | 12:58 |
rlandy|ruck | ysandeep; pls see email from ceph team - requesting community call for Nov 23rd | 13:00 |
rlandy|ruck | cc'ed you | 13:00 |
rlandy|ruck | all: ^^ anyone with an interest in storage tests | 13:01 |
rlandy|ruck | akahat|rover: ^^? | 13:01 |
ysandeep | rlandy|ruck, thanks for looping me, I will take care of that | 13:01 |
rlandy|ruck | ysandeep++ thank you | 13:01 |
akahat|rover | rlandy|ruck, sure.. i'll help. | 13:01 |
rlandy|ruck | ugh - missed pooja again | 13:03 |
ysandeep | rlandy|ruck: Pooja was with me few mins back, We were figuring her ipv6 issue.. She was facing sound issues - I think she might be trying reboot to solve that issue | 13:11 |
ysandeep | rlandy|ruck, she is here ^^ | 13:11 |
rlandy|ruck | pojadhav: hey | 13:13 |
rlandy|ruck | sorry | 13:13 |
rlandy|ruck | pojadhav: can chat now | 13:13 |
pojadhav | rlandy|ruck, yup | 13:14 |
rlandy|ruck | pojadhav: https://meet.google.com/xer-bwsm-mnt?pli=1&authuser=0 | 13:15 |
*** amoralej is now known as amoralej|lunch | 13:15 | |
ysandeep | pojadhav, when you get time.. please check chatter on #rdo https://meetings.opendev.org/irclogs/%23rdo/%23rdo.2021-11-16.log.html , tl;dr version - add a task in oooq to enable ipv6 for c9-stream for the timebeing | 13:16 |
akahat|rover | ykarel, o/ | 13:17 |
akahat|rover | ykarel, https://review.rdoproject.org/zuul/status#36754 i ran some testproject job: https://review.rdoproject.org/r/c/testproject/+/36754 | 13:17 |
akahat|rover | with depends on https://review.opendev.org/c/openstack/tripleo-quickstart/+/818043/ but got most of the failures with the same errors. | 13:18 |
dviroel | rlandy|ruck: marios ysandeep - we are good with containers-multinode for cs9 https://review.rdoproject.org/r/c/rdo-jobs/+/36460 - all dependencies already merged. see test project here https://review.rdoproject.org/r/c/testproject/+/34926 | 13:21 |
ykarel | akahat|rover, yes that's expected | 13:22 |
ykarel | as containers are already built with buggy package | 13:22 |
akahat|rover | oh... | 13:22 |
ykarel | so after the patch merges would need fresh containers to be built with promotion pipelines | 13:23 |
akahat|rover | okay. so we need promotion for it. | 13:23 |
ykarel | no promotion, but new containers with new set of repos | 13:23 |
akahat|rover | ykarel, got it. ty :) | 13:25 |
ysandeep | arxcruz, sshnaidm, rlandy, marios, ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat, chandankumar, frenzy_friday, anbanerj, dviroel Community call in 4 mins | 13:29 |
ysandeep | https://hackmd.io/MMg4WDbYSqOQUhU2Kj8zNg?both#2021-11-16-Community-Call | 13:29 |
ysandeep | sorry for the reping | 13:29 |
arxcruz | ysandeep: i'm having connection issues, trying to log in | 13:30 |
dpawlik | arxcruz, marios: hey, do you agree to be a core reviewer for ci log processing project? | 13:37 |
arxcruz | dpawlik: sure :) | 13:37 |
*** soniya29|ruck|afk is now known as soniya29|ruck | 13:40 | |
*** rcastillo|away is now known as rcastillo | 13:42 | |
*** amoralej|lunch is now known as amoralej | 13:46 | |
marios | dpawlik: o/ hey sure i am up for helping with some reviews | 13:47 |
dpawlik | arxcruz, marios: cool, thank you! | 13:48 |
rlandy|ruck | dpawlik: pls add arxcruz | 13:50 |
rlandy|ruck | and you can add me if needed | 13:50 |
arxcruz | rlandy|ruck: i'm there :) | 13:50 |
rlandy|ruck | cool | 13:51 |
arxcruz | rlandy|ruck: i'm also progressing on the upgrade job | 13:51 |
rlandy|ruck | arxcruz: cool | 13:51 |
marios | mirror.centos.org down for everyone or just me.com | 13:53 |
marios | hmm back now : | 13:53 |
rlandy|ruck | everything is dying ... run for the hills | 13:54 |
*** pojadhav is now known as pojadhav|brb | 13:59 | |
rlandy|ruck | ysandeep: we have a pass on https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/build/d6ba1b3c872140058393043ea0f63cbe | 14:07 |
rlandy|ruck | moving to upstream | 14:07 |
*** pojadhav|brb is now known as pojadhav | 14:08 | |
ysandeep | rlandy|ruck, great, thanks! We can ping kevin / alex afterwards for review if adding on that line is okay. | 14:09 |
* akahat|rover back in few hours | 14:11 | |
rlandy|ruck | ysandeep: done | 14:19 |
rlandy|ruck | sshnaidm: one pass so far on periodic-tripleo-ci-rhel-8-scenario007-standalone-rhos-17 | 14:20 |
sshnaidm | rlandy|ruck, nice | 14:20 |
rlandy|ruck | waiting on ovb | 14:21 |
ysandeep | rlandy|ruck, if your tripleo-common patch merges by my morning, I will create cherry-picks for stable releases and will try to get the workflows. | 14:32 |
* ysandeep out | 14:32 | |
rlandy|ruck | ysandeep: ack - thanks | 14:33 |
rlandy|ruck | depends what else hits today :/ | 14:33 |
ysandeep | fingers crossed | 14:34 |
*** ysandeep is now known as ysandeep|out | 14:34 | |
rlandy|ruck | ykarel++ | 14:46 |
rlandy|ruck | standalone passed in gate | 14:47 |
rlandy|ruck | soniya29|ruck: how are the component lines? | 14:53 |
rlandy|ruck | pls check rdo and downstream | 14:54 |
soniya29|ruck | rlandy|ruck, All seem good except cloud-ops and fs01 baremetal- job health seems good | 14:54 |
soniya29|ruck | i have testproject the sc01 standalone cloudops job | 14:56 |
soniya29|ruck | centos-8-featureset001-baremetal-master job health seems good waiting for next run | 14:57 |
rlandy|ruck | soniya29|ruck: thank you | 14:59 |
*** dviroel is now known as dviroel|lunch | 14:59 | |
soniya29|ruck | rlandy|ruck, :) | 15:02 |
rlandy|ruck | akahat|rover: do we have the same issue with scenario010 on victoria? | 15:04 |
rlandy|ruck | periodic-tripleo-ci-centos-8-scenario010-standalone-victoria | 15:04 |
rlandy|ruck | outstanding to promote | 15:04 |
rlandy|ruck | ttps://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-scenario010-standalone-ussuri&job_name=periodic-tripleo-ci-centos-8-scenario010-standalone-victoria | 15:07 |
rlandy|ruck | akahat|rover: once the gate clears, pls put the voting patches in | 15:09 |
rlandy|ruck | we need to stop this | 15:09 |
rlandy|ruck | sshnaidm: we have an error on OVB - but it's missing image ... "Error running container image prepare: Not found image: https://docker-registry.upshift.redhat.com/v2/tripleorhos-17/openstack-ovn-northd/manifests/47233472b56fe371be2843dbbf5fe5a1", | 15:20 |
rlandy|ruck | so probably unrelated | 15:21 |
rlandy|ruck | https://sf.hosted.upshift.rdu2.redhat.com/logs/40/189440/151/check/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-internal-rhos-17/32a9604/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 15:21 |
sshnaidm | rlandy|ruck, yeah | 15:22 |
sshnaidm | rlandy|ruck, maybe recheck? | 15:22 |
rlandy|ruck | sshnaidm: we haven't promoted in ages may be legit | 15:23 |
rlandy|ruck | but yeah - recheck might work | 15:23 |
rlandy|ruck | need to merge a fix upstream for that promotion to go through | 15:24 |
*** dviroel is now known as dviroel_ | 15:37 | |
ade_lee | sshnaidm, hey - did you resolve that issue you mention to me last week about tripleo-ipa ? | 15:49 |
ade_lee | with the commmunity ansible changes .. | 15:49 |
ade_lee | dviroel_, whats the bz again for the rabbitmq issues? | 15:49 |
ade_lee | dviroel_, found it -- https://bugs.launchpad.net/tripleo/+bug/1950382 | 15:59 |
rlandy|ruck | ok - recheck away | 16:08 |
rlandy|ruck | gate should be working now | 16:08 |
sshnaidm | ade_lee, yes, I think it should be fine | 16:12 |
rlandy|ruck | arxcruz: for python tempestconf ... where did we land on scenario010 | 16:12 |
rlandy|ruck | we are making those jobs voting | 16:12 |
sshnaidm | ade_lee, I've updated fixed c.general collection in deps and it worked fine | 16:12 |
arxcruz | rlandy|ruck: i'm investigating why some tempest tests are failing on standalone job | 16:12 |
rlandy|ruck | arxcruz: maybe we go with making that job non-voting | 16:15 |
rlandy|ruck | in its definition | 16:15 |
rlandy|ruck | so we can make the other jobs voting | 16:15 |
rlandy|ruck | in other repos'] | 16:15 |
arxcruz | rlandy|ruck: yup | 16:15 |
rlandy|ruck | arxcruz: k - let's propose that | 16:15 |
ade_lee | sshnaidm, cool - I thought that might do it - good to know. | 16:15 |
rlandy|ruck | main line integration just started | 16:16 |
rlandy|ruck | we should clear promotion now | 16:16 |
*** dviroel|lunch is now known as dviroel | 16:18 | |
*** ykarel is now known as ykarel|away | 16:27 | |
rlandy|ruck | lunch brb | 16:30 |
*** amoralej is now known as amoralej|off | 16:48 | |
marios | dviroel_: rlandy|ruck: we should have a call tomorrow re 9 repos/mirror state - maybe after prog call if you're available rlandy|ruck | 16:58 |
marios | rlandy|ruck: dviroel_: a bit of a mess (as usual ;)) and needs some consensus about how we will proceed | 16:59 |
rlandy|ruck | marios: ack | 16:59 |
marios | rlandy|ruck: dviroel_: i will continue to dig in my day tomorrow | 16:59 |
rlandy|ruck | marios: maybe before program call | 16:59 |
rlandy|ruck | paul meeting after | 16:59 |
marios | rlandy|ruck: ok works for me i don't have anything scheduled so ping when you're around anyway | 17:00 |
dviroel | marios: ack, i'll be available before program call too | 17:02 |
rlandy|ruck | sshnaidm: https://review.opendev.org/c/openstack/tripleo-repos/+/817397 | 17:03 |
rlandy|ruck | sshnaidm: https://review.opendev.org/c/openstack/tripleo-ci/+/817341 | 17:03 |
*** marios is now known as marios|out | 17:29 | |
*** sshnaidm is now known as sshnaidm|afk | 17:33 | |
*** tosky is now known as Guest6054 | 18:05 | |
*** tosky_ is now known as tosky | 18:05 | |
dviroel | rlandy|ruck: https://review.opendev.org/c/openstack/tripleo-repos/+/818118 | 18:32 |
rlandy|ruck | sshnaidm|afk: ^^ | 18:33 |
sshnaidm|afk | rlandy|ruck, ack.. dviroel maybe we'll have new templates for centos9 for now? | 18:39 |
*** sshnaidm|afk is now known as sshnaidm | 18:39 | |
sshnaidm | dviroel, probably it's not worth to reuse c8 now when things are not stable | 18:40 |
*** tosky_ is now known as tosky | 18:48 | |
dviroel | sshnaidm: we can rework tripleo-repos and create new templates, yes. This is still WIP. | 18:52 |
dviroel | sshnaidm: but yes, there are more issues on reusing code like installing yum-plugin-priorities, which shouldn't be available at c9 anymore | 18:53 |
dviroel | sshnaidm: we will sync tomorrow with marios, before program call | 18:57 |
dviroel | rlandy|ruck: ^ | 18:57 |
sshnaidm | dviroel, ok | 18:57 |
rlandy|ruck | yep | 18:58 |
rlandy|ruck | let's chat then | 18:58 |
rlandy|ruck | rcastillo: https://docs.openstack.org/tripleo-docs/latest/ci/index.html | 19:03 |
rlandy|ruck | rcastillo: https://codesearch.opendev.org | 19:08 |
rlandy|ruck | https://zuul.opendev.org/t/openstack/status | 19:11 |
rlandy|ruck | https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/CentOS-8/master.yml#L108 | 19:19 |
rlandy|ruck | we | 20:00 |
rlandy|ruck | ve cleared check/gate but not promotions yet | 20:00 |
*** dviroel is now known as dviroel|out | 20:30 | |
ade_lee | dviroel|out, rlandy|ruck so I wonder if we can run and keep the node for tripleo-ci-centos-8-standalone-on-multinode-ipa for https://review.opendev.org/c/openstack/tripleo-ci/+/808215 | 21:16 |
ade_lee | that way we can investigate the rabbitmq error .. | 21:17 |
* rlandy|ruck looks | 21:17 | |
rlandy|ruck | ade_lee: we can't hold nodes on upstream zuul | 21:18 |
rlandy|ruck | if you testproject that | 21:18 |
rlandy|ruck | and kick the same job in rdo zuul, we can hold that node | 21:18 |
ade_lee | rlandy|ruck, yeah - thats what I meant .. | 21:18 |
rlandy|ruck | ade_lee: yeah - will set that up in a bit | 21:19 |
ade_lee | rlandy|ruck, thanks! | 21:19 |
* rlandy|ruck needs about 15 mins | 21:19 | |
*** rlandy|ruck is now known as rlandy|ruck|biab | 21:50 | |
*** rlandy|ruck|biab is now known as rlandy|ruck | 22:30 | |
*** tosky is now known as Guest6070 | 22:42 | |
*** tosky_ is now known as tosky | 22:42 | |
*** tosky is now known as Guest6073 | 23:07 | |
*** tosky_ is now known as tosky | 23:07 | |
rlandy|ruck | ade_lee: still around? | 23:52 |
rlandy|ruck | otherwise will hold node tomorrow morning | 23:53 |
* rlandy|ruck out | 23:55 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!