*** rlandy|bbl is now known as rlandy | 00:35 | |
*** rlandy is now known as rlandy|out | 01:49 | |
*** ysandeep|out is now known as ysandeep | 05:21 | |
chkumar|rover | dasm|off: thanks! | 05:34 |
---|---|---|
*** amoralej|off is now known as amoralej | 06:23 | |
jm1 | o/ | 07:04 |
soniya29 | hello | 07:15 |
*** ysandeep is now known as ysandeep|lunch | 07:57 | |
chkumar|rover | marios: https://review.opendev.org/c/openstack/tripleo-quickstart/+/841582 I have +wed it | 08:30 |
marios | thank you chkumar|rover | 08:31 |
chkumar|rover | marios: thanks for addressing the comments :-) | 08:32 |
marios | thanks for thoughtful reviews chkumar|rover | 08:37 |
reviewbot | Do you want me to add your patch to the Review list? Please type something like add to review list <your_patch> so that I can understand. Thanks. | 08:37 |
*** ysandeep|lunch is now known as ysandeep | 09:30 | |
*** rlandy|out is now known as rlandy | 10:23 | |
rlandy | chkumar|rover: hey - how are you? | 10:23 |
chkumar|rover | rlandy: same status still fighting with ovn | 10:24 |
chkumar|rover | rlandy: train promoted | 10:24 |
rlandy | octavia and tripleo master should have promoted | 10:24 |
rlandy | and your patch merged | 10:24 |
rlandy | what is missing | 10:24 |
rlandy | wallaby I see tripleo fs001 is still missing | 10:24 |
chkumar|rover | rlandy: https://bugs.launchpad.net/tripleo/+bug/1981829/comments/6 | 10:24 |
rlandy | you can skip and promote if need be | 10:24 |
rlandy | chkumar|rover: did it work in previous testproject | 10:25 |
chkumar|rover | rlandy: nope | 10:25 |
rlandy | chkumar|rover: let's chat | 10:25 |
chkumar|rover | tripleo-ci is not yet merged | 10:25 |
rlandy | chkumar|rover: https://meet.google.com/akv-cnwk-rqg | 10:27 |
chkumar|rover | https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-17-rhel9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-9-ovb-3ctlr_1comp-featureset035-internal-rhos-17/5a12d18/job-output.txt | 10:33 |
chkumar|rover | https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-17-rhel9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-9-ovb-3ctlr_1comp-featureset035-internal-rhos-17/b63f8e9/job-output.txt | 10:33 |
chkumar|rover | https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-17-rhel9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-9-ovb-3ctlr_1comp-featureset035-internal-rhos-17/c12cfaf/job-output.txt | 10:34 |
rlandy | frenzy_friday: hello | 10:40 |
rlandy | frenzy_friday: let's touch base re: 17.2 | 10:40 |
rlandy | 17.1 | 10:40 |
frenzy_friday | rlandy, yep sure, 5 mins - updating a patch | 10:41 |
rlandy | frenzy_friday: pls ping when ready | 10:42 |
chkumar|rover | ykarel: hello | 10:47 |
chkumar|rover | ykarel: can you take a look at this log https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-17-rhel9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-9-ovb-3ctlr_1comp-featureset035-internal-rhos-17/5a12d18/job-output.txt when free | 10:47 |
chkumar|rover | 503 Service Unavailable: No server is available to handle this request while creating private network | 10:48 |
rlandy | marios: hello | 10:48 |
rlandy | marios: so I took a guess and removed the depends-on - see it made no difference :( | 10:49 |
marios | rlandy: o/ it worked actually | 10:49 |
rlandy | marios: what? still failing ci | 10:49 |
ykarel | chkumar|rover, hi | 10:49 |
marios | rlandy: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/841764/32..33//COMMIT_MSG#b16 | 10:49 |
ykarel | chkumar|rover, is it consistently failing like that? | 10:49 |
ykarel | and only fs035 or all ovbs? | 10:50 |
chkumar|rover | ykarel: only fs035 | 10:50 |
marios | rlandy: yeah but it passed the undercloud-upgrade there https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/841764/32..33#message-de9febad1eb2814dd7482a05169cc49eba182e8c tripleo-ci-centos-9-undercloud-upgrade https://zuul.opendev.org/t/openstack/build/4ffe5d68aac2486ca124438e6c0042e6 : SUCCESS in 1h 05m 25s | 10:50 |
chkumar|rover | ykarel: check the above 4 logs | 10:50 |
frenzy_friday | rlandy, bhagyashris I am ready to sync now | 10:50 |
rlandy | marios: ok - I thought that might be happening | 10:50 |
ykarel | chkumar|rover, ok will check | 10:50 |
rlandy | marios: that the depends-on gating was taking preference | 10:50 |
chkumar|rover | ykarel: thanks! | 10:50 |
marios | rlandy: yeah it was using the wallaby templates as the target of the upgrade | 10:50 |
rlandy | marios: ok- well hope it helped | 10:51 |
marios | rlandy: so it was nothing in the depends-on per se (that file isn't used there at all) just that it was fetching wallaby | 10:51 |
marios | rlandy: thank you! | 10:51 |
marios | rlandy: i went to try exactly what you already did and found your update | 10:51 |
rlandy | marios: sure - it was just a suspicion - no smarts involved | 10:51 |
rlandy | frenzy_friday: bhagyashris: https://meet.google.com/vau-ikvw-auw?pli=1&authuser=0 | 10:52 |
rlandy | soniya29: I need to move your 1-1 | 10:52 |
rlandy | have a manager meeting then | 10:52 |
rlandy | will reschedule | 10:52 |
soniya29 | rlandy, okay, no problem | 10:52 |
bhagyashris | rlandy give me in | 10:54 |
rlandy | frenzy_friday: https://code.engineering.redhat.com/gerrit/gitweb?p=openstack/tripleo-ci-internal-config.git;a=blob;f=zuul.d/dlrn-jobs.yaml;h=8528590b81baf3135387624841b6fa39ba5305c8;hb=HEAD#l111 | 11:00 |
marios | ;) plenty smarts involved rlandy ! | 11:03 |
rlandy | marios: hmmm ... so that's a real issue with any stable branch depends-on and update - wonder why we have not seen that before | 11:06 |
marios | rlandy: right maybe we can tweak build-test-packages to deal with that ... but not sure how (you *want* it to include the depends-on... :/ | 11:12 |
marios | rlandy: otherwise, it means we cant *test* the upgrade job of our branchless repos with depends-on.. so we'll have to enforce the depends-on ourselves (like merge the stable/wallaby whatever then the quickstart). in this case the depends-on wasn't actually needed (it was in an earlier version) | 11:15 |
rlandy | marios: right, so in this case it's not actually needed | 11:21 |
rlandy | but if it was, we'd be in ttouble | 11:21 |
rlandy | trouble | 11:21 |
rlandy | idk - will have to ask chkumar|rover to weigh in here when he is off rr | 11:21 |
ykarel | chkumar|rover, is bug already created for that? | 11:22 |
rlandy | bhagyashris++ on image builds | 11:22 |
chkumar|rover | ykarel: not yet | 11:22 |
chkumar|rover | ykarel: let me create that one | 11:22 |
ykarel | chkumar|rover, ok create, that's happening post switch to ovn clustering | 11:22 |
frenzy_friday | In the container build job: "docker-registry.upshift.redhat.com/tripleorhos-17-1-rhel-9/openstack-base:e5487fd0f4cd374bd3a2f681c7b8e11b\\" in local containers storage"\nunauthorized: authentication require Do we need to create tripleorhos-17-1-rhel-9/ registry first? | 11:25 |
*** dviroel|out is now known as dviroel | 11:27 | |
rlandy | frenzy_friday: ack - we need to create that registry for you | 11:30 |
rlandy | frenzy_friday: you need the new namespace | 11:30 |
* rlandy needs to dig out how | 11:31 | |
frenzy_friday | also do we need a 17-1 file here https://code.engineering.redhat.com/gerrit/gitweb?p=tripleo-environments.git;a=tree;f=config/release;h=b04d922e4b536e2d847461860d73811f54bde2da;hb=HEAD ? | 11:31 |
rlandy | frenzy_friday: in the mean time, you can continue with making sure all the containers build buy setting the push var to false | 11:31 |
frenzy_friday | ack | 11:32 |
rlandy | frenzy_friday: ack - you need that release file | 11:32 |
rlandy | frenzy_friday: bhagyashris must have it | 11:32 |
rlandy | used for image builds | 11:32 |
rlandy | frenzy_friday: bhagyashris: you could merge that file | 11:32 |
rlandy | if you both need it | 11:32 |
rlandy | frenzy_friday: give me a few | 11:32 |
rlandy | will dig up the namespace creation stuff | 11:33 |
chkumar|rover | ykarel: rlandy fyi rhos-17 rhel-9 blocker bug https://bugzilla.redhat.com/show_bug.cgi?id=2108580 | 11:34 |
chkumar|rover | email sent | 11:38 |
rlandy | chkumar|rover: thank you | 11:38 |
ykarel | chkumar|rover, ack will add details | 11:44 |
chkumar|rover | ykarel: ++ thank you :-) | 11:45 |
chkumar|rover | rlandy: dasm|off cs9 wallaby promoted https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43692 <- please merge the revert | 11:54 |
rlandy | chkumar|rover: done - thanks | 11:55 |
bhagyashris | rlandy, i don't have +W rights... | 11:58 |
rlandy | bhagyashris: pls pass me patch and I will merge | 11:58 |
bhagyashris | https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/417020 | 11:58 |
chkumar|rover | bhagyashris: frenzy_friday left minute comments https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/417020 | 12:01 |
*** ysandeep is now known as ysandeep|break | 12:02 | |
bhagyashris | chkumar|rover, ack | 12:05 |
*** amoralej is now known as amoralej|lunch | 12:08 | |
bhagyashris | chkumar|rover, Done | 12:15 |
bhagyashris | ?ME stepping out for bit | 12:15 |
* bhagyashris stepping out for bit | 12:15 | |
chkumar|rover | rlandy: dasm|off stepping out for an hour | 12:21 |
*** ysandeep|break is now known as ysandeep|mtg | 12:33 | |
rlandy | frenzy_friday: registry namespace added - pls try push containers now | 12:35 |
rlandy | namespace=tripleorhos-17-1-rhel-9 | 12:35 |
rlandy | frenzy_friday: let me know if that does not wor | 12:40 |
rlandy | then I need to fix permissions | 12:40 |
ykarel | chkumar|rover, pushed testpatch to test potential fix https://code.engineering.redhat.com/gerrit/c/testproject/+/420544 | 12:46 |
ykarel | hope depends-on works on 17trunk branch | 12:47 |
rlandy | frenzy_friday: rechecked testproject | 12:49 |
rlandy | marios: 1-1 clashes with all hands | 12:51 |
rlandy | moving | 12:52 |
*** ysandeep|mtg is now known as ysandeep | 12:58 | |
marios | rlandy: ack np thanks | 12:58 |
*** amoralej|lunch is now known as amoralej | 13:00 | |
frenzy_friday | rlandy, thanks | 13:14 |
frenzy_friday | sorry went for lunch | 13:15 |
rlandy | frenzy_friday: you need an update on tripleo-environments file | 13:19 |
rlandy | osptrunk-candidate-deps and osp-trunk-deps | 13:19 |
rlandy | uses rhel-9 | 13:19 |
rlandy | not distr_ver | 13:19 |
rlandy | compare with 17 file | 13:20 |
rlandy | pls pdate | 13:20 |
rlandy | and rerun | 13:20 |
frenzy_friday | rlandy, here https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/417020/3/config/release/tripleo-ci/RedHat-9/rhos-17.1.yml#105 ? | 13:22 |
rlandy | frenzy_friday: and 116 | 13:23 |
rlandy | compare with cuurent 17.0 file | 13:23 |
bhagyashris | rlandy, i have updated that as per chkumar|rover comments | 13:23 |
rlandy | it's the wrong link | 13:23 |
rlandy | won't resolve | 13:23 |
rlandy | jobs are failing now | 13:23 |
bhagyashris | ok will rever the change | 13:23 |
bhagyashris | revert* | 13:23 |
frenzy_friday | rlandy, I see a comment from chandan https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/417020/1..3/config/release/tripleo-ci/RedHat-9/rhos-17.1.yml#b105 | 13:24 |
rlandy | bhagyashris: rhel-9 vs rhel9 :) | 13:24 |
frenzy_friday | ohh ok, changing back then | 13:24 |
bhagyashris | frenzy_friday, yeah patch set is ok | 13:24 |
bhagyashris | so we can use the patch set 1 re reupload | 13:24 |
frenzy_friday | bhagyashris, yep, changing back | 13:25 |
bhagyashris | ok thanks | 13:25 |
bhagyashris | arxcruz, rlandy, marios, ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat, chandankumar, frenzy_friday, anbanerj, dviroel, rcastillo, dasm, jm1, marios, chkumar|rover dasm|off | 13:30 |
bhagyashris | Tripleo CI community call | 13:30 |
bhagyashris | https://hackmd.io/MMg4WDbYSqOQUhU2Kj8zNg?both#2022-07-19-Community-Call @ line 30 | 13:31 |
*** dasm|off is now known as dasm|ruck | 13:31 | |
bhagyashris | rlandy, ysandeep rcastillo dviroel ^ | 13:31 |
bhagyashris | arxcruz, ^ | 13:31 |
rlandy | frenzy_friday: https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/417020/3..4/config/release/tripleo-ci/RedHat-9/promotion-testing-hash-rhos-17.1.yml | 13:34 |
rlandy | no diff | 13:34 |
frenzy_friday | updating it | 13:35 |
Tengu | that was a really, really short call :) | 13:35 |
rlandy | yep | 13:36 |
dasm|ruck | o/ | 13:36 |
rlandy | dasm|ruck: hey | 13:36 |
jm1 | Tengu: shortest call ever ^^ | 13:36 |
Tengu | small sharing - RDO seems broken again with the node provisioning. | 13:36 |
rlandy | dasm|ruck: chkumar|rover has the updates for you | 13:36 |
frenzy_friday | updated now | 13:36 |
dasm|ruck | rlandy: checking the hackmd | 13:36 |
rlandy | https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001&skip=0 | 13:37 |
rlandy | yep | 13:37 |
rlandy | all broken | 13:37 |
dasm|ruck | > [H[J[1;1Herror: ../../grub-core/disk/diskfilter.c:916:diskfilter writes are not | 13:38 |
* rlandy need to run to complex management office - brb | 13:38 | |
jm1 | chkumar|rover, dasm|ruck: breaking patch in aoc incoming. tripleo should be safe by now but in case you see messages like "To utilize this module, the installed version of the openstacksdk library MUST be >=0.99.", then please ping me! https://review.opendev.org/c/openstack/ansible-collections-openstack/+/850040 | 13:44 |
jm1 | rlandy: fyi ^ | 13:44 |
marios | Tengu: fyi added yr reviews to the ci reviews list @ https://hackmd.io/FGMoCiRfSNa8puA1BpTQ-Q?edit should get some attention | 13:44 |
reviewbot | Do you want me to add your patch to the Review list? Please type something like add to review list <your_patch> so that I can understand. Thanks. | 13:44 |
Tengu | marios: ah, thanks! | 13:45 |
Tengu | didn't know where to put them.. | 13:45 |
chkumar|rover | amoralej: hello | 13:53 |
amoralej | hi chkumar|rover | 13:53 |
rlandy | jm1: pls note that rcastillo is out today | 13:53 |
chkumar|rover | amoralej: regarding rabbitmq change, fs01 is good on wallaby | 13:53 |
rlandy | so if we need a revert is the later hours | 13:53 |
rlandy | who can do it? | 13:53 |
chkumar|rover | amoralej: https://review.opendev.org/c/openstack/tripleo-quickstart/+/848439/4#message-c0a1106e4aa3ad3982cc4ab6fb52a240c3af2788 | 13:53 |
chkumar|rover | we can go ahead with rabbitmq change | 13:54 |
amoralej | ack, chkumar|rover i'll let maintainer know | 13:54 |
jm1 | rlandy: jm1[m] is always on ;) | 13:57 |
jm1 | rlandy: i will monitor my phone today but i do not expect any tripleo failure due to that patch | 14:00 |
rlandy | jm1; let's hope | 14:01 |
amoralej | chkumar|rover, tagged, let us know if you notice something abnormal | 14:02 |
chkumar|rover | amoralej: sure | 14:02 |
chkumar|rover | dasm|ruck: tldr of today's rr | 14:03 |
chkumar|rover | rhos-17 rhel-9 blocked on https://bugzilla.redhat.com/show_bug.cgi?id=2108580 | 14:03 |
chkumar|rover | cs8 train promoted today | 14:03 |
chkumar|rover | cs9 wallaby promoted today by removing ovn job | 14:04 |
chkumar|rover | ovn job is not yet fixed for wallaby and master | 14:04 |
dasm|ruck | :( | 14:04 |
chkumar|rover | for cs9 master node provisioning issue https://bugs.launchpad.net/tripleo/+bug/1982137 | 14:04 |
dasm|ruck | ack, i just noticed that one | 14:05 |
chkumar|rover | if we get any good hash with all job passing except fs035 we can promote the master line | 14:05 |
chkumar|rover | that's the story of today | 14:05 |
dasm|ruck | k. that's reassuring. | 14:05 |
dasm|ruck | let's hope we're gonna have one | 14:05 |
dasm|ruck | chkumar|rover: do you have any close-to-working one? | 14:06 |
chkumar|rover | dasm|ruck: https://review.rdoproject.org/r/c/testproject/+/44037/1/.zuul.yaml | 14:08 |
dasm|ruck | k, thx | 14:09 |
dasm|ruck | chkumar|rover: did you mention that we're still having ovn issues? periodic-tripleo-ci-centos-9-scenario010-ovn-provider-standalone-master | 14:09 |
chkumar|rover | but node provision issue related to cs9 | 14:09 |
chkumar|rover | dasm|ruck: yes, gthiemonge is working on that | 14:09 |
dasm|ruck | ack | 14:10 |
dasm|ruck | so, not only fs035 but also sc010 needs to be skipped? | 14:10 |
chkumar|rover | dasm|ruck: yes | 14:11 |
dasm|ruck | ack | 14:11 |
chkumar|rover | dasm|ruck: for rhos17 rhel9 ykarel is testing a fix here https://code.engineering.redhat.com/gerrit/c/testproject/+/420544 | 14:21 |
dasm|ruck | ack | 14:21 |
*** ysandeep is now known as ysandeep|dinner | 14:28 | |
*** ysandeep|dinner is now known as ysandeep | 15:02 | |
rlandy | https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-9-undercloud-upgrade&skip=0 | 15:30 |
rlandy | chkumar|rover: dasm|ruck: ^^ know about that failure? | 15:30 |
rlandy | + exec /usr/bin/bootstrap_host_exec barbican_api su barbican -s /bin/bash -c ''\''/usr/bin/barbican-manage' db upgrade \' | 15:31 |
rlandy | ERROR: The argument passed to Dialect.has_table() should be a <class 'sqlalchemy.engine.base.Connection'>, got <class 'sqlalchemy.engine.base.Engine'>. Additionally, the Dialect.has_table() method is for internal dialect use only; please use ``inspect(some_engine).has_table(<tablename>>)`` for public API use. | 15:31 |
rlandy | 2022-07-19 14:47:30.167132 | bc764e10-166d-75f8-aa89-00000 | 15:31 |
dasm|ruck | no. i didn't notice that yet | 15:31 |
dasm|ruck | > "Failed containers: barbican_api_db_sync"} | 15:31 |
dasm|ruck | > ERROR: Can't run container barbican_api_db_sync | 15:31 |
rlandy | dasm|ruck: can you log and investigate? | 15:32 |
dasm|ruck | all of them fail due to aforementioned error | 15:32 |
dasm|ruck | i'm gonna submit a bug | 15:32 |
dasm|ruck | https://bugs.launchpad.net/tripleo/+bug/1982195 | 15:36 |
*** amoralej is now known as amoralej|off | 15:46 | |
dasm|ruck | I'm gonna need some help to triage it further. I don't see any changes to kolla: https://review.opendev.org/q/repo:+openstack/kolla | 15:51 |
dasm|ruck | and barbican seems to be clear from changes too: https://review.opendev.org/q/repo:+openstack/barbican | 15:52 |
dasm|ruck | I don't see any updates to sqlalchemy happening recently | 15:53 |
dasm|ruck | It seems that we're not building the barbican component by ourselves | 15:54 |
rlandy | frenzy_friday: "success": true, | 15:56 |
*** marios is now known as marios|out | 15:58 | |
dasm|ruck | chkumar|rover: i saw you updated the bug. Thanks. Do you have any pointers? Ideas where to look for the issue? | 15:59 |
rlandy | frenzy_friday: bhagyashris: pls bring your 17.1 patches to the review meeting tomorrow | 15:59 |
rlandy | and we can merge up | 15:59 |
rlandy | frenzy_friday: bhagyashris: you should be able to try a standalone. multinode and a few scenraios | 15:59 |
rlandy | then build the mini line | 15:59 |
rlandy | after standalone works | 15:59 |
chkumar|rover | dasm|ruck: there is another file https://536ba7636eca1576ae9f-4e53ffd70f9f0b38678a1c719bbe7de3.ssl.cf2.rackcdn.com/850349/1/check/tripleo-ci-centos-9-undercloud-upgrade/f43c1b0/logs/undercloud/var/log/extra/podman/containers/barbican_api_db_sync/podman_info.log | 16:00 |
rlandy | you can promote to current-tripleo | 16:00 |
frenzy_friday | rlandy, awesome! | 16:00 |
chkumar|rover | may be compairing the rpm with the passing one | 16:00 |
rlandy | chkumar|rover: dasm|ruck: pls let me know what I am watching when you guy are out later | 16:00 |
dasm|ruck | rlandy: ack | 16:00 |
chkumar|rover | dasm|ruck: https://536ba7636eca1576ae9f-4e53ffd70f9f0b38678a1c719bbe7de3.ssl.cf2.rackcdn.com/850349/1/check/tripleo-ci-centos-9-undercloud-upgrade/f43c1b0/logs/undercloud/var/log/extra/podman/containers/barbican_api/podman_info.log | 16:01 |
chkumar|rover | here is the rpm list | 16:01 |
chkumar|rover | it is not in above container | 16:01 |
chkumar|rover | python3-sqlalchemy.x86_64 1.4.37-3.el9 @quickstart-centos-appstreams | 16:02 |
dasm|ruck | hmm.. there was no update to sqlalchemy in some time. So, it's centos internal update then... | 16:03 |
chkumar|rover | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_526/850044/1/check/tripleo-ci-centos-9-undercloud-upgrade/5268c4d/logs/undercloud/var/log/extra/podman/containers/index.html | 16:04 |
chkumar|rover | in passing job there is no barbican container | 16:04 |
chkumar|rover | what is going on | 16:04 |
dasm|ruck | i didn't see barbican there | 16:04 |
chkumar|rover | dasm|ruck: I will take a look tomorrow | 16:04 |
dasm|ruck | yes | 16:04 |
chkumar|rover | see ya! | 16:05 |
chkumar|rover | please leave notes | 16:05 |
dasm|ruck | chkumar|rover: take care ;/ | 16:05 |
dasm|ruck | o/ | 16:05 |
dasm|ruck | ofc | 16:05 |
dasm|ruck | it looks like we might started building barbican containers from scratch? idk | 16:05 |
dasm|ruck | brb | 16:06 |
dasm|ruck | back | 16:11 |
*** ysandeep is now known as ysandeep|afk | 16:18 | |
*** ysandeep|afk is now known as ysandeep|out | 16:38 | |
bhagyashris | rlandy, ack | 16:41 |
dasm|ruck | > openstack-periodic-integration-main just started | 16:42 |
rlandy | dasm|ruck: need something | 16:48 |
rlandy | otherwise going to ceph stuff | 16:48 |
dasm|ruck | rlandy: not at the moment, thank you | 16:49 |
dasm|ruck | rlandy: i'm goin afk for few hours. Currently the only missing thing is cs9 master -- promotion is in progress, but I wouldn't count on flawless pass. chkumar|rover tried rerunning failing jobs, without a success: https://review.rdoproject.org/r/c/testproject/+/44037 | 17:39 |
dasm|ruck | We're also seeing rh9 osp17 issues wrt fs035. | 17:40 |
dasm|ruck | I left all notes in the hackmd: https://hackmd.io/KrGAxws2QiaHuJmj8TH6Jg#2022-07-20 | 17:40 |
rlandy | ok - will watch | 17:40 |
*** rlandy is now known as rlandy|ruck | 17:40 | |
dasm|ruck | I'm gonna check back in 2-3 hours | 17:40 |
dasm|ruck | Tnanks rlandy|ruck++ | 17:41 |
*** dasm|ruck is now known as dasm|off | 17:48 | |
rlandy|ruck | dasm|off: dviroel: looks like wallaby undercloud containers failure is also barbican related | 20:14 |
dviroel | ah ok, thanks | 20:15 |
rlandy|ruck | looks like barbican belongs to secuirty | 20:24 |
rlandy|ruck | may be a change of what we promoted up | 20:24 |
dviroel | rlandy|ruck: is tomorrow the new deadline for getting wallaby patches? | 20:35 |
rlandy|ruck | dviroel: yeah - but not major ofr us | 20:36 |
rlandy|ruck | landed on trunk patches | 20:36 |
dviroel | rlandy|ruck: got it, not on us - tks | 20:41 |
rlandy|ruck | dviroel: oh man - killing everything | 20:58 |
rlandy|ruck | https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-9-standalone&branch=stable%2Fwallaby&skip=0 | 20:58 |
dviroel | thats bad | 21:01 |
dviroel | lets see | 21:01 |
rlandy|ruck | wallaby is hosed everywhere | 21:06 |
dviroel | not sure why it is failing on tripleo-ci-centos-9-standalone | 21:29 |
dviroel | saw your comments on bug | 21:29 |
dviroel | last thing in logs are nova-scheduler requesting resouces for placement | 21:29 |
dviroel | placement has no error in logs | 21:30 |
rlandy|ruck | https://composes.stream.centos.org/production/CentOS-Stream-9-20220718.0/ | 21:32 |
rlandy|ruck | we also got a new stream compose | 21:32 |
dviroel | thats it | 21:36 |
dviroel | last success: CentOS-Stream-9-20220705.0 | 21:36 |
dviroel | first failure: CentOS-Stream-9-20220718.0 | 21:37 |
rlandy|ruck | yep | 21:38 |
rlandy|ruck | looking at diff | 21:38 |
rlandy|ruck | looks like ipa-client got an update | 21:38 |
dviroel | yeah | 21:39 |
rlandy|ruck | but idk if that is the cause of the error | 21:39 |
rlandy|ruck | there are a bunch | 21:39 |
rlandy|ruck | of changes | 21:40 |
dviroel | libknet1-crypto* too | 21:41 |
rlandy|ruck | python3-sqlalchemy-1.4.37-3.el9.x86_64.rpm 2022-07-12 13:17 2.3M | 21:51 |
rlandy|ruck | dviroel: where did you see libknet1-crypt | 21:51 |
rlandy|ruck | ah | 21:52 |
rlandy|ruck | quickstart-centos-highavailability | 21:52 |
rlandy|ruck | dviroel: ok - trying to roll back both of those | 21:52 |
rlandy|ruck | libknet1.x86_64 1.24-2.el9 | 21:53 |
rlandy|ruck | quickstart-centos-highavailability | 21:53 |
rlandy|ruck | and python3-sqlalchemy.x86_64 1.4.37-3.el9 | 21:53 |
dviroel | yep, because you found the libcrypto fatal error | 21:53 |
rlandy|ruck | quickstart-centos-appstreams | 21:53 |
rlandy|ruck | because of all the sqlalchemy.errors | 21:54 |
dviroel | ack | 21:54 |
dviroel | make sense too | 21:54 |
rlandy|ruck | let me try role both of those back in release file | 21:54 |
rlandy|ruck | and see if it helps | 21:54 |
rlandy|ruck | love days like this :( | 21:54 |
dviroel | rlandy|ruck: python3-sqlalchemy is new on composes, previous compose doesn't have it | 22:05 |
rlandy|ruck | they did | 22:06 |
rlandy|ruck | diff version | 22:06 |
dviroel | no, previous jobs where installing from @delorean-wallaby-testing | 22:09 |
dviroel | http://mirror.bhs1.ovh.opendev.org:8080/rdo/centos9-wallaby/deps/latest/x86_64/ | 22:09 |
dviroel | python3-sqlalchemy-1.3.24-1.el9s.x86_64.rpm2021-12-16 14:041.7M | 22:09 |
rlandy|ruck | dviroel: pls check my proposed patch | 22:13 |
dviroel | ack | 22:13 |
rlandy|ruck | that patch will also run tripleo-ci-centos-9-undercloud-containers | 22:14 |
rlandy|ruck | so it may address both bugs | 22:14 |
rlandy|ruck | idk | 22:14 |
dviroel | rlandy|ruck: ok, looks good, if that works, we should exclude all python3-sqlalchemy* from appstream | 22:16 |
dviroel | we have a fixed version on wallaby-deps | 22:16 |
rlandy|ruck | let's see howthat goes | 22:16 |
dviroel | https://github.com/openstack/requirements/blob/stable/wallaby/upper-constraints.txt#L152 | 22:17 |
dviroel | that not python lib, scratch | 22:17 |
dviroel | but the version almost match (1.3.24-1) | 22:19 |
* dviroel dinner | 22:19 | |
*** dviroel is now known as dviroel|dinner | 22:22 | |
*** dviroel|dinner is now known as dviroel|out | 23:20 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!