Tuesday, 2022-07-19

*** rlandy|bbl is now known as rlandy00:35
*** rlandy is now known as rlandy|out01:49
*** ysandeep|out is now known as ysandeep05:21
chkumar|roverdasm|off: thanks!05:34
*** amoralej|off is now known as amoralej06:23
jm1o/07:04
soniya29hello07:15
*** ysandeep is now known as ysandeep|lunch07:57
chkumar|rovermarios: https://review.opendev.org/c/openstack/tripleo-quickstart/+/841582 I have +wed it08:30
mariosthank you chkumar|rover 08:31
chkumar|rovermarios: thanks for addressing the comments :-)08:32
mariosthanks for thoughtful reviews chkumar|rover 08:37
reviewbotDo you want me to add your patch to the Review list? Please type something like add to review list <your_patch> so that I can understand. Thanks.08:37
*** ysandeep|lunch is now known as ysandeep09:30
*** rlandy|out is now known as rlandy10:23
rlandychkumar|rover: hey - how are you?10:23
chkumar|roverrlandy: same status still fighting with ovn10:24
chkumar|roverrlandy: train promoted 10:24
rlandyoctavia and tripleo master should have promoted10:24
rlandyand your patch merged10:24
rlandywhat is missing10:24
rlandywallaby I see tripleo fs001 is still missing10:24
chkumar|roverrlandy: https://bugs.launchpad.net/tripleo/+bug/1981829/comments/610:24
rlandyyou can skip and promote if need be10:24
rlandychkumar|rover: did it work in previous testproject10:25
chkumar|roverrlandy: nope10:25
rlandychkumar|rover: let's chat10:25
chkumar|rovertripleo-ci is not yet merged10:25
rlandychkumar|rover: https://meet.google.com/akv-cnwk-rqg10:27
chkumar|roverhttps://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-17-rhel9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-9-ovb-3ctlr_1comp-featureset035-internal-rhos-17/5a12d18/job-output.txt10:33
chkumar|roverhttps://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-17-rhel9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-9-ovb-3ctlr_1comp-featureset035-internal-rhos-17/b63f8e9/job-output.txt10:33
chkumar|roverhttps://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-17-rhel9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-9-ovb-3ctlr_1comp-featureset035-internal-rhos-17/c12cfaf/job-output.txt10:34
rlandyfrenzy_friday: hello10:40
rlandyfrenzy_friday: let's touch base re: 17.210:40
rlandy17.110:40
frenzy_fridayrlandy, yep sure, 5 mins - updating a patch10:41
rlandyfrenzy_friday: pls ping when ready10:42
chkumar|roverykarel: hello10:47
chkumar|roverykarel: can you take a look at this log https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-17-rhel9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-9-ovb-3ctlr_1comp-featureset035-internal-rhos-17/5a12d18/job-output.txt when free10:47
chkumar|rover503 Service Unavailable: No server is available to handle this request while creating private network10:48
rlandymarios: hello10:48
rlandymarios: so I took a guess and removed the depends-on - see it made no difference :(10:49
mariosrlandy: o/ it worked actually10:49
rlandymarios: what? still failing ci10:49
ykarelchkumar|rover, hi10:49
mariosrlandy: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/841764/32..33//COMMIT_MSG#b1610:49
ykarelchkumar|rover, is it consistently failing like that?10:49
ykareland only fs035 or all ovbs?10:50
chkumar|roverykarel: only fs03510:50
mariosrlandy: yeah but it passed the undercloud-upgrade there https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/841764/32..33#message-de9febad1eb2814dd7482a05169cc49eba182e8c tripleo-ci-centos-9-undercloud-upgrade https://zuul.opendev.org/t/openstack/build/4ffe5d68aac2486ca124438e6c0042e6 : SUCCESS in 1h 05m 25s10:50
chkumar|roverykarel: check the above 4 logs10:50
frenzy_fridayrlandy, bhagyashris I am ready to sync now10:50
rlandymarios: ok - I thought that might be happening10:50
ykarelchkumar|rover, ok will check10:50
rlandymarios: that the depends-on gating was taking preference10:50
chkumar|roverykarel: thanks!10:50
mariosrlandy: yeah it was using the wallaby templates as the target of the upgrade10:50
rlandymarios: ok- well hope it helped10:51
mariosrlandy: so it was nothing in the depends-on per se (that file isn't used there at all) just that it was fetching wallaby 10:51
mariosrlandy: thank you!10:51
mariosrlandy: i went to try exactly what you already did and found your update10:51
rlandymarios: sure - it was just a suspicion - no smarts involved10:51
rlandyfrenzy_friday: bhagyashris: https://meet.google.com/vau-ikvw-auw?pli=1&authuser=010:52
rlandysoniya29: I need to move your 1-110:52
rlandyhave a manager meeting then10:52
rlandywill reschedule10:52
soniya29rlandy, okay, no problem10:52
bhagyashris rlandy give me in10:54
rlandyfrenzy_friday: https://code.engineering.redhat.com/gerrit/gitweb?p=openstack/tripleo-ci-internal-config.git;a=blob;f=zuul.d/dlrn-jobs.yaml;h=8528590b81baf3135387624841b6fa39ba5305c8;hb=HEAD#l11111:00
marios;) plenty smarts involved rlandy !11:03
rlandymarios: hmmm ... so that's a real issue with any stable branch depends-on and update - wonder why we have not seen that before11:06
mariosrlandy: right maybe we can tweak build-test-packages to deal with that ... but not sure how (you *want* it to include the depends-on... :/11:12
mariosrlandy: otherwise, it means we cant *test* the upgrade job of our branchless repos with depends-on.. so we'll have to enforce the depends-on ourselves (like merge the stable/wallaby whatever then the quickstart). in this case the depends-on wasn't actually needed (it was in an earlier version)11:15
rlandymarios: right, so in this case it's not actually needed11:21
rlandybut if it was, we'd be in ttouble11:21
rlandytrouble11:21
rlandyidk - will have to ask chkumar|rover to weigh in here when he is off rr11:21
ykarelchkumar|rover, is bug already created for that?11:22
rlandybhagyashris++ on image builds11:22
chkumar|roverykarel: not yet11:22
chkumar|roverykarel: let me create that one11:22
ykarelchkumar|rover, ok create, that's happening post switch to ovn clustering11:22
frenzy_fridayIn the container build job: "docker-registry.upshift.redhat.com/tripleorhos-17-1-rhel-9/openstack-base:e5487fd0f4cd374bd3a2f681c7b8e11b\\" in local containers storage"\nunauthorized: authentication require Do we need to create tripleorhos-17-1-rhel-9/ registry first?11:25
*** dviroel|out is now known as dviroel11:27
rlandyfrenzy_friday: ack - we need to create that registry for you11:30
rlandyfrenzy_friday: you need the new namespace11:30
* rlandy needs to dig out how11:31
frenzy_fridayalso do we need a 17-1 file here https://code.engineering.redhat.com/gerrit/gitweb?p=tripleo-environments.git;a=tree;f=config/release;h=b04d922e4b536e2d847461860d73811f54bde2da;hb=HEAD ?11:31
rlandyfrenzy_friday: in the mean time, you can continue with making sure all the containers build buy setting  the push var to false11:31
frenzy_fridayack11:32
rlandyfrenzy_friday: ack - you need that release file11:32
rlandyfrenzy_friday: bhagyashris must have it11:32
rlandyused for image builds11:32
rlandyfrenzy_friday: bhagyashris: you could merge that file11:32
rlandyif you both need it11:32
rlandyfrenzy_friday: give me a few11:32
rlandywill dig up the namespace creation stuff11:33
chkumar|roverykarel: rlandy fyi rhos-17 rhel-9 blocker bug https://bugzilla.redhat.com/show_bug.cgi?id=210858011:34
chkumar|roveremail sent11:38
rlandychkumar|rover: thank you11:38
ykarelchkumar|rover, ack will add details11:44
chkumar|roverykarel: ++ thank you :-)11:45
chkumar|roverrlandy: dasm|off cs9 wallaby promoted https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43692 <- please merge the revert11:54
rlandychkumar|rover: done - thanks11:55
bhagyashrisrlandy, i don't have +W rights...11:58
rlandybhagyashris: pls pass me patch and I will merge11:58
bhagyashrishttps://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/41702011:58
chkumar|roverbhagyashris: frenzy_friday left minute comments https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/41702012:01
*** ysandeep is now known as ysandeep|break12:02
bhagyashrischkumar|rover, ack12:05
*** amoralej is now known as amoralej|lunch12:08
bhagyashrischkumar|rover, Done12:15
bhagyashris?ME stepping out for bit12:15
* bhagyashris stepping out for bit12:15
chkumar|roverrlandy: dasm|off stepping out for an hour12:21
*** ysandeep|break is now known as ysandeep|mtg12:33
rlandyfrenzy_friday: registry namespace added - pls try push containers now12:35
rlandynamespace=tripleorhos-17-1-rhel-912:35
rlandyfrenzy_friday: let me know if that does not wor12:40
rlandythen I need to fix permissions12:40
ykarelchkumar|rover, pushed testpatch to test potential fix https://code.engineering.redhat.com/gerrit/c/testproject/+/42054412:46
ykarelhope depends-on works on 17trunk branch12:47
rlandyfrenzy_friday: rechecked testproject12:49
rlandymarios: 1-1 clashes with all hands12:51
rlandymoving12:52
*** ysandeep|mtg is now known as ysandeep12:58
mariosrlandy: ack np thanks12:58
*** amoralej|lunch is now known as amoralej13:00
frenzy_fridayrlandy, thanks13:14
frenzy_fridaysorry went for lunch13:15
rlandyfrenzy_friday: you need an update on tripleo-environments file13:19
rlandyosptrunk-candidate-deps and  osp-trunk-deps13:19
rlandyuses rhel-913:19
rlandynot distr_ver13:19
rlandycompare with 17 file13:20
rlandypls pdate13:20
rlandyand rerun13:20
frenzy_fridayrlandy, here https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/417020/3/config/release/tripleo-ci/RedHat-9/rhos-17.1.yml#105 ?13:22
rlandyfrenzy_friday: and 11613:23
rlandycompare with cuurent 17.0 file13:23
bhagyashrisrlandy, i have updated that as per chkumar|rover comments13:23
rlandyit's the wrong link13:23
rlandywon't resolve13:23
rlandyjobs are failing now13:23
bhagyashrisok will rever the change13:23
bhagyashrisrevert*13:23
frenzy_fridayrlandy, I see a comment from chandan https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/417020/1..3/config/release/tripleo-ci/RedHat-9/rhos-17.1.yml#b10513:24
rlandybhagyashris: rhel-9 vs rhel9 :)13:24
frenzy_fridayohh ok, changing back then13:24
bhagyashrisfrenzy_friday, yeah patch set is ok13:24
bhagyashrisso we can use the patch set 1 re reupload 13:24
frenzy_fridaybhagyashris, yep, changing back13:25
bhagyashrisok thanks 13:25
bhagyashrisarxcruz, rlandy, marios, ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat, chandankumar, frenzy_friday, anbanerj, dviroel, rcastillo, dasm, jm1, marios, chkumar|rover dasm|off 13:30
bhagyashrisTripleo CI community call13:30
bhagyashrishttps://hackmd.io/MMg4WDbYSqOQUhU2Kj8zNg?both#2022-07-19-Community-Call @ line 3013:31
*** dasm|off is now known as dasm|ruck13:31
bhagyashrisrlandy, ysandeep rcastillo dviroel ^13:31
bhagyashrisarxcruz, ^13:31
rlandyfrenzy_friday: https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/417020/3..4/config/release/tripleo-ci/RedHat-9/promotion-testing-hash-rhos-17.1.yml13:34
rlandyno diff13:34
frenzy_fridayupdating it13:35
Tenguthat was a really, really short call :)13:35
rlandyyep13:36
dasm|rucko/13:36
rlandydasm|ruck: hey 13:36
jm1Tengu: shortest call ever ^^13:36
Tengusmall sharing - RDO seems broken again with the node provisioning.13:36
rlandydasm|ruck: chkumar|rover has the updates for you13:36
frenzy_fridayupdated now13:36
dasm|ruckrlandy: checking the hackmd13:36
rlandyhttps://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001&skip=013:37
rlandyyep13:37
rlandyall broken13:37
dasm|ruck> [H[J[1;1Herror: ../../grub-core/disk/diskfilter.c:916:diskfilter writes are not13:38
* rlandy need to run to complex management office - brb13:38
jm1chkumar|rover, dasm|ruck: breaking patch in aoc incoming. tripleo should be safe by now but in case you see messages like "To utilize this module, the installed version of the openstacksdk library MUST be >=0.99.", then please ping me!  https://review.opendev.org/c/openstack/ansible-collections-openstack/+/85004013:44
jm1rlandy: fyi ^13:44
mariosTengu: fyi added yr reviews to the ci reviews list @ https://hackmd.io/FGMoCiRfSNa8puA1BpTQ-Q?edit should get some attention13:44
reviewbotDo you want me to add your patch to the Review list? Please type something like add to review list <your_patch> so that I can understand. Thanks.13:44
Tengumarios: ah, thanks!13:45
Tengudidn't know where to put them..13:45
chkumar|roveramoralej: hello13:53
amoralejhi chkumar|rover 13:53
rlandyjm1: pls note that rcastillo is out today13:53
chkumar|roveramoralej: regarding rabbitmq change, fs01 is good on wallaby13:53
rlandyso if we need a revert is the later hours13:53
rlandywho can do it?13:53
chkumar|roveramoralej: https://review.opendev.org/c/openstack/tripleo-quickstart/+/848439/4#message-c0a1106e4aa3ad3982cc4ab6fb52a240c3af278813:53
chkumar|roverwe can go ahead with rabbitmq change13:54
amoralejack, chkumar|rover i'll let maintainer know13:54
jm1rlandy: jm1[m] is always on ;)13:57
jm1rlandy: i will monitor my phone today but i do not expect any tripleo failure due to that patch14:00
rlandyjm1; let's hope14:01
amoralejchkumar|rover, tagged, let us know if you notice something abnormal14:02
chkumar|roveramoralej: sure14:02
chkumar|roverdasm|ruck: tldr of today's rr14:03
chkumar|roverrhos-17 rhel-9 blocked on https://bugzilla.redhat.com/show_bug.cgi?id=210858014:03
chkumar|rovercs8 train promoted today14:03
chkumar|rovercs9 wallaby promoted today by removing ovn job14:04
chkumar|roverovn job is not yet fixed for wallaby and master14:04
dasm|ruck:(14:04
chkumar|roverfor cs9 master node provisioning issue https://bugs.launchpad.net/tripleo/+bug/198213714:04
dasm|ruckack, i just noticed that one14:05
chkumar|roverif we get any good hash with all job passing except fs035 we can promote the master line14:05
chkumar|roverthat's the story of today14:05
dasm|ruckk. that's reassuring.14:05
dasm|rucklet's hope we're gonna have one14:05
dasm|ruckchkumar|rover: do you have any close-to-working one?14:06
chkumar|roverdasm|ruck: https://review.rdoproject.org/r/c/testproject/+/44037/1/.zuul.yaml14:08
dasm|ruckk, thx14:09
dasm|ruckchkumar|rover: did you mention that we're still having ovn issues? periodic-tripleo-ci-centos-9-scenario010-ovn-provider-standalone-master14:09
chkumar|roverbut node provision issue related to cs914:09
chkumar|roverdasm|ruck: yes, gthiemonge is working on that14:09
dasm|ruckack14:10
dasm|ruckso, not only  fs035 but also sc010 needs to be skipped?14:10
chkumar|roverdasm|ruck: yes14:11
dasm|ruckack14:11
chkumar|roverdasm|ruck: for rhos17 rhel9 ykarel is testing a fix here https://code.engineering.redhat.com/gerrit/c/testproject/+/42054414:21
dasm|ruckack14:21
*** ysandeep is now known as ysandeep|dinner14:28
*** ysandeep|dinner is now known as ysandeep15:02
rlandyhttps://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-9-undercloud-upgrade&skip=015:30
rlandychkumar|rover: dasm|ruck: ^^ know about that failure?15:30
rlandy+ exec /usr/bin/bootstrap_host_exec barbican_api su barbican -s /bin/bash -c ''\''/usr/bin/barbican-manage' db upgrade \'15:31
rlandyERROR: The argument passed to Dialect.has_table() should be a <class 'sqlalchemy.engine.base.Connection'>, got <class 'sqlalchemy.engine.base.Engine'>. Additionally, the Dialect.has_table() method is for internal dialect use only; please use ``inspect(some_engine).has_table(<tablename>>)`` for public API use.15:31
rlandy2022-07-19 14:47:30.167132 | bc764e10-166d-75f8-aa89-0000015:31
dasm|ruckno. i didn't notice that yet15:31
dasm|ruck> "Failed containers: barbican_api_db_sync"}15:31
dasm|ruck> ERROR: Can't run container barbican_api_db_sync15:31
rlandydasm|ruck: can you log and investigate?15:32
dasm|ruckall of them fail due to aforementioned error15:32
dasm|rucki'm gonna submit a bug15:32
dasm|ruckhttps://bugs.launchpad.net/tripleo/+bug/198219515:36
*** amoralej is now known as amoralej|off15:46
dasm|ruckI'm gonna need some help to triage it further. I don't see any changes to kolla: https://review.opendev.org/q/repo:+openstack/kolla15:51
dasm|ruckand barbican seems to be clear from changes too: https://review.opendev.org/q/repo:+openstack/barbican15:52
dasm|ruckI don't see any updates to sqlalchemy happening recently15:53
dasm|ruckIt seems that we're not building the barbican component by ourselves15:54
rlandyfrenzy_friday: "success": true,15:56
*** marios is now known as marios|out15:58
dasm|ruckchkumar|rover: i saw you updated the bug. Thanks. Do you have any pointers? Ideas where to look for the issue?15:59
rlandyfrenzy_friday: bhagyashris: pls bring your 17.1 patches to the review meeting tomorrow15:59
rlandyand we can merge up15:59
rlandyfrenzy_friday: bhagyashris: you should be able to try a standalone. multinode and a few scenraios15:59
rlandythen build the mini line15:59
rlandyafter standalone works15:59
chkumar|roverdasm|ruck: there is another file https://536ba7636eca1576ae9f-4e53ffd70f9f0b38678a1c719bbe7de3.ssl.cf2.rackcdn.com/850349/1/check/tripleo-ci-centos-9-undercloud-upgrade/f43c1b0/logs/undercloud/var/log/extra/podman/containers/barbican_api_db_sync/podman_info.log16:00
rlandyyou can promote to current-tripleo16:00
frenzy_fridayrlandy, awesome!16:00
chkumar|rovermay be compairing the rpm with the passing one16:00
rlandychkumar|rover: dasm|ruck: pls let me know what I am watching when you guy are out later16:00
dasm|ruckrlandy: ack16:00
chkumar|roverdasm|ruck: https://536ba7636eca1576ae9f-4e53ffd70f9f0b38678a1c719bbe7de3.ssl.cf2.rackcdn.com/850349/1/check/tripleo-ci-centos-9-undercloud-upgrade/f43c1b0/logs/undercloud/var/log/extra/podman/containers/barbican_api/podman_info.log16:01
chkumar|roverhere is the rpm list16:01
chkumar|roverit is not in above container16:01
chkumar|roverpython3-sqlalchemy.x86_64                      1.4.37-3.el9                          @quickstart-centos-appstreams16:02
dasm|ruckhmm.. there was no update to sqlalchemy in some time. So, it's centos internal update then...16:03
chkumar|roverhttps://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_526/850044/1/check/tripleo-ci-centos-9-undercloud-upgrade/5268c4d/logs/undercloud/var/log/extra/podman/containers/index.html16:04
chkumar|roverin passing job there is no barbican container16:04
chkumar|roverwhat is going on16:04
dasm|rucki didn't see barbican there16:04
chkumar|roverdasm|ruck: I will take a look tomorrow16:04
dasm|ruckyes16:04
chkumar|roversee ya!16:05
chkumar|roverplease leave notes16:05
dasm|ruckchkumar|rover: take care ;/16:05
dasm|rucko/16:05
dasm|ruckofc16:05
dasm|ruckit looks like we might started building barbican containers from scratch? idk16:05
dasm|ruckbrb16:06
dasm|ruckback16:11
*** ysandeep is now known as ysandeep|afk16:18
*** ysandeep|afk is now known as ysandeep|out16:38
bhagyashrisrlandy, ack16:41
dasm|ruck> openstack-periodic-integration-main just started16:42
rlandydasm|ruck: need something16:48
rlandyotherwise going to ceph stuff16:48
dasm|ruckrlandy: not at the moment, thank you16:49
dasm|ruckrlandy: i'm goin afk for few hours. Currently the only missing thing is cs9 master -- promotion is in progress, but I wouldn't count on flawless pass. chkumar|rover tried rerunning failing jobs, without a success: https://review.rdoproject.org/r/c/testproject/+/4403717:39
dasm|ruckWe're also seeing rh9 osp17 issues wrt fs035.17:40
dasm|ruckI left all notes in the hackmd: https://hackmd.io/KrGAxws2QiaHuJmj8TH6Jg#2022-07-2017:40
rlandyok - will watch17:40
*** rlandy is now known as rlandy|ruck17:40
dasm|ruckI'm gonna check back in 2-3 hours17:40
dasm|ruckTnanks rlandy|ruck++17:41
*** dasm|ruck is now known as dasm|off17:48
rlandy|ruckdasm|off: dviroel: looks like wallaby undercloud containers failure is also barbican related20:14
dviroelah ok, thanks20:15
rlandy|rucklooks like barbican belongs to secuirty20:24
rlandy|ruckmay be a change of what we promoted up20:24
dviroelrlandy|ruck: is tomorrow the new deadline for getting wallaby patches?20:35
rlandy|ruckdviroel: yeah - but not major ofr us20:36
rlandy|rucklanded on trunk patches20:36
dviroelrlandy|ruck: got it, not on us -  tks20:41
rlandy|ruckdviroel: oh man - killing everything20:58
rlandy|ruckhttps://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-9-standalone&branch=stable%2Fwallaby&skip=020:58
dviroelthats bad21:01
dviroellets see21:01
rlandy|ruckwallaby is hosed everywhere21:06
dviroelnot sure why it is failing on tripleo-ci-centos-9-standalone21:29
dviroelsaw your comments on bug21:29
dviroellast thing in logs are nova-scheduler requesting resouces for placement21:29
dviroelplacement has no error in logs21:30
rlandy|ruckhttps://composes.stream.centos.org/production/CentOS-Stream-9-20220718.0/21:32
rlandy|ruckwe also got a new stream compose21:32
dviroelthats it21:36
dviroellast success: CentOS-Stream-9-20220705.021:36
dviroelfirst failure: CentOS-Stream-9-20220718.021:37
rlandy|ruckyep21:38
rlandy|rucklooking at diff21:38
rlandy|rucklooks like ipa-client got an update21:38
dviroelyeah21:39
rlandy|ruckbut idk if that is the cause of the error21:39
rlandy|ruckthere are a bunch21:39
rlandy|ruckof changes21:40
dviroellibknet1-crypto* too21:41
rlandy|ruckpython3-sqlalchemy-1.4.37-3.el9.x86_64.rpm                              2022-07-12 13:17  2.3M  21:51
rlandy|ruckdviroel: where did you see libknet1-crypt21:51
rlandy|ruckah21:52
rlandy|ruckquickstart-centos-highavailability21:52
rlandy|ruckdviroel: ok - trying to roll back both of those21:52
rlandy|rucklibknet1.x86_64                             1.24-2.el9  21:53
rlandy|ruckquickstart-centos-highavailability21:53
rlandy|ruckand python3-sqlalchemy.x86_64                   1.4.37-3.el9   21:53
dviroelyep, because you found the libcrypto fatal error21:53
rlandy|ruckquickstart-centos-appstreams  21:53
rlandy|ruckbecause of all the sqlalchemy.errors21:54
dviroelack21:54
dviroelmake sense too21:54
rlandy|rucklet me try role both of those back in release file21:54
rlandy|ruckand see if it helps21:54
rlandy|rucklove days like this :(21:54
dviroelrlandy|ruck: python3-sqlalchemy is new on composes, previous compose doesn't have it22:05
rlandy|ruckthey did22:06
rlandy|ruckdiff version22:06
dviroelno, previous jobs where installing from @delorean-wallaby-testing22:09
dviroelhttp://mirror.bhs1.ovh.opendev.org:8080/rdo/centos9-wallaby/deps/latest/x86_64/22:09
dviroelpython3-sqlalchemy-1.3.24-1.el9s.x86_64.rpm2021-12-16 14:041.7M22:09
rlandy|ruckdviroel: pls check my proposed patch22:13
dviroelack22:13
rlandy|ruckthat patch will also run tripleo-ci-centos-9-undercloud-containers22:14
rlandy|ruckso it may address both bugs22:14
rlandy|ruckidk22:14
dviroelrlandy|ruck: ok, looks good, if that works, we should exclude all python3-sqlalchemy* from appstream22:16
dviroelwe have a fixed version on wallaby-deps22:16
rlandy|rucklet's see howthat goes22:16
dviroelhttps://github.com/openstack/requirements/blob/stable/wallaby/upper-constraints.txt#L15222:17
dviroelthat not python lib, scratch22:17
dviroelbut the version almost match (1.3.24-1)22:19
* dviroel dinner22:19
*** dviroel is now known as dviroel|dinner22:22
*** dviroel|dinner is now known as dviroel|out23:20

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!