Tuesday, 2024-09-24

*** bauzas_ is now known as bauzas01:15
ttxhaleyb: better if you propose it, as the one we propose is later so it gives the RC a bit less soaking time06:48
opendevreviewBoxiang Zhu proposed openstack/releases master: Add Skyline highlights (Dalmatian release)  https://review.opendev.org/c/openstack/releases/+/93026407:40
opendevreviewBoxiang Zhu proposed openstack/releases master: Add Skyline highlights (Dalmatian release)  https://review.opendev.org/c/openstack/releases/+/93026407:42
opendevreviewBoxiang Zhu proposed openstack/releases master: Add Skyline highlights (Dalmatian release)  https://review.opendev.org/c/openstack/releases/+/93026407:50
zigohberaud: Hi there! Do you know the situation wrt to Eventlet and Python 3.13 ?09:09
zigoIs the patch at https://github.com/eventlet/eventlet/pull/966 enough to fix all 3.13 issues?09:09
zigoLooks like it doesn't.09:15
zigoHere's what I get when I build greenlet with 3.13 and then run eventlet unit tests:09:34
zigohttps://paste.opendev.org/show/bUnyOgZa4DZLJnNsdKG7/09:34
zigoLooks like we're again stuck with a dnspython issue ... :/09:34
zigoAfter rebuilding greenlet + cffi for 3.13, I get these when building eventlet:10:51
zigohttps://paste.opendev.org/show/bIlUz1vnxwPegQo7qNue/10:51
zigoSo it's not fully addressed... :/10:51
elodillesstrange that https://review.opendev.org/c/openstack/nova/+/930007 patch was merged, promote job succeeded, and still we don't have reno page: https://docs.openstack.org/releasenotes/nova/2024.2.html11:10
elodillesbauzas: fyi ^^11:10
elodillesdoes anyone see how this could happen?11:12
elodillesmaybe because the stable/2024.2 job patch finished just after the job on master? https://zuul.opendev.org/t/openstack/builds?job_name=promote-openstack-releasenotes&project=openstack/nova11:15
ttxmaybe fungi can help us understand what happened there ^11:22
fungiusually it's a race condition with two release notes jobs running at the same time for different branches, where the one that was from before the branch existed finishes slower than the one with the branch present. i'll see if i can match up timings12:43
bauzas_elodilles: looking13:10
*** bauzas_ is now known as bauzas13:14
elodillesbauzas: fungi wrote already about the root cause ^^^13:16
elodillesfungi: ACK, thanks!13:16
bauzashow can we fix this ?13:17
fungiwell, i'm only just now looking13:18
fungihttps://zuul.opendev.org/t/openstack/build/3ed83f21d65c4b15b26412a8c11160e0/log/job-output.txt#150-154 says the build with the stable branch was copied into afs between 09:48:02-09:48:06 and then https://zuul.opendev.org/t/openstack/build/cb235df6a8f74e659493202cb07ca52d/log/job-output.txt#147-151 shows the version without the stable branch getting copied between 09:46:53-09:46:5613:20
fungiso the next thing to check is whether the build from 930007 actually included the stable branch notes13:21
fungithe preview build for it from the gate pipeline does contain the desired page: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_d07/930007/1/gate/build-openstack-releasenotes/d07f992/docs/2024.2.html13:23
fungioh, wait 930007 is the master branch change though13:26
fungiokay, so where i got confused is that the stable branch change (930006) does not include the page for its release notes: https://47f28db2c59a0788c3af-c883f70fc8be918d3693e4049b00789d.ssl.cf1.rackcdn.com/930006/1/gate/build-openstack-releasenotes/46b006f/docs/13:28
fungiand that published after the master branch change whose build did contain release notes for the stable branch13:29
fungiso looks like if we reenqueue 930007,1 (master branch change) into the promote pipeline, that will publish the content with the new stable branch release notes13:31
fungii'll do that momentarily13:31
bauzasthanks13:32
*** bauzas_ is now known as bauzas13:41
haleybttx: thanks, will do shortly13:50
fungihttps://docs.openstack.org/releasenotes/nova/2024.2.html works now, so yeah it was a matter of the two promote jobs being triggered so close together that the one which merged first got delayed (probably waiting for its node assignment) and ended up running later than the change which had merged second14:02
fungisince the promote pipeline is not a dependent pipeline, there is no sequencing guarantee for changes on different projects or on different branches of the same project14:03
elodillesfungi: ACK, thanks for fixing it o/14:09
bauzasfungi: thanks a lot !14:10
fungiif those two changes had been merged a little farther apart in time, it would have worked as desired14:10
fungiin zuul development we've talked about things that might fix this scenario, e.g. dynamic per-project semaphores or a branch-agnostic supersedent pipeline manager14:13
fungiit's been a while though... clarkb ^ are you aware of any more recent feature additions that might be able to address the problem of builds for different branches of a project happening in parallel in a supercedent pipeline?14:31
clarkbno I am not aware of anything14:53
clarkbI think if it were me I would remove the semaphore then use a failed_when and try to inspect the failure and determine if the failure is ignorable14:54
clarkbmaybe the rc code from rsync is different or you can check for the tmp file rename error message in stdout/stderr14:56
clarkboh wait you're talking about the sequencing issue above not the every release we remove the semaphore issue14:56
clarkbI think for that a semaphore woudl solve it but then you're back to the other problem14:57
clarkbyou could also ensure that publication occurs into distinct locations14:57
opendevreviewBrian Haley proposed openstack/releases master: RC2 patch for neutron  https://review.opendev.org/c/openstack/releases/+/93034515:01
fricklerttx: elodilles: are we ready for branching qa + reqs?15:03
elodillesfrickler: we still need horizon to branch: https://review.opendev.org/c/openstack/releases/+/93022615:04
elodillesfortunately we just got PTL-Approved+1 on it15:05
elodillesso it's waiting for a 2nd core review15:05
frickler+315:07
elodilles~o~15:07
opendevreviewMerged openstack/releases master: Cut stable/2024.2 branch for horizon  https://review.opendev.org/c/openstack/releases/+/93022615:17
elodillesgmann kopecmartin: horizon stable cut patch has merged, please go on with the QA release activities ^^^15:18
elodillesrelease-team: we still have these to decide what we should do with: https://review.opendev.org/q/topic:dalmatian-rc1-deadline+is:open15:22
elodillesas officially these are needed for requirements branching15:22
elodillesso we should decide ASAP what to do with them.15:22
elodilleseither delete them from deliverables (we didn't allow this in the past after milestone-2) or release them broken (as we had to do in the past a couple of occasions)15:23
opendevreviewMerged openstack/releases master: [ironic] Add automatic_lessee to cycle highlights  https://review.opendev.org/c/openstack/releases/+/92830515:24
fricklerI think https://review.opendev.org/c/openstack/requirements/+/929094 should also get merged before branching reqs15:24
fricklerelodilles: I think it would be good to discuss in the TC meeting later today. cc gouthamr 15:25
frickler(also sidenote: as you can see I'm back this week, but will be out for the next three weeks. so yes, I'll miss the big fun, too)15:26
elodillesfrickler: oh, a new-release patch, indeed15:27
elodillesfrickler: i'm sad to hear that :( and looking forward to your future reviews and help o:)15:42
ttxfrickler: would be good to know if we can force-merge https://review.opendev.org/c/openstack/ansible-role-thales-hsm/+/93018116:09
ttxand unblock at least this rc116:09
ttxGrzegorz Grasza: any chance you could have a look into https://review.opendev.org/c/openstack/ansible-role-thales-hsm/+/930181 ? We'd like to unblock this Barbican deliverable16:13
ttxelodilles: did you get any answer to your Zun email?16:14
fricklerttx: well technically we (infra-root) can do that, but I'm not sure how helpful that would be in the global view of things. also maybe asking for TC approval might be better?16:15
elodillesttx: no answer yet16:16
ttxfrickler: yeah, definitely TC16:16
ttxfrickler: any chance you could relay that?16:17
ttxelodilles: ok will ping again16:17
fricklerttx: I'll try to, though I may end up ending early today. I'm hoping my ping for gouthamr will take care of this, though16:19
fungiyes, i'm happy to bypass inactive reviewers and approve important changes at the direction of the tc16:20
gouthamr+1; adding this to the TC meeting agenda… frickler: would you still be around to summarize this/seed the discussion?16:21
fungiultimately it's the tc who has the decision making power over openstack's software. they delegate it to project leaders who in turn delegate it to reviewers, but the tc can also delegate that permission to me or another gerrit admin if desired16:22
fricklergouthamr: I'll try to, but I'm having a bit of a headache and I might have to close down early today16:23
gouthamrif not, let me attempt to capture the problem: we have a few unreleased components delaying our coordinated release; we need to move these forward without their PTL/release liaison approvals - because we didn’t have them in time.?16:23
fricklergouthamr: it is even worth, we did proceed already with some other projects like you described, but didn't for these remaining 4 because they also have a failing CI16:24
fricklergouthamr: the patch that ttx mentioned above would fix the CI for one project at least16:24
gouthamrah ++16:24
fricklers/worth/worse/16:25
gouthamrelodilles: was the zun email sent only to the maintainers?16:38
gouthamr(checking so I gather links/context)16:40
elodillesgouthamr: yes, we discussed to send a direct mail to PTL and not to mailing list16:40
gouthamrelodilles: ++ ack16:41
* gouthamr pings some Barbican maintainers downstream with https://review.opendev.org/c/openstack/ansible-role-thales-hsm/+/93018116:42
gouthamrawesome! That patch should be on its way to merge now :)16:51
fricklerso down to three then, thx16:51
fungiit takes a village16:52
opendevreviewGhanshyam proposed openstack/releases master: Release Tempest 41.0.0 as final tag for 2024.2  https://review.opendev.org/c/openstack/releases/+/93009317:09
gmannelodilles: thanks, ack. I will start that today17:17
gmannelodilles: ^^ tempest final release is ready 17:17
elodillesACK +2'd17:26
opendevreviewGoutham Pacha Ravi proposed openstack/releases master: Release ansible-role-thales-hsm RC1 for 2024.2 Dalmatian  https://review.opendev.org/c/openstack/releases/+/92851218:47
opendevreviewGhanshyam proposed openstack/releases master: Create stable/2024.2 for devstack  https://review.opendev.org/c/openstack/releases/+/93038120:56
opendevreviewGhanshyam proposed openstack/releases master: Create stable/2024.2 for grenade  https://review.opendev.org/c/openstack/releases/+/93038220:58
gmannelodilles: frickler ttx ^^20:59

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!