*** amoralej|off is now known as amoralej | 07:11 | |
frickler | I think I found another bug in reno. for n-d-r, the last patch before zed was branched added some release notes for that cycle. this patch got merged natively without a merge commit and tagged as 21.0.0. the notes in it now show up both in the zed branch and in 2023.1 https://docs.openstack.org/releasenotes/neutron-dynamic-routing/2023.1.html | 07:35 |
---|---|---|
frickler | hmm, maybe that will resolve itself once 22.0.0 is tagged | 07:38 |
opendevreview | Thierry Carrez proposed openstack/releases master: Release swift 2.31.1 and cut branch stable/2023.1 https://review.opendev.org/c/openstack/releases/+/876579 | 08:21 |
ttx | johnsom: good catch... I should really have pushed back a lot more when stable/2023.1 -style branch names were mandated... I knew it would break a bunch of tooling at the worst possible time | 08:30 |
ttx | This will block all RC2s and final release. | 08:33 |
elodilles | oh, another stable/2023.1 branch name issue :S i'll look into it when i get there today | 08:53 |
opendevreview | Merged openstack/releases master: Release blazar-tempest-plugin for 2023.1 Antelope https://review.opendev.org/c/openstack/releases/+/876602 | 09:01 |
opendevreview | Merged openstack/releases master: Release designate-tempest-plugin for 2023.1 Antelope https://review.opendev.org/c/openstack/releases/+/876606 | 09:01 |
opendevreview | Merged openstack/releases master: Release cinder-tempest-plugin for 2023.1 Antelope https://review.opendev.org/c/openstack/releases/+/876603 | 09:01 |
opendevreview | Merged openstack/releases master: Release octavia-tempest-plugin for 2023.1 Antelope https://review.opendev.org/c/openstack/releases/+/876617 | 09:01 |
opendevreview | Merged openstack/releases master: Add Axel as release liaison https://review.opendev.org/c/openstack/releases/+/876990 | 09:01 |
opendevreview | Merged openstack/releases master: Release swift 2.31.1 and cut branch stable/2023.1 https://review.opendev.org/c/openstack/releases/+/876579 | 09:01 |
elodilles | OK, so now swift has also branched. now we only have: devstack, grenade, and requirements to branch | 09:05 |
elodilles | if i'm not mistaken branching devstack & grenade is the part of QA team's release task, so i'll ping the team | 09:06 |
hberaud | I'll update the requirement patch | 09:25 |
opendevreview | Hervé Beraud proposed openstack/releases master: Branch requirements for stable/2023.1 https://review.opendev.org/c/openstack/releases/+/876576 | 09:27 |
hberaud | done ^ | 09:28 |
hberaud | I'll also rerun check to see if we not missed some branching | 09:29 |
hberaud | normally everything is branched | 09:29 |
tkajinam | hberaud, there is one requirement bump still kept. you may want to merge it first. I have to head off now but I believe the issue with heat unit tests have been sorted. https://review.opendev.org/c/openstack/requirements/+/874234 | 09:35 |
hberaud | tkajinam: ack thanks for the heads up | 09:35 |
hberaud | I'll update the branch cut once this one is merged | 09:36 |
hberaud | Well, the check' outputs only list the requirements deliverables as unbranched yet | 09:38 |
elodilles | yes, though devstack and grenade needs to be branched, too | 09:52 |
opendevreview | Sylvain Bauza proposed openstack/releases master: WIP: Propose Nova deadlines for Bobcat schedule https://review.opendev.org/c/openstack/releases/+/877094 | 12:00 |
opendevreview | Hervé Beraud proposed openstack/releases master: Branch requirements for stable/2023.1 https://review.opendev.org/c/openstack/releases/+/876576 | 13:43 |
hberaud | tkajinam: FYI ^ | 13:43 |
*** amoralej is now known as amoralej|lunch | 13:45 | |
tkajinam | hberaud, thanks ! | 13:46 |
elodilles | reminder: meeting will start in 5 mins | 13:55 |
hberaud | ack | 13:55 |
elodilles | #startmeeting releaseteam | 14:00 |
opendevmeet | Meeting started Fri Mar 10 14:00:07 2023 UTC and is due to finish in 60 minutes. The chair is elodilles. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
opendevmeet | The meeting name has been set to 'releaseteam' | 14:00 |
hberaud | o/ | 14:00 |
elodilles | Ping list: hberaud armstrong elodilles | 14:00 |
ttx | o/ | 14:00 |
elodilles | #link https://etherpad.opendev.org/p/antelope-relmgt-tracking | 14:00 |
elodilles | o/ | 14:00 |
elodilles | we are doooown at Line 400 | 14:01 |
elodilles | R-2 | 14:01 |
elodilles | scary | 14:01 |
elodilles | let's start :) | 14:02 |
hberaud | yeah | 14:02 |
elodilles | #topic Review task completion | 14:02 |
elodilles | 1st task was: | 14:02 |
elodilles | 'On Monday, W+1 the https://review.opendev.org/q/topic:antelope-rc1-deadline entries that had no responses from PTLs (ttx)' | 14:02 |
hberaud | done | 14:03 |
elodilles | everything has merged \o/ | 14:03 |
elodilles | yepp | 14:03 |
elodilles | next task then: | 14:03 |
ttx | \o/ | 14:03 |
elodilles | 'Look up why reno includes all versions in 2023.1 series release notes (ttx, but welcomes help)' | 14:03 |
ttx | So with frickler's help that was solved afaik | 14:04 |
ttx | We got a reno 4.0.0 fixing that | 14:04 |
elodilles | even the upper constraint is bumped | 14:04 |
ttx | There might be a remaining issue but we'll likely see better once the final notes are generated | 14:04 |
elodilles | i've seen questions from teams, that they now realised the issue, | 14:05 |
elodilles | i told them that it is fixed with latest reno | 14:05 |
ttx | ah ok | 14:05 |
elodilles | the question is when will their reno page refreshed | 14:05 |
ttx | at final release for sure | 14:06 |
ttx | (for RC things) | 14:06 |
ttx | for the CWI things less sure | 14:06 |
elodilles | hmmm, I thought it will be refreshed sooner, with for example a merged patch on that project or something | 14:07 |
elodilles | (of course it depends, which happens earlier...) | 14:07 |
ttx | ok let's just wait and see | 14:08 |
elodilles | ttx: ack | 14:08 |
elodilles | i'll try to not forget this and if nothing will be refreshed then I guess we can ask infra team whether they know any trick | 14:08 |
elodilles | anyway, thanks for the fix \o/ | 14:09 |
elodilles | let's move on | 14:09 |
elodilles | ' During the week, process any https://review.opendev.org/q/topic:antelope-rc1-deadline with exceptions (those with PTL -1) (all)' | 14:09 |
ttx | done too | 14:10 |
elodilles | yes, this is the same as 1st task | 14:10 |
elodilles | 'Gracefully release tempest plugins with latest changes available (elod)' | 14:10 |
elodilles | release patches were proposed: https://review.opendev.org/q/topic:antelope-tp-latest | 14:10 |
ttx | all but 4 are arppoved or merged | 14:10 |
elodilles | we are over the deadline, | 14:11 |
elodilles | we haven't got -1s | 14:11 |
elodilles | so feel free to review and +2 them if everything looks fine | 14:11 |
ttx | yes those last 4 are probably good to go now | 14:12 |
elodilles | yepp | 14:12 |
ttx | alright, all enqueued | 14:13 |
elodilles | cool, thanks \o/ | 14:13 |
elodilles | 'On Monday, generate stable branches for all cycle deliverables that are still missing one (hberaud)' | 14:13 |
elodilles | patches were proposed: https://review.opendev.org/q/topic:antelope-branching-cwi-others | 14:13 |
elodilles | thanks hberaud | 14:13 |
ttx | are we ready to pull the trigger on requirements ? | 14:14 |
elodilles | requirements is the last remaining | 14:14 |
hberaud | only the requirements patch remains https://review.opendev.org/c/openstack/releases/+/876576 | 14:14 |
elodilles | well, devstack and grenade haven't branched yet, but I think that can happen parallel, right? | 14:14 |
hberaud | ttx: normally yes but I'd suggest to grab feedback from prometheanfire ^ | 14:14 |
hberaud | elodilles: I think yes | 14:14 |
ttx | yeah, that can be done early next week alright | 14:15 |
elodilles | so we are good with this task i think | 14:15 |
elodilles | next task then: | 14:16 |
elodilles | 'After all the projects enabled in devstack by default have been branched, we can engage with the (elod)' | 14:16 |
elodilles | somewhat related, as needed to wait until everything have branched | 14:16 |
elodilles | so today I've pinged QA team on IRC | 14:16 |
elodilles | so they will start doing QA release tasks | 14:17 |
elodilles | I've sent a mail to i18n SIG chair, Ian, today | 14:17 |
elodilles | and I haven't pinged requirements PTL yet | 14:18 |
fungi | though the requirements ptl also hangs out in here ;) | 14:19 |
elodilles | but it's main part is the requirements branching patch: https://review.opendev.org/c/openstack/releases/+/876576 | 14:20 |
ttx | fungi: do you see a convenient way to force refresh of all release notes to pick up reno 4? | 14:20 |
elodilles | that we talked about earlier :) | 14:20 |
fungi | ttx: not really, unless we added periodic docs build jobs for all projects | 14:20 |
fungi | that's probably the simplest solution other than waiting for eventual consistency | 14:21 |
ttx | ok maybe let's wait until that solves itself | 14:21 |
elodilles | :S | 14:22 |
opendevreview | Merged openstack/releases master: Release keystone-tempest-plugin for 2023.1 Antelope https://review.opendev.org/c/openstack/releases/+/876612 | 14:22 |
opendevreview | Merged openstack/releases master: Release magnum-tempest-plugin for 2023.1 Antelope https://review.opendev.org/c/openstack/releases/+/876627 | 14:22 |
opendevreview | Merged openstack/releases master: Release monasca-tempest-plugin for 2023.1 Antelope https://review.opendev.org/c/openstack/releases/+/876615 | 14:22 |
elodilles | so, back to the task: | 14:22 |
elodilles | prometheanfire: please review https://review.opendev.org/c/openstack/releases/+/876576 && it's time to announce that the requirements freeze is lifted from master | 14:22 |
opendevreview | Merged openstack/releases master: Release cloudkitty-tempest-plugin for 2023.1 Antelope https://review.opendev.org/c/openstack/releases/+/876604 | 14:23 |
elodilles | done o:) | 14:23 |
elodilles | next task then: | 14:23 |
elodilles | 'Ensure that all projects that are publishing release notes have the notes link included in their deliverable file (hberaud)' | 14:24 |
elodilles | patch is proposed: https://review.opendev.org/c/openstack/releases/+/876952 | 14:24 |
ttx | most objections have been about the rreno 4 issue | 14:24 |
ttx | which imho should not block that patch | 14:24 |
hberaud | +1 | 14:25 |
ttx | ok will +2 | 14:25 |
elodilles | ++ | 14:25 |
elodilles | thanks. | 14:25 |
hberaud | another round can be done next week | 14:25 |
elodilles | let's not spam PTLs further :) simply merge it :) | 14:25 |
ttx | yes needs to add up nova again | 14:25 |
elodilles | hberaud: sounds good | 14:25 |
ttx | +2a | 14:25 |
elodilles | for the record, now that hberaud fixed the reno link script, I've checked that if there are missing reno links from old releases | 14:26 |
elodilles | and proposed these: https://review.opendev.org/q/topic:missing-reno-links | 14:27 |
hberaud | good | 14:27 |
opendevreview | Merged openstack/releases master: Release mistral-tempest-plugin for 2023.1 Antelope https://review.opendev.org/c/openstack/releases/+/876614 | 14:27 |
opendevreview | Merged openstack/releases master: Release kuryr-tempest-plugin for 2023.1 Antelope https://review.opendev.org/c/openstack/releases/+/876628 | 14:27 |
elodilles | when you have time to review them I think those can be merged as well | 14:27 |
elodilles | but this is not a priority | 14:28 |
elodilles | so let's move on | 14:28 |
elodilles | 'Let cycle-with-rc projects iterate on RCs as needed. The final release candidate for each project needs to be prepared at least one week before the final release date (all)' | 14:28 |
elodilles | well, this is not really a task, but a reminder ^^^ | 14:28 |
*** amoralej|lunch is now known as amoralej | 14:28 | |
elodilles | we still need to do this next week | 14:29 |
ttx | also they currently can't do RC2s | 14:29 |
elodilles | though i haven't heard many RC2s yet | 14:29 |
ttx | due to next topic | 14:29 |
ttx | RC@s fail tests | 14:29 |
elodilles | yepp | 14:29 |
ttx | RC2s | 14:29 |
elodilles | let's move on to the next topic then, as we are done with the tasks | 14:29 |
elodilles | #topic Critical issue with stable/2023.1 releases failing validation with error: "did not find remotes/origin/stable/antelope in branches containing..." | 14:30 |
elodilles | Call needs to be updated to not rely on file path at https://github.com/openstack/releases/blob/master/openstack_releases/cmds/validate.py#L1412 | 14:30 |
elodilles | I've started to look into this, but i had only a little time yet | 14:30 |
ttx | Since I'm not around next week i haven't even tried | 14:30 |
ttx | but we need a fix up asap otherwise we won;t have any RC2s | 14:31 |
elodilles | yes | 14:31 |
ttx | or fainl release for the matter | 14:31 |
ttx | final* | 14:31 |
ttx | we probably need to look up series.yaml to grab the id corresponding to the directory name | 14:31 |
elodilles | with a first glance its a bit more tricky then the previous fixes, but we'll see | 14:31 |
elodilles | i will definitely spend some time with this, but every help is welcome :) | 14:32 |
ttx | yeah series_status.yaml has the antelope -> 2023.1 mapping we need | 14:33 |
ttx | and hopefully is already loaded somewhere | 14:33 |
elodilles | yes, we used that in the previous fixes | 14:33 |
elodilles | so just have to find the right place to use :) | 14:33 |
elodilles | anything else to add? | 14:34 |
elodilles | OK, if not, then let's move on to the next topic: | 14:36 |
elodilles | #topic Assign next week tasks | 14:36 |
opendevreview | Merged openstack/releases master: add releasenotes links for antelope 2023.1 https://review.opendev.org/c/openstack/releases/+/876952 | 14:36 |
elodilles | i've added my name to some tasks, only one is free to pick | 14:37 |
hberaud | I took it | 14:37 |
ttx | I'm off all week so did not assign anything | 14:37 |
elodilles | thanks hberaud o/ | 14:37 |
ttx | thanks all! | 14:37 |
elodilles | #topic Review countdown email | 14:37 |
elodilles | #link https://etherpad.opendev.org/p/relmgmt-weekly-emails | 14:38 |
elodilles | please review ^^^ | 14:38 |
ttx | lgtm | 14:39 |
hberaud | LGTM | 14:39 |
elodilles | thanks! | 14:39 |
elodilles | will send it after the meeting | 14:39 |
elodilles | last topic then | 14:39 |
elodilles | #topic Open Discussion | 14:40 |
elodilles | anything to discuss? | 14:40 |
ttx | I think we are in good shape, apart from the reelase notes regeneration issue (minor) and the validate failures on stable/2023.1 (critical but probably simple enough) | 14:40 |
hberaud | nope | 14:40 |
ttx | nothing else to discuss | 14:41 |
ttx | have a great time next week without me around | 14:41 |
elodilles | yepp, things look good so far. fingers crossed :) | 14:41 |
elodilles | ttx: thanks, have a nice time off :] | 14:41 |
elodilles | then let's close the meeting! | 14:42 |
ttx | thanks elodilles ! | 14:42 |
elodilles | thanks everyone for participating o/ | 14:42 |
hberaud | thanks elodilles | 14:42 |
elodilles | #endmeeting | 14:42 |
opendevmeet | Meeting ended Fri Mar 10 14:42:22 2023 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:42 |
opendevmeet | Minutes: https://meetings.opendev.org/meetings/releaseteam/2023/releaseteam.2023-03-10-14.00.html | 14:42 |
opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/releaseteam/2023/releaseteam.2023-03-10-14.00.txt | 14:42 |
opendevmeet | Log: https://meetings.opendev.org/meetings/releaseteam/2023/releaseteam.2023-03-10-14.00.log.html | 14:42 |
hberaud | elodilles, ttx how to reproduce this critical issue? I tried locally but without success | 14:55 |
elodilles | hberaud: by cutting an rc2 and run 'tox -e validate | 14:58 |
hberaud | ok | 14:58 |
hberaud | I tried with creating a new tag on oslo.messaging | 14:58 |
elodilles | here is an example: https://review.opendev.org/c/openstack/releases/+/877008 | 14:58 |
hberaud | ack | 14:59 |
ttx | should happen on any release made on stable/2023.1 | 15:05 |
opendevreview | Hervé Beraud proposed openstack/releases master: Release Octavia RC2 for Antelope https://review.opendev.org/c/openstack/releases/+/877008 | 15:15 |
opendevreview | Hervé Beraud proposed openstack/releases master: Fix gitutils to use release-id https://review.opendev.org/c/openstack/releases/+/877105 | 15:15 |
hberaud | elodilles, ttx this patch fixed the issue locally ^ | 15:16 |
hberaud | let's test with octavia on gates | 15:16 |
ttx | 👍️ | 15:18 |
elodilles | hberaud: thx \o/ | 15:21 |
hberaud | np | 15:21 |
hberaud | yet another `get_stable_branch_id` function definition :) | 15:22 |
elodilles | yepp, definitely will be good to put it in a common place :) | 15:23 |
prometheanfire | elodilles: it looks fine, the main concern I have is that https://review.opendev.org/873390 is not merged (oslo.log) and https://review.opendev.org/867266 (tripleo-common) | 15:29 |
elodilles | hmmm. tripleo is kind of retired. but the oslo.log looks bad :S | 15:36 |
elodilles | it definitely looks like oslo.log latest release causes some issue with nova :-o | 15:46 |
opendevreview | Sylvain Bauza proposed openstack/releases master: WIP: Propose Nova deadlines for Bobcat schedule https://review.opendev.org/c/openstack/releases/+/877094 | 15:56 |
hberaud | validation is fixed \o/ | 15:56 |
elodilles | hberaud: cool, thx \o/ | 15:57 |
elodilles | hberaud: any idea what could cause the cross-nova-py310 to fail for oslo.log 5.1.0? https://review.opendev.org/873390 | 15:58 |
johnsom | Thanks you! | 16:05 |
hberaud | elodilles: nope, there is no functional differences between oslo.log 5.0.2 and 5.1.0 https://github.com/openstack/oslo.log/compare/5.0.2...5.1.0 | 16:14 |
hberaud | and the nova log are not clear | 16:14 |
hberaud | I see lot of kafka errors | 16:14 |
*** amoralej is now known as amoralej|off | 16:14 | |
hberaud | so, I'm not sure the failure is really related to oslo.log | 16:14 |
hberaud | just to be sure, nothing seems related to kafka in oslo.log https://github.com/search?q=repo%3Aopenstack%2Foslo.log%20kafka&type=code | 16:18 |
elodilles | ack, thanks. weird :S | 16:20 |
hberaud | yeah | 16:20 |
elodilles | hberaud: as I see actually, oslo.log 5.0.2 was also not accepted | 16:23 |
elodilles | the patch still replaces 5.0.0 with 5.1.0 | 16:23 |
hberaud | ah interesting | 16:24 |
hberaud | so in this case a couple of eventlet fixes have been merged https://github.com/openstack/oslo.log/compare/5.0.0...5.1.0 | 16:24 |
elodilles | yepp. eventlet sounds more like something that could interfere with a unit test :S | 16:25 |
prometheanfire | it often does :| | 16:27 |
elodilles | so the question is what we could do with this. can we release antelope with oslo.log 5.0.0 if we can't find the root cause? | 16:34 |
opendevreview | Elod Illes proposed openstack/releases master: Fix gitutils to use release-id https://review.opendev.org/c/openstack/releases/+/877105 | 17:07 |
elodilles | hberaud: i've updated slightly to make the test jobs pass ^^^ | 17:11 |
hberaud | elodilles: concerning oslo.log that's a good question... I'm not even what is the root cause, if a fix is needed is needed in oslo.log, then it could be backported, but my main fear is that release version for antelope and requirements version allowed for antelope won't be in sync | 17:13 |
hberaud | if we backport a fix we would have to release a version 5.1.1 which wouldn't be an issue for stable antelope requirements | 17:13 |
hberaud | even if they are unsync | 17:14 |
hberaud | while this issue is not solved we would continue to use 5.0.0 | 17:14 |
hberaud | I asked question to Rodolfo into the requirements patch, he authored one of the 2 fixes landed by 5.0.2 | 17:16 |
hberaud | (the other fix was landed by 5.0.1) | 17:16 |
hberaud | and he requested to block 5.0.1 to be sure to use his fix https://review.opendev.org/c/openstack/requirements/+/864573/4 | 17:17 |
hberaud | well, I need to eject, see you next week | 17:17 |
opendevreview | Bernard Cafarelli proposed openstack/releases master: [neutron] New Zed releases for Neutron https://review.opendev.org/c/openstack/releases/+/876835 | 17:33 |
elodilles | hberaud: hmmm. this is interesting, as in nova the privsep test cases fail, just like what Rodolfo is talking about. anyway, have a nice weekend, see you next week! | 18:32 |
opendevreview | Ghanshyam proposed openstack/releases master: Create stable/2023.1 for devstack https://review.opendev.org/c/openstack/releases/+/877123 | 19:41 |
opendevreview | Ghanshyam proposed openstack/releases master: Create stable/2023.1 for grenade https://review.opendev.org/c/openstack/releases/+/877125 | 19:43 |
gmann | elodilles: hberaud ttx ^^ branch cut for devstack and grenade | 19:44 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!