| elodilles | frickler: sorry for pinging, but can you please review this doc patch for the Hibiscus release? https://review.opendev.org/c/openstack/openstack-manuals/+/1006577 | 06:06 |
|---|---|---|
| opendevreview | Elod Illes proposed openstack/releases master: Mark 2026.2 Hibiscus as released https://review.opendev.org/c/openstack/releases/+/1008008 | 06:35 |
| ttx | It's release day! I'm a bit swamped preparing for next week's Open Source Summit in Prague, but if my +2 or attention is needed just ping me! | 06:51 |
| elodilles | ACK, thanks in advance o/ | 07:04 |
| elodilles | so far things are good | 07:09 |
| elodilles | though based on https://status.python.org there were some errors during the night... so... fingers crossed :X | 07:09 |
| *** ykarel_ is now known as ykarel | 07:45 | |
| elodilles | T-10 | 09:50 |
| elodilles | https://status.python.org seems a bit fragile at the moment, but what can we do... it does not fail at the moment, but have failed during the night and had a couple of errors 1-2 hours ago | 09:54 |
| elodilles | zuul looks also okay: https://zuul.opendev.org/t/openstack/status | 09:54 |
| elodilles | 0/0 events | 09:55 |
| elodilles | so we should be ready to push the red button on patch https://review.opendev.org/c/openstack/releases/+/1007691 | 09:55 |
| elodilles | anyone around to do it? :) | 09:55 |
| fungi | i'm awake now | 09:56 |
| elodilles | good morning fungi o/ | 09:57 |
| fungi | i can approve 1007691 whenever we're ready | 09:58 |
| elodilles | based on the above, i think we are ready as much as we can | 09:59 |
| elodilles | if you agree, then please do approve :) | 09:59 |
| fungi | yeah, i caught up on scrollback, let's hope pypi holds up for now | 09:59 |
| frickler | ok, I'm back, too | 09:59 |
| elodilles | hi frickler o/ | 10:00 |
| fungi | approved now | 10:00 |
| elodilles | good to have everyone onboard | 10:00 |
| elodilles | okay, it's rolling \o/ https://zuul.opendev.org/t/openstack/status?change=1007691 | 10:01 |
| elodilles | zuul is busy with kolla and OSA, as usual o:) | 10:06 |
| fungi | well, the gate jobs did get nodes assigned, and the pipelines we care about after 1007691 merges take priority over everything else in that zuul tenant | 10:08 |
| elodilles | yepp, now both docs and validate jobs are running | 10:08 |
| elodilles | docs job finished. validate could still take 10-50 minutes more, based on my past cycles memories | 10:14 |
| frickler | well it is currently at c for cloudkitty, so yes, it will take a lot longer than what zuul projected ;) | 10:14 |
| fungi | yeah, zuul's predicted duration is based on average completion times for that job, and most of the time it doesn't check nearly so many new releases | 10:17 |
| elodilles | yepp | 10:18 |
| elodilles | 0 errors found | 10:29 |
| opendevreview | Merged openstack/releases master: 2026.2 Hibiscus final releases for cycle-with-rc projects https://review.opendev.org/c/openstack/releases/+/1007691 | 10:30 |
| elodilles | merged ^^^ | 10:30 |
| fungi | yay! | 10:30 |
| elodilles | now the post jobs :X | 10:31 |
| fungi | and tag-releases is now running in release-post, so tags should start appearing in the release and tag pipelines shortly | 10:35 |
| tkajinam | \o/ | 10:38 |
| elodilles | 7 jobs in tag pipeline already | 10:38 |
| fungi | https://pypi.org/project/adjutant-ui/#history has a new release! | 10:40 |
| elodilles | \o/ | 10:40 |
| fungi | hopefully that bodes well for the rest | 10:41 |
| elodilles | yepp. items in release pipeline also slowly increasing. 28 now | 10:41 |
| elodilles | 62 now in release pipeline. probably that's all? | 10:46 |
| elodilles | since we had 62 yamls in the patch | 10:47 |
| fungi | yeah, and zun is in there | 10:48 |
| elodilles | and that is the last one based on the alphabet :) | 10:48 |
| fungi | also tag-releases completed (successfully) | 10:49 |
| elodilles | e.g. cinder, keystone releases appear on pypi | 10:49 |
| fungi | and the count in the release pipeline is starting to fall | 10:49 |
| elodilles | slowly, but decreasing, yes ~o~ | 10:53 |
| fungi | zun just successfully uploaded to pypi | 10:55 |
| fungi | there are still a handful enqueued ahead of it that haven't finished uploading though | 10:57 |
| fungi | looks like some took a little longer to get nodes for their release-openstack-python builds | 10:58 |
| elodilles | ++ | 10:59 |
| elodilles | tag pipeline is also almost empty | 10:59 |
| fungi | the last straggler just uploaded | 11:01 |
| elodilles | \o/ | 11:02 |
| elodilles | if i'm not mistaken we can start looking for missing releases | 11:03 |
| fungi | yep | 11:03 |
| elodilles | versions have refreshed on https://releases.openstack.org/hibiscus/index.html too \o/ | 11:04 |
| fungi | shouldn't have to wait for release announcements and constraints proposals to complete | 11:04 |
| fungi | i've updated the foundation staff on our progress so far at the one-hour mark | 11:06 |
| elodilles | awesome, thanks! | 11:06 |
| fungi | looks like the release pipeline will empty out well before nova release notes are done | 11:07 |
| elodilles | yeah, nova repo is quite heavy, so no wonder... :S | 11:08 |
| fungi | that's the last job still running at this point, and https://lists.openstack.org/archives/list/release-job-failures@lists.openstack.org/ has no new release failures reported this week | 11:11 |
| elodilles | \o/ | 11:11 |
| fungi | somehow we dodged pypi problems | 11:12 |
| elodilles | yeah. lucky us :X | 11:12 |
| elodilles | (missing-releases check is still running in my terminal, currently checking oslo deliverables) | 11:13 |
| ttx | \o/ | 11:14 |
| fungi | elodilles: i guess you can un-wip 1007453 at this point too so that frickler will be able to merge it | 11:19 |
| elodilles | fungi: done | 11:21 |
| elodilles | furthermore, the missing-release check has finished and did not report any issue | 11:21 |
| elodilles | neither any false alarm | 11:21 |
| elodilles | \o/ | 11:22 |
| fungi | and nova's release notes did eventually finish | 11:24 |
| elodilles | so everyting in its right place \o/ | 11:25 |
| elodilles | we have time to approve https://review.opendev.org/c/openstack/openstack-manuals/+/1007453/1 and https://review.opendev.org/c/openstack/releases/+/1008008 | 11:26 |
| elodilles | but feel free to approve them whenever you are ready | 11:26 |
| fungi | i think frickler has to approve 1007453 (or someone else on the tc) | 11:27 |
| elodilles | maybe openstack-manuals has higher priority as the docs page refreshes could take longer | 11:27 |
| fungi | but yes, the sooner we get that in, the better, based on historical challenges | 11:28 |
| fungi | 1008008 will only need a few minutes from approval to publication, in contrast | 11:29 |
| mnasiadka | I can approve 1007453 if you want me to ;-) | 11:33 |
| fungi | thanks mnasiadka! that would be great. we're ready to get that rolling now | 11:34 |
| mnasiadka | Rolling! ;-) | 11:34 |
| fungi | much obliged | 11:34 |
| fungi | that will take somewhere around 60-90 minutes from approval to publication | 11:35 |
| elodilles | thanks mnasiadka \o/ | 11:37 |
| elodilles | i've prepared the 2 announcement mails as well, feel free to rephrase if you see fit: https://etherpad.opendev.org/p/relmgmt-weekly-emails | 11:37 |
| fungi | and build-tox-manuals-publishdocs is running in the gate now | 11:38 |
| elodilles | and will send when we get the signal | 11:38 |
| frickler | thx mnasiadka, I was just fetching some food | 11:42 |
| fungi | that second message usually goes to -discuss instead of -announce, doesn't it? | 11:42 |
| frickler | +2 on https://review.opendev.org/c/openstack/releases/+/1008008, is that ready to proceed or do you want to wait a bit? | 11:42 |
| mnasiadka | No problems, happy to help ;) | 11:42 |
| elodilles | fungi, yepp, fixing | 11:42 |
| fungi | otherwise both messages lgtm | 11:43 |
| elodilles | +1 | 11:43 |
| fungi | frickler: i think we've usually wait until closer to sending the announcement to update the releases site, though i don't know that it's strictly necessary | 11:44 |
| fungi | er, waited | 11:44 |
| fungi | which would be about two hours from now if we follow our historical timing of completing just before 14:00 utc | 11:46 |
| fungi | which is when the embargo lifts on the foundation's press release materials so news articles all start to be published | 11:46 |
| fungi | er, i guess the embargo technically lifts at 15:00 utc, but we tend to finish at 14:00 | 11:48 |
| fungi | the manuals change merged and promote-openstack-manuals is running now, that tends to take a while, so i'm going to use this opportunity to do some deferred morning tasks | 11:51 |
| elodilles | yeah, something like that. though exact timestamps are mixing up in my memory as it is not always the same local time due to daylight saving time :P | 11:51 |
| fungi | yeah, they schedule it in usa local time so can vary relative to utc | 11:58 |
| fungi | promote-openstack-manuals is finishing up now | 12:26 |
| fungi | last of the files uploaded to afs will get published in the 12:30 utc vos release pulse | 12:27 |
| fungi | after that we can consider it all fully live on the docs site | 12:28 |
| fungi | i gave the foundation staff another update just now at the 2.5-hour mark | 12:29 |
| fungi | `vos release docs` completed moments ago | 12:30 |
| fungi | i guess we pause here, and resume in about an hour approving 1008008 | 12:32 |
| fungi | since we're well ahead of schedule this time | 12:33 |
| elodilles | ACK | 12:45 |
| elodilles | (btw, there were like 600+ errors around 11 UTC on pypi according to https://status.python.org so we were lucky, indeed :S) | 12:55 |
| fungi | wow | 12:56 |
| fungi | we must be a drop in the bucket | 12:56 |
| elodilles | yeah, that's probably true | 13:00 |
| fungi | queries and such aside, i think we only uploaded 124 packages | 13:02 |
| elodilles | yes | 13:04 |
| frickler | ok, https://review.opendev.org/c/openstack/releases/+/1008008 approved | 13:34 |
| fungi | cool, monitoring | 13:35 |
| opendevreview | Merged openstack/releases master: Mark 2026.2 Hibiscus as released https://review.opendev.org/c/openstack/releases/+/1008008 | 13:46 |
| fungi | publish-tox-docs-releases is running now | 13:54 |
| fungi | the upload just missed the 13:55 vos release, but should be included in the 14:00 run | 13:55 |
| fungi | actually it still hasn't uploaded, so may not make it in time, it isn't finished building the content yet | 13:59 |
| fungi | okay, now it's finally uploaded, so will go live at 14:05 utc | 14:00 |
| fungi | and done, https://releases.openstack.org/ shows 2026.2 maintained with 2027.1 in development | 14:05 |
| fungi | i'm updating foundation staff and checking with marketing to make sure they're still on track | 14:06 |
| elodilles | yepp, https://releases.openstack.org/ updated | 14:06 |
| fungi | i got the go-ahead from marketing they're ready if we want to send announcements to mailing lists now | 14:07 |
| elodilles | fungi: on https://www.openstack.org/ still Gazpacho is the latest release. will that be updated as well? :-o | 14:07 |
| fungi | yes, aprice is working on switching that as we speak, the update was staged and waiting for us to be done | 14:07 |
| fungi | i'm on hand to accept the message in the openstack-announce moderation queue | 14:08 |
| elodilles | awesome \o/ | 14:08 |
| elodilles | okay, sending it in a minute | 14:08 |
| fungi | she's waiting to update the www site until our announcements go out | 14:08 |
| fungi | but otherwise ready to pull the trigger on it | 14:08 |
| elodilles | fungi: mail sent | 14:09 |
| elodilles | to announce list | 14:10 |
| fungi | accepted through moderation | 14:10 |
| elodilles | \o/ | 14:11 |
| elodilles | preparing and sending the other mail | 14:11 |
| fungi | i've received my copy of the announcement | 14:12 |
| elodilles | mail sent to discuss list | 14:13 |
| fungi | received the discuss post too | 14:13 |
| elodilles | ~o~ | 14:14 |
| fungi | https://www.openstack.org/ now also shows hibiscus as latest and indri under development | 14:14 |
| fungi | er, halfway | 14:15 |
| gthiemonge | just FYI the release page contains html meta tags with "2026.1 Hibiscus" https://www.openstack.org/software/openstack-hibiscus/ | 14:16 |
| fungi | gthiemonge: thanks for the heads up, i'll let them know right away | 14:17 |
| elodilles | hmmm, the main link to 'latest release' goes correctly to openstack-hibiscus, though if i click 'latest release' from | 14:20 |
| elodilles | Get Started Roadmap Latest Release Source Code | 14:20 |
| elodilles | from... https://www.openstack.org/software | 14:21 |
| elodilles | then it is still openstack-gazpacho | 14:21 |
| fungi | yeah, i've gone over the page source and reported those bits to them as well | 14:22 |
| fungi | they're working to get all that corrected now | 14:22 |
| fungi | the source code button should be fixed now at least | 14:22 |
| elodilles | cool :) i see that things are changing :) | 14:22 |
| fungi | the banner at the top sounds like it may take a few additional minutes to get corrected because it can't be done through the cms | 14:24 |
| frickler | that remindes me - elodilles do you want to run the stiemap update? that also needs a tooling upgrade like https://review.opendev.org/c/openstack/openstack-doc-tools/+/984104 first | 14:30 |
| elodilles | frickler: oh, you are right, let me run it | 14:41 |
| elodilles | i mean... let me prepare the update first :P | 14:42 |
| elodilles | frickler: https://review.opendev.org/c/openstack/openstack-doc-tools/+/1008075 | 14:48 |
| ttx | Congrats! | 14:53 |
| frickler | elodilles: thx, that's waiting for the oslo team, then, but you can run the generator with that change locally, anyway | 14:57 |
| ttx | social-posted | 14:59 |
| elodilles | \o/ | 15:02 |
| tkajinam | while some people are around, can we push https://review.opendev.org/c/openstack/releases/+/1007434 to publish oslo.message CVE fix ? We didn't create ones after backpoort for some branches, unfortunately | 15:34 |
| tkajinam | I checked that change to openstack-doc-tools, and am now fixing the CI error there. just fyi | 15:35 |
| elodilles | frickler: sitemap update is proposed, though i had to use older Scrappy as the latest dropped TypeErrors to me :/ https://review.opendev.org/c/openstack/openstack-manuals/+/1008086 | 15:53 |
| elodilles | tkajinam: looking | 15:53 |
| tkajinam | elodilles, thanks ! | 15:59 |
| tkajinam | elodilles, is that TypeErorr related to zstd or something else ? | 16:00 |
| tkajinam | maybe I should just try it in my local | 16:01 |
| elodilles | i didn't see zstd in the stack trace, but tried it with multiple python versions (py314, py312 and py310) and all failed | 16:03 |
| tkajinam | TypeError: write() argument must be str, not bytes | 16:04 |
| tkajinam | ok | 16:04 |
| elodilles | yes, that's the one. ( https://paste.opendev.org/show/bXhhQH3MSkYMF4GnRD6n/ ) | 16:05 |
| elodilles | tkajinam: thanks for working on fixing openstack-doc-tools. i wanted to "quickly" generate the xml so after some initial trial i decided to use older scrappy and postponed the debugging for tomorrow o:) | 16:07 |
| tkajinam | hmm it doesn't appear in unit tests, so it might be a bit trickier than expected. | 16:07 |
| tkajinam | elodilles, yeah that's not urgent if we know working version of scrapy. | 16:07 |
| elodilles | i remembered that i used scrappy ~1 year ago so i chose Scrappy==2.13.4 which was released some time around that time. it worked well on py314 on resolute (26.04) | 16:10 |
| opendevreview | Merged openstack/releases master: [security] Release oslo.messaging 17.1.1, 17.3.1 https://review.opendev.org/c/openstack/releases/+/1007434 | 16:11 |
| fungi | the "learn more" banner at the top of the release page on the www site is finally mentioning hibiscus too, so at this point i think all previously identified problems there are resolved but let me know if anyone spots something else | 17:11 |
| * zigo finished uploaded the release. | 20:04 | |
| zigo | Thanks everyone! | 20:04 |
| zigo | Now, will do another CI run to see if I didn't abuse too much Type=notify everywhere ... :P | 20:07 |
| zigo | (let's find out if the AI was smart enough to find cases where I shouldn't do it) | 20:08 |
Generated by irclog2html.py 4.1.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!