| *** elodilles_pto is now known as elodilles | 07:55 | |
| bauzas | gouthamr: I don't see anything in the TC agenda about eventlet removal deadlines but given the mailing-list thread, I think we should discuss this as TC | 15:19 |
|---|---|---|
| gmaan | ++ | 15:27 |
| gouthamr | bauzas: okay, did you add it? | 16:04 |
| bauzas | nope, want me to do it ? | 16:04 |
| gouthamr | tc-members: gentle reminder that we are meeting here in ~55 mins | 16:05 |
| gouthamr | bauzas: a bit last minute I guess, let’s hold it for open discussion.. I do see other topics from last week | 16:05 |
| bauzas | gouthamr: so should I add it then ? | 16:06 |
| gouthamr | add it under open discussion if you must, I’ll remember | 16:06 |
| bauzas | cool | 16:07 |
| cardoe | I'm going to miss today but I'll be on right after (and before) so I'll catch up on the convo. Share anything I need to jump on reviews for. | 16:36 |
| cardoe | I'm at my kid's Boy Scout camp and I'm one of a handful of dad's here today. So our meeting is right at the same time at lunch. Just making sure 300 teenage boys and girls make good choices like not having a food fight. | 16:38 |
| mnasiadka | gouthamr: I added my absence today, currently on sick leave, but will be back next week surely | 16:39 |
| gouthamr | ack cardoe and mnasiadka | 16:40 |
| gouthamr | mnasiadka: hope you feel better soon | 16:41 |
| cardoe | mnasiadka: yeah feel better soon | 16:41 |
| gouthamr | cardoe: fight the good fight | 16:41 |
| cardoe | heh. Honestly it's not much different than some TC meetings when we really get into the thick of it. | 16:41 |
| gouthamr | 😂 | 16:48 |
| gouthamr | #startmeeting tc | 17:00 |
| opendevmeet | Meeting started Tue Jun 17 17:00:10 2025 UTC and is due to finish in 60 minutes. The chair is gouthamr. Information about MeetBot at http://wiki.debian.org/MeetBot. | 17:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 17:00 |
| opendevmeet | The meeting name has been set to 'tc' | 17:00 |
| gouthamr | Welcome to the weekly meeting of the OpenStack Technical Committee. A reminder that this meeting is held under the OpenInfra Code of Conduct available at https://openinfra.dev/legal/code-of-conduct. | 17:00 |
| gouthamr | Today's meeting agenda can be found at https://wiki.openstack.org/wiki/Meetings/TechnicalCommittee | 17:00 |
| gouthamr | #topic Roll Call | 17:00 |
| frickler | \o | 17:00 |
| gtema | o/ | 17:01 |
| * gibi lurks as well | 17:02 | |
| gouthamr | noted absence: c a r d o e, m n a s i a d k a | 17:02 |
| gouthamr | courtesy ping: gmaan bauzas spotz[m] noonedeadpunk | 17:02 |
| gmaan | o/ | 17:02 |
| bauzas | o/ | 17:03 |
| gouthamr | okay, lets get started.. | 17:05 |
| gouthamr | #topic Last Week's AIs | 17:05 |
| gouthamr | we took a couple of AIs | 17:05 |
| gouthamr | one of these is about project activity in cyborg (and vitrage) - we have a separate topic for this so lets dive into this when we get to the topic | 17:06 |
| gouthamr | the other was following up on DCO related changes | 17:06 |
| gouthamr | this might be a quick one, so lets cover the state of open things now | 17:06 |
| fungi | some of those have started to merge | 17:06 |
| gouthamr | #link https://review.opendev.org/q/hashtag:+dco-signed-off-by | 17:07 |
| gouthamr | on the contributor guide change, we have 1 +2.. | 17:07 |
| gouthamr | i don't recall if we discussed if it can be merged prior to July 1st | 17:08 |
| gouthamr | #link https://review.opendev.org/c/openstack/contributor-guide/+/950839 (Replace CLA instructions with DCO) | 17:08 |
| gouthamr | dropping the CLA bits may confuse any new contributors between now and July 1st.. but, we need to land the DCO content there asap | 17:08 |
| frickler | well currently a new contributor would still need to follow the CLA process, right? so I wouldn't merge it too early | 17:08 |
| gouthamr | okay, what's a good date to merge? a week prior? | 17:09 |
| gouthamr | really short term pain/gain | 17:09 |
| fungi | i suppose if anyone has questions in the meantime on what the future guidance is going to be, we can point them at the contributor guide change (or zuul's draft rendering of the future state of the built document) | 17:10 |
| frickler | yes, that would be next week, I think that's fine | 17:10 |
| gouthamr | ack on both points | 17:11 |
| gouthamr | any objections to that? | 17:11 |
| gouthamr | #link https://review.opendev.org/c/openstack/releases/+/950760 ([tools] Add 'signed off by' tag to scripts) | 17:12 |
| gouthamr | did you have consensus (with ttx perhaps?) regarding this one? | 17:12 |
| gouthamr | fungi ^ | 17:12 |
| fungi | gouthamr: his last comment looked consensus-ish? | 17:13 |
| fungi | ah, it was on a different change | 17:14 |
| gouthamr | ack, good stuff.. i was wondering if we had any blockers | 17:15 |
| gouthamr | i think the pending issue with translations is the only remaining concern | 17:15 |
| fungi | #link https://review.opendev.org/950770 (openstack/project-config) | 17:15 |
| gouthamr | ty fungi | 17:16 |
| fungi | the comments there covered it | 17:16 |
| gouthamr | we can buy some time for DCO enforcement in translations , i will chat with ianychoi and seongsoo about this.. the student interns were onboarding as of this week, and making good progress.. i'm hopeful we'll have something substantial towards M-3 as far as our weblate transition goes | 17:17 |
| gouthamr | that's all i had for DCO this week, and that's all of the AIs i could gather as well | 17:17 |
| gouthamr | noonedeadpunk: thank you again for running the meeting! | 17:17 |
| gouthamr | were there any other AIs you were tracking? | 17:17 |
| gouthamr | #topic Improving Contributor experience, contd.. | 17:19 |
| gouthamr | we had an update on the ML from ildikov | 17:20 |
| fungi | ildikov had a follow-up post to the ml yesterday with a bunch of review metrics analysis | 17:20 |
| gouthamr | wrt the contributor/maintainer surveys | 17:20 |
| fungi | yeah, that one | 17:20 |
| gouthamr | #link https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/message/NTBNI7YIDCWBR6BTPEKVZIODWTVUIOXO/ (Re: [all][dev][ops][tc] Bridging the gap between community and contributing orgs) | 17:20 |
| gouthamr | more interesting analysis there | 17:21 |
| fungi | we also joined the nova meeting a few minutes ago and gave some project-specific analysis, i'm planning to do the same for cinder tomorrow | 17:21 |
| gouthamr | ah very nice; how many teams are you able to do this with? | 17:21 |
| fungi | probably 6 initially over the next month or so, basically prioritizing any that got multiple contributor and maintainer survey responses for now | 17:22 |
| gouthamr | good stuff, thank you for doing this | 17:23 |
| fungi | but as more people fill out those surveys we'll have better data and a clearer picture, i think, so can probably do more | 17:23 |
| gouthamr | we did have a few ideas through the brainstorm we had here in the past few weeks | 17:23 |
| gouthamr | i want to pause here, and wait to see what opinions you gather from the project teams in their meetings | 17:24 |
| fungi | i'm not expecting these early analyses to be extra illuminating, probably full of things we already know, but maybe with some more concrete evidence to back them up. as for ways to turn any of it around, that's harder obviously and something most open source projects struggle to solve | 17:24 |
| gouthamr | mainly interested if we can see different pain points, and practices teams are taking that are helping, and things theyre planning to adopt | 17:24 |
| fungi | yeah, i hope that starts to come out of this | 17:25 |
| gouthamr | ++ | 17:25 |
| fungi | i also expect it to take time, this is not going to be a short journey | 17:26 |
| fungi | first we need a solid picture of where we are before we can figure out ways to maybe get closer to where we want to be | 17:26 |
| gouthamr | yes, i think if we can go into the Oct PTG better informed and share some best practices it'd be a win :) | 17:26 |
| fungi | agreed, that seems like a reasonable next goal | 17:27 |
| gouthamr | anything else for $topic today? | 17:27 |
| fungi | i didn't have anything | 17:27 |
| gouthamr | ty | 17:28 |
| gouthamr | #topic Cyborg project status | 17:28 |
| gouthamr | did we have any update in the past week wrt this? | 17:29 |
| gmaan | this is something we discussed in last meeting also | 17:29 |
| bauzas | yup | 17:30 |
| gouthamr | sorry, i was confused with the wiki updates.. i was under the impression we took an AI to follow up over the past week? | 17:30 |
| gmaan | as m-2 release team deadline to have a final list of deliverables to release for his cycle, we should see if we need to mark it inactive or need to wait more for core reviewer to become active? | 17:30 |
| bauzas | that's what we said, see in July whether Cyborg would be back | 17:31 |
| gmaan | issue is core members are not active. AI was try to reachout to them, ML, gerrit has no response | 17:31 |
| gmaan | bauzas: but we should decide before m-2 which is july 3rd otherwise we miss the timeline to mark project inactive though we can have exception for that | 17:32 |
| bauzas | ah right | 17:33 |
| gmaan | nova also has the cyborg job which is failing and non voting. having a clear status on project will help cross project/CI effort also | 17:33 |
| frickler | is there any interest to look into other projects, too? | 17:34 |
| gmaan | yeah, i think its time to bring all such projects. we have at least 2 weeks from m-2 | 17:35 |
| gmaan | sean brought this during cyborg fix and I brought it here but discussing more such inactive project if anyone knows is good timing | 17:35 |
| frickler | IMO everyone in https://review.opendev.org/q/topic:%22create-2025.1%22+status:open would be worth a closer look | 17:36 |
| gouthamr | sounds like we could have a patch to mark cyborg inactive | 17:36 |
| gouthamr | and then update the original thread with a new subject? | 17:36 |
| gouthamr | i understand asking the foundation staff to reach out to the cores would be unsustainable.. i don't want to resort to it personally.. | 17:37 |
| bauzas | we can try | 17:37 |
| gmaan | frickler: ++ in first glance yes, most of those projects are less active in past too | 17:37 |
| gouthamr | okay, anyone wants to own this action item? | 17:38 |
| frickler | yes, repeat the same query with 2024.x and you see a pattern. but that is a strong argument for me that these should not be part of the regular release cycle if they don't have much updates anyway | 17:38 |
| fungi | i have pinged horace (our china community manager) since he might have some idea of the level of continued engagement from the employer of the cyborg maintainers | 17:38 |
| fungi | if he has any ideas i'll immediately pass them along | 17:39 |
| gouthamr | thank you fungi | 17:40 |
| fungi | he already got back to me, suggested that the best next step is to probably ask the openstack community if anyone is interested in taking over cyborg maintainership going forward | 17:42 |
| fungi | so sounds like their employer is probably not very engaged any longer | 17:43 |
| gmaan | I can push change to mark it inactive and we can see if anyone interested to take over | 17:43 |
| fungi | pairing that with the proposed inactive change sounds like a great combo, yes | 17:43 |
| bauzas | ++ | 17:43 |
| gouthamr | ty for the update fungi and thanks for owning the next steps, gmaan | 17:45 |
| gmaan | gouthamr: you can add action item on me, I will push change today | 17:45 |
| gouthamr | #action: gmaan will propose a governance change to tag cyborg inactive for 2025.2 | 17:45 |
| gouthamr | frickler: ty for the link, not merging bot patches is sure an indication of how active a team is .. | 17:47 |
| gouthamr | we need to tag these projects inactive just like we're doing with cyborg, and pair that with an ML post before M-2.. if you or anyone from the release team would like to do that, please do.. | 17:48 |
| gouthamr | anything else for this topic? | 17:48 |
| gouthamr | #topic A check on gate health | 17:49 |
| gouthamr | anything concerning in the gate this week? | 17:49 |
| fungi | opendev is in the process of switching most zuul nodesets over from nodepool to zuul-launcher managed nodes. the change should be transparent, but we'll keep an eye out for any reports of problems | 17:50 |
| fungi | we've already done this in other zuul tenants, just not the openstack tenant yet | 17:50 |
| gouthamr | oh long live nodepool | 17:50 |
| gouthamr | have you folks been finding any issues with the other tenants? | 17:51 |
| fungi | not so far, no | 17:51 |
| fungi | i mean other than when initially developing the funcitonality and dogfooding it in the zuul upstream community's zuul tenant | 17:52 |
| gouthamr | transparent is good, i will miss nodepool :) spent several hours watching image builds and nodes being ready when maintaining third party CI in a past lifetime | 17:52 |
| fungi | zuul-launcher will give you even more of that ;) | 17:52 |
| fungi | it just relies on zuul jobs to build node images now | 17:52 |
| gouthamr | speaking of, i know this was well communicated, but will nodepool continue to be supported for third party CI people that will need to switch over time? | 17:53 |
| fungi | i don't know the current deprecation schedule for nodepool, but it won't be overnight | 17:53 |
| gouthamr | ty.. | 17:54 |
| gouthamr | lets skip through the TC tracker and spend the next five mins with open discussion | 17:54 |
| gouthamr | #topic Open Discussion | 17:54 |
| bauzas | yes please | 17:54 |
| mnasiadka | fungi: does that mean we can also use the 16g ram flavors after that switch? | 17:54 |
| gouthamr | there was a late breaking topic regarding Eventlet Removal | 17:54 |
| gouthamr | #link https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/BIC7BTAN72X6AA4BE6VVNSP7FYFOC362/ (eventlet removal deadlines) | 17:55 |
| gouthamr | #link https://removal.eventlet.org/guide/sequencing-the-migration/#openstack-migration (current proposal) | 17:55 |
| bauzas | so | 17:55 |
| fungi | mnasiadka: probably best to ask in #opendev or during the meeting in #opendev-meeting at 19:00 today | 17:55 |
| mnasiadka | fungi: ack | 17:55 |
| bauzas | so, if you look at the above, services should be done to longer to use eventlet by 2026.1 | 17:56 |
| bauzas | and to remove eventlet by 2026.2 | 17:56 |
| bauzas | that's what gibi asked | 17:56 |
| bauzas | in his thread | 17:56 |
| bauzas | and I agree with him, we have concerns here | 17:56 |
| bauzas | so I think we couldn't remove eventlet by 2026.2 | 17:57 |
| bauzas | gibi: I guess that's what you're saying ? | 17:58 |
| gibi | based on the progress we made so far in nova we will need at least 2026.1 to transform the nova-comput service | 17:58 |
| gouthamr | that still adheres to the community-wide plan, correct? | 17:59 |
| gibi | and we was explicitly asked by operators on the PTG to have a way to switch from eventlet to threading outside of the upgrade window | 17:59 |
| bauzas | and I think we need to take some time for our operators to verify whether they font some issue | 17:59 |
| frickler | I think this is a bit related to which distros/python version we want to support? <=3.12 may work, but py3.13 or newer is critical with eventlet afaict | 17:59 |
| gibi | so we need a release where both eventlet and threading is supported | 17:59 |
| bauzas | frickler: correct, the problem appears with py3.13 | 17:59 |
| gmaan | yeah, we need to extend the py3.12 support also until then | 17:59 |
| gouthamr | <<--- time check -->> please drop off if you're unable to stay, but we'll wrap up a bit later today | 18:00 |
| bauzas | but distros could try to support py3.12 a bit later | 18:00 |
| gmaan | which is what we might be doing I think | 18:00 |
| frickler | trixie will have python3.13 only afaict. and Ubuntu 26.04 may have an even newer version | 18:00 |
| bauzas | py3.12 would only be EOL by 2028-10 | 18:00 |
| bauzas | https://devguide.python.org/versions/ | 18:00 |
| bauzas | so we have more time, the problem only appears for distros that no longer support py3.12 | 18:01 |
| fungi | yeah, i think this is squarely in the realm of distros dropping their openstack packages because including openstack isn't enough justification to maintain older cpython interpreter packages and dependencies | 18:01 |
| gouthamr | in the #openstack-eventlet-removal channel, hberaud noted that py3.13 support is an ongoing effort, with some fixes that were pending a new release of eventlet.. | 18:01 |
| bauzas | gouthamr: I'm not asking the eventlet team to support py3.13 | 18:02 |
| bauzas | this is no longer possible and this would take more time | 18:02 |
| fungi | if eventlet can be made to work on cpython 3.13 and 3.14 then debian and ubuntu could probably continue to include openstack | 18:02 |
| gibi | gouthamr: I think they fixed bugs but I'm not sure they fixed all the blocking bugs | 18:02 |
| bauzas | so we know that the last py version would be py3.12 which will be EOL by 2028.2 timeframe | 18:02 |
| gmaan | yeah, it is more of our timeline. I do not think we can accommodate every distro versions support | 18:03 |
| fungi | yes, which is fine as long as you deploy on platforms that are going to maintain those older python versions, or get the from somewhere or compile them yourelf | 18:03 |
| bauzas | here, I want to make it clear that it looks to me not possible to have nova to no longer support eventlet by 2027.1 | 18:03 |
| gmaan | at long as we can support py3.12, I think we should and have feasible timeline for eventlet plan | 18:03 |
| bauzas | possibly 2028.1 | 18:04 |
| bauzas | but here my main concern (as a nova-core maintainer) is that I'd ask our operators to test the performance for threads for more than just one release | 18:04 |
| fungi | i think that needs to be clearly called out on the ml thread, that we're talking about basically not supporting python 3.13 for a couple more years, and making sure the distros are aware of that fact asap | 18:04 |
| gibi | I think I called it out on the ML | 18:05 |
| frickler | maybe zigo can confirm, but I don't think the Debian ship will move backwards for this | 18:05 |
| gibi | but feel free to ephesize it | 18:05 |
| bauzas | frickler: the problem is not whether we want to drop eventlet or not | 18:05 |
| fungi | if you read down into the message, yes, but there's e.g. nothing on the ml with the subject line "no python 3.13 for openstack until 2028" | 18:05 |
| bauzas | frickler: but rather whether we should be able to drop it | 18:06 |
| fungi | so we need to make sure it comes to their attention | 18:06 |
| bauzas | and 2027.1 is just not possible | 18:06 |
| bauzas | this is tbc unrealistic to drop our eventlet support by only one release | 18:07 |
| gmaan | agree | 18:07 |
| gmaan | and do we know if all other projects are ok with current timeline or what their progress is? | 18:07 |
| bauzas | good question | 18:07 |
| gmaan | I am afraid if 'no work started' is the silence there and we have this a bigger concern from many projects | 18:08 |
| fungi | yeah, if openstack just plan isn't going to work on python 3.13, then it won't be packaged in debian, full stop. ubuntu might do extra work to keep a python3.12 interpreter and enough package builds of openstack dependencies for 3.12 to make it usable in 2026.04 but that's still some time out | 18:08 |
| bauzas | I know that Neutron is aggresively removing evently | 18:08 |
| bauzas | eventlet | 18:08 |
| bauzas | but for Cinder, last time I heard was that they need more time | 18:09 |
| bauzas | and honestly, Nova has concerns as I said by the performance | 18:09 |
| bauzas | as gibi said, operators need to better tune their options with threads | 18:09 |
| gibi | my concerns is about the speed we are able to progress with the removal in nova | 18:10 |
| bauzas | I don't know for Neutron if operators are able or need to tune some performance usage for the services, but I'd guess this would be the same | 18:10 |
| gibi | we simply won't be ready to drop eventlet when we planned | 18:10 |
| bauzas | gibi: that, plus as I said the fact that I'd like our operators to test threads-only nova-scheduler not just by one release | 18:10 |
| bauzas | yeah the dropping is the main concern | 18:11 |
| gibi | our current plan is to have one release where both eventlet and threadin will be supported | 18:11 |
| gibi | so that operators can switch outside of the upgrade window and tune | 18:11 |
| bauzas | whether we could use other but eventlet could be possible | 18:11 |
| bauzas | for the timeframe we said | 18:11 |
| bauzas | but *dropping* the usage seems unrealistic as I said | 18:11 |
| gibi | I'm past my 11th hour today so I cannot really add more to this discussion now | 18:14 |
| bauzas | anyway, do we want to signal that as a TC ? | 18:15 |
| gouthamr | okay, sounds like great points, but i don't think we can take a call on changing the timeline without checking with all the projects, and hberaud/oslo folks | 18:15 |
| bauzas | gibi: heh, live my life :p | 18:15 |
| * bauzas reads the current goal | 18:15 | |
| gibi | bauzas: I have my own thanks :p | 18:15 |
| bauzas | https://governance.openstack.org/tc/goals/selected/remove-eventlet.html#completion-criteria | 18:16 |
| gouthamr | if you'd like, we could have a topic proposed to the next TC meeting, or, maybe weigh pros and cons on the #openstack-eventlet-removal channel and the ML post | 18:16 |
| bauzas | gouthamr: I could propose a Gerrit change to the goal | 18:16 |
| gibi | I prefer the ML post at the moment as there is some engagement already there | 18:16 |
| gouthamr | yes, that would be a good place to hash out arguments | 18:16 |
| bauzas | or gibi, as you want :) | 18:16 |
| gmaan | ++ I think that will help to have wider discussion | 18:16 |
| bauzas | gmaan: about the ML thread ? | 18:17 |
| gmaan | I mean gerrit | 18:17 |
| bauzas | the problem is that it goes into technical details | 18:17 |
| bauzas | and I don't want to derail into those | 18:17 |
| gmaan | gibi: ML is ok but I am not seeing other projects stating their state | 18:17 |
| bauzas | OK, I can draft a gerrit patch against the goal with the help of gibi | 18:17 |
| bauzas | gibi: would you be OK with that ? | 18:17 |
| bauzas | and then we could promote the gerrit proposal into the ML thread | 18:18 |
| gibi | bauzas: sure | 18:18 |
| bauzas | cool | 18:18 |
| gmaan | ++, thanks | 18:18 |
| bauzas | gouthamr: put me an AI on it | 18:18 |
| bauzas | I'm done on my side for that topic | 18:19 |
| gouthamr | #action bauzas propose an update to the Eventlet Removal Goal | 18:19 |
| bauzas | thanks for the discussion | 18:19 |
| gouthamr | thank you | 18:19 |
| gouthamr | final thing before i close this meeting: | 18:19 |
| gouthamr | #link https://t.e2ma.net/message/mrxorh/ikxczt (The OpenInfra Summit '25 CFP for Forum Topics & Project Updates Is Now LIVE!) | 18:19 |
| bauzas | oh yeah | 18:20 |
| bauzas | good call | 18:20 |
| gouthamr | ^ we definitely need to drum up more contributor and operator attendance at the Summit, so if you're thinking about it, please do propose your sessions | 18:20 |
| gouthamr | anything else for the minutes today? | 18:20 |
| bauzas | I think we could do again a nova meet-and-greet party there :) | 18:20 |
| bauzas | I'd recommend other projects to do so | 18:21 |
| gouthamr | nice, with fine bordeaux | 18:21 |
| gouthamr | ill come hang with you fine folks :D | 18:21 |
| gouthamr | thank you all for attending, and sorry this went on 21 minutes over | 18:21 |
| bauzas | gouthamr: with cotes du rhone and savoie please | 18:21 |
| gouthamr | #endmeeting | 18:21 |
| opendevmeet | Meeting ended Tue Jun 17 18:21:42 2025 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 18:21 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/tc/2025/tc.2025-06-17-17.00.html | 18:21 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/tc/2025/tc.2025-06-17-17.00.txt | 18:21 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/tc/2025/tc.2025-06-17-17.00.log.html | 18:21 |
| bauzas | thanks gouthamr | 18:21 |
| gibi | thanks folks | 18:22 |
| -opendevstatus- NOTICE: Zuul jobs reporting POST_FAILURE were due to an incident with one of our cloud providers; this provider has been temporarily disabled and changes can be rechecked | 22:38 | |
| opendevreview | Ghanshyam proposed openstack/governance master: Mark Cyborg inactive https://review.opendev.org/c/openstack/governance/+/952798 | 23:58 |
Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!