Thursday, 2024-09-12

opendevreviewOpenStack Proposal Bot proposed openstack/ironic-inspector master: Imported Translations from Zanata  https://review.opendev.org/c/openstack/ironic-inspector/+/92770103:36
opendevreviewDmitry Tantsur proposed openstack/ironic master: Try limiting MTU to at least 1280  https://review.opendev.org/c/openstack/ironic/+/92893108:16
opendevreviewDmitry Tantsur proposed openstack/ironic master: Try limiting MTU to at least 1280  https://review.opendev.org/c/openstack/ironic/+/92893108:35
opendevreviewDmitry Tantsur proposed openstack/ironic master: Fix inspection if bmc_address or bmc_v6address is None  https://review.opendev.org/c/openstack/ironic/+/92888508:36
dtantsurboth patches need an urgent review ^^^08:36
opendevreviewSzymon proposed openstack/metalsmith master: Add ability to specify columns used for json output  https://review.opendev.org/c/openstack/metalsmith/+/92899309:03
masgharSo in ironic, when a node is deleted, is it also cleaned as a result? Say, using automated cleaning?11:42
JayFNo, you mark node retired and on undeploy, after cleaning, it goes to manageable instead of available12:14
JayFSo you have a clean node ready to be deleted12:14
masgharI see! Thanks Jay12:38
dtantsurmasghar: note that metal3 sorta automates it for you (without retirement)12:39
masgharokay12:39
dtantsurattention cores: everything is quite broken until we merge https://review.opendev.org/c/openstack/ironic/+/928931 and https://review.opendev.org/c/openstack/ironic/+/92888512:39
dtantsurJayF, TheJulia, the 3 of us seem to be the only active cores now12:40
JayFI single core approved the CI fix and put a plus 2 on the inspection fix12:42
dtantsurthx!12:42
JayFdtantsur: by now mean for this point in time? 12:42
JayFI count five. Me, you, Julia, Ricardo, Iury12:43
masgharRiccardo and Iury are on PTO these days12:43
dtantsurright ^^12:43
dtantsurRiccardo is back next week, Iury even later12:43
JayFOkay that's what I thought just making sure that there hadn't been any shuffling around that I wasn't aware of12:44
JayF😅12:44
TheJuliaWait everything broken could be good right? Vacation?!?12:54
TheJuliaJoking, kind of :)12:54
TheJuliagoing to be a slow start for me this morning. Had to take meds that kept me up until 1 am12:55
TheJuliaJayF: your up really early13:00
dtantsurTheJulia: take it easy, rest well13:01
dtantsurnothing can be merged anyway :D13:01
masgharyep, definitely take it easy 13:01
JayFTheJulia: I'm often up this early and lurking IRC on my phone. Just rare that I'm going to break the silence13:06
TheJuliaAhh13:07
TheJuliaTime to move to the coffee maker now that the cats have left me.13:07
opendevreviewDmitry Tantsur proposed openstack/sushy master: Make default request timeout configurable on Connector  https://review.opendev.org/c/openstack/sushy/+/92905513:22
TheJuliaso at one point https://review.opendev.org/c/openstack/ironic/+/928931 was similar to other configuration we had. It occurs to me that broke because one of the prior clouds broke because all public intertubes were over a tunnel.13:29
TheJuliabut, should that ever happen again, we can cross that bridge at that point13:29
JayFWell essentially the discovery is that you simply cannot use IPv6 if the MTU is lower than that13:47
JayFSo if that change ends up breaking, we'll have to re-architect something about how that networking works for us13:47
opendevreviewMerged openstack/ironic master: Try limiting MTU to at least 1280  https://review.opendev.org/c/openstack/ironic/+/92893113:50
dtantsuryay13:50
dtantsurnow only metal3/bifrost is not feeling well13:50
dtantsurno clean cherry-picks because of the job disabling, sigh13:51
fricklerJayF: I was asking on the patch, but since this is maybe semi-urgent: do you want to release team to override the ptl-approval to release the cve fixes? https://review.opendev.org/c/openstack/releases/+/92886213:54
cardoeSo total aside but I see dtantsur's requests timeout. Yeah that's a super important thing with Python requests... you gotta set a timeout. Its terrible it doesn't do that by default. BUT as a follow on, with the goal to go away from eventlet. I know the recommendation was to use aiohttp in the future. I don't believe it's in the global requirements. But we should nudge that to happen (or httpx if people wanna switch to 14:01
cardoethat).14:01
cardoeThen start using aiohttp or httpx in place of requests.14:01
cardoeBecause it's a trivial sed to switch a code base with either of those from the sync backend that requests uses to the asyncio backend.14:01
dtantsurAs another aside, we need to start sushy-async :)14:03
JayFdtantsur: are you still a release manager? If so can you go approve that releases patch14:05
dtantsurI'm not14:05
JayFfrickler: I am +1 to that14:05
JayFIf any cores object please say so now14:05
fricklerJayF: dtantsur: TheJulia: maybe we can do this the other way round and have at least one other core +1 the release patch? then I'd feel more comfortable with overriding14:38
opendevreviewMerged openstack/ironic master: Fix inspection if bmc_address or bmc_v6address is None  https://review.opendev.org/c/openstack/ironic/+/92888514:41
TheJuliaJayF: Interesting, metal3 use of ipv6?14:49
JayFNo, basically any ironic tempest job on rackspace flex14:50
JayFit starts at a lower MTU dropping us below the limit14:50
TheJuliaeww14:51
JayFexactly14:51
TheJuliaEWWWWW14:51
TheJulia:(14:51
JayFyou can read backlog on #openstack-qa / #openstack-neutron if you want14:51
TheJuliais rackspace flex their new deployment?14:51
JayFbut basically that's the result14:51
JayFyep14:51
clarkbas mentioned in that thread it isn't ideal but it also isn't that uncommon (its not the first cloud to do this and people with pppoe + dsl may experience similar if running things locally). I did provide this as feedback to them that they may want to look at jumbo frames in the underlying infrastructure so that neutron networks can have 1500 MTUs14:53
TheJuliaclarkb: thanks15:00
opendevreviewDmitry Tantsur proposed openstack/ironic bugfix/26.0: Try limiting MTU to at least 1280  https://review.opendev.org/c/openstack/ironic/+/92912815:05
opendevreviewDmitry Tantsur proposed openstack/ironic bugfix/25.0: Try limiting MTU to at least 1280  https://review.opendev.org/c/openstack/ironic/+/92912915:05
opendevreviewDmitry Tantsur proposed openstack/ironic bugfix/24.0: Try limiting MTU to at least 1280  https://review.opendev.org/c/openstack/ironic/+/92913015:05
opendevreviewDmitry Tantsur proposed openstack/ironic stable/2024.1: Try limiting MTU to at least 1280  https://review.opendev.org/c/openstack/ironic/+/92913115:06
opendevreviewDmitry Tantsur proposed openstack/ironic stable/2023.2: Try limiting MTU to at least 1280  https://review.opendev.org/c/openstack/ironic/+/92913215:07
opendevreviewDmitry Tantsur proposed openstack/ironic stable/2023.1: Try limiting MTU to at least 1280  https://review.opendev.org/c/openstack/ironic/+/92913315:07
opendevreviewDmitry Tantsur proposed openstack/ironic bugfix/26.0: Fix inspection if bmc_address or bmc_v6address is None  https://review.opendev.org/c/openstack/ironic/+/92913415:08
opendevreviewDmitry Tantsur proposed openstack/ironic bugfix/25.0: Fix inspection if bmc_address or bmc_v6address is None  https://review.opendev.org/c/openstack/ironic/+/92913515:08
opendevreviewDmitry Tantsur proposed openstack/ironic bugfix/24.0: Fix inspection if bmc_address or bmc_v6address is None  https://review.opendev.org/c/openstack/ironic/+/92913615:08
opendevreviewDmitry Tantsur proposed openstack/ironic stable/2024.1: Fix inspection if bmc_address or bmc_v6address is None  https://review.opendev.org/c/openstack/ironic/+/92913715:09
opendevreviewDmitry Tantsur proposed openstack/ironic stable/2023.2: Fix inspection if bmc_address or bmc_v6address is None  https://review.opendev.org/c/openstack/ironic/+/92913815:09
dtantsursorry for spam :D15:09
TheJuliaain't spam when it's legitimate :)15:18
JayFI worked at an email marketing co for my first job; I was doing "deliverabililty" (aka begging email hosts to not mark us as spam). At the first MAAWG (anti-spam) conference, I gave out lunchboxes with cans of spam promising it was the only spam they'd get from us15:22
JayFI always think about that when talking about spam now, the fact I worked at an email marketing company and /literally gave the postmasters for AOL/Yahoo/etc a can of spam/15:22
TheJuliahow... meta15:31
JayFWell, we were doing a re-launch as a startup, so they were "launch boxes"15:35
JayFI'm realizing telling this story in writing that it might be the most jay thing I've ever done15:36
clarkbyour next campaign could've been something like "We serve only the best spam: in fried rice and musubis"15:42
JayFmy next campaign involved quitting when a no-grey-area-spammer -- our largest company -- that I convinced the company to fire -- was reinstated when they agreed to pay a multiple of our typical rate15:43
JayFs/largest company/largest customer/15:43
JayFI've never quite seen such an explicit demonstration of money directly paying to make someone look the other way for an ethical and reputation issue15:43
JayF(... and that led to me being at Rackspace, which led to me being here) 15:44
JayFTheJulia, others: https://review.opendev.org/c/openstack/ironic/+/928974 needs to land for yoga CI, and then we can merge those followups15:46
JayFit'd be extremely helpful to me if we can try to get these unmaintained fixup patches in back to xena today, or by eow15:49
TheJuliaack, I just approved it15:52
JayFyou want me to remove the req bump from your patch or will you?15:53
TheJulialets keep rolling then, I'm *almost* done with my train version of the nightmare15:53
JayFeither way one of us who doesn't has to +2a15:53
TheJuliaJayF: if you could, that would be kickass, I'd approve it anyway as it is an unmaintained branch at this point but we both care and that is good enough for me15:54
JayFack15:54
JayFam I crazy? I thought https://review.opendev.org/c/openstack/ironic/+/928709 had a requirements change with it15:55
JayFguess not, easier this way anyway15:58
TheJulianah, I was trying to repro locally and complaining in irc15:58
JayFI think we could justify a setuptools addition to u-c in yoga15:59
JayFbut those u-c updates in yoga have been agressively nacked in the past15:59
TheJuliayeah, keeping it working in current state on an uncapped dependency is more important16:00
JayFI agree with "don't change requirements"16:01
JayFbut for things like setuptools, I feel like that's mostly a "shipped with OS" thing16:01
TheJuliawe really are not, from what it was developed with16:01
TheJuliayeah16:01
JayFreally only developers and weirdoes running gentoo hit it ;) 16:01
clarkbsetuptools is also special because people think that putting it in requirements or constraints allows you to control its version (it does not)16:03
clarkbyou haev to use pyproject.toml to do that reliable16:03
* TheJulia finds issue on train backport and gets the wax and buffer back out16:04
JayFclarkb: having it there matters in tox cases, afaict16:05
JayFclarkb: and that's mainly the only case16:05
JayFwhich is why in that yoga fix patch, I put setuptools<71 in the tox.ini instead of requirements16:05
clarkbthat only works if people use tox right. But if you just pip install kaboom16:06
clarkbif you want pip install to reliably fetch setuptools you need to use pyproject.toml to specify the dep16:06
JayFwhich is not a change we're going to backport16:06
JayFwhich is why we end up in these weird situations :/16:07
clarkbya I'm not saying you should I'm just calling out why you have to be careful with pretending to manage setuptools16:07
clarkbit gives people the feeling of a solution when it doesn't work in the most common case16:07
JayFYeah. It's not easy trying to maintain software for a half-decade when it's built on a quicksand foundation ;/16:08
JayFpython packaging tools have yolo-broken more packages that I work on than any other set of libraries combined16:08
opendevreviewOpenStack Release Bot proposed openstack/ironic bugfix/22.0: Update .gitreview for bugfix/22.0  https://review.opendev.org/c/openstack/ironic/+/92914916:14
JayFI approved dmitry's changes above to unblock CI across our branches. Once they land I'll evaluate if we need to send 'em to unmaintained, too16:18
opendevreviewMerged openstack/ironic master: Set node "alive" when inspection finished  https://review.opendev.org/c/openstack/ironic/+/92782816:46
opendevreviewMerged openstack/ironic bugfix/26.0: Try limiting MTU to at least 1280  https://review.opendev.org/c/openstack/ironic/+/92912816:46
opendevreviewMerged openstack/ironic bugfix/25.0: Try limiting MTU to at least 1280  https://review.opendev.org/c/openstack/ironic/+/92912916:46
opendevreviewMerged openstack/ironic bugfix/24.0: Try limiting MTU to at least 1280  https://review.opendev.org/c/openstack/ironic/+/92913016:46
TheJuliaJayF: what do you need from me right now for the branch patches?17:03
JayFnothing, I think17:03
JayFI went ahead and +2A all of those UM patches so we could make them get landed; the yoga one needs a recheck once my fix-it patch lands17:04
JayFbut I expect we'll have em all landed by eod17:04
JayFI'll ping ya if I need something specific :D 17:04
JayFTheJulia: one question: is there a reason the cve follow-up isn't on victoria? Just making sure before I cherry-pick it17:08
TheJuliaI likely forgot17:09
TheJuliaI've been getting pulled in a few different directions the past few days17:09
JayFno problem, I'm on it17:09
JayFjust making sure no unknowns17:09
TheJuliaI think it was more trying to figure out what was going on with yoga17:09
TheJuliaThank you for your attention to detail and follow-up17:09
JayFhttps://review.opendev.org/c/openstack/ironic/+/929165 probably best you +2A this since I picked it17:10
TheJuliadone17:16
JayFty17:20
opendevreviewMerged openstack/ironic stable/2024.1: Try limiting MTU to at least 1280  https://review.opendev.org/c/openstack/ironic/+/92913117:53
opendevreviewMerged openstack/ironic stable/2023.2: Try limiting MTU to at least 1280  https://review.opendev.org/c/openstack/ironic/+/92913217:56
JayFhttps://review.opendev.org/q/topic:%22mtu-fix%22 I cherry-picked those MTU fixes onto unmaintained before we lose context; they are there if you wanna review but CI is still running.18:09
TheJulia++18:24
TheJuliaThanks18:24
TheJuliaI'm adding some stuff to the PTG etherpad before I forget18:24
JayFFYI 11-14 days until final Ironic releases *must* be cut18:25
JayFso if we need to land something, we should do it soon18:25
TheJulia++18:25
TheJuliaI'm sure that will be "release right meow!" next monday.18:25
opendevreviewMerged openstack/ironic stable/2023.1: Try limiting MTU to at least 1280  https://review.opendev.org/c/openstack/ironic/+/92913318:28
TheJuliaFolks: reminder, for PTG etherpad stuffs, put an estimated amount of time on the item18:35
TheJuliaJayF: did the move of ironic to formally be part of VMT ever go forward or was it pending cores to +1.. or what?!18:36
JayFTheJulia: sometimes hard to predict the time until we see the async discussion; I know when I was PTL I often filled in expected times across many topics18:37
TheJuliaTrue, yeah18:37
TheJuliabut starting to scope it early is really critical18:38
TheJuliabecause then your saying "this could be big"18:38
TheJuliaor "this should be quick"18:38
TheJuliaand when some of that async starts pushing back, it is easy to know18:38
JayFhttps://review.opendev.org/c/openstack/ironic-python-agent/+/927985 and friends need review, trivial, just adding the "we are insecure" warning to older ipas18:38
JayFhttps://review.opendev.org/c/openstack/ossa/+/928005 I have that W-1 until after rpittau is around to approve it18:39
JayFI know he will be unlikely to have opposition to it, but I want to respect that he gets a vote :D18:39
JayFI need to also check the vmt checklist, ensure we've done all the things there18:40
* JayF adds it to his list for tomorrow, along with doing an ironic security vid18:40
JayFI put general time based comments on mine18:41
TheJuliacool cool, thanks18:45
TheJuliaI think my cat supervisor thinks I need to call it a day soon18:49
cardoeTIL loading interfaces can swallow exceptions and exit silently19:36
cardoehttps://github.com/rackerlabs/understack/pull/27519:45
TheJuliayup, the exception hits the surface19:50
TheJuliaOkay, two trips, PTG, and Jury duty now on my calandar for october.22:04
TheJuliaPlease, nothing else.22:04
clarkbmaybe you'll get lucky and they'll say they don't need jurors on the day you are supposed to go in22:05
TheJuliaIt is the whole week, but depending on how they feel I might have to report each and every day or not22:07
TheJuliabest case, they just punt it each day22:07
clarkboh wow in my county it has only ever been a single day unless you get picked22:08
clarkbthen if picked it is for the duration of the trial22:08
TheJuliaIt really depends with what is going on, but similar most of the time.22:12
TheJuliaGo in, fill out form. Either get disqualified in the first or second round of paperwork.22:12
JayFThe experience here in Washington is similar to what Julia experienced... I was basically told to be prepared to come in to be in a jury pool for four out of the five business days of the week, and if we got selected for a trial we would serve and no matter how long it took we were done22:17
JayFI luckily was struck from having to be on a case that would have been extremely unpleasant to be a juror on22:17
cardoePTG gonna be available virtually too?22:49
TheJuliaIt will be entirely virtual23:24

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!