Monday, 2025-11-17

rpittaugood morning ironic! o/07:28
Ayo[m]Good morning ironic :)07:33
Ayo[m]Hi there rpittau good morning:)07:33
rpittauHey Ayo[m] :)07:35
jandersgood morning Ironic o/07:48
opendevreviewRiccardo Pittau proposed openstack/ironic master: [WIP] Skip BMC detection in IPA for out-of-band management  https://review.opendev.org/c/openstack/ironic/+/96716608:53
mumesan[m]good morning ironic 11:03
opendevreviewMerged openstack/ironic master: Deprecate iRMC hardware type and interfaces  https://review.opendev.org/c/openstack/ironic/+/96687911:48
opendevreviewMerged openstack/ironic-python-agent master: Fix RuntimeError when stopping heartbeater in rescue mode  https://review.opendev.org/c/openstack/ironic-python-agent/+/96700612:11
opendevreviewRiccardo Pittau proposed openstack/ironic-python-agent stable/2025.2: Fix RuntimeError when stopping heartbeater in rescue mode  https://review.opendev.org/c/openstack/ironic-python-agent/+/96735312:30
opendevreviewRiccardo Pittau proposed openstack/ironic-python-agent stable/2025.1: Fix RuntimeError when stopping heartbeater in rescue mode  https://review.opendev.org/c/openstack/ironic-python-agent/+/96735512:31
opendevreviewRiccardo Pittau proposed openstack/ironic-python-agent bugfix/11.1: Fix RuntimeError when stopping heartbeater in rescue mode  https://review.opendev.org/c/openstack/ironic-python-agent/+/96735612:32
opendevreviewRiccardo Pittau proposed openstack/ironic-python-agent bugfix/11.0: Fix RuntimeError when stopping heartbeater in rescue mode  https://review.opendev.org/c/openstack/ironic-python-agent/+/96735712:32
opendevreviewHarald Jensås proposed openstack/networking-baremetal master: Configurable allowed network types for ML2 driver  https://review.opendev.org/c/openstack/networking-baremetal/+/96736713:40
TheJuliagood morning13:51
opendevreviewJulia Kreger proposed openstack/ironic-specs master: WIP VXLAN networking  https://review.opendev.org/c/openstack/ironic-specs/+/95940114:26
iurygregorygood morning14:28
* iurygregory is back from PTO14:28
TheJuliao/14:30
TheJuliaclif: just fyi, you left an incomplete comment on 964570 :)14:31
* clif looks14:56
clifI think I completed the thought in another comment14:57
clifIs there a way to delete a comment?14:57
TheJulianot once posted15:01
TheJuliaAre we meeting today?15:01
clifoh well, rip15:01
JayFYou want me to run the meeting?15:01
TheJulia#startmeeting ironic15:01
opendevmeetMeeting started Mon Nov 17 15:01:50 2025 UTC and is due to finish in 60 minutes.  The chair is TheJulia. Information about MeetBot at http://wiki.debian.org/MeetBot.15:01
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:01
opendevmeetThe meeting name has been set to 'ironic'15:01
alegacyo/15:01
kubajjo/15:01
iurygregoryo/15:01
clifo/15:01
TheJuliaGood morning fellow followers of Bare Metal Irony!15:02
cardoeAnyone know if Harald Jensås on IRC?15:02
JayF\o15:02
JayFhjensas: ^15:02
cardoe(I know the meeting started but before I forget) TheJulia: https://review.opendev.org/c/openstack/networking-baremetal/+/967367 might intersect a little with our VXLAN15:02
cardoeThank you JayF.15:02
dtantsuro/15:02
rpittauo/15:02
cardoeo/ for attendance :D15:03
TheJuliacardoe: you may want to add to the etherpad I created in the agenda15:03
TheJuliaAnyhow!15:03
TheJuliaDoes everyone have coffeee?15:03
clifsome, but never enough15:03
TheJulia(This is now a prompt on our agenda, so trying to make sure we're all awake!)15:03
TheJulia#topic Announcements / Reminders15:03
TheJulia#undo15:03
opendevmeetRemoving item from minutes: #topic Announcements / Reminders15:03
TheJuliaOur agenda can be located on the wiki!15:04
TheJulia#link https://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_November_17.2C_202515:04
TheJulia#topic Announcements / Reminders15:04
cido/15:04
TheJuliaOur standing reminder to review items labeled with the hashtag "ironic-week-prio".15:04
TheJulia#link https://tinyurl.com/ironic-weekly-prio-dash15:04
TheJuliaThis week is week R-19, meaning we're past the first milestone of the overall OpenStack project for the current development cycle.15:05
cardoeYes. ALL OF YOU REVIEW!15:05
TheJulia#link https://releases.openstack.org/gazpacho/schedule.html15:05
cardoeAnytime that link has a second page we should aim to whittle that down to 1 page. That might involve kicking patches out of that list if they just aren't ready to land this week.15:05
TheJuliaA general reminder as well, we're quickly approaching holidays15:06
TheJuliaSome folks only have ~3-4 more weeks to the year. So... Get stuff posted and under review!15:06
TheJuliaDoes anyone else have anything to announce or remind us of?15:06
dtantsur#link https://groups.google.com/g/metal3-dev/c/GnyEuOCk5Gc Metal3 virtual meetup this Thursday15:06
TheJuliacardoe: I was thinking about that, and then I was thinking "I need to review harder!"15:07
dtantsurnot very NA friendly time, unfortunately15:07
TheJuliaSeriously though, the key right now is to advance and good is better than nothing and perfection is the enemy of good.15:07
TheJuliadtantsur: oh well :(15:07
TheJuliaAnything else, or are we safe to proceed?15:08
* dtantsur has nothing15:08
TheJuliaOkay then!15:08
TheJulia#topic Working Group Updates15:08
TheJuliaWe have 3 working group etherpads now!15:08
TheJuliaFirst up is Standalone networking!15:09
alegacyThanks for the reviews on my new split patch series.15:09
TheJuliaalegacy: since you've been driving that, anything to update us on aside from you splitting the patches up last week?15:09
alegacyI've updated my patches with fixes to those comments.15:09
TheJuliaExcellent!15:09
alegacyexcept for a couple that are questions that I was unclear about.15:09
alegacyhaving some trouble with zuul job on this one (https://review.opendev.org/c/openstack/bifrost/+/962038) and the next one up for it... not sure I did anything to break it though.15:10
alegacyother than that... just in a holding pattern.15:11
TheJuliaAny determinable failure pattern emerging?15:11
alegacyseems like a timeout to boot a node15:11
alegacysame thing happened several updates ago but cleared after a recheck15:11
TheJuliabest to check the console log then. I suspect it may be unlikely for you to have broken it at that point, but still good to look15:11
alegacythis time it didn't clear up15:11
janderso/15:12
TheJuliaGreetings janders!15:12
janders(sorry for being late, in transit)15:12
TheJuliaOkay, onward!15:12
TheJuliaNext up, asyncio!15:12
jandersif that's OK I have a couple updates/questions - would be awesome if I can squeeze in after the current topic15:12
cidI doubt we have any updates in regards to asyncio yet!15:13
cidclear15:13
TheJuliacid: fair15:13
dtantsurnothing from me too15:13
TheJuliaNext up, our new addition! VXLAN Networking15:13
TheJuliaThis etherpad is fresh and new, having been recently created just a half hour ago!15:14
TheJulia#link https://etherpad.opendev.org/p/ironic-vxlan15:14
cardoeStill has that fresh out of the oven smell15:14
TheJuliaI think the tl;dr is we're trying to spread context and awareness15:14
TheJuliacardoe: indeed!15:14
TheJuliaThere is a new version of the ironic spec. It seems like the Neutron one to get the idea across is where they are wanting a demo15:15
TheJuliaI guess, more discussion and consensus building will be necessary!15:15
cardoeI'm looking to update my docs a little bit on L2VNI vs L3VNI so that we can convey the segment binding.15:15
TheJuliacardoe: checkout my spec, I detail all the why "L3VNI" and why "existing overlay VXLAN" doesn't work.15:16
TheJuliaI also have a crazy idea, support geneve since internally ovn entirely ignores the segmentation_id15:16
cardoeYeah I saw you add that which made me think I should add some details.15:16
TheJuliaand we still need to plumb an attachment15:16
TheJuliacool cool15:16
TheJuliaOnward if there is nothing else15:16
TheJuliaWe have no standing Discussion topics right now, so onward to the Bug Deputy!15:17
TheJulia#topic Bug Deputy Updates15:17
TheJuliacid: the floor is yours15:17
cidThere were two bugs and two RFEs.15:17
cidOne I'm not certain if it's worthy of an RFE15:18
cidhttps://bugs.launchpad.net/ironic/+bug/2131055 - Support segmented serial console port range (RFE?)15:18
cidhttps://bugs.launchpad.net/networking-generic-switch/+bug/2114451 - Ports should contain a reference to the segment_id they are bound to15:18
TheJuliaso that n-g-s one, I think it is actually a bug. Honestly, if it didn't exist and wasn't already highlighted in neutron code as being problematic, I might have raised it under embargo.15:18
TheJuliaI'm +1 to the first RFE15:19
dtantsurNo objections to the RFE either15:20
cid++15:20
TheJuliaIs there anything further to discuss regarding these RFE's?15:21
cardoeCan n-g-s store extra data in a binding on a neutron port? Cause if not, we need it to be fixed in neutron.15:22
TheJuliaTechnically, we might be able to if the field exists. 15:22
TheJuliaBut it *is* an awful bug15:23
TheJuliaI added it to NGS because the same pattern is referenced, fwiw15:23
cardoeyep agreed.15:24
TheJuliaSo onward to Open Dsicussion?15:24
jandersI have two items (if my transit comms allow)15:24
TheJulia#topic Open Discussion15:25
TheJuliajanders: the floor is yours15:25
janders1) Fujitsu15:25
jandersthe iRMC deprecation patch is merged15:25
janderscommunications with FJ went relatively well15:25
jandersmy main question is: what is our plan for removal of iRMC15:26
jandersnormally we would want it deprecated for a release and them move on to removal15:26
jandersbut from PTG my impression is we want to move as soon as practical15:26
jandersI'd be interested in your thoughts, in particularly TheJulia and JayF15:26
JayFWas iRMC in that list of dying drivers a couple years ago?15:27
TheJuliaJayF: yes15:27
TheJuliaDeprecation ages ago, actually15:27
dtantsurWe only deprecated it today officially15:28
JayFhttps://specs.openstack.org/openstack/ironic-specs/priorities/2024-1-workitems.html#marking-multiple-drivers-for-removal15:28
JayFwe did not list iRMC then15:28
TheJuliaYeah, the internals were only marked today15:28
JayFwe put it in current work items15:28
JayFso that means an 18 month timer /should/ start15:28
TheJuliaThere is a prior deprecation release note15:28
JayFoh, good15:28
dtantsurWhere?15:28
TheJuliajanders went to edit it and I -1'ed editing it15:28
JayFwhat's 18 months from when that was posted? That's what we technically owe; although realistically I think technical requirements may rule over promised support timelines given the vendor bailed15:29
dtantsurI'm only aware of a release note today15:29
TheJuliaI need to jump to another meeting in a few minutes, but I'll dig it up15:29
jandersI can't get to gerrit from my current wifi at the moment so if someone could pull it out that would be awesome15:29
JayFIn any event, we can't keep the snmp driver around longer than this cycle15:30
JayFso I am of the opinion iRMC goes away next cycle even if it's a promise breaker15:30
JayFis it great? No. Is it better than keeping vulnerable SNMP libraries around even longer? yes.15:30
dtantsurI concur15:30
janders++15:30
jandersbut - no removal this cycle, right?15:30
jandersduring PTG we were thinking moving quickly so trying to quantify how quickly, it makes sense to me that we need to give folks some minimal notice15:31
JayFSNMP driver is gone *next* cycle15:31
JayFiRMC depends on SNMP driver15:31
JayFso that serves as a hard end date15:32
jandersagreed15:32
jandersok so this sounds like a sufficient answer to me15:32
jandersany closing thoughts on the iRMC topic for now?15:32
dtantsurFor Metal3, I'm planning removal after the upcoming releases15:32
dtantsurbasically, early next year15:32
jandersthanks for your inputs, folks15:33
opendevreviewMerged openstack/ironic-python-agent-builder stable/2025.2: Wait up to 30 seconds for config drive  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/96682215:34
TheJuliachange If0d124352dec7072d7f806d60628eefe3619a8b015:34
TheJulia2020 it was first put in a release note15:34
JayFso we could kill it this cycle if we wanted15:35
TheJuliaso I think alignment with SNMP works.15:35
JayFyep15:35
TheJuliacool cool15:35
TheJuliaAnyway, Anything else for Open Dsicussion15:35
dtantsurTheJulia: this was reverted15:36
dtantsuranyway15:36
jandersif no further thoughts on iRMC deprecation, I'd like to redfish monitoring topic. I can't pull up the patch atm (wifi issues) but I wanted to clarify how to go about making healthchecks configurable and 15:36
TheJuliadoh!15:36
janderssee if we can reach consensus on that15:36
TheJulia... wait, we left the release note?15:36
dtantsurTheJulia: added another one in 8bd138ca85cf80911153064ab9286f6a3fd9011815:37
TheJuliagaaaah15:37
* TheJulia sighs15:37
TheJuliaIt has to go with the snmp driver anyhow15:37
TheJuliaso *shrugs*15:37
dtantsurjanders: I think the underlying problem is that we keep piling things into the power sync loop without really considering a wider picture15:38
dtantsurwhich is not terrible, to be clear. but it does cause discussions like this one15:38
jandersshould I reconsider putting syncing health info somewhere else?15:38
dtantsurthere is no somewhere, that's the problem15:39
jandersor do we keep it as-is but start thinking about a better way (especially in case we want to pull in detailed health metrics from more/man components)15:39
jandersI understand15:39
dtantsurand I don't think it's on you to really rethink the whole thing15:39
JayFI think we should answer the bigger question but it doesn't have to be in your change. Like I said in the patch, I mainly want an escape hatch if someone has misbehaving hardware or if a driver exists in the future where that's a pricey call.15:39
dtantsur(some of my thoughts are in https://bugs.launchpad.net/ironic/+bug/2049913 but who has time for that..)15:39
dtantsurHonestly, we may need to go even further and have a step-like mechanism for periodic inspection15:40
dtantsurbut I shut up :)15:40
dtantsurI don't have really hard objections to an option for disabling health status fetching, as long as we set the Node.health field to something that indicates it15:40
jandersall noted15:40
jandersso dtantsur would you be happy with me re-introducing the config option?15:41
dtantsur(i.e. "Disabled" instead of a generic null)15:41
jandersOK15:41
janders(sorry, laggy link)15:41
dtantsurnp15:41
jandersok, thank you15:41
jandersthat's it from me15:41
jandersI gotta run (little one getting impatient, gotta keep driving)15:41
* dtantsur keeps pondering "sync steps" and potentially "sync runbooks"15:41
jandersthanks and see you next time o/15:42
dtantsurthank you janders15:42
JayFdtantsur: sync?15:42
JayFdtantsur: fwiw the only issue I'd have with your RFE around integrated-inspection is that I have a specific ask to try and ensure paths exist to use Ironic w/minimal redfish surface, primarily related to us sometimes being the first folks to get hardware (and finding things like the three headed server monster) .... and IME, inspection is much more likely to break than basic boot management and power control.15:43
dtantsurJayF: sync derived from "power sync". Like steps for periodic collection of various data.15:44
dtantsurThink about defining a runbook that says what you want to be collected and how often.15:44
JayFwhoa15:44
dtantsur"Please disable power sync for this node but do collect health information"15:44
* dtantsur is getting carried away15:44
JayFThat's a fun idea15:45
JayFand integrates with your existing RFE in a way that doesn't trip up my needs15:45
dtantsuryeah15:45
TheJuliaIs there anything else to discuss today?15:47
cardoedtantsur: thanks for putting that RFE up there.15:47
cardoeToday we're doing redfish inspection to create the ports and then agent inspection for other bits but that can't touch the ports.15:47
cardoeWe'd also want to run the redfish inspection even when the machine is active.15:48
TheJuliaI'm going to wrap the meeting, thanks folks!15:50
dtantsurthanks all!15:51
TheJulia#endmeeting15:51
opendevmeetMeeting ended Mon Nov 17 15:51:37 2025 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:51
opendevmeetMinutes:        https://meetings.opendev.org/meetings/ironic/2025/ironic.2025-11-17-15.01.html15:51
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/ironic/2025/ironic.2025-11-17-15.01.txt15:51
opendevmeetLog:            https://meetings.opendev.org/meetings/ironic/2025/ironic.2025-11-17-15.01.log.html15:51
TheJuliacardoe: your not the first person to raise that ask, actually :\15:51
dtantsurcardoe: yeah, we've basically started bypassing inspection for certain things that need to be updated regularly (like this health status)15:52
dtantsurso my RFE is a first stab at trying to rethink what inspection even is15:52
kubajjanybody would have a minute to trigger workflow for https://review.opendev.org/c/openstack/ironic-python-agent/+/963200 ?15:52
TheJuliaSeems like it could also be a red herring since we need to focus on the most impactful first15:52
hjensascardoe: That networking-baremetal change, triggered by some downstream testing we are doing. It turns out neutron does not filter the check for vlan transparancy on ML2 drivers supported networks so it won't work.15:58
cardoeLovely.15:59
cardoeThere's a number of things that need to check before a ML2 driver does something16:00
hjensascardoe: so ... we are discussing downstream if we just should not have tests mixing ironic and VLAN transparency for VMs in the same cloud at all, or if this is a bug in neutron ...16:00
hjensasThe initial ask was to just create the function to report we support transparent VLAN, but I am not sure networking-baremetal/n-g-s should support it.16:05
TheJuliahjensas: vlan transparency, is that 802.1q trunks?16:10
TheJuliaoh, you mean a native vlan when you have other vlans being passed over?16:13
cardoeI thought vlan transparency was going away in neutron in favor of q-in-q?16:17
opendevreviewTakashi Kajinami proposed openstack/ironic master: Drop remaining inspector job  https://review.opendev.org/c/openstack/ironic/+/96739716:19
tkajinamI'm just curious to know if we can drop inspector inspect interface now ? I see the doc already says it's deprecated while release note does not16:20
hjensasTheJulia: vlan transparency is truly "transparent" it just moved the packets and it is left to the workload to look at the VLAN tags. In physical switch world it's like "create vlans 1-4000" on the switch and set ports to "mode trunk allowed vlans all"16:20
mnasiadkacardoe:If you’re referring to https://review.opendev.org/c/openstack/neutron/+/951136 - I think it was just delegated to the driver16:20
TheJuliaeww, yeah, that is likely a bad idea16:21
TheJuliatkajinam: likely16:22
TheJuliahjensas: yeah, That seems like a nightmare and I likely would say "no, we'll never support that."16:22
TheJuliasince inherently that is a huge security issue as well and doesn't scale16:22
mnasiadkaTheJulia: well, from one perspective yes - but if somebody is using Ironic to deploy hypervisors used by Nova in the same cloud - adding hundreds of VLANs in a trunk (so essentially Neutron subports) is probably also a fun thing to do.16:23
TheJuliaThen it can be a default off option16:24
hjensasTheJulia: yeah, even in OVN it required port-security disabled etc. So all security is "outsourced" to the workload.16:24
TheJuliafun!16:24
opendevreviewVerification of a change to openstack/ironic-python-agent master failed: Implement functionality for the is_root_volume RAID config  https://review.opendev.org/c/openstack/ironic-python-agent/+/96320016:54
cardoedon't forget folks... some cheap ones in that ironic-week-prio queue like https://review.opendev.org/c/openstack/ironic/+/966684 a backport :D which will spawn another one as I backport it down again17:49
opendevreviewMerged openstack/networking-generic-switch master: Fix support for Aruba AOS CX devices  https://review.opendev.org/c/openstack/networking-generic-switch/+/95823418:31
opendevreviewVerification of a change to openstack/ironic stable/2025.1 failed: Fix storing inventory and plugin data in Swift  https://review.opendev.org/c/openstack/ironic/+/96668319:10
opendevreviewMerged openstack/ironic master: Add Release Schedule to release how to  https://review.opendev.org/c/openstack/ironic/+/96509019:27
cardoelooks like dnsmasq git might be down about to see a bunch of failed gates.20:18
opendevreviewVerification of a change to openstack/ironic stable/2025.1 failed: fix: local_link_connection inspection hook does not fail on missing port  https://review.opendev.org/c/openstack/ironic/+/96668420:18
cardoenova also is failing to build the VM in the timeout with OVN iPXE IPv620:19
opendevreviewJulia Kreger proposed openstack/ironic master: ci: disable multinode subnode running n-cpu  https://review.opendev.org/c/openstack/ironic/+/95611720:22
TheJulia^^^ is my thinking of maybe making the mulitnode jobs happier20:22
TheJuliacardoe: got al ink?20:23
cardoehttps://zuul.opendev.org/t/openstack/build/85d54c85112c449da1bbdd26b3867a3c there's an OVN iPXE IPv620:24
cardoeactually looks like we ran out of disk space20:25
cardoehttps://zuul.opendev.org/t/openstack/build/85d54c85112c449da1bbdd26b3867a3c/log/controller/logs/ironic-bm-logs/node-0_console.log.020:25
TheJuliayup20:27
TheJuliawell20:27
TheJuliaRAM20:27
TheJuliaIRONIC_VM_SPECS_RAM: 275020:28
TheJuliauhhh20:28
TheJuliahttps://tarballs.opendev.org/openstack/ironic-python-agent/dib/files/20:29
TheJuliawe need to backport some fixes, I guess20:29
opendevreviewJulia Kreger proposed openstack/ironic-python-agent-builder stable/2025.2: cs10 - remove excess intel firmware  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/96743820:31
opendevreviewJulia Kreger proposed openstack/ironic-python-agent-builder stable/2025.2: Fix firmware cleanup - more.  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/96744420:34
opendevreviewVerification of a change to openstack/ironic stable/2025.1 failed: Fix storing inventory and plugin data in Swift  https://review.opendev.org/c/openstack/ironic/+/96668320:35
opendevreviewJulia Kreger proposed openstack/ironic-python-agent-builder stable/2025.1: Allow dib build to remove firmware in a structure.  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/96744620:36
opendevreviewJulia Kreger proposed openstack/ironic-python-agent-builder stable/2025.1: Fix firmware cleanup - more.  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/96744720:36
opendevreviewJulia Kreger proposed openstack/ironic-python-agent-builder stable/2025.1: Add Mellanox Spectrum to firmware to remove list  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/96745020:41
opendevreviewJulia Kreger proposed openstack/ironic-python-agent-builder stable/2025.1: Add additional firmware images which are not needed  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/96745120:41
opendevreviewJulia Kreger proposed openstack/ironic-python-agent-builder stable/2025.1: Exclude unnecessary firmewares  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/96745220:41
TheJuliacardoe: ^^^ all those should make the world happier20:42
TheJuliabut we'll need to get something to land on the branches to do a rebuild20:42
cardoeah okay. So I was gonna do 2024.2 and bugfix/31.0 next20:48
TheJuliasure, 2024.2 should be moving to unmaintained soonish21:14

Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!