Monday, 2025-11-24

opendevreviewVerification of a change to openstack/networking-generic-switch master failed: tox: Enable codespell by default and limit it to relevant files  https://review.opendev.org/c/openstack/networking-generic-switch/+/95815401:41
rpittaugood morning ironic! o/07:47
rpittauinteresting, there are some specific performance issues in noble jobs compared to cs10 jobs in bifrost, especially for vmedia08:53
opendevreviewRiccardo Pittau proposed openstack/bifrost master: Remove tinyipa support and switch to debian IPA  https://review.opendev.org/c/openstack/bifrost/+/96440408:56
iurygregorygood morning ironic11:24
himani__Happy Monday ironic ^^11:35
opendevreviewVerification of a change to openstack/ironic master failed: ci: remove snmp ci job  https://review.opendev.org/c/openstack/ironic/+/96321512:46
opendevreviewRiccardo Pittau proposed openstack/bifrost master: Remove tinyipa support and switch to debian IPA  https://review.opendev.org/c/openstack/bifrost/+/96440413:43
TheJuliagood morning everyone13:57
opendevreviewRiccardo Pittau proposed openstack/tenks master: [WIP] Modernize and fix CI  https://review.opendev.org/c/openstack/tenks/+/96820014:13
cardoegood morning everyone14:13
opendevreviewRiccardo Pittau proposed openstack/tenks master: [WIP] Modernize and fix CI  https://review.opendev.org/c/openstack/tenks/+/96820014:18
opendevreviewRiccardo Pittau proposed openstack/tenks master: [WIP] Modernize and fix CI  https://review.opendev.org/c/openstack/tenks/+/96820014:19
opendevreviewRiccardo Pittau proposed openstack/tenks master: [WIP] Modernize and fix CI  https://review.opendev.org/c/openstack/tenks/+/96820014:21
opendevreviewRiccardo Pittau proposed openstack/tenks master: [WIP] Modernize and fix CI  https://review.opendev.org/c/openstack/tenks/+/96820014:23
opendevreviewRiccardo Pittau proposed openstack/tenks master: [WIP] Modernize and fix CI  https://review.opendev.org/c/openstack/tenks/+/96820014:47
TheJuliagood morning Ironic!15:00
TheJuliaWho is driving our Ironic meeting this week?15:00
TheJuliaI guess I'm going to be running it15:01
TheJuliaDoes everyone have a large cup of coffee?15:02
womaxgood morning/afternoon15:02
TheJulia#startmeeting ironic15:02
opendevmeetMeeting started Mon Nov 24 15:02:33 2025 UTC and is due to finish in 60 minutes.  The chair is TheJulia. Information about MeetBot at http://wiki.debian.org/MeetBot.15:02
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:02
opendevmeetThe meeting name has been set to 'ironic'15:02
alegacyo/15:02
TheJuliaWelcome to the Ironic meeting for November 24th, 2025. Our agenda can be found on the wiki.15:02
TheJulia#link https://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_November_24.2C_202515:03
TheJuliaBig question for the moment: do we have a quorum ?15:03
kubajjo/15:03
TheJuliaOr is everyone going and getting coffee like the agenda says? :)15:03
cidI think so :D15:04
cido/15:04
TheJuliaI know Jay said he was semi-taking today off, although I entirely forgot something I discussed with him last week.15:05
TheJuliaI believe Dmitry is out as well this week.15:05
TheJuliaSince it looks like we're basically right below where I'd feel comfortable going through the full agenda  with what feels like quorum, do we have anything which requires specific inspection or discussion by attendees at this time?15:06
cidTrue. Jay proposed a review jam session after the weekly meeting. 15:07
cidNone from my end.15:07
alegacyI've got some new review comments to address on my end so i'll be busy with that for the next day or so.15:08
TheJuliaAhh, yes. In part I know alegacy pushed a bunch of revisions as well on ?Friday?15:08
TheJuliaalegacy: okay, do you need review focus today?15:08
opendevreviewRiccardo Pittau proposed openstack/tenks master: [WIP] Modernize and fix CI  https://review.opendev.org/c/openstack/tenks/+/96820015:08
dtantsurI'm not out, only slow :)15:08
alegacyif there are more review comments i'll take 'em. :)15:08
rpittauo/15:09
TheJuliaHuh, I thought you were out...15:09
TheJuliaalegacy: fair enough15:09
dtantsurI'm here until the very holidays15:09
TheJuliado we want to roll through the agenda, or just continue on our laid back path we're on today?15:09
dtantsurI'm fine being laid back15:09
TheJuliaSpeaking of holidays, I raised a question, End of year meeting skips15:10
TheJuliaAny thoughts on skipping 12/22 and 12/29 ?15:10
kubajjI think it is reasonable15:11
cid++15:11
rpittausounds good15:11
dtantsuryep15:12
TheJuliaSounds like we have consensus on that then15:12
TheJuliaI'll take the action item to send an email out15:12
TheJuliaDo we have any bugs to discuss or other items to discuss?15:12
* TheJulia takes silence as no15:14
cidMostly no! I triaged this bug with a high priority.15:15
cidhttps://bugs.launchpad.net/ironic/+bug/213224615:15
* TheJulia looks15:15
cidI bet it's valid, but not confirmed : https://bugs.launchpad.net/ironic/+bug/213224615:15
TheJuliaIf what someone else mentioned to me last week is true, it is totally valid15:15
TheJuliawe swapped the clients out and didn't check shared image behavior explicitly when we did15:16
cidMakes sense.15:16
TheJuliaAnything else?15:17
cidNot really15:17
TheJuliaOkay, thanks!15:17
TheJuliaAnything else for us to [plot|discuss|design|confer] ?15:18
womaxHi totally new here, dunno if it is the good times to talk about it, but i was recently working on adding support to generate temp url for image stored on s3 backend and wanted to try to contribute it upstream. And i was asking myself a few questions15:19
womaxMainly if temp url generation should stay only in ironic or should I suggest change to move this part to glance maybe, to be able to use it in nova for example15:20
TheJuliaWelcome womax! I think I'll end the meeting if your alright with it, and your free to ask questions anytime15:20
womaxok I'm good with that15:20
TheJuliaThanks everyone! Have a wondeful week!15:20
TheJulia#endmeeting15:20
opendevmeetMeeting ended Mon Nov 24 15:20:49 2025 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:20
opendevmeetMinutes:        https://meetings.opendev.org/meetings/ironic/2025/ironic.2025-11-24-15.02.html15:20
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/ironic/2025/ironic.2025-11-24-15.02.txt15:20
opendevmeetLog:            https://meetings.opendev.org/meetings/ironic/2025/ironic.2025-11-24-15.02.log.html15:20
cardoeblah I missed the meeting sorry15:21
TheJuliawomax: So S3 backend with Glance? Or directly use S3 ?15:21
cardoecid, TheJulia: https://bugs.launchpad.net/ironic/+bug/2132246 is fixed by https://review.opendev.org/c/openstack/ironic/+/96808715:21
TheJuliacardoe: moar coffee15:21
cardoeIf someone +2/+W that, I'll backport it.15:21
womaxso currently glance already support s3 but ironic is unable to boot image that are stored in a s3 store because temp url generation in swift specific15:22
womaxI made a few patches on my end to change that but doing that I took quite a bit of code from glance_store mainly to handle config file15:22
TheJuliacardoe: just to confirm, member.id value is the project UUID?15:23
TheJuliawomax: so, what is actually required to generate the S3 tempurl?15:23
TheJuliaWith swift, its a shared secret in advnace 15:23
womaxsome credentials, endpoints and bucket name15:23
womaxit close to what swift required but the main problem from my understanding of the code is that ironic doesn't really care about which store the image is in in case glance is confiured with multistore15:24
TheJuliaFollowing the swift pattern, it sounds like you'd need to add image service client code to sort of directly understand and handle it to generate the tempurl if it is S3. Maybe that is the right path?15:25
TheJuliaIs a glance client able to determine if it is stored in S3?15:25
cardoeTheJulia: per the docs yes15:25
opendevreviewMerged openstack/ironic master: fix: sphinx-lint unbalanced backticks  https://review.opendev.org/c/openstack/ironic/+/96814815:25
womaxfrom what i found it depends what glance exposing in image info15:25
womaxin my case I only found glance only sending me the store name but maybe i did not found the right way to do it15:26
TheJuliaHmm, that does make it a bit difficult15:27
womaxand yeah i did make my change in image service15:27
cardoeTheJulia: "the appropriate identifier to use for the member_id is the consumer’s project ID"15:28
womaxbasically what i did is add configuration options like glance to define store and update image service to try to load the store glance give based on ironic config and then generate it15:28
womaxthat why i was wondering wether such change should stay in ironic or maybe i should also go see the glance team to move the generation in glance (where configuration is already present) and just retrieve in ironic15:29
TheJuliathat doesn't seem like an awful approach, really.15:29
TheJuliaOne service can't retrieve configuration details of another service15:29
TheJuliaso configuration duplication is really the only way15:30
womaxI understand that what I meant is maybe just generate a temp url in glance and then send it to ironic as glance has already everything it need to do the generation15:30
womaxBut I agree a simpler approach would be configuration duplication15:31
opendevreviewJulia Kreger proposed openstack/ironic-python-agent master: ci: disable vnc on IPA jobs  https://review.opendev.org/c/openstack/ironic-python-agent/+/96807815:31
TheJuliaThat could be viable, I mean, it would be nice to be able to ask glance to "give us tempurls" in general15:32
womaxOk so I guess I'll go discuss with the glance to get their opinions on this, and see where it goes15:34
JayFTheJulia: cid: I'm here if we wanted to go through reviews. Maybe +5M to give me time to make coffee :)15:34
womaxthank you for your time15:35
TheJuliawomax: thank you for your efforts! Keep us apprised! Thanks!15:35
opendevreviewVerification of a change to openstack/ironic master failed: ci: remove snmp ci job  https://review.opendev.org/c/openstack/ironic/+/96321515:35
TheJuliaJayF: Sure, I will warn you, my coffee is being retireved and has yet to be sipped15:35
cardoeTheJulia: even though https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/951681 failed it seemed like a good thing we wanted? So I dragged it out of the wood work.15:36
TheJuliacardoe: hmm.. I got soemthing wrong there15:36
cardoesure but the concept seemed good15:37
JayFhttps://us06web.zoom.us/j/89014244066?pwd=5PiI85z5DpGSEC0L1CqkqeFicw8fao.1 no rush just hanging out until we get folks around15:37
TheJulialooking for headphones15:37
opendevreviewVerification of a change to openstack/ironic master failed: Remove inspector inspect interface  https://review.opendev.org/c/openstack/ironic/+/96747615:40
cidomw15:41
JayFcardoe: cid: review jam? We need 3 for edit-and-land-quorum15:41
dtantsuroh, review jam? I can join if you give me a few minutes15:42
cardoeI'd be down. Trying to troubleshoot this 2025.2 env15:42
opendevreviewJulia Kreger proposed openstack/ironic master: Switch graphical console image to ubuntu by default  https://review.opendev.org/c/openstack/ironic/+/96420115:45
opendevreviewMarcus Furlong proposed openstack/sushy master: Don't require Boot and Actions for Systems  https://review.opendev.org/c/openstack/sushy/+/96771515:45
opendevreviewRiccardo Pittau proposed openstack/tenks master: [WIP] Modernize and fix CI  https://review.opendev.org/c/openstack/tenks/+/96820015:46
opendevreviewRiccardo Pittau proposed openstack/bifrost master: Remove tinyipa support and switch to debian IPA  https://review.opendev.org/c/openstack/bifrost/+/96440415:51
JayFiurygregory: https://review.opendev.org/c/openstack/ironic/+/955484/12/ironic/drivers/modules/redfish/management.py please make sure to review this15:52
cardoeJayF: so that image issue we're seeing... it appears that our instance_master_path and our tftp_master_path are different. It's downloading the image to the tftp_master_path and then throwing the exception because it expects the file to be in the instance_master_path15:57
opendevreviewJulia Kreger proposed openstack/ironic master: Minimize json-rpc client logging  https://review.opendev.org/c/openstack/ironic/+/95811915:59
JayFcardoe: is https://review.opendev.org/c/openstack/ironic/+/967965/2#message-185c8672f7b643acca5e874865e598e1faf339c3 a -1, essentially?16:04
cardoeyeah sorry. I should have done that.16:05
JayFclif: please be sure to apply this followup: https://review.opendev.org/c/openstack/ironic/+/962598/11#message-dcb4932cf93b6b6f045596e6a7054598b7fdef5d16:07
opendevreviewcid proposed openstack/python-ironicclient master: A new `instance_name` field to the node object  https://review.opendev.org/c/openstack/python-ironicclient/+/95510216:10
opendevreviewVerification of a change to openstack/ironic master failed: Remove inspector inspect interface  https://review.opendev.org/c/openstack/ironic/+/96747616:17
opendevreviewMerged openstack/ironic master: fix: grammar Ideall -> Ideally  https://review.opendev.org/c/openstack/ironic/+/96814916:23
opendevreviewVerification of a change to openstack/ironic master failed: fix: remove unnecessary trailing slash  https://review.opendev.org/c/openstack/ironic/+/96815016:23
opendevreviewVerification of a change to openstack/ironic master failed: chore: disable pycodestyle and pyflakes double runs  https://review.opendev.org/c/openstack/ironic/+/96815116:23
opendevreviewVerification of a change to openstack/ironic master failed: chore: fix spelling mistakes  https://review.opendev.org/c/openstack/ironic/+/96815216:23
opendevreviewVerification of a change to openstack/ironic master failed: chore: bump to latest pre-commit tools  https://review.opendev.org/c/openstack/ironic/+/96815316:23
opendevreviewJay Faulkner proposed openstack/ironic master: ci: remove metalsmith ci job invocation  https://review.opendev.org/c/openstack/ironic/+/96321616:26
JayFstevebaker[m]: https://review.opendev.org/c/openstack/ironic/+/962242/11 needs a rebase then can land16:29
dtantsurTheJulia: https://review.opendev.org/c/openstack/bifrost/+/961388 (the last failure is because of the oslo.service issue, rechecking now)16:36
TheJuliayeouch, github error took out that chain of patches16:36
opendevreviewcid proposed openstack/ironic master: Move configdrive code to configdrive_utils  https://review.opendev.org/c/openstack/ironic/+/96588016:36
* dtantsur shakes fist at github16:36
dtantsuryeah, we had a row of failures in the metal3 CI too16:37
TheJuliayeah16:40
opendevreviewMerged openstack/ironic master: fix: glance image member lookup resulted in an empty list always  https://review.opendev.org/c/openstack/ironic/+/96808716:40
opendevreviewJulia Kreger proposed openstack/ironic master: Revert "ci: stabilize ironic-standalone-redfish"  https://review.opendev.org/c/openstack/ironic/+/95651516:50
opendevreviewDoug Goldstein proposed openstack/ironic stable/2025.2: fix: glance image member lookup resulted in an empty list always  https://review.opendev.org/c/openstack/ironic/+/96822616:50
opendevreviewMerged openstack/ironic master: ci: disable multinode subnode running n-cpu  https://review.opendev.org/c/openstack/ironic/+/95611717:03
opendevreviewRiccardo Pittau proposed openstack/tenks master: [WIP] Modernize and fix CI  https://review.opendev.org/c/openstack/tenks/+/96820017:19
opendevreviewVerification of a change to openstack/ironic master failed: Trait Based Networking Filter Expression Parsing and Base Models  https://review.opendev.org/c/openstack/ironic/+/96149817:21
opendevreviewVerification of a change to openstack/ironic master failed: Configuration file for Trait Based Networking  https://review.opendev.org/c/openstack/ironic/+/96259817:21
opendevreviewRiccardo Pittau proposed openstack/tenks master: [WIP] Modernize and fix CI  https://review.opendev.org/c/openstack/tenks/+/96820017:31
opendevreviewMerged openstack/ironic-python-agent-builder master: Add simple-init by default  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/96619217:33
clifJayF: aren't we also changing the format of the config file to be JSON instead of YAML?17:43
opendevreviewVerification of a change to openstack/networking-generic-switch master failed: Fix incorrect command when unplugging bond subports  https://review.opendev.org/c/openstack/networking-generic-switch/+/95942317:45
cardoeMy eyes are floating looking at this image cache / download code.17:57
TheJuliacardoe: why are you causing yourself pain doing that?17:57
cardoeWe cannot get a box to kick on 2025.2 cause of this error17:58
cardoeskrobul and I are trying to figure out why17:58
opendevreviewJulia Kreger proposed openstack/ironic master: WIP: Downgrade the lock on vif detach  https://review.opendev.org/c/openstack/ironic/+/96806118:01
TheJuliacardoe: what error? and btw ^^^ is for y'all18:02
opendevreviewMerged openstack/ironic-python-agent master: ci: disable vnc on IPA jobs  https://review.opendev.org/c/openstack/ironic-python-agent/+/96807818:02
cardoehttps://gist.github.com/skrobul/64798d4ff8987ee3fcce93f8f1b991e518:03
cardoeLine 54 of the conductor logs18:03
cardoehttps://github.com/rackerlabs/understack/releases/download/understack-images-20251016184704/ubuntu-noble.qcow2 is image 5048de36-4c01-4047-b638-195e639cb1e318:05
cardoeWhich is just disk image builder of the Ubuntu Noble with a broadcom NIC driver being added by a DIB18:05
cardoeI'm wondering if John Garbutt didn't see the periodic timer coming along and cleaning up the image cache directory cause it doesn't take into account files that are currently locked and will just delete anything.18:07
TheJuliaall sorts of fun errors, looks like you ahve a machine which doesn't have version attributes in the bios settings18:08
TheJuliaso, hmmm18:08
TheJuliaconverted should only be a thing when files are converted18:08
cardoeyeah cid made a patch and I +W'd it last week18:08
TheJuliabut, I don't remember exactly18:09
cardoeSo the Ubuntu image is qcow2... I should probably just upload it raw18:09
TheJulianothing there, at a glance makes me think image_to_raw is getting invoked18:10
TheJuliabut that is expected18:10
TheJuliaoh, more files18:11
cardoehttps://www.irccloud.com/pastebin/LCNKchR2/18:11
cardoeThat's what the image checker thing gives from oslo.utils18:11
TheJuliataht sure does sort of look like the cache got waxed mid-stream18:12
cardoeWe slapped a root logger on all of this and qemu-img doesn't get called.18:14
cardoeor at least utils.execute() didn't throw its logging messages18:14
TheJuliaso, it gets checked18:15
TheJulia... weird18:16
TheJuliaThat explains the error, but... how18:16
TheJuliabecause that would explain the unlink/removal error as well18:16
TheJuliawell, sort of if it was going down that path18:16
TheJuliaweird, I'd add more logging just to be on the safe side that we're actually getting to qemu_img.convert_image18:17
opendevreviewMerged openstack/ironic-tempest-plugin master: list detailed ports by node  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/71283118:31
opendevreviewDoug Goldstein proposed openstack/ironic master: split error messages in image cache for more clarity  https://review.opendev.org/c/openstack/ironic/+/96824618:40
opendevreviewClif Houck proposed openstack/ironic master: Generate network plan based on trait based networking config  https://review.opendev.org/c/openstack/ironic/+/96489518:41
opendevreviewClif Houck proposed openstack/ironic master: Trait Based Networking Simulator  https://review.opendev.org/c/openstack/ironic/+/96620218:41
opendevreviewClif Houck proposed openstack/ironic master: WIP: Add configuration options for trait based networking  https://review.opendev.org/c/openstack/ironic/+/96805418:41
cardoeTheJulia: so getting the exception from the _fetch() and not the os.link()19:00
TheJuliaso the actual write operation?19:01
JayFclif: that wasn't the original intent, but if you switch to Jason, it completely removes the concern from the standalone networking patches about it introducing a json-based config file. Just please make sure that the spec gets updated as well. As long as TheJulia has no objection19:05
clifI thought we had a conversation at some point last week about changing the format to JSON which I'm fine with19:06
TheJuliaI don't remember any discussion about using json, but we've tried to weed json out in favor of yaml over thea ges19:07
TheJuliathe ages19:07
clifaha19:07
JayFI want it to be consistent for networking features across the project. I don't care what direction it goes. 19:07
cliferg19:07
clifThen I'm going to keep YAML for now and will change the format if there's consensus it should change19:08
clifSince I've got +2s on the config file change19:08
clifalso since the spec calls for YAML19:08
opendevreviewJulia Kreger proposed openstack/bifrost master: DNM: Test chagne to evaluate CI's state  https://review.opendev.org/c/openstack/bifrost/+/96824819:09
JayFYeah. We'll use code review on the other standalone changes to make sure that they are revised to use yaml or oslo.config.19:11
cardoeAre you guys still reviewing?19:19
cardoeclif: so jsonschema maybe added to the confusion but the point was jsonschema can validate yaml as well19:29
opendevreviewMerged openstack/ironic master: ci: remove metalsmith ci job invocation  https://review.opendev.org/c/openstack/ironic/+/96321619:33
clifcardoe: you also metioned pydantic, do you have a preference?19:45
cardoeI'm just suggesting we don't open code parsing of data. Whatever we use is fine19:46
opendevreviewVerification of a change to openstack/ironic master failed: Trait Based Networking Filter Expression Parsing and Base Models  https://review.opendev.org/c/openstack/ironic/+/96149819:50
cardoeYAY20:28
cardoeFound it20:28
cardoeHoly exception swallowing batmans20:28
TheJuliaWhich batman?!20:34
TheJuliaThese are important questions for an important moment20:34
stevebaker[m]TheJulia: boop20:34
TheJuliastevebaker[m]: https://review.opendev.org/c/openstack/bifrost/+/96138820:34
opendevreviewMerged openstack/ironic master: Minimize json-rpc client logging  https://review.opendev.org/c/openstack/ironic/+/95811920:42
TheJuliadtantsur: oh, I get it, your using podman in rootless mode but I bet its not uniformly available. :\20:43
TheJuliaCould we instead make it just opt-in, or maybe start out for just centos10?20:45
cardoeor not...20:46
TheJuliacardoe: not... batman?20:48
cardoewell it switched to wait call-back but then never had iPXE configs setup for the box to boot from20:49
cardoeBut got past the image issue20:49
cardoeits related to turning off deep image inspection which was problematic recently cause it was identifying an image differently than ironic did previously20:50
TheJuliadid it recognize the qcow2 as raw or something?20:53
cardoeI believe it's the VMware images that foul it up.20:53
TheJuliasingle file vmdks or other?20:54
cardoeNo it's the ESXi installer raw image20:55
TheJuliaoh, hmm20:55
opendevreviewDoug Goldstein proposed openstack/ironic master: fix: use the correct path to the image when deep image inspection is off  https://review.opendev.org/c/openstack/ironic/+/96825821:06
cardoeThat's at least the image issue21:09
cardoeyay successful kick with my pile o' backports.21:56
opendevreviewVerification of a change to openstack/ironic master failed: fix: remove unnecessary trailing slash  https://review.opendev.org/c/openstack/ironic/+/96815021:56
cardoeSo the image issue is actually when using macOS tools to convert the image to raw21:59
TheJuliaInteresting22:00
TheJuliawhat is getting returned on the conversion?22:00
cardoeI'm gonna have to run the oslo.utils helper myself on an image. I'm just relaying what I'm getting told.22:01
TheJuliaahh, okay22:01
opendevreviewJulia Kreger proposed openstack/ironic-specs master: WIP VXLAN networking  https://review.opendev.org/c/openstack/ironic-specs/+/95940122:02
TheJuliahmm... still doesnt' do the linked file, wut22:10
opendevreviewMerged openstack/ironic master: Trait Based Networking Filter Expression Parsing and Base Models  https://review.opendev.org/c/openstack/ironic/+/96149822:15
opendevreviewVerification of a change to openstack/ironic master failed: Configuration file for Trait Based Networking  https://review.opendev.org/c/openstack/ironic/+/96259823:10
opendevreviewSteve Baker proposed openstack/ironic master: Add a kubernetes provider for console container  https://review.opendev.org/c/openstack/ironic/+/96224223:10

Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!