Monday, 2025-06-16

opendevreviewVerification of a change to openstack/networking-generic-switch master failed: Clean up add_subports_on_trunk, del_subports_on_trunk  https://review.opendev.org/c/openstack/networking-generic-switch/+/94983305:28
opendevreviewDoug Goldstein proposed openstack/ironic master: allow running inspection hooks on redfish interface  https://review.opendev.org/c/openstack/ironic/+/93306608:57
opendevreviewYu Zou proposed openstack/ironic master: feat: add verify ca conf support for drivers  https://review.opendev.org/c/openstack/ironic/+/94754409:08
*** tosky_ is now known as tosky09:49
opendevreviewDoug Goldstein proposed openstack/ironic master: inspection: define inventory shape with dataclasses  https://review.opendev.org/c/openstack/ironic/+/94486810:32
TheJuliagood morning12:41
queensly[m]Good morning12:51
iurygregorygood morning ironic13:30
iurygregoryInteresting bug when doing firmware updates via servicing https://bugs.launchpad.net/ironic/+bug/2114737 13:35
iurygregoryso far it seems specific for Dell PowerEdge XR8620t13:35
TheJuliaiurygregory: I'm guessing the BMC rebooted due to an update?13:41
TheJuliaiurygregory: which would detach the virtual media?13:42
TheJuliaI guess... That should be an expected possibility, the other aspect is we likely need to also consider re-attachment ?13:42
iurygregoryTheJulia, there was an update, I"m trying to reproduce the issue (so far it happened when doing a bios update)13:43
iurygregoryI'm just surprised this only happens in this model XR8620t13:43
TheJuliathere is another side to this coin, If you do things which will cause actions like reboots or device resets/detachments, your going to have to know to navigate it or ironic will need (this is the other side of the first's side of the coin of the reality) to navigate and re-attach vmedia in such cases.13:44
iurygregorythe error happend in https://opendev.org/openstack/ironic/src/branch/master/ironic/conductor/servicing.py#L23113:44
TheJuliaYeah, the payload suggests we attempted to detach and it was just not present so we errored13:45
iurygregoryso if we see such error should we re-attach the vmedia? 13:47
iurygregorysince it was in the end of the process I'm wondering how we would "eject" the media later .-.13:47
TheJuliaWell, the issue is when13:47
TheJuliaI'm saying, we either need to "just expect we're going to get errors like that in teardown", and that is okay in general13:48
TheJuliaI'm also saying, separately, we might want to consider logic or even steps which can be invoked to re-attach vmedia which might be useful to navigate more complex scenarios13:48
TheJuliathe shortest path obviously being "oh, tearodwn, oh missing vmedia already, cool cool... moving on!"13:48
iurygregoryyeah, I was thinking on the shortest13:51
iurygregorynot sure how people would feel about it, maybe a topic for the meeting to see if people would be ok13:51
TheJuliaI think that shortest/minimally needful is downright logical13:51
TheJuliaIf are boot or something else occured which detached a bmc, thats fine. we shouldn't freak out about it.13:52
TheJuliaToday, we clearly freak out about it :)13:52
iurygregoryyeah13:52
dtantsurI'm sure we should not fail to eject a device if it's not connected to begin with :)13:57
TheJuliaAgree 1000%13:57
TheJuliaI suspect though, if we do for that, what other cases and that is likely a future feature or two which is disjointed from this exact situation13:58
TheJuliaCould *almost* be a low-hanging-fruit item to "reattach" virtual media as an explicit step14:00
TheJuliawhich could be invoked...14:00
cardoestephenfin: I could use TypedDict for the shape instead of dataclasses.14:02
cardoeI think reattach could be its own step and just be happy if its the same thing connected.14:03
stephenfincardoe: meant for me?14:23
cardoeI think you commented on the dataclasses14:24
TheJuliacardoe: Yeah, sort of what I'm thinking. If you know you do something which breaks the bmc, give people an escape-ish shaped hatch14:24
TheJulia"WARNING: This is only an escape hatch."14:24
opendevreviewAbhishek Bongale proposed openstack/ironic-tempest-plugin master: WIP Add Tempest tests for inspection rules in Ironic  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/95176114:29
cidTheJulia, I was wondering how to turn an ironic configuration on for CI alone :)14:55
TheJuliacid: devstack/lib/ironic ;)14:59
TheJulialook for iniset ;)14:59
TheJuliaSo who is running the meeting this week?14:59
cidRight. tks.14:59
TheJulia#startmeeting ironic15:00
opendevmeetMeeting started Mon Jun 16 15:00:35 2025 UTC and is due to finish in 60 minutes.  The chair is TheJulia. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
opendevmeetThe meeting name has been set to 'ironic'15:00
TheJuliao/15:00
TheJuliaHi Everybody!15:00
iurygregoryo/15:00
alegacyo/15:00
masgharo/15:01
TheJuliaAm I running this meeting?15:01
iurygregoryI think so15:01
masgharlooks like it15:01
TheJuliaDoh!15:01
TheJuliaOur agenda this week can be found on the wiki.15:02
TheJulia#link https://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_June_16.2C_202515:02
cido/15:02
TheJulia#topic Announcements / Reminders15:02
TheJuliaOur first item is our standing reminder to reivew (and set the hashtag for items ready for review with "ironic-week-prio". A review dashboard link is available at https://tinyurl.com/ironic-weekly-prio-dash.15:02
dtantsuro/15:02
TheJuliaOur next item is the release schedule.15:03
TheJulia#link https://releases.openstack.org/flamingo/schedule.html15:03
TheJuliaThis week is R-15.15:03
TheJuliaAnyone have anything else to announce or remind us of?15:03
TheJuliaI guess not!15:04
TheJulia#topic Working Group Updates15:04
TheJuliaFirst working group! Standalone networking!15:04
TheJulia#link https://etherpad.opendev.org/p/ironic-standalone-networking15:04
alegacySpec was published last week... waiting for reviews15:04
TheJuliaalegacy: could you paste the link into irc for folks?15:05
TheJuliaAlso, has the hashtag been set?15:05
alegacyhttps://review.opendev.org/c/openstack/ironic-specs/+/95212615:05
TheJuliaFolks, please try to make time to review this specification this week. Thanks!15:05
TheJuliaAnything else this week?15:05
alegacyyes ironic-week-prio is set.15:05
TheJuliaCool cool!15:05
* dtantsur bookmarks15:05
TheJuliaNext group! Eventlet Removal!15:06
TheJulia#link https://etherpad.opendev.org/p/ironic-eventlet-removal15:06
dtantsurI see some progress on the cheroot patch15:07
dtantsurhttps://github.com/cherrypy/cheroot/pull/74515:07
TheJuliaIndeed, I think cid wins some awards15:07
cid:D15:07
TheJuliawe are definitely making good progress15:07
TheJuliaIt would be good if we could get some updated notes into the etherpad. Is there anything else of note or to discuss this week in regards to eventlet removal?15:07
TheJuliaI guess not, onward then!15:09
TheJulia#topic Discussion topics15:09
TheJuliaDo we have anything to discuss today?15:09
* TheJulia will take silence as no15:10
cidI think iury wanted to bring something up?15:10
TheJuliaiurygregory: ?15:10
cidMaybe not15:10
iurygregoryhttps://bugs.launchpad.net/ironic/+bug/211473715:10
TheJuliaAhh, what we were discussing earlier15:11
iurygregoryif we want to go on a different path, but I don't think its the case15:11
iurygregoryyeah15:11
TheJuliacool cool, then I guess we can carry on?15:11
iurygregoryyeah15:11
cid++15:11
TheJulia#topic Bug Deputy Updates15:11
TheJuliacid: I *think* you volunteered last week?15:11
cidBug update, it was a quite week, only two bugs filed, 0 RFEs15:11
TheJuliacool cool, thanks!15:11
TheJuliaWho will do it this week?15:12
cidI will like to15:12
TheJuliaOkay, excellent, Thank you for your continued service as the bug deputy115:12
TheJulia#topic RFE Review15:12
TheJuliaIt doesn't sound like we have anything new, does anyone have anything to bring up?15:13
kubajjo/15:13
TheJuliao/ kubajj 15:14
* TheJulia takes silence as a no15:14
TheJulia#topic Open Discussion15:14
TheJuliaAnyone have any crazy ideas?15:14
TheJuliaBaking any tasty cookies or cakes?15:14
TheJuliaso on, and so forth15:14
dtantsurSomething suitable for camping15:15
TheJuliaYou going soon?15:15
TheJuliaI'm looking at taking some PTO soon, need to make phone call or two in order to solidify things15:16
iurygregoryenjoy the time off =D15:16
TheJuliaYeah, I need it. Badly.15:17
TheJuliaAnything else to discuss? Plot? Facilitate? Co-ordinate?15:17
cidNone from me.15:18
TheJuliaOkay then! Have a great week everyone, and remember to please take a little time to review and engage on the items in ironic-specs. Thanks!15:18
iurygregorytks!15:19
JayFI'm going to be gone by this time next week JFYI15:19
JayFbut I'm also not terribly here today either :( 15:19
TheJuliaThat sounds... unplanned15:20
TheJuliaAnyway, have some great time off.15:20
TheJulia#endmeeting15:20
opendevmeetMeeting ended Mon Jun 16 15:20:25 2025 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:20
opendevmeetMinutes:        https://meetings.opendev.org/meetings/ironic/2025/ironic.2025-06-16-15.00.html15:20
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/ironic/2025/ironic.2025-06-16-15.00.txt15:20
opendevmeetLog:            https://meetings.opendev.org/meetings/ironic/2025/ironic.2025-06-16-15.00.log.html15:20
dtantsurTheJulia: yeah, we have some more religious holidays here, so I'll be in the Netherlands Thu-Sun15:20
TheJuliaEnjoy!15:21
TheJuliaI'm off Thursday and I assume I may also just take Friday, so if there is anything which is needed attention wise, lets get it sorted by EOD wednesday.15:22
JayFdtantsur: https://review.opendev.org/c/openstack/ironic/+/951054 your review on that would be nice before it gets landed15:26
* TheJulia goes back to docs15:26
* dtantsur looks15:27
dtantsurJayF, cid, can we make the standalone job pass on this change? it currently fails with "no space left", so might not be your fault. But that's the only job that tests RPC.15:28
TheJuliaeek. :(15:28
JayFFWIW that's not true based on our earlier looking, there's one passing that is RPC 15:28
JayFbut we should have them all passing, is a good point15:29
dtantsurI guess if it goes as far as trying to deploy, it works..15:29
JayFI think it's not absurd for this change to say "we need to see every job, including -nv, pass once"15:29
dtantsurthe redfish job passed once, so I'm sorta fine with approving it15:31
dtantsurcan I assume that the rest of the migration will follow soon? I'd prefer not to cross any release boundary half-migrated15:31
dtantsurJayF, cid ^^15:31
dtantsurI think the next bugfix branch is soon upon us?15:32
JayFI mean, we're migrating it as we can. As long as we're monkey_patching the perf change here is not meaningful15:32
JayFone was just cut15:32
JayFwe still have monkey patch in so threading.Thread is still a lit15:32
JayF**lie15:32
cidI think the conductor is the next major part of the migration ?15:32
dtantsurright15:32
JayFso I don't really think this puts us in any "middle place" anyway, we're just now an eventlet-using app that doesn't use the eventlet wsgi library15:32
JayFthat being said, eventlet migration is cid's top thing so we'll keep going as much as we can :)15:33
dtantsurSo I wonder if eventlet.wsgi existed because something could not be monkey-patched15:33
dtantsure.g. I remember greenDNS being a large part of it15:33
dtantsurmaybe I'm paranoid15:33
cidSo, I think I'm fine with us knowing we've made progress on one major part, but will like to be on par all-round before landing.15:34
cidI should be able to pick up the conductor change sometime this week (like Jay said, it's on the top of my priority list)15:34
dtantsurdoes anyone remember for sure when the next release is?15:35
JayFhonestly I pay most of my attention to the cycle release, which we aren't even at milestone-2 for15:35
JayFand I think bugfixes were cut last week or something? maybe week before?15:35
dtantsuryou're right, 30.0 is very recent, the next is due in August15:36
dtantsurI'm cool now. Do you want me to W+1 or want to massage the CI a bit more?15:36
JayFlets do a recheck so we have two jobs to compare15:36
JayFif they fail identically we should assume the worst and fix it first15:36
cid+++15:36
dtantsur+++15:37
dtantsurConsider me +2W otherwise15:37
* dtantsur turns his attention to another broken CI15:37
* cid adds the rechek comment15:39
opendevreviewVerification of a change to openstack/ironic master failed: Report provisioned state where appropiate when raising InvalidState* Exceptions  https://review.opendev.org/c/openstack/ironic/+/95230015:44
dougszua question for virtual media boot folks - Ironic has made a shiny ISO with network_data.json baked in, all very good so far - but when the ISO boots, I can't get to network_data.json16:12
dougszuit lives in the root of the iso, alongside the kernel / ramdisk16:13
dougszuand the uefi bootloader16:13
dougszuOnce IPA boots, I can't 'remount' the ISO from within the ramdisk16:14
dougszuI'm wondering how other folks are doing the network config16:14
JayFyou need to use the redfish_virtual_media boot interface. That behavior sounds like the http/https one16:15
dougszuI've also tried the virtual USB/floppy to expose it, but appears there is a limitation that you can't use two virtual media devices at the same time16:15
JayF(which has a major limitation of ... exactly what you laid out: inability to see the virtual media after boot)16:15
dougszuThanks JayF - I am indeed doing that16:15
JayFI don't know what "doing that" is :D redfish-virtual-media or *http*16:15
JayFeither way I have to step away, but hopefully this was helpful o/16:16
dougszuno problem! I am using redfish-virtual-media 16:16
dougszuthanks btw :S16:17
dougszus/:S/:D16:17
TheJuliaInteresting, because it should be there...17:21
TheJuliaat least, afaik17:21
opendevreviewcid proposed openstack/ironic master: Log executed steps during cleaning/servicing/deploy  https://review.opendev.org/c/openstack/ironic/+/95263717:33
opendevreviewcid proposed openstack/ironic master: Log executed steps during cleaning/servicing/deploy  https://review.opendev.org/c/openstack/ironic/+/95263717:35
opendevreviewMerged openstack/ironic bugfix/30.0: Update .gitreview for bugfix/30.0  https://review.opendev.org/c/openstack/ironic/+/95255818:40
TheJulia Download of image cirros-0.6.1-x86_64-disk.img failed: Unable to write image to /tmp/cirros-0.6.1-x86_64-disk.img. Error: [Errno 28] No space left on device <-- on the ironic-standalone-redfish job :(19:12
opendevreviewJulia Kreger proposed openstack/ironic master: Increase memory allocation for ironic-base  https://review.opendev.org/c/openstack/ironic/+/95270919:17
opendevreviewMerged openstack/ironic master: Report provisioned state where appropiate when raising InvalidState* Exceptions  https://review.opendev.org/c/openstack/ironic/+/95230019:19
opendevreviewcid proposed openstack/ironic master: Log executed steps during cleaning/servicing/deploy  https://review.opendev.org/c/openstack/ironic/+/95263719:21
iurygregoryWOOT19:21
TheJulia?!?19:22
iurygregorythe error you mentioned 19:22
JayFthat implies that cid's change is good, which is woot-worthy19:23
TheJuliaindeed, looks like, compressed were at 518 mb19:38
TheJulia530mb compressed, but that space doesn't get used for files in ram19:39
TheJulia883M uncompressed19:44
TheJuliamkkkkkkkkkkkkkkkk22:04

Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!