opendevreview | Verification of a change to openstack/networking-generic-switch master failed: Clean up add_subports_on_trunk, del_subports_on_trunk https://review.opendev.org/c/openstack/networking-generic-switch/+/949833 | 05:28 |
---|---|---|
opendevreview | Doug Goldstein proposed openstack/ironic master: allow running inspection hooks on redfish interface https://review.opendev.org/c/openstack/ironic/+/933066 | 08:57 |
opendevreview | Yu Zou proposed openstack/ironic master: feat: add verify ca conf support for drivers https://review.opendev.org/c/openstack/ironic/+/947544 | 09:08 |
*** tosky_ is now known as tosky | 09:49 | |
opendevreview | Doug Goldstein proposed openstack/ironic master: inspection: define inventory shape with dataclasses https://review.opendev.org/c/openstack/ironic/+/944868 | 10:32 |
TheJulia | good morning | 12:41 |
queensly[m] | Good morning | 12:51 |
iurygregory | good morning ironic | 13:30 |
iurygregory | Interesting bug when doing firmware updates via servicing https://bugs.launchpad.net/ironic/+bug/2114737 | 13:35 |
iurygregory | so far it seems specific for Dell PowerEdge XR8620t | 13:35 |
TheJulia | iurygregory: I'm guessing the BMC rebooted due to an update? | 13:41 |
TheJulia | iurygregory: which would detach the virtual media? | 13:42 |
TheJulia | I guess... That should be an expected possibility, the other aspect is we likely need to also consider re-attachment ? | 13:42 |
iurygregory | TheJulia, there was an update, I"m trying to reproduce the issue (so far it happened when doing a bios update) | 13:43 |
iurygregory | I'm just surprised this only happens in this model XR8620t | 13:43 |
TheJulia | there is another side to this coin, If you do things which will cause actions like reboots or device resets/detachments, your going to have to know to navigate it or ironic will need (this is the other side of the first's side of the coin of the reality) to navigate and re-attach vmedia in such cases. | 13:44 |
iurygregory | the error happend in https://opendev.org/openstack/ironic/src/branch/master/ironic/conductor/servicing.py#L231 | 13:44 |
TheJulia | Yeah, the payload suggests we attempted to detach and it was just not present so we errored | 13:45 |
iurygregory | so if we see such error should we re-attach the vmedia? | 13:47 |
iurygregory | since it was in the end of the process I'm wondering how we would "eject" the media later .-. | 13:47 |
TheJulia | Well, the issue is when | 13:47 |
TheJulia | I'm saying, we either need to "just expect we're going to get errors like that in teardown", and that is okay in general | 13:48 |
TheJulia | I'm also saying, separately, we might want to consider logic or even steps which can be invoked to re-attach vmedia which might be useful to navigate more complex scenarios | 13:48 |
TheJulia | the shortest path obviously being "oh, tearodwn, oh missing vmedia already, cool cool... moving on!" | 13:48 |
iurygregory | yeah, I was thinking on the shortest | 13:51 |
iurygregory | not sure how people would feel about it, maybe a topic for the meeting to see if people would be ok | 13:51 |
TheJulia | I think that shortest/minimally needful is downright logical | 13:51 |
TheJulia | If are boot or something else occured which detached a bmc, thats fine. we shouldn't freak out about it. | 13:52 |
TheJulia | Today, we clearly freak out about it :) | 13:52 |
iurygregory | yeah | 13:52 |
dtantsur | I'm sure we should not fail to eject a device if it's not connected to begin with :) | 13:57 |
TheJulia | Agree 1000% | 13:57 |
TheJulia | I suspect though, if we do for that, what other cases and that is likely a future feature or two which is disjointed from this exact situation | 13:58 |
TheJulia | Could *almost* be a low-hanging-fruit item to "reattach" virtual media as an explicit step | 14:00 |
TheJulia | which could be invoked... | 14:00 |
cardoe | stephenfin: I could use TypedDict for the shape instead of dataclasses. | 14:02 |
cardoe | I think reattach could be its own step and just be happy if its the same thing connected. | 14:03 |
stephenfin | cardoe: meant for me? | 14:23 |
cardoe | I think you commented on the dataclasses | 14:24 |
TheJulia | cardoe: Yeah, sort of what I'm thinking. If you know you do something which breaks the bmc, give people an escape-ish shaped hatch | 14:24 |
TheJulia | "WARNING: This is only an escape hatch." | 14:24 |
opendevreview | Abhishek Bongale proposed openstack/ironic-tempest-plugin master: WIP Add Tempest tests for inspection rules in Ironic https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/951761 | 14:29 |
cid | TheJulia, I was wondering how to turn an ironic configuration on for CI alone :) | 14:55 |
TheJulia | cid: devstack/lib/ironic ;) | 14:59 |
TheJulia | look for iniset ;) | 14:59 |
TheJulia | So who is running the meeting this week? | 14:59 |
cid | Right. tks. | 14:59 |
TheJulia | #startmeeting ironic | 15:00 |
opendevmeet | Meeting started Mon Jun 16 15:00:35 2025 UTC and is due to finish in 60 minutes. The chair is TheJulia. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
opendevmeet | The meeting name has been set to 'ironic' | 15:00 |
TheJulia | o/ | 15:00 |
TheJulia | Hi Everybody! | 15:00 |
iurygregory | o/ | 15:00 |
alegacy | o/ | 15:00 |
masghar | o/ | 15:01 |
TheJulia | Am I running this meeting? | 15:01 |
iurygregory | I think so | 15:01 |
masghar | looks like it | 15:01 |
TheJulia | Doh! | 15:01 |
TheJulia | Our agenda this week can be found on the wiki. | 15:02 |
TheJulia | #link https://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_June_16.2C_2025 | 15:02 |
cid | o/ | 15:02 |
TheJulia | #topic Announcements / Reminders | 15:02 |
TheJulia | Our first item is our standing reminder to reivew (and set the hashtag for items ready for review with "ironic-week-prio". A review dashboard link is available at https://tinyurl.com/ironic-weekly-prio-dash. | 15:02 |
dtantsur | o/ | 15:02 |
TheJulia | Our next item is the release schedule. | 15:03 |
TheJulia | #link https://releases.openstack.org/flamingo/schedule.html | 15:03 |
TheJulia | This week is R-15. | 15:03 |
TheJulia | Anyone have anything else to announce or remind us of? | 15:03 |
TheJulia | I guess not! | 15:04 |
TheJulia | #topic Working Group Updates | 15:04 |
TheJulia | First working group! Standalone networking! | 15:04 |
TheJulia | #link https://etherpad.opendev.org/p/ironic-standalone-networking | 15:04 |
alegacy | Spec was published last week... waiting for reviews | 15:04 |
TheJulia | alegacy: could you paste the link into irc for folks? | 15:05 |
TheJulia | Also, has the hashtag been set? | 15:05 |
alegacy | https://review.opendev.org/c/openstack/ironic-specs/+/952126 | 15:05 |
TheJulia | Folks, please try to make time to review this specification this week. Thanks! | 15:05 |
TheJulia | Anything else this week? | 15:05 |
alegacy | yes ironic-week-prio is set. | 15:05 |
TheJulia | Cool cool! | 15:05 |
* dtantsur bookmarks | 15:05 | |
TheJulia | Next group! Eventlet Removal! | 15:06 |
TheJulia | #link https://etherpad.opendev.org/p/ironic-eventlet-removal | 15:06 |
dtantsur | I see some progress on the cheroot patch | 15:07 |
dtantsur | https://github.com/cherrypy/cheroot/pull/745 | 15:07 |
TheJulia | Indeed, I think cid wins some awards | 15:07 |
cid | :D | 15:07 |
TheJulia | we are definitely making good progress | 15:07 |
TheJulia | It would be good if we could get some updated notes into the etherpad. Is there anything else of note or to discuss this week in regards to eventlet removal? | 15:07 |
TheJulia | I guess not, onward then! | 15:09 |
TheJulia | #topic Discussion topics | 15:09 |
TheJulia | Do we have anything to discuss today? | 15:09 |
* TheJulia will take silence as no | 15:10 | |
cid | I think iury wanted to bring something up? | 15:10 |
TheJulia | iurygregory: ? | 15:10 |
cid | Maybe not | 15:10 |
iurygregory | https://bugs.launchpad.net/ironic/+bug/2114737 | 15:10 |
TheJulia | Ahh, what we were discussing earlier | 15:11 |
iurygregory | if we want to go on a different path, but I don't think its the case | 15:11 |
iurygregory | yeah | 15:11 |
TheJulia | cool cool, then I guess we can carry on? | 15:11 |
iurygregory | yeah | 15:11 |
cid | ++ | 15:11 |
TheJulia | #topic Bug Deputy Updates | 15:11 |
TheJulia | cid: I *think* you volunteered last week? | 15:11 |
cid | Bug update, it was a quite week, only two bugs filed, 0 RFEs | 15:11 |
TheJulia | cool cool, thanks! | 15:11 |
TheJulia | Who will do it this week? | 15:12 |
cid | I will like to | 15:12 |
TheJulia | Okay, excellent, Thank you for your continued service as the bug deputy1 | 15:12 |
TheJulia | #topic RFE Review | 15:12 |
TheJulia | It doesn't sound like we have anything new, does anyone have anything to bring up? | 15:13 |
kubajj | o/ | 15:13 |
TheJulia | o/ kubajj | 15:14 |
* TheJulia takes silence as a no | 15:14 | |
TheJulia | #topic Open Discussion | 15:14 |
TheJulia | Anyone have any crazy ideas? | 15:14 |
TheJulia | Baking any tasty cookies or cakes? | 15:14 |
TheJulia | so on, and so forth | 15:14 |
dtantsur | Something suitable for camping | 15:15 |
TheJulia | You going soon? | 15:15 |
TheJulia | I'm looking at taking some PTO soon, need to make phone call or two in order to solidify things | 15:16 |
iurygregory | enjoy the time off =D | 15:16 |
TheJulia | Yeah, I need it. Badly. | 15:17 |
TheJulia | Anything else to discuss? Plot? Facilitate? Co-ordinate? | 15:17 |
cid | None from me. | 15:18 |
TheJulia | Okay then! Have a great week everyone, and remember to please take a little time to review and engage on the items in ironic-specs. Thanks! | 15:18 |
iurygregory | tks! | 15:19 |
JayF | I'm going to be gone by this time next week JFYI | 15:19 |
JayF | but I'm also not terribly here today either :( | 15:19 |
TheJulia | That sounds... unplanned | 15:20 |
TheJulia | Anyway, have some great time off. | 15:20 |
TheJulia | #endmeeting | 15:20 |
opendevmeet | Meeting ended Mon Jun 16 15:20:25 2025 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:20 |
opendevmeet | Minutes: https://meetings.opendev.org/meetings/ironic/2025/ironic.2025-06-16-15.00.html | 15:20 |
opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/ironic/2025/ironic.2025-06-16-15.00.txt | 15:20 |
opendevmeet | Log: https://meetings.opendev.org/meetings/ironic/2025/ironic.2025-06-16-15.00.log.html | 15:20 |
dtantsur | TheJulia: yeah, we have some more religious holidays here, so I'll be in the Netherlands Thu-Sun | 15:20 |
TheJulia | Enjoy! | 15:21 |
TheJulia | I'm off Thursday and I assume I may also just take Friday, so if there is anything which is needed attention wise, lets get it sorted by EOD wednesday. | 15:22 |
JayF | dtantsur: https://review.opendev.org/c/openstack/ironic/+/951054 your review on that would be nice before it gets landed | 15:26 |
* TheJulia goes back to docs | 15:26 | |
* dtantsur looks | 15:27 | |
dtantsur | JayF, cid, can we make the standalone job pass on this change? it currently fails with "no space left", so might not be your fault. But that's the only job that tests RPC. | 15:28 |
TheJulia | eek. :( | 15:28 |
JayF | FWIW that's not true based on our earlier looking, there's one passing that is RPC | 15:28 |
JayF | but we should have them all passing, is a good point | 15:29 |
dtantsur | I guess if it goes as far as trying to deploy, it works.. | 15:29 |
JayF | I think it's not absurd for this change to say "we need to see every job, including -nv, pass once" | 15:29 |
dtantsur | the redfish job passed once, so I'm sorta fine with approving it | 15:31 |
dtantsur | can I assume that the rest of the migration will follow soon? I'd prefer not to cross any release boundary half-migrated | 15:31 |
dtantsur | JayF, cid ^^ | 15:31 |
dtantsur | I think the next bugfix branch is soon upon us? | 15:32 |
JayF | I mean, we're migrating it as we can. As long as we're monkey_patching the perf change here is not meaningful | 15:32 |
JayF | one was just cut | 15:32 |
JayF | we still have monkey patch in so threading.Thread is still a lit | 15:32 |
JayF | **lie | 15:32 |
cid | I think the conductor is the next major part of the migration ? | 15:32 |
dtantsur | right | 15:32 |
JayF | so I don't really think this puts us in any "middle place" anyway, we're just now an eventlet-using app that doesn't use the eventlet wsgi library | 15:32 |
JayF | that being said, eventlet migration is cid's top thing so we'll keep going as much as we can :) | 15:33 |
dtantsur | So I wonder if eventlet.wsgi existed because something could not be monkey-patched | 15:33 |
dtantsur | e.g. I remember greenDNS being a large part of it | 15:33 |
dtantsur | maybe I'm paranoid | 15:33 |
cid | So, I think I'm fine with us knowing we've made progress on one major part, but will like to be on par all-round before landing. | 15:34 |
cid | I should be able to pick up the conductor change sometime this week (like Jay said, it's on the top of my priority list) | 15:34 |
dtantsur | does anyone remember for sure when the next release is? | 15:35 |
JayF | honestly I pay most of my attention to the cycle release, which we aren't even at milestone-2 for | 15:35 |
JayF | and I think bugfixes were cut last week or something? maybe week before? | 15:35 |
dtantsur | you're right, 30.0 is very recent, the next is due in August | 15:36 |
dtantsur | I'm cool now. Do you want me to W+1 or want to massage the CI a bit more? | 15:36 |
JayF | lets do a recheck so we have two jobs to compare | 15:36 |
JayF | if they fail identically we should assume the worst and fix it first | 15:36 |
cid | +++ | 15:36 |
dtantsur | +++ | 15:37 |
dtantsur | Consider me +2W otherwise | 15:37 |
* dtantsur turns his attention to another broken CI | 15:37 | |
* cid adds the rechek comment | 15:39 | |
opendevreview | Verification of a change to openstack/ironic master failed: Report provisioned state where appropiate when raising InvalidState* Exceptions https://review.opendev.org/c/openstack/ironic/+/952300 | 15:44 |
dougszu | a question for virtual media boot folks - Ironic has made a shiny ISO with network_data.json baked in, all very good so far - but when the ISO boots, I can't get to network_data.json | 16:12 |
dougszu | it lives in the root of the iso, alongside the kernel / ramdisk | 16:13 |
dougszu | and the uefi bootloader | 16:13 |
dougszu | Once IPA boots, I can't 'remount' the ISO from within the ramdisk | 16:14 |
dougszu | I'm wondering how other folks are doing the network config | 16:14 |
JayF | you need to use the redfish_virtual_media boot interface. That behavior sounds like the http/https one | 16:15 |
dougszu | I've also tried the virtual USB/floppy to expose it, but appears there is a limitation that you can't use two virtual media devices at the same time | 16:15 |
JayF | (which has a major limitation of ... exactly what you laid out: inability to see the virtual media after boot) | 16:15 |
dougszu | Thanks JayF - I am indeed doing that | 16:15 |
JayF | I don't know what "doing that" is :D redfish-virtual-media or *http* | 16:15 |
JayF | either way I have to step away, but hopefully this was helpful o/ | 16:16 |
dougszu | no problem! I am using redfish-virtual-media | 16:16 |
dougszu | thanks btw :S | 16:17 |
dougszu | s/:S/:D | 16:17 |
TheJulia | Interesting, because it should be there... | 17:21 |
TheJulia | at least, afaik | 17:21 |
opendevreview | cid proposed openstack/ironic master: Log executed steps during cleaning/servicing/deploy https://review.opendev.org/c/openstack/ironic/+/952637 | 17:33 |
opendevreview | cid proposed openstack/ironic master: Log executed steps during cleaning/servicing/deploy https://review.opendev.org/c/openstack/ironic/+/952637 | 17:35 |
opendevreview | Merged openstack/ironic bugfix/30.0: Update .gitreview for bugfix/30.0 https://review.opendev.org/c/openstack/ironic/+/952558 | 18:40 |
TheJulia | Download of image cirros-0.6.1-x86_64-disk.img failed: Unable to write image to /tmp/cirros-0.6.1-x86_64-disk.img. Error: [Errno 28] No space left on device <-- on the ironic-standalone-redfish job :( | 19:12 |
opendevreview | Julia Kreger proposed openstack/ironic master: Increase memory allocation for ironic-base https://review.opendev.org/c/openstack/ironic/+/952709 | 19:17 |
opendevreview | Merged openstack/ironic master: Report provisioned state where appropiate when raising InvalidState* Exceptions https://review.opendev.org/c/openstack/ironic/+/952300 | 19:19 |
opendevreview | cid proposed openstack/ironic master: Log executed steps during cleaning/servicing/deploy https://review.opendev.org/c/openstack/ironic/+/952637 | 19:21 |
iurygregory | WOOT | 19:21 |
TheJulia | ?!? | 19:22 |
iurygregory | the error you mentioned | 19:22 |
JayF | that implies that cid's change is good, which is woot-worthy | 19:23 |
TheJulia | indeed, looks like, compressed were at 518 mb | 19:38 |
TheJulia | 530mb compressed, but that space doesn't get used for files in ram | 19:39 |
TheJulia | 883M uncompressed | 19:44 |
TheJulia | mkkkkkkkkkkkkkkkk | 22:04 |
Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!