| opendevreview | Merged openstack/ironic-tempest-plugin master: Invoke tests with fake interfaces https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/909939 | 00:16 |
|---|---|---|
| opendevreview | OpenStack Proposal Bot proposed openstack/ironic master: Imported Translations from Zanata https://review.opendev.org/c/openstack/ironic/+/913733 | 04:45 |
| rpittau | good morning ironic! o/ | 07:54 |
| opendevreview | Riccardo Pittau proposed openstack/ironic stable/2024.1: Update min required version of scciclient https://review.opendev.org/c/openstack/ironic/+/914007 | 07:55 |
| dtantsur | TheJulia: when did you last screamed in the darkness? https://issues.redhat.com/browse/OCPBUGS-31104 | 08:33 |
| opendevreview | Michal Nasiadka proposed openstack/networking-generic-switch master: Cumulus NVUE support https://review.opendev.org/c/openstack/networking-generic-switch/+/907551 | 08:40 |
| dtantsur | TheJulia: I believe you asked me about issues with Gen 10 plus, so that is one. | 08:49 |
| TheJulia | dtantsur: different, unfortuantely, that is also an older version | 12:51 |
| TheJulia | Also, goo dmorning! | 12:51 |
| TheJulia | err, Good morning | 12:51 |
| TheJulia | dtantsur: I wonder if the firmware for the plus stream of gear is an similarly versioned fork... | 13:13 |
| dtantsur | that would be a hell... good morning! | 13:14 |
| rpittau | could be either a bug in that version or just the Gen10 plus responding differently against the same implementation ? | 13:22 |
| dtantsur | whatever that is, I'm looking into a workaround. | 13:23 |
| TheJulia | dtantsur: the possibility feels "very HPE" to me | 13:27 |
| TheJulia | rpittau: likely a bit of both | 13:27 |
| dtantsur | :D | 13:28 |
| iurygregory | good morning Ironic o/ | 13:29 |
| iurygregory | happy monday :D | 13:29 |
| rpittau | hey iurygregory happy monday! | 13:35 |
| iurygregory | rpittau, did you push a new release for Ironic Caracal with the commit we merged with the new version of scciclient? | 13:44 |
| rpittau | iurygregory: I... don't think so, I meant to, I didn't | 13:46 |
| iurygregory | rpittau, oh we still need https://review.opendev.org/c/openstack/ironic/+/914007 | 13:47 |
| iurygregory | :facepalm: | 13:47 |
| rpittau | ah yeah, that's why | 13:47 |
| iurygregory | the moment you forget we already cut the branch and we need backports :D | 13:47 |
| TheJulia | release team might block us given the point at where we are in the release | 13:48 |
| TheJulia | but... in the grand scheme of things as long as it is merged, the world will be okay | 13:48 |
| iurygregory | rpittau, in case you are not around when it merges I will push the change | 13:48 |
| rpittau | TheJulia: I think we just miss that one commit after the release | 13:48 |
| rpittau | iurygregory: sounds good, thanks | 13:48 |
| TheJulia | rpittau: yeah, falling then into "in the grand scheme of things" then :) | 13:49 |
| TheJulia | I just +2'ed it | 13:49 |
| rpittau | ah ok | 13:49 |
| rpittau | not even if we consider that a fix? which it is :) | 13:50 |
| TheJulia | they may not care at this poitn | 14:05 |
| TheJulia | process over quality | 14:05 |
| TheJulia | We've had times where they have been "sure no problem", and times where they are like "no" | 14:06 |
| opendevreview | Merged openstack/ironic stable/2024.1: Update min required version of scciclient https://review.opendev.org/c/openstack/ironic/+/914007 | 14:06 |
| TheJulia | mileage (or distance in km) varies based upon the people and the situation. | 14:06 |
| iurygregory | truth | 14:10 |
| TheJulia | soo many emails/threads to reply to | 14:19 |
| JayF | rpittau: you are running meeting today? or me? | 14:22 |
| JayF | rpittau: I think it's all yours now just making sure :D | 14:22 |
| rpittau | JayF: I'll handle it, thanks! :) | 14:24 |
| rpittau | #startmeeting ironic | 15:00 |
| opendevmeet | Meeting started Mon Mar 25 15:00:15 2024 UTC and is due to finish in 60 minutes. The chair is rpittau. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| opendevmeet | The meeting name has been set to 'ironic' | 15:00 |
| iurygregory | o/ | 15:00 |
| masghar | o/ | 15:00 |
| dtantsur | o/ | 15:00 |
| rpittau | hello ironicers! welcome to our weekly meeting! | 15:00 |
| rpittau | The meeting agenda can be found here: | 15:01 |
| rpittau | #link https://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_next_meeting | 15:01 |
| rpittau | #topic Announcements / Reminders | 15:01 |
| rpittau | #info Standing reminder to review patches tagged ironic-week-prio and to hashtag any patches ready for review with ironic-week-prio: | 15:01 |
| rpittau | #link https://tinyurl.com/ironic-weekly-prio-dash | 15:01 |
| rpittau | #info Project Teams Gathering (PTG) will be held from Monday, April 8 to Friday, April 12 2024 | 15:02 |
| rpittau | I'm going to leave the topics page open for another couple of days before finalizing the schedule | 15:02 |
| rpittau | #link https://etherpad.opendev.org/p/ironic-ptg-april-2024 | 15:03 |
| rpittau | #link https://ptg.opendev.org/ptg.html | 15:03 |
| JayF | rpittau: If you want any help with that, feel free to reach out. I'll be around this week but gone next. | 15:03 |
| * iurygregory has one item to add to announcements | 15:03 | |
| rpittau | thanks JayF! definitely will need help :) | 15:03 |
| TheJulia | o/ | 15:03 |
| rpittau | iurygregory: go ahead | 15:03 |
| iurygregory | #info The CFP for the #OpenInfraSummit Asia is now open! Submissions for the CFP can be submitted in both English and Korean. The CFP closes May 29, 2024 at 11:59 PM KST! | 15:04 |
| iurygregory | #link https://openinfrafoundation.formstack.com/forms/openinfra_asia_summit_2024 | 15:04 |
| rpittau | awesome, thanks for the reminder | 15:04 |
| iurygregory | we also have some CFP open for the OpenInfra Days in Europe if I recall | 15:04 |
| TheJulia | Yes, they are also open | 15:04 |
| rpittau | #link https://openinfra.dev/days | 15:04 |
| TheJulia | or at least, several of them I believe are open | 15:04 |
| iurygregory | yup | 15:05 |
| rpittau | we're particularly interested in one of them | 15:05 |
| rpittau | #info Ironic Meetup/BareMetal SIG June 5, OpenInfra Days June 6 @ CERN. Signup at https://indico.cern.ch/event/1378171/ and https://indico.cern.ch/event/1376907/ | 15:05 |
| rpittau | I will be there, hope to see a lot of you :) | 15:05 |
| rpittau | anything else to add to announcements / reminders ? | 15:06 |
| rpittau | I'll actually add one more thing now :D | 15:06 |
| rpittau | I'd like to thank JayF for his work as PTL for 3 cycles! | 15:07 |
| iurygregory | ++ | 15:07 |
| masghar | ++ | 15:07 |
| JayF | Thanks :) PTL of Ironic is the easiest leadership gig in OpenStack :D | 15:08 |
| rpittau | lol | 15:08 |
| rpittau | well I should be relieved since I'm officially the PTL now :P | 15:08 |
| TheJulia | rpittau: congrats! | 15:09 |
| rpittau | thanks! | 15:09 |
| iurygregory | congrats rpittau \o/ | 15:09 |
| masghar | Congratulations :D | 15:09 |
| rpittau | thank you all! :) | 15:09 |
| dking | Congratulations | 15:09 |
| rpittau | ok, moving forward | 15:10 |
| rpittau | #topic Caracal Release schedule | 15:10 |
| rpittau | we're at R-1 week | 15:10 |
| rpittau | the deadline for the final release is March 28th, so this week | 15:11 |
| rpittau | I think we want to make sure to do one more release this week with the scciclient bump and hopefully won't have te release team yelling at us :D | 15:11 |
| opendevreview | cid proposed openstack/ironic master: Special treatment of .json is now disabled for nodes with .json extension. https://review.opendev.org/c/openstack/ironic/+/913467 | 15:11 |
| rpittau | #topic Review Ironic CI Status | 15:12 |
| rpittau | I was out last week, is the metalsmith job still kaput? | 15:12 |
| TheJulia | dunno, I had a family emergency last week which largely consumed me | 15:13 |
| iurygregory | I also didn't look to much at CI upstream last week .-. | 15:13 |
| JayF | Nobody fixed the metalsmith job. | 15:13 |
| JayF | AFAICT | 15:13 |
| rpittau | ok, I think the issue was due to the most recent tinyipa, but didn't also have the time to check | 15:14 |
| rpittau | can anyone double-check this week? otherwise I'll see if I can make some time | 15:14 |
| TheJulia | it is definitely the new tinyipa | 15:15 |
| TheJulia | It tosses an error. I think we have two base questions, what to do with tinyipa and what to also do with metalsmith | 15:15 |
| rpittau | the issue is just on the legacy job, UEFI seems to work just fine | 15:16 |
| TheJulia | ++ | 15:16 |
| TheJulia | so maybe the question becomes, are we okay with dropping the legacy job | 15:16 |
| TheJulia | I will note the number of cases I'm seeing on the actual support ironic side of things where people are trying to intentionally use bios boot are almost zero these days | 15:17 |
| rpittau | we've disabled the job in IPA for the time being | 15:17 |
| rpittau | is that the only legacy job we have ? | 15:17 |
| TheJulia | So continuing to worry about legacy bios booting as much as we do might not be sustainable given the consumption pipeline | 15:17 |
| TheJulia | I'm fairly sure we have some others, but I don't think we need *all of them* | 15:18 |
| rpittau | that is a valid argument | 15:18 |
| TheJulia | the base issue is though, we've seen tinyipa fail on other legacy bios jobs as well which are not metalsmith | 15:18 |
| rpittau | ok, didn't see that either | 15:19 |
| masghar | So maybe we can drop the metalsmith bios job and look at the rest of the failing bios jobs? | 15:20 |
| rpittau | I say we give it a try for a fix, but if it's not immediately clear what's wrong, we remove the metalsmith legacy job | 15:20 |
| JayF | What are we actually testing re: bios vs legacy boot? | 15:21 |
| JayF | Is there a way to get there without a full scenario job? | 15:21 |
| TheJulia | UEFI based boot versus BIOS based boot | 15:22 |
| TheJulia | in this case, things fail when the ramdisk is tinyipa and it hits the bios path with partitioning | 15:22 |
| TheJulia | parted throws a "you found a libc bug!" error | 15:23 |
| JayF | What I'm asking is, in terms of *what Ironic does differently* | 15:23 |
| TheJulia | sets the modes differently to the BMC | 15:23 |
| TheJulia | different options get used with IPMI | 15:23 |
| JayF | Are we testing anything other than the ability for e.g. sushy-tools to translate "boot uefi" | 15:23 |
| TheJulia | the ramdisk will partition things differently as well | 15:23 |
| JayF | TheJulia: I will note I know cases of BIOS booted machines in production with modern-ish ironic | 15:24 |
| TheJulia | but we have extensive unit testing around that *as well* | 15:24 |
| TheJulia | JayF: but are new machines being deployed in 1+ years? | 15:24 |
| TheJulia | *with* tinyipa?! | 15:24 |
| dtantsur | TheJulia: re your comment above: we literally have legacy boot in the Metal3 quick start guide because it was written against ilo4 | 15:24 |
| TheJulia | the issue is tinyipa | 15:24 |
| JayF | TheJulia: I am making no comments re: how much we should test, just noting a data point to go with the one you asserted earlier :) | 15:24 |
| JayF | TheJulia: it's coming late because of latency :D | 15:25 |
| JayF | I think we're much more likely to end up with better ironic slimming the coverage so we spend more time making Ironic better and less time fiddling with tinyipa and zuul | 15:26 |
| TheJulia | Look, the tl;dr is we're at a union of the venn digram of "resources" "tinyipa limitations" and "complexity", I'm not saying we drop legacy boot entirely, I'm saying we work the fundimental problems and reduce our exposure | 15:26 |
| TheJulia | The failure, we know is libc not playing nicely with parted in tinyipa | 15:26 |
| TheJulia | we know, because of of differing clouds and ipa images which get used, that this doesn't impact dib based images | 15:27 |
| dtantsur | That does mean removing the coverage for our parted code completely | 15:27 |
| dtantsur | parted+grub I guess | 15:28 |
| rpittau | it's the only legacy job in ipa | 15:28 |
| JayF | parted+grub with legacy boot? | 15:28 |
| dtantsur | grub implies legacy boot, yes | 15:28 |
| JayF | That seems wacky to me, you can't even secure boot on legacy/bios? | 15:28 |
| TheJulia | that is only if we entirely remove legacy boot support, and I'm not advocating that purely, just thinking the reality is we cannot keep metalsmith stuffs around forever | 15:28 |
| JayF | Metalsmith is also deprecated as of last ptg, which should impact our choices as to how coverage falls | 15:29 |
| dtantsur | yeah, I'm just highlighting the code path left with zero testing | 15:29 |
| dtantsur | Metalsmith is not deprecating, nor are we discussing coverage for it | 15:29 |
| TheJulia | and my point ends up being, do we "really" need to test that moving forward given the amount of hardware out there that simply doesn't even have bios support in the classical sense anymore | 15:29 |
| rpittau | I'm sensing a larger discussion at PTG for this :) | 15:30 |
| TheJulia | we changed our default... ?2? or ?3? years ago | 15:30 |
| dtantsur | I don't mind us stopping supporting that eventually, but we need to be careful with expecations and messaging | 15:30 |
| TheJulia | rpittau: oh very yes :) | 15:30 |
| JayF | dtantsur: https://github.com/openstack/metalsmith/commit/e4fd02fa30164de00bc5a354af954b503f42c89b deprecated was too strong of a word, and I now also remember we often use it here for "going away eventually" while others use it for "already gone" | 15:30 |
| TheJulia | dtantsur: ++++++ | 15:30 |
| dtantsur | JayF: yep, hence we used a softer wording. Metalsmith can leave in maintenance mode for a long time, not that it's going to rot (unlike its CI job) | 15:31 |
| TheJulia | so | 15:31 |
| rpittau | let's see if we can find the time to at least understand the root cause of the failure, maybe someone will be able to reproduce the issue locally | 15:31 |
| rpittau | then we can discuss at PTG for the next steps | 15:31 |
| rpittau | wdyt? | 15:31 |
| TheJulia | what is our fastest/easiest fix, I think it is to pull tinyipa usage out | 15:31 |
| dtantsur | We could start with "We recommend users of partition images to only use UEFI mode because of lack of testing" | 15:31 |
| TheJulia | or start to dial it out of existence | 15:31 |
| TheJulia | That is also an easy path :) | 15:31 |
| dtantsur | I wonder if the metalsmith jobs could use IPA images, by the way | 15:32 |
| rpittau | DIB images ? | 15:32 |
| JayF | I suggest we table some of this for PTG? Discussion around replacing tinyipa with $something is alreayd scheduled for it | 15:32 |
| dtantsur | yeah | 15:32 |
| dtantsur | They probably have more RAM because they use "normal" OS | 15:32 |
| JayF | And I think that technical outcome will impact this discussion | 15:32 |
| rpittau | wondering the same, but I think thy're just too big | 15:32 |
| rpittau | anyway, we need more time as this expands rapidly. so PTG it is :) | 15:32 |
| JayF | e.g. we wouldn't even be having this chat if tinyipa itself wasn't bugged, I suspect | 15:32 |
| rpittau | yeah | 15:32 |
| rpittau | I'll add the topic after the meeting, unless it's already there :D | 15:33 |
| rpittau | moving on! | 15:33 |
| rpittau | #topic Bug Deputy | 15:34 |
| rpittau | JayF: anything to report? | 15:34 |
| JayF | That I'm extremely bad at prioritizing this kind of work in light of a week of firefighting :( | 15:34 |
| rpittau | :D | 15:35 |
| JayF | I apologize, nothing to report, nothing meaningful done here, my time has been eaten 15 minutes at a time | 15:35 |
| rpittau | no worries! | 15:35 |
| JayF | Best bug deputy thing I did was linking the gigabyte server bug to the person on the list lol | 15:35 |
| rpittau | I was wondering if we had any interesting/priority bug | 15:35 |
| TheJulia | JayF: what day was that last week? I saw mention of it, but I don't remember the what anymore | 15:36 |
| JayF | TheJulia: I'll just link you the post directly, easier that way | 15:36 |
| JayF | TheJulia: https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/VILS5HFLO4FKG4G7ZVDB7HN3YO7HGJRE/ | 15:36 |
| rpittau | we also need a volunteer for the bug deputy for the week, anyone available? | 15:38 |
| TheJulia | Gah, no arne to see if he replied to Arne directly | 15:39 |
| TheJulia | Eh, I might be able to | 15:39 |
| rpittau | TheJulia: thanks! | 15:40 |
| rpittau | #info bug deputy for the week: TheJulia | 15:40 |
| rpittau | we don't have any RFE to review so I'll jump to | 15:40 |
| rpittau | #topic Open Discussion | 15:40 |
| rpittau | next monday is bank holiday in Europe and I guess North/South America too ? | 15:41 |
| rpittau | I guess we can cancel the meeting | 15:41 |
| JayF | I've alluded to this various places, I'm going to be on PTO, and completely out of pocket next week with notifications off. If the world somehow pivots on getting in touch with me, many of you have my personal cell phone -- use it. | 15:41 |
| rpittau | JayF: enjoy! :) | 15:42 |
| rpittau | anything else for Open Discussion ? | 15:42 |
| dking | I think I put it in as a bug, but I have a RFE. | 15:42 |
| rpittau | dking: sure, a link ? | 15:42 |
| dking | If anybody would be interested in looking it over: https://launchpad.net/bugs/2057668 | 15:43 |
| dking | I put in a commit for review: https://review.opendev.org/c/openstack/ironic-python-agent/+/913209 | 15:43 |
| dking | I thought it might be interesting to bring up as Jay will be out next week. | 15:44 |
| TheJulia | dking: the idea seems reasonable to me | 15:45 |
| rpittau | thanks dking, it looks ok to me | 15:45 |
| JayF | That seems like a good feature to me, for folks doing customization, but it does overlap pretty heavily with the skip hinting we do | 15:45 |
| TheJulia | and actually would help folks with the super complex support cases, reminiscent of arne :) | 15:45 |
| JayF | I'd suggest considering, as part of this implementation, adding a new hardware manager to examples/ that covers the use case not handled by existing code | 15:45 |
| dking | The skip hinting is a neat feature. Unfortunately, I needed something with a little bit more control. I think that I'm often that guy. | 15:46 |
| TheJulia | JayF: that was my thought as well, plus at a minimum a release note is needed :) | 15:46 |
| JayF | Yeah, I am +1 to the rfe just suggesting you ensure the path is paved with examples for the next "that guy" :D | 15:46 |
| TheJulia | dking: Also, add a release note :) | 15:46 |
| dking | TheJulia: Okay. I might needs some pointers. | 15:47 |
| rpittau | dking: can you please fix the indentation in https://review.opendev.org/c/openstack/ironic-python-agent/+/913208 also ? | 15:47 |
| dking | I can add a bit to an example hardware manager. I could probably put it on one of the existing ones. | 15:48 |
| TheJulia | dking: on the text, or use of the reno (pip install reno && reno new <description_text> format? | 15:48 |
| JayF | I specifically request it's a separate one please dking :) | 15:48 |
| dking | rpittau: sure. I did a squash merge and forgot about that. | 15:49 |
| rpittau | dking: thanks! | 15:49 |
| dking | JayF: Sure. | 15:49 |
| TheJulia | dking: fyi, https://docs.openstack.org/reno/2.1.1/usage.html | 15:49 |
| rpittau | going to close the meeting, we can keep discussing afterwards if needed | 15:50 |
| rpittau | thanks everyone! o/ | 15:50 |
| dking | In a related issue, it may also be nice to go back and review the current hooks available for hardware managers. I have a separate bug in because we have some methods in HardwareManager which almost seem to imply that they could be overridden, but are never called with dispatch_to_managers. | 15:50 |
| rpittau | #endmeeting | 15:50 |
| opendevmeet | Meeting ended Mon Mar 25 15:50:47 2024 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:50 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/ironic/2024/ironic.2024-03-25-15.00.html | 15:50 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/ironic/2024/ironic.2024-03-25-15.00.txt | 15:50 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/ironic/2024/ironic.2024-03-25-15.00.log.html | 15:50 |
| TheJulia | dking: yeah, that seems like a good bug | 15:54 |
| TheJulia | :( | 15:54 |
| dking | At first glance it looks like there might have been a time when they were each meant to be overridable, but perhaps over time many of them began to be called exclusively by GenericHardwareManager, meaning that they only now make sense in GenericHardwareManager. | 15:57 |
| JayF | going to mark https://bugs.launchpad.net/ironic-python-agent/+bug/2057668 as rfe-approved with some of the notes from here | 15:57 |
| dking | JayF: Thank you very much! | 15:58 |
| NobodyCam | good morning Openstack folks, Happy Monday | 15:59 |
| TheJulia | good morning | 16:04 |
| rpittau | happy monday NobodyCam :) | 16:04 |
| TheJulia | dking: I suspect there is also a delineation which is needed, some things likely make sense there as helpers, but if they are directly called... eh | 16:05 |
| TheJulia | that is a whole thing to unwind | 16:05 |
| dking | TheJulia: Yeah, they're called, usually exclusively, with self.<METHOD_NAME> inside of other methods existing only in GenericHardwareManager. | 16:06 |
| TheJulia | a first step might be a wip/doc sort of pass just to highlight the cases actually | 16:07 |
| TheJulia | and then maybe put in some inline notes, dunno | 16:07 |
| dking | It seems to me that they should either be moved into HardwareManager (if they're expected to be useful for any), replacing the abstract versions, or moved entirely into GenericHardwareManager. | 16:07 |
| dking | Maybe. I suppose that right now, I was wanting to get input from the community. It's probably a separate agenda note. I'm not sure how important it would be, though, as nobody else seemed to have complained, and I don't know if many people are making custom hardware managers. | 16:11 |
| opendevreview | Dmitry Tantsur proposed openstack/sushy master: Handle NotAcceptable when Accept-Encoding: identity is not allowed https://review.opendev.org/c/openstack/sushy/+/914118 | 16:40 |
| dtantsur | This is not the cleanest way to solve this issue ^^ but it's the smallest change | 16:40 |
| dtantsur | cc TheJulia | 16:40 |
| rpittau | good night! o/ | 16:59 |
| iurygregory | oh this change is funny, I saw the bug downstream last week... | 17:52 |
| TheJulia | dtantsur: unfortunately, the weird issue was with virtual media attachment on that hardware, but without any errors or grokable error message in the returned data set | 18:37 |
| *** jamesdenton_ is now known as jamesdenton | 18:58 | |
| opendevreview | cid proposed openstack/ironic-tempest-plugin master: Patch to enforce json extension works in existing API behaviour https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/913926 | 20:23 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!