Monday, 2025-12-15

opendevreviewMerged openstack/ironic master: remove sushy_oem_idrac usage  https://review.opendev.org/c/openstack/ironic/+/97027301:11
opendevreviewMerged openstack/ironic master: doc: trivial: Quick revision of README  https://review.opendev.org/c/openstack/ironic/+/96805601:11
opendevreviewMerged openstack/ironic stable/2025.1: fix: ensure that the bootloader path exists  https://review.opendev.org/c/openstack/ironic/+/96912201:11
opendevreviewMerged openstack/ironic master: Replace remaining usage of policy.json  https://review.opendev.org/c/openstack/ironic/+/97065001:11
opendevreviewIury Gregory Melo Ferreira proposed openstack/ironic master: Make post-firmware-update reboot conditional on component  https://review.opendev.org/c/openstack/ironic/+/96634404:04
opendevreviewIury Gregory Melo Ferreira proposed openstack/ironic master: Fix firmware update failure when task remains in RUNNING state  https://review.opendev.org/c/openstack/ironic/+/97099804:06
opendevreviewIury Gregory Melo Ferreira proposed openstack/ironic master: Fix BIOS firmware not flashing when task completes before first poll  https://review.opendev.org/c/openstack/ironic/+/97099904:15
opendevreviewIury Gregory Melo Ferreira proposed openstack/ironic master: Fix BMC resource validation to catch all sushy exceptions  https://review.opendev.org/c/openstack/ironic/+/97100004:19
rpittaugood morning ironic! o/08:05
*** ubuntu is now known as Guest3365509:36
opendevreviewMerged openstack/ironic master: Use native override of RequestContext.from_environ  https://review.opendev.org/c/openstack/ironic/+/97097010:15
opendevreviewMerged openstack/ironic master: fix: agent inspection hooks failure does not clean up  https://review.opendev.org/c/openstack/ironic/+/97092210:17
opendevreviewTakashi Kajinami proposed openstack/ironic master: Use common request_id middleware  https://review.opendev.org/c/openstack/ironic/+/97097811:15
iurygregorygood morning ironic12:03
iurygregorydoes anyone notice a problem with releasenote jobs?12:04
iurygregorys/does/did12:04
iurygregoryhttps://zuul.opendev.org/t/openstack/build/c39749889c3b48f5a00a819c705a022f12:04
opendevreviewDoug Goldstein proposed openstack/ironic stable/2025.2: fix: agent inspection hooks failure does not clean up  https://review.opendev.org/c/openstack/ironic/+/97103112:31
opendevreviewDoug Goldstein proposed openstack/ironic bugfix/33.0: fix: agent inspection hooks failure does not clean up  https://review.opendev.org/c/openstack/ironic/+/97103212:32
frickleriurygregory: looks to me like an issue in that change, commented12:48
iurygregoryfrickler, oh tks!12:49
iurygregoryI couldn't really find the error when looking at it .-.12:49
opendevreviewIury Gregory Melo Ferreira proposed openstack/ironic master: Make post-firmware-update reboot conditional on component  https://review.opendev.org/c/openstack/ironic/+/96634413:35
opendevreviewDoug Goldstein proposed openstack/ironic stable/2025.1: fix: agent inspection hooks failure does not clean up  https://review.opendev.org/c/openstack/ironic/+/97104313:40
opendevreviewIury Gregory Melo Ferreira proposed openstack/ironic master: Fix firmware update failure when task remains in RUNNING state  https://review.opendev.org/c/openstack/ironic/+/97099814:03
opendevreviewIury Gregory Melo Ferreira proposed openstack/ironic master: Fix BIOS firmware not flashing when task completes before first poll  https://review.opendev.org/c/openstack/ironic/+/97099914:06
cardoeGood morning ironic14:06
opendevreviewIury Gregory Melo Ferreira proposed openstack/ironic master: Fix BMC resource validation to catch all sushy exceptions  https://review.opendev.org/c/openstack/ironic/+/97100014:06
cardoeSince I'm always in a work call during the ironic meeting and I struggle to keep up... wanted to throw https://review.opendev.org/c/openstack/ironic/+/957613 out here as one to have folks decide on.14:09
womaxhi ironic team, a few weeks ago I came here to discuss temp URL and adding s3 support for such url. After a bit of discutions, I decided to go to Glance and propose direct support in Glance.14:12
cardoedtantsur: what do we gotta do to https://review.opendev.org/c/openstack/ironic/+/969277 to get it over the line?14:12
cardoewomax: so updating glance to support the temp url style? or updating ironic's glance support?14:13
womaxupdating glance to support temp url14:13
womaxmore precisely temp url generation14:13
womaxI came up with a spec I proposed recently (https://review.opendev.org/c/openstack/glance-specs/+/970214). In it I mentioned Ironic already use Swift URL and it could be useful to have then managed at glance level. And I am now facing the question of why are they used in Ironic and wanted to make sure I understand it correctly14:14
womaxMy current understanding is: it is python-ironic-agent that need to download image on the bm server, but deploying credentials to access either glance or storage backend would be tricky / not very secure. So ironic-conductor generates a temp URL that it passes down to python-ironic-agent that can then download the image without any credentials required. is that it?14:16
opendevreviewMerged openstack/ironic bugfix/33.0: fix: agent inspection hooks failure does not clean up  https://review.opendev.org/c/openstack/ironic/+/97103214:18
dtantsurcardoe: I'd prefer my comments addressed; not sure if TheJulia has time though14:18
cardoeah I didn't look at resolved comments so that's why I didn't see any14:19
cardoeI dunno when TheJulia is back from PTO.14:19
cardoewomax: that's correct14:19
dtantsurcardoe: I'm honestly not sure why they show as resolved Oo14:19
cardoeJust trying to triage the ironic-week-prio a little before my meetings start.14:20
womaxcardoe: thanks14:25
womaxcardoe: and to be a bit more precise (it is mostly curiosity at this point), the fact that there is no credentials deploy with ironic-python-agent is more linked to a security reason or feasibilty reason14:39
womaxmy guess is security but i'm a bit curious to know for sure14:40
opendevreviewMerged openstack/ironic-prometheus-exporter master: Fix handling of unknown metric keys in ironic parser  https://review.opendev.org/c/openstack/ironic-prometheus-exporter/+/97062714:49
TheJuliagood morning14:52
TheJuliaI'm back, but doing a lot of administrivia at the moment14:52
kubajjo/15:01
janderso/15:02
dtantsurCould someone who is not me drive the meeting this time?15:02
TheJuliaThe meeting has been cancelled15:03
TheJuliaIt was cancelled weeks ago15:03
dtantsurah, fair enough15:03
kubajjI thought it's next week's that's cancelled15:03
TheJulia... at least15:03
kubajjbut fair15:03
TheJuliaI think it was15:03
TheJuliauhhhh15:03
* TheJulia looks15:03
kubajj| <TheJulia> Any thoughts on skipping 12/22 and 12/29 ?15:04
opendevreviewIury Gregory Melo Ferreira proposed openstack/ironic master: Add retry logic for transient BMC errors during system reset  https://review.opendev.org/c/openstack/ironic/+/97105815:04
kubajjbut anyway, don't know how many people are around15:04
TheJulia22nd and 29th15:04
TheJuliaYeah, seems like we're below or right out qorum15:04
TheJuliaAnyone have anything to discuss and I can fire up the meeting15:04
jandersI have two-liner update from raising multi-system-systems topic with DMTF folks, not sure if it sanctions a meeting15:05
* TheJulia takes silence as "nope"15:05
* TheJulia shrugs15:05
janders(and I don't think I see Jay here)15:06
jandersif no one is particularly interested, we can discuss this later15:06
dtantsurI don't have anything, and I'm debugging why my vim is misbehaving15:06
TheJuliaYeah, he has been the real driver there. I get where he is coming from albeit... part of it is the spec itself's modeling15:07
TheJuliadtantsur: maybe you need to install emacs just to cause vim to behave? :)15:07
dtantsuras a threat? yeah, may work15:11
opendevreviewRiccardo Pittau proposed openstack/ironic-prometheus-exporter stable/2025.2: Fix handling of unknown metric keys in ironic parser  https://review.opendev.org/c/openstack/ironic-prometheus-exporter/+/97107215:45
opendevreviewRiccardo Pittau proposed openstack/ironic-prometheus-exporter stable/2025.1: Fix handling of unknown metric keys in ironic parser  https://review.opendev.org/c/openstack/ironic-prometheus-exporter/+/97107315:46
dtantsurWell, this was a fun one: https://github.com/ycm-core/ycmd/issues/180016:03
JayFjanders: yeah, thanks, I'm out today but can talk later this week16:11
jandersJayF sounds good. I will be back from PTO Wednesday-ish so things will get easier16:12
alegacyhas anything changed recently with how things work in bifrost or how configdrives are handled in any way?  I'll explain... 16:24
alegacyfor the past months... while testing the standalone networking changes, I would use bifrost to do some of the testing.  I would create the testenv, do the install, do the enroll, manually inspect, provide, deploy, undeploy, manage, inspect, delete... rinse -> repeat.16:26
alegacyall this was done with inspection on vlan10, cleaning on vlan20, and tenant network on vlan30.16:26
alegacyuntil late last week I have not had a problem with that workflow.... at least not that I noticed or remember.16:27
alegacynow what seems to be happening is that everything works fine up to the after the deploy finishes... but then when I do an undeploy which triggers a clean that times out.16:28
alegacywhat appears to be happening is that the configdrive from the deploy step is still kicking around an so when the node boots to clean it uses the IP address that was used for the deployed node.16:28
alegacythat IP address won't work on the vlan that I have set aside for cleaning.  16:29
dtantsurUuuugh16:29
alegacyis this new behaviour?  have I been missing something all this time?16:29
dtantsurI bet it's related to https://opendev.org/openstack/ironic-python-agent-builder/commit/3f83c9ccb56200c26c21f33d656bfbdbe467ee2d (cc TheJulia)16:29
dtantsurHaven't we solved that issue though? I was sure we have safeguards in place16:30
alegacyi had added that "force_dhcp" flag... but after some digging it looks like maybe that only works for virtual media booting and not PXE like in the bifrost case.  ...and of course only for inspection.16:32
TheJuliaHhmm, I thought we fixed that16:32
alegacyin my current state even subsequent inspections won't work because it still seems to rely on that config drive.16:32
opendevreviewMerged openstack/ironic stable/2025.2: fix: agent inspection hooks failure does not clean up  https://review.opendev.org/c/openstack/ironic/+/97103116:33
alegacyMaybe I'm missing a fix? ... I could try rebasing ironic and bifrost to latest.   I thought I did that last week though so I should be fairly close to the tip16:33
TheJuliathat would lend creedence to the other report of issues because it should be locking it out but maybe the order is not being honored16:33
TheJuliaalegacy: latest bifrost with a cleared out image/artifact cache (or just "rm -r -f /httpboot" and reinstall) would be ideal16:34
alegacyk, I'll refresh things and report back.16:34
TheJuliaThanks16:34
* TheJulia goes back to administrivia16:34
alegacyTheJulia: for /httpboot are you referring to /var/lib/ironic/httpboot? 16:37
TheJuliayes, yes I am16:37
alegacyk16:37
opendevreviewMerged openstack/ironic stable/2025.1: fix: agent inspection hooks failure does not clean up  https://review.opendev.org/c/openstack/ironic/+/97104317:34
alegacyTheJulia: removed that directory and re-ran the bifrost install.  Same result.  Config drive seems to used still.18:03
TheJuliaugggh18:03
opendevreviewJulia Kreger proposed openstack/ironic-python-agent-builder master: Revert "Add simple-init by default"  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/97111018:06
dtantsuralegacy: do you think you can fetch the entire journal from the running ramdisk?18:07
TheJuliayeah, that would likely help. I've gone ahead and reverted the change18:08
alegacydtantsur: you mean the console log of the VM?18:08
TheJuliaI'll have to dig up the CI change and get it running again. I bet order or process has changed silently somewhere along the way18:08
TheJuliaalegacy: console is at least a solid data point18:09
dtantsuryep18:09
dtantsurI wonder if we inject the SSH key by default in bifrost...18:09
dtantsurmm, yes, but not by default for some reason.. ipa_add_ssh_key  is set to false18:10
alegacyk, i can collect the console file... is there a standard way of sharing that here?  18:10
dtantsuralegacy: https://paste.opendev.org/18:11
alegacyperfect... k, if I can't do it before I need to skip out to the dentist shortly I'll do it when I get back.18:11
TheJuliadtantsur: fwiw, I +2+A'ed the revert I generated in gerrit.18:13
dtantsurack18:14
opendevreviewVerification of a change to openstack/ironic master failed: Add Redfish LLDP data collection support to the Redfish inspection interface.  https://review.opendev.org/c/openstack/ironic/+/96784119:59
opendevreviewMerged openstack/ironic-python-agent-builder master: Revert "Add simple-init by default"  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/97111020:22
opendevreviewVerification of a change to openstack/ironic master failed: Add Redfish LLDP data collection support to the Redfish inspection interface.  https://review.opendev.org/c/openstack/ironic/+/96784120:51
opendevreviewJulia Kreger proposed openstack/ironic master: OCI: Add an option to fallback to HTTP  https://review.opendev.org/c/openstack/ironic/+/96927721:14
opendevreviewJulia Kreger proposed openstack/ironic master: OCI Basic Auth/Tag access  https://review.opendev.org/c/openstack/ironic/+/96931421:14
alegacydtantsur: TheJulia: paste.opendev.org only supports 64K chunks... so split the file into 4 chunks.  First one is https://paste.opendev.org/show/829913/ ...and the other 3 are sequentially numbered ...914...915...916.21:38
TheJuliaErr, I think I see what is going on21:42
TheJuliaI should be able to make progress on it tomorrow21:42
opendevreviewMerged openstack/ironic-python-agent master: Remove unicode literal from code  https://review.opendev.org/c/openstack/ironic-python-agent/+/85251221:45
opendevreviewDoug Goldstein proposed openstack/ironic master: fix redfish inspect system product name  https://review.opendev.org/c/openstack/ironic/+/97114222:41
opendevreviewDoug Goldstein proposed openstack/ironic master: fix: allow system owner to view and manipulate inspection rules  https://review.opendev.org/c/openstack/ironic/+/97114623:43

Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!