Thursday, 2025-07-17

rpittaugood morning ironic! o/06:29
queensly[m]Good morning07:33
abongalegm ironic!08:24
opendevreviewSyed Haseeb Ahmed proposed openstack/ironic master: Add interface name to inventory for inspection hooks  https://review.opendev.org/c/openstack/ironic/+/95341408:34
fricklerI'm having an issue with ipa from master, it fails to find any ethernet interfaces' mac on my cisco boxes. version from about 2 weeks ago is working fine, stable/2025.1 too. anybody seen something similar? good ideas for debugging? sadly remote access to the site is a bit ... complicated10:16
dtantsurfrickler: a side effect of https://opendev.org/openstack/ironic-python-agent-builder/commit/e06a6cf64cc8dee786ae728624afbff758939809?10:51
dtantsurcould be https://opendev.org/openstack/ironic-python-agent/commit/9db3cd1e4d72462eb9303fd917f2d19a823cf4f0 too but I hardly see how10:51
dtantsurthese are two directions I'd be looking into10:52
TheJuliacardoe: okay, then perhaps an explicit disabled field and we just add that to the logic today to ignore the port entirely13:21
TheJuliaAlso, good morning13:21
dtantsurmorning TheJulia13:25
opendevreviewMerged openstack/ironic-prometheus-exporter master: Zuul: do not use USE_PYTHON3  https://review.opendev.org/c/openstack/ironic-prometheus-exporter/+/95349813:32
fricklerdtantsur: thx, I've been looking at the second patch already, but it does look fine for me just from the sight of it. maybe I'll need to do some bisecting. the builder change is unlikely, since building from stable/2025.1 is not affected13:38
dtantsurfrickler: you use master builder for stable/2025.1?13:48
fricklerdtantsur: well until yesterday I only built ipa from master, because it just worked. when I noticed the regression, I just did set the dib reporef var to switch ipa+reqs to 2025.1, and that worked fine again. I wasn't aware that the builder is branched, too, until now13:58
TheJuliafrickler: I guess the big question is do these network interfaces work at all? If they require firmware blobs to initalize, that would be a pretty solid data point15:34
fricklerTheJulia: I don't think they need firmware blobs, but I also didn't understand what exactly the builder patch does. the interfaces are all present as expected in lshw output, just somehow the master ipa fails to find them15:37
TheJuliaweird15:37
TheJuliaso the builder patch just strips excess firmware blobs out to make the ramdisk size drop15:37
dtantsurfrickler: you have lshw, does it mean you also have the agent logs?15:48
dtantsurTheJulia: drafted my ideas around scaling sensor data https://bugs.launchpad.net/ironic/+bug/2117178 (can be applied to power actions later)15:50
fricklerdtantsur: I can look at them, but not copy&paste from them. or could, currently everything worked with the 2025.1 ipa. sadly with this issue ipa also doesn't get far enough such that it could save logs on the conductor15:51
dtantsurGot it. Do you have any downstream hardware managers in IPA?15:52
fricklerI don't think so. from a screenshot the relevant message seems to be: WARNING: ironic_python_agent.hardware - Cannot find detailed information about interface ens1f0np0: StopIteration15:54
fricklerwhich is the first of 8 interfaces. this is repeated a couple of times, none of the other ifs is mentioned in the log15:55
dtantsurThis is about inability to find this interface in lshw; not fatal15:56
fricklerbut the interface is there. and in the end the list of gathered mac addresses is empty and thus the node fails to identify itself to the conductor16:04
opendevreviewSyed Haseeb Ahmed proposed openstack/ironic master: Add interface name to inventory for inspection hooks  https://review.opendev.org/c/openstack/ironic/+/95341416:34
TheJuliafrickler: easy way to check, you could set IPA_REMOVE_FIRMWARE to an empty string on building a new ramdisk, and it will keep all the firmware blobs17:29
rm_work[m]off-topic, anyone happen to know the state of Zun? TheJulia maybe you have had some interaction with them?18:00
TheJuliaI don't think it really got off the ground beyond the original authors/consumers.18:02
TheJuliadtantsur: your dynamic pool patch seems to kind of work, letting my local heavily patched ironic roll for a while :)18:30
cardoeTheJulia: you good with the style in https://review.opendev.org/c/openstack/ironic/+/953414 or I can refactor that to combine the summary and the other mock.19:15
cardoeJust trying to get Haseeb over the finish line with this one.19:15
TheJuliacardoe: LGTM at this point19:37
cardoeThanks. I gave it my +2 as well.20:08
opendevreviewNahian Pathan proposed openstack/sushy master: Support expanded Chassis and Storage for redfish  https://review.opendev.org/c/openstack/sushy/+/95521121:03
opendevreviewNahian Pathan proposed openstack/sushy master: Support expanded Chassis and Storage for redfish  https://review.opendev.org/c/openstack/sushy/+/95521121:05
opendevreviewNahian Pathan proposed openstack/sushy master: Support expanded Chassis and Storage for redfish  https://review.opendev.org/c/openstack/sushy/+/95521121:07
TheJuliadtantsur: so, overall your futurist chagne actually seems to do exactly what is needed minus what was already noted on change. Ironic just sitting syncing power runs 26-30 threads. Some further worker changes and need to revisit the rejection logic.21:24
TheJuliaOverall spread on requests, does semi-match just eventlet... although maybe a little (oddly) slower, but... my local ironic likely needs a fresh state and can re-measure, but I do think the futurist change is the right path at this point as it aligns and keeps ironic itself from having to watch over/modify the thread pool.21:26
TheJuliawhich also seems like a bad idea21:26
opendevreviewNahian Pathan proposed openstack/sushy master: Support expanded Chassis and Storage for redfish  https://review.opendev.org/c/openstack/sushy/+/95521122:04

Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!