| opendevreview | Julia Kreger proposed openstack/ironic master: trivial: add missing exception to agent code path docstrings https://review.opendev.org/c/openstack/ironic/+/949776 | 01:17 |
|---|---|---|
| opendevreview | Verification of a change to openstack/ironic master failed: trivial: follow-up on ftp enable/disable flag https://review.opendev.org/c/openstack/ironic/+/942357 | 01:18 |
| TheJulia | 4 changes in the gate, 6 in the check queue at the moment :) | 01:19 |
| opendevreview | Merged openstack/ironic master: Allow configuring RPC client TLS separately from server https://review.opendev.org/c/openstack/ironic/+/945482 | 01:20 |
| opendevreview | Merged openstack/ironic master: Make metal3 job voting again https://review.opendev.org/c/openstack/ironic/+/949458 | 01:38 |
| opendevreview | Merged openstack/ironic master: Fix unhandled exception during node tear down https://review.opendev.org/c/openstack/ironic/+/949909 | 02:24 |
| opendevreview | Verification of a change to openstack/ironic master failed: Fix redfish driver URL parsing https://review.opendev.org/c/openstack/ironic/+/949597 | 02:28 |
| opendevreview | Merged openstack/ironic master: trivial: add missing exception to agent code path docstrings https://review.opendev.org/c/openstack/ironic/+/949776 | 04:30 |
| rpittau | good morning ironic! happy friday! | 07:35 |
| rpittau | awesome, tinycore does not have python>3.9 binaries, at least on x86 | 07:41 |
| rpittau | it does have for ARM | 07:41 |
| rpittau | pinning reqs there too ? | 07:41 |
| queensly[m] | Good morning :) | 08:14 |
| abongale | Good Morning Ironic! | 08:27 |
| opendevreview | Riccardo Pittau proposed openstack/ironic master: [WIP] Run metal3 integration job using UEFI boot (default) https://review.opendev.org/c/openstack/ironic/+/939694 | 08:50 |
| opendevreview | Riccardo Pittau proposed openstack/ironic-python-agent-builder master: Update pip version in dib source install https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/949974 | 09:06 |
| dtantsur | rpittau: oh, this all is a complete disaster | 10:52 |
| iurygregory | good morning Ironic | 10:54 |
| opendevreview | Ivan Anfimov proposed openstack/ironic master: wip https://review.opendev.org/c/openstack/ironic/+/950145 | 11:20 |
| opendevreview | Ivan Anfimov proposed openstack/ironic master: wip https://review.opendev.org/c/openstack/ironic/+/950145 | 11:37 |
| opendevreview | Ivan Anfimov proposed openstack/ironic master: Remove installation guide for openSUSE/SLES https://review.opendev.org/c/openstack/ironic/+/950145 | 11:37 |
| iurygregory | silly question, anyone here have successfully provisioned an iDRAC10 via ironic? I have the feeling they changed more then just the Targets to be an array instead of string.. | 12:00 |
| opendevreview | Riccardo Pittau proposed openstack/ironic-python-agent-builder master: Build CS9 DIB IPA ramdisk with python 3.12 https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/950152 | 12:11 |
| rpittau | on the other hand, this looks doable ^ | 12:11 |
| rpittau | "it works on my laptop" (TM) | 12:11 |
| iurygregory | now we just need the "it works on devstack" | 12:11 |
| iurygregory | :D | 12:12 |
| rpittau | :) | 12:12 |
| TheJulia | ugh, maybe time to give up on tinycore... | 13:10 |
| rpittau | yeah that's definitely a blocker for us | 13:24 |
| TheJulia | doh, forgot to recheck the anaconda job fix yesterday | 13:39 |
| opendevreview | Verification of a change to openstack/ironic master failed: CI: Fix anaconda job post OSSA-2025-001 https://review.opendev.org/c/openstack/ironic/+/949529 | 13:58 |
| rpittau | mmm all the src jobs in ipa builder are tinycore based | 14:04 |
| rpittau | either we convert them to DIB, or we need an alternative very soon | 14:04 |
| TheJulia | yeah | 14:04 |
| TheJulia | I'm semi-wondering how to get more ram to avoid having to re-do all the jobs at this point | 14:05 |
| TheJulia | the whole 8gb thing is basically holding everything back | 14:05 |
| TheJulia | and... I know that is going to start an argument, and I'm kind of at the point where I don't care. | 14:06 |
| TheJulia | we've burned an untold amount of resources trying to stay under that threshold | 14:07 |
| TheJulia | and... at some point we've done all we can | 14:07 |
| rpittau | we're running with 1 gigs of RAM per VM with tinyipa | 14:11 |
| rpittau | DIB has 2 to 4 times that amount | 14:11 |
| rpittau | plus the disk space | 14:11 |
| TheJulia | yeah, dib needs a minimum of like 2.6G at this point, we likely need to look at the artifacts again to see if there is any new thing we can drop out | 14:12 |
| TheJulia | *but* 2.6G has kept us in a relatively happy place for a few cycles without ending up dead in the water | 14:12 |
| rpittau | ok that's not super big actually | 14:22 |
| rpittau | 490M May 16 12:16 /home/zuul/ipa-centos9-master.initramfs | 14:22 |
| rpittau | still 170 MB bigger than debian (which has python 3.12) | 14:25 |
| TheJulia | we're sort of splitting hairs at that point though | 14:25 |
| TheJulia | We won't be able to run debian in anything less than... say... 2GB, which is still 2x the memory footprint of tiny | 14:26 |
| rpittau | yep, true :/ | 14:26 |
| opendevreview | Julia Kreger proposed openstack/ironic master: DNM: CI Science - 16GB!? https://review.opendev.org/c/openstack/ironic/+/950192 | 14:35 |
| TheJulia | lets see if that explodes in a horrible fashion | 14:36 |
| rpittau | oO | 14:41 |
| rpittau | I'm trying something with tinycore, but it's a long shot | 14:42 |
| TheJulia | so it processed but the build requests failed | 14:42 |
| iurygregory | CI Science WOW | 14:56 |
| TheJulia | oh, I see what I did | 15:01 |
| TheJulia | doh | 15:01 |
| opendevreview | Julia Kreger proposed openstack/ironic master: DNM: CI Science - 16GB!? https://review.opendev.org/c/openstack/ironic/+/950192 | 15:02 |
| JayF | TheJulia: rpittau: I was able to get a ramdisk in the ballpark of 500M with gentoo; that just is nowhere near as small as tinycore | 15:17 |
| opendevreview | Julia Kreger proposed openstack/ironic master: DNM: CI Science - 32GB!? https://review.opendev.org/c/openstack/ironic/+/950192 | 15:50 |
| opendevreview | Julia Kreger proposed openstack/ironic master: DNM: CI Science - 32GB!? https://review.opendev.org/c/openstack/ironic/+/950192 | 16:16 |
| TheJulia | iurygregory: so, fyi, we have to use a label in https://zuul.opendev.org/t/openstack/labels because tenant config is in the middle from base zuul config | 16:19 |
| rpittau | FYI we're officially in no-python-3.9 zone with https://review.opendev.org/c/openstack/requirements/+/950167 | 16:29 |
| rpittau | clock is ticking | 16:29 |
| iurygregory | TheJulia, tks for sharing I wasn't aware of it | 16:30 |
| JayF | networking-baremetal is passing CI with the "remove eventlet but don't explicitly tell anything oslo to use threading" change, except for a requirements issue. I'll clean it up further once the oslo change is merged+released. | 16:37 |
| opendevreview | Julia Kreger proposed openstack/ironic master: DNM: CI Science - Expand the multinode job https://review.opendev.org/c/openstack/ironic/+/950206 | 16:38 |
| TheJulia | so the 32GB node works, ansible job will need to be retooled to use an ssh key | 16:44 |
| JayF | nice, thank you | 16:45 |
| opendevreview | Julia Kreger proposed openstack/ironic master: DNM: CI Science - Expand the multinode job https://review.opendev.org/c/openstack/ironic/+/950206 | 16:46 |
| TheJulia | lets see if that spins up | 16:47 |
| opendevreview | Merged openstack/ironic master: CI: Fix anaconda job post OSSA-2025-001 https://review.opendev.org/c/openstack/ironic/+/949529 | 16:56 |
| TheJulia | woot | 17:08 |
| opendevreview | Julia Kreger proposed openstack/ironic stable/2025.1: CI: Fix anaconda job post OSSA-2025-001 https://review.opendev.org/c/openstack/ironic/+/950210 | 17:09 |
| opendevreview | Julia Kreger proposed openstack/ironic stable/2024.2: CI: Fix anaconda job post OSSA-2025-001 https://review.opendev.org/c/openstack/ironic/+/950211 | 17:10 |
| TheJulia | woot | 17:10 |
| opendevreview | Jay Faulkner proposed openstack/ironic unmaintained/xena: [um-only] [ci] Disable all integration testing https://review.opendev.org/c/openstack/ironic/+/945173 | 17:11 |
| opendevreview | Jay Faulkner proposed openstack/ironic master: Inspection throws exception on CPU-less systems https://review.opendev.org/c/openstack/ironic/+/949090 | 17:13 |
| opendevreview | Jay Faulkner proposed openstack/ironic master: PTG: Move CI job descriptions into yaml https://review.opendev.org/c/openstack/ironic/+/946584 | 17:14 |
| JayF | For this ( https://review.opendev.org/c/openstack/ironic/+/945259 ) automated cleaning via runbook ... should we still check the runbook against node traits even though it's explicitly configured? | 17:22 |
| JayF | I'm leaning towards yes to prevent it being easy for an operator to brick themselves | 17:23 |
| freemanboss[m] | I have patches please anyone to help me look into them and resolve them | 17:24 |
| freemanboss[m] | https://review.opendev.org/c/openstack/bifrost/+/947600 | 17:25 |
| freemanboss[m] | https://review.opendev.org/c/openstack/bifrost/+/946726 | 17:25 |
| freemanboss[m] | https://review.opendev.org/c/openstack/bifrost/+/946724 | 17:25 |
| freemanboss[m] | Also I'd like to know how I can start having coding contributions? | 17:26 |
| opendevreview | Merged openstack/ironic-python-agent master: trivial: Fix missing extra space in logging https://review.opendev.org/c/openstack/ironic-python-agent/+/949920 | 17:34 |
| TheJulia | so, looks like we'll have to re-key names for expanding the multinode pool | 17:41 |
| TheJulia | which should likely be doable | 17:41 |
| opendevreview | Jay Faulkner proposed openstack/ironic unmaintained/xena: [um-only] [ci] Disable all integration testing https://review.opendev.org/c/openstack/ironic/+/945173 | 18:15 |
| opendevreview | Julia Kreger proposed openstack/ironic master: DNM: CI Science - Expand the multinode job https://review.opendev.org/c/openstack/ironic/+/950206 | 18:23 |
| opendevreview | Julia Kreger proposed openstack/ironic master: CI: Reconfigure jobs to minimize tinyipa usage https://review.opendev.org/c/openstack/ironic/+/950192 | 19:10 |
| opendevreview | Julia Kreger proposed openstack/ironic master: DNM: CI Science - Expand the multinode job https://review.opendev.org/c/openstack/ironic/+/950206 | 19:10 |
| opendevreview | Julia Kreger proposed openstack/ironic master: CI: Remove the multinode grenade job https://review.opendev.org/c/openstack/ironic/+/950224 | 19:10 |
| opendevreview | Julia Kreger proposed openstack/ironic master: CI: Reconfigure jobs to minimize tinyipa usage https://review.opendev.org/c/openstack/ironic/+/950192 | 19:15 |
| opendevreview | Julia Kreger proposed openstack/ironic master: CI: Reconfigure jobs to minimize tinyipa usage https://review.opendev.org/c/openstack/ironic/+/950192 | 19:17 |
| opendevreview | Julia Kreger proposed openstack/ironic master: CI: Remove the multinode grenade job https://review.opendev.org/c/openstack/ironic/+/950224 | 19:26 |
| opendevreview | Julia Kreger proposed openstack/ironic master: DNM: CI Science - Expand the multinode job https://review.opendev.org/c/openstack/ironic/+/950206 | 19:26 |
| TheJulia | JayF: in general, verify is a good idea ;) | 19:28 |
| JayF | I just don't love the idea of cleaning failing due to a misconfiguration | 19:28 |
| JayF | it basically leads to a late-error | 19:28 |
| TheJulia | same | 19:28 |
| TheJulia | so, maybe a knob, dunno | 19:29 |
| TheJulia | its always a fine line | 19:29 |
| JayF | yeah I guess I'll put in a knob | 19:29 |
| JayF | that'll at least get me further so I'm not paralyzed by indecision | 19:29 |
| TheJulia | oh, doh, I need to figure out the ansible job. :\ | 19:33 |
| opendevreview | Julia Kreger proposed openstack/ironic-python-agent-builder master: Remove tinyipa CI testing https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/950235 | 20:35 |
| opendevreview | Julia Kreger proposed openstack/ironic-python-agent master: Remove TinyIPA jobs https://review.opendev.org/c/openstack/ironic-python-agent/+/950236 | 20:36 |
| opendevreview | Julia Kreger proposed openstack/ironic master: CI: Reconfigure jobs to minimize tinyipa usage https://review.opendev.org/c/openstack/ironic/+/950192 | 20:44 |
| opendevreview | Julia Kreger proposed openstack/ironic-tempest-plugin master: Remove available nodes configuration https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/950238 | 21:01 |
| opendevreview | Julia Kreger proposed openstack/ironic master: CI: Reconfigure jobs to minimize tinyipa usage https://review.opendev.org/c/openstack/ironic/+/950192 | 21:08 |
| opendevreview | Julia Kreger proposed openstack/ironic master: CI: Remove the multinode grenade job https://review.opendev.org/c/openstack/ironic/+/950224 | 21:10 |
| TheJulia | to scale out multinode jobs and drop tinyipa at the same time, we'll really need to merge https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/950238 in first. | 21:14 |
| iurygregory | I'm trying to understand why we need to remove the available_nodes config .-. | 21:19 |
| opendevreview | Julia Kreger proposed openstack/ironic master: DNM: CI Science - Expand the multinode job https://review.opendev.org/c/openstack/ironic/+/950206 | 21:20 |
| TheJulia | if you look at the patch I just pushed | 21:20 |
| TheJulia | you'll realize it was always based on IRONIC_VM_COUNT | 21:20 |
| TheJulia | which means its artificial constraint | 21:21 |
| iurygregory | oh now I see | 21:21 |
| TheJulia | *REALLY* the tests should look at the cloud they are running against | 21:22 |
| TheJulia | and not config | 21:22 |
| iurygregory | ++ | 21:22 |
| TheJulia | The big issue is for the multinode jobs, we can only really fit 1 VM on the main node | 21:22 |
| TheJulia | at 2.6-3GB | 21:22 |
| iurygregory | its life =( | 21:23 |
| TheJulia | so, let everything run, just house a single node there, and move on | 21:23 |
| TheJulia | yeah | 21:23 |
| TheJulia | I've been busy peeling away tinyipa | 21:23 |
| * TheJulia gets out the label printer, and puts "tinyipa remover" on the angle grinder | 21:23 | |
| iurygregory | and hopefully put us in a better place for eventlet removal | 21:24 |
| TheJulia | yeah, less technical debt really | 21:25 |
| TheJulia | quick reviews on https://review.opendev.org/q/I79204117cdbffab1f619981767471475870b4571 would be appreciated so we can unbrick ironic-tempest-plugin's CI and merge changes | 21:27 |
| iurygregory | Jay just approved | 21:40 |
| JayF | I landed and approved them. As a single core since it is a fix for CI. Wouldn't be terrible if someone else went behind and added votes | 21:40 |
| iurygregory | jesus, I think iDRAC10 is totally broken omg | 21:41 |
| JayF | iurygregory: if you could document your issues in like an etherpad or somewhere where I have a shareable link, that would be really really good | 21:41 |
| iurygregory | why did they moved the BootSourceOverrideTarget@Redfish.AllowableValues to other endpoint?! | 21:41 |
| JayF | iurygregory: I might could even have a person talk to a person and see if they can make it less terrible | 21:41 |
| iurygregory | just WHY | 21:41 |
| iurygregory | JayF, ack o/ | 21:41 |
| iurygregory | I'm testing their https://github.com/dell/iDRAC-Redfish-Scripting to be sure i wasn't doing something crazy via ironic XD | 21:42 |
| iurygregory | https://paste.opendev.org/show/bc3SkP5gvQlMUAalXsKI/ | 21:44 |
| iurygregory | now the BootSourceOverrideTarget@Redfish.AllowableValues is under /redfish/v1/Systems/System.Embedded.1/Settings instead of the default /redfish/v1/Systems/System.Embedded.1/ | 21:46 |
| JayF | is that still valid redfish and just weird/different? | 21:49 |
| iurygregory | I have no idea tbh, trying to look at the DMTF files to see | 21:50 |
| TheJulia | thanks! | 21:50 |
| JayF | cool, I honestly am not sure I have redfish knowledge to actually help, but I am invested in helping us make better-behaved hardware :) | 21:50 |
| iurygregory | ++ | 21:51 |
| TheJulia | afaik that is not compliant, but maybe they changed it, but they have tried hard not to have breaking changes and that sounds super breaking | 21:51 |
| TheJulia | like... "hold my beer!" sort of breaking | 21:51 |
| iurygregory | TheJulia, yeah =( I do have this feeling | 21:52 |
| JayF | it also seems like it /should/ be trivial to make a compatibility shim at least | 21:52 |
| JayF | not like saying "make this path work too" is asking to move a mountain :) | 21:52 |
| iurygregory | and I have people asking me "hey why we can't use iDRAC10 ?" | 21:52 |
| JayF | I know you probably can't give them the real answer I would :D | 21:52 |
| iurygregory | JayF, yup, i'm testing workarounds with bifrost before pushing upstream | 21:53 |
| iurygregory | when i get a deployment working end to end I will probably cry | 21:53 |
| * TheJulia just leaves https://redfish.dmtf.org/schemas/v1/ComputerSystem.v1_24_0.json here | 21:57 | |
| TheJulia | ... and hopefully your being brutally honest with people asking | 21:57 |
| TheJulia | And a full value move, fwiw, would break the semver of the model, and well... it is v1.24.0 for a reason ;) | 21:58 |
| TheJulia | ugh, hot + dry +wind is resulting in fires popping up nearby today | 22:01 |
| iurygregory | ok, I don't see such "Settings" in Boot part, which is a good sign for the standard, but a bad sign for me =) | 22:06 |
| JayF | y'all be careful :| | 22:06 |
| iurygregory | oh wow, take care TheJulia! | 22:08 |
| TheJulia | eh, I'm fine right now, ~2.5km away | 22:09 |
| TheJulia | maybe 2 | 22:09 |
| iurygregory | in the city where i live it's raining since yesterday night | 22:09 |
| TheJulia | iurygregory: yeah, no settings object, just BootSourceOverrideEnabled nestled under Boot | 22:10 |
| iurygregory | on monday i will do some magic in bifrost to see this working (fingers crossed that this will solve the problem) | 22:10 |
| iurygregory | https://paste.opendev.org/show/bTjIcIO62d78kC6Kzgx2/ | 22:17 |
| TheJulia | Yeah, that seems nice and breaking | 22:28 |
| TheJulia | Comparing a 9 vs 10? | 22:29 |
| iurygregory | this is in a 10 | 22:32 |
| iurygregory | they have Boot twice, but under System is without some options it seems | 22:33 |
| TheJulia | sounds like they are intentionally trying to break vendor neutral tools | 22:37 |
| iurygregory | https://etherpad.opendev.org/p/ironic-idrac10-issues | 22:42 |
| iurygregory | added some details about the diff | 22:42 |
| opendevreview | Verification of a change to openstack/ironic stable/2025.1 failed: CI: Fix anaconda job post OSSA-2025-001 https://review.opendev.org/c/openstack/ironic/+/950210 | 22:48 |
| opendevreview | Merged openstack/ironic stable/2024.2: CI: Fix anaconda job post OSSA-2025-001 https://review.opendev.org/c/openstack/ironic/+/950211 | 22:59 |
| opendevreview | Julia Kreger proposed openstack/ironic master: CI: Reconfigure jobs to minimize tinyipa usage https://review.opendev.org/c/openstack/ironic/+/950192 | 23:00 |
| TheJulia | I'm not sure what is up with the multinode jobs besides what appears to be network issues pxe booting... which means I may need to request it be held | 23:16 |
Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!