| opendevreview | Julia Kreger proposed openstack/ironic master: docs: augment security docs https://review.opendev.org/c/openstack/ironic/+/920705 | 00:33 |
|---|---|---|
| opendevreview | Julia Kreger proposed openstack/ironic master: Enhance security notes in config description https://review.opendev.org/c/openstack/ironic/+/920706 | 00:33 |
| opendevreview | Merged openstack/ironic master: Add Node Servicing to api-ref https://review.opendev.org/c/openstack/ironic/+/920152 | 02:36 |
| opendevreview | cid proposed openstack/ironic master: wip: Provision aarch64 fake-bare-metal-vms https://review.opendev.org/c/openstack/ironic/+/915441 | 03:06 |
| iurygregory | ok, talk submitted to OIS Asia 24 (fingers crossed) | 03:14 |
| iurygregory | \o/ | 03:14 |
| opendevreview | OpenStack Proposal Bot proposed openstack/ironic-inspector master: Imported Translations from Zanata https://review.opendev.org/c/openstack/ironic-inspector/+/920710 | 04:13 |
| rpittau | good morning ironic! o/ | 07:15 |
| rpittau | iurygregory: good luck! :) | 07:15 |
| sylvr | Hi! I'm a bit lost with Ironic about inspection/provision using the idrac driver, I was hoping I could get some help clear some misunderstanding I have on the software | 07:40 |
| JayF | Just go ahead and ask your specific question, even if no contributors are currently active we'll reply as folks see it o/ | 08:15 |
| JayF | welcome :) | 08:15 |
| sylvr | Thanks ! | 08:16 |
| sylvr | So, I'm trying to use kayobe to manage an openstack with baremetal capabilities (mix HPC and VM for users). I have 3 switches : one OOB with all of the iDRAC on it, accessible by the seed-bifrost (Ironic run on it), one for management (internal openstack) and one for traffic | 08:20 |
| sylvr | so, I'm trying to inspect and provision nodes with seed-bifrost (ironic) but I can't figure out how to manage any nodes as they're stuck in the "enroll" state... | 08:21 |
| JayF | so are you trying to get them out of enroll into another state and getting an error, or just stuck there | 08:21 |
| JayF | I suspect there's an error in the bifrost run because iirc they shouldn't be left in enroll | 08:21 |
| sylvr | I think I might misunderstood some key point of provisionning/inspection using ironic | 08:21 |
| JayF | So you're using mixed HPC and VMs | 08:22 |
| JayF | do you have other openstack pieces? I assume yes? | 08:22 |
| sylvr | well, AFAIK, enroll state is the first one (duirng inspection, PXEboot with IPA etc) | 08:22 |
| sylvr | I'm using kayobe, what pieces of openstack are you refering to ? | 08:23 |
| JayF | well, if you're trying to do VMs | 08:23 |
| JayF | that's not something that Ironic can do | 08:23 |
| JayF | so I was assuming you're likely using Nova | 08:23 |
| JayF | we only have VM support in Ironic/bifrost for development purposes (they are VMs that pretend to be bare metal) | 08:23 |
| sylvr | oh yeah, well for now I'm trying to inspect and provision the undercloud ? | 08:24 |
| JayF | got it | 08:24 |
| JayF | so you want to use kayobe to provision bare metal | 08:24 |
| JayF | which will eventually have an openstack cluster installed on it (via ironic) | 08:24 |
| sylvr | yes | 08:25 |
| sylvr | or just baremetal nodes if needed, but for now yeah to host an openstack cluster | 08:25 |
| JayF | so if your nodes are in enroll, you have to kick them through to the next state to get them ready to provision | 08:25 |
| JayF | I think it's `baremetal node manage UUID` `baremetal node provide UUID` | 08:25 |
| JayF | but I can find a doc | 08:25 |
| sylvr | gonna try this rn, I think I have an error when running one of these | 08:26 |
| JayF | https://docs.openstack.org/bifrost/latest/user/howto.html#enroll-hardware is instructions for doing it via the bifrost ansible | 08:26 |
| JayF | TBH I am not so much an expert on those bits as much as the underlying Ironic | 08:26 |
| JayF | yeah, that error will be key to getting in a good state | 08:27 |
| * dtantsur got a second of surprise to see JayF so early :D | 08:27 | |
| JayF | we won't move the nodes outta enroll if some config is messed up, or ironic can't talk to them | 08:27 |
| JayF | trying to get you the errors as early as possible :D | 08:27 |
| JayF | dtantsur: it's 9:30am, what are you talking about | 08:27 |
| * JayF yawns in jet lag | 08:27 | |
| JayF | don't worry, I will disappear into a swarm of meetings once johnthetubaguy and friends arrive :D | 08:28 |
| sylvr | well, running 'baremetal node manage UUID' don't seem to do anything | 08:29 |
| sylvr | but runniong 'baremetal node provide UUID' get me : The requested action "provide" can not be performed on node "UUID" while it is in state "enroll". (HTTP 400) | 08:29 |
| sylvr | btw, none of my idrac are getting IP address (they're waiting for a DHCP server to get IP) | 08:30 |
| JayF | so, we don't provide DHCP for the BMCs in this case | 08:32 |
| JayF | Most operators prefer to manage those pieces of the network; we only run DHCP servers when it's needed to provision machines specifically. | 08:32 |
| JayF | That's likely your problem -- you have to ensure those BMCs are IP'd and can generally respond to a "hello world" kind of query for Ironic to start managing them | 08:32 |
| JayF | if you get the BMCs online, Ironic should be able to take you thru the rest | 08:33 |
| JayF | after you run the `bm node manage ...` command, do a `bm node show ...` on that same node, and you may see something in the last_error field -- likely a timeout connecting to the drac | 08:33 |
| sylvr | Failed to validate power driver interface for node UUID. Error: Missing the following Redfish properties in node UUID driver_info: [ 'redfish_address'] | 08:37 |
| sylvr | okay, so redfish_address should be equal to the BMC address right ? it's in the OOB network ? | 08:37 |
| JayF | https://docs.openstack.org/ironic/latest/admin/drivers/idrac.html#protocol-specific-properties | 08:37 |
| JayF | you should be using the redfish style, not the wsman style (wsman is old; redfish is new and awesome) | 08:38 |
| JayF | that doc, and the one for the redfish driver linked, should have the information you need (if anything; too much information) | 08:38 |
| JayF | but to answer your specific question: yes, I believe so | 08:38 |
| JayF | I believe in a bifrost world, you'd put all those properties in the inventory and it'd probably get a lot further on it's own, but if you have an installed Ironic you can probably get to where you're going manually. | 08:39 |
| sylvr | okay, so just to be clear : the OOB network should have a DHCP for my BMC(idrac), ironic-inspector(and such) can communicate with the node using their BMC on the OOB network | 08:40 |
| sylvr | yeah I am using bifrost | 08:40 |
| JayF | well, DHCP is an implementation choice -- but yes, your BMC has to have a working address | 08:40 |
| JayF | Ironic also will, at a point further down than you are now, for some inspection and provisioning tasks, will boot a ramdisk agent on the machine | 08:41 |
| JayF | so we use the BMC in concert with in-band to get things working (in fact, probably 75% or more of our BMC interactions are around getting the machine to boot our agent) | 08:41 |
| sylvr | yeah okay, so the BMC is used to manage the BIOS, but the provisionning(and inspection maybe) is still done via PXEboot of the IPA | 08:43 |
| JayF | well, depending on driver, sometimes one or the other, sometimes both | 08:43 |
| sylvr | yeah okay ! | 08:43 |
| JayF | for an idrac, it'll be both | 08:43 |
| sylvr | My idrac are a bit old, this won't be an issue with redfish ? | 08:44 |
| JayF | if it's older, you might have to use idrac-wsman | 08:45 |
| JayF | but if at all possible, you wanna use the redfish version | 08:45 |
| JayF | I am not familiar enough with dell hardware to know where the line is, unfortunately | 08:45 |
| sylvr | hum... okay, well I'm going to provide IP address for my BMC, and I'll experiment to know what driver I should use | 08:46 |
| dtantsur | how old is a bit old? | 08:46 |
| sylvr | PowerEdge C6320 | 08:47 |
| dtantsur | I'm not familiar with models, what's the iDRAC version and its firmware version? | 08:48 |
| dtantsur | (its = iDRAC's) | 08:48 |
| sylvr | can I as you to proof read my (kayobe)network configuration to be sure that I'm not mistaking provision/inspect network ? | 08:48 |
| dtantsur | I think we're both unfamiliar with kayobe itself, but we can try | 08:49 |
| sylvr | I think idrac8 but I need to be sure (I don't know for sure but I expect some issue with redfish/wsman so I'll look out for that! | 08:50 |
| sylvr | thanks! | 08:50 |
| dtantsur | 8 should be okay, 7 probably won't work with redfish | 08:51 |
| sylvr | https://pastebin.com/vp70PEbz | 08:52 |
| dtantsur | sylvr: as I said, I'm not exactly familiar with this configuration, so I might be off, but it feels weird to me that inspection/cleaning networks match the OOB network, not the value of provision_oc_net_name | 08:53 |
| sylvr | yeah, that's exactly what I was unsure of | 08:54 |
| dtantsur | my intuition is that you should use mgnt there too | 08:54 |
| sylvr | yeah okay, that was my first thought too, but I tried changing things to see if it would help and fix my issues | 08:55 |
| sylvr | thank you all a lot! | 08:55 |
| JayF | No problem, good luck and we'll be here if you have any other questions. Just make sure to hang around, many of us have limited availability so happy to help but not always in this TZ | 09:10 |
| * JayF is usually PDT but in BST for the week | 09:10 | |
| JayF | Please have a look at https://review.opendev.org/c/openstack/ironic-specs/+/890164 -- I know cid may start implementing this soon, and it'd be very annoying if the design changed afterwards | 09:17 |
| JayF | also lots of low-hanging-fruit in https://review.opendev.org/q/hashtag:ironic-week-prio+status:open if someone has a few minutes | 09:17 |
| JayF | rpittau: you likely need to un-W-1 https://review.opendev.org/c/openstack/python-ironicclient/+/907094 as well fwiw, it's passing now | 09:19 |
| rpittau | JayF: yep, done | 09:20 |
| rpittau | I'm actually going through the prio list right now | 09:21 |
| opendevreview | Merged openstack/ironic-prometheus-exporter master: Fix codespell reported errors https://review.opendev.org/c/openstack/ironic-prometheus-exporter/+/920426 | 09:33 |
| opendevreview | Riccardo Pittau proposed openstack/bifrost master: Update supported Python versions https://review.opendev.org/c/openstack/bifrost/+/918029 | 09:37 |
| opendevreview | Merged openstack/sushy-tools master: Add virtual-media-boot to openstack driver https://review.opendev.org/c/openstack/sushy-tools/+/906768 | 10:01 |
| opendevreview | Merged openstack/python-ironicclient master: Fix functional test run https://review.opendev.org/c/openstack/python-ironicclient/+/907094 | 10:30 |
| opendevreview | Verification of a change to openstack/ironic-tempest-plugin master failed: Handle invalid configuration for vif test execution https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/919544 | 10:53 |
| * shajizad uploaded an image: (41KiB) < https://matrix.org/_matrix/media/v3/download/matrix.org/wttmUYHZGoiaoIpCGfXJlNoq/20240529_141033_3078507187978565396.jpg > | 11:10 | |
| opendevreview | Merged openstack/ironic master: Update front page of contributor guide https://review.opendev.org/c/openstack/ironic/+/920649 | 11:13 |
| iurygregory | rpittau, tks :D hopefully people will like the abstract :fingers crossed: | 11:22 |
| iurygregory | good morning Ironic | 11:26 |
| opendevreview | Merged openstack/ironic-python-agent master: Fix negative lookahead assertion syntax error https://review.opendev.org/c/openstack/ironic-python-agent/+/920280 | 11:30 |
| opendevreview | cid proposed openstack/ironic master: wip: Provision aarch64 fake-bare-metal-vms https://review.opendev.org/c/openstack/ironic/+/915441 | 11:50 |
| opendevreview | Merged openstack/ironic master: Add pre-commit configuration and docs https://review.opendev.org/c/openstack/ironic/+/917880 | 11:58 |
| sylvr | Hi again ! So I installed and configured a DHCP server on my oob network, my idrac are getting IP addresses, but running the command `baremetal node manage UUID` I get the following error (in last_error) : "Failed to validate power driver interface for node UUID. Error: Missing the following Redfish properties in node UUID driver_info: [ 'redfish_address']" | 12:22 |
| sylvr | baremetal node show UUID shows only "idrac" in driver, shouldn't it be idrac-redfish ? (as the recommanded driver is redfish) | 12:28 |
| dtantsur | sylvr: the driver name is the same for both protocols; bifrost only configures the redfish implementations | 12:38 |
| TheJulia | good morning | 13:07 |
| opendevreview | Julia Kreger proposed openstack/ironic master: WIP Advanced vmedia deployment test ops https://review.opendev.org/c/openstack/ironic/+/898010 | 13:27 |
| sylvr | dtantsur: thanks! maybe I should remove one then, my 3 drivers are idrac,ipmi and redfish | 13:31 |
| opendevreview | cid proposed openstack/ironic master: Flexible IPMI credential persistence method configuration https://review.opendev.org/c/openstack/ironic/+/917229 | 13:32 |
| dtantsur | sylvr: this list is okay, you just need to provide the correct fields for your nodes | 13:53 |
| dtantsur | the redfish part of https://docs.openstack.org/ironic/latest/admin/drivers/idrac.html#protocol-specific-properties | 13:54 |
| sylvr | dtantsur: I'm using kayobe and I didn't see the config for redfish, maybe I'm missing something (I assume this shouldn't be a manual step, as IPMI driver got the correct address) thanks for the links! | 13:57 |
| dtantsur | could be something missing from kayobe, mgoddard may know | 13:58 |
| sylvr | well, I need to check if my configs aren't missing files due to update, I think I'll ask tomorrow, thanks again ! | 14:05 |
| sylvr | also, I'm 99% sure that my iDRAC aren't supporting redfish, so I'll try the idrac-swman driver ^^ | 14:10 |
| TheJulia | sylvr: what version of idracs do you have? | 14:11 |
| JayF | CI is ARM'd and almost ready to go \o/ wtg cid https://usercontent.irccloud-cdn.com/file/hmG3WMil/image.png | 14:25 |
| JayF | hopefully that patch will be cleaned up for landing soon | 14:25 |
| TheJulia | wow that is far faster than I woudl have ever expected | 14:27 |
| JayF | I think it's only running a ping test | 14:30 |
| JayF | and I think he had to make the VM pretty big | 14:30 |
| TheJulia | still that is really fast | 14:30 |
| JayF | I haven't looked at it in detail yet; but am pretty thrilled to see a green | 14:30 |
| TheJulia | when I last tried to do emulated arm it was 2x slower than the host machine natively running | 14:30 |
| JayF | and from a cursory look at the logs it is a real-pass | 14:30 |
| rpittau | that's great! | 14:37 |
| TheJulia | Nice | 14:45 |
| TheJulia | 4GB ram, 2 CPUs | 14:45 |
| TheJulia | Yeah, that seems to be working just fine | 14:46 |
| TheJulia | ~105 seconds for the ramdisk to really get started after the transfer. Around the 140 second mark DHCP configuration achieved. The ramdisk continued to try networking on the other interface (uhhh.. what distro is this?!) and resumed booting around the 200 second mark | 14:49 |
| TheJulia | multi-user at 214 seconds. Looks lik the actual IPA start was super slow, didn't start logging its start until 296 seconds :( | 14:50 |
| TheJulia | Debian... I guess we should be mindful of that moving forward | 14:51 |
| opendevreview | Merged openstack/ironic master: Use specific element to detect database backend https://review.opendev.org/c/openstack/ironic/+/919749 | 15:09 |
| opendevreview | Julia Kreger proposed openstack/ironic master: WIP Advanced vmedia deployment test ops https://review.opendev.org/c/openstack/ironic/+/898010 | 15:23 |
| opendevreview | Merged openstack/ironic master: Fix some typo in servicing doc https://review.opendev.org/c/openstack/ironic/+/920323 | 15:40 |
| rpittau | good night! o/ | 16:02 |
| TheJulia | cid: great job, left review feedback on the two changes. I'm leaning towards just letting it run as non-voting to start so we can get some good deta points | 17:26 |
| cid | TheJulia: Ok. For a moment, I felt like I was on the moon when I saw a passing test | 17:28 |
| TheJulia | heh :) | 17:28 |
| cid | o/ | 20:41 |
| opendevreview | Julia Kreger proposed openstack/ironic-python-agent-builder master: WIP: Allow cloud-init? https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/920777 | 20:55 |
| opendevreview | Julia Kreger proposed openstack/ironic master: WIP Advanced vmedia deployment test ops https://review.opendev.org/c/openstack/ironic/+/898010 | 20:56 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!
