shermanm | so, I was trying out the `ipa-ntp-server` boot param to fix clock skew on a server, but it seems like the conductor is failing to verify TLS and shutting the server back down before the the ntp server gets a chance to run? I tried on a second server (that was already up to date), and it seemed like the ntp update happened towards the end of provisioning. | 00:02 |
---|---|---|
shermanm | Am I misunderstanding something, or is this not helpful for fixing an already-skewed clock? | 00:02 |
shermanm | edit: rather, it seems like there's some race between the initial time sync and the TLS cert generation, but I'll need to dig into which specific flavor of time sync we've got in our image. (kinda jumped the gun before debugging enough :) ) | 00:24 |
vsaienko | hello ironic community, can you please vote https://review.opendev.org/c/openstack/devstack/+/939578 patch enables atop installation by default, should help to debug performance issues and unstable ci | 07:57 |
opendevreview | Dmitry Tantsur proposed openstack/ironic bugfix/28.0: Pass agent token to get command results https://review.opendev.org/c/openstack/ironic/+/942060 | 08:02 |
opendevreview | Dmitry Tantsur proposed openstack/ironic bugfix/27.0: Pass agent token to get command results https://review.opendev.org/c/openstack/ironic/+/942061 | 08:03 |
opendevreview | Dmitry Tantsur proposed openstack/ironic bugfix/26.0: Pass agent token to get command results https://review.opendev.org/c/openstack/ironic/+/942062 | 08:03 |
rpittau | good morning ironic! o/ | 08:08 |
opendevreview | Riccardo Pittau proposed openstack/ironic master: Mention removing codespell job in bugfix branches https://review.opendev.org/c/openstack/ironic/+/942067 | 09:13 |
opendevreview | Riccardo Pittau proposed openstack/ironic bugfix/26.0: The codespell test is not supposed to run on bugfix branches https://review.opendev.org/c/openstack/ironic/+/942069 | 09:15 |
opendevreview | Dmitry Tantsur proposed openstack/ironic bugfix/26.0: Pass agent token to get command results https://review.opendev.org/c/openstack/ironic/+/942062 | 09:15 |
opendevreview | Merged openstack/ironic bugfix/27.0: Pass agent token to get command results https://review.opendev.org/c/openstack/ironic/+/942061 | 09:28 |
opendevreview | Verification of a change to openstack/ironic bugfix/28.0 failed: Pass agent token to get command results https://review.opendev.org/c/openstack/ironic/+/942060 | 09:45 |
opendevreview | Vasyl Saienko proposed openstack/networking-generic-switch master: Adds vlan aware VMs support for Cumulus NVUE and DellOS10 https://review.opendev.org/c/openstack/networking-generic-switch/+/940966 | 10:25 |
opendevreview | Merged openstack/ironic stable/2023.2: Pass agent token to get command results https://review.opendev.org/c/openstack/ironic/+/941917 | 10:53 |
opendevreview | Merged openstack/ironic bugfix/28.0: Pass agent token to get command results https://review.opendev.org/c/openstack/ironic/+/942060 | 11:02 |
mnasiadka | JayF: Vasyl made really great progress on NGS trunking patch (https://review.opendev.org/c/openstack/networking-generic-switch/+/928490) - we're still puzzled with what docs should be added - can you reply with some ,,requirements'' in Gerrit? | 13:09 |
*** tkajinam is now known as Guest9449 | 13:10 | |
opendevreview | Kaifeng Wang proposed openstack/ironic-python-agent-builder master: Change to maximum compression level when using lzma https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/940602 | 13:38 |
opendevreview | Julia Kreger proposed openstack/ironic-python-agent master: Lockout agent command results if a token is received https://review.opendev.org/c/openstack/ironic-python-agent/+/942010 | 14:32 |
opendevreview | Julia Kreger proposed openstack/ironic-python-agent master: Remove pre-victoria cycle agent token transition upgrade support https://review.opendev.org/c/openstack/ironic-python-agent/+/941565 | 14:35 |
opendevreview | Julia Kreger proposed openstack/ironic-python-agent master: Remove agent_token_required upgrade knob https://review.opendev.org/c/openstack/ironic-python-agent/+/941566 | 14:36 |
TheJulia | Hey folks, ironic/ipa is 3 small patches away from being able to support oci://urls by the agent for final asset streaming (at least, when not zstd compressed. https://review.opendev.org/c/openstack/ironic/+/941252 https://review.opendev.org/c/openstack/ironic-python-agent/+/941300 https://review.opendev.org/c/openstack/ironic-python-agent/+/941494 All of the patches have one +2 at this time. | 14:43 |
opendevreview | cid proposed openstack/ironic master: API/Testing: Inspection rules migration https://review.opendev.org/c/openstack/ironic/+/939217 | 14:59 |
opendevreview | cid proposed openstack/ironic master: [WIP] Follow-up to Inspection Rules https://review.opendev.org/c/openstack/ironic/+/942112 | 14:59 |
opendevreview | Verification of a change to openstack/ironic master failed: trivial: lock dnsmasq check to ubuntu https://review.opendev.org/c/openstack/ironic/+/941710 | 15:00 |
opendevreview | Merged openstack/ironic bugfix/26.0: The codespell test is not supposed to run on bugfix branches https://review.opendev.org/c/openstack/ironic/+/942069 | 15:02 |
TheJulia | stevebaker[m]: https://review.opendev.org/c/openstack/ironic/+/939191 2x+2. It would be awesome for some further clarity around auth and and maybe some theory level of doc at some point in the admin guide to provide a clear picture, but as-is LGTM. | 15:27 |
TheJulia | Some nits though, but fine to follow-up. :) | 15:27 |
JayF | I had a question on that I never sent through | 15:47 |
JayF | don't let it be considered blocking, I'm just curious | 15:47 |
* JayF found it in drafts when he clicked the link | 15:47 | |
opendevreview | Merged openstack/ironic stable/2024.1: ci: automatically set the branch for IPA to match TARGET_BRANCH https://review.opendev.org/c/openstack/ironic/+/941920 | 15:49 |
-opendevstatus- NOTICE: nominations for the OpenStack PTL and TC positions are closing soon, for details see https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/message/7DKEV7IEHOTHED7RVEFG7WIDVUC4MY3Z/ | 15:58 | |
opendevreview | Merged openstack/ironic stable/2023.2: ci: automatically set the branch for IPA to match TARGET_BRANCH https://review.opendev.org/c/openstack/ironic/+/941921 | 16:00 |
opendevreview | Merged openstack/ironic master: OCI: Send the auth header to IPA https://review.opendev.org/c/openstack/ironic/+/941252 | 16:03 |
shermanm | hey, I wanted to ask if anyone else had a use for a NGS feature we're working on internally; using vlan translation to use a switch as a "l2gw" between some neutron-managed vlan network, and some externally managed provider vlan, so we can separate the lifecycles of each | 16:17 |
opendevreview | Julia Kreger proposed openstack/ironic master: deprecate shellinabox https://review.opendev.org/c/openstack/ironic/+/942124 | 16:20 |
TheJulia | shermanm: seems interesting to upstream, not sure if anyone has a use for it directly at the moment, but perhaps in the future | 16:30 |
opendevreview | Julia Kreger proposed openstack/ironic master: deprecate shellinabox https://review.opendev.org/c/openstack/ironic/+/942124 | 16:35 |
rpittau | good night! o/ | 16:50 |
TheJulia | JayF: w/r/t https://review.opendev.org/c/openstack/ironic/+/942124 I feel like it might need to be 2026.1 at the earliest but I've lost track of that model and where we are. | 17:28 |
cardoe | shermanm: so like VLAN remapping? | 17:43 |
shermanm | Cardoe: exactly, the underlying implementation in our case is vlan translation in a juniper switch, just working out what kind of API is sane to wrap around it | 17:48 |
TheJulia | framing it that way, people might be totally on board for such a capability becuase I know one of the huge giant nightmare problems is the concept neutron has that it is the network infrastucture owner | 17:51 |
TheJulia | which is... laughable | 17:51 |
TheJulia | but... its the world they live in | 17:51 |
TheJulia | With baremetal, we live in a different world revolving around kWh | 17:52 |
shermanm | For us, we had initially statically configured these external networks as provider networks, but it became frustrating for us to manage as it got more dynamic, and frustrating for end users who'd need to rebuild / reattach instances to new ones as vlan ids changed. We solved our frustration by wrapping an API around "create a specific provider net for me", but it's still fairly brittle | 17:57 |
cardoe | shermanm: yeah so literally working on that right now as well. | 17:59 |
cardoe | But with our VXLAN setup. | 17:59 |
cardoe | So I've only really cared about the trunking side. | 17:59 |
cardoe | So when the user creates a subport and they specify their segmentation-id. We set that as the user visible VLAN. | 18:01 |
shermanm | In some ways I think we only need the most minimal case, because it's restricted to a 1-1 connection between internal vlan net, and external vlan id. | 18:06 |
shermanm | But I'd love to also support vlan trunks and vxlan, it's been on our wishlist. | 18:07 |
shermanm | When brainstorming, I was looking at extending networking-l2gw to support vlan-vlan, instead of only vxlan-vlan, just because it already modeled the " l2 gateway" idea, and then plumbing into NGS to execute the "l2gw create/update/delete...." operations | 18:09 |
cardoe | Yeah I guess I need to look at the l2gw bits some more. | 18:10 |
TheJulia | Regarding networking: some more reviews on https://review.opendev.org/c/openstack/ironic/+/941343 would be appreciated | 18:17 |
JayF | TheJulia: My thought was: you must have at least 1 SLURP release with it deprecated before it can be removed. I think that means we could pull it in 2025.2 since from a SLURP perspective: 2025.1 deprecated it; 2026.1 removed it. | 18:19 |
TheJulia | wfm | 18:19 |
TheJulia | I'll rev it | 18:19 |
* JayF commented that in gerrit, too | 18:20 | |
JayF | it gets funky with .2, e.g. if we deprecated in 2025.2 we couldn't remove until 2026.2 (the deprecation has to hit a SLURP release) | 18:21 |
opendevreview | Julia Kreger proposed openstack/ironic master: deprecate shellinabox https://review.opendev.org/c/openstack/ironic/+/942124 | 18:25 |
JayF | +2 | 18:30 |
TheJulia | wheee, do a thing, find a bug | 18:43 |
opendevreview | Merged openstack/ironic-python-agent master: oci: Enable embedded authentication passing https://review.opendev.org/c/openstack/ironic-python-agent/+/941300 | 19:22 |
opendevreview | Verification of a change to openstack/ironic-python-agent master failed: oci: permit an 'unknown' but valid image https://review.opendev.org/c/openstack/ironic-python-agent/+/941494 | 19:22 |
opendevreview | Julia Kreger proposed openstack/ironic master: centos devstack support: fix VM permissions https://review.opendev.org/c/openstack/ironic/+/942134 | 19:31 |
opendevreview | Julia Kreger proposed openstack/ironic master: Don't log PXE when your not doing PXE. https://review.opendev.org/c/openstack/ironic/+/942135 | 19:31 |
opendevreview | Doug Goldstein proposed openstack/sushy master: migrate sushy_oem_idrac to sushy https://review.opendev.org/c/openstack/sushy/+/940557 | 19:35 |
opendevreview | Doug Goldstein proposed openstack/sushy master: fix extension loading test to use correct namespace https://review.opendev.org/c/openstack/sushy/+/942136 | 19:35 |
opendevreview | Doug Goldstein proposed openstack/sushy master: fix extension loading test to use correct namespace https://review.opendev.org/c/openstack/sushy/+/942136 | 19:36 |
opendevreview | Doug Goldstein proposed openstack/sushy master: migrate sushy_oem_idrac to sushy https://review.opendev.org/c/openstack/sushy/+/940557 | 19:36 |
stevebaker[m] | good morning | 20:07 |
stevebaker[m] | TheJulia: cool thanks. I've added a todo to write some context docs. Could we maybe +1 that change? | 20:10 |
TheJulia | stevebaker[m]: you mean workflow it? | 20:11 |
stevebaker[m] | ya | 20:11 |
TheJulia | Any objections out there in IRC land to beginning to workflow graphical console work?! | 20:15 |
* TheJulia suspects the folks who care have chimed in already ;) | 20:16 | |
TheJulia | (besides, need to start getting stuff merged anyway) | 20:16 |
JayF | 🛬 | 20:41 |
TheJulia | heh | 20:57 |
cardoe | Go for it. | 20:57 |
cardoe | Land my first commit in the hooks stuff to fix the crasher in preprocess() of a hook. | 20:58 |
cardoe | https://review.opendev.org/c/openstack/ironic/+/940332 that guy | 20:59 |
TheJulia | a crasher() you say? ;) | 21:01 |
TheJulia | Is this a feature ?! Inquiring minds want to know ;) | 21:01 |
cardoe | Well if you throw an exception of any kind, we attempt to log it but our logger line is wrong. So conductor then itself hits an exception. | 21:08 |
cardoe | I added more test coverage when I moved the code around and hit it. | 21:08 |
cardoe | Same way the merging of the idrac code into sushy is exposing badness in the sushy tests. | 21:08 |
JayF | I'm sorry, but we can't remove the spacebar heating feature without leaving a toggle /s https://xkcd.com/1172/ | 21:09 |
TheJulia | JayF: don't tell one of my neighbors, her thing is heated mouses and keyboards | 21:13 |
TheJulia | cardoe: shouldn't there be a test on https://review.opendev.org/c/openstack/ironic/+/940333/ ? | 21:26 |
cardoe | That's fair. I'll add one. | 21:30 |
cardoe | The more concerning one to me was the crasher that causes conductor to bail out and cleaning up the node is less than fun. | 21:31 |
opendevreview | cid proposed openstack/ironic master: [WIP] Follow-up to Inspection Rules https://review.opendev.org/c/openstack/ironic/+/942112 | 21:34 |
opendevreview | cid proposed openstack/ironic master: API/Testing: Inspection rules migration https://review.opendev.org/c/openstack/ironic/+/939217 | 21:34 |
opendevreview | Merged openstack/ironic master: OVN UEFI IPv6 CI job https://review.opendev.org/c/openstack/ironic/+/941352 | 21:46 |
JayF | Did someone (rpittau?) sign up Ironic for the PTG? | 21:50 |
opendevreview | Satoshi Shirosaka proposed openstack/ironic-python-agent master: Missing 'interface' in Clean Step https://review.opendev.org/c/openstack/ironic-python-agent/+/942152 | 21:57 |
TheJulia | JayF: he said he was going to | 22:16 |
JayF | okay cool, just checking since the last call just went out | 22:17 |
TheJulia | cardoe: yeah, fair enough as well :) | 22:17 |
JayF | and that often is a "next PTL" thing :D | 22:17 |
TheJulia | yup | 22:17 |
TheJulia | lets see, where did I put my brain | 22:17 |
JayF | I just had roofers arrive 15 minutes ago and start cleaning off my roof, and it's the loudest thing ever | 22:19 |
JayF | I'm saying, your brain might be having a party with my attention somewhere three towns over | 22:19 |
opendevreview | cid proposed openstack/ironic master: [WIP] Follow-up to Inspection Rules https://review.opendev.org/c/openstack/ironic/+/942112 | 22:29 |
opendevreview | cid proposed openstack/ironic master: API/Testing: Inspection rules migration https://review.opendev.org/c/openstack/ironic/+/939217 | 22:29 |
TheJulia | Ugh, roofers | 22:30 |
opendevreview | Verification of a change to openstack/ironic master failed: Add ironic-novncproxy service https://review.opendev.org/c/openstack/ironic/+/939191 | 22:34 |
cardoe | well... nova.exception.ValidationError: Ironic node: 90b75aae-bd7b-4ad8-98f0-230968738d2c failed to validate. (deploy: Image 5c54ce37-0d26-4c0a-9704-f8791c590eaa is missing the following properties: stage2_id, power: No Error, storage: No Error) with my patch to nova | 22:51 |
cardoe | Even though that image has "stage2_id" on it. | 22:51 |
JayF | I wonder if the user nova is using to call glance can see it | 22:51 |
cardoe | All of the pieces were created at the same time by the same user. | 22:53 |
cardoe | The owner is the same for them all and they're all shared. | 22:53 |
cardoe | But more debugging | 22:53 |
opendevreview | Doug Goldstein proposed openstack/sushy master: fix extension loading test to use correct namespace https://review.opendev.org/c/openstack/sushy/+/942136 | 23:08 |
opendevreview | Doug Goldstein proposed openstack/sushy master: migrate sushy_oem_idrac to sushy https://review.opendev.org/c/openstack/sushy/+/940557 | 23:08 |
cardoe | I guess that needs a release note... and I also need to figure out the right way for OpenStack to express an install conflict. | 23:15 |
opendevreview | Doug Goldstein proposed openstack/sushy master: fix extension loading test to use correct namespace https://review.opendev.org/c/openstack/sushy/+/942136 | 23:20 |
opendevreview | Doug Goldstein proposed openstack/sushy master: migrate sushy_oem_idrac to sushy https://review.opendev.org/c/openstack/sushy/+/940557 | 23:20 |
cardoe | hrmmm that extension loading mock is still behaving oddly. | 23:33 |
opendevreview | Merged openstack/ironic master: move hooks execution into shareable module https://review.opendev.org/c/openstack/ironic/+/940332 | 23:36 |
opendevreview | Doug Goldstein proposed openstack/sushy master: fix extension loading test to use correct namespace https://review.opendev.org/c/openstack/sushy/+/942136 | 23:36 |
opendevreview | Doug Goldstein proposed openstack/sushy master: migrate sushy_oem_idrac to sushy https://review.opendev.org/c/openstack/sushy/+/940557 | 23:36 |
cardoe | Like I don't get how that test ever passed. | 23:37 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!