| rpittau | good morning ironic! Happy Friday! o/ | 08:11 |
|---|---|---|
| opendevreview | Riccardo Pittau proposed openstack/bifrost master: Fix disable-dhcp option in playbook https://review.opendev.org/c/openstack/bifrost/+/903135 | 09:08 |
| opendevreview | Riccardo Pittau proposed openstack/bifrost master: Update default ansible version https://review.opendev.org/c/openstack/bifrost/+/903136 | 09:15 |
| opendevreview | Riccardo Pittau proposed openstack/bifrost master: Use fully qualified name for ipaddr filter https://review.opendev.org/c/openstack/bifrost/+/903137 | 09:21 |
| dtantsur | sqlalchemy.exc.OperationalError: (pymysql.err.OperationalError) (1005, 'Can\\'t create table `ironic`.`firmware_information` (errno: 135 \"No more room in record file\")')", | 09:56 |
| dtantsur | WUT | 09:56 |
| dtantsur | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_6cc/902656/1/check/bifrost-integration-dhcp-ubuntu-jammy/6cc6c37/job-output.txt | 09:56 |
| dtantsur | also, we probably need to stop using debian until they fix their lshw https://fec6cf00b7d47efb90d8-f4e1e757f6e1e9727e757a7fa4b37fa7.ssl.cf5.rackcdn.com/902656/1/check/bifrost-integration-dibipa-debian-ubuntu-jammy/d9482d3/logs/testvm1_console.log | 09:57 |
| opendevreview | Dmitry Tantsur proposed openstack/bifrost master: Switch IPA building to Debian Bookworm https://review.opendev.org/c/openstack/bifrost/+/903162 | 10:04 |
| dtantsur | rpittau: ^^ not sure if you looked into bookworm previously | 10:04 |
| dtantsur | I wonder if we're going to hit https://bugs.launchpad.net/ironic-python-agent-builder/+bug/2043112 there | 10:06 |
| opendevreview | Dmitry Tantsur proposed openstack/ironic-python-agent-builder master: Switch IPA building to Debian Bookworm https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/903164 | 10:15 |
| opendevreview | Dmitry Tantsur proposed openstack/ironic-python-agent-builder master: Switch IPA building to Debian Bookworm https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/903164 | 10:15 |
| mnasiadka | Hello ironic | 10:37 |
| mnasiadka | Wondering if anybody has any clue why I get "Node 8d89761a-97e8-406c-ad1c-1b3d6319ff8b failed step {'interface': 'raid', 'step': 'create_configuration', 'abortable': False, 'priority': 0}: [] is too short"? | 10:38 |
| mnasiadka | ok, found the traceback in conductor logs, nevermind :) | 10:44 |
| dtantsur | mnasiadka: let us know what the cause was | 11:06 |
| dtantsur | even if it was your fault, I see an opportunity for improving the error message | 11:07 |
| mnasiadka | dtantsur: https://paste.opendev.org/show/bKEjAWhE9TcIDhNLdJPg/ | 11:18 |
| mnasiadka | Actually I don't really understand why it's failing (yet) ;-) | 11:19 |
| dtantsur | mnasiadka: a silly question, but do you actually have at least 1 logical disk? | 11:22 |
| dtantsur | because it thinks you have none | 11:22 |
| mnasiadka | in target_raid_config? yes | 11:23 |
| mnasiadka | target_raid_config | {'logical_disks': [{'size_gb': 'MAX', 'raid_level': '1', 'is_root_volume': True, 'controller': 'software', 'disk_type': 'ssd'}]} | 11:23 |
| mnasiadka | in raid_config - no, but that's the create step failing I assume | 11:23 |
| dtantsur | I wonder if the ilo driver passes something in a wrong way | 11:24 |
| dtantsur | Hold on, why do you end up using the ilo RAID for a software RAID? that's probably your issue. | 11:24 |
| dtantsur | mnasiadka: make sure you have raid_interface=agent on your node, not ilo | 11:24 |
| mnasiadka | and that makes sense now - thanks :) | 11:25 |
| dtantsur | Feel welcome to propose a patch to make the hardware drivers reject such configurations more explcitly | 11:25 |
| dtantsur | mnasiadka: ^^ | 11:26 |
| mnasiadka | Makes sense, maybe somewhere near the more calm christmas season ;) | 11:26 |
| dtantsur | Sure. Could you please file a bug at least? I'd expect this to be a common source of confusion. | 11:27 |
| mnasiadka | while I have your attention dtantsur - any idea why jobs are failing on https://review.opendev.org/c/openstack/ironic-python-agent/+/899883 ? :) | 11:27 |
| dtantsur | oh heck | 11:28 |
| dtantsur | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_616/899883/1/check/ipa-tempest-bios-ipmi-direct-src/6165e45/controller/logs/ironic-bm-logs/node-0_console.log.0 is a known eventlet bug | 11:29 |
| dtantsur | We had to fix it for our product, I'll ask downstream if anyone has a clue | 11:30 |
| * dtantsur steps back for a while | 11:31 | |
| rpittau | dtantsur: I had a quick look at bookworm, but never acted on it | 11:33 |
| rpittau | I'll keep an eye on your change | 11:35 |
| rpittau | wow big failures in bifrost ci | 13:20 |
| rpittau | or just bad timing | 13:20 |
| dtantsur | okay, at least IPA-builder looks good, that's a start | 13:33 |
| opendevreview | Dmitry Tantsur proposed openstack/bifrost master: Switch IPA building to Debian Bookworm https://review.opendev.org/c/openstack/bifrost/+/903162 | 13:35 |
| dtantsur | rpittau, JayF, okay, so it seems that IPA no longer works on CS8 (e.g. Yoga) because a CVE fix in Python 3.6 broke eventlet | 13:53 |
| dtantsur | I can report it to the eventlet upstream, but... eventlet upstream... | 13:53 |
| dtantsur | Should we try to switch the builder to a newer Python there? | 13:53 |
| dtantsur | was 3.9 supported in yoga? | 13:54 |
| dtantsur | (details: https://issues.redhat.com/browse/OCPBUGS-20486) | 13:55 |
| rpittau | it seems like python 3.9 is in the supported runtimes for yoga https://governance.openstack.org/tc/reference/runtimes/yoga.html, but not on CS8 | 14:04 |
| dtantsur | That's probably okay | 14:04 |
| dtantsur | Xena is out though | 14:04 |
| rpittau | we can give it a try, I mean py3.9 on CS8, although yoga is going soon into Unmaintained (should be there already actually) | 14:06 |
| dtantsur | mnasiadka: how important is it for you to fix yoga? | 14:13 |
| dtantsur | rpittau: meanwhile, I got told that debian backports have a newer lshw for bullseye | 14:28 |
| rpittau | cool | 14:29 |
| rpittau | so we can keep bullseye compatibility, but I guess it's worth moving the main job to bookworm | 14:29 |
| dtantsur | agreed | 14:29 |
| opendevreview | Dmitry Tantsur proposed openstack/ironic-python-agent-builder master: Fix building images for Bullseye and Bookworm https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/903175 | 14:41 |
| dtantsur | rpittau: trying ^^ | 14:41 |
| dtantsur | the default will be switched separately then | 14:41 |
| opendevreview | Dmitry Tantsur proposed openstack/bifrost master: Switch IPA building to Debian Bookworm https://review.opendev.org/c/openstack/bifrost/+/903162 | 14:46 |
| dtantsur | I've toned down my patches in the hope that the lshw from backports works | 14:47 |
| opendevreview | Dmitry Tantsur proposed openstack/ironic-python-agent-builder master: Switch IPA building to Debian Bookworm https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/903164 | 14:48 |
| opendevreview | Dmitry Tantsur proposed openstack/bifrost master: Support for Debian Bookworm https://review.opendev.org/c/openstack/bifrost/+/903177 | 14:52 |
| mnasiadka | dtantsur: well, I have that in my local fork, I build IPA from that, but if it would be in upstream - I could just download ipa instead of building it ;-) | 14:54 |
| opendevreview | Verification of a change to openstack/ironic master failed: devstack - enable v6 addr list if q-dhcp enabled https://review.opendev.org/c/openstack/ironic/+/893922 | 14:55 |
| opendevreview | Dmitry Tantsur proposed openstack/bifrost master: Support for Debian Bookworm https://review.opendev.org/c/openstack/bifrost/+/903177 | 14:58 |
| opendevreview | Riccardo Pittau proposed openstack/bifrost master: Fix disable-dhcp option in playbook https://review.opendev.org/c/openstack/bifrost/+/903135 | 15:10 |
| rpittau | bye everyone, have a great weekend! o/ | 15:43 |
| opendevreview | Maryna Savchenko proposed openstack/ironic master: Adding community images to always available ones prevents from not being able to retrieve rootfs_uuid from community images. https://review.opendev.org/c/openstack/ironic/+/903179 | 15:56 |
| dtantsur | reached failure state \"clean failed\"; the last error is Failed to prepare node 4e41df61-84b1-5856-bfb6-6b5f2cd3dd11 for cleaning: IPMI call failed: raw 0x00 0x08 0x05 0xa0 0x04 0x00 0x00 0x00." | 16:13 |
| dtantsur | who broke my virtualbmc? :) | 16:13 |
| dtantsur | Unable to send RAW command (channel=0x0 netfn=0x0 lun=0x0 cmd=0x8) | 16:14 |
| dtantsur | and what does this affect only dibipa jobs? | 16:16 |
| dtantsur | I seriously wonder if installing ipmitool in a chroot somehow affects IPMI usability on the host | 16:23 |
| opendevreview | Dmitry Tantsur proposed openstack/bifrost master: Enable IPMI debugging in the testing mode https://review.opendev.org/c/openstack/bifrost/+/903182 | 16:30 |
| opendevreview | Dmitry Tantsur proposed openstack/ironic master: Fix two severe errors in the firmware caching code https://review.opendev.org/c/openstack/ironic/+/903185 | 17:11 |
| dtantsur | This is pretty bad, I'd appreciate some urgent reviews ^^ | 17:11 |
| JayF | dtantsur: this even broke metal3 ci, and it was fixed in an incorrect way | 18:31 |
| JayF | dtantsur: like, it landed, metal3 ci broke, and I think it was fixed by making metal3 send the proper data instead of fixing Ironic to not error hard in the bad case | 18:31 |
| JayF | IIRC | 18:31 |
| JayF | but I couldn't ever put my finger on exactly *why* it was wrong | 18:32 |
| JayF | Heads up: https://review.opendev.org/c/openstack/releases/+/903199 Train+Ussuri are going to be retired as part of unmaintained branch work unless someone wants to pick up all of "T+U" support for openstack. | 18:36 |
| opendevreview | Merged openstack/networking-generic-switch stable/2023.1: Honor ngs_save_configuration setting when using batch commands https://review.opendev.org/c/openstack/networking-generic-switch/+/900884 | 18:48 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!