| *** k_mouza has quit IRC | 00:04 | |
| *** rloo has quit IRC | 00:04 | |
| *** tzumainn has quit IRC | 00:17 | |
| openstackgerrit | xinliang proposed openstack/ironic-python-agent-builder master: Fix build error on aarch64 https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/788388 | 00:52 |
|---|---|---|
| *** bfournie has joined #openstack-ironic | 00:53 | |
| openstackgerrit | xinliang proposed openstack/ironic-python-agent-builder master: Fix build error on aarch64 https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/788388 | 01:24 |
| *** zzzeek has quit IRC | 02:56 | |
| *** zzzeek has joined #openstack-ironic | 03:04 | |
| *** zzzeek has quit IRC | 03:10 | |
| *** zzzeek has joined #openstack-ironic | 03:11 | |
| *** zzzeek has quit IRC | 03:20 | |
| *** zzzeek has joined #openstack-ironic | 03:21 | |
| *** zzzeek has quit IRC | 03:23 | |
| *** zzzeek has joined #openstack-ironic | 03:26 | |
| *** rcernin has quit IRC | 03:32 | |
| *** mkrai has joined #openstack-ironic | 03:35 | |
| *** rcernin has joined #openstack-ironic | 03:42 | |
| *** rcernin has quit IRC | 03:42 | |
| *** rcernin has joined #openstack-ironic | 03:42 | |
| *** k_mouza has joined #openstack-ironic | 03:45 | |
| *** k_mouza has quit IRC | 03:49 | |
| *** mkrai_ has joined #openstack-ironic | 04:13 | |
| *** mkrai has quit IRC | 04:16 | |
| *** k_mouza has joined #openstack-ironic | 05:46 | |
| *** k_mouza has quit IRC | 05:51 | |
| *** mkrai_ has quit IRC | 06:27 | |
| *** jhesketh has quit IRC | 06:28 | |
| arne_wiebalck | Good morning, ironic! | 06:54 |
| *** rpittau|afk is now known as rpittau | 07:05 | |
| rpittau | good morning ironic! o/ | 07:05 |
| rpittau | Happy Friday! | 07:05 |
| rpittau | NobodyCam, iurygregory, the local.conf example has been recently updated to run on ubuntu focal (and other distro) https://docs.openstack.org/ironic/latest/contributor/dev-quickstart.html | 07:09 |
| *** gyee has quit IRC | 07:13 | |
| iurygregory | good morning arne_wiebalck rpittau and Ironic o/ | 07:30 |
| rpittau | hey iurygregory :) | 07:31 |
| arne_wiebalck | hey iurygregory and rpittau o/ | 07:31 |
| rpittau | hey arne_wiebalck :) | 07:31 |
| iurygregory | rpittau, I totally forgot you changed the local.conf (sorry) | 07:31 |
| rpittau | iurygregory: hey no worries! :) | 07:32 |
| *** rcernin has quit IRC | 07:34 | |
| *** k_mouza has joined #openstack-ironic | 07:48 | |
| *** tosky has joined #openstack-ironic | 07:48 | |
| *** k_mouza has quit IRC | 07:52 | |
| *** ociuhandu has joined #openstack-ironic | 07:53 | |
| *** dtantsur|afk is now known as dtantsur | 07:58 | |
| dtantsur | morning ironic | 07:58 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-python-agent master: [DNM] Try very long write_image https://review.opendev.org/c/openstack/ironic-python-agent/+/790205 | 08:00 |
| iurygregory | morning dtantsur | 08:02 |
| *** lucasagomes has joined #openstack-ironic | 08:02 | |
| *** dansmith has quit IRC | 08:08 | |
| *** ociuhandu has quit IRC | 08:09 | |
| *** dansmith has joined #openstack-ironic | 08:09 | |
| *** ociuhandu has joined #openstack-ironic | 08:09 | |
| *** rcernin has joined #openstack-ironic | 08:16 | |
| *** derekh has joined #openstack-ironic | 08:22 | |
| *** rcernin has quit IRC | 08:22 | |
| *** ociuhandu has quit IRC | 08:25 | |
| *** rcernin has joined #openstack-ironic | 08:32 | |
| *** xinliang has joined #openstack-ironic | 08:32 | |
| *** rcernin has quit IRC | 08:37 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: Fix deployment when executing a command fails after the command starts https://review.opendev.org/c/openstack/ironic/+/790210 | 08:40 |
| *** hjensas|afk is now known as hjensas | 08:41 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-python-agent master: [DNM] Try very long write_image https://review.opendev.org/c/openstack/ironic-python-agent/+/790205 | 08:43 |
| dtantsur | fun ^^^ | 08:44 |
| iurygregory | define fun... | 08:45 |
| iurygregory | import time, time.sleep(60)... | 08:48 |
| iurygregory | :D | 08:48 |
| dtantsur | :) | 08:49 |
| dtantsur | this is pretty much a simulation of the issue we see | 08:49 |
| iurygregory | yeah =) | 08:49 |
| iurygregory | I would set a higher time like 4 to 5 min | 08:50 |
| *** ociuhandu has joined #openstack-ironic | 08:50 | |
| dtantsur | we have a read timeout of 60 seconds | 08:57 |
| dtantsur | on the ironic side | 08:57 |
| iurygregory | oh ok, makes sense =) | 08:57 |
| *** jhesketh has joined #openstack-ironic | 09:01 | |
| *** mkrai has joined #openstack-ironic | 09:06 | |
| *** rcernin has joined #openstack-ironic | 09:06 | |
| *** rcernin has quit IRC | 09:11 | |
| arne_wiebalck | Is there a way to leave the node powered on after a (successful) manual clean step? | 09:34 |
| janders | SPUC anyone? :) https://redhat.bluejeans.com/772893798 | 10:01 |
| rpittau | janders: not today, I'm following KubeCon :/ | 10:17 |
| iurygregory | I'm having lunch now (forgot that spuc was at 12) | 10:18 |
| *** k_mouza has joined #openstack-ironic | 10:19 | |
| janders | no worries - another time! :) | 10:20 |
| *** ociuhandu has quit IRC | 10:34 | |
| *** ociuhandu_ has joined #openstack-ironic | 10:34 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-python-agent master: [DNM] Try very long write_image https://review.opendev.org/c/openstack/ironic-python-agent/+/790205 | 10:43 |
| *** xinliang has quit IRC | 10:54 | |
| arne_wiebalck | janders: sorry, was at lunch! | 10:57 |
| *** mkrai has quit IRC | 10:59 | |
| *** mkrai_ has joined #openstack-ironic | 10:59 | |
| janders | arne_wiebalck no worries | 11:12 |
| janders | have a great weekend Ironic, see you next week o/ | 11:12 |
| iurygregory | bye janders o/ have a great weekend | 11:13 |
| arne_wiebalck | bye janders o/ | 11:13 |
| rpittau | bye janders :) | 11:16 |
| *** mkrai_ has quit IRC | 11:19 | |
| *** rcernin has joined #openstack-ironic | 11:29 | |
| janders | thank you iurygregory arne_wiebalck rpittau, you too! | 11:30 |
| *** rcernin has quit IRC | 11:34 | |
| dtantsur | o/ | 11:35 |
| *** rcernin has joined #openstack-ironic | 11:50 | |
| *** rcernin has quit IRC | 11:55 | |
| *** cenne is now known as cenn | 11:59 | |
| *** uzumaki has joined #openstack-ironic | 12:08 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-python-agent master: [DNM] Try very long write_image https://review.opendev.org/c/openstack/ironic-python-agent/+/790205 | 12:13 |
| *** k_mouza has quit IRC | 12:21 | |
| *** k_mouza has joined #openstack-ironic | 12:22 | |
| *** ociuhandu_ has quit IRC | 12:30 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: Fix deployment when executing a command fails after the command starts https://review.opendev.org/c/openstack/ironic/+/790210 | 12:40 |
| *** rloo has joined #openstack-ironic | 13:01 | |
| dtantsur | JayF: we're seeing something awkward, potentially related to TLS and eventlet: https://bugzilla.redhat.com/show_bug.cgi?id=1957976#c7. Does it ring any bells? | 13:10 |
| openstack | bugzilla.redhat.com bug 1957976 in Bare Metal Hardware Provisioning "Ironic deploy_steps command to ramdisk has connection error, resulting in a failed deployment" [Urgent,Assigned] - Assigned to dtantsur | 13:10 |
| *** ociuhandu has joined #openstack-ironic | 13:10 | |
| *** hjensas has quit IRC | 13:18 | |
| *** k_mouza_ has joined #openstack-ironic | 13:19 | |
| *** paras333 has joined #openstack-ironic | 13:20 | |
| *** ociuhandu has quit IRC | 13:21 | |
| *** k_mouza has quit IRC | 13:23 | |
| *** k_mouza has joined #openstack-ironic | 13:24 | |
| *** k_mouza_ has quit IRC | 13:27 | |
| *** ociuhandu has joined #openstack-ironic | 13:33 | |
| *** hjensas has joined #openstack-ironic | 13:36 | |
| *** tzumainn has joined #openstack-ironic | 13:40 | |
| *** ociuhandu has quit IRC | 13:41 | |
| *** rh-jelabarre has joined #openstack-ironic | 13:44 | |
| *** mkowalski has joined #openstack-ironic | 13:44 | |
| *** paras333 has quit IRC | 13:52 | |
| *** ociuhandu has joined #openstack-ironic | 13:54 | |
| *** paras333 has joined #openstack-ironic | 13:55 | |
| *** ociuhandu has quit IRC | 13:58 | |
| *** paras333 has quit IRC | 13:58 | |
| *** rcernin has joined #openstack-ironic | 14:08 | |
| *** VoochkO has joined #openstack-ironic | 14:08 | |
| VoochkO | hello there, I am new here | 14:09 |
| dtantsur | hi VoochkO, welcome | 14:10 |
| VoochkO | I have opened recently an issue here: http://lists.openstack.org/pipermail/openstack-discuss/2021-April/021539.html | 14:10 |
| VoochkO | still fighting with that. tried from another server which is different type and actually noticed that problem starts when I try to load initrd that comes with IPA | 14:11 |
| VoochkO | so Grub command "initrd /initrd-of-ipa" starts and blocks | 14:12 |
| dtantsur | VoochkO: sorry if it's a silly question: does it die completely or just progresses REALLY slowly? | 14:13 |
| VoochkO | nope it just freezes with brack screen and one static red cursor on the left side | 14:13 |
| *** rcernin has quit IRC | 14:13 | |
| VoochkO | and stays like that forever | 14:14 |
| dtantsur | okay, Julia already asked about secure boot.. and given that you get to booting the initrd, we can rule out grub | 14:15 |
| dtantsur | I assume normal operating systems boot on your machines? | 14:15 |
| VoochkO | so if I go to Grub prompt i can load the kernel with "linux" command successfully and after that I try to load initrd with "initrd" command and this is where it freezes. I can not come to position to type "boot" command | 14:15 |
| dtantsur | oh | 14:15 |
| VoochkO | if I boot before "initrd" it starts but I get kernel panic as it does not find root dev | 14:16 |
| dtantsur | right | 14:16 |
| VoochkO | I am going not to try another initramfs or initrd (not IPA one) to see if the same thing happens with it. | 14:17 |
| VoochkO | btw. the same server has already normal ubuntu installed | 14:17 |
| VoochkO | but it was done manually, not via ironic | 14:18 |
| dtantsur | VoochkO: I'm looking at your node, and it doesn't have boot_mode:uefi in capabilities. Do you set default_boot_mode=uefi in ironic.conf? | 14:18 |
| VoochkO | I think yes, let me check | 14:18 |
| dtantsur | VoochkO: furthermore, it looks like the iLO driver has its own boot mode setting [ilo]default_boot_mode | 14:20 |
| dtantsur | I don't remember if both are needed, try setting both | 14:20 |
| VoochkO | # uefi - UEFI boot mode | 14:21 |
| VoochkO | # bios - Legacy BIOS boot mode | 14:21 |
| VoochkO | # Note: This option can be changed without restarting. | 14:21 |
| VoochkO | #default_boot_mode = bios | 14:21 |
| VoochkO | auch, it seems it tries bios by default, I did not notice that | 14:21 |
| VoochkO | but ilo has as default "auto" | 14:22 |
| VoochkO | # Possible values: | 14:22 |
| VoochkO | # auto - based on boot mode settings on the system | 14:22 |
| VoochkO | # bios - BIOS boot mode | 14:22 |
| VoochkO | # uefi - UEFI boot mode | 14:22 |
| VoochkO | #default_boot_mode = auto | 14:22 |
| *** ociuhandu has joined #openstack-ironic | 14:23 | |
| rpittau | VoochkO: that will probably be set to bios | 14:24 |
| *** rcernin has joined #openstack-ironic | 14:25 | |
| *** ociuhandu has quit IRC | 14:26 | |
| *** ociuhandu has joined #openstack-ironic | 14:26 | |
| rpittau | bye everyone! have a great weekend! o/ | 14:28 |
| *** rpittau is now known as rpittau|afk | 14:29 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: Fix deployment when executing a command fails after the command starts https://review.opendev.org/c/openstack/ironic/+/790210 | 14:29 |
| *** rcernin has quit IRC | 14:30 | |
| iurygregory | bye rpittau|afk o/ | 14:30 |
| *** k_mouza_ has joined #openstack-ironic | 14:35 | |
| *** k_mouza_ has quit IRC | 14:38 | |
| *** k_mouza_ has joined #openstack-ironic | 14:38 | |
| *** k_mouza__ has joined #openstack-ironic | 14:39 | |
| *** k_mouza has quit IRC | 14:40 | |
| *** rcernin has joined #openstack-ironic | 14:41 | |
| *** k_mouza_ has quit IRC | 14:43 | |
| VoochkO | rpittau|afk just corrected the boot mode, but it is the same thing | 14:44 |
| VoochkO | it blocks on initrd | 14:44 |
| VoochkO | I have checked in logs, ilo was correctly detecting uefi mode on the server, so my previous attempts were all uefi | 14:45 |
| iurygregory | maybe a bad image? | 14:45 |
| *** rcernin has quit IRC | 14:46 | |
| VoochkO | iurygregory I get the same with existing images from : https://tarballs.opendev.org/openstack/ironic-python-agent/dib/files/ | 14:48 |
| VoochkO | will now try with generic kernel and initramfs images | 14:48 |
| *** k_mouza__ has quit IRC | 14:49 | |
| *** k_mouza has joined #openstack-ironic | 14:50 | |
| iurygregory | I'm not 100% sure, but I think iLO servers would need to build the ramdisk to have proliantutils etc | 14:52 |
| iurygregory | I don't think the one in tarballs have that by default... | 14:53 |
| dtantsur | proliantutils are not required by default, only for certain features | 15:00 |
| dtantsur | I'd recommend at least setting default_boot_mode=uefi in both places (and restarting ironic-conductor) | 15:01 |
| dtantsur | even if the machine does know it uses UEFI, ironic does not. and ironic needs to prepare ISO images correctly. | 15:01 |
| JayF | dtantsur: the mode of failure is identical to the other TLS/eventlet stuff I was tackling in IPA when getting TLS working | 15:05 |
| JayF | dtantsur: well, at least one of them... | 15:06 |
| dtantsur | interesting | 15:06 |
| JayF | check eventlet versions | 15:06 |
| JayF | in that install vs in ci | 15:06 |
| JayF | as well as oslo.service | 15:06 |
| dtantsur | it's very likely that we're using an older eventlet | 15:06 |
| JayF | if it's older than lower-constraints (was) when I tested this | 15:06 |
| JayF | then you're 100% the winner | 15:06 |
| JayF | because if you remember, I had to raise the lower-constraint | 15:06 |
| JayF | to avoid this problem in particular | 15:07 |
| dtantsur | le sigh | 15:07 |
| JayF | If I had an open source time machine, to fix one openstack decision | 15:07 |
| JayF | it would be using eventlet | 15:07 |
| dtantsur | absolutely | 15:08 |
| VoochkO | @dtan | 15:21 |
| VoochkO | dtantsur JayF iurygregory I can now confirm that generic kernel and initrd from Ubuntu Bionic are booting correctly | 15:22 |
| JayF | Please don't ping me directly; I will help with troubleshooting if I'm around and it's something I'm able to help with. | 15:22 |
| dtantsur | It's interesting, we don't really change initramfs THAT substantially | 15:23 |
| VoochkO | so if I use those images and do "openstack baremetal node provide" it boots | 15:23 |
| VoochkO | sorry Jay, I was just replying | 15:23 |
| dtantsur | I wonder if we get overly eager with removing firmware.. do you have anything from this list https://opendev.org/openstack/ironic-python-agent-builder/src/branch/master/dib/ironic-python-agent-ramdisk/environment.d/10-defaults.bash? | 15:24 |
| dtantsur | unlikely, but who knows | 15:25 |
| dtantsur | VoochkO: you may need to tune [ilo]kernel_append_params to enable maximum logging from the kernel | 15:25 |
| VoochkO | It is an AMD server, but not sure about AMD GPU module "amdgpu" | 15:27 |
| VoochkO | it is HPE DL325 Gen10+, will check later if it is having any dependency on that gpu | 15:27 |
| VoochkO | other things are some wifi and exotic stuff that I do not have for sure! | 15:28 |
| VoochkO | will try with maximum logging and will check for amdgpu and will report back | 15:29 |
| VoochkO | but thanks for the support so far! it seems to be lively community and I am happy to engage. happy weekend to all! | 15:29 |
| *** VoochkO has quit IRC | 15:30 | |
| arne_wiebalck | Is there a way to leave the node powered on after (successful) manual cleaning? | 15:35 |
| NobodyCam | Good Morning Ironic'ers | 15:36 |
| NobodyCam | and ofc ... | 15:36 |
| NobodyCam | TGIF | 15:36 |
| NobodyCam | why does our Devstack integration not respect `DOWNLOAD_DEFAULT_IMAGES=False` | 15:37 |
| *** bnemec has quit IRC | 15:42 | |
| *** bnemec has joined #openstack-ironic | 15:43 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: Fix deployment when executing a command fails after the command starts https://review.opendev.org/c/openstack/ironic/+/790210 | 15:51 |
| *** gyee has joined #openstack-ironic | 15:56 | |
| *** lucasagomes has quit IRC | 16:07 | |
| NobodyCam | rpittau|afk: Awesome Thank you! | 16:20 |
| arne_wiebalck | bye everyone, have a good weekend o/ | 16:22 |
| NobodyCam | have a good weekend arne_wiebalck | 16:22 |
| *** ociuhandu_ has joined #openstack-ironic | 16:30 | |
| openstackgerrit | Merged openstack/ironic-python-agent-builder master: Fix build error on aarch64 https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/788388 | 16:32 |
| *** ociuhandu has quit IRC | 16:33 | |
| *** ociuhandu_ has quit IRC | 16:35 | |
| cenn | bye arne_wienbalk | 16:39 |
| *** ociuhandu has joined #openstack-ironic | 16:42 | |
| *** rcernin has joined #openstack-ironic | 16:42 | |
| *** rcernin has quit IRC | 16:47 | |
| *** ociuhandu has quit IRC | 16:48 | |
| * dtantsur has no clue what DOWNLOAD_DEFAULT_IMAGES is | 16:50 | |
| dtantsur | but hi NobodyCam, TGIF indeed | 16:50 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic stable/wallaby: Fix deployment when executing a command fails after the command starts https://review.opendev.org/c/openstack/ironic/+/790282 | 17:02 |
| *** derekh has quit IRC | 17:03 | |
| *** k_mouza_ has joined #openstack-ironic | 17:04 | |
| *** k_mouza has quit IRC | 17:06 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic stable/victoria: Fix deployment when executing a command fails after the command starts https://review.opendev.org/c/openstack/ironic/+/790283 | 17:07 |
| *** dtantsur is now known as dtantsur|afk | 17:12 | |
| dtantsur|afk | o/ | 17:12 |
| NobodyCam | Night dtantsur|afk \o | 17:18 |
| *** k_mouza_ has quit IRC | 17:30 | |
| *** k_mouza has joined #openstack-ironic | 17:30 | |
| *** dsneddon has quit IRC | 17:34 | |
| *** k_mouza has quit IRC | 17:37 | |
| *** VoochkO has joined #openstack-ironic | 18:06 | |
| *** k_mouza has joined #openstack-ironic | 18:11 | |
| *** VoochkO has quit IRC | 18:14 | |
| *** k_mouza has quit IRC | 18:16 | |
| *** rpioso has quit IRC | 18:31 | |
| *** knikolla has quit IRC | 18:32 | |
| *** naved001 has quit IRC | 18:34 | |
| *** knikolla has joined #openstack-ironic | 18:35 | |
| *** rpioso has joined #openstack-ironic | 18:35 | |
| *** naved001 has joined #openstack-ironic | 18:36 | |
| *** rcernin has joined #openstack-ironic | 18:43 | |
| *** dsneddon has joined #openstack-ironic | 18:46 | |
| *** rcernin has quit IRC | 18:48 | |
| *** bfournie has quit IRC | 19:26 | |
| *** k_mouza has joined #openstack-ironic | 20:13 | |
| *** k_mouza has quit IRC | 20:46 | |
| *** rcernin has joined #openstack-ironic | 21:37 | |
| *** paras333 has joined #openstack-ironic | 21:42 | |
| *** rcernin has quit IRC | 21:42 | |
| *** paras333 has quit IRC | 21:47 | |
| *** mkowalski has quit IRC | 21:59 | |
| *** mkowalski has joined #openstack-ironic | 22:00 | |
| *** rcernin has joined #openstack-ironic | 22:05 | |
| *** hjensas_ has joined #openstack-ironic | 22:10 | |
| *** hjensas has quit IRC | 22:14 | |
| *** rcernin has quit IRC | 22:26 | |
| *** k_mouza has joined #openstack-ironic | 22:29 | |
| *** k_mouza has quit IRC | 22:34 | |
| *** rloo has quit IRC | 22:39 | |
| *** bfournie has joined #openstack-ironic | 22:44 | |
| *** ayoung has quit IRC | 22:49 | |
| *** tosky has quit IRC | 23:08 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!