Friday, 2019-06-14

*** ianychoi has joined #openstack-ironic00:19
*** gyee has quit IRC00:38
openstackgerritJulia Kreger proposed openstack/ironic-python-agent master: Add IPv6 module for tinycore  https://review.opendev.org/66527000:39
openstackgerritJulia Kreger proposed openstack/ironic master: WIP ipv6 job  https://review.opendev.org/61316900:43
*** dsneddon has quit IRC01:11
*** yedongcan has joined #openstack-ironic01:16
openstackgerritKaifeng Wang proposed openstack/networking-generic-switch master: Add Mellanox MLNX-OS Switch support  https://review.opendev.org/64256501:23
*** dsneddon has joined #openstack-ironic01:24
*** rcernin has quit IRC01:27
*** rcernin has joined #openstack-ironic01:27
*** igordc has quit IRC01:35
openstackgerritDongcan Ye proposed openstack/ironic master: Update ironic-api installation  https://review.opendev.org/66451801:41
openstackgerritDongcan Ye proposed openstack/ironic master: Update ironic installation  https://review.opendev.org/66451801:42
*** Goneri has quit IRC02:14
*** Goneri has joined #openstack-ironic02:25
openstackgerritMerged openstack/python-ironicclient master: Update Python 3 test runtimes for Train  https://review.opendev.org/66505302:46
*** mkrai_ has joined #openstack-ironic02:48
*** Goneri has quit IRC02:49
*** gregoryo has joined #openstack-ironic02:57
*** nishagb has quit IRC03:07
*** dmellado_ has joined #openstack-ironic03:08
*** dmellado has quit IRC03:08
*** dmellado_ is now known as dmellado03:08
*** nishagb has joined #openstack-ironic03:08
openstackgerritMerged openstack/python-ironic-inspector-client master: Update Python 3 test runtimes for Train  https://review.opendev.org/66505003:19
*** nishagb has quit IRC03:22
*** zaneb has quit IRC03:22
*** mkrai has quit IRC03:22
*** EmilienM has quit IRC03:22
*** rloo has quit IRC03:22
*** rh-jelabarre has quit IRC03:22
*** mkowalski has quit IRC03:22
*** mgagne has quit IRC03:22
*** persia has quit IRC03:22
*** hamzy has quit IRC03:22
*** sziviani has quit IRC03:22
openstackgerritKaifeng Wang proposed openstack/ironic-specs master: [PoC] Enable creating pdf doc  https://review.opendev.org/66528503:36
*** nishagb has joined #openstack-ironic03:38
*** zaneb has joined #openstack-ironic03:38
*** mkrai has joined #openstack-ironic03:38
*** EmilienM has joined #openstack-ironic03:38
*** rloo has joined #openstack-ironic03:38
*** rh-jelabarre has joined #openstack-ironic03:38
*** mkowalski has joined #openstack-ironic03:38
*** mgagne has joined #openstack-ironic03:38
*** persia has joined #openstack-ironic03:38
*** hamzy has joined #openstack-ironic03:38
*** sziviani has joined #openstack-ironic03:38
*** rloo has quit IRC03:40
openstackgerritKaifeng Wang proposed openstack/ironic-specs master: [PoC] Enable creating pdf doc  https://review.opendev.org/66528503:41
*** irclogbot_2 has quit IRC03:41
*** irclogbot_0 has joined #openstack-ironic03:42
*** rh-jelabarre has quit IRC03:43
openstackgerritzhufl proposed openstack/ironic master: Fix :param: in docstring  https://review.opendev.org/66528703:50
openstackgerritKaifeng Wang proposed openstack/ironic-specs master: [PoC] Enable creating pdf doc  https://review.opendev.org/66528503:54
openstackgerritKaifeng Wang proposed openstack/ironic-inspector-specs master: [PoC] Enable creating pdf doc  https://review.opendev.org/66529004:02
*** stendulker has joined #openstack-ironic04:09
*** igordc has joined #openstack-ironic04:12
*** igordc has quit IRC04:19
openstackgerritparesh sao proposed openstack/ironic master: [WIP]oob disk erase patch  https://review.opendev.org/64158204:28
*** whoami-rajat has joined #openstack-ironic04:47
*** pcaruana has joined #openstack-ironic05:09
*** stendulker has quit IRC05:16
*** e0ne has joined #openstack-ironic05:21
*** yaawang has quit IRC06:24
*** rachit7 has joined #openstack-ironic06:28
*** gregoryo has quit IRC06:35
*** stendulker has joined #openstack-ironic06:35
*** rpittau|afk is now known as rpittau06:35
rpittaugood morning ironic! o/06:36
rpittauhappy friday!06:36
arne_wiebalckgood morning rpittau and ironic o/06:36
rpittauhey arne_wiebalck :)06:37
openstackgerritzhufl proposed openstack/ironic master: Fix :param: in docstring  https://review.opendev.org/66528706:40
openstackgerritKaifeng Wang proposed openstack/ironic-inspector-specs master: [PoC] Enable creating pdf doc  https://review.opendev.org/66529006:52
*** iurygregory has joined #openstack-ironic06:58
iurygregorygood morning all06:58
arne_wiebalckiurygregory: o/06:58
rpittauhi iurygregory :)06:58
iurygregoryo/06:59
*** tesseract has joined #openstack-ironic07:08
*** zhangfei has joined #openstack-ironic07:08
*** sungn__ has joined #openstack-ironic07:12
*** sungn__ is now known as sungn07:13
*** rcernin has quit IRC07:22
*** yaawang has joined #openstack-ironic07:22
*** e0ne has quit IRC07:35
*** rachit7 has quit IRC07:41
*** dtantsur|afk is now known as dtantsur07:44
dtantsurmorning ironic07:44
*** S4ren has joined #openstack-ironic07:51
openstackgerritDmitry Tantsur proposed openstack/ironic-inspector master: Stop failing on missing memory or CPU  https://review.opendev.org/66532408:11
*** dougsz has joined #openstack-ironic08:15
*** lucasagomes has joined #openstack-ironic08:16
iurygregorymorning dtantsur08:17
*** priteau has joined #openstack-ironic08:23
mkraigood morning ironic o/08:28
openstackgerritraphael.glon proposed openstack/ironic stable/queens: Ansible module: fix configdrive partition creation step  https://review.opendev.org/66532708:29
rpittauhey mkrai :)08:29
*** derekh has joined #openstack-ironic08:29
mkrairpittau: o/08:30
*** jtomasek has joined #openstack-ironic08:38
*** stendulker has quit IRC08:48
*** yaawang has quit IRC08:50
*** rachit7 has joined #openstack-ironic08:55
*** e0ne has joined #openstack-ironic09:08
openstackgerritMerged openstack/bifrost master: Update Python 3 test runtimes for Train  https://review.opendev.org/66507509:08
*** sungn has quit IRC09:21
openstackgerritKaifeng Wang proposed openstack/sushy master: [PoC] Enable creating pdf doc  https://review.opendev.org/66534209:40
openstackgerritKaifeng Wang proposed openstack/ironic-tempest-plugin master: [PoC] Enable creating pdf doc  https://review.opendev.org/66534409:49
openstackgerritMerged openstack/ironic-python-agent master: Add IPv6 module for tinycore  https://review.opendev.org/66527009:57
*** yaawang has joined #openstack-ironic10:02
*** S4ren has quit IRC10:03
* etingof considers mock.name being root of all evil10:12
openstackgerritDmitry Tantsur proposed openstack/ironic master: redfish: handle missing Bios attribute  https://review.opendev.org/66510010:14
dtantsuretingof: indeed, this is ridiculous.10:14
openstackgerritMerged openstack/ironic master: Fix :param: in docstring  https://review.opendev.org/66528710:17
openstackgerritDmitry Tantsur proposed openstack/ironic master: redfish: handle missing Bios attribute  https://review.opendev.org/66510010:25
openstackgerritDigambar proposed openstack/ironic stable/rocky: DRAC: Fix OOB introspection to use pxe_enabled flag in idrac driver  https://review.opendev.org/64836010:57
jrollmorning y'all10:58
*** S4ren has joined #openstack-ironic10:59
*** rachit7 has quit IRC11:11
dtantsurmorning jroll11:18
openstackgerritM V P Nitesh proposed openstack/ironic-lib master: Returns disk_identifier for UEFI boot mode nodes  https://review.opendev.org/66485211:24
*** EmilienM is now known as EvilienM11:45
iurygregorymorning jroll12:03
*** rh-jelabarre has joined #openstack-ironic12:06
*** rh-jelabarre has quit IRC12:09
*** rh-jelabarre has joined #openstack-ironic12:09
*** bobmel has joined #openstack-ironic12:13
*** derekh has quit IRC12:25
*** hamzy has quit IRC12:27
*** mkrai_ has quit IRC12:36
*** S4ren has quit IRC12:38
*** mkowalski has quit IRC12:39
*** mkowalski has joined #openstack-ironic12:47
openstackgerritNisha Brahmankar proposed openstack/ironic-python-agent master: Removes tinyipa from IPA  https://review.opendev.org/66537912:54
*** derekh has joined #openstack-ironic12:58
*** priteau has quit IRC12:59
jrolloh neat13:00
jrollTIL someone picked that back up13:00
*** hamzy has joined #openstack-ironic13:02
*** rloo has joined #openstack-ironic13:05
dtantsurjroll: you mean, image building?13:08
jrolldtantsur: yeah, the builder repo thing13:09
dtantsurjroll: yep, nishagb is our outreachy intern working on it this summer13:09
jrolloh awesome, hi nishagb :)13:09
openstackgerritNisha Brahmankar proposed openstack/ironic-python-agent master: Removes tinyipa from IPA  https://review.opendev.org/66537913:10
nishagbhii jroll :)13:10
*** hamzy has quit IRC13:13
*** hamzy has joined #openstack-ironic13:17
*** hamzy has quit IRC13:19
*** hamzy has joined #openstack-ironic13:20
TheJuliaGood morning fellow humans, AI's and IRC bots!13:21
rpittauhey TheJulia :)13:23
TheJuliaso turns out we need more than just to load the modules in tinycore... but getting the modules loaded at least makes that one step closer to having it work.13:25
*** priteau has joined #openstack-ironic13:26
dtantsurmorning TheJulia13:27
dtantsurbaby steps..13:27
*** bfournie has quit IRC13:28
TheJuliaIndeed, now that I have ipxe booting an agent image things move much faster13:28
TheJuliaI guess I should consider posting my crazy local.cf at some point....13:28
TheJuliaStill need a devstack neutron lib fix merged :(13:29
dtantsurheh13:29
dtantsurmeanwhile, I'm trying to figure out why we always end up with trimmed ramdisk logs in tripleo. so far came up with https://review.rdoproject.org/r/#/c/21142/ comments welcome13:29
TheJuliaI... guess... that should fix it13:30
openstackgerritDongcan Ye proposed openstack/ironic master: Update ironic installation  https://review.opendev.org/66451813:30
* dtantsur will try to torture his devstack to test that13:32
* etingof thinks that devstack aims at torturin dtantsur 13:33
*** bfournie has joined #openstack-ironic13:33
dtantsurit never stopped13:33
TheJuliaAny volunteers to review https://review.opendev.org/#/c/638492 ?13:37
patchbotpatch 638492 - sushy-tools - Rename `drivers` to `resources/systems` - 17 patch sets13:37
TheJuliadtantsur: do you want me to paste my local.cf?13:37
dtantsurwould be curious, although I'm unlikely to get to it today13:37
dtantsurTheJulia: I stopped -1'ing that sushy-tools patch at some point and decided to never come back there again :)13:37
TheJuliaI'm trying to put together my notes for my first call of the day... so I won't get to posting it for a little bit13:38
rpittauif RPMs let me live I might be able to have a look :/13:42
TheJuliadtantsur: so I thought about some of the changes in the sushy-tools patches and they actually make sense in building a later foundation at least, but I didn't get that on my first few passes :(13:43
dtantsurTheJulia: this assumes that we need any later foundation :)13:44
* etingof fears that the amount of sensor data coming from redfish will burn Prometheus13:46
dtantsuretingof: Prometheus has good relationship with fire, don't worry about him13:46
TheJuliaheh13:46
dtantsurbeware of eagles though13:46
etingof...unless BMC dies first13:46
TheJuliadtantsur: Somewhat agree with you there, but yeah. *shrugs*13:47
*** sthussey has joined #openstack-ironic13:47
*** whoami-rajat has quit IRC13:57
*** KurtB_ has joined #openstack-ironic14:03
openstackgerritNisha Brahmankar proposed openstack/ironic master: Updates ironic for using ironic-python-agent-builder  https://review.opendev.org/66539914:04
*** e0ne has quit IRC14:13
KurtB_I'm running into a bit of a chicken and egg problem and thinking I can use ironic as a standalone to provision systems to then build openstack. Is that not correct today? I'm totally new to Ironic, and just starting t build a bare-metal stack.14:14
TheJuliaKurtB_: I can respond after I'm off my calls for the days, but that might be 2 hours.14:19
KurtB_@TheJulia Thanks. I'm here all day and really appreciate the response. :-)14:20
dtantsurKurtB_: two projects, Kayobe and TripleO, are doing roughly what you expect (Kayobe is more standalone)14:27
*** priteau has quit IRC14:30
KurtB_dtantsur: Thank. I'll take a look at Kayobe14:31
*** hamzy has quit IRC14:36
TheJuliaIs there a unicode character for head desk yet?14:36
*** hamzy has joined #openstack-ironic14:37
TheJuliahttps://giphy.com/gifs/head-desk-forkke-62XCHIYqiwOhW also works14:37
*** yedongcan has left #openstack-ironic14:45
openstackgerritNisha Brahmankar proposed openstack/ironic master: Updates ironic for using ironic-python-agent-builder  https://review.opendev.org/66539914:47
*** bnemec has joined #openstack-ironic14:48
*** e0ne has joined #openstack-ironic14:57
*** e0ne has quit IRC15:00
*** hamzy has quit IRC15:01
*** hamzy has joined #openstack-ironic15:02
*** bnemec is now known as beekneemech15:11
*** e0ne has joined #openstack-ironic15:15
*** kbaegis has joined #openstack-ironic15:20
kbaegisMorning all15:20
kbaegisI’m having issues with the pxe boot interface. The pxelinux.0 file gets loaded, but then the grub gets loaded from the nodes drive instead of over pxe15:21
*** e0ne has quit IRC15:21
kbaegisSo working: ipmi driver, dhcp, tftp; not working: grub and everything it’s blocking15:21
*** e0ne has joined #openstack-ironic15:24
dtantsurkbaegis: are you sure your node is not booting in UEFI mode?15:24
kbaegisdtantsur: I wanted uefi pxe15:24
kbaegisdtantsur: Is that my issue?15:25
dtantsurkbaegis: likely. UEFI vs Legacy is not quite automatic, check https://docs.openstack.org/ironic/latest/install/advanced.html#boot-mode-support15:25
dtantsurtl;dr you need to opt into UEFI-compatible configuration15:26
*** e0ne has quit IRC15:27
kbaegisdtantsur: I mean- I’ve set `openstack baremetal node set —property ‘capabilities=‘boot_mode=uefi’` for the ndoe15:28
kbaegis*node15:28
dtantsurkbaegis: the syntax is boot_mode:uefi and without quotation marks inside15:28
dtantsur--property capabilities=boot_mode:uefi15:28
dtantsurif you use nova, I think you need to update the flavor as well15:29
kbaegisdtantsur: I don’t use nova15:29
dtantsurin any case, pxelinux.0 is for legacy BIOS, you shouldn't see it loading when things work correctly15:29
*** e0ne has joined #openstack-ironic15:29
kbaegisdtantsur: What should it be transferring? I may need to update my dhcp settings15:30
* dtantsur thinks15:30
kbaegis*should probably be in the guide15:30
dtantsurI wonder if we even document it..15:30
kbaegisI have in my tftpboot directory: grubx64.efi, chain.c32, bootx64.efi, pxelinux.015:32
rpittaukbaegis: should be here: https://docs.openstack.org/ironic/latest/install/configure-pxe.html15:32
*** e0ne has quit IRC15:33
dtantsurkbaegis: I think it should be bootx64.efi15:33
kbaegisrpittau: It’s not really. The UEFI PXE - Grub setup portion completely omits the dhcp settings15:34
dtantsurbut we really should try and document it\15:34
*** Goneri has joined #openstack-ironic15:35
kbaegisSweet. Let’s try bootx64.efi then15:37
dtantsurkbaegis, rpittau, we don't have enough standalone docs indeed :( for the neutron case the DHCP part is done automagically.15:40
kbaegisSure. By a dnsmasq daemon running inside a netns, statically configured with the ironic interface -> neutron15:41
rpittaukbaegis, dtantsur, in that page the config file is mentioned in 2 places but it's definitely a bit confusing15:41
rpittaulook for 'Bootfile DHCP parameter for UEFI boot mode. (string value)'15:42
kbaegisrpittau: I was looking at my wireshark/tcpdump logs and seeing pxelinux.0 go across the wire just fine and then have it still boot up to the os in a clean operation- scratching my hea15:42
kbaegis*head15:42
kbaegisNot realizing that isc-dhcpd was pointing to the wrong file15:43
*** zhangfei has quit IRC15:43
kbaegisHuh.15:44
kbaegisIt’s requesting grub.efi, not grubx64.efi15:44
kbaegisdtantsur: Are there any functional tests wrapped around ironic-standalone?15:47
dtantsurkbaegis: there are bifrost and metalsmith jobs; I don't think either of them tests UEFI though. we also tend to use iPXE rather than plain PXE.15:48
kbaegisdtantsur: Yeah, unfortunately iPXE isn’t an option on my hardware. Virtual-media would require me to purchase $600 in licenses as well from supermicro15:48
kbaegisWell- to do it from redfish that is, which I’ve abandoned15:49
*** jaypipes has quit IRC15:51
dtantsurkbaegis: iPXE does not require virtual media. it works similarly to PXE, but after loading the initial firmware it loads stuff via HTTP.15:53
TheJuliadtantsur: kbaegis: bootx64.efi needs to be the shim... or can be ipxe.efi instead.15:53
dtantsurit also behaves quite similarly for legacy and UEFI boot15:53
kbaegisOh, so PXE -> iPXE?15:54
dtantsurkbaegis: yep. ipxe.efi is booted via DHCP options, then it proceeds with iPXE15:55
kbaegisSo several assumptions (in the docs) break standalone. First, the file needs to be grub.efi (and not grubx64.efi), and second the grub.cfg apparently needs to be in the root tftp directory. Third, my grub.cfg is loaded, but $net_default_ip.conf isn’t an expanded parameter.15:55
kbaegisSo it doesn’t know where to pull a grub config file15:56
kbaegisIf I’m reading this right.15:56
TheJuliaif it is a newer version of ironic $net_default_mac.conf might work15:57
TheJuliaI changed that in ?stein? or ?rocky?15:58
kbaegisThat appears correct. I have dirs created by mac, not IP15:58
dtantsurbug in the docs?15:59
*** hjensas is now known as hjensas|afk16:01
kbaegisAlso, I was having difficulty finding the grub modules per the docs. On opensuse they’re located at /usr/share/grub2/x86_64-efi/command.lst16:02
TheJuliait might not know it is efi16:02
TheJuliaor set for ipxe16:02
kbaegisI’m not using iPXE just yet.16:03
kbaegisExit16:03
kbaegisOops. :)16:03
TheJuliaheh16:03
dtantsurTheJulia: could you check https://review.opendev.org/#/c/665324/ please?16:05
patchbotpatch 665324 - ironic-inspector - Stop failing on missing memory or CPU - 1 patch set16:05
TheJuliabraaaainssss16:06
kbaegisLol16:06
kbaegisSo for me to automate this setup for others on macos, I’m thinking I should rely on a docker container transfer rather than homebrew. Anyone know of a place I can download all the requisite grub/syslinux packages for a standalone deployment?16:07
dtantsurnot sure I really get the question16:10
dtantsuryou mean, where to download containers? or which distribution to use?16:10
kbaegisI mean there isn’t a handy place where I can download everything as a single tarball is there?16:10
kbaegisI.e. - the contents of the /tftpboot folder16:10
kbaegisMore of a method-of-procedure than a packager16:11
rpittaubye all, have a great weekend! o/16:11
*** rpittau is now known as rpittau|afk16:11
kbaegisrpittau|afk: You too!16:12
dtantsurkbaegis: not sure. you may try bifrost in a VM or a container16:12
* TheJulia is still on calls16:13
kbaegisWhat’s the easiest place to extend stuff installed on tiny-ipa?16:15
dtantsurkbaegis: what exactly are you trying to do?16:15
kbaegisdtantsur: Add a custom hardware manager to the image w/ diskimage-builder16:16
kbaegisNever used diskimage-builder for anything other than stock images16:16
dtantsurkbaegis: diskimage-builder and tinyipa are two different things. I *think* when you use DIB you can pass -p argument to install an additional package.16:16
kbaegisIsn’t tinyipa built with dib?16:17
dtantsurkbaegis: nope. tinyipa is built with tinycorelinux and largely targets testing. production ramdisks are usually built with DIB based on some real distributions (I work for Red Hat, so I'm mostly seeing RHEL and CentOS based images :)16:18
kbaegisdtantsur: Cool16:19
kbaegisMuch change with the acquisition for you guys yet?16:19
dtantsurIt's not even done yet :)16:20
kbaegisdtantsur: Oh! I thought it had closed.16:20
kbaegisJust found out that HPE/Microfocus acquired Cray16:20
dtantsuroh? I haven't heard about it16:21
TheJuliaI heard HPE, didn't hear about Microfocus...16:21
kbaegisHPE is Microfocus16:21
dtantsurkbaegis: that's how we build images in TripleO CI (you may not need all of this, just an example): https://logs.rdoproject.org/83/665383/1/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/c53651b/logs/undercloud/home/zuul/overcloud_image_build.log.txt.gz#_2019-06-14_14_14_1216:22
*** lucasagomes has quit IRC16:22
kbaegis:/ Access violations on the PXE driver16:24
kbaegisGlobal read and execute on the mac symlink/file too16:25
dtantsurI'm sorry, I have to go now. Talk to you on Monday, have a great weekend, everyone!16:26
*** dtantsur is now known as dtantsur|afk16:26
kbaegisYou too!16:26
*** mkowalski has quit IRC16:33
TheJuliaokay16:35
TheJuliafinally off calls.16:35
TheJulia.16:35
* TheJulia breakfasts16:35
kbaegis???16:36
kbaegisGrub is throwing me errors like “can’t find command ‘default’”16:37
*** derekh has quit IRC16:37
TheJuliakbaegis: I thought HPE Software was what Microfocus had? Or had they purchased/acquired more since that transaction (which I narrowly avoided)16:39
kbaegisI believe that HPE is a fully owned subsidiary of Microfocus16:39
TheJuliaHPE is publicly traded16:39
kbaegis*shrug*16:40
kbaegisI’m at SUSE, and we just bought ourselves free from Microfocus16:40
TheJuliaNow, that being said.... Microfocus could have rights to operate under the HPE name/brand in some countries or places...16:40
TheJulia\o/16:40
kbaegisWe have an HPE building in my town, and we were using it as a meeting place16:40
kbaegisWe got several of their engineers when we split from Microfocus as well16:41
TheJuliaHPE contractors I believe16:41
TheJuliathat whole thing was complex....16:41
TheJuliaI think everyone I know that ended up being acquired in that whole transaction has moved on...16:42
kbaegis https://www.microfocus.com/about/press-room/article/2017/micro-focus-completes-merger-with-hpe-software/16:42
kbaegisTheJulia: Grub is now giving me this error: http://paste.openstack.org/show/752939/16:46
TheJulia"merger" I remember being on the calls and hearing the spin16:47
* TheJulia sighs16:47
TheJuliakbaegis: wow.... uhhh...16:48
TheJuliatrying to network boot grub right?16:48
kbaegisYeah16:48
TheJuliahttps://opendev.org/openstack/ironic/src/commit/55e8d3fde1132af32b413b1b38d3e16288ec4398/devstack/lib/ironic#L236816:50
TheJuliaI quite literally dealt with this like a week ago16:51
TheJuliacheckout what I did there. Grub at some point... changed I think16:51
TheJuliaI should ping one of the grub folks that I know... but I'll feel guilty because I've not been in contact with their sister who is a friend of mine #itsasmallworld16:52
kbaegisSo I need to run grub-mknetdir?16:53
*** iurygregory has quit IRC16:53
TheJuliakbaegis: yeah, default grub seems to lack the network modules these days16:55
TheJuliaand that builds a binary that has them16:55
TheJuliadtantsur|afk: re ironic-inspector, I'll approve the change. I'm wondering if we need to backport. I'm fine if we just amend the backport commit message (if really really really needed)16:56
*** dougsz has quit IRC16:57
TheJuliathe commands errors your getting _are_ different from the error I was seeing with ubuntu. I suspect it all comes down to how grub is built and with what defaults16:58
kbaegisGrub needs to die17:01
kbaegisWith efi it has gotten way too complicated and arcane to be useful as a tool17:02
kbaegisI love how they require a wrapper just to generate a config file, and it does some very lame discovery of files17:03
kbaegis`/opinions`17:06
kbaegisI’ve spent far too many hours troubleshooting what grub file is named what and includes which features17:07
TheJuliaYeah. iPXE can also be a headache as well, but it does make for a clean launch pad for more complex things like iscsi booting, or AOE if someone has that sort of gear in their data center17:08
TheJuliaTroubleshooting it... can be a headache17:09
* TheJulia looks at the good chunk of the week only to find macvtap's eat multicast packets by default17:09
TheJulia"OM NOM NOM Multicast packets!"17:09
* TheJulia might... have... actually. Lost.. it.17:09
kbaegisWell I spent a month with my lab out of commission because supermicro looks exclusively for bootx64.efi on the EFI partition. It will let you configure any name you want, but it only WORKS with bootx64.efi17:13
*** iurygregory has joined #openstack-ironic17:15
kbaegisTheJulia: Tried your workaround; not working for me17:16
TheJuliakbaegis: ugh, I actually think I've seen that on my supermicro chassis... and always wondered why I couldn't get uefi to work.  I seem to remember my HP desktop when I worked for HP actually did the exact same thing, it would record the device in nvram, but not the file name17:17
TheJuliakbaegis: same errors? Different errors? Servers not erroring?17:17
kbaegisSame errors; no errors from tftp or network17:17
kbaegisError: can’t find command “default”17:18
TheJuliaany tftp activity after the initial load of shim/grubx64.efi?17:18
kbaegisSure is. It loads a bunch of modules successfully17:19
kbaegisSpecifically /boot/grub2/x86_64-efi/terminal.mod,crypto.mod,extcmd.mod,gettext.mod,gzio.mod,command.lst,etc17:20
kbaegisWait a minute. Is it supposed to be grubx64.efi or bootx64.efi?17:22
*** igordc has joined #openstack-ironic17:22
*** hamzy has quit IRC17:23
TheJuliacore.efi from the command should be renamed grubx64.efi17:23
*** priteau has joined #openstack-ironic17:23
TheJuliashim.efi should be bootx64.efi17:23
*** iurygregory has quit IRC17:23
TheJuliawhich you'll need from the shim package of course17:23
kbaegisSee, this is the stupid crap that makes grub2 completely unusable17:23
*** hamzy has joined #openstack-ironic17:24
kbaegisIt’s a simple concept: a bunch of modular files that represent specific programs on booting17:25
kbaegisBut in practice everything breaks because of dumb assumptions about what things are named and how specifically they were generated.17:25
openstackgerritMerged openstack/ironic-inspector master: Simplify locking code  https://review.opendev.org/65919917:26
TheJuliaSo core.efi when built, at least on ubuntu... only results in the *.lst files being downloaded according to my packet captures locally17:26
TheJuliaif those files are missing it all kind of detonates17:27
kbaegisI don’t have any tftp errors or “Unauthorized” packets across the wire17:27
kbaegisI don’t think it likes the way the grub.cfg or mac.conf files are generated anymore17:28
TheJuliacore.efi, when built, is _supposed_ to have all the modules integrated. In theory.17:29
kbaegisWoudn’t it be great if we could check?17:29
TheJuliaOh, so its actually downloading grub.cfg?17:29
TheJuliait would!17:29
* TheJulia messages grub developer's sister so she stops feeling bad about not keeping in touch with her friends17:29
kbaegisRight. So it downloads a TXT file for configfile /$net_default_mac.conf and that’s where it breaks17:30
kbaegisOn the “master” entry in grub17:31
TheJuliaWhat if you change that to something like /$net_default_interface.conf which should result in a file not found and grub2 basically going "I can't boot!"17:32
TheJuliaWhich would start to help us to understand which side of this issue it is on17:33
kbaegisIt’s already doing that17:33
kbaegisI’ve been moving files around as necessary. :/17:34
TheJuliaOkay, so it returns "i can't boot because I cant find the thing, and with the file errors about the default command?17:36
*** iurygregory has joined #openstack-ironic17:36
kbaegisTheJulia: Correct. It pulls the file the pxe driver generates successfully17:36
kbaegisBut it’s complaining that 1) the file is filled with nonsense terms, and 2) it probably isn’t loading grub modules correctly17:37
TheJuliahttps://opendev.org/openstack/ironic/src/branch/master/ironic/drivers/modules/pxe_grub_config.template <-- This is the base template, I wonder if something is leaking maybe....17:37
kbaegisWant to see what it’s failing on?17:37
TheJuliasure17:38
*** iurygregory has quit IRC17:38
*** e0ne has joined #openstack-ironic17:41
*** iurygregory has joined #openstack-ironic17:44
*** e0ne has quit IRC17:46
*** hamzy has quit IRC17:47
kbaegisTheJulia: http://paste.openstack.org/show/752958/17:52
kbaegisThose are the contents of the evidently faulty config17:53
TheJuliakbaegis: what version of ironic is this?17:53
kbaegis12.2.0.dev13717:54
kbaegisIronicm12.2.0, GRUB 2.0217:56
*** hamzy has joined #openstack-ironic17:56
TheJuliaI see what is going on17:56
TheJuliayou need to change your pxe config template17:56
TheJuliait is set to the default pxe_config17:56
TheJuliaerr, pxe_config.template, it should be set to the pxe_grub_config.template file17:56
TheJulialet me get you an ipxe example real quick17:57
kbaegisWhere are these located?17:57
kbaegisIn the tftpboot directory as well?17:58
TheJuliain ironic.conf, change [pxe] section parameter to be the following line: pxe_config_template = $pybasedir/drivers/modules/pxe_grub_config.template17:58
TheJuliaits a jinja2 template file that is used, the pxe driver is just configured for the wrong one17:58
TheJuliasince it doesn't know any better17:58
TheJuliahttps://github.com/openstack/bifrost/blob/master/playbooks/roles/bifrost-ironic-install/templates/ironic.conf.j2#L44 <-- for bifrost's ipxe usage17:59
kbaegisHow do I unset a node in “clean wait”?18:04
kbaegisJ18:04
TheJuliaabort18:09
TheJuliaoh wait18:09
TheJuliayeah, abort _should_ work if it is not actually cleaning yet18:10
kbaegisI just deleted the node and recreated18:10
TheJulia*sigh*18:10
* TheJulia grumbles about the state machine18:10
TheJuliaCleaning is one of those fairly rigid areas because of security concerns with BMaaS scenarios18:10
* TheJulia feels completely... mentally... derailed and realizes fedex never showed up for an overnight document delivery18:12
TheJuliaand perfectly timed email from my attorney indicates Monday. Woot!18:15
kbaegisPatent?18:15
TheJuliaNo, Probate18:15
TheJulia:(18:15
kbaegisYou know, I was thinking about it and I think it would be very handy to have a hardware manager that took care of crypto for the disks18:16
TheJuliakbaegis: so that is a super interesting topic!18:16
kbaegisRather than cleaning them, you could set up readable compartments based on luks keys18:16
TheJuliaThat is a possibility, although who knows what might happen with other disks... and there is always the case if someone deploys Windows or a BSD of some variety18:17
*** tesseract has quit IRC18:18
kbaegisRight. So it’s shared tenancy- no assumptions should be made18:18
kbaegisBut at least then it isn’t destroyed until it needs to be18:18
kbaegisThere’s nothing that presently enables ironic to only show specific drives however, correct?18:22
kbaegisLocal or remote18:22
kbaegisRADIUS?18:22
TheJuliaThat could be really interesting from a shared standpoitn....18:24
kbaegisI think so. You’d need an agent to do the brokering however...18:25
TheJuliashow specific drives? like network shares?18:25
kbaegisIt’d almost have to be18:25
kbaegisI wish you could isolate local storage, but I don’t know how that would work18:25
TheJuliaYeah, or lots of parameters on the kernel command line18:25
kbaegisI suppose that could be an option18:26
kbaegisFor linux only18:26
TheJuliaSo what Mass Open Cloud does is they use iscsi with the baremetal fleet and they chain load ipxe to the iscsi target from that.18:26
TheJuliaWith zero local storage.18:26
TheJuliaThey also have a couple other neat things which I'm not sure they've talked about publically so I'll just say "neat" :)18:27
kbaegisI’ve been hoping for a shared/federated “compute time” model for years18:27
kbaegisInteresting. Hadn’t heard about Mass Open Cloud18:28
kbaegisWoah! PXE is working now. It’s now hanging on “Booting deploy”...18:30
TheJuliaI feel the need to go spend time in Boston soon....  I need to catch up with those folks.18:32
kbaegisTheJulia: http://paste.openstack.org/show/752963/18:32
kbaegisDoes that look more like what you’d expect?18:32
TheJuliait does... the errors are... interesting18:33
TheJuliaI've never seen those spit out before, but really most people just run ipxe for this sort of stuff for the reasons already highlighted18:33
TheJuliadouble checking the template18:34
TheJuliahmmm18:34
* TheJulia goes and looks for the console log from one of the grub uefi jobs18:34
TheJuliakbaegis: Interesting, no errors on our CI run: http://logs.openstack.org/25/663725/1/check/ironic-tempest-ipa-partition-uefi-pxe-grub2/b86039e/controller/logs/ironic-bm-logs/node-0_no_ansi_2019-06-06-18:05:29_log.txt.gz18:36
*** e0ne has joined #openstack-ironic18:42
kbaegisIgnoring malformed capability 'boot_mode=uefi'.18:49
kbaegisConductor is also doing something stupid. It’s trying to unlink a directory that doesn’t exist18:52
kbaegisIs my node creation incorrect? http://paste.openstack.org/raw/752966/18:55
TheJuliawe always try to unlink, it might be only logging those if your in debug. I think they are normally supressed18:55
kbaegisNo, I’m getting full ERRORS and a traceback. PermissionError18:56
TheJuliaoooh ramdisk deploy interface18:56
TheJuliayou shouldn't need root_gb if your directly asking for a ramdisk to boot. That might be a bug if you had to add it.18:57
kbaegisI can’t even get past cleaning. I’ve never used the ramdisk deploy18:57
kbaegisK18:58
kbaegisI’ll remove it. I was just trying to follow the docs18:58
TheJuliayou might be the first person who I've talked to who has tried using the ramdisk interface with grub, since it is not what we would call a traditional deploy. you'r not writing any sort of image to disks.18:58
TheJuliaoh wait18:59
TheJuliayour set to ramdisk deploy interface, deploy interface with an image_source should be iscsi or direct18:59
TheJuliasince that would be written to disk18:59
kbaegisUser.image is a file that says “xfail” right now19:00
kbaegisMy thought was: 1) boot to ipa, 2) clean the node with a custom driver, 3) write a disk image to disk with a very minimal install19:02
kbaegis*custom hardware manager19:02
kbaegisExperimental mode. I don’t even know how the drive is selected to host the image19:03
kbaegisI have SSDs, NVMEs and HDDs in each of my boxes, but I’m trying to create a redeployable environment19:03
*** hamzy has quit IRC19:05
kbaegisIdeally it would copy the image to an lvm2 LV rather than a raw device, but I don’t even know if direct supports that19:05
*** iurygregory has quit IRC19:07
NobodyCamGood morning ironic’ers19:10
NobodyCamAnd ofc TGIF19:10
TheJuliagood morning NobodyCam19:11
TheJuliakbaegis: sorry on the phone, give me a few19:11
NobodyCam\o/19:11
kbaegisTheJulia: I’m around. Right now the state machine is dumping me off on clean failed because of the permission errors when it fails to unlink a directory it never created19:13
kbaegisIt created a directory with ‘dr----x--t’19:14
TheJuliadefault umask?19:16
*** e0ne has quit IRC19:16
*** e0ne has joined #openstack-ironic19:16
kbaegishttp://paste.openstack.org/show/752967/19:21
*** e0ne has quit IRC19:21
kbaegisThat’s what happens to conductor when I execute the command (previous paste) and then run http://paste.openstack.org/show/752967/19:23
*** e0ne has joined #openstack-ironic19:23
kbaegisSorry, when I run “openstack baremetal node clean prong.ipmi --clean-steps '[{"interface": "deploy", "step": "erase_devices_metadata"}]'”19:25
*** priteau has quit IRC19:26
*** e0ne has quit IRC19:33
*** rloo has quit IRC19:33
openstackgerritMerged openstack/ironic-inspector master: Stop failing on missing memory or CPU  https://review.opendev.org/66532419:37
*** pcaruana has quit IRC19:39
*** hamzy has joined #openstack-ironic19:45
TheJuliaOkay... sorry. Was on the phone with my wife.19:49
TheJuliakbaegis: yeah, you can do that. we have the the fast_track option in ?stein? that sould make that a little faster for you as a standalone user. For writing that image, juse be sure to use iscsi or direct modules19:50
TheJuliahmmmm19:53
TheJuliawhoops about the elilo deprecation warning19:53
TheJuliathe config is concerning because that should be getting created....19:53
TheJuliakbaegis: so that exception is upon creation, not deletion.19:55
TheJuliayou know you can flag automatic cleaning, using the configuration priorities so it just does erase_devices_metadata between the provide verb moving kbaegis: from managable to available states.19:56
*** dsneddon has quit IRC20:23
kbaegisTheJulia: I’m back20:50
TheJuliaokay, I'm just typing up an RFE20:51
kbaegisI saw your code. Right now I’m getting “FailedToGetIpaddressOnPort”20:52
kbaegisFixed the syntax I was using for openstack cli uefi20:52
kbaegisMy ironic.conf: http://paste.openstack.org/show/752970/20:55
TheJuliadtantsur|afk: https://storyboard.openstack.org/#!/story/2005896 ?20:57
TheJuliaoh ugh, thats a bug people shot me down on fixing. :(20:57
* TheJulia looks for that patch20:57
TheJuliahttps://review.opendev.org/#/c/499376/ would have done it... but that error can be gotten rid of with...20:58
patchbotpatch 499376 - ironic - Bypass neutron dhcp if noop interface - 1 patch set20:58
TheJuliahttps://review.opendev.org/#/c/533153/ <--20:59
patchbotpatch 533153 - ironic - Remove elilo support - 5 patch sets20:59
kbaegisIt’s not merged in yet?20:59
TheJuliaI've literally blocked it so I can do a minor version release first20:59
TheJuliaActually, now is not a bad time to do that....20:59
* TheJulia gets hair tie21:00
TheJuliaelilo's deprecation took a while because we wanted to have a CI job for grub21:01
TheJuliaand the IP address stuff started with elilo21:01
TheJuliaso removing it will make the world a happier place21:01
*** kbaegis has quit IRC21:01
TheJuliadtantsur|afk: that inspection change actually sounds like a really quick set of changes to make. Frozenset based on config and new entrypoint/path on ipa, but even that is nearly entirely based upon what we already have for launching IPA today.21:04
TheJuliaEveryone rocks for keeping release notes in a good shape :)21:08
openstackgerritJulia Kreger proposed openstack/ironic master: Update qemu hook to facilitate Multicast  https://review.opendev.org/66522121:20
openstackgerritJulia Kreger proposed openstack/ironic master: Remove ipxe tags when ipx6 is in use.  https://review.opendev.org/66526721:22
*** kbaegis has joined #openstack-ironic21:26
kbaegisTheJulia: Huh. Dropped21:26
kbaegisI just tried that patch set and it’s not working for me. Traceback: http://paste.openstack.org/show/752971/21:28
TheJuliawhich one?21:28
kbaegis53315321:28
* TheJulia watches ipxe loop on the other screen and wonders "is it too early to get a drink?"21:29
kbaegisHah21:30
TheJuliagive me a few let me put up another patch real quick and I'll siwtch back21:31
openstackgerritJulia Kreger proposed openstack/ironic-python-agent master: Add ipv6 modprobe config  https://review.opendev.org/66547721:37
*** rh-jelabarre has quit IRC21:37
openstackgerritJulia Kreger proposed openstack/ironic master: WIP ipv6 job  https://review.opendev.org/61316921:37
openstackgerritJulia Kreger proposed openstack/ironic master: WIP ipv6 job  https://review.opendev.org/61316921:37
TheJuliaokay!21:37
TheJuliachanging gears before i go find tequila21:38
TheJuliahmm... I thought I removed that helper21:38
TheJulianopo!21:39
TheJuliaokay, new plan. Fix old patch on top of eilo fix21:39
kbaegisTheJulia: Let me test something first21:40
kbaegisI’m going to try the ipxe boot driver21:40
kbaegisI messed up the syntax for something again21:41
TheJuliakbaegis: the ipxe path is one of the most tested paths, so likely better and what the standalone code uses in other cases, so you have good templates to use (and it doesn't try to lookup the IP addresses)21:43
kbaegisRight. If it’s properly configured21:43
kbaegis|| http://paste.openstack.org/show/752972/21:44
kbaegisDoes ironic ipxe act as a web server?21:45
kbaegisOr does it just point towards one?21:45
TheJuliatowards one21:50
TheJuliawill look at the paste in like 2-3 min21:50
TheJuliawow that is an unfriendly error :(21:55
*** mkowalski has joined #openstack-ironic21:58
openstackgerritJulia Kreger proposed openstack/ironic master: Enable no IP address to be returned  https://review.opendev.org/49937622:02
TheJuliaAnd I'm super flabbergasted that that didn't require a test change :(22:02
*** EvilienM is now known as EmilienM22:03
TheJuliaEmilienM: I've never noticed alt-nick friday for you and that is awesome.22:07
TheJuliakbaegis: that last patch _should_ make make things better :)22:09
kbaegisTheJulia: Thanks! Retesting22:09
TheJuliait is actually two patches stacked22:09
kbaegisipxe_script_url = '/'.join([CONF.deploy.http_url, script_name]) NoneType error?22:16
kbaegisAhh, I should probably populate one then22:17
TheJuliayeah... only you know that url22:21
*** kbaegis has quit IRC22:27
*** igordc has quit IRC22:45
*** dsneddon has joined #openstack-ironic23:07
*** igordc has joined #openstack-ironic23:13
*** mkowalski has quit IRC23:13
*** jtomasek has quit IRC23:19
*** dsneddon has quit IRC23:19
openstackgerritMerged openstack/ironic stable/stein: Ansible module: fix configdrive partition creation step  https://review.opendev.org/66487623:20
*** sthussey has quit IRC23:47

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!