Monday, 2022-10-17

opendevreviewOpenStack Proposal Bot proposed openstack/ironic master: Imported Translations from Zanata  https://review.opendev.org/c/openstack/ironic/+/86155503:42
rpittaugood morning ironic! o/07:32
arne_wiebalckGood morning rpittau and Ironic!08:00
rpittauhey arne_wiebalck :)08:00
jpodivinHi. I wanted to ask how should I get info about the storage devices used by a node. I've seen "local_gb" in the properties dictionary I get when running `node show` ... but what if there are multiple disks? 08:20
jandersgood morning rpittau arne_wiebalck jpodivin and Ironic o/08:40
rpittauhey janders :)08:40
arne_wiebalckgood morning janders o/08:40
* dtantsur checks the ptg etherpad08:58
dtantsurwe don't have the normal meeting today, do we?09:07
rpittauwe don't09:08
rpittauif anyone has a moment please review the bifrost migration to jammy https://review.opendev.org/c/openstack/bifrost/+/848828 and upgrading from zed https://review.opendev.org/c/openstack/bifrost/+/859075 thanks!09:16
jpodivinjanders: do you happen to know how to get the disk info? 09:20
opendevreviewVerification of a change to openstack/ironic master failed: Imported Translations from Zanata  https://review.opendev.org/c/openstack/ironic/+/86155509:44
dtantsurjpodivin: if you use ironic-inspector, it stores some data that can be accessed via its API/CLI10:13
dtantsurif not, it's not possible10:13
jpodivindtantsur: I see. So there is no way to find out how many disks are on an active node?10:27
dtantsurjpodivin: if you don't use ironic-inspector (or don't have access to it) - no.10:27
dtantsur(note that we don't provide or support agents that run on active instances)10:27
jpodivindtantsur: including inspector?10:27
dtantsursorry?10:28
dtantsur(okay, there is limited support for re-introspection of active instances - forgot about it)10:28
jpodivinSo if I have ironic inspector I can get info about the disks? 10:29
dtantsurjpodivin: if you ran introspection for the nodes - yes10:29
dtantsur`openstack baremetal introspection data save <node>`10:29
jpodivindtantsur: but that doesn't work on active nodes ... hm10:29
dtantsurjpodivin: what's your case? do you expect the disks to change?10:30
jpodivindtantsur: not necessarily, I just need to know how many there are and which one is root. On a working cloud that is, with active nodes. 10:31
dtantsurjpodivin: it's not something we have out-of-box. I think arne_wiebalck is doing something like this: a container is running on the nodes that periodically posts updated inventory to ironic-inspector. Right Arne?10:32
jpodivindtantsur: ok, if there is no way to get it without introspection we'll work with that. The introspection data are stored automatically right? They can be called back at any point after it's finished and node is active? 10:37
dtantsurjpodivin: correct10:58
dtantsurJayF, iurygregory, TheJulia, I wonder if it's too late to swap "Merging inspector into Ironic" and e.g. "OpenInfra Labs collab". I have a hard stop at 16:00 UTC on Tue/Wed, so it's somewhat risky for me.10:59
iurygregorygood morning Ironic11:06
iurygregorydtantsur, fine with me11:06
arne_wiebalckjpodivin: we do not do this periodically/constantly, but we have the mechanism in place in case we have to, yes11:14
arne_wiebalckjpodivin: e.g. when we need to update the serial numbers of nodes11:14
arne_wiebalckjpodivin: and we were able to run introspection on a few 100 nodes in parallel against our APIs, seemed ok :)11:15
kubajjGood afternoon Ironic, I had a wee chat with TheJulia on Friday and I was suggested to share my devstack local.conf and the error block of output that I think says what the error is. If anybody has any suggestions on what could be the problem, please let me know.13:03
kubajjhttps://www.irccloud.com/pastebin/VKmADRDT/13:04
kubajjhttps://www.irccloud.com/pastebin/knWJYNrZ/13:04
kubajj(It seems that the paste bins are not there anymore, I'll redo them)13:06
kubajjLocal.conf: https://paste.opendev.org/show/bLnk28LuR4A5NrZTVL8h/13:08
kubajjDevstack output: https://paste.opendev.org/show/b341YTBEYGexAATLPNrJ/13:08
iurygregorykubajj, so the error is on neutron, so probably some of the configs you have in your local.conf should be changed13:48
JayFdtantsur: sure; I'm OK with that. You wanna edit the etherpad directly or shall I?13:48
iurygregoryin the devstack jobs checked the local.conf we have FIXED_RANGE="10.1.0.0/20" and we don't have any value set for FIXED_NETWORK_SIZE13:49
iurygregoryI was looking at https://0f0a489eb876d8f6c64b-af7203ec313049b47d68440a509d433a.ssl.cf5.rackcdn.com/861496/1/check/ironic-tempest-uefi-redfish-vmedia/865590e/controller/logs/local_conf.txt13:49
iurygregoryif you have neutron enabled you probably need to set some extra params like the "Q_***" variables 13:50
iurygregoryI think neutron has some defaults with the plugin that we don't support, so you need to have the variable set13:55
iurygregory4min for our session with nova right?13:56
JayFyes13:57
dtantsurJayF: changed14:53
dtantsurFYI kubajj, I've moved the inspector session to Wednesday because of a conflict14:53
kubajjdtantsur: thanks, I think I should be able to make it14:54
JayFthank you dtantsur; happy you'll be there14:54
* TheJulia sighs16:06
TheJuliaoff calls, and now to call to figure out flight options :(16:06
rpittaubye everyone! o/16:16
iurygregorydo we have support for UEFI HTTP boot? 17:51
iurygregorysomeone just asked me this if we have this type of support in redfsih when using ironic17:51
TheJuliadepends on which style, technically that is what ipxe+ipv6 is, fwiw17:51
iurygregoryhumm ok17:52
TheJuliabut there is a version which is tell the BMC what url to use17:52
TheJuliathere is a DHCP version17:52
TheJuliawhich we don't explicitly support unless it is v617:52
TheJuliaand ipv6, since we can hand back a full url17:52
iurygregoryI see17:52
iurygregorythanks TheJulia 17:52
TheJuliaYeah, yay standardization or lack their of17:52
TheJuliaor multiple standards!17:52
JayFDo I even need to link the xkcd here?17:53
TheJuliain redfish would be via the bmc, and we really don't from the standpoint of "set a URL"17:53
TheJuliawas not widely supported when I did some wip patches for sushy a couple years back17:53
TheJuliaJayF: absolutely17:53
JayFhttps://xkcd.com/927/17:53
JayFI can't wait for onefish, twofish, and bluefish to go with redfish ;)17:54
TheJuliaswordfish17:55
iurygregoryTheJulia, so in redfish scenario we don't have support for it?17:55
TheJulianot kidding at all: https://www.snia.org/forums/smi/swordfish17:55
TheJulianot for a direct url to boot from17:55
JayFaw hell, can't they at least make it seussian :P 17:56
* JayF afk17:56
TheJuliait wouldn't be super hard to add support for, and maybe then teach ironic to fallback via the DHCP path17:56
TheJuliabut setting via url is basically virtual media boot17:56
TheJuliasimilar construct and mechanics17:56
stevebaker[m]good morning19:15
TheJuliaGood morning stevebaker[m]19:16
TheJuliastevebaker[m]: https://review.opendev.org/c/openstack/ironic/+/861305 would likely help with fixing older ci20:57
stevebaker[m]Looking20:57
JayFTheJulia: that commit message says train; but the patch is on ussuri21:01
TheJuliaoh, well, same exact change is required21:01
JayFI think commit message here matters? At least it'd confuse me if I saw that on a !train branch :( 21:02
TheJuliawaiting for it to laod to fix it21:02
JayFack ty21:02
opendevreviewJulia Kreger proposed openstack/ironic stable/ussuri: CI: Pin ussuri to use only basic standalone tests  https://review.opendev.org/c/openstack/ironic/+/86130521:06
kubajjTheJulia: any suggestions on the local.conf? I tried adding some of the Q_* variables as iury suggested https://paste.opendev.org/show/btVaKadYmu5eSWwXux4E/ and I am getting a different error, but I am clueless at this point (the error: https://paste.opendev.org/show/bfAqH0g5ZkYQ6DQGVTMX/ )21:09
JayF> 503: Egress is over the account limit21:09
JayFlooks like you might have some quota at maximum?21:09
JayFoh, wait, that's fomr github etcd21:09
JayFthat looks like etcd's download is broken upstream21:10
TheJuliasigh21:10
JayFkubajj: try re-running ./stack.sh with the exact same config on the exact same machine21:10
kubajjJayF: this did not take even 30 seconds to fail21:11
JayFyeah, if you look at that error log you posted21:11
JayFit's just downloading and installing requirements21:12
JayFand it dies early because the download from github fails21:12
JayFnot much devstack can do about that :(21:12
kubajjI see21:12
kubajjI will try another VM then21:12
JayFdon't use a nnew one21:12
JayFif you can help it21:12
JayFdevstack should be eventually consistent; if it errors and you fix it you can re-run stack.sh and it'll just do what's needed21:13
kubajjthis is the error after re-running it: https://paste.opendev.org/show/bBOuZ5tkzHOvFFo9tMve/21:14
JayFkubajj: so lets read through it: it's saying ~kuba/devstack/files/etcd{}.tar.gz checksum doesn't match21:14
JayFso that implies to me that it might have partially downloaded earlier when it failed21:15
JayFso you might be able to remove that file and retry, so it re-fetches it21:15
kubajjI don't know why it did not delete it when it says it in the paste above, but after calling the rm manually, it is running again now21:16
JayFwell that's basically what it's checking21:17
JayFto see if the file already there is good21:17
JayFin the gate; for instance, many of those things are baked into the image21:17
JayFso it can just check to make sure the file is good and skip the download21:17
JayFyou don't get that cache for a single local devstack run :)21:17
TheJuliais gerrit being painfully slow for anyone else?21:27
kubajjI am not going to lie, neutron is slowly becoming my least favourite service21:28
kubajjTheJulia: for me it is quite fast now21:28
TheJuliahmm, now it is21:30
opendevreviewJulia Kreger proposed openstack/ironic master: Phase 3 - SQLAlchemy 2.0 Compatability  https://review.opendev.org/c/openstack/ironic/+/85793221:31
opendevreviewMerged openstack/ironic-python-agent bugfix/8.1: CI: Zuul no longer respects queue param  https://review.opendev.org/c/openstack/ironic-python-agent/+/86019422:17
opendevreviewVerification of a change to openstack/ironic-python-agent stable/wallaby failed: Use utf-16-le if BOM not present  https://review.opendev.org/c/openstack/ironic-python-agent/+/86106322:17
opendevreviewVerification of a change to openstack/ironic-python-agent stable/victoria failed: Use utf-16-le if BOM not present  https://review.opendev.org/c/openstack/ironic-python-agent/+/86106422:40
opendevreviewMerged openstack/ironic-python-agent-builder stable/xena: dhcp-all-interfaces: let NetworkManager doit.  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/86043222:52
opendevreviewVerification of a change to openstack/ironic master failed: Use project scoped token for cinder, glance services  https://review.opendev.org/c/openstack/ironic/+/86149622:55
opendevreviewMerged openstack/ironic master: Phase 2 - SQLAlchemy 2.0 Compatability  https://review.opendev.org/c/openstack/ironic/+/85751623:27
opendevreviewMerged openstack/ironic master: Phase 3 - SQLAlchemy 2.0 Compatability  https://review.opendev.org/c/openstack/ironic/+/85793223:27
TheJuliathat... feels... good23:44
opendevreviewMerged openstack/ironic-python-agent master: Fix failure of bind mount in _install_grub2  https://review.opendev.org/c/openstack/ironic-python-agent/+/85727123:46
opendevreviewVerification of a change to openstack/ironic stable/ussuri failed: CI: Pin ussuri to use only basic standalone tests  https://review.opendev.org/c/openstack/ironic/+/86130523:53

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!