Tuesday, 2022-01-25

opendevreviewJulia Kreger proposed openstack/ironic-tempest-plugin master: WIP: An idea for rbac positive/negative testing  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/81916500:04
opendevreviewJulia Kreger proposed openstack/ironic-tempest-plugin master: WIP: An idea for rbac positive/negative testing  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/81916500:38
opendevreviewSteve Baker proposed openstack/ironic-python-agent-builder master: Added element to enable RDO deps repo to install sysbench  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/82531301:02
opendevreviewSteve Baker proposed openstack/ironic-python-agent-builder master: Added element to enable RDO deps repo to install sysbench  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/82531301:04
opendevreviewMerged openstack/ironic-python-agent-builder stable/wallaby: Preliminary work to support CentOS 9 Stream  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/82336501:17
opendevreviewJulia Kreger proposed openstack/ironic-tempest-plugin master: WIP: An idea for rbac positive/negative testing  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/81916502:34
opendevreviewSteve Baker proposed openstack/ironic-python-agent-builder master: Move centos9 jobs from experimental to check  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/82541103:38
opendevreviewMerged openstack/ironic-python-agent-builder master: Move centos9 jobs from experimental to check  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/82541106:55
arne_wiebalckGood morning, Ironic!07:31
opendevreviewArne Wiebalck proposed openstack/ironic-python-agent master: SoftwareRAID: Use efibootmgr (and drop grub2-install)  https://review.opendev.org/c/openstack/ironic-python-agent/+/82602608:04
arne_wiebalckdtantsur: TheJulia: ^^ s/w RAID with efibootmgr now with unit test, ready for reviews (I removed the WIP tag)08:05
rpittaugood morning ironic! o/08:25
rpittauif anyone has a minute please check https://review.opendev.org/c/openstack/bifrost/+/824193 thanks!08:32
jandersgood morning arne_wiebalck rpittau and Ironic o/08:44
rpittauuuhhh PTG dates are out https://www.openstack.org/ptg/08:45
rpittauhey janders :)08:45
arne_wiebalckhe janders o/08:45
rpittauhey arne_wiebalck :)08:45
arne_wiebalck*hey (not he :-)08:45
arne_wiebalckgood morning rpittau o/08:46
dtantsurmorning ironic08:54
rpittaugood morning dtantsur :)08:55
arne_wiebalckhey dtantsur o/08:56
opendevreviewMerged openstack/ironic-specs master: Spec proposal for a Redfish proxy for Ironic  https://review.opendev.org/c/openstack/ironic-specs/+/80880409:15
opendevreviewMerged openstack/bifrost master: Add CentOS Stream 9 keystone integration job  https://review.opendev.org/c/openstack/bifrost/+/82419309:32
iurygregorygood morning Ironic o/10:54
jandershey iurygregory o/10:57
iurygregoryjanders, o/10:57
dtantsurfolks, I have a bunch of bifrost patches pending on review https://review.opendev.org/q/project:openstack/bifrost+status:open+owner:dtantsur%2540protonmail.com could someone please help me clear up this backlog? :)11:07
iurygregorydtantsur, looking now o/11:24
iurygregoryor checking if I already reviewed XD11:24
dtantsurthx!11:42
arne_wiebalckdtantsur: https://review.opendev.org/c/openstack/bifrost/+/824719 a couple of minor edits ... you want to update or shall I W+1 ?11:44
dtantsurarne_wiebalck: I think I'll follow-up, maybe will notice some other useful additions11:44
dtantsur(i.e. in a new patch)11:44
arne_wiebalckdtantsur: ++11:44
opendevreviewMerged openstack/bifrost stable/xena: Do not run ironic-prometheus-exporter as root  https://review.opendev.org/c/openstack/bifrost/+/82495712:07
opendevreviewMerged openstack/bifrost master: Change the TFTP directory to /var/lib/tftpboot  https://review.opendev.org/c/openstack/bifrost/+/82355212:07
opendevreviewMerged openstack/bifrost master: Terminate TLS on Nginx  https://review.opendev.org/c/openstack/bifrost/+/81964012:13
opendevreviewMerged openstack/bifrost master: Use the combined Ironic service instead of API+conductor  https://review.opendev.org/c/openstack/bifrost/+/82039012:20
opendevreviewMerged openstack/bifrost master: Use "none" RPC by default, disable JSON RPC  https://review.opendev.org/c/openstack/bifrost/+/82047912:27
opendevreviewMerged openstack/bifrost master: Start Bifrost Architecture documentation  https://review.opendev.org/c/openstack/bifrost/+/82471912:27
*** sshnaidm|afk is now known as sshnaidm12:28
opendevreviewMerged openstack/ironic-python-agent-builder stable/xena: Remove centos7 job, python2 support  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/82619712:29
dtantsurIf someone still has time, https://review.opendev.org/c/openstack/bifrost/+/823673 is something I want to build further work on13:07
* dtantsur updates the architecture guide13:07
iurygregoryI'm reviewing this one =)13:09
dtantsurnice :)13:09
opendevreviewMerged openstack/bifrost bugfix/12.0: Do not make password files world-readable  https://review.opendev.org/c/openstack/bifrost/+/82505713:12
opendevreviewMerged openstack/bifrost stable/wallaby: Do not make password files world-readable  https://review.opendev.org/c/openstack/bifrost/+/82505613:12
opendevreviewMerged openstack/bifrost stable/xena: Do not make password files world-readable  https://review.opendev.org/c/openstack/bifrost/+/82505513:12
*** para is now known as parasitid13:13
parasitidhi13:14
parasitidi have a question related to the project ironic-prometheus-exporter13:14
parasitidhow can i setup ironic so that13:14
parasitid- i can have all notifications sent to a kafka cluster13:14
parasitid- i can have all sensor data exposed by the prometheus exporter /13:15
parasitid?13:15
parasitidit seems to me that it's not doable, as the prometheus-exporter makes use of the oslo_notifications conf section, so i cant have 2 differents sinks for notifications and sensor data. am i correct ?13:16
dtantsurcc iurygregory ^^^13:20
* iurygregory reads13:21
opendevreviewDmitry Tantsur proposed openstack/bifrost master: Clean up the new architecture docs  https://review.opendev.org/c/openstack/bifrost/+/82628513:22
dtantsurarne_wiebalck: ^^13:23
iurygregoryparasitid, hi! by "have all notifications sent to a kafka cluster" you want all the sensor data notifications sent to it?13:23
TheJuliagood morning13:24
dtantsurmorning TheJulia 13:24
dtantsurTheJulia: a difficult question ahead: do you remember why we make the Bifrost's venv owned by the current user (rather than root)? also cc rpittau 13:25
* dtantsur is working on hardening bifrost as a distraction from all the things downstream13:25
TheJuliano, I don't13:25
rpittaummmm I don't remember either13:26
iurygregorygood morning TheJulia 13:26
TheJuliait was a really long time ago13:26
dtantsurokay, I'll try to change it and see what breaks :)13:26
TheJuliaokay13:27
* TheJulia continues to caffinate13:27
TheJuliaCAFFINE! Then nice-ish looking clothing! Then hide all the stuff in the background and board meeting13:27
rpittaugetting my second espresso now :)13:27
TheJuliaoooh ahh some of my multi-part tempest tests seem to work13:29
parasitidiurygregory: hi, no, probably not. sensor to prom, but notifications to kafka13:30
parasitidi'd like to collect all node enrollments, port creation/delete, etc in a central system. but keep sensor data in  my alerting system13:31
iurygregoryparasitid, I *think* it's possible to enable multiple drivers in "oslo_messaging_notifications" section...13:31
iurygregorylet me ask in the #openstack-oslo13:31
parasitidiurygregory: so that all stuff would be sent in both sinks ?13:32
iurygregoryparasitid, there is a way to filter things by topics from what I remember =)13:32
parasitidiurygregory: just by curiosity, do you think it would make sense to have a dedicated sensor section in the conf file ?13:35
iurygregoryparasitid, not 100% sure, the configs for sensor data are already in the conductor section13:46
* TheJulia hopes enough browser windows have been lcosed to run zoom in an hour13:47
iurygregorykill -9 <browser pid>13:48
iurygregory:D13:48
iurygregoryparasitid, can you join #openstack-oslo channel?13:50
parasitidiurygregory: ok thanks. btw, i have a totally unrelated question: do you know where i can find docs about the chassis entity ? i cant get how it relates to the nodes and for what purpose. thanks again13:51
opendevreviewDmitry Tantsur proposed openstack/bifrost master: Make virtual environment owned by root  https://review.opendev.org/c/openstack/bifrost/+/82628913:51
iurygregorylet me try to find  the docs13:52
* TheJulia continues to close browser tabs found in unknown windows with pictures of shoes... beautiful shoes13:53
opendevreviewDmitry Tantsur proposed openstack/bifrost master: Make virtual environment owned by root  https://review.opendev.org/c/openstack/bifrost/+/82628913:54
iurygregoryparasitid, the api-ref should help https://docs.openstack.org/api-ref/baremetal/#chassis-chassis let us know if you have any questions13:56
parasitidiurygregory: yes i read that one, but i cant get what it's made for13:57
TheJuliaparasitid: it was made to kind of help represent multi-chassis machines or concepts like composible hardware, but it has never really evolved. It is entirely optional13:58
parasitidTheJulia: hi, ok so if i understand it well, i could use this "chassis" to reprensent hosts within a same rack ?13:59
parasitidor is this more like the notion of "aggregates" in nova ?14:00
opendevreviewDmitry Tantsur proposed openstack/bifrost master: Do not clone repositories that are not used  https://review.opendev.org/c/openstack/bifrost/+/82629214:06
iurygregorydtantsur, re https://review.opendev.org/c/openstack/bifrost/+/823673/4/scripts/collect-test-info.sh i was expecting to see bifrost-install-env.json in the logs dir in the jobs .-.14:08
iurygregoryhttps://zuul.opendev.org/t/openstack/build/5ec3aa967f2541c7ad72d42cda5deced/logs14:08
dtantsuriurygregory: I think we don't use `bifrost-cli install` in most jobs14:10
dtantsuriurygregory: here's a bifrost-cli job: https://zuul.opendev.org/t/openstack/build/6e7b6787f63a44d8aa3cbfbb015b57da/logs14:10
* iurygregory forgot to read the full name of the job - facepalm14:11
iurygregory+2 =)14:11
TheJuliaparasitid: hosts in same rack, or I think when the feature was implemented HPE Moonshots were a growing concept of use14:14
TheJuliaso you have one base chassis, and lots of compute cards14:14
TheJuliaOdds zoom will want me to upgrade this morning?!?14:16
iurygregoryseems legit...14:21
TheJuliaheh14:25
TheJuliaAnyone going to wish me to break a leg?14:25
iurygregoryO.o not me14:25
TheJuliagoodluck maybe?14:26
rpittauTheJulia: we say "in the mouth of the wolf" :)14:26
iurygregorygood luck ++ 14:27
iurygregoryyou can do it TheJulia =D14:27
timeuparasitid: FYI We use chassis because in ironic because we have 4 compute blades/nodes within a chassis (they share BMC, power, etc). But we use it simply to know which computes nodes can be moved together14:28
rpiosoGood morning, ironic :-)14:29
timeuthat's basically how it looks like: https://lenovopress.com/datasheet/ds0003-lenovo-thinksystem-sd530-and-d2-enclosure14:29
rpiosoiurygregory: Welcome back!14:30
iurygregoryhey rpioso o/ tks!14:31
rpiosoDoes anyone know if the PXE (not iPXE :-) boot interface is being successfully tested/used with UEFI boot mode?14:33
TheJuliarpittau: the grub2 job in CI14:34
dtantsurisn't it legacy?14:34
rpittauTheJulia: mmm ?14:35
rpiosorpittau: Hello brother ;-)14:35
rpittauhey rpioso "D14:35
TheJuliai thought the grub2 job was netboot efi14:35
TheJuliaI know steve has done it14:35
* rpittau professionally stealing pings 14:35
opendevreviewDmitry Tantsur proposed openstack/ironic master: Recommend various installers in the install guide  https://review.opendev.org/c/openstack/ironic/+/82629514:37
dtantsurhave I forgotten any installers? ^^14:37
ajyahi sdanni , did you get your answer about idrac settings yesterday?14:38
rpiosorpittau: LOL14:39
rpiosoTheJulia: ironic-tempest-ipa-partition-uefi-pxe-grub2 uses iPXE.14:39
dtantsurrpioso: the postgres job, I think14:40
sdanniajya: i didn't14:40
ajyasdanni:  import, export _configuration will contain iDRAC settings. Are you interested in any particular?14:41
opendevreviewDmitry Tantsur proposed openstack/bifrost master: Clean up the new architecture docs  https://review.opendev.org/c/openstack/bifrost/+/82628514:42
dtantsurarne_wiebalck: fixed the nit ^^14:42
sdanniajya: yes. Since a user can modify idrac setting during using the node, we would like to cleanup all settings to the previous stage after the node is returned to owner. If import, export configuration could work, I would like a try.14:46
arne_wiebalckdtantsur: thanks, done14:53
ajyasdanni: import,export configuration OEM section is using iDRAC's SCP underneath, see https://downloads.dell.com/manuals/common/dellemc-server-config-profile-refguide.pdf , in section 6 it has some details about iDRAC setting.14:53
ajyasdanni: I reckon the easiest way how to get the settings right is to manually configure one system, then export, delete all unnecessary parts and use what is left. 14:54
ajyasdanni: also if using static IP for iDRAC, be careful not to break it. Recently there was a patch merged to guard from accidentally overwriting it https://review.opendev.org/c/openstack/ironic/+/816816 14:56
opendevreviewDmitry Tantsur proposed openstack/bifrost master: Make virtual environment owned by root  https://review.opendev.org/c/openstack/bifrost/+/82628914:59
sdanniajya: thanks! I'll definitely have a try.15:01
*** sshnaidm is now known as sshnaidm|afk15:01
ajyasdanni: welcome, if have more questions, ping me15:02
opendevreviewMerged openstack/bifrost master: Clean up the new architecture docs  https://review.opendev.org/c/openstack/bifrost/+/82628515:06
opendevreviewDmitry Tantsur proposed openstack/bifrost master: Stop using sub-sections of driver_info  https://review.opendev.org/c/openstack/bifrost/+/82630715:12
opendevreviewDmitry Tantsur proposed openstack/bifrost master: Remove deprecated os_ironic_facts  https://review.opendev.org/c/openstack/bifrost/+/82630815:16
*** sshnaidm|afk is now known as sshnaidm15:55
opendevreviewDmitry Tantsur proposed openstack/bifrost master: bindep: don't try to install epel-release on fedora  https://review.opendev.org/c/openstack/bifrost/+/82632016:15
dtantsurrpittau: sorry, I might have misled you ^^16:15
rpittaunp :)16:16
rpittaummm we need epel "just" for debootstrap16:27
rpiosodtantsur, TheJulia: Thank you! We found a test in the CI that uses PXE boot with UEFI boot mode: ironic-tempest-ipa-partition-uefi-pxe-grub2.16:29
dtantsurnice16:32
rpittauI thin kwe should account for CS9 if we want to keep using debootstrap in bifrost, I'll prepare a patch16:59
TheJuliarpioso: there *is* a caveat to thinking grub will always work. It has to be built to support it and that binary has to be signed for secure boot. This is not always the case with every vendor. Different binaries may exist, etc.17:09
opendevreviewMerged openstack/bifrost master: Generate an environment file during bifrost-cli install  https://review.opendev.org/c/openstack/bifrost/+/82367317:10
rpiosoTheJulia: What is the 'it' in "It has to be built to support it"?17:10
TheJuliagrub and shim17:11
rpiosoTheJulia: Oops. I meant "support it". Support what? 17:11
TheJuliagrub does not natively grok network usage for PXE17:12
TheJuliawell, by default17:12
TheJuliaso its not a standard compile time feature17:12
jamesdentonhi TheJulia -- just sliding this in here (at your convenience). Thanks in advance! https://review.opendev.org/c/openstack/networking-generic-switch/+/55705117:12
TheJuliaand simillarlly, shim needs to know to use the network as well. I believe shim does get the primitive right and works as expected to load grub17:13
TheJuliarpioso: tl;dr, it is not a simple sequence. UEFI firmware needs to load shim, and then shim loads grub, and then grub needs to reach over the network and get the configuration file17:13
TheJuliaand then the next configuration file(s) and then assets to boot, and then finally boot17:13
TheJuliajamesdenton: thanks for the reminder17:14
jamesdentonthank you17:14
TheJuliajamesdenton: no release note :)17:15
rpiosoTheJulia: Are there any already built IPA ramdisks you expect would just work in our third-party CI?17:15
jamesdentondoh17:15
jamesdentoni'll add one shortly17:15
TheJuliajamesdenton: thanks17:15
TheJuliarpioso: https://tarballs.opendev.org/openstack/ironic-python-agent/dib/ipa-centos8-master.tar.gz should be centos8 stream based17:17
rpiosoTheJulia: Thanks, again :-)17:17
rpittaubye everyone! o/17:21
rpiosorpittau: Good nite :-)17:21
dtantsurspeaking of which, we should plan switching our IPA images to centos9 now?17:26
TheJuliaI would say yes, keeping 8 for the time being17:30
opendevreviewJames Denton proposed openstack/networking-generic-switch master: Support multiple links in link_local_information dict of portgroups  https://review.opendev.org/c/openstack/networking-generic-switch/+/55705117:30
TheJulialike we did with 717:30
dtantsurTheJulia: we had a switchover with 7 I think. one release on 7, the next - on 817:30
TheJuliawe *do* need to clean up some of the old artifacts off tarballs.o.o at some point17:30
dtantsurTheJulia: I ping someone on #opendev for that usually17:30
dtantsuryeah, train used 7, ussuri used 817:31
dtantsurso we can do 8 in yoga, 9 in in z?17:31
dtantsur(letting tripleo folks test it first :)17:32
TheJuliahehehe17:32
dtantsurif you have a second, please check https://review.opendev.org/c/openstack/bifrost/+/826320, it fixes the Fedora job17:33
dtantsur(which we should likely remove, but probably in z)17:33
dtantsursee you tomorrow o/17:33
arne_wiebalckbye everyone, see you tomorrow o/18:08
opendevreviewMerged openstack/bifrost master: bindep: don't try to install epel-release on fedora  https://review.opendev.org/c/openstack/bifrost/+/82632018:37
opendevreviewSteve Baker proposed openstack/ironic-python-agent-builder master: Added element to enable RDO deps repo to install sysbench  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/82531319:22
opendevreviewMerged openstack/bifrost master: Tighten permissions on keystone directories  https://review.opendev.org/c/openstack/bifrost/+/82470219:28
opendevreviewJulia Kreger proposed openstack/ironic stable/xena: ImageCache: respect Cache-Control: no-store  https://review.opendev.org/c/openstack/ironic/+/82637021:18
sdanniHi! I have another question about bios interface "apply_configuration" cleaning step. Is it possible to add this step into automated cleaning? if so, how should I pass the arguments to ironic?21:20
TheJuliainto automated cleaning...21:25
TheJuliahmmm21:25
TheJuliaI don't think that was ever intended, but I *think* it would just require a decorator and maybe a configuration knob?21:26
TheJuliais there an operational case to be made for such? I'm guessing by the question there is, and from an operational standpoint we can justify backporting21:26
TheJuliasdanni: ^^^21:30
sdanniTheJulia: if it's an automated cleaning step, owners don't need to do a manual bios reset after the node is returned. It's fine if it's not designed for automated cleaning. We just want to make clear about it.21:38
TheJuliaso going by memory, I don't think it was designed to be asserted in automated cleaning, but I think taht was *mostly* us just being process conservative. 21:45
TheJuliathe thing that I believe is supposed to happen is I think those settings get cached upon cleaning21:45
sdanniyeah, we can retrieve the cached settings and apply them to the node during manual cleaning21:54
TheJuliayeah, maybe a feature could be... If it doesn't match what is expected, force assert it21:58
TheJuliamaybe21:58
TheJuliait is a complicated dance21:58
JayFTheJulia: sdanni: I wonder if there should be another step, designed for use in automated cleaning, that would restore settings to a given static set (or default?)22:08
TheJuliaJayF: ++22:12
TheJuliacould just wrap apply_configuration really, but yeah with it's own specific knob22:12
JayFI'm just thinking... apply_configuration seems to have been made to be like "deploy this set of bios settings" which I compare to node deployment22:12
JayFso it makes sense to have a version of the method that would be more like cleaning that deployment22:12
JayFJay's school of pattern-matching tech architecture, coming Fall 2022 /s22:12
TheJulia++22:23
TheJuliayeah, extra validation and logic case handling could be useful for some22:23
* TheJulia looks in the spoon basket for spoons22:23
JayFI'll note that back in OnMetal days, we actually did this inband, and we did it twice: early to change BIOS settings to unlock firmwares and such so that we could validate them, then at the end to lock everything back down22:27
JayFSo it might be worth consideration that someone would want to follow that same pattern (although at that point; they probably would have custom cleaning libraries already)22:28
TheJuliaThe bios stuff is all intended to be OOB, but I could see some reasoning there. Conundrum is ultimately with base operating settings like Bios/UEFI which completely change things around22:59
TheJuliamaybe... in a few more years we'll finally be able to forget bios booting?!?22:59
JayFI'm not saying support in-band, I'm saying do not implement an assumption when building that method22:59
JayFabout how many times it will be used and/or what priority it will run at23:00
JayF(or make the tradeoff intentionally)23:00
TheJuliaoh yeah, no I agree with that23:00
* TheJulia goes and finds an early dinner23:08
jandersGood Morning Ironic o/23:19

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!