Wednesday, 2022-10-19

TheJulia0700 UTC... yeouch. but I have thoughts. :(00:03
TheJuliaThen again, that is.. PM...00:03
opendevreviewJulia Kreger proposed openstack/ironic-specs master: WIP Add a shard key  https://review.opendev.org/c/openstack/ironic-specs/+/86180300:04
TheJuliajohnthetubaguy: JayF: ^^ tossing up an idea to get it out of my head. I'm thinking a migration could be "if microvresion is valid upon running, and an evacuate occurs, then we might be able to actually set a shard key value from nova-compute into ironic00:05
TheJulia*ironic's response* TBD00:05
TheJuliaor not... there are some options there, but I think we could go either way, but we will ideally want to make assignment auto-magic00:05
TheJuliaif at all possible.00:06
TheJuliaI'd love for us to clean things up eventually, and it could just be a command to execute but locking would be *fun* albeit not impossible.00:08
* TheJulia goes now00:08
shukunTheJulia: Could you please review this patch: https://review.opendev.org/c/openstack/ironic/+/85703504:00
rpittaugood morning ironic! o/06:51
arozmanHello Ironic!07:36
dtantsurTheJulia, JayF, our devstack configures tempest tests for both partition and whole-disk images. However, testing partition images on BIOS is not possible. In the normal case (as seen in the ironic jobs), we skip the partition test, but in case of misconfiguration, it may be run.10:27
opendevreviewJacob Anders proposed openstack/sushy master: Improve resiliency of eTag handling  https://review.opendev.org/c/openstack/sushy/+/85612310:28
dtantsurjanders: I can do UTC morning, just let me know how it turns out10:32
opendevreviewMerged openstack/ironic-lib stable/yoga: CI: Zuul no longer respects queue param  https://review.opendev.org/c/openstack/ironic-lib/+/86017210:35
opendevreviewMerged openstack/ironic stable/victoria: CI: Reduce overall test load  https://review.opendev.org/c/openstack/ironic/+/86085110:37
opendevreviewMerged openstack/ironic stable/ussuri: CI: Reduce overall test load  https://review.opendev.org/c/openstack/ironic/+/86085210:37
jandersdtantsur TY. Let's chat more with TheJulia when she's online and I will run proposed times by Moshe, too10:39
dtantsurjanders: would that mean cancelling the one at 22UTC?10:40
dtantsur(I guess no because the scale topic interests stevebaker[m])10:41
dtantsur(but it may cancel it for me specifically :)10:41
* janders is looking at the schedule10:41
* janders is firing up WorldClock10:42
jandersdtantsur I agree, the 22UTC session would remain10:44
jandersif we wanted to do Active Steps in UTC morning, that would have to trickle down to Thursday, right? (it's kind of too late to do it still today)10:45
jandersis that an option, WDYT?10:45
jandersI missed that earlier cause Wednesday night UTC is my Thursday anyway10:45
dtantsurit's totally an option for me (we're past UTC morning already:)10:47
jandersOK! let's work it out before today's session starts10:50
iurygregoryJayF, I've updated the ptgbot =) 12:42
TheJuliaI'm a zombie, but good morning12:43
dtantsurgood zombie morning TheJulia 12:48
dtantsurwhat do zombies drink instead of coffee?12:48
TheJuliaOatmeal12:48
TheJuliaacceptable texture which provides the fuel to do the zombie shuffle12:49
* TheJulia sips coffee and starts to wake up12:50
jandersTheJulia JayF dtantsur before we start I wanted to touch again on re-scheduling the Active Steps discussion to a more Israel-friendly time12:57
jandersre-pasting earlier idea to make things easier:12:58
jandersWe originally planned for 0700hrs UTC ( https://etherpad.opendev.org/p/ironic-antelope-ptg#L188 ) but the current schedule is 2200hrs UTC ( https://etherpad.opendev.org/p/ironic-antelope-ptg#L56 ). The new time doesn't suit him, that's 1am in his timezone. Do you think we still have room to move it? The original proposed time would work,12:58
jandersalternatively 2000hrs UTC could maybe be considered, although it is getting late for the folks in Europe. What are your thoughts?12:58
JayFjanders: and that was moved at the request of dtantsur /o\13:00
dtantsurwas it? Oo13:00
JayFjanders: I'll bring it up, see what folks think. Worst case we just do a short meeting of the minds outside of the context of ptg13:00
JayFor iurygregory 13:01
JayFI think it was iurygregory then, sorry dtantsur 13:01
dtantsur22UTC could not be something I requested.. yeah, Iury maybe13:01
iurygregorywe talked that 22 would be a good time for APAC to participate, since in the past we had the same sessions in EU/America TZ and America/APAC TZ13:09
jandersiurygregory makes sense13:15
jandersin this case I wonder if we should add a repeat session on Active steps, say 0800hrs UTC (pedning Moshe/Mellanox availability)?13:16
jandersthis way we don't need to stuff around with the existing schedule at last minute13:16
janderslet me know if this seems like a good idea and I can reach out to Moshe13:16
dtantsurif it's not earlier than 8UTC, it's doable13:33
JayFjanders: if you all want to meet at 0800 UTC; you can. Please take good notes as that is basically maximally-worst timezone time for me.13:35
jandersdtantsur JayF thanks! Checking with Moshe/Mellanox, if it works let's try. We can treat it as a repeat session.13:37
* TheJulia reads depressing news and sighs13:55
dtantsursorry to hear TheJulia!13:58
TheJuliaeh, just another attempt to ban my existence... at a national level.13:58
iurygregoryTheJulia, ouch =( sorry to hear *hugs*13:59
dtantsuroh of course... these people will never forward their energy to something useful and peaceful, will they?13:59
iurygregoryprobably not14:00
TheJuliaI really wish they would!14:00
iurygregoryarne_wiebalck, if possible in the ironic session we are talking about raid14:07
iurygregorycan you join?14:07
dtantsurjanders: any response re the active steps slot?14:24
johnthetubaguyTheJulia: FWIW, I was wondering about evacuate as possible move nova-compute operation, it almost fits. I guess we need to decide if moving between nova-compute-ironic services is a one off transition thing, or a regular rebalance my shards thing. If its a one off, I like not changing the API I guess.14:40
JayFjohnthetubaguy: we were talking in PTG: it'll either need to be rebalancable and/or nova compute needs to be able to handle "N" shard keys per n-c (so you can preprovision ala cassandra vnodes)14:42
johnthetubaguyI think one of the assumptions we had on the Nova side was "this doesn't change, for a given node uuid"... but I think if the service is down, you should be able to move it again.14:44
johnthetubaguysorry, been in magnum land today, and nova/kolla land yesterday, so not had chance to loop back, I might try write something down before I forget it all14:45
JayFWe agreed to accept that limitation in the same way that other drivers accept it; it's hard for me to imagine someone being upset about hooking up `migrate` or `evacuate` if we kept the model properly14:56
jandersdtantsur nothing from Moshe so far. Based on response or lack of, we can decide if we have a follow-up session during the 2200hrs "main" active steps session. It would be small-ish anyway. Would this work?15:00
jandersI will set the alarm clock - will be in the 2200hrs session :)15:00
dtantsuryeah15:02
dtantsurI'll try not to fall asleep :)15:02
JayFI'm sorry about that :( It's very difficult to get everyone booked at good times15:02
jandersJayF I think we're doing well - thanks for organising everything15:03
JayFdtantsur: I need to step away, I might be back in time to start session on inspector merge; please start without me if I'm not back15:07
dtantsurwhen did we agree to start?15:07
dtantsurI was out on a call15:07
TheJulia10 after15:07
stevebaker[m]good morning15:09
opendevreviewKirill proposed openstack/ironic master: add vnc console  https://review.opendev.org/c/openstack/ironic/+/86068915:33
* TheJulia blinks15:40
TheJuliazoom crashed.. again16:06
TheJuliazoom why do you hate me16:06
iurygregoryzoom hate us all 16:07
rpittaubye! o/16:08
opendevreviewKirill proposed openstack/python-ironicclient master: add support of new graphical console interface  https://review.opendev.org/c/openstack/python-ironicclient/+/86068816:16
hjensasTheJulia: Raised bug/rfe on port list https://storyboard.openstack.org/#!/story/2010373 - I found the old bug on performance/scale issue and linked to that, this new bug also brings up my wishes related to networking-baremetal agent scaling.16:34
TheJuliahjensas: ack, thanks17:01
hjensasTheJulia: Looks like we could do the conductor_group filtering in a similar way we do owner and project filtering? Would probably be a good thing for me too look into.17:03
TheJuliahjensas: yes, that definitely would be good to do in the networking-baremetal service17:04
TheJuliahjensas: likely just a configuration key for networking-baremetal to decide how it will query Ironic.17:04
hjensasTheJulia: yes, I'll start working on adding add_port_filter_by_node_conductor_group in db api.17:07
TheJuliaoh yeah17:07
TheJuliathat... would be needed too17:08
TheJuliaif you beat me to making the query/result set a join cool17:08
TheJuliaI'm thinking this may be a case where working with our existing object model for getting the result set may just be a "bad idea" fwiw.17:08
opendevreviewKirill proposed openstack/python-ironicclient master: add support of new graphical console interface  https://review.opendev.org/c/openstack/python-ironicclient/+/86068817:50
opendevreviewJulia Kreger proposed openstack/ironic-specs master: WIP Add a shard key  https://review.opendev.org/c/openstack/ironic-specs/+/86180318:08
TheJuliaJayF: johnthetubaguy: ^ So I don't think nova-computes can handle n number of shard keys. The conundrum becomes what happens if a new shard key is created... and well... a new nova-compute would be needed realistically. And I think that is okay. this is a case where automatic scalability was a problem to support overall, and explicit decisions on scaling need to be made on the nova side. From inventory management, we can 18:21
TheJuliajust... handle it somehow. And I think likely some sort of tool to stamp existing baremetal nodes with a key and then a nova operator being able to do a rolling migration makes sense to me18:21
jandersdtantsur TheJulia JayF no response from Moshe, so I don't think we'll be doing alternate Active Steps session. Let's stick with the original plan, we can have further discussions outside PTG.21:19
JayFAlright. Thank you for coming even though it's a rough time21:19
JayFThis is the 15 minute warning for the final Ironic PTG session at UTC 2200-230021:46
opendevreviewJulia Kreger proposed openstack/ironic-specs master: WIP Add a shard key  https://review.opendev.org/c/openstack/ironic-specs/+/86180321:55
TheJuliaokay, I think the idea is out of my head21:56
TheJuliaoh, we would need a tool to do the shard key setting, it could be the base migration though21:56
TheJuliawell, no21:56
TheJuliaonline migration, it can be done while running21:56
JayFI admire your capacity to do such things after 4-5 hours of video meetings21:57
dtantsurI guess I need to have a fresher brain to understand the difference with conductor groups21:58
TheJuliadtantsur: I will write that then!21:58
TheJuliaor at least, expand upon it21:58
dtantsur++ would be great21:58
dtantsurI also hope it won't be completely parallel to conductor groups, but I'll wait for the write-up (and enough capacity to read it)21:59
TheJuliaoh absolutely not parrallel22:00
* TheJulia feels like "#ironic now bikeshedding verbs"22:12
dtantsurgo for it!22:12
dtantsurstevebaker[m]: side note: I'd love to know how much in common we have between metal3/openshift and what you're doing22:35
dtantsurour timezone overlap is disastrous :)22:35
dtantsurmaybe janders could sync with you.. or maybe there is a slot which is not deep night for either of us22:36
JayFdtantsur: just putting this here -- Ironic remote pxe support. e.g. Ironic using a remote agent on a machine to configure http/tftp/pxe environment *there*22:40
* JayF wonders if one could abuse webdav for that22:40
dtantsuron the machine itself? or just splitting away a "PXE as a Service"?22:40
JayFI'm saying if you had an nginx in a node-facing position, it could run an agent/webdav/be-sshed-to to configure pxe/tftp/http boot22:41
JayFPXEaaS makes it sound much more difficult but probably is more truthful to the difficulty22:41
dtantsuryou're inventing a shared directory :)22:41
dtantsurwe'll need locks, so NFS is actually better IMO22:42
opendevreviewMerged openstack/ironic master: Add support auth protocols for iRMC  https://review.opendev.org/c/openstack/ironic/+/85703523:10
stevebaker[m]dtantsur: yeah now that I actually understand the space I'm ready for a proper engagement with metal3. I could do a late night for your morning23:32
opendevreviewJulia Kreger proposed openstack/ironic-specs master: WIP Add a shard key  https://review.opendev.org/c/openstack/ironic-specs/+/86180323:34

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!