Monday, 2020-08-17

openstackgerritJacob Anders proposed openstack/ironic master: [WIP]Generic way to configure clean step priorites  https://review.opendev.org/74411700:24
*** ociuhandu has joined #openstack-ironic01:00
*** ociuhandu has quit IRC01:05
*** yolanda has quit IRC01:26
*** yolanda has joined #openstack-ironic01:26
*** yolanda has quit IRC01:27
*** yolanda has joined #openstack-ironic01:27
*** ociuhandu has joined #openstack-ironic02:25
*** ociuhandu has quit IRC02:29
*** Qianbiao has joined #openstack-ironic02:30
*** mkrai has joined #openstack-ironic03:20
*** ricolin has joined #openstack-ironic03:31
*** dking has quit IRC03:56
*** abdysn has joined #openstack-ironic05:26
*** mkrai has quit IRC06:00
*** mkrai_ has joined #openstack-ironic06:01
ftarasenkoJayF: Gm! Sorry, was afk when you've answered to me. I mean, I want to be able to deploy one image in both in UEFI and BIOS modes for different servers.06:06
ftarasenkoJayF: Regarding uefi configuration, you can look on kolla-ansible playbooks. It has option to configure iroinic for uefi out of the box.06:07
*** belmoreira has joined #openstack-ironic06:45
*** mkrai_ has quit IRC07:07
rpittaugood morning ironic! o/07:40
*** dtantsur|afk is now known as dtantsur07:55
dtantsurgood morning ironic!07:55
* dtantsur has no scrollback whatsoever, any pings have to be repeated07:55
*** lucasagomes has joined #openstack-ironic07:59
*** k_mouza has joined #openstack-ironic08:03
openstackgerritShivanand Tendulker proposed openstack/ironic master: Documentation update for ilo hardware type  https://review.opendev.org/74645308:19
jandersgood morning rpittau and dtantsur08:30
jandersdtantsur how was your break? Did you manage to do the hikes you were planning/08:30
*** Lucas_Gray has joined #openstack-ironic08:30
gudrutis0Yo Ironic08:30
*** mkrai has joined #openstack-ironic08:30
rpittauhey janders :)08:30
*** alexmcleod has joined #openstack-ironic08:32
jandersrpittau how did the move related work go?08:36
rpittaujanders: we're still a bit far from the end, roughly a little bit more than half of the work has been done08:37
*** k_mouza has quit IRC08:41
jandersrpittau well done! :)08:43
jandersdefinitely glass (more than) half full from the sound of it08:44
rpittaujanders: heh thanks, next 3 weeks will be a bit frenetic08:44
jandersI can imagine08:44
jandersdo you have a good overlap period when you have both places so that the move can happen without mad rush?08:44
*** k_mouza has joined #openstack-ironic08:45
rpittaujanders: we have roughly one week between the end of the renovations and the end of the contract in the current apartment, so we should be fine08:46
janderscool! :)08:47
dtantsurjanders: hey, was amazing, thanks! we did manage to get everywhere we planned09:00
dtantsurjanders: like https://twitter.com/creepy_owlet/status/129435694384752640009:00
openstackgerritVerification of a change to openstack/ironic failed: DRAC: Drives conversion from JBOD to RAID  https://review.opendev.org/73850909:05
*** johnhaan has quit IRC09:10
*** arne_wiebalck has quit IRC09:11
*** rajinir has quit IRC09:12
*** arne_wiebalck has joined #openstack-ironic09:14
*** johnhaan has joined #openstack-ironic09:16
*** rajinir has joined #openstack-ironic09:19
hjensasdtantsur: wow! You beat me by 2.5 k meters this summer! :)09:23
dtantsurheh :)09:24
rpittaudtantsur: you should try "Aiguille du midi" next time then :)09:25
* dtantsur googles09:26
jandersdtantsur that's great to hear - and the photos are amazing! :)09:26
jandersvery well done09:26
dtantsurthanks :)09:26
dtantsurrpittau: ah, interesting, so a direct cable car there?09:26
dtantsurat some point in my life, I'd like to ascend Mont Blanc the hardcore way. but that's not soon :)09:27
rpittaudtantsur: yep, you reach that by cable car, I think it's 2 stops if I remember correctly, it's been a while :)09:28
jandersdtantsur how cold was the water in the stream where you're standing bare-footed?09:29
dtantsurit was flowing directly from a glacier above, you guess it :)09:29
jandersgiven the amount of snow lying around I suppose not far off 0C?09:29
janders:)09:30
dtantsurafter 3-4 hrs of walking in mountain shoes, it was a relief though09:30
jandersit definitely would be... I feel like doing something like that after some longer runs sometimes.09:30
jandersdtantsur what camera are you using?09:31
dtantsurjanders: just my Pixel 3a09:32
jandersAmazingly sharp photos for a phone camera.09:34
dtantsuryep, impressed myself09:36
janders...and having 2x the megapixels wouldn't be likely to justify carrying a few kilos of DSLR gear all day :)09:37
dtantsurright :) I used to carry a Canon 500D (IIRC) around, but I no longer09:37
dtantsurthe weight-to-quality ratio in my hands is not worth it09:37
dtantsurand phones are much more usable with one hand, which matters on some parts09:38
jandersvery true09:38
jandersand that's before you start worrying about swapping lenses :)09:38
dtantsurhaha, right09:38
jandersholding to a chain with one hand, swapping one 2k $ lens out for another 2k $ lens... nah09:39
dtantsurI ended up carrying something like a huge 15-300 (don't remember exact numbers), adding even more to the weight09:39
dtantsurexactly :)09:39
jandersis flying drones allowed over there?09:40
dtantsurwell, I've seen at least two09:40
dtantsur(not on this peak though)09:40
janderswould be fun have one following you as you hike the best parts09:40
dtantsuroh, right09:41
dtantsurstill probably won't justify the weight :)09:41
jandersthe small ones are quite light... my current one would be a little annoying but not DSLR-with-the-lot-annonying09:41
dtantsurwell, it has to have a semi-decent camera at the very least. and enough batteries to last 4-8 hours.09:42
dtantsur(the first day we did 8 hours, that was rough)09:42
jandersI think you'd need to launch it just for specific parts of the trail09:43
jandersone batt would be half an hour of flying and you probably don't want to carry too many09:43
janders8hrs.. how many kilometers and how much elevation gain?09:43
*** ociuhandu has joined #openstack-ironic09:44
dtantsurjanders: I'll need to calculate since we improvized a lot09:44
jandersno worries :)09:44
dtantsurone part (~ 2 hrs) was just "oh, let's hike up that mountain" :D09:45
jandersthat's what holidays are for, right? :)09:45
jandersdoing what you feel like doing09:45
dtantsurexactly09:46
janderson a less fun note, if you have time it would be great to have some pointers on debugging CI errors caused by my clean_steps patch09:46
jandershttps://review.opendev.org/#/c/744117/09:46
patchbotpatch 744117 - ironic - [WIP]Generic way to configure clean step priorites - 5 patch sets09:46
jandersI'm struggling a little to find a pattern in those failures09:47
dtantsurso, the planned part was 13.5 km with roughly 300 m up and 1km down09:47
jandersnice! :)09:47
dtantsurthe unplanned probably added 300m up and down a very rough alpine terrain with support ropes in some places09:47
janders13.5km.. that's a fair bit especially in this kind of terrain09:47
dtantsurthat's why it took so long :) granted, it includes one ice-cream stop and the stop at the waterfall :)09:48
jandersIce cream. Important!09:48
jandersOne of the first thing we did on the Recharge day :)09:49
jandersdouble espresso + a good portion of ice cream = rocket fuel09:49
dtantsuroh, there was a restaurant on top of that 3.5km mountain, so we had a lunch with quite some views :)09:49
dtantsur(that was another day)09:49
jandersawesome! :)09:50
jandersthat is what you call a lunch with a view09:50
dtantsurjanders: a proof-pic: https://www.dropbox.com/s/r5bdw3knu9r57t4/2020-08-14%2015.09.05.jpg?dl=009:55
*** tkajinam has quit IRC09:55
openstackgerritRiccardo Pittau proposed openstack/ironic-lib master: Use tenacity to retry convert_image  https://review.opendev.org/74570409:56
jandersdtantsur what's on the menu?09:56
dtantsurjanders: traditional Swiss and German stuff. I had https://en.wikipedia.org/wiki/R%C3%B6sti, my wife - a schnitzel09:57
jandersgiven we're talking Switzerland, I expect a healthy dose of cheese is a must09:57
dtantsurof course!09:57
jandersnice! :)09:58
openstackgerritRiccardo Pittau proposed openstack/ironic-lib master: Use tenacity to retry convert_image  https://review.opendev.org/74570409:59
dtantsurjanders: I haven't spotted any immediate problems with https://review.opendev.org/#/c/744117/ but I did leave some design comments10:04
patchbotpatch 744117 - ironic - [WIP]Generic way to configure clean step priorites - 5 patch sets10:04
*** k_mouza has quit IRC10:10
*** k_mouza has joined #openstack-ironic10:12
*** ociuhandu has quit IRC10:37
*** mkrai has quit IRC10:37
*** mkrai has joined #openstack-ironic10:37
*** priteau has joined #openstack-ironic10:41
*** ricolin has quit IRC10:41
*** mkrai has quit IRC10:48
*** mkrai has joined #openstack-ironic10:48
*** k_mouza has quit IRC10:52
*** k_mouza has joined #openstack-ironic10:55
dtantsuroh, lovely vagrant is broken in CentOS 8...11:18
*** tkajinam has joined #openstack-ironic11:27
*** weshay_ is now known as weshay|ruck11:36
openstackgerritVishal Manchanda proposed openstack/ironic-ui master: [goal] Migrate testing to ubuntu focal  https://review.opendev.org/74470811:46
*** k_mouza has quit IRC11:57
*** rh-jelabarre has joined #openstack-ironic11:58
openstackgerritVishal Manchanda proposed openstack/ironic-ui master: [goal] Migrate testing to ubuntu focal  https://review.opendev.org/74470812:00
*** ricolin has joined #openstack-ironic12:06
*** mkrai has quit IRC12:10
openstackgerritHarald JensÃ¥s proposed openstack/ironic master: Switch Ironic to openstacksdk for Neutron  https://review.opendev.org/73487312:11
*** rh-jelabarre has quit IRC12:18
*** rh-jelabarre has joined #openstack-ironic12:25
openstackgerritVishal Manchanda proposed openstack/ironic-ui master: [goal] Migrate testing to ubuntu focal  https://review.opendev.org/74470812:32
*** ociuhandu has joined #openstack-ironic12:37
jandersdtantsur thank you for your comments in https://review.opendev.org/#/c/744117/12:41
patchbotpatch 744117 - ironic - [WIP]Generic way to configure clean step priorites - 5 patch sets12:41
jandersregarding the multiopt config, am I understanding correctly - is this how it would work? http://paste.openstack.org/show/796885/12:42
*** ociuhandu has quit IRC12:42
rpittaujanders:  that's correct12:47
jandersthank you rpittau12:50
jandersrpittau would you have time to help me understand the CI errors I'm hitting with this patch?12:50
jandersthis way hopefully I can work through these tomorrow morning12:50
rpittaujanders: sure :)12:50
rpittaujanders: which failure ?12:51
jandersmaybe let's start with ironic-standalone12:51
jandersfrom a brief look at the logs it looks like a ping timeout12:51
jandersthe bit I dont understand is - if I were to break ironic badly how come most of the other tests pass...12:51
rpittaujanders: it could be that the failure is not related to your patch, I see that is failing in wholedisk but succeeding in partition12:53
rpittauthe same test I mean12:53
jandersright...12:54
janderswhat's the best thing to do in such cases?12:54
*** mkrai has joined #openstack-ironic12:54
rpittaujanders: I'd spend some time checking the logs, for example the conductor in this case it's showing quite some "ERROR ironic.conductor.manager [None req-461d82b6-8acf-4074-92c1-31956f82ad21 None None] Invalid agent_token receieved for node db19275c-dcbd-4c50-9d22-1e8fce7096c7"12:56
jandersif I think it's not the patch causing the problem, what's the best thing to do? can I trigger CI re-run?12:58
rpittaujanders: you can try issuing a "recheck"12:59
jandershow do I do that?12:59
rpittaujanders: add a comment with the single ord "recheck" in it :)13:00
rpittaus/ord/word13:00
jandersdo I do this in the "reply" menu in the top-level of the patch?13:00
*** mkrai has quit IRC13:00
rpittauyes, hit Reply... and then just put "recheck" and click on Post13:01
jandersdone!13:01
jandersI will see how this run goes, whether the patch fails the same tests13:01
jandersin case of HP tests, I get 404s when I click on the specific one13:03
jandersis it just me, or is there an issue with those in general?13:04
openstackgerritRiccardo Pittau proposed openstack/ironic master: [DNM] test CI  https://review.opendev.org/74649513:04
rpittaujanders: that's probably an issue with HP CI in general13:04
jandersok... and the last one - Dell13:04
jandersI can get the logs no worries for those - but that's a *lot* of logs13:05
janderswhat's a good place to start the investigation?13:05
rpittaujanders: I'm not sure the dell CI is testing rescue/unrescue to be honest, consider that those CIs are maintained by 3rd party vendors, we don't always know the exact status13:06
*** rloo has joined #openstack-ironic13:07
jandersright!13:07
jandersbut the patch needs to pass those to get merged, right?13:07
rpittaujanders: I guess for more info on dell the right person to ask to is rpioso13:07
rpittaujanders: not necessarily13:07
jandersok - so I suppose I need to focus on figuring out what's happening with the two voting tests from the "main" (non-thirdparty) list, correct?13:08
rpittaustendulker is not here right now, but that would be the first contact for HP13:09
rpittaujanders: what should really pass in terms of CI are all the jobs that are not marked as "non-voting" under Zuul check13:09
rpittaukeeping an eye on the non-voting too13:10
jandersok! in this case - I will see how the recheck goes and if the same tests fail again I will read deeper into the logs13:10
jandersthanks rpittau13:12
rpittaujanders: no problem :)13:12
ajyarpioso is off this week, erbarr might help with CI questions13:12
ajyajanders ^13:13
*** Goneri has joined #openstack-ironic13:13
jandersthanks ajya! :)13:13
jandersgood to know13:13
janderswrapping up for the night, see you tomorrow Ironic o/13:14
rpittaujanders: bye!13:16
openstackgerritBob Fournier proposed openstack/ironic-inspector master: Minor doc fix to kernel options  https://review.opendev.org/74650213:16
*** michchap has joined #openstack-ironic13:17
TheJuliagood morning everyone13:31
dtantsurmorning TheJulia13:31
* dtantsur reboots his IRC bouncer, brb13:31
*** dtantsur has quit IRC13:32
* TheJulia tries to wake up13:34
rpittaugood morning TheJulia :)13:34
*** ociuhandu has joined #openstack-ironic13:37
*** dtantsur has joined #openstack-ironic13:38
*** tzumainn has joined #openstack-ironic13:42
*** k_mouza has joined #openstack-ironic13:57
*** k_mouza has quit IRC14:02
*** tkajinam has quit IRC14:06
*** abdysn has quit IRC14:14
*** cdearborn has joined #openstack-ironic14:19
*** k_mouza has joined #openstack-ironic14:27
*** sshnaidm is now known as sshnaidm|MYG14:27
*** sshnaidm|MYG is now known as sshnaidm|mtg14:27
openstackgerritVishal Manchanda proposed openstack/ironic-ui master: [goal] Migrate testing to ubuntu focal  https://review.opendev.org/74470814:34
openstackgerritVerification of a change to openstack/bifrost failed: Validate that the services are running after installation  https://review.opendev.org/74356914:42
openstackgerritMerged openstack/ironic-inspector master: Follow up to incorrect pxe-enabled was set  https://review.opendev.org/73875214:51
openstackgerritMerged openstack/ironic-inspector master: Minor doc fix to kernel options  https://review.opendev.org/74650214:51
TheJuliai'm sensing the ci universe dislikes us this week14:53
*** kaifeng has joined #openstack-ironic14:55
dtantsur"this week"??14:56
TheJuliawell14:56
dtantsuror was it nice while I was out?14:56
TheJuliaI mean... it hates us14:56
dtantsurjust tell me I have to go back :D14:56
TheJuliaIt was moderately well behaved14:56
TheJuliawe actually got a bunch of backports landed14:56
*** stendulker has joined #openstack-ironic14:58
*** gyee has joined #openstack-ironic14:58
TheJulia#startmeeting ironic15:00
openstackMeeting started Mon Aug 17 15:00:18 2020 UTC and is due to finish in 60 minutes.  The chair is TheJulia. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
TheJuliao/15:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
*** openstack changes topic to " (Meeting topic: ironic)"15:00
openstackThe meeting name has been set to 'ironic'15:00
rpittauo/15:00
stendulkero/15:00
TheJuliaGood morning Ironic!15:00
TheJuliaOur meeting agenda this week can be found on the wiki.15:00
TheJulia#link https://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_next_meeting15:00
ajyao/15:00
kaifengo/15:01
rpioso\o15:01
rlooo/15:01
TheJuliaERROR: Insufficent [\o|o/] : More coffee required15:01
TheJulia:)15:01
TheJulia#topic Announcements / Reminder15:01
*** openstack changes topic to "Announcements / Reminder (Meeting topic: ironic)"15:01
cdearborno/15:01
dtantsuro/15:01
TheJuliaWe had several of our components have their second release of the cycle last week. We have a couple others still in the final pipeline as they were not approved last week.15:02
bfournieo/15:02
TheJuliaAside from that, all quiet. Does anyone have anything to announce or remind us of?15:02
* TheJulia hears https://www.youtube.com/watch?v=K8E_zMLCRNg :)15:03
TheJulia(crickets)15:03
dtantsura reminder:15:03
dtantsurafter creating a bugfix branch, do NOT approve the constraints changes15:04
dtantsurwe need to fix the release tooling not to propose them at all, they're broken15:04
rpittaudid we forget to release something ?15:04
rpittaudtantsur: yeah15:04
TheJuliadtantsur: definitely need to fix the tooling then, they are too easy to auto-pilot approve on15:04
dtantsurfor now manually update the patches to replace X.Y with victoria15:04
dtantsuryep15:04
dtantsurI had to hold my hand several times already15:04
TheJuliaDo we have any to revert?15:04
rloowonder if there is anywhere else we can record that info, cuz yeah, too easy to approve :-(15:05
dtantsurTheJulia: we need to fix one, inspector or bifrost, I don't remember15:05
TheJuliaWell, we can't even update them manually now because the victoria branch does not exist yet15:05
TheJuliajoy!15:06
rpittaubtw the release tool now has a new option for intermediate-branch https://review.opendev.org/74591815:06
patchbotpatch 745918 - releases - Add intermediate-branch arg to new-release script (MERGED) - 1 patch set15:06
TheJuliaOkay, well, we can carry on!15:06
TheJuliaWe had no action items from our last meeting, so if there is no objection we can proceed to the whiteboard15:06
* TheJulia hears no objections15:07
TheJulia#topic Review subteam status reports15:07
*** openstack changes topic to "Review subteam status reports (Meeting topic: ironic)"15:07
TheJulia#link https://etherpad.openstack.org/p/IronicWhiteBoard15:08
dtantsurTheJulia: the victoria branch does not exist, but the constraints link does15:08
TheJuliadtantsur: ack15:08
dtantsuri.e. https://releases.openstack.org/constraints/upper/victoria is already valid and should be used15:08
TheJuliaStarting around line 310 on the whiteboard15:08
dtantsur(it redirects to master)15:08
*** Qianbiao has quit IRC15:09
*** dking has joined #openstack-ironic15:11
TheJuliaLooks like the Standalone auth item is done?15:11
dtantsurI hope so15:11
TheJuliaI see the WSME related changes are continuing to move forward although they seem to be fighting CI headaches15:13
TheJuliaLooks like duplicate job changes have kind of stalled?15:14
* TheJulia sees dtantsur add an update for the section she was about to ask about15:16
dtantsurheh15:16
rpittauwe should maybe decide if we want to keep the name of the image used in the jobs, tinyipa or dib15:16
TheJuliarpioso: arne_wiebalck: rpittau: Any new updates on the redfish interop profiles. (This is where dating notes helps a lot)15:17
TheJuliarpittau: that is a good question15:17
rpittauTheJulia: no news, I think last ujpdate is from arne_wiebalck on July 2815:18
TheJuliarpittau: ack15:18
TheJuliaI guess once arne_wiebalck is mentally back we'll need to discuss next steps15:18
rpittauI think rpioso is giving an update :)15:19
TheJuliawesome15:19
TheJuliaawesome15:19
*** belmoreira has quit IRC15:20
TheJuliaawesome15:21
rpiosorpittau, TheJulia: Done15:21
TheJuliaWell, is everyone good to move onward?15:21
rpittaurpioso: thanks!15:21
rpiosoTheJulia: yw15:21
TheJuliaEveryone good to proceed to priorites for the week?15:22
rpittaulet's15:23
TheJulia#topic Deciding on priorities for the coming week15:23
*** openstack changes topic to "Deciding on priorities for the coming week (Meeting topic: ironic)"15:23
TheJulia#link https://etherpad.opendev.org/p/IronicWhiteBoard15:23
TheJuliaStarting at line 15915:24
TheJuliaFirst up, clean up the merged items!15:24
TheJuliaOkay, I've staged some items at line 238 through 262. Any objections to adding them?15:25
TheJuliaAny additional items people would like to see added?15:25
* dtantsur has an empty list this time15:26
rpittaushould be ok15:26
TheJuliaDoes the list look good at this time?15:28
rpittauyep15:29
TheJuliaSo onward to discussion! Although one item was raised for discussion in the list of items to review. :)15:30
TheJuliaWe sort of briefly visited it last week, so we can get to that again during Open Discussion15:30
TheJulia#topic Discussion15:30
*** openstack changes topic to "Discussion (Meeting topic: ironic)"15:30
TheJuliaOne item this week, and largely raising, yet another question, when shall we have another midcycle?15:30
* TheJulia wonders if youtube would grant her another random crickets video15:32
rpittauvictoria will be released on October 14th, so maybe in 2 weeks ?15:32
rpittautoo short notice?15:32
TheJuliaI think that is about perfect15:32
TheJuliaAny volunteers to create a poll?15:33
rpittauthat should be the  1st week of September15:33
rpittauI can do it15:33
TheJuliaWe can start an etherpad this week as well for ideas15:33
TheJuliaAwesome!15:34
rpittausounds good15:34
TheJuliaAnyone disagree?15:34
TheJuliaor have any other thoughts on the topic before we jump to Open Discussion?15:34
TheJuliaarne_wiebalck: I'm guessing Baremetal SIG has nothing this week to discuss at the moment, please let me know if this is not the case15:35
* TheJulia hears crickets15:37
TheJulia#topic Open Discussion15:37
*** openstack changes topic to "Open Discussion (Meeting topic: ironic)"15:37
TheJuliaSo one item to be revisited I guess for open discussion is https://etherpad.opendev.org/p/IronicWhiteBoard line # 169.15:38
TheJuliaWhich kind of brings back the question of "How would an operator interact?", I'm wondering if anyone has more thoughts on this?15:38
* TheJulia senses she needs to brew coffee for the IRC channel this morning15:40
kaifengarne_wiebalck seems ok with populating properties :)15:40
kaifengbut the overhead for large-scale cloud, I don't have the precise stats of the overhead15:41
TheJuliaA lot of CPU time and api calls gets consumed keeping nova in sync with ironic. So adding more work to that series of events requires careful consideration15:42
TheJuliaI guess I was also wondering if it would be data operators would ever have to change15:42
TheJuliaor would it be entirely inspector managed15:43
stendulkerHow are these acclerator devices in node supposed to be used? To create resource classes subsequently...15:44
TheJuliaGreat question15:44
kaifengthey are expected to be used for scheduling15:44
* TheJulia wonders if so, do we publish it directly...15:45
stendulkerkaifeng: through capabilities?15:45
TheJuliaThat would allieviate most of my scale concern15:45
dkingJayF: Thank you for the great information the other day regarding Hardware Managers. They seem to be more simple than I had expected, which is good. One thing that I don't fully understand, though, is how they are loaded. Is it supposed to be that the code is just placed into the hardware_managers directory? I tried that, and tried clearing the cache directory, but the new ones still don't seem to be loaded.15:45
kaifengfor precise scheduling, user can create accel profile in the flavor, it can't be satisfied by trait, it's too simple.15:46
TheJuliadking: it has to be installed so the package setup metadata can point to it as a distinct endpoint... if memory serves15:46
kaifengNo, not going through capabilities, actually it's barely used in the resource class based scheduling15:47
dkingTheJulia: Okay. I didn't find any information on actually installing the new hardware managers, only info on how to create them and how they work.15:47
dtantsurdking: are you following the examples? https://opendev.org/openstack/ironic-python-agent/src/branch/master/examples15:48
stendulkerkaifeng: is it something like in cyborg? https://docs.openstack.org/api-guide/compute/accelerator-support.html15:48
TheJuliadking: this package: https://opendev.org/x/proliantutils/src/branch/master/setup.cfg#L31 has an example of the entrypoint creation. When installed as a python package, the data is updated and ironic_python_agent finds it as a result15:48
dkingdtantsur: Yes, those were the ones I was trying to mimic.... Oh, I see now that readme mentions setup.cfg. Let me check that.15:49
TheJuliadking: funny thing is, that package also has other code totally unrelated to the hardware manager embedded in it (in other words, its a good example)15:49
kaifengstendulker: it is, we are pairing with virtual machine in accelerator support15:49
dtantsurour examples also have setup.cfg https://opendev.org/openstack/ironic-python-agent/src/branch/master/examples/business-logic/setup.cfg15:49
stendulkerkaifeng: ok15:49
TheJuliadtantsur: \o/15:50
ajyaRegarding the spec at https://review.opendev.org/#/c/740721/12 I left a comment at the very end about ways to improve security for configuration file storage. Can anyone take a look and see if that's OK direction to go or suggest alternatives?15:50
patchbotpatch 740721 - ironic-specs - Operationally efficient & fast-track provisioning - 12 patch sets15:50
TheJuliaajya: I should be able to look later today or tomorrow15:51
ajyathanks, TheJulia15:51
kaifengI think the scaling issue can't be addressed by introducing a new field, as a scheduling metric, it has to be collected by the data consumer AIUI,15:51
openstackgerritMerged openstack/ironic-inspector master: Fix URL parsing to enable redfish_address matching  https://review.opendev.org/74597215:52
stendulkerkaifeng: There are some accel discovery done by IRMC driver https://github.com/openstack/ironic/blob/master/ironic/conf/irmc.py#L83-L10015:52
TheJuliakaifeng: as long as we're getting the field in the same get request from ironic, that is about all that really can be done... I think.15:52
TheJuliakaifeng: the additional dictionary handling in nova-compute wouldn't be great but I guess it would be necessary15:53
openstackgerritMerged openstack/networking-generic-switch master: Generate key on PEM format  https://review.opendev.org/73918615:55
kaifengstendulker: thanks for the link, will take a look, looks like something we have in the pci_devices plugin from inspector15:55
TheJuliastendulker: I think where what kaifeng is proposing is different is wanting to take it further to facilitate scheduling data population somehow15:55
TheJuliawow, two changes merged. I guess CI maybe might be a little happier today then it was at first look?15:55
TheJuliaWell everyone, we're about at time.15:56
TheJuliaIf there is nothing else we can end the meeting15:56
stendulkerkaifeng, TheJulia : Yes, I understand. I was pointing that we would have to consolidate them in a fashion that would be usable. I think even ilo has some inspection data around gpus.15:56
TheJuliastendulker: ahh!15:56
stendulkerilo driver15:56
TheJuliastendulker: I see, makes sense15:56
*** priteau has quit IRC15:57
stendulkeri think its just dumped in node properties as these were done when capabilities was getting used for scheduling15:57
TheJulia:\15:58
TheJuliaThis seems like a larger conundrum that needs to be visited15:58
TheJuliaAnyway, Thanks everyone!15:58
rpittauthanks115:59
TheJulia#endmeeting15:59
*** openstack changes topic to "Bare Metal Provisioning | Status: http://bit.ly/ironic-whiteboard | Docs: http://docs.openstack.org/ironic/ | Bugs: https://storyboard.openstack.org/#!/project_group/75 | Contributors are generally present between 6 AM and 12 AM UTC, If we do not answer, please feel free to pose questions to openstack-discuss mailing list."15:59
openstackMeeting ended Mon Aug 17 15:59:32 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:59
openstackMinutes:        http://eavesdrop.openstack.org/meetings/ironic/2020/ironic.2020-08-17-15.00.html15:59
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/ironic/2020/ironic.2020-08-17-15.00.txt15:59
openstackLog:            http://eavesdrop.openstack.org/meetings/ironic/2020/ironic.2020-08-17-15.00.log.html15:59
rpittauTheJulia: virtual meetup doodle: will 2 hours be ok as last time? or do we want multiple days/more time per day?16:00
kaifengstendulker: a quick checking on the irmc, it populates properites and might add trait support in a later time16:01
kaifengsuch information is not accurate, as user may need to "I want to this kind of GPU" instead of "Give me a GPU"16:01
*** lucasagomes has quit IRC16:02
TheJuliarpittau: 2 hours and I guess looking for two days?16:02
rpittauTheJulia: ack16:02
*** mkrai has joined #openstack-ironic16:02
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Validate that the services are running after installation  https://review.opendev.org/74356916:03
*** stendulker has quit IRC16:05
*** sshnaidm|mtg is now known as sshnaidm16:08
dtantsuranyone seen this from libvirt? "internal error: Network is already in use by interface enp1s016:15
dtantsurmmm, too many networks, sigh16:16
rpittaudtantsur, TheJulia: https://review.opendev.org/74655316:30
patchbotpatch 746553 - project-config - Do not update upper constraints for intermediate b... - 1 patch set16:30
*** belmoreira has joined #openstack-ironic16:33
TheJuliathanks rpittau16:34
*** belmoreira has quit IRC16:36
*** k_mouza has quit IRC16:37
dkingI just noticed that my baremetal servers don't have any swap setup by default. Is there an option to add that, or is that something that would need to be setup after they are deployed?16:41
*** Lucas_Gray has quit IRC16:52
*** dtantsur is now known as dtantsur|afk16:59
dtantsur|afkout tomorrow (yes, again), so see you on Wednesday!16:59
dtantsur|afkdking: there is an instance_info field for partition images, I don't remember by heart16:59
dtantsur|afkprobably swap_mb16:59
TheJuliamy memory is saying swap_mb as well17:01
TheJuliadking: you can also just add it in the image, but you'll have to ensure it is pre-formatted and in the fstab for the image as well17:01
dkingThanks. I think that if there's an option to do it from instance_info, that would be better as I could have different settings while keeping the same image.17:02
dkingHowever, I don't see that option listed on https://docs.openstack.org/ironic/latest/install/standalone.html17:03
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Validate that the services are running after installation  https://review.opendev.org/74356917:03
*** mkrai has quit IRC17:05
openstackgerritJulia Kreger proposed openstack/ironic master: ISO ramdisk virtual media test enablement  https://review.opendev.org/73638317:15
openstackgerritMerged openstack/ironic stable/train: DRAC: Drives conversion from JBOD to RAID  https://review.opendev.org/73850917:16
TheJuliadking: yeah, because we only ever did that for partition images17:16
TheJuliaand I think cloud-init does or did look for swap partitions to use17:17
dkingOkay. Thanks for hte info.17:28
dkingGetting back to hardware_managers, though, I think I'm a bit lost. Could somebody help me understand all the steps involved in installing one. I imagine that it would start with DIB and installing ironic-python-agent-builder, which is essentially a wrapper to setup a custom ELEMENTS_PATH, but I'm not sure how to get one in the image from there.17:38
TheJuliadking: well, you would likely want to make an element that installed the plugin17:43
TheJuliaeither from source or your favorite packaging utility17:43
JayFTheJulia: dtantsur|afk: When adding oslo.service support to IPA, was there an explicit reason `use_ssl` wasn't exposed for the oslo.service wsgi server? (Loaded question: I hooked it up downstream, and it causes requests to hang, but adding an eventlet.sleep https://github.com/eventlet/eventlet/blob/master/eventlet/wsgi.py#L995 here fixed it)17:56
TheJuliaJayF: define requests to hang17:57
TheJuliawhat exactly is occuring with the requests where they are hanging17:58
JayFno response to an HTTPS client connecting, in debug mode, last log is the "accepted" log from eventlet.wsgi17:58
JayFafter some debugging with jroll, we determined that serv.process_request (which is spawned in a thread in above linked code) never gets run at all without that eventlet.sleep(0) after it's spawned17:58
TheJuliaweird that it would hang that way, but I guess it would be required17:59
JayF(with the eventlet.sleep(0) there, it seems to work OK; but given how non-responsive the eventlet backdoor was, I suspect there's still other shenanigans there)17:59
JayFI was going to upstream the ssl support if I got it working; obviously I'm sorta at a wall now17:59
JayFnot trying to nerd snipe a fix, more gain insight if you all had the same problem (and so didn't hook up `use_ssl`) or if it was just not worth it at the time18:00
JayFI'm probably going to be filing a bug with oslo.service and eventlet about this, and going the "run a proxy in the ramdisk" route for TLS+client cert auth, it's just unfortunate because the code to hook this up is minimal if it worked18:00
bnemecThere was a fix recently in oslo.service that was related to ssl/eventlet/py3.18:01
JayFIt was limited to unit tests AFAICT18:01
JayFI reproduced this with master oslo.service18:01
bnemecYeah, you're right. No functional changes.18:02
* bnemec shakes his fist at eventlet. Again.18:02
TheJuliaJayF: I suspect it just not wired up for mvp practicality reasons and not the issue your encoutering18:20
*** hoonetorg has joined #openstack-ironic18:29
JayFack; I'll file the tickets upstream with oslo.service and eventlet ,see what happens. If they fix it, I might push up my local change -- which just equates `listen_ssl` in config to what is passed to `use_ssl` in the oslo.service object18:29
TheJuliaok18:29
JayFalso, filed a bug about listen_port/listen_host not being honored since the oslo.service transition. I have downstream code to fix listen_port (happy to push it up), but need to make it fix listen_host as well18:30
TheJuliathat would be appreciated18:30
JayFno promises because I don't wanna break promises, but it's on my list for the next two weeks18:30
TheJuliaUnderstood, thanks!18:31
*** kaifeng has quit IRC18:34
*** belmoreira has joined #openstack-ironic19:13
*** stevebaker has joined #openstack-ironic19:33
*** belmoreira has quit IRC20:43
*** ociuhandu has quit IRC21:39
*** trandles has joined #openstack-ironic21:45
trandlesjust to close the loop on my problems from Friday...I was running too new version of kernel for systemd...rolling back fixed the issue21:45
*** mgoddard has quit IRC22:10
*** mgoddard has joined #openstack-ironic22:18
*** janders has quit IRC22:18
*** ijw has joined #openstack-ironic22:25
*** rcernin has joined #openstack-ironic22:33
*** Lucas_Gray has joined #openstack-ironic22:41
TheJuliatrandles: I was off Friday, what was the issue?!?22:47
JayFTheJulia: tl;dr https://bugzilla.redhat.com/show_bug.cgi?id=185373622:49
openstackbugzilla.redhat.com bug 1853736 in systemd "systemctl show service fails with "Failed to parse bus message: Invalid argument"" [Unspecified,Closed: errata] - Assigned to systemd-maint22:49
JayFI was giving them moral support lol22:49
TheJuliajoy!22:50
TheJuliaJayF: \o/22:50
JayFoh TheJulia btw, there's an error in our docs -- we indicate that IPA reads /etc/ironic_python_agent/ironic_python_agent.conf by default; but it does that only if `--config-file [path]` is set22:52
JayFTheJulia: unsure if that's an IPA bug or a docs bug22:52
TheJuliahmm22:54
TheJuliaNot sure22:54
JayFMy hunch is oslo_config changed behavior at some point, IDK for sure22:55
JayFnot really a major issue, just something to hrm at22:55
*** Lucas_Gray has quit IRC23:04
*** tkajinam has joined #openstack-ironic23:07
trandlesTheJulia, what JayF said...bifrost got much further with install today until DOB puked trying to build the debian image23:13
trandlesDIB23:13
trandleswe're behind a proxy so it's probably related to that given this:        "2020-08-17 22:17:44.038 | E: Failed getting release file http://deb.debian.org/debian/dists/buster/Release"23:16
trandlesanyway, that's for tomorrow o/23:16
*** trandles has quit IRC23:17
TheJuliatradles: Tha.. GAH!23:17
*** janders has joined #openstack-ironic23:17
TheJuliao/ janders23:17
jandersgood morning TheJulia o/23:18
jandershow was your weekend mammoth drive?23:18
TheJuliaIt didn't happen. Thursday night my father called and didn't want me to come visit this weekend23:18
jandersright!23:19
jandershave you managed to have a nice relaxing long weekend in this case?23:19
TheJuliaSo I cleaned and did some stuff around the house. Plotted making a air ram scoop intake for my Fiesta23:19
jandershaha :)23:21
jandersour 4WD could do with one of those, instead of having the intercooler under the RHS front light23:21
TheJuliaBadCub who is not on IRC these days... had the front end of his Fiesta removed so I went and took some photos/measurements23:21
TheJuliaoh, intercooler upgrade is also required... Just likely not from Mountune23:22
jandersit's silly to put the intercooler in harm's way in event of even a small collision and even more so in a 4WD. Having it on the top of the engine, Subaru style would be heaps better.23:22
TheJuliaif I do it, Air ram intake + intercooler at the same time23:22
TheJuliaswapping the turbo would be hard here23:23
jandersIs it the ST series, or a more custom sporty fiesta?23:24
janderss/f/F23:24
TheJuliaST23:24
jandersnice!23:26
janderslittle weapon23:26
jandersunmodified it probably has like 20% more power than either of my cars, though it's half the weight of the 4WD and a fair bit lighter than the Lancer23:27
janderson the Ironic topic.. my little patch failed CI early yesterday but I re-ran CI overnight and it's all good now23:32
jandersis it likely CI was having some hiccups or is it likely that my code is intermittently failing?23:32
*** ociuhandu has joined #openstack-ironic23:39
*** ociuhandu has quit IRC23:45
TheJulialikely CI23:51
TheJuliabut good to make sure it is not your code23:51
TheJuliaas in, not something that relates. Often most failures are totally unrelated though23:51
*** Goneri has quit IRC23:54
jandersACK. Thanks TheJulia23:56

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!