openstackgerrit | Jacob Anders proposed openstack/ironic master: [WIP]Generic way to configure clean step priorites https://review.opendev.org/744117 | 00:24 |
---|---|---|
*** ociuhandu has joined #openstack-ironic | 01:00 | |
*** ociuhandu has quit IRC | 01:05 | |
*** yolanda has quit IRC | 01:26 | |
*** yolanda has joined #openstack-ironic | 01:26 | |
*** yolanda has quit IRC | 01:27 | |
*** yolanda has joined #openstack-ironic | 01:27 | |
*** ociuhandu has joined #openstack-ironic | 02:25 | |
*** ociuhandu has quit IRC | 02:29 | |
*** Qianbiao has joined #openstack-ironic | 02:30 | |
*** mkrai has joined #openstack-ironic | 03:20 | |
*** ricolin has joined #openstack-ironic | 03:31 | |
*** dking has quit IRC | 03:56 | |
*** abdysn has joined #openstack-ironic | 05:26 | |
*** mkrai has quit IRC | 06:00 | |
*** mkrai_ has joined #openstack-ironic | 06:01 | |
ftarasenko | JayF: Gm! Sorry, was afk when you've answered to me. I mean, I want to be able to deploy one image in both in UEFI and BIOS modes for different servers. | 06:06 |
ftarasenko | JayF: Regarding uefi configuration, you can look on kolla-ansible playbooks. It has option to configure iroinic for uefi out of the box. | 06:07 |
*** belmoreira has joined #openstack-ironic | 06:45 | |
*** mkrai_ has quit IRC | 07:07 | |
rpittau | good morning ironic! o/ | 07:40 |
*** dtantsur|afk is now known as dtantsur | 07:55 | |
dtantsur | good morning ironic! | 07:55 |
* dtantsur has no scrollback whatsoever, any pings have to be repeated | 07:55 | |
*** lucasagomes has joined #openstack-ironic | 07:59 | |
*** k_mouza has joined #openstack-ironic | 08:03 | |
openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Documentation update for ilo hardware type https://review.opendev.org/746453 | 08:19 |
janders | good morning rpittau and dtantsur | 08:30 |
janders | dtantsur how was your break? Did you manage to do the hikes you were planning/ | 08:30 |
*** Lucas_Gray has joined #openstack-ironic | 08:30 | |
gudrutis0 | Yo Ironic | 08:30 |
*** mkrai has joined #openstack-ironic | 08:30 | |
rpittau | hey janders :) | 08:30 |
*** alexmcleod has joined #openstack-ironic | 08:32 | |
janders | rpittau how did the move related work go? | 08:36 |
rpittau | janders: we're still a bit far from the end, roughly a little bit more than half of the work has been done | 08:37 |
*** k_mouza has quit IRC | 08:41 | |
janders | rpittau well done! :) | 08:43 |
janders | definitely glass (more than) half full from the sound of it | 08:44 |
rpittau | janders: heh thanks, next 3 weeks will be a bit frenetic | 08:44 |
janders | I can imagine | 08:44 |
janders | do you have a good overlap period when you have both places so that the move can happen without mad rush? | 08:44 |
*** k_mouza has joined #openstack-ironic | 08:45 | |
rpittau | janders: we have roughly one week between the end of the renovations and the end of the contract in the current apartment, so we should be fine | 08:46 |
janders | cool! :) | 08:47 |
dtantsur | janders: hey, was amazing, thanks! we did manage to get everywhere we planned | 09:00 |
dtantsur | janders: like https://twitter.com/creepy_owlet/status/1294356943847526400 | 09:00 |
openstackgerrit | Verification of a change to openstack/ironic failed: DRAC: Drives conversion from JBOD to RAID https://review.opendev.org/738509 | 09:05 |
*** johnhaan has quit IRC | 09:10 | |
*** arne_wiebalck has quit IRC | 09:11 | |
*** rajinir has quit IRC | 09:12 | |
*** arne_wiebalck has joined #openstack-ironic | 09:14 | |
*** johnhaan has joined #openstack-ironic | 09:16 | |
*** rajinir has joined #openstack-ironic | 09:19 | |
hjensas | dtantsur: wow! You beat me by 2.5 k meters this summer! :) | 09:23 |
dtantsur | heh :) | 09:24 |
rpittau | dtantsur: you should try "Aiguille du midi" next time then :) | 09:25 |
* dtantsur googles | 09:26 | |
janders | dtantsur that's great to hear - and the photos are amazing! :) | 09:26 |
janders | very well done | 09:26 |
dtantsur | thanks :) | 09:26 |
dtantsur | rpittau: ah, interesting, so a direct cable car there? | 09:26 |
dtantsur | at some point in my life, I'd like to ascend Mont Blanc the hardcore way. but that's not soon :) | 09:27 |
rpittau | dtantsur: yep, you reach that by cable car, I think it's 2 stops if I remember correctly, it's been a while :) | 09:28 |
janders | dtantsur how cold was the water in the stream where you're standing bare-footed? | 09:29 |
dtantsur | it was flowing directly from a glacier above, you guess it :) | 09:29 |
janders | given the amount of snow lying around I suppose not far off 0C? | 09:29 |
janders | :) | 09:30 |
dtantsur | after 3-4 hrs of walking in mountain shoes, it was a relief though | 09:30 |
janders | it definitely would be... I feel like doing something like that after some longer runs sometimes. | 09:30 |
janders | dtantsur what camera are you using? | 09:31 |
dtantsur | janders: just my Pixel 3a | 09:32 |
janders | Amazingly sharp photos for a phone camera. | 09:34 |
dtantsur | yep, impressed myself | 09:36 |
janders | ...and having 2x the megapixels wouldn't be likely to justify carrying a few kilos of DSLR gear all day :) | 09:37 |
dtantsur | right :) I used to carry a Canon 500D (IIRC) around, but I no longer | 09:37 |
dtantsur | the weight-to-quality ratio in my hands is not worth it | 09:37 |
dtantsur | and phones are much more usable with one hand, which matters on some parts | 09:38 |
janders | very true | 09:38 |
janders | and that's before you start worrying about swapping lenses :) | 09:38 |
dtantsur | haha, right | 09:38 |
janders | holding to a chain with one hand, swapping one 2k $ lens out for another 2k $ lens... nah | 09:39 |
dtantsur | I ended up carrying something like a huge 15-300 (don't remember exact numbers), adding even more to the weight | 09:39 |
dtantsur | exactly :) | 09:39 |
janders | is flying drones allowed over there? | 09:40 |
dtantsur | well, I've seen at least two | 09:40 |
dtantsur | (not on this peak though) | 09:40 |
janders | would be fun have one following you as you hike the best parts | 09:40 |
dtantsur | oh, right | 09:41 |
dtantsur | still probably won't justify the weight :) | 09:41 |
janders | the small ones are quite light... my current one would be a little annoying but not DSLR-with-the-lot-annonying | 09:41 |
dtantsur | well, it has to have a semi-decent camera at the very least. and enough batteries to last 4-8 hours. | 09:42 |
dtantsur | (the first day we did 8 hours, that was rough) | 09:42 |
janders | I think you'd need to launch it just for specific parts of the trail | 09:43 |
janders | one batt would be half an hour of flying and you probably don't want to carry too many | 09:43 |
janders | 8hrs.. how many kilometers and how much elevation gain? | 09:43 |
*** ociuhandu has joined #openstack-ironic | 09:44 | |
dtantsur | janders: I'll need to calculate since we improvized a lot | 09:44 |
janders | no worries :) | 09:44 |
dtantsur | one part (~ 2 hrs) was just "oh, let's hike up that mountain" :D | 09:45 |
janders | that's what holidays are for, right? :) | 09:45 |
janders | doing what you feel like doing | 09:45 |
dtantsur | exactly | 09:46 |
janders | on a less fun note, if you have time it would be great to have some pointers on debugging CI errors caused by my clean_steps patch | 09:46 |
janders | https://review.opendev.org/#/c/744117/ | 09:46 |
patchbot | patch 744117 - ironic - [WIP]Generic way to configure clean step priorites - 5 patch sets | 09:46 |
janders | I'm struggling a little to find a pattern in those failures | 09:47 |
dtantsur | so, the planned part was 13.5 km with roughly 300 m up and 1km down | 09:47 |
janders | nice! :) | 09:47 |
dtantsur | the unplanned probably added 300m up and down a very rough alpine terrain with support ropes in some places | 09:47 |
janders | 13.5km.. that's a fair bit especially in this kind of terrain | 09:47 |
dtantsur | that's why it took so long :) granted, it includes one ice-cream stop and the stop at the waterfall :) | 09:48 |
janders | Ice cream. Important! | 09:48 |
janders | One of the first thing we did on the Recharge day :) | 09:49 |
janders | double espresso + a good portion of ice cream = rocket fuel | 09:49 |
dtantsur | oh, there was a restaurant on top of that 3.5km mountain, so we had a lunch with quite some views :) | 09:49 |
dtantsur | (that was another day) | 09:49 |
janders | awesome! :) | 09:50 |
janders | that is what you call a lunch with a view | 09:50 |
dtantsur | janders: a proof-pic: https://www.dropbox.com/s/r5bdw3knu9r57t4/2020-08-14%2015.09.05.jpg?dl=0 | 09:55 |
*** tkajinam has quit IRC | 09:55 | |
openstackgerrit | Riccardo Pittau proposed openstack/ironic-lib master: Use tenacity to retry convert_image https://review.opendev.org/745704 | 09:56 |
janders | dtantsur what's on the menu? | 09:56 |
dtantsur | janders: traditional Swiss and German stuff. I had https://en.wikipedia.org/wiki/R%C3%B6sti, my wife - a schnitzel | 09:57 |
janders | given we're talking Switzerland, I expect a healthy dose of cheese is a must | 09:57 |
dtantsur | of course! | 09:57 |
janders | nice! :) | 09:58 |
openstackgerrit | Riccardo Pittau proposed openstack/ironic-lib master: Use tenacity to retry convert_image https://review.opendev.org/745704 | 09:59 |
dtantsur | janders: I haven't spotted any immediate problems with https://review.opendev.org/#/c/744117/ but I did leave some design comments | 10:04 |
patchbot | patch 744117 - ironic - [WIP]Generic way to configure clean step priorites - 5 patch sets | 10:04 |
*** k_mouza has quit IRC | 10:10 | |
*** k_mouza has joined #openstack-ironic | 10:12 | |
*** ociuhandu has quit IRC | 10:37 | |
*** mkrai has quit IRC | 10:37 | |
*** mkrai has joined #openstack-ironic | 10:37 | |
*** priteau has joined #openstack-ironic | 10:41 | |
*** ricolin has quit IRC | 10:41 | |
*** mkrai has quit IRC | 10:48 | |
*** mkrai has joined #openstack-ironic | 10:48 | |
*** k_mouza has quit IRC | 10:52 | |
*** k_mouza has joined #openstack-ironic | 10:55 | |
dtantsur | oh, lovely vagrant is broken in CentOS 8... | 11:18 |
*** tkajinam has joined #openstack-ironic | 11:27 | |
*** weshay_ is now known as weshay|ruck | 11:36 | |
openstackgerrit | Vishal Manchanda proposed openstack/ironic-ui master: [goal] Migrate testing to ubuntu focal https://review.opendev.org/744708 | 11:46 |
*** k_mouza has quit IRC | 11:57 | |
*** rh-jelabarre has joined #openstack-ironic | 11:58 | |
openstackgerrit | Vishal Manchanda proposed openstack/ironic-ui master: [goal] Migrate testing to ubuntu focal https://review.opendev.org/744708 | 12:00 |
*** ricolin has joined #openstack-ironic | 12:06 | |
*** mkrai has quit IRC | 12:10 | |
openstackgerrit | Harald Jensås proposed openstack/ironic master: Switch Ironic to openstacksdk for Neutron https://review.opendev.org/734873 | 12:11 |
*** rh-jelabarre has quit IRC | 12:18 | |
*** rh-jelabarre has joined #openstack-ironic | 12:25 | |
openstackgerrit | Vishal Manchanda proposed openstack/ironic-ui master: [goal] Migrate testing to ubuntu focal https://review.opendev.org/744708 | 12:32 |
*** ociuhandu has joined #openstack-ironic | 12:37 | |
janders | dtantsur thank you for your comments in https://review.opendev.org/#/c/744117/ | 12:41 |
patchbot | patch 744117 - ironic - [WIP]Generic way to configure clean step priorites - 5 patch sets | 12:41 |
janders | regarding the multiopt config, am I understanding correctly - is this how it would work? http://paste.openstack.org/show/796885/ | 12:42 |
*** ociuhandu has quit IRC | 12:42 | |
rpittau | janders: that's correct | 12:47 |
janders | thank you rpittau | 12:50 |
janders | rpittau would you have time to help me understand the CI errors I'm hitting with this patch? | 12:50 |
janders | this way hopefully I can work through these tomorrow morning | 12:50 |
rpittau | janders: sure :) | 12:50 |
rpittau | janders: which failure ? | 12:51 |
janders | maybe let's start with ironic-standalone | 12:51 |
janders | from a brief look at the logs it looks like a ping timeout | 12:51 |
janders | the bit I dont understand is - if I were to break ironic badly how come most of the other tests pass... | 12:51 |
rpittau | janders: it could be that the failure is not related to your patch, I see that is failing in wholedisk but succeeding in partition | 12:53 |
rpittau | the same test I mean | 12:53 |
janders | right... | 12:54 |
janders | what's the best thing to do in such cases? | 12:54 |
*** mkrai has joined #openstack-ironic | 12:54 | |
rpittau | janders: I'd spend some time checking the logs, for example the conductor in this case it's showing quite some "ERROR ironic.conductor.manager [None req-461d82b6-8acf-4074-92c1-31956f82ad21 None None] Invalid agent_token receieved for node db19275c-dcbd-4c50-9d22-1e8fce7096c7" | 12:56 |
janders | if I think it's not the patch causing the problem, what's the best thing to do? can I trigger CI re-run? | 12:58 |
rpittau | janders: you can try issuing a "recheck" | 12:59 |
janders | how do I do that? | 12:59 |
rpittau | janders: add a comment with the single ord "recheck" in it :) | 13:00 |
rpittau | s/ord/word | 13:00 |
janders | do I do this in the "reply" menu in the top-level of the patch? | 13:00 |
*** mkrai has quit IRC | 13:00 | |
rpittau | yes, hit Reply... and then just put "recheck" and click on Post | 13:01 |
janders | done! | 13:01 |
janders | I will see how this run goes, whether the patch fails the same tests | 13:01 |
janders | in case of HP tests, I get 404s when I click on the specific one | 13:03 |
janders | is it just me, or is there an issue with those in general? | 13:04 |
openstackgerrit | Riccardo Pittau proposed openstack/ironic master: [DNM] test CI https://review.opendev.org/746495 | 13:04 |
rpittau | janders: that's probably an issue with HP CI in general | 13:04 |
janders | ok... and the last one - Dell | 13:04 |
janders | I can get the logs no worries for those - but that's a *lot* of logs | 13:05 |
janders | what's a good place to start the investigation? | 13:05 |
rpittau | janders: I'm not sure the dell CI is testing rescue/unrescue to be honest, consider that those CIs are maintained by 3rd party vendors, we don't always know the exact status | 13:06 |
*** rloo has joined #openstack-ironic | 13:07 | |
janders | right! | 13:07 |
janders | but the patch needs to pass those to get merged, right? | 13:07 |
rpittau | janders: I guess for more info on dell the right person to ask to is rpioso | 13:07 |
rpittau | janders: not necessarily | 13:07 |
janders | ok - so I suppose I need to focus on figuring out what's happening with the two voting tests from the "main" (non-thirdparty) list, correct? | 13:08 |
rpittau | stendulker is not here right now, but that would be the first contact for HP | 13:09 |
rpittau | janders: what should really pass in terms of CI are all the jobs that are not marked as "non-voting" under Zuul check | 13:09 |
rpittau | keeping an eye on the non-voting too | 13:10 |
janders | ok! in this case - I will see how the recheck goes and if the same tests fail again I will read deeper into the logs | 13:10 |
janders | thanks rpittau | 13:12 |
rpittau | janders: no problem :) | 13:12 |
ajya | rpioso is off this week, erbarr might help with CI questions | 13:12 |
ajya | janders ^ | 13:13 |
*** Goneri has joined #openstack-ironic | 13:13 | |
janders | thanks ajya! :) | 13:13 |
janders | good to know | 13:13 |
janders | wrapping up for the night, see you tomorrow Ironic o/ | 13:14 |
rpittau | janders: bye! | 13:16 |
openstackgerrit | Bob Fournier proposed openstack/ironic-inspector master: Minor doc fix to kernel options https://review.opendev.org/746502 | 13:16 |
*** michchap has joined #openstack-ironic | 13:17 | |
TheJulia | good morning everyone | 13:31 |
dtantsur | morning TheJulia | 13:31 |
* dtantsur reboots his IRC bouncer, brb | 13:31 | |
*** dtantsur has quit IRC | 13:32 | |
* TheJulia tries to wake up | 13:34 | |
rpittau | good morning TheJulia :) | 13:34 |
*** ociuhandu has joined #openstack-ironic | 13:37 | |
*** dtantsur has joined #openstack-ironic | 13:38 | |
*** tzumainn has joined #openstack-ironic | 13:42 | |
*** k_mouza has joined #openstack-ironic | 13:57 | |
*** k_mouza has quit IRC | 14:02 | |
*** tkajinam has quit IRC | 14:06 | |
*** abdysn has quit IRC | 14:14 | |
*** cdearborn has joined #openstack-ironic | 14:19 | |
*** k_mouza has joined #openstack-ironic | 14:27 | |
*** sshnaidm is now known as sshnaidm|MYG | 14:27 | |
*** sshnaidm|MYG is now known as sshnaidm|mtg | 14:27 | |
openstackgerrit | Vishal Manchanda proposed openstack/ironic-ui master: [goal] Migrate testing to ubuntu focal https://review.opendev.org/744708 | 14:34 |
openstackgerrit | Verification of a change to openstack/bifrost failed: Validate that the services are running after installation https://review.opendev.org/743569 | 14:42 |
openstackgerrit | Merged openstack/ironic-inspector master: Follow up to incorrect pxe-enabled was set https://review.opendev.org/738752 | 14:51 |
openstackgerrit | Merged openstack/ironic-inspector master: Minor doc fix to kernel options https://review.opendev.org/746502 | 14:51 |
TheJulia | i'm sensing the ci universe dislikes us this week | 14:53 |
*** kaifeng has joined #openstack-ironic | 14:55 | |
dtantsur | "this week"?? | 14:56 |
TheJulia | well | 14:56 |
dtantsur | or was it nice while I was out? | 14:56 |
TheJulia | I mean... it hates us | 14:56 |
dtantsur | just tell me I have to go back :D | 14:56 |
TheJulia | It was moderately well behaved | 14:56 |
TheJulia | we actually got a bunch of backports landed | 14:56 |
*** stendulker has joined #openstack-ironic | 14:58 | |
*** gyee has joined #openstack-ironic | 14:58 | |
TheJulia | #startmeeting ironic | 15:00 |
openstack | Meeting started Mon Aug 17 15:00:18 2020 UTC and is due to finish in 60 minutes. The chair is TheJulia. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
TheJulia | o/ | 15:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
*** openstack changes topic to " (Meeting topic: ironic)" | 15:00 | |
openstack | The meeting name has been set to 'ironic' | 15:00 |
rpittau | o/ | 15:00 |
stendulker | o/ | 15:00 |
TheJulia | Good morning Ironic! | 15:00 |
TheJulia | Our meeting agenda this week can be found on the wiki. | 15:00 |
TheJulia | #link https://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_next_meeting | 15:00 |
ajya | o/ | 15:00 |
kaifeng | o/ | 15:01 |
rpioso | \o | 15:01 |
rloo | o/ | 15:01 |
TheJulia | ERROR: Insufficent [\o|o/] : More coffee required | 15:01 |
TheJulia | :) | 15:01 |
TheJulia | #topic Announcements / Reminder | 15:01 |
*** openstack changes topic to "Announcements / Reminder (Meeting topic: ironic)" | 15:01 | |
cdearborn | o/ | 15:01 |
dtantsur | o/ | 15:01 |
TheJulia | We had several of our components have their second release of the cycle last week. We have a couple others still in the final pipeline as they were not approved last week. | 15:02 |
bfournie | o/ | 15:02 |
TheJulia | Aside from that, all quiet. Does anyone have anything to announce or remind us of? | 15:02 |
* TheJulia hears https://www.youtube.com/watch?v=K8E_zMLCRNg :) | 15:03 | |
TheJulia | (crickets) | 15:03 |
dtantsur | a reminder: | 15:03 |
dtantsur | after creating a bugfix branch, do NOT approve the constraints changes | 15:04 |
dtantsur | we need to fix the release tooling not to propose them at all, they're broken | 15:04 |
rpittau | did we forget to release something ? | 15:04 |
rpittau | dtantsur: yeah | 15:04 |
TheJulia | dtantsur: definitely need to fix the tooling then, they are too easy to auto-pilot approve on | 15:04 |
dtantsur | for now manually update the patches to replace X.Y with victoria | 15:04 |
dtantsur | yep | 15:04 |
dtantsur | I had to hold my hand several times already | 15:04 |
TheJulia | Do we have any to revert? | 15:04 |
rloo | wonder if there is anywhere else we can record that info, cuz yeah, too easy to approve :-( | 15:05 |
dtantsur | TheJulia: we need to fix one, inspector or bifrost, I don't remember | 15:05 |
TheJulia | Well, we can't even update them manually now because the victoria branch does not exist yet | 15:05 |
TheJulia | joy! | 15:06 |
rpittau | btw the release tool now has a new option for intermediate-branch https://review.opendev.org/745918 | 15:06 |
patchbot | patch 745918 - releases - Add intermediate-branch arg to new-release script (MERGED) - 1 patch set | 15:06 |
TheJulia | Okay, well, we can carry on! | 15:06 |
TheJulia | We had no action items from our last meeting, so if there is no objection we can proceed to the whiteboard | 15:06 |
* TheJulia hears no objections | 15:07 | |
TheJulia | #topic Review subteam status reports | 15:07 |
*** openstack changes topic to "Review subteam status reports (Meeting topic: ironic)" | 15:07 | |
TheJulia | #link https://etherpad.openstack.org/p/IronicWhiteBoard | 15:08 |
dtantsur | TheJulia: the victoria branch does not exist, but the constraints link does | 15:08 |
TheJulia | dtantsur: ack | 15:08 |
dtantsur | i.e. https://releases.openstack.org/constraints/upper/victoria is already valid and should be used | 15:08 |
TheJulia | Starting around line 310 on the whiteboard | 15:08 |
dtantsur | (it redirects to master) | 15:08 |
*** Qianbiao has quit IRC | 15:09 | |
*** dking has joined #openstack-ironic | 15:11 | |
TheJulia | Looks like the Standalone auth item is done? | 15:11 |
dtantsur | I hope so | 15:11 |
TheJulia | I see the WSME related changes are continuing to move forward although they seem to be fighting CI headaches | 15:13 |
TheJulia | Looks like duplicate job changes have kind of stalled? | 15:14 |
* TheJulia sees dtantsur add an update for the section she was about to ask about | 15:16 | |
dtantsur | heh | 15:16 |
rpittau | we should maybe decide if we want to keep the name of the image used in the jobs, tinyipa or dib | 15:16 |
TheJulia | rpioso: arne_wiebalck: rpittau: Any new updates on the redfish interop profiles. (This is where dating notes helps a lot) | 15:17 |
TheJulia | rpittau: that is a good question | 15:17 |
rpittau | TheJulia: no news, I think last ujpdate is from arne_wiebalck on July 28 | 15:18 |
TheJulia | rpittau: ack | 15:18 |
TheJulia | I guess once arne_wiebalck is mentally back we'll need to discuss next steps | 15:18 |
rpittau | I think rpioso is giving an update :) | 15:19 |
TheJulia | wesome | 15:19 |
TheJulia | awesome | 15:19 |
*** belmoreira has quit IRC | 15:20 | |
TheJulia | awesome | 15:21 |
rpioso | rpittau, TheJulia: Done | 15:21 |
TheJulia | Well, is everyone good to move onward? | 15:21 |
rpittau | rpioso: thanks! | 15:21 |
rpioso | TheJulia: yw | 15:21 |
TheJulia | Everyone good to proceed to priorites for the week? | 15:22 |
rpittau | let's | 15:23 |
TheJulia | #topic Deciding on priorities for the coming week | 15:23 |
*** openstack changes topic to "Deciding on priorities for the coming week (Meeting topic: ironic)" | 15:23 | |
TheJulia | #link https://etherpad.opendev.org/p/IronicWhiteBoard | 15:23 |
TheJulia | Starting at line 159 | 15:24 |
TheJulia | First up, clean up the merged items! | 15:24 |
TheJulia | Okay, I've staged some items at line 238 through 262. Any objections to adding them? | 15:25 |
TheJulia | Any additional items people would like to see added? | 15:25 |
* dtantsur has an empty list this time | 15:26 | |
rpittau | should be ok | 15:26 |
TheJulia | Does the list look good at this time? | 15:28 |
rpittau | yep | 15:29 |
TheJulia | So onward to discussion! Although one item was raised for discussion in the list of items to review. :) | 15:30 |
TheJulia | We sort of briefly visited it last week, so we can get to that again during Open Discussion | 15:30 |
TheJulia | #topic Discussion | 15:30 |
*** openstack changes topic to "Discussion (Meeting topic: ironic)" | 15:30 | |
TheJulia | One item this week, and largely raising, yet another question, when shall we have another midcycle? | 15:30 |
* TheJulia wonders if youtube would grant her another random crickets video | 15:32 | |
rpittau | victoria will be released on October 14th, so maybe in 2 weeks ? | 15:32 |
rpittau | too short notice? | 15:32 |
TheJulia | I think that is about perfect | 15:32 |
TheJulia | Any volunteers to create a poll? | 15:33 |
rpittau | that should be the 1st week of September | 15:33 |
rpittau | I can do it | 15:33 |
TheJulia | We can start an etherpad this week as well for ideas | 15:33 |
TheJulia | Awesome! | 15:34 |
rpittau | sounds good | 15:34 |
TheJulia | Anyone disagree? | 15:34 |
TheJulia | or have any other thoughts on the topic before we jump to Open Discussion? | 15:34 |
TheJulia | arne_wiebalck: I'm guessing Baremetal SIG has nothing this week to discuss at the moment, please let me know if this is not the case | 15:35 |
* TheJulia hears crickets | 15:37 | |
TheJulia | #topic Open Discussion | 15:37 |
*** openstack changes topic to "Open Discussion (Meeting topic: ironic)" | 15:37 | |
TheJulia | So one item to be revisited I guess for open discussion is https://etherpad.opendev.org/p/IronicWhiteBoard line # 169. | 15:38 |
TheJulia | Which kind of brings back the question of "How would an operator interact?", I'm wondering if anyone has more thoughts on this? | 15:38 |
* TheJulia senses she needs to brew coffee for the IRC channel this morning | 15:40 | |
kaifeng | arne_wiebalck seems ok with populating properties :) | 15:40 |
kaifeng | but the overhead for large-scale cloud, I don't have the precise stats of the overhead | 15:41 |
TheJulia | A lot of CPU time and api calls gets consumed keeping nova in sync with ironic. So adding more work to that series of events requires careful consideration | 15:42 |
TheJulia | I guess I was also wondering if it would be data operators would ever have to change | 15:42 |
TheJulia | or would it be entirely inspector managed | 15:43 |
stendulker | How are these acclerator devices in node supposed to be used? To create resource classes subsequently... | 15:44 |
TheJulia | Great question | 15:44 |
kaifeng | they are expected to be used for scheduling | 15:44 |
* TheJulia wonders if so, do we publish it directly... | 15:45 | |
stendulker | kaifeng: through capabilities? | 15:45 |
TheJulia | That would allieviate most of my scale concern | 15:45 |
dking | JayF: Thank you for the great information the other day regarding Hardware Managers. They seem to be more simple than I had expected, which is good. One thing that I don't fully understand, though, is how they are loaded. Is it supposed to be that the code is just placed into the hardware_managers directory? I tried that, and tried clearing the cache directory, but the new ones still don't seem to be loaded. | 15:45 |
kaifeng | for precise scheduling, user can create accel profile in the flavor, it can't be satisfied by trait, it's too simple. | 15:46 |
TheJulia | dking: it has to be installed so the package setup metadata can point to it as a distinct endpoint... if memory serves | 15:46 |
kaifeng | No, not going through capabilities, actually it's barely used in the resource class based scheduling | 15:47 |
dking | TheJulia: Okay. I didn't find any information on actually installing the new hardware managers, only info on how to create them and how they work. | 15:47 |
dtantsur | dking: are you following the examples? https://opendev.org/openstack/ironic-python-agent/src/branch/master/examples | 15:48 |
stendulker | kaifeng: is it something like in cyborg? https://docs.openstack.org/api-guide/compute/accelerator-support.html | 15:48 |
TheJulia | dking: this package: https://opendev.org/x/proliantutils/src/branch/master/setup.cfg#L31 has an example of the entrypoint creation. When installed as a python package, the data is updated and ironic_python_agent finds it as a result | 15:48 |
dking | dtantsur: Yes, those were the ones I was trying to mimic.... Oh, I see now that readme mentions setup.cfg. Let me check that. | 15:49 |
TheJulia | dking: funny thing is, that package also has other code totally unrelated to the hardware manager embedded in it (in other words, its a good example) | 15:49 |
kaifeng | stendulker: it is, we are pairing with virtual machine in accelerator support | 15:49 |
dtantsur | our examples also have setup.cfg https://opendev.org/openstack/ironic-python-agent/src/branch/master/examples/business-logic/setup.cfg | 15:49 |
stendulker | kaifeng: ok | 15:49 |
TheJulia | dtantsur: \o/ | 15:50 |
ajya | Regarding the spec at https://review.opendev.org/#/c/740721/12 I left a comment at the very end about ways to improve security for configuration file storage. Can anyone take a look and see if that's OK direction to go or suggest alternatives? | 15:50 |
patchbot | patch 740721 - ironic-specs - Operationally efficient & fast-track provisioning - 12 patch sets | 15:50 |
TheJulia | ajya: I should be able to look later today or tomorrow | 15:51 |
ajya | thanks, TheJulia | 15:51 |
kaifeng | I think the scaling issue can't be addressed by introducing a new field, as a scheduling metric, it has to be collected by the data consumer AIUI, | 15:51 |
openstackgerrit | Merged openstack/ironic-inspector master: Fix URL parsing to enable redfish_address matching https://review.opendev.org/745972 | 15:52 |
stendulker | kaifeng: There are some accel discovery done by IRMC driver https://github.com/openstack/ironic/blob/master/ironic/conf/irmc.py#L83-L100 | 15:52 |
TheJulia | kaifeng: as long as we're getting the field in the same get request from ironic, that is about all that really can be done... I think. | 15:52 |
TheJulia | kaifeng: the additional dictionary handling in nova-compute wouldn't be great but I guess it would be necessary | 15:53 |
openstackgerrit | Merged openstack/networking-generic-switch master: Generate key on PEM format https://review.opendev.org/739186 | 15:55 |
kaifeng | stendulker: thanks for the link, will take a look, looks like something we have in the pci_devices plugin from inspector | 15:55 |
TheJulia | stendulker: I think where what kaifeng is proposing is different is wanting to take it further to facilitate scheduling data population somehow | 15:55 |
TheJulia | wow, two changes merged. I guess CI maybe might be a little happier today then it was at first look? | 15:55 |
TheJulia | Well everyone, we're about at time. | 15:56 |
TheJulia | If there is nothing else we can end the meeting | 15:56 |
stendulker | kaifeng, TheJulia : Yes, I understand. I was pointing that we would have to consolidate them in a fashion that would be usable. I think even ilo has some inspection data around gpus. | 15:56 |
TheJulia | stendulker: ahh! | 15:56 |
stendulker | ilo driver | 15:56 |
TheJulia | stendulker: I see, makes sense | 15:56 |
*** priteau has quit IRC | 15:57 | |
stendulker | i think its just dumped in node properties as these were done when capabilities was getting used for scheduling | 15:57 |
TheJulia | :\ | 15:58 |
TheJulia | This seems like a larger conundrum that needs to be visited | 15:58 |
TheJulia | Anyway, Thanks everyone! | 15:58 |
rpittau | thanks1 | 15:59 |
TheJulia | #endmeeting | 15:59 |
*** openstack changes topic to "Bare Metal Provisioning | Status: http://bit.ly/ironic-whiteboard | Docs: http://docs.openstack.org/ironic/ | Bugs: https://storyboard.openstack.org/#!/project_group/75 | Contributors are generally present between 6 AM and 12 AM UTC, If we do not answer, please feel free to pose questions to openstack-discuss mailing list." | 15:59 | |
openstack | Meeting ended Mon Aug 17 15:59:32 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:59 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/ironic/2020/ironic.2020-08-17-15.00.html | 15:59 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/ironic/2020/ironic.2020-08-17-15.00.txt | 15:59 |
openstack | Log: http://eavesdrop.openstack.org/meetings/ironic/2020/ironic.2020-08-17-15.00.log.html | 15:59 |
rpittau | TheJulia: virtual meetup doodle: will 2 hours be ok as last time? or do we want multiple days/more time per day? | 16:00 |
kaifeng | stendulker: a quick checking on the irmc, it populates properites and might add trait support in a later time | 16:01 |
kaifeng | such information is not accurate, as user may need to "I want to this kind of GPU" instead of "Give me a GPU" | 16:01 |
*** lucasagomes has quit IRC | 16:02 | |
TheJulia | rpittau: 2 hours and I guess looking for two days? | 16:02 |
rpittau | TheJulia: ack | 16:02 |
*** mkrai has joined #openstack-ironic | 16:02 | |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: Validate that the services are running after installation https://review.opendev.org/743569 | 16:03 |
*** stendulker has quit IRC | 16:05 | |
*** sshnaidm|mtg is now known as sshnaidm | 16:08 | |
dtantsur | anyone seen this from libvirt? "internal error: Network is already in use by interface enp1s0 | 16:15 |
dtantsur | mmm, too many networks, sigh | 16:16 |
rpittau | dtantsur, TheJulia: https://review.opendev.org/746553 | 16:30 |
patchbot | patch 746553 - project-config - Do not update upper constraints for intermediate b... - 1 patch set | 16:30 |
*** belmoreira has joined #openstack-ironic | 16:33 | |
TheJulia | thanks rpittau | 16:34 |
*** belmoreira has quit IRC | 16:36 | |
*** k_mouza has quit IRC | 16:37 | |
dking | I just noticed that my baremetal servers don't have any swap setup by default. Is there an option to add that, or is that something that would need to be setup after they are deployed? | 16:41 |
*** Lucas_Gray has quit IRC | 16:52 | |
*** dtantsur is now known as dtantsur|afk | 16:59 | |
dtantsur|afk | out tomorrow (yes, again), so see you on Wednesday! | 16:59 |
dtantsur|afk | dking: there is an instance_info field for partition images, I don't remember by heart | 16:59 |
dtantsur|afk | probably swap_mb | 16:59 |
TheJulia | my memory is saying swap_mb as well | 17:01 |
TheJulia | dking: you can also just add it in the image, but you'll have to ensure it is pre-formatted and in the fstab for the image as well | 17:01 |
dking | Thanks. I think that if there's an option to do it from instance_info, that would be better as I could have different settings while keeping the same image. | 17:02 |
dking | However, I don't see that option listed on https://docs.openstack.org/ironic/latest/install/standalone.html | 17:03 |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: Validate that the services are running after installation https://review.opendev.org/743569 | 17:03 |
*** mkrai has quit IRC | 17:05 | |
openstackgerrit | Julia Kreger proposed openstack/ironic master: ISO ramdisk virtual media test enablement https://review.opendev.org/736383 | 17:15 |
openstackgerrit | Merged openstack/ironic stable/train: DRAC: Drives conversion from JBOD to RAID https://review.opendev.org/738509 | 17:16 |
TheJulia | dking: yeah, because we only ever did that for partition images | 17:16 |
TheJulia | and I think cloud-init does or did look for swap partitions to use | 17:17 |
dking | Okay. Thanks for hte info. | 17:28 |
dking | Getting back to hardware_managers, though, I think I'm a bit lost. Could somebody help me understand all the steps involved in installing one. I imagine that it would start with DIB and installing ironic-python-agent-builder, which is essentially a wrapper to setup a custom ELEMENTS_PATH, but I'm not sure how to get one in the image from there. | 17:38 |
TheJulia | dking: well, you would likely want to make an element that installed the plugin | 17:43 |
TheJulia | either from source or your favorite packaging utility | 17:43 |
JayF | TheJulia: dtantsur|afk: When adding oslo.service support to IPA, was there an explicit reason `use_ssl` wasn't exposed for the oslo.service wsgi server? (Loaded question: I hooked it up downstream, and it causes requests to hang, but adding an eventlet.sleep https://github.com/eventlet/eventlet/blob/master/eventlet/wsgi.py#L995 here fixed it) | 17:56 |
TheJulia | JayF: define requests to hang | 17:57 |
TheJulia | what exactly is occuring with the requests where they are hanging | 17:58 |
JayF | no response to an HTTPS client connecting, in debug mode, last log is the "accepted" log from eventlet.wsgi | 17:58 |
JayF | after some debugging with jroll, we determined that serv.process_request (which is spawned in a thread in above linked code) never gets run at all without that eventlet.sleep(0) after it's spawned | 17:58 |
TheJulia | weird that it would hang that way, but I guess it would be required | 17:59 |
JayF | (with the eventlet.sleep(0) there, it seems to work OK; but given how non-responsive the eventlet backdoor was, I suspect there's still other shenanigans there) | 17:59 |
JayF | I was going to upstream the ssl support if I got it working; obviously I'm sorta at a wall now | 17:59 |
JayF | not trying to nerd snipe a fix, more gain insight if you all had the same problem (and so didn't hook up `use_ssl`) or if it was just not worth it at the time | 18:00 |
JayF | I'm probably going to be filing a bug with oslo.service and eventlet about this, and going the "run a proxy in the ramdisk" route for TLS+client cert auth, it's just unfortunate because the code to hook this up is minimal if it worked | 18:00 |
bnemec | There was a fix recently in oslo.service that was related to ssl/eventlet/py3. | 18:01 |
JayF | It was limited to unit tests AFAICT | 18:01 |
JayF | I reproduced this with master oslo.service | 18:01 |
bnemec | Yeah, you're right. No functional changes. | 18:02 |
* bnemec shakes his fist at eventlet. Again. | 18:02 | |
TheJulia | JayF: I suspect it just not wired up for mvp practicality reasons and not the issue your encoutering | 18:20 |
*** hoonetorg has joined #openstack-ironic | 18:29 | |
JayF | ack; I'll file the tickets upstream with oslo.service and eventlet ,see what happens. If they fix it, I might push up my local change -- which just equates `listen_ssl` in config to what is passed to `use_ssl` in the oslo.service object | 18:29 |
TheJulia | ok | 18:29 |
JayF | also, filed a bug about listen_port/listen_host not being honored since the oslo.service transition. I have downstream code to fix listen_port (happy to push it up), but need to make it fix listen_host as well | 18:30 |
TheJulia | that would be appreciated | 18:30 |
JayF | no promises because I don't wanna break promises, but it's on my list for the next two weeks | 18:30 |
TheJulia | Understood, thanks! | 18:31 |
*** kaifeng has quit IRC | 18:34 | |
*** belmoreira has joined #openstack-ironic | 19:13 | |
*** stevebaker has joined #openstack-ironic | 19:33 | |
*** belmoreira has quit IRC | 20:43 | |
*** ociuhandu has quit IRC | 21:39 | |
*** trandles has joined #openstack-ironic | 21:45 | |
trandles | just to close the loop on my problems from Friday...I was running too new version of kernel for systemd...rolling back fixed the issue | 21:45 |
*** mgoddard has quit IRC | 22:10 | |
*** mgoddard has joined #openstack-ironic | 22:18 | |
*** janders has quit IRC | 22:18 | |
*** ijw has joined #openstack-ironic | 22:25 | |
*** rcernin has joined #openstack-ironic | 22:33 | |
*** Lucas_Gray has joined #openstack-ironic | 22:41 | |
TheJulia | trandles: I was off Friday, what was the issue?!? | 22:47 |
JayF | TheJulia: tl;dr https://bugzilla.redhat.com/show_bug.cgi?id=1853736 | 22:49 |
openstack | bugzilla.redhat.com bug 1853736 in systemd "systemctl show service fails with "Failed to parse bus message: Invalid argument"" [Unspecified,Closed: errata] - Assigned to systemd-maint | 22:49 |
JayF | I was giving them moral support lol | 22:49 |
TheJulia | joy! | 22:50 |
TheJulia | JayF: \o/ | 22:50 |
JayF | oh TheJulia btw, there's an error in our docs -- we indicate that IPA reads /etc/ironic_python_agent/ironic_python_agent.conf by default; but it does that only if `--config-file [path]` is set | 22:52 |
JayF | TheJulia: unsure if that's an IPA bug or a docs bug | 22:52 |
TheJulia | hmm | 22:54 |
TheJulia | Not sure | 22:54 |
JayF | My hunch is oslo_config changed behavior at some point, IDK for sure | 22:55 |
JayF | not really a major issue, just something to hrm at | 22:55 |
*** Lucas_Gray has quit IRC | 23:04 | |
*** tkajinam has joined #openstack-ironic | 23:07 | |
trandles | TheJulia, what JayF said...bifrost got much further with install today until DOB puked trying to build the debian image | 23:13 |
trandles | DIB | 23:13 |
trandles | we're behind a proxy so it's probably related to that given this: "2020-08-17 22:17:44.038 | E: Failed getting release file http://deb.debian.org/debian/dists/buster/Release" | 23:16 |
trandles | anyway, that's for tomorrow o/ | 23:16 |
*** trandles has quit IRC | 23:17 | |
TheJulia | tradles: Tha.. GAH! | 23:17 |
*** janders has joined #openstack-ironic | 23:17 | |
TheJulia | o/ janders | 23:17 |
janders | good morning TheJulia o/ | 23:18 |
janders | how was your weekend mammoth drive? | 23:18 |
TheJulia | It didn't happen. Thursday night my father called and didn't want me to come visit this weekend | 23:18 |
janders | right! | 23:19 |
janders | have you managed to have a nice relaxing long weekend in this case? | 23:19 |
TheJulia | So I cleaned and did some stuff around the house. Plotted making a air ram scoop intake for my Fiesta | 23:19 |
janders | haha :) | 23:21 |
janders | our 4WD could do with one of those, instead of having the intercooler under the RHS front light | 23:21 |
TheJulia | BadCub who is not on IRC these days... had the front end of his Fiesta removed so I went and took some photos/measurements | 23:21 |
TheJulia | oh, intercooler upgrade is also required... Just likely not from Mountune | 23:22 |
janders | it's silly to put the intercooler in harm's way in event of even a small collision and even more so in a 4WD. Having it on the top of the engine, Subaru style would be heaps better. | 23:22 |
TheJulia | if I do it, Air ram intake + intercooler at the same time | 23:22 |
TheJulia | swapping the turbo would be hard here | 23:23 |
janders | Is it the ST series, or a more custom sporty fiesta? | 23:24 |
janders | s/f/F | 23:24 |
TheJulia | ST | 23:24 |
janders | nice! | 23:26 |
janders | little weapon | 23:26 |
janders | unmodified it probably has like 20% more power than either of my cars, though it's half the weight of the 4WD and a fair bit lighter than the Lancer | 23:27 |
janders | on the Ironic topic.. my little patch failed CI early yesterday but I re-ran CI overnight and it's all good now | 23:32 |
janders | is it likely CI was having some hiccups or is it likely that my code is intermittently failing? | 23:32 |
*** ociuhandu has joined #openstack-ironic | 23:39 | |
*** ociuhandu has quit IRC | 23:45 | |
TheJulia | likely CI | 23:51 |
TheJulia | but good to make sure it is not your code | 23:51 |
TheJulia | as in, not something that relates. Often most failures are totally unrelated though | 23:51 |
*** Goneri has quit IRC | 23:54 | |
janders | ACK. Thanks TheJulia | 23:56 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!