Tuesday, 2023-08-29

dvo-plvsean-k-mooney, Hello06:44
dvo-plvregarding our yesterday discussion. I see two options. we can get back to the separate mech driver, like was suggested year ago06:45
dvo-plvor we can pass socket name + pci endpoint in some way06:46
UgglaHello Nova.07:25
gibiUggla: o/07:34
opendevreviewmelanie witt proposed openstack/nova master: nova-manage: Add 'limits migrate_to_unified_limits'  https://review.opendev.org/c/openstack/nova/+/89164608:24
opendevreviewMaksim Malchuk proposed openstack/nova stable/xena: Fix to implement 'pack' or 'spread' VM's NUMA cells  https://review.opendev.org/c/openstack/nova/+/82980412:56
*** artom_ is now known as artom12:57
*** tbachman_ is now known as tbachman12:57
*** ozzzo1 is now known as ozzzo12:57
*** NeilHanlon_ is now known as NeilHanlon13:11
*** ykarel_ is now known as ykarel14:01
opendevreviewDan Smith proposed openstack/nova master: WIP: Detach disks using alias when possible  https://review.opendev.org/c/openstack/nova/+/89306814:47
dansmithkashyap: was just going to point you at this, first PoC of using the stable alias to detach disks: https://review.opendev.org/c/openstack/nova/+/89306814:49
dansmithseems to work, without having to muck with all the actual detach plumbing like I was originally thinking14:49
dansmithI think something similar should work for interfaces too14:49
dansmiththere's a lot more looking-up-of-devices elsewhere that would need to change, but I'm hoping those places will be able to use that helper too14:49
opendevreviewElod Illes proposed openstack/nova stable/yoga: Don't provide MTU value in metadata service if DHCP is enabled  https://review.opendev.org/c/openstack/nova/+/87970114:50
kashyapdansmith: Nice that you preserve the fallback to using 'disk_dev'14:50
kashyapdansmith: I guess you're (me for sure) pleasnatly surprised that it turned out to be much less of code-footprint than anticipated14:52
kashyap(Unless there are no nasty surprises lurking somewhere)14:52
dansmithyeah I originally had rewritten all the detach stuff to use that per-alias method, but realized it was really not necessary and that I could just change how we looked it up instead14:52
dansmithwhich is much smaller *and* should apply to the other places where we just need to look it up and not detach14:53
kashyapSmart.  (On changing how we looked it up.  I would've racked my brains longer)14:53
opendevreviewPavlo Shchelokovskyy proposed openstack/nova master: Replace -- as 3-4 char in hostname with -  https://review.opendev.org/c/openstack/nova/+/89307214:53
dansmithso I'm hoping that helper on guest that looks up all devices and then finds by alias will work for interfaces in a similar workflow14:54
kashyapYou already ran nova.tests.unit.virt.libvirt.* unit tests locallY?14:55
dansmithno, no tests, it just works in a devstack14:57
opendevreviewElod Illes proposed openstack/nova stable/xena: Don't provide MTU value in metadata service if DHCP is enabled  https://review.opendev.org/c/openstack/nova/+/87970314:57
opendevreviewPavlo Shchelokovskyy proposed openstack/nova master: Replace -- as 3-4 char in hostname with -  https://review.opendev.org/c/openstack/nova/+/89307214:57
dansmithkashyap: i.e.: Aug 29 14:40:22 jammy nova-compute[306476]: DEBUG nova.virt.libvirt.driver [None req-323b5960-d0c5-4729-b269-5743cd4fdf90 demo demo] Found disk vdb by alias ua-ada5af06-300e-4d07-931d-3cc2bff8a8a9 {{(pid=306476) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2722}}14:57
kashyapAh, nice. 14:58
opendevreviewElod Illes proposed openstack/nova stable/wallaby: Don't provide MTU value in metadata service if DHCP is enabled  https://review.opendev.org/c/openstack/nova/+/87970415:01
kashyapdansmith: I'm just quietly wondering if there are scenarios where we have to care about transient disk configs at all15:02
bauzasauniyal: left a comment on https://review.opendev.org/c/openstack/nova/+/889947 but also on the dependent patch, please review it as soon as you can15:02
opendevreviewElod Illes proposed openstack/nova stable/victoria: Don't provide MTU value in metadata service if DHCP is enabled  https://review.opendev.org/c/openstack/nova/+/87970515:03
dansmithkashyap: meaning all the detaching from live+persistent you mean?15:04
dansmithAFAIK we pretty much always keep them in sync, so I'm not sure why we're going to all that trouble, yeah15:04
kashyap(Yeah, detach from both live and persistent)15:05
kashyapI didn't realize we're keeping them in sync.  Then one less trouble.15:05
opendevreviewElod Illes proposed openstack/nova stable/ussuri: Don't provide MTU value in metadata service if DHCP is enabled  https://review.opendev.org/c/openstack/nova/+/87970215:06
bauzasreminder : nova meeting in 55 mins (heya, back)15:06
opendevreviewPavlo Shchelokovskyy proposed openstack/nova master: Replace -- as 3-4 char in hostname with -  https://review.opendev.org/c/openstack/nova/+/89307215:32
bauzasauniyal: also gave -1 for a few nits on https://review.opendev.org/c/openstack/nova/+/88228415:48
auniyalack bauzas, thanks for reviews16:00
bauzas#startmeeting nova16:00
opendevmeetMeeting started Tue Aug 29 16:00:07 2023 UTC and is due to finish in 60 minutes.  The chair is bauzas. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
opendevmeetThe meeting name has been set to 'nova'16:00
bauzashey folks, welcome16:00
auniyalo/16:00
bauzasI'm eventually released from Canada16:00
bauzas#link https://wiki.openstack.org/wiki/Meetings/Nova#Agenda_for_next_meeting16:00
bauzaswho's around ?16:00
Ugglao/16:01
gmanno/16:01
elodilleso/16:01
* gibi is partially around (on a call in parallel)16:01
bauzaswe can softly start16:01
bauzas#topic Bugs (stuck/critical) 16:01
bauzas#info No Critical bug16:01
bauzas#link https://bugs.launchpad.net/nova/+bugs?search=Search&field.status=New 49 new untriaged bugs (+9 since the last meeting)16:01
dansmitho/16:01
bauzas#info Add yourself in the team bug roster if you want to help https://etherpad.opendev.org/p/nova-bug-triage-roster16:02
bauzasso, we would like to do some bug triage16:02
bauzasauniyal: you're the next in the roster list, fancy with this ?16:02
auniyalack bauzas16:02
auniyalyes16:03
bauzasvery much appreciated16:03
bauzas#info bug baton is auniyal16:03
bauzasthanks16:03
bauzasmoving on, I don't see any critical bug to discuss16:03
bauzas#topic Gate status 16:03
bauzas#link https://bugs.launchpad.net/nova/+bugs?field.tag=gate-failure Nova gate bugs 16:03
bauzas#link https://etherpad.opendev.org/p/nova-ci-failures16:04
bauzas#link https://zuul.openstack.org/builds?project=openstack%2Fnova&project=openstack%2Fplacement&pipeline=periodic-weekly Nova&Placement periodic jobs status16:04
bauzas#info nova-emulation seems flakey16:04
bauzas#info https://zuul.openstack.org/build/209dc9676c4149b281420d9ae18f889c16:04
dansmiththings are better lately, thanks to a lot of hard work by a number of people, most recently probably melwitt with an LVM fix that might help with some stability, and a functional fix from gibi16:05
bauzasdansmith: ++, I was about to ask for news :)16:05
dansmithstill need to work on some random timeouts we get which I think is related to stress on the api workers (at least in part) and melwitt has a green/native threads refactor up which I hope will eventually help with that16:05
bauzasI have to admit the issues I've seen are out of my knowledge area :(16:06
dansmithalso still occasional OOMs which are hard to address when we're legitimately running out of memory if we get unlucky with what gets started when16:06
bauzasdansmith: ack, any change in particular for greenthreading ?16:06
dansmithbauzas: we need to move to native threads in nova-api when under wsgi so that we can handle more than two things at once16:06
dansmith*and* so we can enable it in devstack so that other services which can already do so can leverage that :)16:07
bauzasI see16:07
dansmithanyway, that's pretty much the status.. I encourage everyone to look critically at any failure they see and try to resolve it or nail it down while waiting for your recheck :)16:08
bauzaswell, I'd say, I'm a bad doctor, I'm only able to tell what's wrong without any cure16:08
bauzasand my diagnostics are always biased16:09
bauzasbut yeah, teamwork, agreed :)16:09
dansmithwell, doctors require continuing education to get better ;)16:09
bauzasnot only doctors :)16:09
bauzasanyway, thanks for the update16:09
bauzasI'm still wondering if the GPT errors I'm seeing in the console are somehow related to the timeouts16:10
dansmithI don't think so,16:11
dansmithwe get those every time we attach a blank disk to an instance16:11
bauzasack, ok16:11
dansmiththe correlation is lots of timeouts come from volume tests,16:11
dansmithwhich always dump console logs, and you see those things that look error-like16:11
dansmithcorrelated, but not caused16:12
bauzasyeah, correlation is not cause, I get it :)16:12
bauzasI know sean-k-mooney was also investing any alping image usage in some job16:13
bauzashave we moved forward on it ?16:13
bauzasalpine*16:13
bauzasanyway, I think gate stability deserves some discussions at the PTG, if we haven't closed the gaps yet16:14
dansmithnot that I know of16:15
bauzasmoving on then16:16
sean-k-mooneyi havent looked at that in a while16:16
bauzas#info Please look at the gate failures and file a bug report with the gate-failure tag.16:16
sean-k-mooneybut it was failing becuase it did not have growfs i.e. the disk root partition was not being expanded16:16
sean-k-mooneyeasy fix jsut have not had time to work on it16:16
bauzassean-k-mooney: ack, this week I'm busy but next week, I could help16:17
sean-k-mooneywe can move on but https://review.opendev.org/q/topic:alpine is the topic for context16:17
bauzasmoving on indeed16:17
bauzas#topic Release Planning 16:18
bauzas#link https://releases.openstack.org/bobcat/schedule.html16:18
bauzas#link https://etherpad.opendev.org/p/nova-bobcat-blueprint-status Etherpad for tracking blueprints status16:18
bauzas#info 2 days before FeatureFreeze16:18
bauzasso, I tried to update the etherpad based on my recent findings16:18
bauzaswe have about 5 series that are reviewable16:18
bauzasand we only have 2 days to get them into some state16:19
bauzasof those 5 series, 2 of them are quite large16:19
bauzasso I don't expect a full merge, but I'd appreciate if some reviews could be made, particularly in order to let them move forward quickly once we open Caracal feature dev16:20
bauzasand we can discuss whether we can half-merge some series or hold the whole16:20
bauzasso, please, take your pens16:20
bauzasI'll continue to give a few review rounds till the last day, but I also need traction from others :)16:21
bauzasand if you're an owner of one of those series, feel free to ping us on IRC if you think you'd like feedback16:22
bauzasI think we're done on this topic16:24
bauzasI'll probably ping a couple of folks after this meeting to get a proper status16:24
bauzas#topic Review priorities 16:25
bauzas#link https://review.opendev.org/q/status:open+(project:openstack/nova+OR+project:openstack/placement+OR+project:openstack/os-traits+OR+project:openstack/os-resource-classes+OR+project:openstack/os-vif+OR+project:openstack/python-novaclient+OR+project:openstack/osc-placement)+(label:Review-Priority%252B1+OR+label:Review-Priority%252B2)16:25
bauzas#topic Stable Branches 16:26
bauzaselodilles: floor is yours16:26
elodilleswell, i was on PTO last week,16:26
elodillesand i didn't see much activity on stable branches16:27
elodillesi guess people are more focused on Bobcat nowadays ;)16:27
bauzasthis week, for sure16:27
elodillesanyway, i'm not aware of any stable gate failures16:27
elodilles#info stable branch status / gate failures tracking etherpad: https://etherpad.opendev.org/p/nova-stable-branch-ci16:27
elodillesfeel free to add anything there if you find any issue ^^^16:28
elodillesthat's all from me16:28
auniyal#info Please{10} *review* these backport patches of stable 2023.1, zed and yoga for next minor release16:28
auniyal#info most of these already have one +2.16:28
auniyal#link https://etherpad.opendev.org/p/release-liaison-PatchesToReview16:29
bauzasyeah, it would be nice to deliver some stable releases while we reach the rc period16:30
elodilles++16:30
bauzasI'll personnally doublecheck if some are missing my +216:30
auniyalI added 2 more patches for stable/2023.116:31
auniyalearlier bauzas had merged all16:31
bauzasa 2023.1 stable release before we cut rc1 is important16:31
bauzasoperators can then upgrade to the latest .z release on Antelope before upgrading smoothly to Bobcat16:32
bauzasbut ok, I'll try to chase them down16:32
bauzason a note, my usual stable branches item :16:32
bauzas#info train-eol patch proposed https://review.opendev.org/c/openstack/releases/+/88536516:33
bauzasI guess it's waiting a second releases core16:33
elodillesoh, it's still not merged... :S16:33
elodillesyes, it is waiting for that16:33
bauzasI know US trains are pretty long16:33
elodilles:)16:33
bauzasanyway, moving on, last topic16:33
bauzas#topic Open discussion 16:34
bauzasnothing on my agenda, ever after a wiki refresh16:34
bauzasso, anything anyone ?16:34
bauzaslooks not16:37
bauzasthanks all, and tbh I'm happy to see all of you back :)16:37
bauzas#endmeetinh16:37
bauzasdoh16:37
bauzas#endmeeting16:37
opendevmeetMeeting ended Tue Aug 29 16:37:43 2023 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:37
opendevmeetMinutes:        https://meetings.opendev.org/meetings/nova/2023/nova.2023-08-29-16.00.html16:37
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/nova/2023/nova.2023-08-29-16.00.txt16:37
opendevmeetLog:            https://meetings.opendev.org/meetings/nova/2023/nova.2023-08-29-16.00.log.html16:37
elodillesthanks o/16:37
gibio/16:38
opendevreviewMerged openstack/os-vif master: Don't break traffic if port already exists  https://review.opendev.org/c/openstack/os-vif/+/88512717:38
opendevreviewRaul Moldovan proposed openstack/nova master: Update resources post live migration  https://review.opendev.org/c/openstack/nova/+/89261418:11
*** melwitt_ is now known as melwitt18:34
opendevreviewRaul Moldovan proposed openstack/nova master: Update resources post live migration  https://review.opendev.org/c/openstack/nova/+/89261420:28

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!