Monday, 2024-04-08

*** mikal_ is now known as mikal04:55
noonedeadpunkhey folks! I was looking through changes that we in osa need to make towards projects config and got slightly confused about quotas part. Like here https://docs.openstack.org/nova/latest/admin/quotas.html it's said that default will be changed to unified driver for Caracal07:51
noonedeadpunkbut then seems it was not changed? https://docs.openstack.org/nova/latest/configuration/config.html#quota.driver07:52
bauzasbhaley: fwiw we don't have any neutron topic in our etherpad, but sure we can have a neutron x-p session when you want09:02
mikalbauzas: I'm not sure if this was clear or not, so just in case. While I appreciate a courtesy ping before you discuss spice-direct, I kind of also need it to be at the start of the day with warning the day before so I can rearrange my sleep schedule for the day.09:08
bauzasmikal: sure, I'm currently working on a planning :)09:08
mikalbauzas: yeah cool, no rush.09:08
bauzasmaybe Friday would work for you ?09:09
mikalbauzas: I'd also really like to just focus on the "do we want this at all" bit first, instead of implementation specifics. We can rat hole on those later if we get past the "do we even want this" bit.09:09
mikalbauzas: let me check ye olde calendar...09:09
mikalbauzas: oh actually, Friday (EU time) works well for me because that's Friday night my time and I can just sleep in on Saturday. So yeah that sounds good to me.09:10
bauzasmikal: ok, so I'll try to discuss your topic around 1300UTC 09:12
mikalbauzas: cool. Want me to put it on the topic list for that day in the etherpad?09:12
bauzasmikal: I already did it :)09:13
mikalbauzas: "(fwiesel): POST /servers/{server_id}/remote-consoles is "leaky"" sounds a bit overlappy with me too, isn't that also talking about console types which might want to return connection details other than a URL? Maybe that should be a Friday session too then?09:14
bauzasmikal: ahah, good point, I could move it on Friday if fwiesel is okay09:14
bauzasyeah, it looks okay for fwiesel, so I'll move it09:15
mikalbauzas: is the "userdata" one this spec? https://review.opendev.org/c/openstack/nova-specs/+/86388409:15
mikalbauzas: because I have _opinions_ about that one.09:16
bauzasyup09:16
mikalbauzas: because "nova metadata optimization" is _not_ that spec as best as I can see.09:17
bauzasmikal: we'll discuss this on Friday too09:18
bauzasFWIW, I'll start to review the specs today09:20
mikalbauzas: yeah cool, I did not intend to create pressure.09:24
mikalI wonder if it still makes sense to provide ec2 style metadata at all? We don't have an ec2 API any more right? And its not like we're new and anyone is running a cloud-init which doesn't know about openstack any more...09:25
bauzasmikal: no we removed the ec2 API indeed (like in 6 years ago IIRC)09:29
bauzasyeah, checked, this was in mitaka09:30
bauzashttps://docs.openstack.org/releasenotes/nova/mitaka.html#release-notes-13-0-0-stable-mitaka-prelude09:31
bauzasthen the ec2 api was in https://opendev.org/openstack/ec2-api/09:32
mikalIIRC we spun it off into another project that then withered on the vine?09:32
mikalI think the days of having to pretend to be ec2 to our users are well and truely over.09:32
bauzaswell, because most of folks already know about direct OpenStack APIs 09:34
mikalYeah, and back in the day lots of tooling (cloud-init etc) didn't know about us, so we pretended to be ec2. Eucalyptus did the same.09:34
bauzasmikal: we have a related topic https://etherpad.opendev.org/p/nova-dalmatian-ptg#L30309:35
bauzasour API documentations are fine, but some folks want to automatically get our documents by their own scripts09:36
mikalHmmm, do the current JSON schemas document all of the HTTP response codes which might be returned by an API call?09:38
mikalhttps://openapi.shakenfist.com/#/instances/get_instances__instance_ref_ for example is some output from a Swagger / OpenAPI automation tool, and having the HTTP response codes there is quite important. I think OpenAPI is a good idea. For a lot of languages it means people can auto-generate their own API clients for example.09:39
bauzassorry I need to go off for an appointment09:41
mikalNo worries.09:52
fricklerfyi openapi is also a topic in the tc session on friday, IIUC mainly a discussion about gtema's codegenerator project10:04
fricklersee https://etherpad.opendev.org/p/apr2024-ptg-os-tc#L3710:04
frickler(note the scheduling might not be final yet)10:05
opendevreviewRajesh Tailor proposed openstack/nova master: Fix case-sensitivity for metadata keys  https://review.opendev.org/c/openstack/nova/+/87390110:38
bauzaswow, our PTG agenda is now pretty packed11:57
bauzasI'll provide an email11:57
sean-k-mooneymikal: o/13:01
sean-k-mooneymikal: its been a long time since i saw you around these parts how are you?13:03
bauzasfolks, the QA team will discuss about grenade skip-level jobs around 14300UTC (ie. in 30 mins by now) https://etherpad.opendev.org/p/apr2024-ptg-qa#L4314:04
bauzasyou may be interested in joining it ^14:04
opendevreviewribaudr proposed openstack/nova master: Fix: migration configuration with cpu_shared_set (object part)  https://review.opendev.org/c/openstack/nova/+/90370614:21
opendevreviewribaudr proposed openstack/nova master: Fix: migration configuration with cpu_shared_set (libvirt part)  https://review.opendev.org/c/openstack/nova/+/91513914:21
opendevreviewribaudr proposed openstack/nova master: Test live migration between hosts with differnet cpu_shared_sets  https://review.opendev.org/c/openstack/nova/+/91374414:21
sean-k-mooneybauzas: gibi can ye review this logging patch https://review.opendev.org/c/openstack/nova/+/898057 i want to merge that to help debugging some numa issues14:38
bauzassean-k-mooney: -1 for a missing test coverage14:54
bauzasbut I like your approach14:54
sean-k-mooneyok ill figure out how tot test it14:55
sean-k-mooneyif your happy with the approch then that is easy to adresss14:55
bauzassean-k-mooney: oh, that's simple to test, sec14:56
bauzashttps://github.com/openstack/nova/blob/master/nova/tests/unit/objects/test_objects.py14:57
bauzashere, you can add another fake object that would inherit from your JSONPrintableObjectMixin mixin14:57
sean-k-mooney yep14:57
sean-k-mooneysounds good14:58
bauzasor just amend MyObj14:58
sean-k-mooneyill proably inherit form it14:58
bauzasand add the two test methods for checking the output14:58
sean-k-mooneyor duplicate it 14:58
bauzasin _BaseTest14:58
bauzasas you want14:58
sean-k-mooneybut ill ready over it and see what is simplest14:58
bauzasyup, I just wanted to make sure we double check that we get a dump14:59
sean-k-mooneysure thats tottally valid to ask for.14:59
sean-k-mooneyi didnt add it becuase i tought it was trivial enough not to need ti but im tottaly fine with adding tests14:59
bauzasI'm thinking about the RPC compatibility14:59
bauzasI think it will work14:59
bauzasthe primitive won't have the mixin in it, so an old compute would just rehydrate the object without the mixin15:00
sean-k-mooneyrpc is fine15:01
sean-k-mooneyon unupgraded code we will just fall back to the default __str__ impl15:01
sean-k-mooneywe are not going to depend on this out side of logs15:01
sean-k-mooneyso old code will just log as it does now15:01
sean-k-mooneynew code will log  the .obj_to_primitive() json dump15:02
dansmithSo fwiw, I'd rather us not always dump these as json15:02
sean-k-mooneywell i applied them to some of the objects where its needed but perhapse i could make it configuable based on the log level15:03
dansmithit's much harder to read and it's not exactly the same format as we expect in python (null instead of None, no list/set distinction, etc)15:03
sean-k-mooneyi.e. only do that if debug15:03
dansmithwhy not just dump the primitive in specific places if and when you want it?15:03
sean-k-mooneyi want it everywhere we log this15:03
dansmithwhat's the extra thing you're getting out of this that we don't get with the inbuilt dump?15:03
sean-k-mooneyyes 15:04
sean-k-mooneywe just get something<?> or stuff like that15:04
sean-k-mooneyfor pci request and many of the numa related info15:04
dansmithyou get that when a field is unset I think is that what you mean?15:04
bauzasI often used .dumps() for objects and ya got a question mark for unset fields IIRC15:06
bauzasbut we can test this quickly15:06
sean-k-mooneyit not jsut <?>15:06
dansmithright, which you won't even see in the json dump I think15:06
sean-k-mooneywwe also had requests=[InstancePCIRequest,InstancePCIRequest])15:06
sean-k-mooneyso it does not recursivly print the nested objects15:07
dansmithyeah, which it could do...15:08
sean-k-mooneyso i guess i wasnt expecting much push back as this to me is a significant readbility gain15:08
sean-k-mooneywe could adress it other wasy but this to mean was a clean an consitent way to make it more readable and support debuggin form logs15:09
sean-k-mooneyfor the specific objects where the current logging is lacking15:09
dansmithit's a significant readability regression to me :)15:09
sean-k-mooneyi guess you would prefer if i modified the list object ot print recurrsivly instead15:11
sean-k-mooneykeeping the same format15:11
sean-k-mooneydo you know if there is an atribute we would need to apply to do that15:12
dansmithI mean, the reason it doesn't recurse now is just because the dump could end up being super massive and so the decision not to recurse was intentional15:12
dansmiththat was at a time where we had many fewer object types and less nesting I'm sure15:13
sean-k-mooneybut that often means i cant debug custoemr issues form the logs15:13
dansmithbut things like a list of instances would be a massive dump in the logs15:13
dansmithsure, I know15:13
sean-k-mooneyi think we shoudl recuse for debug mode15:13
sean-k-mooneybut perhaps not for anythign else15:13
dansmithI'm not saying don't make it recursive, I'm just saying it's pretty heavy15:13
sean-k-mooneydo you know if we have dont that before?15:13
dansmithnot that I know of15:13
sean-k-mooneyok ill pause the patch there then and see if that is possibel15:14
sean-k-mooneyif thats an approch you and bauzas prefer15:14
sean-k-mooneydansmith: for context i have othen patch in this dumping in the past15:14
bauzasI'm just testing what we get15:14
sean-k-mooneywhen doing testing locally to repoduce an issue15:14
bauzasso we just jsondump the primitive15:15
bauzaswhich means for unset attrs that we won't show them15:15
bauzasso yeah I agree with dansmith, we should show all the fields regardless, as it will be easier for ops to know whether we provided the fields or not15:16
kashyaptobias-urdin: Hi, for later - I think this removal of "tunnelled migration" should be merged this cycle (also wrote it on the review): https://review.opendev.org/c/openstack/nova/+/87902115:31
kashyaptobias-urdin: If you're respinning it for other reasons, please add the deprecation patch URL to the commit message :)15:31
tobias-urdinkashyap: ack, thanks!18:34

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!