Wednesday, 2022-11-16

opendevreviewNobuhiro MIKI proposed openstack/nova master: libvirt: fix typo in test_config  https://review.opendev.org/c/openstack/nova/+/86464102:34
*** dasm|off is now known as Guest163403:20
opendevreviewGhanshyam proposed openstack/nova master: Add service role in nova policy  https://review.opendev.org/c/openstack/nova/+/86459403:44
opendevreviewGhanshyam proposed openstack/nova master: api-ref update: Move the service APIs in a separate section  https://review.opendev.org/c/openstack/nova/+/86465504:49
opendevreviewGhanshyam proposed openstack/nova master: api-ref update: Move the service APIs in a separate section  https://review.opendev.org/c/openstack/nova/+/86465505:38
opendevreviewAmit Uniyal proposed openstack/nova stable/train: Refactor volume connection cleanup out of _post_live_migration  https://review.opendev.org/c/openstack/nova/+/86467005:44
opendevreviewAmit Uniyal proposed openstack/nova stable/train: Move pre-3.44 Cinder post live migration test to test_compute_mgr  https://review.opendev.org/c/openstack/nova/+/86467105:44
opendevreviewAmit Uniyal proposed openstack/nova stable/train: functional: Change order of two classes  https://review.opendev.org/c/openstack/nova/+/86467205:44
opendevreviewGhanshyam proposed openstack/nova master: DNM: test new defaults  https://review.opendev.org/c/openstack/nova/+/86467305:51
*** han-guangyu is now known as Guest164806:02
*** Guest1648 is now known as han-guangyu06:02
opendevreviewYounghwan Yoo proposed openstack/nova master: Update a return value of mdev_name2uuid function to be a valid UUID value  https://review.opendev.org/c/openstack/nova/+/86467406:10
han-guangyuHello, I want to package ovn in openEuler(a OS had been supported by openstack ci))06:13
han-guangyuCould I can get a recommended version of ovn to Train and Wallaby06:14
han-guangyuI see:06:14
han-guangyu> OpenStack doesn’t set explicit version requirements for OVN installation, but it’s recommended to follow at least the version that is used in upstream CI,    in https://docs.openstack.org/neutron/latest/ovn/faq/index.html06:14
han-guangyuBut I am not sure, if I use the latest version of ovn, whether the neutron of train and wallaby both can be connected normally06:16
han-guangyuDo they have a capped version that supports06:16
opendevreviewYounghwan Yoo proposed openstack/nova master: Update mdev_name2uuid function return value to be a valid UUID  https://review.opendev.org/c/openstack/nova/+/86467406:17
opendevreviewYounghwan Yoo proposed openstack/nova master: Update return value to be a valid UUID  https://review.opendev.org/c/openstack/nova/+/86467406:21
han-guangyuoh06:21
han-guangyuI send to a incorret channel06:21
han-guangyuI want to neutron , sorry06:21
opendevreviewYounghwan Yoo proposed openstack/nova master: Update return value to be a valid UUID  https://review.opendev.org/c/openstack/nova/+/86467406:37
opendevreviewAmit Uniyal proposed openstack/nova stable/train: functional: Change order of two classes  https://review.opendev.org/c/openstack/nova/+/86467206:42
opendevreviewAmit Uniyal proposed openstack/nova stable/train: Add boot from volume functional test with a huge request  https://review.opendev.org/c/openstack/nova/+/86467907:56
*** han-guangyu__ is now known as han-guangyu08:36
opendevreviewSahid Orentino Ferdjaoui proposed openstack/nova-specs master: spec: allowing target state for evacuate  https://review.opendev.org/c/openstack/nova-specs/+/85783809:02
sahidgibi, sean-k-mooney o/ if you can have a second look at ^ there is one point that I don't get 09:03
gibisahid: looking...09:05
*** han-guangyu is now known as Guest166009:08
*** han-guangyu_ is now known as han-guangyu09:08
sean-k-mooney[m]sahid gibi is just asking that you bump the compute service version and add a min compute service version check in the api09:08
sean-k-mooney[m]so if you upgrade the api and conductors but not the computes09:09
sean-k-mooney[m]we would still reject the new microversion09:09
sean-k-mooney[m]until you completed updating all the computes09:09
gibiyepp09:10
gibiI left a reply in the review too09:10
gibibut it is what sean-k-mooney[m] described above09:11
sean-k-mooney[m]we do this with a decorator on the api method09:11
sean-k-mooney[m]https://github.com/openstack/nova/blob/bcdf5988f6ae902dba9b41144a7b4a60688b627c/nova/compute/api.py#L28309:11
sean-k-mooney[m]that is an example for vdpa09:11
sean-k-mooney[m]you will need to reject the new microverion untill the requied min service version is reached09:12
sean-k-mooney[m]you might want to do this eailer then that actully09:15
sean-k-mooney[m]i dont think we have the microverion at that point09:15
opendevreviewAmit Uniyal proposed openstack/nova stable/train: functional: Unify '_wait_until_deleted' implementations  https://review.opendev.org/c/openstack/nova/+/86471209:16
opendevreviewAmit Uniyal proposed openstack/nova stable/train: functional: Unify '_build_minimal_create_server_request' implementations  https://review.opendev.org/c/openstack/nova/+/86471309:16
sean-k-mooney[m]so it would be better to do it here https://github.com/openstack/nova/blob/bcdf5988f6ae902dba9b41144a7b4a60688b627c/nova/api/openstack/compute/evacuate.py instead09:16
sahidgibi, sean-k-mooney[m] Ok I think I have your point09:17
opendevreviewSahid Orentino Ferdjaoui proposed openstack/nova-specs master: spec: allowing target state for evacuate  https://review.opendev.org/c/openstack/nova-specs/+/85783809:20
sahidfixed ^09:21
zigoHi there! I have a compute node with 3 VMs that look like having an affinity server group, so I can't live-evacuate the node (for kernel upgrade). How do I force the affinity to become a soft-affinity in the nova scheduler ?09:42
zigoI think that's possible, right?09:43
kashyapGood question, I don't even know top off my head.  Perhaps bauzas or gibi 09:43
gibizigo: you cannot change the policy of the group09:43
zigogibi: What's the way to evacuate my node then?09:44
gibizigo: if you want to live migrate the VM then you can use old microversion to specify the target host with force=true09:44
gibithen the scheduler will not do any checks09:44
zigoOh, thanks! :)09:44
* zigo tries09:45
gibiforce available until 2.6709:45
zigoI'm on Victoria on that cluster, so that's 2.87... :)09:46
zigoopenstack server migrate: error: unrecognized arguments: --force09:48
zigo"The Force" isn't with me ... :/09:50
gibihm , I don't see --force in openstack client09:51
zigoRight, so how do I do force=true ?09:53
gibiif you use microversion < 2.30 the --host will also mean force as well. but please note that nova will not check the target host if it is valid or not09:55
gibialso if you have an instance with nested allocation like bandwith, vgpu then forcing a host will not work properly, you will probably use the nested allocations09:56
gibis/use/lose/09:56
gibiif you want to have safe live migration then you need to disable the server group filter in the scheduler temporarily and do the migration without --host and then restore the filter09:57
zigoAh, ok.09:58
gibiwe lack the capability to change a policy on a server group so affinity is very sticky09:58
gibi(with a small DB hack you can change the affinity to soft-affinity on the group :D)10:01
opendevreviewAmit Uniyal proposed openstack/nova stable/train: functional: Rework '_delete_server'  https://review.opendev.org/c/openstack/nova/+/86472110:17
zigogibi: That's what I ended-up doing, yes ...11:00
zigoI just had a few "Error monitoring migration: internal error: client socket is closed: libvirt.libvirtError: internal error: client socket is closed"11:00
zigoWhat does this mean, and how to avoid it?11:01
sean-k-mooneythat sound like the qemu instance crashed or at least teh qemu monitor connection11:01
zigook...11:15
opendevreviewKirill proposed openstack/nova-specs master: new spec: support of vnc console for ironic  https://review.opendev.org/c/openstack/nova-specs/+/86377312:17
opendevreviewSahid Orentino Ferdjaoui proposed openstack/nova-specs master: spec: allowing target state for evacuate  https://review.opendev.org/c/openstack/nova-specs/+/85783812:31
opendevreviewKirill proposed openstack/nova-specs master: new spec: support of vnc console for ironic  https://review.opendev.org/c/openstack/nova-specs/+/86377312:40
Kirill_hope i covered all wishes)12:42
sean-k-mooneyKirill_: one benifit of looking up the password wehn you connec tby the way is you can actully rotate teh vnc passworkd on the ironic side if that is required by your security policy12:57
sean-k-mooneyiw we saved it in the nova db you could never change the vnc password on the ironic host12:58
Kirill_its not actually true. i mean if we change password on ironic side we will get new password via get_vnc_console method. and it will be stored in nova db. in auth_tokens table we have records for each vnc request13:00
Kirill_but as you said we need a db migration, so it is easier to make your realisation13:00
sean-k-mooneyyou mean if you create a new console via the api13:00
sean-k-mooneyi guess it would update that way yes13:00
sean-k-mooneyso i kind of expect other to ask for more detail in the spec as you have not really explianed how your going to impmletne this in the proxy13:01
Kirill_just to clarify: more details with realisation with storing password on Nova side? cause with out storing there is nothing to add. i mean only realisation new class which can work with rfb protocol and addifn get_vnc_console method to ironic virt driver.13:04
Kirill_with out storing password there will e more changes on ironic side13:05
Kirill_adding new request to ironic_cli. but i think that need to discuss it in ironic channak13:05
sean-k-mooneyso without storing the password it would be nice to hav emore then 1 line on the change to the novnc proxy13:05
sean-k-mooneywe shoudl call out the depency on the ironic change and deatail the workflow that will be implmented13:06
sean-k-mooney1 user create console that creaate a token whihc is used by the proxy to corraltate the proxy request to the instnace13:07
sean-k-mooney2 the user connecct to the proxy with the token and the proxy looks up the password in ironic13:07
sean-k-mooney3 if that succeed the proxy connect to the vnc console exposed by the bmc and stream the result to the user13:08
sean-k-mooneyin step too it woudl be good to call out which ironic endpoint in the api we will invoke to get the password13:09
sean-k-mooneynova does not use the cli by the way to the password need to be accesabel via the ironic api13:09
Kirill_oh, what do you use instead?13:10
sean-k-mooneyinter service comunciation is directly to the rest api. we can use the ironnic-pythonclinet to provide python binding for the rest api but we do not invoke the cli in a subshell13:11
sean-k-mooneyeventrually we want to drop the project client and move to the openstack sdk instead13:12
Kirill_++13:12
sean-k-mooneyif the info is already acceabel via the sdk you can just use that directly13:13
opendevreviewAlexey Stupnikov proposed openstack/nova stable/wallaby: Cleanup old resize instances dir before resize  https://review.opendev.org/c/openstack/nova/+/86469113:13
sean-k-mooneyKirill_: currently we are using the ironic client for most things realted to ironic https://github.com/openstack/nova/blob/master/nova/virt/ironic/client_wrapper.py#L5713:14
Kirill_i'd like to do smth like this:console = self.ironicclient.call('node.get_console', node_uuid = node_uuid)13:15
sean-k-mooneybut we do use the sdk in places 13:15
sean-k-mooneyhttps://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L378-L38513:15
Kirill_get_console_> get_vnc_password13:16
sean-k-mooneywhere is the vnc password stored13:17
sean-k-mooneyis it directly on the node 13:17
Kirill_in ironic, idrac-info13:17
Kirill_on node13:17
Kirill_node show will return vnc_pasword:****13:18
sean-k-mooneyok we alreay have a get node function https://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L215-L22613:18
sean-k-mooneyso you should jsut be able to call that and do pwd = node.vnc_password13:19
Kirill_yep, sound good13:21
sean-k-mooneyi dont directly see it here https://github.com/openstack/openstacksdk/blob/master/openstack/baremetal/v1/node.py#L97-L246 but its proably there on a sub filed of one of those properties13:23
sean-k-mooneyits not directly in https://github.com/openstack/python-ironicclient/blob/master/ironicclient/v1/node.py either so im guessing its a subfield13:25
*** abhishekk is now known as akekane|home13:26
Kirill_thanks, need to check it13:26
opendevreviewAlexey Stupnikov proposed openstack/nova stable/victoria: Cleanup old resize instances dir before resize  https://review.opendev.org/c/openstack/nova/+/86473013:40
opendevreviewAlexey Stupnikov proposed openstack/nova stable/victoria: Cleanup old resize instances dir before resize  https://review.opendev.org/c/openstack/nova/+/86473013:41
opendevreviewAlexey Stupnikov proposed openstack/nova stable/ussuri: Cleanup old resize instances dir before resize  https://review.opendev.org/c/openstack/nova/+/86473213:48
*** Guest1634 is now known as dasm13:48
opendevreviewAlexey Stupnikov proposed openstack/nova stable/train: Cleanup old resize instances dir before resize  https://review.opendev.org/c/openstack/nova/+/86469213:51
Ugglabauzas, shit ! I have just encountered a "great python" ! ;)14:05
bauzassorry, was at the doc for a inflamed shoulder ;)14:17
sahido/ gibi,sean-k-mooney again me :-) About your point on the spec https://review.opendev.org/c/openstack/nova-specs/+/85783814:40
sahidso I have to add a check to here which verifies that the RPC version is supported14:40
sahidhttps://review.opendev.org/c/openstack/nova/+/858384/19/nova/api/openstack/compute/evacuate.py#9814:40
sahidthat is the point? I'm verify sorry I'm not so famialiar with the API/RPC part14:41
sean-k-mooney so indie that if14:44
sean-k-mooney*inside14:44
sean-k-mooneyyou can get the min compute service verion14:45
sean-k-mooneyand raise an excption if it below the one required for your feature14:45
sahidperfect, got it!14:45
sahidthanks a lot14:45
sean-k-mooneymin_ver = objects.service.get_minimum_version_all_cells(14:46
sean-k-mooney                        nova_context.get_admin_context(), ['nova-compute']14:46
sean-k-mooney                    )14:46
sean-k-mooneythat will give you the min version14:46
sean-k-mooneyso just to if min_ver < X raise ...14:46
sahid:-)14:47
sean-k-mooneywe normally do this latter but its similar to do it there14:47
opendevreviewRafael Weingartner proposed openstack/nova master: Nova to honor "cross_az_attach" during server(VM) migrations  https://review.opendev.org/c/openstack/nova/+/86476016:14
bauzassean-k-mooney: I'm not opposed to the fact we don't hardly specific cpu governors in nova and we let the operator decide which ones they want https://review.opendev.org/c/openstack/nova-specs/+/861591/comments/6a5d4488_55cda4bd16:27
bauzassean-k-mooney: but I wonder how we could let the operators *specify* it16:27
bauzasa ListOpt doesn't really help16:27
bauzasas we would need to guess which governor is the powersaving one and which one is the best performant16:27
bauzassean-k-mooney: and I feel a DictOpt is too much painful to add16:28
bauzassean-k-mooney: see my concern ?16:29
sean-k-mooneywell i was thinking of having the first be the low power and second high16:39
sean-k-mooneybut you could just add 2 config options16:39
sean-k-mooneyfor high and low16:39
sean-k-mooneydictopts are supporte by oslo but we dont currently use them in nova16:40
bauzascorrect hence me reluctant16:40
sean-k-mooneybauzas: its really just the active/high-power one that we really care about16:40
sean-k-mooneypowersave runs the cpu at the lowest frequency it can without turning off16:40
sean-k-mooneyperformance is the opicite16:41
sean-k-mooneyin general you would not want to hardcode perfromace if your trying to manage power16:41
sean-k-mooneyso if the high power one was configurable that woudl be enough16:41
sean-k-mooneyif you want to keep it simple howwever why not add two config options16:42
sean-k-mooneycpu_high_power_govoner and cpu_low_power_govoner16:42
sean-k-mooneyjust simple stings16:42
bauzasyup, that's what I write now16:42
sean-k-mooneyworks for me16:43
bauzaswe could bikeshed on the namings16:43
sean-k-mooneygibi: ^16:43
opendevreviewSylvain Bauza proposed openstack/nova-specs master: Proposes cpu power managment in libvirt  https://review.opendev.org/c/openstack/nova-specs/+/86159116:43
bauzasthere you go16:43
opendevreviewSylvain Bauza proposed openstack/nova master: Deprecate mdev creation and hardfail on reboot when missing.  https://review.opendev.org/c/openstack/nova/+/86441817:10
opendevreviewSylvain Bauza proposed openstack/nova master: Reproducer for bug 1951656  https://review.opendev.org/c/openstack/nova/+/85067317:10
opendevreviewSylvain Bauza proposed openstack/nova master: Handle mdev devices in libvirt 7.7+  https://review.opendev.org/c/openstack/nova/+/83897617:10
opendevreviewJohn Garbutt proposed openstack/nova master: Ironic nodes with instance reserved in placement  https://review.opendev.org/c/openstack/nova/+/86477317:25
johnthetubaguygibi: I think I may have found an "interesting" way to close that ironic scheduler race with automatic clean, but it feels a bit wrong, its a follow on from that patch you reviewed yesterday: https://review.opendev.org/c/openstack/nova/+/86477317:28
gibijohnthetubaguy: that is a clever one17:31
johnthetubaguyit might be too clever, but it seems to work... funky right?17:32
gibiI think we intentionally designed placement in a way that it allows reserving already allocated inventories17:33
gibibut not allow allocating reserved ones17:33
gibiso I think what you do is OK from placement perspective17:33
gibihow likely that a big ironic deployment has no cleaning configured and the update_provider_tree periodic is set to a big value due to preformance reasons?17:36
johnthetubaguyOK, neat. I remember some related discussions around increasing host reserved memory, and it sounded OK ish.17:36
johnthetubaguy... unsure, that is a very good question. Most large deployments I work on do automatic cleaning, but I know that far from representative17:37
johnthetubaguy(I have to run I am afraid, I am told my dinner is going cold)17:37
gibijohnthetubaguy: no worries. I will leave the feedback in the review17:37
gibihave a nice dinner17:40
sean-k-mooneyo/ just saw the comment on ironic reivew17:45
sean-k-mooneyis the plan to proceed with https://review.opendev.org/c/openstack/nova/+/842478 anyway17:46
sean-k-mooneyif so i can review again tomorrow17:46
sean-k-mooneyi am mostly out of brain power today but i dont mind looking at it in the morning17:47
sean-k-mooneyhttps://review.opendev.org/c/openstack/nova/+/864773 is the other one? to review with https://review.opendev.org/c/openstack/nova/+/84247817:48
sean-k-mooneyand yes if you are over allcoated you cannot make  new allcoations 17:51
sean-k-mooneybut i think you are right that you can modify the reserve value17:52
sean-k-mooneylike you can go form reservice 0 cpus to 10 and if that would over allocate that is fine it will be resolved when a vm is delete/moved17:53
sean-k-mooneyi have not looked at johnthetubaguy clever solution but form context i assume it invovles setting the reserved value to 1 for the custom resoucs inventory that represnt the baremetal hosts17:54
opendevreviewRafael Weingartner proposed openstack/nova master: Nova to honor "cross_az_attach" during server(VM) migrations  https://review.opendev.org/c/openstack/nova/+/86476018:03
opendevreviewRafael Weingartner proposed openstack/nova master: Nova to honor "cross_az_attach" during server(VM) migrations  https://review.opendev.org/c/openstack/nova/+/86476022:02
*** dasm is now known as dasm|off23:11
opendevreviewYounghwan Yoo proposed openstack/nova master: Update return value to be a valid UUID  https://review.opendev.org/c/openstack/nova/+/86467423:41

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!