Thursday, 2023-11-16

songwenpinghi, team. nova-conductor services block at starting after the control nodes' network reset(stop and start for 5min), what's the reason and any guys got this?01:01
gibimgariepy: you might hit by https://bugs.launchpad.net/nova/+bug/203980308:31
opendevreviewElod Illes proposed openstack/nova stable/2023.1: add a regression test for all compute RPCAPI 6.x pinnings for rebuild  https://review.opendev.org/c/openstack/nova/+/90030609:43
opendevreviewElod Illes proposed openstack/nova stable/2023.1: Fix rebuild compute RPC API exception for rolling-upgrades  https://review.opendev.org/c/openstack/nova/+/90033609:43
opendevreviewElod Illes proposed openstack/nova stable/2023.1: Adding server actions tests to grenade-multinode  https://review.opendev.org/c/openstack/nova/+/90033709:43
bauzaselodilles: thanks for taking care of the RPC backports09:53
elodillesnp :)10:18
bauzaselodilles: as a reminder, we'll need to modify the main change when backporting to Zed since one of the two modifications are related to a new RPC version that was added in Antelope10:19
elodillesbauzas: i had only a quick look at the zed version, but yes, i saw that there should be a conflict10:19
elodillesthough as i saw probably it's trivial to resolve (famous last words? :))10:20
bauzaselodilles: probably, I can take a look when I have time10:35
opendevreviewMark Goddard proposed openstack/nova master: Functional test test_boot_reschedule_with_proper_pci_device_count  https://review.opendev.org/c/openstack/nova/+/76035411:23
opendevreviewMark Goddard proposed openstack/nova master: Fix PCI passthrough race on reschedule (refresh)  https://review.opendev.org/c/openstack/nova/+/71084811:23
dvo-plvsean-k-mooney, I write to you regarding your comment https://review.opendev.org/c/openstack/nova/+/876075/27/nova/api/validation/extra_specs/hw.py#54012:03
dvo-plvI found this doc https://review.opendev.org/c/openstack/glance/+/882133/3/doc/source/admin/useful-image-properties.rst12:03
dvo-plvbut i can not find glance metadada and flavor extra spec which I have to extend12:04
sean-k-mooney ah right you have done this already12:04
sean-k-mooneydvo-plv: you have already done it in https://review.opendev.org/c/openstack/glance/+/882133/3/etc/metadefs/compute-libvirt.json12:04
sean-k-mooneythat patch has everything you need to do in glance12:04
sean-k-mooneydvo-plv: all that is missing is the nova doc update to document the extra spec12:05
dvo-plvokay, I will test gibi's comments and update nova patch12:05
sean-k-mooneythat is done in the user/flavor.rst doc12:05
dvo-plvsoory, i did not get 12:06
sean-k-mooneyyour current nova patch does not update doc/source/user/flavor.rst12:06
sean-k-mooney* doc/source/user/flavors.rst12:07
sean-k-mooneywe list all the extra specs there https://github.com/openstack/nova/blob/master/doc/source/user/flavors.rst#extra-specs12:07
sean-k-mooneyso you shoudl just add the packed format there in your patch too12:07
sean-k-mooneyjust as you did in the glance useful-imageproperties.rst12:08
dvo-plvokay, I based on the vif_multiqueue_enabled and it does not present in this doc, so I thought it has other purposes12:15
sean-k-mooneywhen vif_multiqueue_enabled was first intoduced it was only an image property12:17
sean-k-mooneywe added it as a flavor extra spec in a sperate patch a few release later12:17
dvo-plvgot it12:18
sean-k-mooneyalthough it looks like we also forgot to update the doc when we added it12:18
sean-k-mooneyso we shoudl proably fix that at some point12:18
sean-k-mooneydvo-plv: sorry i think i link the wrong doc12:19
sean-k-mooneydvo-plv: you shoudl update https://docs.openstack.org/nova/latest/configuration/extra-specs.html instead12:27
sean-k-mooneywhich is here https://github.com/openstack/nova/blob/e5e5e00579212cf0b3a58cf7248f7e9483c17461/doc/source/configuration/extra-specs.rst12:27
sean-k-mooneythis doc is auto generated so you shoudl not need to modify it12:29
sean-k-mooneylet me confirm on the docs preview job12:29
sean-k-mooneydvo-plv: https://5e2e8f3aeccddec75327-8da05f86af8a44d2353be3e602197c08.ssl.cf1.rackcdn.com/876075/27/check/openstack-tox-docs/8e3d058/docs/configuration/extra-specs.html#hw:virtio_packed_ring 12:30
sean-k-mooneydvo-plv: so nova doc genreate is workign fine for your chage12:31
dvo-plvI also found this doc, it has in the web version https://docs.openstack.org/nova/latest/configuration/extra-specs.html, but it does not has so much info in the github https://github.com/openstack/nova/blob/master/doc/source/configuration/extra-specs.rst12:31
dvo-plvSo i thought that it generate dynamicly12:32
sean-k-mooneywe use sphinx directives to auto generate the contnet of the doc12:32
sean-k-mooney.. extra-specs:: hw12:33
sean-k-mooneyis automatically generating all the hw: extra specs including the one your adding12:33
sean-k-mooneywe have a sphix extention that does this https://github.com/openstack/nova/blob/e5e5e00579212cf0b3a58cf7248f7e9483c17461/doc/ext/extra_specs.py12:34
sean-k-mooneydvo-plv: it uses the info form the extra spec validators to generate the content12:35
sean-k-mooneyso as long as we provide a vlaidator the doc is always up to date12:35
dvo-plvso, with docs all good12:40
dvo-plvi do not update anything else12:40
dvo-plvonly fix gibi's comments12:40
sean-k-mooneycorrect the docs shoudl all be fine12:41
sean-k-mooneybut gibis comments in the review are valid12:41
sean-k-mooneysepcialy = false handeling12:41
dvo-plvgood that we clarify that, thanks12:41
mgariepygibi, yes thanks i found it and applied the workarounds stuff.13:37
SvenKieskehi there, can anybody update me on the status of this spec? https://specs.openstack.org/openstack/nova-specs/specs/wallaby/approved/nova-support-webvnc-with-password-authentication.html13:55
sean-k-mooneySvenKieske: it was rejected13:56
SvenKieskeI found out that it was not accepted for xena for non stated issues with it's design and then I can't find any updates anymore13:56
sean-k-mooneythe issues with the diesign came down ot how insecure the passward based auth is 13:56
SvenKieskemhm ok, don't want to argue about that, right now.13:57
sean-k-mooneyour recomendation is to use vcrpyt instead13:57
SvenKieskerelated, I found the docs for the "auth_schemes" variable really lacking, as, there is no description of possible values: https://docs.openstack.org/nova/latest/configuration/config.html#vnc.auth_schemes13:58
sean-k-mooneythere are 2 vauels vencrypt and none13:58
SvenKieskeyeah, but only "none" is documented, leaving users to reading the source code, as usual in openstack land :)13:59
sean-k-mooneyor all the vencrypt values below it13:59
sean-k-mooneywhich explcitly say "vnc.auth_schemes: must include vencrypt"13:59
sean-k-mooneybut that is a small chagne we coudl make we do list the enum values in other config options14:00
SvenKieskeregarding vcrypt: isn't that about tranport channel encryption? isn't that totally unrelated to user authentication and authorization?14:00
sean-k-mooneyso user auth and autherisation shoudl be done at the OS level14:00
SvenKieskeI mean, not totally unrelated, it's also a good security thing to do, but it does address a different problem, doesn't it?14:00
sean-k-mooneythere are two seperate thigns here yes14:01
SvenKieskethanks for the information so far, it has been some time since I looked into novnc auth stuff.14:01
sean-k-mooneynova provides a vnc proxy where autherisation is granted to connect via a bearer token that is provided as part of the console show reponce14:01
sean-k-mooneyif you enbale vencrypt that enabels cert base auth betwen the proxy and qemu14:02
SvenKieskeyeah, that's the mechanism I'm used to, also from other virtualization solutions in the space14:02
sean-k-mooneywhich prevents direct access to the qemu consoles14:02
SvenKieskeI didn't find any information so far though: is the bearer token stuff enabled by default? how to configure it? maybe I was looking at the wrong config values14:02
sean-k-mooneyit is we use the token for 2 diffent things14:03
sean-k-mooneyfirst its used for auth as it has an expiry and can only be issues by someone in the same porject14:03
sean-k-mooneysecond we use it to look up which instance to proxy the websocket conenction too14:04
sean-k-mooneyso the porxy checks if the token is still valid and then uses it to lookup what host/tcp port to proxy too14:04
SvenKieskeso it seems it's always enabled? at least here is no config toggle documented? https://docs.openstack.org/nova/latest/configuration/config.html#consoleauth14:05
sean-k-mooneycombin that with vencrypt and that will mean the only way to conenct to the console is via the proxy14:05
sean-k-mooneySvenKieske: so console auth used to be a speerate service but it was roled into the other nova servies several years ago14:06
sean-k-mooneythe token_tll is all that is left14:06
sean-k-mooneyso yes will alwasy issue the token when you do  openstack console url show <instance>14:06
sean-k-mooneywith a default expiry of 10 minutes14:07
sean-k-mooneythe current behavior of the proxy is to keep the active session alive after token expiry but we are addign a featue to terminate it this cycle14:07
sean-k-mooneyit will be opt in via a config option since most end user will wont the current beahiovor14:08
SvenKieskeokay, nice to know, thank you very much for the detailed explanations, as always :)14:19
opendevreviewMerged openstack/nova stable/zed: Add debug logging when Instance raises OrphanedObjectError  https://review.opendev.org/c/openstack/nova/+/88816114:26
opendevreviewJohn Garbutt proposed openstack/nova-specs master: Expose PCI device NUMA using PXB  https://review.opendev.org/c/openstack/nova-specs/+/86941614:26
SvenKieskeopened a bug for our deployment scenario, as we don't currently seem to lock down the connection between proxy and qemu: https://bugs.launchpad.net/kolla-ansible/+bug/204370914:35
sean-k-mooneymost installers dont14:35
sean-k-mooneyits not even done in tripleo and redhat added the feature in nova :P14:35
sean-k-mooneybut it is somethign we are planning to enable soon14:35
sean-k-mooneythe main blocker to using this by defualt in installer is the need to do tls cert generation and rotaion14:36
sean-k-mooneywe are currently in the process of movign our downstream product to use golang operator to deploy openstack on openshift14:37
sean-k-mooneyand we plan ot leverage the fact that we have access to certmanager in that env to handle that for us14:37
opendevreviewPierre Riteau proposed openstack/nova master: Fix a couple of typos  https://review.opendev.org/c/openstack/nova/+/89230014:40
opendevreviewSylvain Bauza proposed openstack/nova-specs master: Proposes mdev live-migration support in libvirt  https://review.opendev.org/c/openstack/nova-specs/+/90063615:12
admin1i get this "Build of instance 6c7b960d-ede4-4218-99b0-2f9d55f84dab aborted: Volume d53a7298-685a-43cd-89a3-13b9d6207dcd did not finish being created even after we waited 187 seconds or 61 attempts. And its status is creating" -- this is due to a 20gb image which is not present in the hypervisors and they need to be downloaded from glance first to16:12
admin1use as base image ..  which variables in nova.conf do I need to  use to fix this ? 16:12
opendevreviewSylvain Bauza proposed openstack/nova-specs master: Proposes mdev live-migration support in libvirt  https://review.opendev.org/c/openstack/nova-specs/+/90063616:20
opendevreviewMerged openstack/nova stable/yoga: Add debug logging when Instance raises OrphanedObjectError  https://review.opendev.org/c/openstack/nova/+/88816216:47
opendevreviewBalazs Gibizer proposed openstack/nova master: Allow enabling cpu_power_management with 0 dedicated CPUs  https://review.opendev.org/c/openstack/nova/+/90118817:11
opendevreviewJohn Garbutt proposed openstack/nova-specs master: Expose PCI device NUMA using PXB  https://review.opendev.org/c/openstack/nova-specs/+/86941617:14
Continuity__admin1: block_device_allocate_retries and block_device_allocate_retries_interval 17:24
*** Continuity__ is now known as Continuity17:25
Continuityin nova.conf will allow you to adjust those timeouts17:25
opendevreviewJohn Garbutt proposed openstack/nova-specs master: Add spec for PCI Groups  https://review.opendev.org/c/openstack/nova-specs/+/89971917:39
opendevreviewJohn Garbutt proposed openstack/nova-specs master: Add spec for PCI Groups  https://review.opendev.org/c/openstack/nova-specs/+/89971917:43
opendevreviewJohn Garbutt proposed openstack/nova-specs master: Add spec for PCI Groups  https://review.opendev.org/c/openstack/nova-specs/+/89971917:44
opendevreviewJing Geng proposed openstack/nova-specs master: APIImpact  https://review.opendev.org/c/openstack/nova-specs/+/90114517:45
opendevreviewArtom Lifshitz proposed openstack/nova master: DNM: Debug log if host state not updated from compute  https://review.opendev.org/c/openstack/nova/+/90119618:03
admin1Continuity, thanks ..    is block_device_allocate_retries: 600 and  block_device_allocate_retries_interval: 5 an accpetable value ? 18:10
opendevreviewMerged openstack/nova master: Fix python shebang  https://review.opendev.org/c/openstack/nova/+/89859419:02
Continuityadmin1: yeah that should be fine20:24
Continuityit means it will wait 5 seconds and try 600 times20:24
opendevreviewMerged openstack/nova master: Drop remaining deprecated upgrade_levels option for nova-cert  https://review.opendev.org/c/openstack/nova/+/89861320:50
opendevreviewMerged openstack/nova stable/xena: Add debug logging when Instance raises OrphanedObjectError  https://review.opendev.org/c/openstack/nova/+/88816320:53
opendevreviewmelanie witt proposed openstack/nova master: libvirt: Configure and teardown ephemeral encryption secrets  https://review.opendev.org/c/openstack/nova/+/82675423:19
opendevreviewmelanie witt proposed openstack/nova master: imagebackend: Add support to libvirt_info for LUKS based encryption  https://review.opendev.org/c/openstack/nova/+/82675523:19
opendevreviewmelanie witt proposed openstack/nova master: Add encryption support to convert_image  https://review.opendev.org/c/openstack/nova/+/87093423:19
opendevreviewmelanie witt proposed openstack/nova master: Support create with ephemeral encryption for qcow2  https://review.opendev.org/c/openstack/nova/+/87093223:19

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!