openstackgerrit | Brin Zhang proposed openstack/nova master: Fix os-volumes-attachments policy to be admin_or_owner https://review.opendev.org/709955 | 00:00 |
---|---|---|
*** joshualyle has joined #openstack-nova | 00:02 | |
*** threestrands has joined #openstack-nova | 00:03 | |
joshualyle | does anyone have any ideas on why my compute nodes would only seem to schedule migrations between subsets of nodes? | 00:03 |
joshualyle | I upgraded half of my nodes and then the other half but now the latter half will only live-migrate between themselves and I'm not sure why | 00:04 |
openstackgerrit | Brin Zhang proposed openstack/nova master: Add test coverage of existing os-volumes-attachments policies https://review.opendev.org/709929 | 00:08 |
openstackgerrit | Brin Zhang proposed openstack/nova master: Introduce scope_types in os-volumes-attachments policy https://review.opendev.org/709388 | 00:08 |
*** slaweq has joined #openstack-nova | 00:11 | |
openstackgerrit | Merged openstack/nova master: Add new default roles in Admin Action API policies https://review.opendev.org/676682 | 00:16 |
*** slaweq has quit IRC | 00:17 | |
openstackgerrit | Brin Zhang proposed openstack/nova master: Add test coverage of existing os-volumes-attachments policies https://review.opendev.org/709929 | 00:19 |
openstackgerrit | Brin Zhang proposed openstack/nova master: Introduce scope_types in os-volumes-attachments policy https://review.opendev.org/709388 | 00:21 |
openstackgerrit | Merged openstack/nova master: Introduce scope_types in os-assisted_volume_snapshots policy https://review.opendev.org/701837 | 00:23 |
openstackgerrit | Merged openstack/nova master: Add new default roles in os-assisted_volume_snapshots policies https://review.opendev.org/701840 | 00:23 |
openstackgerrit | Merged openstack/nova master: api-ref: mark device response param as optional for list/show vol attachments https://review.opendev.org/690383 | 00:23 |
openstackgerrit | Brin Zhang proposed openstack/nova master: Add new default roles in os-volumes-attachments policies https://review.opendev.org/710190 | 00:25 |
*** tetsuro has joined #openstack-nova | 00:42 | |
openstackgerrit | Brin Zhang proposed openstack/nova master: Add new default roles in os-volumes-attachments policies https://review.opendev.org/710190 | 00:46 |
*** tetsuro has quit IRC | 00:47 | |
*** tetsuro has joined #openstack-nova | 00:47 | |
*** owalsh has quit IRC | 00:54 | |
*** owalsh has joined #openstack-nova | 01:00 | |
joshualyle | turns out it might just be overallocated because of some weirdness during previous allocations. Is there a straightforward way to fix "There are allocations remaining against the source host that might need to be removed" | 01:10 |
*** slaweq has joined #openstack-nova | 01:11 | |
melwitt | joshualyle: this might be of help https://docs.openstack.org/nova/latest/admin/troubleshooting/orphaned-allocations.html | 01:16 |
*** slaweq has quit IRC | 01:16 | |
*** mtreinish has quit IRC | 01:27 | |
joshualyle | thank you melwitt. I was able to clean up some messed up allocations but I still have a host that refuses to accept any migrations :-/ | 01:40 |
*** mtreinish has joined #openstack-nova | 01:40 | |
melwitt | joshualyle: I would get the osc-placement cli (it's a plugin for osc) and use this command to see if there's any allocations that don't belong on it https://docs.openstack.org/osc-placement/latest/cli/index.html#resource-provider-show | 01:55 |
melwitt | openstack resource provider show --allocations <uuid> | 01:56 |
melwitt | you can also use that cli to remove bad allocations. just be aware that it does a full replace when you 'set' allocations. so removing allocations is by omission of only the ones you want gone and setting only the ones you want to keep | 01:57 |
*** sapd1 has joined #openstack-nova | 02:08 | |
*** gyee has quit IRC | 02:08 | |
*** slaweq has joined #openstack-nova | 02:11 | |
joshualyle | melwitt: I'm currently on rocky. "openstack resource provider" doesn't seem to be available | 02:13 |
joshualyle | after a lot of troubleshooting, the problem seems to be clock drift because chrony wasn't working and neutron not working correctly on the destination compute node causing preflight check failures | 02:14 |
*** slaweq has quit IRC | 02:15 | |
openstackgerrit | Merged openstack/nova master: Workaround a race initialising version control in db_version() https://review.opendev.org/619622 | 02:18 |
openstackgerrit | Merged openstack/nova master: Add description of live_migration_timeout_action option https://review.opendev.org/700124 | 02:19 |
openstackgerrit | Merged openstack/nova master: doc: note the need to configure cinder auth in reclaim_instance_interval https://review.opendev.org/690602 | 02:19 |
openstackgerrit | Merged openstack/nova master: Monkey patch original current_thread _active https://review.opendev.org/707474 | 02:19 |
*** joshualyle has quit IRC | 02:26 | |
*** kaisers_ has quit IRC | 02:28 | |
*** tbachman has joined #openstack-nova | 02:42 | |
*** mkrai has joined #openstack-nova | 02:51 | |
*** rcernin_ has joined #openstack-nova | 02:52 | |
*** spatel has joined #openstack-nova | 02:52 | |
*** rcernin has quit IRC | 02:55 | |
*** slaweq has joined #openstack-nova | 03:11 | |
*** mkrai has quit IRC | 03:15 | |
*** slaweq has quit IRC | 03:16 | |
*** mkrai has joined #openstack-nova | 03:21 | |
*** lbragstad has quit IRC | 03:58 | |
*** slaweq has joined #openstack-nova | 04:11 | |
*** slaweq has quit IRC | 04:17 | |
openstackgerrit | Sundar Nadathur proposed openstack/nova master: ksa auth conf and client for Cyborg access https://review.opendev.org/631242 | 04:21 |
openstackgerrit | Sundar Nadathur proposed openstack/nova master: Add Cyborg device profile groups to request spec. https://review.opendev.org/631243 | 04:21 |
openstackgerrit | Sundar Nadathur proposed openstack/nova master: Create and bind Cyborg ARQs. https://review.opendev.org/631244 | 04:21 |
openstackgerrit | Sundar Nadathur proposed openstack/nova master: Pass accelerator requests to each virt driver from compute manager. https://review.opendev.org/698581 | 04:21 |
openstackgerrit | Sundar Nadathur proposed openstack/nova master: Compose accelerator PCI devices into domain XML in libvirt driver. https://review.opendev.org/631245 | 04:21 |
openstackgerrit | Sundar Nadathur proposed openstack/nova master: Delete ARQs for an instance when the instance is deleted. https://review.opendev.org/673735 | 04:21 |
openstackgerrit | Sundar Nadathur proposed openstack/nova master: Enable hard/soft reboot with accelerators. https://review.opendev.org/697940 | 04:21 |
openstackgerrit | Sundar Nadathur proposed openstack/nova master: Enable start/stop of instances with accelerators. https://review.opendev.org/699553 | 04:21 |
openstackgerrit | Sundar Nadathur proposed openstack/nova master: Enable and use COMPUTE_ACCELERATORS trait. https://review.opendev.org/699554 | 04:21 |
openstackgerrit | Sundar Nadathur proposed openstack/nova master: Bump compute rpcapi version and reduce Cyborg calls. https://review.opendev.org/704227 | 04:21 |
openstackgerrit | Sundar Nadathur proposed openstack/nova master: Block unsupported instance operations with accelerators. https://review.opendev.org/674726 | 04:21 |
openstackgerrit | Sundar Nadathur proposed openstack/nova master: Add cyborg tempest job. https://review.opendev.org/670999 | 04:21 |
*** links has joined #openstack-nova | 04:38 | |
*** ociuhandu has joined #openstack-nova | 04:55 | |
*** ratailor has joined #openstack-nova | 04:57 | |
*** ratailor has quit IRC | 04:59 | |
*** ratailor has joined #openstack-nova | 04:59 | |
*** ociuhandu has quit IRC | 04:59 | |
*** jamesdenton has quit IRC | 05:03 | |
*** jamesdenton has joined #openstack-nova | 05:04 | |
*** slaweq has joined #openstack-nova | 05:11 | |
*** slaweq has quit IRC | 05:16 | |
*** rcernin_ has quit IRC | 05:24 | |
*** vesper has quit IRC | 05:34 | |
*** evrardjp has quit IRC | 05:35 | |
*** evrardjp has joined #openstack-nova | 05:35 | |
*** vesper11 has joined #openstack-nova | 05:37 | |
*** boxiang has joined #openstack-nova | 05:47 | |
*** boxiang has joined #openstack-nova | 05:48 | |
*** macz_ has joined #openstack-nova | 05:50 | |
*** boxiang_ has joined #openstack-nova | 05:53 | |
*** macz_ has quit IRC | 05:55 | |
*** boxiang has quit IRC | 05:56 | |
*** zhanglong has joined #openstack-nova | 05:59 | |
*** igordc has joined #openstack-nova | 06:09 | |
*** slaweq has joined #openstack-nova | 06:11 | |
openstackgerrit | Lenny Verkhovsky proposed openstack/os-vif master: WIP: Testing CI https://review.opendev.org/686937 | 06:11 |
*** igordc has quit IRC | 06:13 | |
*** yedongcan has joined #openstack-nova | 06:14 | |
*** slaweq has quit IRC | 06:16 | |
*** toabctl has quit IRC | 06:18 | |
*** spatel has quit IRC | 06:22 | |
*** zhanglong has quit IRC | 06:22 | |
*** toabctl has joined #openstack-nova | 06:22 | |
*** brinzhang has joined #openstack-nova | 06:32 | |
*** jangutter has joined #openstack-nova | 06:35 | |
*** brinzhang_ has joined #openstack-nova | 06:35 | |
*** zhanglong has joined #openstack-nova | 06:38 | |
*** brinzhang has quit IRC | 06:38 | |
*** jangutter has quit IRC | 06:39 | |
*** brinzhang has joined #openstack-nova | 06:40 | |
*** brinzhang has quit IRC | 06:41 | |
*** brinzhang has joined #openstack-nova | 06:41 | |
*** brinzhang_ has quit IRC | 06:43 | |
*** zhanglong has quit IRC | 06:44 | |
*** brinzhang has quit IRC | 06:46 | |
*** brinzhang has joined #openstack-nova | 06:46 | |
*** brinzhang has quit IRC | 06:48 | |
*** brinzhang has joined #openstack-nova | 06:49 | |
*** kaisers has joined #openstack-nova | 06:56 | |
*** brinzhang_ has joined #openstack-nova | 06:59 | |
openstackgerrit | Brin Zhang proposed openstack/nova master: Add PATCH volume attachments api to os-volume_attachments https://review.opendev.org/693828 | 07:01 |
*** brinzhang has quit IRC | 07:02 | |
*** slaweq has joined #openstack-nova | 07:11 | |
*** rcernin has joined #openstack-nova | 07:13 | |
*** slaweq has quit IRC | 07:16 | |
*** mkrai has quit IRC | 07:21 | |
*** mkrai has joined #openstack-nova | 07:35 | |
*** maciejjozefczyk has joined #openstack-nova | 07:48 | |
*** happyhemant has joined #openstack-nova | 07:50 | |
*** damien_r has joined #openstack-nova | 07:52 | |
*** slaweq has joined #openstack-nova | 07:52 | |
*** maciejjozefczyk has quit IRC | 07:55 | |
*** maciejjozefczyk has joined #openstack-nova | 08:01 | |
*** iurygregory has joined #openstack-nova | 08:26 | |
*** tesseract has joined #openstack-nova | 08:30 | |
*** iurygregory has quit IRC | 08:36 | |
*** rpittau|afk is now known as rpittau | 08:41 | |
*** iurygregory has joined #openstack-nova | 08:41 | |
*** rcernin has quit IRC | 08:41 | |
*** ralonsoh has joined #openstack-nova | 08:42 | |
*** brinzhang has joined #openstack-nova | 08:47 | |
*** brinzhang has quit IRC | 08:49 | |
*** brinzhang has joined #openstack-nova | 08:49 | |
*** brinzhang_ has quit IRC | 08:50 | |
*** brinzhang has quit IRC | 08:51 | |
*** brinzhang has joined #openstack-nova | 08:52 | |
*** brinzhang has quit IRC | 08:53 | |
*** brinzhang has joined #openstack-nova | 08:54 | |
*** breizhkoala has joined #openstack-nova | 09:02 | |
*** ccamacho has quit IRC | 09:02 | |
*** FlorianFa has quit IRC | 09:05 | |
*** ociuhandu has joined #openstack-nova | 09:06 | |
*** threestrands has quit IRC | 09:09 | |
openstackgerrit | Lee Yarwood proposed openstack/nova master: images: Move qemu-img info calls into privsep https://review.opendev.org/706897 | 09:09 |
openstackgerrit | Lee Yarwood proposed openstack/nova master: images: Allow the output format of qemu-img info to be controlled https://review.opendev.org/706898 | 09:09 |
openstackgerrit | Lee Yarwood proposed openstack/nova master: virt: Pass request context to extend_volume https://review.opendev.org/706899 | 09:09 |
openstackgerrit | Lee Yarwood proposed openstack/nova master: libvirt: Correctly resize encrypted LUKSv1 volumes https://review.opendev.org/706900 | 09:09 |
openstackgerrit | Lee Yarwood proposed openstack/nova master: DNM - Test TEMPEST_EXTEND_ATTACHED_ENCRYPTED_VOLUME https://review.opendev.org/707593 | 09:09 |
*** ociuhandu has quit IRC | 09:12 | |
*** udesale has joined #openstack-nova | 09:14 | |
*** ociuhandu has joined #openstack-nova | 09:15 | |
openstackgerrit | Lee Yarwood proposed openstack/nova master: libvirt: Use oslo.utils >= 4.1.0 to fetch format-specific image data https://review.opendev.org/710785 | 09:20 |
openstackgerrit | Lee Yarwood proposed openstack/nova master: libvirt: Always provide the size in bytes when calling virDomainBlockResize https://review.opendev.org/707590 | 09:20 |
openstackgerrit | Lee Yarwood proposed openstack/nova master: images: Remove Libvirt specific configurable use from qemu_img_info https://review.opendev.org/707591 | 09:20 |
openstackgerrit | Lee Yarwood proposed openstack/nova master: libvirt: Remove QEMU_VERSION_REQ_SHARED https://review.opendev.org/710239 | 09:20 |
*** tesseract has quit IRC | 09:25 | |
*** tesseract has joined #openstack-nova | 09:26 | |
*** iurygregory has quit IRC | 09:27 | |
*** martinkennelly has joined #openstack-nova | 09:34 | |
*** ociuhandu has quit IRC | 09:37 | |
happyhemant | Hello folks, I am having trouble creating instance with sriov network port. I tried creating normal instance it works really fine but creating it with sriov network port dosent seems to work for me. The logs of nova-conductor shows `No valid host found`. Look at my config of nova and neutron did i miss anything there ? help will be muc appreciated thank you so much | 09:38 |
happyhemant | https://www.irccloud.com/pastebin/tCZBhkNZ/ | 09:38 |
*** jangutter has joined #openstack-nova | 09:38 | |
happyhemant | nova.conf https://www.irccloud.com/pastebin/4RPX1qJm/ | 09:40 |
happyhemant | neutron conf https://www.irccloud.com/pastebin/wByQoY60/ | 09:42 |
*** iurygregory has joined #openstack-nova | 09:43 | |
*** derekh has joined #openstack-nova | 09:43 | |
*** ociuhandu has joined #openstack-nova | 09:45 | |
*** ociuhandu has quit IRC | 09:58 | |
*** dtantsur|afk is now known as dtantsur | 10:03 | |
*** rcernin has joined #openstack-nova | 10:04 | |
stephenfin | happyhemant: That _looks_ correct. Could you give us the output of 'lspci -vvv' and try again with nova-compute in DEBUG mode though? | 10:08 |
stephenfin | happyhemant: Also, what's the output of '/sys/class/net/eno1/device/sriov_numvfs' ? | 10:11 |
*** brinzhang_ has joined #openstack-nova | 10:11 | |
stephenfin | happyhemant: Are these VFs you're attempting to use or PFs? eno1 sounds like the latter. If so, you need to do some additional configuration | 10:12 |
*** brinzhang has quit IRC | 10:15 | |
happyhemant | stephenfin: Thank you so much for reply so basically i have two computes so the result of `/sys/class/net/eno1/device/sriov_numvfs`this https://www.irccloud.com/pastebin/BSSYQc9T/ | 10:18 |
happyhemant | stephenfin: also have look lscpi -vvv output https://pastebin.com/raw/XetJLPuD | 10:24 |
*** brinzhang has joined #openstack-nova | 10:24 | |
*** ociuhandu has joined #openstack-nova | 10:25 | |
happyhemant | stephenfin: I will also try to add DEBUG mode and will try to redeploy it | 10:25 |
*** ivve has joined #openstack-nova | 10:27 | |
*** ociuhandu has quit IRC | 10:27 | |
*** brinzhang_ has quit IRC | 10:27 | |
*** ociuhandu has joined #openstack-nova | 10:27 | |
*** spatel has joined #openstack-nova | 10:27 | |
stephenfin | happyhemant: okay, you've that configured wrong :) | 10:28 |
stephenfin | you use 'devname' to passthrough a specific device, so what you're asking nova to passthrough is the PFs eno1 and eno2 | 10:28 |
stephenfin | not their VFs | 10:28 |
openstackgerrit | Brin Zhang proposed openstack/nova master: WIP Add functional tests for PATCH volume attachments API https://review.opendev.org/710965 | 10:31 |
stephenfin | happyhemant: so you need to either (a) find and use the product IDs of the VFs or (b) use the PCI addresses instead | 10:33 |
*** spatel has quit IRC | 10:33 | |
happyhemant | stephenfin: well thank you so much stephenfin i will try this and will let you know | 10:34 |
stephenfin | No problem. Let me know if you get it going. There's a guide for this at [1] and if you think we're missing information, I'd encourage you to submit a patch. Even a draft that one of us can finish for you would be good (y) [1] https://docs.openstack.org/neutron/latest/admin/config-sriov.html | 10:37 |
*** rcernin has quit IRC | 10:37 | |
*** rcernin has joined #openstack-nova | 10:38 | |
*** ociuhandu has quit IRC | 10:39 | |
*** brinzhang_ has joined #openstack-nova | 10:42 | |
*** brinzhang_ has quit IRC | 10:43 | |
*** brinzhang_ has joined #openstack-nova | 10:44 | |
*** brinzhang has quit IRC | 10:45 | |
*** brinzhang_ has quit IRC | 10:45 | |
*** brinzhang_ has joined #openstack-nova | 10:46 | |
*** sapd1 has quit IRC | 10:47 | |
*** ccamacho has joined #openstack-nova | 10:52 | |
*** ccamacho has quit IRC | 10:53 | |
*** ccamacho has joined #openstack-nova | 10:54 | |
*** klippo has quit IRC | 10:56 | |
happyhemant | stephenfin: hey stephenfin hi again `passthrough_whitelist: '[{physical_network": "public", "vendor_id":"10df", "product_id":"0720"}, {"physical_network": "public", "vendor_id":"10df", "product_id":"0720"}]'` this should be good ? ` | 10:58 |
stephenfin | 0720 is the VF product_id, yeah? | 10:58 |
stephenfin | and not the PF | 10:58 |
happyhemant | https://www.irccloud.com/pastebin/VWAbYQER/ | 10:59 |
stephenfin | (they nearly always have different product_id's) | 10:59 |
happyhemant | i found this | 10:59 |
*** openstackstatus has quit IRC | 10:59 | |
happyhemant | where `VF offset: 32, stride: 1, Device ID: 0720` | 10:59 |
stephenfin | ah, perfect | 10:59 |
stephenfin | they'll show up if you do 'lspci -nn' too, I'd imagine | 11:00 |
*** waverider has joined #openstack-nova | 11:00 | |
stephenfin | in any case, assuming those are correct then that looks good to me | 11:00 |
stephenfin | make sure you're in DEBUG mode and away you go | 11:00 |
*** brinzhang has joined #openstack-nova | 11:01 | |
happyhemant | stephenfin: yeah sure i already enabled debug mode in nova and neutron conf | 11:01 |
happyhemant | i am newbie but thanks for 'lspci -nn' `04:00.0 Ethernet controller [0200]: Emulex Corporation OneConnect NIC (Skyhawk) [10df:0720] (rev 10)` | 11:02 |
happyhemant | this is what i got | 11:02 |
happyhemant | so i think i am good to go to try this out | 11:02 |
stephenfin | hmm, not sure that's right | 11:02 |
stephenfin | what about 'lspci -nn | grep 04:04.0' ? | 11:03 |
stephenfin | happyhemant: ^ | 11:03 |
*** brinzhang_ has quit IRC | 11:03 | |
happyhemant | https://www.irccloud.com/pastebin/3Y9y6QdG/ | 11:04 |
happyhemant | stephenfin: ^ | 11:05 |
stephenfin | So they use the same product_id. Lovely | 11:05 |
stephenfin | okay, I think nova will just filter out the PFs so you should be good to go still | 11:05 |
stephenfin | try that and let me know how it goes | 11:05 |
happyhemant | stephenfin: but does this sound reasonable to you ? `passthrough_whitelist: '[{"physical_network": "public", "vendor_id":"10df", "product_id":"0720"}, { "physical_network": "public", "vendor_id":"10df", "product_id":"0720"}]' | 11:06 |
stephenfin | Mostly. You don't need to specify it twice since they say the same thing now, right? | 11:07 |
happyhemant | yeah | 11:07 |
happyhemant | thats my question shall specify it one time ? | 11:07 |
stephenfin | just once, yeah | 11:08 |
happyhemant | stephenfin: cool will let you know if it works or not | 11:09 |
*** ociuhandu has joined #openstack-nova | 11:12 | |
*** rpittau is now known as rpittau|bbl | 11:17 | |
happyhemant | stephenfin: i think the conf is not good for me i am missing something ` Invalid PCI devices Whitelist config: Invalid entry: 'map[physical_network:public product_id:0720 vendor_id:10df]'` | 11:21 |
*** klippo has joined #openstack-nova | 11:22 | |
happyhemant | `passthrough_whitelist: [{ "physical_network": "public", "vendor_id":"10df", "product_id":"0720" }]`this is what i have right now | 11:22 |
stephenfin | I'm assuming you're using some deployment too. Does it need to be escaped or anything, seeing as it's JSON in a string | 11:23 |
happyhemant | yes i am using deployment https://www.irccloud.com/pastebin/Uu9vQV2e/ | 11:25 |
happyhemant | i have no idea tbh | 11:26 |
stephenfin | happyhemant: Can you put that into a string | 11:31 |
stephenfin | so passthrough_whitelist: '[{ "physical_network": "public", "vendor_id":"10df", "product_id":"0720" }]' | 11:31 |
stephenfin | (notice the extra quotes) | 11:32 |
happyhemant | stephenfin: heyy i think i found out i was missing '' this :( | 11:32 |
happyhemant | my bad sorry | 11:32 |
happyhemant | missing quotes sometimes blows your mind :D | 11:33 |
*** mkrai has quit IRC | 11:33 | |
happyhemant | https://www.irccloud.com/pastebin/etoeESAh/ | 11:39 |
happyhemant | stephenfin: i created two instances but result is still the same :( https://www.irccloud.com/pastebin/9xC23uMj/ | 11:39 |
stephenfin | Damn. What are the logs saying? | 11:40 |
stephenfin | and how are you creating the ports and instances? openstackclient? Can you share the commands you're executing? | 11:40 |
happyhemant | nova-conductor https://www.irccloud.com/pastebin/UnFf1AUh/ | 11:40 |
happyhemant | yes using openstackclient | 11:41 |
stephenfin | what about nova-scheduler? | 11:41 |
happyhemant | nova-schedular https://www.irccloud.com/pastebin/1cafm67C/ | 11:42 |
*** mkrai has joined #openstack-nova | 11:43 | |
happyhemant | for creating instance i have some script https://www.irccloud.com/pastebin/GNNjRZbJ/ | 11:43 |
happyhemant | so at the end i do `create_sriov <name> <flavor-name>` | 11:43 |
stephenfin | happyhemant: Okay, unfortunately I'm not sure how much debug logging there is for this stuff so you might need to hack on the code a little to figure out what's going wrong. It's a misconfiguration but I can't figure out where :-\ | 11:46 |
*** trident has quit IRC | 11:46 | |
stephenfin | happyhemant: The code you want is in 'nova/pci/stats.py'. The 'PciPassthroughFilter' calls that | 11:47 |
*** david-lyle has joined #openstack-nova | 11:47 | |
*** dklyle has quit IRC | 11:47 | |
*** trident has joined #openstack-nova | 11:49 | |
stephenfin | happyhemant: If you go stick in a load of debug logging in that file, restart the services and then try again, you should be able to grok what's going on. For example, it would be good to ensure '_filter_pools_for_spec' is returning something https://github.com/openstack/nova/blob/master/nova/pci/stats.py#L328 | 11:49 |
stephenfin | so literally add 'LOG.debug('Got matching_pools: %r', matching_pools)' after that line | 11:50 |
stephenfin | ditto for every other 'matching_pools' assignment. That will let us figure out what's causing the PCI devices to be dropped | 11:50 |
*** tbachman has quit IRC | 11:50 | |
happyhemant | stephenfin: thanks stephenfin again i will dig in more into that code i am not much familiar but will try to find out. Btw i use the same config with queens and it worked for me without any error | 11:52 |
*** rcernin has quit IRC | 11:52 | |
stephenfin | what version are you on now? | 11:52 |
happyhemant | i am using master branch | 11:52 |
stephenfin | yeah, not a lot has changed there in a few releases. The only changes we made was the ability to configure NUMA affinity, but that won't affect you since you're not using that feature | 11:53 |
stephenfin | hence my thought that it's some configuration issue that we just haven't spotted | 11:53 |
stephenfin | anyway | 11:54 |
* stephenfin -> lunch | 11:54 | |
happyhemant | no problem but let me know if you find something and bon appetit | 11:54 |
happyhemant | i will try to dig in more | 11:55 |
*** tetsuro has quit IRC | 11:57 | |
*** mkrai has quit IRC | 12:12 | |
*** nicolasbock has joined #openstack-nova | 12:15 | |
*** boxiang_ has quit IRC | 12:20 | |
*** boxiang_ has joined #openstack-nova | 12:20 | |
*** brinzhang has quit IRC | 12:21 | |
*** brinzhang has joined #openstack-nova | 12:22 | |
*** brinzhang_ has joined #openstack-nova | 12:26 | |
*** mkrai has joined #openstack-nova | 12:26 | |
*** brinzhang has quit IRC | 12:29 | |
*** ratailor has quit IRC | 12:39 | |
*** bbowen has joined #openstack-nova | 13:00 | |
*** brinzhang has joined #openstack-nova | 13:03 | |
*** rpittau|bbl is now known as rpittau | 13:04 | |
*** Corwin_ has joined #openstack-nova | 13:06 | |
*** ociuhandu has quit IRC | 13:06 | |
*** mkrai has quit IRC | 13:06 | |
*** brinzhang_ has quit IRC | 13:06 | |
*** lbragstad has joined #openstack-nova | 13:07 | |
*** ociuhandu has joined #openstack-nova | 13:07 | |
*** tbachman has joined #openstack-nova | 13:08 | |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: WIP: Hey let's support routed networks y'all! https://review.opendev.org/656885 | 13:09 |
*** jaosorior has joined #openstack-nova | 13:11 | |
*** ociuhandu has quit IRC | 13:12 | |
*** Sundar has joined #openstack-nova | 13:14 | |
*** udesale_ has joined #openstack-nova | 13:17 | |
*** brinzhang_ has joined #openstack-nova | 13:17 | |
*** udesale has quit IRC | 13:18 | |
Sundar | dansmith, sean-k-mooney, gibi, efried, brinzhang: Re. https://review.opendev.org/#/c/674726/3/nova/exception.py@159 , if the client attempts an operation despite documentation that it is unsupported, is that not a client error? | 13:18 |
gibi | Sundar: for me it is a client error. but I have no hard oppinion on 400 or 403 both works for me | 13:21 |
gibi | alex_xu: ^^ ? | 13:21 |
brinzhang_ | gibi, Sundar, me too. | 13:22 |
brinzhang_ | 400 or 403 all works good for me | 13:22 |
*** udesale_ has quit IRC | 13:24 | |
*** udesale has joined #openstack-nova | 13:24 | |
Sundar | gibi, brinzhang_: It is currently handled in https://review.opendev.org/#/c/674726/3/nova/api/openstack/compute/servers.py@758 . However, the resulting error code is not 403, but is 500. I am still looking into that. Off the top of your head, do you see why? | 13:26 |
gibi | Sundar: are you sure that you hit Line 760 in your test? | 13:27 |
*** mkrai has joined #openstack-nova | 13:28 | |
*** Sundar35 has joined #openstack-nova | 13:28 | |
*** Sundar35 has quit IRC | 13:28 | |
*** Sundar30 has joined #openstack-nova | 13:29 | |
gibi | Sundar: as at a first glance your code looks correct | 13:30 |
Sundar30 | Sorry, got disconnected due to network issues. | 13:31 |
*** udesale has quit IRC | 13:31 | |
*** Sundar has quit IRC | 13:31 | |
*** udesale has joined #openstack-nova | 13:31 | |
gibi | 14:27 < gibi> Sundar: are you sure that you hit Line 760 in your test? | 13:31 |
gibi | 14:30 < gibi> Sundar: as at a first glance your code looks correct | 13:31 |
Sundar30 | gibi: I'll double check that. Without that, one should have got 403 error code. | 13:33 |
*** mkrai has quit IRC | 13:33 | |
Sundar30 | Back in 10 min. | 13:34 |
gibi | Sundar30: I'm on a meeting for 90 minutes so it will take time to answere | 13:36 |
brinzhang_ | Sundar30: How about inherit Forbidden class? it's code also 403, and your case is suitable for Forbidden, just need to override msg_fmt, do you think so? | 13:39 |
*** nweinber has joined #openstack-nova | 13:41 | |
brinzhang_ | Sundar30: checked again, as gibi said, your code look correct, the phenomenon you said is strange | 13:42 |
Sundar30 | Back. Let me try some things. | 13:44 |
*** nweinber has quit IRC | 13:48 | |
*** nweinber has joined #openstack-nova | 13:49 | |
*** ratailor has joined #openstack-nova | 13:50 | |
*** tbachman has quit IRC | 13:53 | |
*** udesale has quit IRC | 13:58 | |
*** udesale has joined #openstack-nova | 13:58 | |
*** zigo has quit IRC | 13:58 | |
*** lbragstad has quit IRC | 13:59 | |
*** eharney has joined #openstack-nova | 14:02 | |
*** links has quit IRC | 14:05 | |
*** sapd1 has joined #openstack-nova | 14:09 | |
*** mriedem has joined #openstack-nova | 14:14 | |
*** yedongcan has left #openstack-nova | 14:15 | |
*** lpetrut has joined #openstack-nova | 14:18 | |
*** iurygregory has quit IRC | 14:26 | |
*** iurygregory has joined #openstack-nova | 14:28 | |
*** tkajinam has quit IRC | 14:30 | |
*** tkajinam has joined #openstack-nova | 14:31 | |
*** zigo has joined #openstack-nova | 14:32 | |
openstackgerrit | Brin Zhang proposed openstack/nova master: Store instance action event exc_val fault details https://review.opendev.org/694428 | 14:36 |
openstackgerrit | Brin Zhang proposed openstack/nova master: Expose instance action event details out of the API https://review.opendev.org/694430 | 14:36 |
*** spatel has joined #openstack-nova | 14:36 | |
*** xek has joined #openstack-nova | 14:37 | |
*** links has joined #openstack-nova | 14:37 | |
*** links has quit IRC | 14:37 | |
*** brinzhang has quit IRC | 14:39 | |
*** brinzhang has joined #openstack-nova | 14:40 | |
*** spatel has quit IRC | 14:40 | |
openstackgerrit | Brin Zhang proposed openstack/nova master: Add instance actions v283 samples test https://review.opendev.org/706251 | 14:43 |
*** ratailor has quit IRC | 14:46 | |
*** tbachman has joined #openstack-nova | 14:51 | |
*** artom has joined #openstack-nova | 14:51 | |
happyhemant | stephenfin: hey hi again do you think `LOG.debug('Got matching_pools: %r', matching_pools)` after every matching_pools and building its image will help getting detailed logs ? | 14:55 |
dansmith | Sundar30: have you gone through the multinode test to look at the failures? | 14:56 |
dansmith | Sundar30: some stuff in there makes sense, live migration and such, but some other things are blocked that seem like they shouldn't be | 14:57 |
dansmith | actually, now that I say this I wonder if these are old results | 14:57 |
dansmith | ah yeah, from yesterday before you pushed | 14:58 |
Sundar30 | dansmith: Yea, I have updated the patches. Where do you see the multinode results? | 14:58 |
dansmith | I just rechecked it so we can get the updates | 14:59 |
dansmith | Sundar30: https://review.opendev.org/#/c/709641/6 | 14:59 |
Sundar30 | Good | 15:00 |
*** lbragstad has joined #openstack-nova | 15:01 | |
Sundar30 | dansmith: We discussed https://review.opendev.org/#/c/674726/3/nova/exception.py@159 earlier today. Are you ok with 403 error code? | 15:03 |
*** ociuhandu has joined #openstack-nova | 15:03 | |
dansmith | 403 means "forbidden despite proper authorization", which to me could mean "you're not allowed to do this with this thing", which seems perfectly appropriate to me | 15:04 |
dansmith | I'm also fine with 400, but I definitely don't think 403 is wrong | 15:04 |
*** spatel has joined #openstack-nova | 15:05 | |
stephenfin | happyhemant: It should help, yes | 15:05 |
happyhemant | stephenfin: ok thanks so i actually started building new image lets see what we see but i am done for today so will let you know about it tomorrow. Tbh i am completely lost cause of it and doing some silly stuff i hope it will get fixed tomorrow or soon :( | 15:08 |
*** tkajinam has quit IRC | 15:09 | |
*** brinzhang_ has quit IRC | 15:11 | |
*** KeithMnemonic has quit IRC | 15:16 | |
*** Sundar30 has quit IRC | 15:16 | |
*** lpetrut has quit IRC | 15:23 | |
openstackgerrit | Dan Smith proposed openstack/nova master: Fix two test cases that use side effects in comprehensions https://review.opendev.org/711039 | 15:24 |
*** N3l1x has joined #openstack-nova | 15:32 | |
*** udesale_ has joined #openstack-nova | 15:35 | |
*** udesale has quit IRC | 15:37 | |
*** ociuhandu has quit IRC | 15:39 | |
*** dave-mccowan has joined #openstack-nova | 15:41 | |
*** mlavalle has joined #openstack-nova | 15:43 | |
*** tesseract has quit IRC | 15:43 | |
*** dave-mccowan has quit IRC | 15:46 | |
dansmith | gibi: I went through the bottom chunk of the cyborg patches yesterday and many of my concerns have been resolved, | 15:51 |
dansmith | but I need to focus on the higher ones and the test results still | 15:51 |
*** spatel has quit IRC | 15:51 | |
dansmith | Sundar revised the set between yesterday and today too | 15:51 |
dansmith | have you looked recently and/or how are you feeling on it? | 15:52 |
*** tesseract has joined #openstack-nova | 15:53 | |
gibi | I haven't looked that recently. But I planning to | 15:56 |
gibi | I can try to get a look through tomorrow morning | 15:57 |
dansmith | gibi: cool.. I think test coverage is still a problem, even in some of the cases you've already pointed out, but I've tried to continue to hammer on that | 15:59 |
openstackgerrit | Lee Yarwood proposed openstack/nova master: virt: Provide block_device_info during rescue https://review.opendev.org/700811 | 16:03 |
openstackgerrit | Lee Yarwood proposed openstack/nova master: libvirt: Add support for stable device rescue https://review.opendev.org/700812 | 16:03 |
openstackgerrit | Lee Yarwood proposed openstack/nova master: compute: Report COMPUTE_RESCUE_BFV and check during rescue https://review.opendev.org/701429 | 16:03 |
openstackgerrit | Lee Yarwood proposed openstack/nova master: api: Introduce microverion 2.83 allowing boot from volume rescue https://review.opendev.org/701430 | 16:03 |
openstackgerrit | Lee Yarwood proposed openstack/nova master: compute: Extract _get_bdm_image_metadata into nova.utils https://review.opendev.org/705212 | 16:03 |
openstackgerrit | Lee Yarwood proposed openstack/nova master: libvirt: Support boot from volume stable device instance rescue https://review.opendev.org/701431 | 16:03 |
gibi | dansmith: ack | 16:04 |
openstackgerrit | Lee Yarwood proposed openstack/nova master: DNM - Test stable device rescue tests with BFV instances https://review.opendev.org/710050 | 16:05 |
mriedem | lyarwood: beware this https://review.opendev.org/#/c/710861/ | 16:18 |
lyarwood | mriedem: oh fun | 16:20 |
lyarwood | mriedem: thanks for the heads up | 16:20 |
mriedem | found the related bug https://bugs.launchpad.net/nova/+bug/1788014 so i -1'ed that backport | 16:22 |
openstack | Launchpad bug 1788014 in OpenStack Compute (nova) rocky "when live migration fails due to a internal error rollback is not handeled correctly." [Medium,Triaged] | 16:22 |
mriedem | looks like the fix never made it to rocky though so it's still an issue there | 16:22 |
* mriedem smoke bombs out of here | 16:24 | |
lyarwood | \o/ thanks | 16:24 |
*** gyee has joined #openstack-nova | 16:27 | |
*** damien_r has quit IRC | 16:28 | |
*** udesale_ has quit IRC | 16:29 | |
*** brinzhang_ has joined #openstack-nova | 16:29 | |
*** waverider has quit IRC | 16:30 | |
*** brinzhang has quit IRC | 16:32 | |
*** nweinber has quit IRC | 16:37 | |
*** macz_ has joined #openstack-nova | 16:39 | |
*** ivve has quit IRC | 16:44 | |
*** macz_ has quit IRC | 16:44 | |
*** macz_ has joined #openstack-nova | 16:47 | |
*** breizhkoala has quit IRC | 16:51 | |
*** tbachman has quit IRC | 16:53 | |
*** maciejjozefczyk has quit IRC | 16:55 | |
*** jangutter has quit IRC | 16:57 | |
*** jangutter has joined #openstack-nova | 16:58 | |
*** tesseract has quit IRC | 16:58 | |
*** nweinber has joined #openstack-nova | 17:09 | |
*** rpittau is now known as rpittau|afk | 17:10 | |
*** dtantsur is now known as dtantsur|afk | 17:13 | |
*** brinzhang has joined #openstack-nova | 17:19 | |
*** ociuhandu has joined #openstack-nova | 17:21 | |
*** brinzhang_ has quit IRC | 17:22 | |
*** tbachman has joined #openstack-nova | 17:22 | |
*** derekh has quit IRC | 17:28 | |
*** evrardjp has quit IRC | 17:35 | |
*** evrardjp has joined #openstack-nova | 17:35 | |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: WIP: Hey let's support routed networks y'all! https://review.opendev.org/656885 | 17:36 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Support routed net during cold migration https://review.opendev.org/711071 | 17:37 |
*** martinkennelly has quit IRC | 17:38 | |
*** ociuhandu_ has joined #openstack-nova | 17:40 | |
*** ociuhandu has quit IRC | 17:43 | |
*** ociuhandu_ has quit IRC | 17:44 | |
*** jangutter has quit IRC | 17:47 | |
*** jangutter has joined #openstack-nova | 17:50 | |
*** igordc has joined #openstack-nova | 17:59 | |
*** nweinber has quit IRC | 18:10 | |
*** jangutter has quit IRC | 18:25 | |
*** vishalmanchanda has quit IRC | 18:59 | |
*** eharney has quit IRC | 19:19 | |
*** ralonsoh has quit IRC | 19:21 | |
*** mvkr has quit IRC | 19:28 | |
*** tbachman has quit IRC | 19:34 | |
openstackgerrit | Michael Bayer proposed openstack/nova master: Remove oslo_db.sqlalchemy.compat reference https://review.opendev.org/711093 | 19:35 |
*** tbachman has joined #openstack-nova | 19:38 | |
*** tbachman_ has joined #openstack-nova | 19:40 | |
*** tbachman has quit IRC | 19:43 | |
*** tbachman_ is now known as tbachman | 19:43 | |
openstackgerrit | Merged openstack/nova master: Pass the actual target in os-assisted_volume_snapshots policy https://review.opendev.org/701841 | 19:47 |
*** maciejjozefczyk has joined #openstack-nova | 19:48 | |
*** eharney has joined #openstack-nova | 19:50 | |
*** mvkr has joined #openstack-nova | 19:53 | |
*** nweinber has joined #openstack-nova | 20:03 | |
*** ociuhandu has joined #openstack-nova | 20:10 | |
*** ociuhandu has quit IRC | 20:15 | |
*** trident has quit IRC | 20:23 | |
*** maciejjozefczyk has quit IRC | 20:23 | |
*** maciejjozefczyk has joined #openstack-nova | 20:24 | |
*** trident has joined #openstack-nova | 20:26 | |
openstackgerrit | Lee Yarwood proposed openstack/nova master: libvirt: Remove VIR_DOMAIN_BLOCK_REBASE_RELATIVE flag check https://review.opendev.org/702021 | 20:33 |
*** slaweq has quit IRC | 20:46 | |
*** tbachman has quit IRC | 20:50 | |
*** damien_r has joined #openstack-nova | 20:53 | |
*** damien_r has quit IRC | 20:53 | |
*** damien_r has joined #openstack-nova | 20:54 | |
*** nicolasbock has quit IRC | 20:58 | |
*** tbachman has joined #openstack-nova | 21:02 | |
*** lbragstad_ has joined #openstack-nova | 21:04 | |
openstackgerrit | Lee Yarwood proposed openstack/nova stable/pike: Remove exp legacy-tempest-dsvm-full-devstack-plugin-nfs https://review.opendev.org/702061 | 21:06 |
*** lbragstad has quit IRC | 21:07 | |
*** igordc has quit IRC | 21:08 | |
*** igordc has joined #openstack-nova | 21:08 | |
*** igordc has quit IRC | 21:10 | |
*** slaweq has joined #openstack-nova | 21:11 | |
*** TxGirlGeek has joined #openstack-nova | 21:11 | |
*** igordc has joined #openstack-nova | 21:12 | |
*** igordc has quit IRC | 21:12 | |
*** slaweq has quit IRC | 21:16 | |
*** nweinber has quit IRC | 21:17 | |
*** xek has quit IRC | 21:20 | |
*** damien_r has quit IRC | 21:27 | |
*** damien_r has joined #openstack-nova | 21:28 | |
*** damien_r has quit IRC | 21:28 | |
*** damien_r has joined #openstack-nova | 21:28 | |
*** happyhemant has quit IRC | 21:29 | |
*** damien_r has quit IRC | 21:35 | |
*** tbachman has quit IRC | 21:41 | |
openstackgerrit | Merged openstack/nova master: Remove 'nova.image.api' module https://review.opendev.org/702451 | 21:45 |
openstackgerrit | Rafael Weingärtner proposed openstack/nova master: Enhance os-simple-tenant-usage VM hours accounting https://review.opendev.org/711113 | 21:52 |
*** maciejjozefczyk has quit IRC | 21:52 | |
openstackgerrit | Merged openstack/nova master: Fix two test cases that use side effects in comprehensions https://review.opendev.org/711039 | 21:53 |
*** rcernin has joined #openstack-nova | 21:56 | |
*** dpawlik has quit IRC | 22:00 | |
openstackgerrit | Rafael Weingärtner proposed openstack/nova master: Enhance os-simple-tenant-usage VM hours accounting https://review.opendev.org/711113 | 22:00 |
*** owalsh has quit IRC | 22:03 | |
*** owalsh has joined #openstack-nova | 22:03 | |
*** imacdonn has quit IRC | 22:04 | |
*** imacdonn has joined #openstack-nova | 22:04 | |
openstackgerrit | Rafael Weingärtner proposed openstack/nova master: Enhance os-simple-tenant-usage VM hours accounting https://review.opendev.org/711113 | 22:06 |
*** slaweq has joined #openstack-nova | 22:11 | |
*** slaweq has quit IRC | 22:16 | |
*** lbragstad_ is now known as lbragstad | 22:20 | |
*** tbachman has joined #openstack-nova | 22:26 | |
*** brinzhang_ has joined #openstack-nova | 22:42 | |
*** mriedem has left #openstack-nova | 22:42 | |
*** brinzhang has quit IRC | 22:45 | |
*** tkajinam has joined #openstack-nova | 22:48 | |
*** kozhukalov has joined #openstack-nova | 22:51 | |
*** tbachman has quit IRC | 23:00 | |
*** slaweq has joined #openstack-nova | 23:11 | |
*** slaweq has quit IRC | 23:16 | |
*** owalsh_ has joined #openstack-nova | 23:25 | |
*** owalsh has quit IRC | 23:28 | |
*** tbachman has joined #openstack-nova | 23:30 | |
*** brinzhang has joined #openstack-nova | 23:33 | |
*** brinzhang_ has quit IRC | 23:36 | |
*** mlavalle has quit IRC | 23:44 | |
*** sapd1 has quit IRC | 23:53 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!