| *** TxGirlGeek has joined #openstack-nova | 00:00 | |
| *** TxGirlGeek has quit IRC | 00:00 | |
| *** jawad_axd has joined #openstack-nova | 00:03 | |
| *** gyee has quit IRC | 00:05 | |
| *** jawad_axd has quit IRC | 00:08 | |
| *** slaweq has joined #openstack-nova | 00:17 | |
| *** andreaf has joined #openstack-nova | 00:18 | |
| *** slaweq has quit IRC | 00:22 | |
| *** jawad_axd has joined #openstack-nova | 00:24 | |
| *** markvoelker has joined #openstack-nova | 00:27 | |
| *** jawad_axd has quit IRC | 00:29 | |
| *** markvoelker has quit IRC | 00:30 | |
| *** markvoelker has joined #openstack-nova | 00:30 | |
| *** benj_ has quit IRC | 00:50 | |
| *** ricolin has joined #openstack-nova | 00:50 | |
| *** markvoelker has quit IRC | 00:54 | |
| *** ricolin has quit IRC | 00:55 | |
| *** markvoelker has joined #openstack-nova | 00:57 | |
| *** benj_ has joined #openstack-nova | 01:05 | |
| *** jawad_axd has joined #openstack-nova | 01:05 | |
| *** markvoelker has quit IRC | 01:08 | |
| *** dviroel has quit IRC | 01:08 | |
| *** jawad_axd has quit IRC | 01:10 | |
| *** tbachman has quit IRC | 01:18 | |
| *** tbachman_ has joined #openstack-nova | 01:18 | |
| *** tbachman has joined #openstack-nova | 01:26 | |
| *** tbachman_ has quit IRC | 01:26 | |
| *** jawad_axd has joined #openstack-nova | 01:26 | |
| *** jawad_axd has quit IRC | 01:30 | |
| *** nanzha has joined #openstack-nova | 01:37 | |
| *** nanzha has quit IRC | 01:42 | |
| *** jawad_axd has joined #openstack-nova | 01:47 | |
| *** nanzha has joined #openstack-nova | 01:49 | |
| *** jawad_axd has quit IRC | 01:51 | |
| *** abaindur has quit IRC | 01:53 | |
| *** jawad_axd has joined #openstack-nova | 02:08 | |
| *** jawad_axd has quit IRC | 02:12 | |
| *** nanzha has quit IRC | 02:20 | |
| *** nanzha has joined #openstack-nova | 02:21 | |
| *** jawad_axd has joined #openstack-nova | 02:28 | |
| *** jawad_axd has quit IRC | 02:32 | |
| *** jawad_axd has joined #openstack-nova | 02:49 | |
| *** jawad_axd has quit IRC | 02:53 | |
| *** mkrai has joined #openstack-nova | 03:08 | |
| *** markvoelker has joined #openstack-nova | 03:09 | |
| *** jawad_axd has joined #openstack-nova | 03:10 | |
| *** benj_ has quit IRC | 03:10 | |
| *** markvoelker has quit IRC | 03:13 | |
| *** jawad_axd has quit IRC | 03:14 | |
| *** psachin has joined #openstack-nova | 03:34 | |
| *** nanzha has quit IRC | 03:38 | |
| *** nanzha has joined #openstack-nova | 03:39 | |
| *** benj_ has joined #openstack-nova | 03:40 | |
| *** benj_ has quit IRC | 03:53 | |
| *** janki has joined #openstack-nova | 03:56 | |
| *** igordc has quit IRC | 04:01 | |
| *** benj_ has joined #openstack-nova | 04:05 | |
| *** benj_ has quit IRC | 04:10 | |
| *** VedaAnnayappa has joined #openstack-nova | 04:11 | |
| *** gbarros_ has quit IRC | 04:11 | |
| VedaAnnayappa | hi | 04:11 |
|---|---|---|
| VedaAnnayappa | I need help with tempest test bed. | 04:11 |
| *** benj_ has joined #openstack-nova | 04:14 | |
| *** mkrai has quit IRC | 04:15 | |
| VedaAnnayappa | is there any impact on nova testcases in py37? | 04:17 |
| *** janki has quit IRC | 04:19 | |
| *** janki has joined #openstack-nova | 04:22 | |
| *** ricolin has joined #openstack-nova | 04:24 | |
| *** VedaAnnayappa has quit IRC | 04:30 | |
| *** nanzha has quit IRC | 04:39 | |
| *** nanzha has joined #openstack-nova | 04:44 | |
| *** udesale has joined #openstack-nova | 04:44 | |
| *** mkrai has joined #openstack-nova | 04:54 | |
| *** tkajinam has quit IRC | 05:01 | |
| *** bcm has joined #openstack-nova | 05:07 | |
| *** hamzy has quit IRC | 05:19 | |
| *** hamzy has joined #openstack-nova | 05:21 | |
| *** janki has quit IRC | 05:30 | |
| *** artom has quit IRC | 05:31 | |
| *** janki has joined #openstack-nova | 05:33 | |
| *** janki has quit IRC | 05:33 | |
| *** janki has joined #openstack-nova | 05:33 | |
| openstackgerrit | Merged openstack/nova master: Add regression test for bug 1824435 https://review.opendev.org/688205 | 05:36 |
| openstack | bug 1824435 in OpenStack Compute (nova) "fill_virtual_interface_list migration fails on second attempt" [Medium,In progress] https://launchpad.net/bugs/1824435 - Assigned to melanie witt (melwitt) | 05:36 |
| *** janki has quit IRC | 05:39 | |
| *** slaweq has joined #openstack-nova | 05:39 | |
| *** tkajinam has joined #openstack-nova | 05:44 | |
| *** slaweq has quit IRC | 05:44 | |
| *** slaweq has joined #openstack-nova | 05:45 | |
| *** nanzha has quit IRC | 05:46 | |
| *** nanzha has joined #openstack-nova | 05:50 | |
| *** nanzha has quit IRC | 05:54 | |
| *** nanzha has joined #openstack-nova | 05:54 | |
| *** dpawlik has joined #openstack-nova | 06:17 | |
| *** tesseract has joined #openstack-nova | 06:19 | |
| *** maciejjozefczyk has joined #openstack-nova | 06:23 | |
| *** udesale has quit IRC | 06:24 | |
| *** udesale has joined #openstack-nova | 06:25 | |
| *** rcernin has quit IRC | 06:26 | |
| *** udesale has quit IRC | 06:27 | |
| *** jawad_axd has joined #openstack-nova | 06:52 | |
| *** udesale has joined #openstack-nova | 06:52 | |
| *** Dinesh_Bhor has joined #openstack-nova | 06:58 | |
| *** abaindur has joined #openstack-nova | 06:59 | |
| *** ccamacho has joined #openstack-nova | 07:01 | |
| *** trident has quit IRC | 07:02 | |
| *** trident has joined #openstack-nova | 07:06 | |
| *** otsukahy has joined #openstack-nova | 07:07 | |
| *** markvoelker has joined #openstack-nova | 07:11 | |
| *** slaweq has quit IRC | 07:12 | |
| *** ttsiouts has joined #openstack-nova | 07:13 | |
| *** markvoelker has quit IRC | 07:16 | |
| *** ttsiouts has quit IRC | 07:26 | |
| *** tetsuro_ has joined #openstack-nova | 07:26 | |
| *** ttsiouts has joined #openstack-nova | 07:27 | |
| *** ttsiouts has quit IRC | 07:28 | |
| *** ttsiouts_ has joined #openstack-nova | 07:28 | |
| *** tetsuro has quit IRC | 07:29 | |
| *** abaindur has quit IRC | 07:41 | |
| *** tetsuro_ has quit IRC | 07:42 | |
| *** tetsuro has joined #openstack-nova | 07:42 | |
| *** ttsiouts_ has quit IRC | 07:43 | |
| *** ttsiouts has joined #openstack-nova | 07:43 | |
| *** ttsiouts_ has joined #openstack-nova | 07:47 | |
| *** ttsiouts has quit IRC | 07:48 | |
| *** udesale has quit IRC | 07:49 | |
| *** udesale has joined #openstack-nova | 07:49 | |
| *** rpittau|afk is now known as rpittau | 07:51 | |
| *** zbr has joined #openstack-nova | 07:53 | |
| *** ralonsoh has joined #openstack-nova | 07:55 | |
| *** otsukahy has quit IRC | 07:55 | |
| *** efried has quit IRC | 08:02 | |
| *** efried has joined #openstack-nova | 08:02 | |
| *** tssurya has joined #openstack-nova | 08:04 | |
| *** rcernin has joined #openstack-nova | 08:09 | |
| *** tkajinam has quit IRC | 08:10 | |
| *** ttsiouts_ has quit IRC | 08:12 | |
| *** ttsiouts has joined #openstack-nova | 08:13 | |
| *** ttsiouts has quit IRC | 08:17 | |
| *** ivve has joined #openstack-nova | 08:21 | |
| *** mkrai has quit IRC | 08:23 | |
| *** ttsiouts has joined #openstack-nova | 08:24 | |
| *** rcernin has quit IRC | 08:28 | |
| *** trident has quit IRC | 08:29 | |
| *** dpawlik has quit IRC | 08:34 | |
| *** trident has joined #openstack-nova | 08:35 | |
| *** nanzha has quit IRC | 08:41 | |
| *** nanzha has joined #openstack-nova | 08:42 | |
| *** derekh has joined #openstack-nova | 08:43 | |
| *** tssurya_ has joined #openstack-nova | 08:57 | |
| *** tssurya has quit IRC | 08:58 | |
| *** mkrai has joined #openstack-nova | 09:00 | |
| *** dpawlik has joined #openstack-nova | 09:02 | |
| *** maciejjozefczyk has quit IRC | 09:09 | |
| *** markvoelker has joined #openstack-nova | 09:12 | |
| *** cdent has joined #openstack-nova | 09:16 | |
| *** markvoelker has quit IRC | 09:17 | |
| *** nanzha has quit IRC | 09:19 | |
| *** xek_ has joined #openstack-nova | 09:19 | |
| *** otsukahy has joined #openstack-nova | 09:23 | |
| *** FlorianFa has joined #openstack-nova | 09:28 | |
| *** nanzha has joined #openstack-nova | 09:31 | |
| *** abaindur has joined #openstack-nova | 09:42 | |
| *** lpetrut has joined #openstack-nova | 09:42 | |
| *** otsukahy has quit IRC | 09:42 | |
| *** dpawlik has quit IRC | 09:48 | |
| *** rcernin has joined #openstack-nova | 09:49 | |
| *** otsukahy has joined #openstack-nova | 09:49 | |
| *** otsukahy has quit IRC | 09:50 | |
| *** otsukahy has joined #openstack-nova | 09:51 | |
| *** nanzha has quit IRC | 09:51 | |
| *** lpetrut has quit IRC | 09:55 | |
| *** otsukahy has quit IRC | 09:56 | |
| *** nanzha has joined #openstack-nova | 10:01 | |
| *** mkrai has quit IRC | 10:02 | |
| *** rpittau is now known as rpittau|bbl | 10:08 | |
| *** ttsiouts has quit IRC | 10:11 | |
| *** ttsiouts has joined #openstack-nova | 10:12 | |
| *** otsukahy has joined #openstack-nova | 10:12 | |
| *** dtantsur|afk has quit IRC | 10:16 | |
| *** ttsiouts has quit IRC | 10:16 | |
| *** dtantsur has joined #openstack-nova | 10:16 | |
| *** nanzha has quit IRC | 10:18 | |
| *** dpawlik has joined #openstack-nova | 10:19 | |
| *** nanzha has joined #openstack-nova | 10:21 | |
| *** dpawlik has quit IRC | 10:24 | |
| openstackgerrit | Merged openstack/nova master: libvirt: Ignore volume exceptions during post_live_migration https://review.opendev.org/682622 | 10:28 |
| *** otsukahy has quit IRC | 10:31 | |
| openstackgerrit | Lee Yarwood proposed openstack/nova stable/train: libvirt: Ignore volume exceptions during post_live_migration https://review.opendev.org/691281 | 10:33 |
| openstackgerrit | Lee Yarwood proposed openstack/nova stable/stein: libvirt: Ignore volume exceptions during post_live_migration https://review.opendev.org/691282 | 10:33 |
| openstackgerrit | Lee Yarwood proposed openstack/nova stable/rocky: libvirt: Ignore volume exceptions during post_live_migration https://review.opendev.org/691283 | 10:34 |
| openstackgerrit | Lee Yarwood proposed openstack/nova stable/queens: libvirt: Ignore volume exceptions during post_live_migration https://review.opendev.org/691284 | 10:34 |
| *** otsukahy has joined #openstack-nova | 10:37 | |
| *** tbachman has quit IRC | 10:40 | |
| *** otsukahy has quit IRC | 10:50 | |
| *** ccamacho has quit IRC | 10:55 | |
| *** mkrai has joined #openstack-nova | 10:58 | |
| *** lpetrut has joined #openstack-nova | 11:02 | |
| *** lpetrut has quit IRC | 11:05 | |
| *** dpawlik has joined #openstack-nova | 11:10 | |
| *** artom has joined #openstack-nova | 11:12 | |
| *** rcernin has quit IRC | 11:18 | |
| *** otsukahy has joined #openstack-nova | 11:21 | |
| sean-k-mooney | aspiers: are you around for a quick question about amd cpus and openstack | 11:22 |
| sean-k-mooney | aspiers: mainly have you tried to use cpu pinning and have you turned on SMT/hyperthreading when useing openstack? if so did it all just work fine? im ignoring the slighly dumb numa topology of eypc gen 1. | 11:24 |
| sean-k-mooney | aspiers: i have no reason to belive that nova will need any modifcation to work with amd eypc cpu for normal vms but im closing a ticket downstream saying i am happy to rely on the testing done by libvirt and qemu in this area. | 11:26 |
| *** ccamacho has joined #openstack-nova | 11:27 | |
| *** ttsiouts has joined #openstack-nova | 11:32 | |
| *** otsukahy has quit IRC | 11:32 | |
| *** mkrai has quit IRC | 11:43 | |
| *** mdbooth has quit IRC | 11:44 | |
| *** otsukahy has joined #openstack-nova | 11:50 | |
| *** mdbooth has joined #openstack-nova | 11:52 | |
| *** ttsiouts has quit IRC | 11:54 | |
| *** otsukahy has quit IRC | 11:54 | |
| *** ttsiouts has joined #openstack-nova | 11:54 | |
| *** ttsiouts has quit IRC | 11:59 | |
| *** ttsiouts_ has joined #openstack-nova | 11:59 | |
| *** otsukahy has joined #openstack-nova | 12:00 | |
| *** rpittau|bbl is now known as rpittau | 12:04 | |
| *** artom has quit IRC | 12:05 | |
| *** tbachman has joined #openstack-nova | 12:12 | |
| *** slaweq has joined #openstack-nova | 12:15 | |
| *** otsukahy has quit IRC | 12:15 | |
| *** dave-mccowan has joined #openstack-nova | 12:16 | |
| *** otsukahy has joined #openstack-nova | 12:17 | |
| *** otsukahy has quit IRC | 12:23 | |
| *** otsukahy has joined #openstack-nova | 12:26 | |
| *** jawad_axd has quit IRC | 12:28 | |
| *** jawad_axd has joined #openstack-nova | 12:30 | |
| *** jawad_ax_ has joined #openstack-nova | 12:32 | |
| *** jawad_axd has quit IRC | 12:34 | |
| *** kaisers has joined #openstack-nova | 12:35 | |
| *** jawad_ax_ has quit IRC | 12:37 | |
| *** otsukahy has quit IRC | 12:37 | |
| *** ttsiouts_ has quit IRC | 12:38 | |
| *** ttsiouts has joined #openstack-nova | 12:39 | |
| *** ttsiouts has quit IRC | 12:43 | |
| *** jmlowe has quit IRC | 12:44 | |
| *** ygk_12345 has joined #openstack-nova | 12:47 | |
| *** FlorianFa has quit IRC | 12:48 | |
| *** ttsiouts has joined #openstack-nova | 12:49 | |
| *** dpawlik has quit IRC | 12:57 | |
| *** maciejjozefczyk has joined #openstack-nova | 12:58 | |
| *** READ10 has joined #openstack-nova | 12:59 | |
| *** maciejjozefczyk has quit IRC | 13:04 | |
| *** markvoelker has joined #openstack-nova | 13:15 | |
| *** mriedem has joined #openstack-nova | 13:17 | |
| *** henriqueof has joined #openstack-nova | 13:18 | |
| *** markvoelker has quit IRC | 13:19 | |
| *** eharney has quit IRC | 13:30 | |
| mriedem | gibi: do you think you'll be able to get to these today? https://review.opendev.org/#/q/topic:bp/support-move-ops-with-qos-ports-ussuri+status:open | 13:34 |
| ygk_12345 | hi all | 13:35 |
| ygk_12345 | can someone point me to any resource in understanding the code for nova wsgi.py file ? | 13:35 |
| gibi | mriedem: if I don't have to solve the rollback of the parent_ifname ugliness there then yes I can fix your comments to clean up the patches | 13:35 |
| mriedem | yeah i'm not asking for that | 13:36 |
| gibi | mriedem: OK, then I will go and fix those patches up | 13:36 |
| *** tesseract has quit IRC | 13:36 | |
| * gibi puts on headphone | 13:36 | |
| *** tssurya_ has quit IRC | 13:37 | |
| *** dpawlik has joined #openstack-nova | 13:37 | |
| *** dviroel has joined #openstack-nova | 13:39 | |
| mriedem | ygk_12345: http://lists.openstack.org/pipermail/openstack-discuss/2019-October/010307.html may be helpful | 13:45 |
| *** nweinber_ has joined #openstack-nova | 13:48 | |
| *** artom has joined #openstack-nova | 13:49 | |
| openstackgerrit | Merged openstack/nova master: [Trivial] Add missing ws between words https://review.opendev.org/689921 | 13:49 |
| *** ttsiouts has quit IRC | 13:50 | |
| *** ttsiouts has joined #openstack-nova | 13:51 | |
| *** gbarros has joined #openstack-nova | 13:53 | |
| *** ygk_12345 has quit IRC | 13:53 | |
| *** kaisers is now known as kaisers_away | 13:54 | |
| *** gbarros has quit IRC | 13:55 | |
| *** ttsiouts has quit IRC | 13:55 | |
| *** kaisers_away is now known as kaisers | 13:56 | |
| *** kaisers is now known as kaisers_away | 13:56 | |
| mriedem | lyarwood: very weird that your stein backport fails pep8 https://review.opendev.org/#/c/691282/ for an unused variable but it didn't on master or train, | 13:57 |
| *** otsukahy has joined #openstack-nova | 13:57 | |
| mriedem | something must have changed since train with flake8 rules | 13:57 |
| *** ttsiouts has joined #openstack-nova | 13:57 | |
| mriedem | my guess would be something due to https://github.com/openstack/nova/commit/3e65f778bdb51e2cf0693f4e9b1b4539ea5c294c#diff-b91f3d5bd63fcd17221b267e851608e8 | 13:59 |
| *** priteau has joined #openstack-nova | 13:59 | |
| *** mlavalle has joined #openstack-nova | 13:59 | |
| *** kaisers_away is now known as kaisers | 13:59 | |
| *** kaisers is now known as kaisers_away | 14:00 | |
| lyarwood | mriedem: what the flying friday | 14:01 |
| mriedem | pycodestyle doesn't check for F841 | 14:01 |
| * lyarwood looks | 14:02 | |
| mriedem | https://pycodestyle.readthedocs.io/en/latest/intro.html#error-codes | 14:02 |
| mriedem | stephenfin: ^ | 14:03 |
| sean-k-mooney | mriedem: stephenfin is currently in japan watching the rugby world cup | 14:04 |
| mriedem | yeah i know he's not around | 14:05 |
| *** kaisers_away is now known as kaisers | 14:05 | |
| *** kaisers is now known as kaisers_away | 14:05 | |
| bbobrov | dansmith: hi, i will be fixing amd sev code | 14:06 |
| *** ileixe___ has joined #openstack-nova | 14:07 | |
| *** benj_ has quit IRC | 14:08 | |
| *** kaisers_away is now known as kaisers | 14:09 | |
| *** gbarros has joined #openstack-nova | 14:09 | |
| *** kaisers is now known as kaisers_away | 14:09 | |
| mriedem | lyarwood: if you're able it would be good to move forward on these rocky backports today https://review.opendev.org/#/q/status:open+project:openstack/nova+branch:stable/rocky+label:Code-Review=2 | 14:10 |
| mriedem | because those are also in queens https://review.opendev.org/#/q/status:open+project:openstack/nova+branch:stable/queens | 14:10 |
| *** benj has joined #openstack-nova | 14:11 | |
| *** benj is now known as Guest14611 | 14:12 | |
| *** sapd1 has joined #openstack-nova | 14:13 | |
| *** kaisers_away is now known as kaisers | 14:13 | |
| lyarwood | mriedem: yup stuck in calls for a while but I'll take a look once I'm out | 14:13 |
| *** kaisers is now known as kaisers_away | 14:14 | |
| *** kaisers_away is now known as kaisers | 14:14 | |
| *** kaisers is now known as kaisers_away | 14:14 | |
| *** kaisers_away is now known as kaisers | 14:14 | |
| *** mkrai has joined #openstack-nova | 14:14 | |
| *** markvoelker has joined #openstack-nova | 14:16 | |
| dansmith | mriedem: thanks for that notification sample patch | 14:17 |
| dansmith | mriedem: so onto the more progress-related notifications, I think we could do one of two things: | 14:17 |
| *** dpawlik has quit IRC | 14:17 | |
| dansmith | 1. Have the computes all emit a notification when they've downloaded an image, which won't include the aggregate | 14:17 |
| dansmith | 2. Have the conductor emit one notification per compute after it reports what it did | 14:18 |
| dansmith | 3. Have conductor emit a progress notification as it is doing it with numbers that can be turned into percentage (like 30% complete or N/M complete) | 14:18 |
| dansmith | I can see benefits and drawbacks to all of those approaches | 14:19 |
| dansmith | 1-2 don't let you predict completion, 3 doesn't given you much info, like which ones failed | 14:19 |
| openstackgerrit | Eric Fried proposed openstack/os-traits master: Stop testing with py2 https://review.opendev.org/690997 | 14:20 |
| openstackgerrit | Eric Fried proposed openstack/os-resource-classes master: Stop testing with py2 https://review.opendev.org/690996 | 14:22 |
| *** eharney has joined #openstack-nova | 14:23 | |
| openstackgerrit | Eric Fried proposed openstack/os-vif master: Drop python2 support and testing https://review.opendev.org/691364 | 14:24 |
| mriedem | dansmith: couldn't 2 and 3 be combined? | 14:28 |
| openstackgerrit | Eric Fried proposed openstack/python-novaclient master: Stop supporting and testing python2 https://review.opendev.org/691365 | 14:28 |
| dansmith | mriedem: ah, so per compute, but with progress? sure | 14:28 |
| mriedem | also, i think you can do 3 without 3 using the existing notification, | 14:28 |
| mriedem | so you'd listen for aggregate.cache_images.start which passes the list of hosts being processed already, | 14:29 |
| mriedem | then you listen for per-compute notifications for that aggregate, and since you know how many are in the aggregate from the first notification, you can do your own progress tracking | 14:29 |
| mriedem | you know you're done when you get aggregate.cache_images.end | 14:29 |
| mriedem | so i think i'd just go with 2 | 14:29 |
| dansmith | that is assuming you don't have multiple operations going at once and/or that you don't have overlapping aggregates, both of which I think are not reasonable | 14:30 |
| mriedem | 1 isn't great if the compute is down | 14:30 |
| dansmith | not reasonable assumptions I mean | 14:30 |
| mriedem | the initial notification has the aggregate name in it though | 14:30 |
| mriedem | so even if you have hosts that overlap aggregates i don't think that's a problem from a tracking pov | 14:30 |
| dansmith | you have to have aggregate in each notification to link all that up | 14:31 |
| dansmith | either way, | 14:31 |
| dansmith | 2 with a total and complete count makes the most sense to me I think | 14:31 |
| mriedem | having the aggregate in the per-compute notification is fine i think | 14:31 |
| dansmith | I wasn't sure if once per compute was too much, but sounds like you're thinking that way | 14:31 |
| *** johnthetubaguy has joined #openstack-nova | 14:31 | |
| mriedem | you'd have the aggregate, the compute, maybe the image(s) and the status | 14:32 |
| mriedem | we could make it configurable | 14:32 |
| mriedem | like we do for bdms in notifications | 14:32 |
| mriedem | so by default we don't send all that noise, but if you need it it's there | 14:32 |
| mriedem | or we wait until a consumer comes to us with their actual requirement for what they need to get out of thise | 14:32 |
| mriedem | *this | 14:32 |
| dansmith | you really kinda need to know what the status of the images are too if you want this to be coherent | 14:33 |
| dansmith | well, I have one customer requirement so I have some of that | 14:33 |
| dansmith | lemme run with 2+info and we can argue about the contents and/or what should be included by default or by config in gerrit | 14:33 |
| mriedem | fetching the image status....that means doing yet another GET on each image after we've validated them in the API which would make me sad | 14:34 |
| dansmith | no, | 14:34 |
| dansmith | I mean the result of the operation from thecompute | 14:34 |
| mriedem | oh yeah that's fine, i said that'd be in there above | 14:34 |
| dansmith | yeah | 14:35 |
| *** jaosorior has joined #openstack-nova | 14:38 | |
| *** ccamacho has quit IRC | 14:39 | |
| dansmith | mriedem: https://pastebin.com/cCYBiD3h | 14:40 |
| dansmith | emitted from conductor after each host | 14:40 |
| openstackgerrit | Eric Fried proposed openstack/os-traits master: Stop testing with py2 and switch to ussuri jobs https://review.opendev.org/690997 | 14:42 |
| *** damien_r has quit IRC | 14:43 | |
| *** kaisers is now known as kaisers_away | 14:43 | |
| *** jangutter has quit IRC | 14:43 | |
| openstackgerrit | Eric Fried proposed openstack/os-traits master: Stop testing with py2 and switch to ussuri jobs https://review.opendev.org/690997 | 14:45 |
| openstackgerrit | Eric Fried proposed openstack/os-resource-classes master: Stop testing with py2 https://review.opendev.org/690996 | 14:46 |
| gregwork | has anyone seen a situation where nova is not getting the update from cloudbase-init on the admin password on provision? eg. running nova get-password instance mykey.pem returns nothing occasionally | 14:47 |
| gregwork | in the console log of the instance I see cloudbase set the admin password and notify metadata | 14:48 |
| mriedem | dansmith: seems reasonable | 14:49 |
| mriedem | gregwork: asking in #openstack-hyper-v might be more productive | 14:55 |
| openstackgerrit | Eric Fried proposed openstack/os-vif master: Drop python2 support and testing https://review.opendev.org/691364 | 14:55 |
| mriedem | or poking through open/merged changes https://review.opendev.org/#/q/project:x/cloudbase-init | 14:55 |
| gregwork | mriedem: i didnt even know that existed, thanks :) | 14:55 |
| dansmith | gibi: you around? | 14:59 |
| gibi | dansmith: yep | 14:59 |
| gibi | dansmith: I saw your convo with Matt about the instance cache notification | 14:59 |
| dansmith | gibi: I dunno if you noticed any of that between mriedem and I, but I'm moving on with more rich notifications for progress | 14:59 |
| *** kaisers_away is now known as kaisers | 15:00 | |
| *** kaisers is now known as kaisers_away | 15:00 | |
| gibi | dansmith: I skimmed the convo (busy with fixing up patches) overall seems good to me | 15:00 |
| gregwork | mriedem: hmmn that channel has 3 people in it including me :/ | 15:00 |
| *** ivve has quit IRC | 15:00 | |
| dansmith | gibi: cool, so.. I guess I need a new action for the per-host notification, but it strikes me as a good candidate to instead have a new phase, like "progress" so... start..progress...progress...progress...end | 15:00 |
| dansmith | gibi: I assume we don't have that for some reason | 15:00 |
| gibi | dansmith: there is instance.update for example so I have nothing against adding progress as well | 15:01 |
| dansmith | gibi: but that's an action, not a phase yeah? | 15:02 |
| gibi | dansmith: hm. good point. your notification would be like image_cache.start, image_cache.progress ... image_cache.end | 15:03 |
| dansmith | gibi: right, that's what would make the most sense to me | 15:03 |
| gibi | dansmith: I have no problem with this either | 15:03 |
| *** xek__ has joined #openstack-nova | 15:03 | |
| mriedem | gregwork: lots of the cloudbase people are in eastern europe i think | 15:03 |
| mriedem | lpetrut is maybe your best bet | 15:04 |
| dansmith | gibi: okay I'll add it and you can see what you think in the review | 15:04 |
| gregwork | so this is definitely a clousbase agent problem and not a wierd nova issue i ran into ? | 15:04 |
| gibi | dansmith: sure. I will check | 15:04 |
| gregwork | *cloudbase | 15:04 |
| dansmith | gibi: thanks | 15:04 |
| mriedem | gregwork: i have no idea | 15:04 |
| mriedem | but i'd start there rather than here | 15:05 |
| *** ileixe___ has left #openstack-nova | 15:05 | |
| gregwork | ok thanks for the contact info | 15:05 |
| *** xek_ has quit IRC | 15:06 | |
| *** sapd1 has quit IRC | 15:11 | |
| *** sapd1_ has quit IRC | 15:13 | |
| *** sapd1_ has joined #openstack-nova | 15:14 | |
| *** sapd1 has joined #openstack-nova | 15:14 | |
| *** gyee has joined #openstack-nova | 15:14 | |
| openstackgerrit | Eric Fried proposed openstack/python-novaclient master: Stop supporting and testing python2 https://review.opendev.org/691365 | 15:19 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Allow evacuating server with port resource request https://review.opendev.org/688387 | 15:23 |
| gibi | mriedem: one up ^^ one more to go | 15:24 |
| *** sapd1 has quit IRC | 15:25 | |
| *** TxGirlGeek has joined #openstack-nova | 15:26 | |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Enable evacuation with qos ports https://review.opendev.org/688688 | 15:32 |
| gibi | mriedem: done as well ^^ | 15:32 |
| *** otsukahy has quit IRC | 15:32 | |
| *** macz has joined #openstack-nova | 15:33 | |
| *** ttsiouts has quit IRC | 15:33 | |
| openstackgerrit | John Garbutt proposed openstack/nova-specs master: Add Unified Limits Spec https://review.opendev.org/602201 | 15:34 |
| gibi | this marks the end of my work week. have a nice weekend folks! | 15:34 |
| *** ttsiouts has joined #openstack-nova | 15:34 | |
| dansmith | gibi: wait | 15:37 |
| dansmith | WAIT | 15:37 |
| dansmith | gibi: in functional, I'm doing wait_for_versioned_notification() by the things it returns have empty payloads.. do I need to enable some config to have that work? | 15:37 |
| *** ttsiouts has quit IRC | 15:38 | |
| dansmith | mriedem: do you know? | 15:40 |
| mriedem | no, you just need to stub the fake notifier stuff | 15:41 |
| dansmith | okay, I got that of course and am getting the notifs but payloads are empty | 15:41 |
| dansmith | maybe I'm emitting wrong | 15:41 |
| dansmith | must be because the other ones have payloads | 15:46 |
| dansmith | danigt | 15:46 |
| dansmith | helps if I register the payload too :D | 15:48 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: Fail compute service delete if resource provider delete fails https://review.opendev.org/678100 | 15:48 |
| mriedem | ^ is wip until i get some reviews on what's proposed there which is based on what was discussed in the ML for not orphaning resource providers when deleting a compute service that still has allocations against it | 15:49 |
| mriedem | we continue to get bugs in triage for this kind of thign | 15:50 |
| mriedem | e.g. https://bugs.launchpad.net/nova/+bug/1849701 | 15:50 |
| openstack | Launchpad bug 1849701 in OpenStack Compute (nova) "Resource_provider entry related to a deleted compute node, unable to migrate vms to the node" [Undecided,New] | 15:50 |
| *** jaosorior has quit IRC | 15:51 | |
| *** xek_ has joined #openstack-nova | 15:56 | |
| *** kaisers_away is now known as kaisers | 15:58 | |
| *** kaisers is now known as kaisers_away | 15:58 | |
| *** xek__ has quit IRC | 15:59 | |
| *** kaisers_away is now known as kaisers | 16:00 | |
| *** kaisers is now known as kaisers_away | 16:00 | |
| *** rpittau is now known as rpittau|afk | 16:05 | |
| openstackgerrit | John Garbutt proposed openstack/nova-specs master: Add Unified Limits Spec https://review.opendev.org/602201 | 16:06 |
| *** derekh has quit IRC | 16:07 | |
| *** otsukahy has joined #openstack-nova | 16:08 | |
| mriedem | looks like docs job is busted | 16:09 |
| cdent | dansmith, mriedem : when nova-compute comes up and tries to initiate talking to the conductor it uses an "early_timeout" and then after 10 attempts fails over to the global timeout. If those 10 attempts pass, is it possible the nova-compute will sit doing nothing on that long timeout for a long time before talking to the conductor, or should it loop quickly if there is an actual connection failed (rather than timing out | 16:10 |
| cdent | waiting for response)? I'm reading some bugs where it seems like the sit doing nothing is happening, but it seems illogical. | 16:10 |
| mriedem | https://zuul.opendev.org/t/openstack/build/10344924bca44849b06b8fae29b5494f/log/job-output.txt#652 | 16:10 |
| mriedem | cdent: not sure off the top of my head, probably a better question for dansmith | 16:11 |
| *** otsukahy has quit IRC | 16:12 | |
| cdent | in placement we addressed that docs issue by having a different set of requirements for docs | 16:13 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Enable evacuation with qos ports https://review.opendev.org/688688 | 16:13 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Allow evacuating server with port resource request https://review.opendev.org/688387 | 16:14 |
| dansmith | cdent: not sure what you mean by early timeout | 16:14 |
| cdent | dansmith: one sec, will get code link | 16:14 |
| dansmith | cdent: it should be calling ping for the conductor pretty regularly and wait forever | 16:14 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Enable evacuation with qos ports https://review.opendev.org/688688 | 16:14 |
| cdent | dansmith: https://github.com/openstack/nova/blob/master/nova/conductor/api.py#L41 | 16:15 |
| dansmith | oh right | 16:16 |
| cdent | after early attempts expires, if the global rpc timeout is huge (because people do that...) it appears like it can be a very long time before "ready" happens | 16:16 |
| cdent | but I would have thought that if the conductor is literally not there, you would know sooner | 16:16 |
| dansmith | cdent: people who set the global timeout large are begging for problems, so I don't think we should do something different here | 16:16 |
| dansmith | however, | 16:16 |
| mriedem | vmware sets the timeout large because they are pulling 1K+ instances from conductor on startup yeah? | 16:17 |
| cdent | but could it be that if the message bus is up but the conductor is not, the ping will hang out in rabbit... waiting | 16:17 |
| dansmith | the reason for that was because if you have a power outage and start a thousand computes, they need to chill if they can't get a response right away.. just because they have a connection doesn't mean they're not overwhelming the conductor(s), which is why we have the backoff | 16:17 |
| dansmith | cdent: sure | 16:17 |
| *** tbachman has quit IRC | 16:17 | |
| cdent | mriedem: probably something like that, yeah | 16:17 |
| cdent | Okay, cool, this confirms what I thought was happening, but hadn't been able to trace it all the way down | 16:18 |
| cdent | mriedem: there also appears to be an ordering problem in service restarts | 16:18 |
| cdent | thanks to you both | 16:19 |
| cdent | I'll go write down more stuff that people will ignore... | 16:19 |
| cdent | (not you, I mean internal people) | 16:19 |
| mriedem | *those* people | 16:19 |
| openstackgerrit | John Garbutt proposed openstack/nova master: WIP: Integrating with unified limits https://review.opendev.org/615180 | 16:19 |
| cdent | them | 16:19 |
| *** TxGirlGeek has quit IRC | 16:22 | |
| mriedem | blarg, yeah we have doc/requirements.txt but https://review.opendev.org/#/c/689152/ threw requirements.txt back into the install for the docs job | 16:24 |
| mriedem | fixing | 16:24 |
| openstackgerrit | Dan Smith proposed openstack/nova master: Log some stats for image pre-cache https://review.opendev.org/688173 | 16:26 |
| openstackgerrit | Dan Smith proposed openstack/nova master: Add Aggregate image caching progress notifications https://review.opendev.org/691390 | 16:26 |
| mriedem | https://bugs.launchpad.net/nova/+bug/1849870 | 16:29 |
| openstack | Launchpad bug 1849870 in OpenStack Compute (nova) "docs build failing on psycopg2 dependency" [Undecided,New] | 16:29 |
| *** tbachman has joined #openstack-nova | 16:31 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Stop building docs with (test-)requirements.txt https://review.opendev.org/691391 | 16:39 |
| mriedem | ^ will hopefully unblock the gate for nova ^ | 16:39 |
| *** nanzha has quit IRC | 16:41 | |
| dansmith | mriedem: should we slam that in? | 16:41 |
| mriedem | let's see if it passes the docs job first, it works for me locally | 16:42 |
| mriedem | guess it could take awhile to get a node... | 16:42 |
| dansmith | okay | 16:42 |
| mriedem | oh it got a node http://zuul.openstack.org/stream/63d6bbd171134e00877ae6ce61856a84?logfile=console.log | 16:42 |
| mriedem | build baby build! | 16:42 |
| *** kaisers_away is now known as kaisers | 16:45 | |
| mriedem | dansmith: looks like it passed so you can commence to slamming | 16:47 |
| *** udesale has quit IRC | 16:48 | |
| dansmith | mriedem: you going to fix the typo? | 16:48 |
| mriedem | sure, sec | 16:48 |
| dansmith | or just clarifying for review? | 16:48 |
| dansmith | ack | 16:48 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Stop building docs with (test-)requirements.txt https://review.opendev.org/691391 | 16:49 |
| openstackgerrit | Dan Smith proposed openstack/nova master: Add Aggregate image caching progress notifications https://review.opendev.org/691390 | 16:50 |
| mriedem | melwitt: were you going to backport https://review.opendev.org/#/c/688206/ and the one below it? | 17:00 |
| mriedem | i'm planning a train release next week so probably good to get that in it | 17:00 |
| melwitt | mriedem: yes. I wasn't sure if I should wait for the top patch to merge first before proposing | 17:01 |
| mriedem | i don't think you need to wait | 17:01 |
| melwitt | ok | 17:01 |
| *** kaisers is now known as kaisers_away | 17:02 | |
| *** TxGirlGeek has joined #openstack-nova | 17:03 | |
| *** otsukahy has joined #openstack-nova | 17:04 | |
| dansmith | mriedem: what's the trick for generating the notification samples? | 17:09 |
| *** priteau has quit IRC | 17:12 | |
| *** tbachman has quit IRC | 17:14 | |
| *** igordc has joined #openstack-nova | 17:14 | |
| *** otsukahy has quit IRC | 17:19 | |
| *** abaindur has quit IRC | 17:21 | |
| *** abaindur has joined #openstack-nova | 17:21 | |
| *** tbachman has joined #openstack-nova | 17:30 | |
| mriedem | you have to create them manually | 17:32 |
| mriedem | the json file i mean | 17:33 |
| dansmith | WAT | 17:33 |
| * dansmith wants a refund | 17:33 | |
| mriedem | all sales are final | 17:33 |
| * dansmith calls the BBB | 17:34 | |
| dansmith | if I add this is there something that will check my work? | 17:35 |
| *** xek_ has quit IRC | 17:35 | |
| mriedem | the functional test should be comparing against the sample | 17:35 |
| dansmith | oh if I write that test okay | 17:35 |
| *** xek_ has joined #openstack-nova | 17:35 | |
| dansmith | I should rebase mine on yours I guess | 17:36 |
| mriedem | yeah so instead of this https://review.opendev.org/#/c/691390/2/nova/tests/functional/compute/test_cache_image.py | 17:36 |
| mriedem | right | 17:36 |
| dansmith | not instead, in addition right? | 17:36 |
| mriedem | i don't see why we'd need both | 17:36 |
| dansmith | because it already has the error case and other-agg case | 17:37 |
| *** kaisers_away is now known as kaisers | 17:37 | |
| mriedem | this is where the test in mine validates the sample against the actual notification generated by the test https://review.opendev.org/#/c/691129/1/nova/tests/functional/notification_sample_tests/test_aggregate.py@199 | 17:37 |
| *** kaisers is now known as kaisers_away | 17:37 | |
| mriedem | oh yeah ok that makes sense | 17:37 |
| *** kaisers_away is now known as kaisers | 17:37 | |
| *** kaisers is now known as kaisers_away | 17:38 | |
| *** cdent has quit IRC | 17:38 | |
| openstackgerrit | Merged openstack/nova stable/train: libvirt: Ignore volume exceptions during post_live_migration https://review.opendev.org/691281 | 17:39 |
| *** ralonsoh has quit IRC | 17:39 | |
| *** kaisers_away is now known as kaisers | 17:39 | |
| *** kaisers is now known as kaisers_away | 17:40 | |
| openstackgerrit | melanie witt proposed openstack/nova stable/train: Add regression test for bug 1824435 https://review.opendev.org/691402 | 17:40 |
| openstack | bug 1824435 in OpenStack Compute (nova) "fill_virtual_interface_list migration fails on second attempt" [Medium,In progress] https://launchpad.net/bugs/1824435 - Assigned to melanie witt (melwitt) | 17:40 |
| openstackgerrit | melanie witt proposed openstack/nova stable/train: Remove redundant call to get/create default security group https://review.opendev.org/691403 | 17:40 |
| openstackgerrit | Merged openstack/nova stable/queens: Fix unit of hw_rng:rate_period https://review.opendev.org/689155 | 17:43 |
| *** jdillaman has quit IRC | 17:44 | |
| *** zbr has quit IRC | 17:45 | |
| *** kaisers_away is now known as kaisers | 17:46 | |
| *** kaisers is now known as kaisers_away | 17:46 | |
| *** ivve has joined #openstack-nova | 17:49 | |
| dansmith | mriedem: I don't really understand why we specify the payload in a file, but also some fields of the payload to verify in the doc schema file or whatever | 17:50 |
| dansmith | mriedem: this stuff: https://review.opendev.org/#/c/691129/1/doc/notification_samples/aggregate-cache_images-end.json@5 | 17:51 |
| *** kaisers_away is now known as kaisers | 17:58 | |
| *** kaisers is now known as kaisers_away | 17:59 | |
| *** kaisers_away is now known as kaisers | 18:03 | |
| *** kaisers is now known as kaisers_away | 18:03 | |
| openstackgerrit | Dan Smith proposed openstack/nova master: Add notification sample test for aggregate.cache_images.start|end https://review.opendev.org/691129 | 18:04 |
| openstackgerrit | Dan Smith proposed openstack/nova master: Log some stats for image pre-cache https://review.opendev.org/688173 | 18:04 |
| openstackgerrit | Dan Smith proposed openstack/nova master: Add Aggregate image caching progress notifications https://review.opendev.org/691390 | 18:04 |
| *** luksky has joined #openstack-nova | 18:09 | |
| *** TxGirlGeek has quit IRC | 18:14 | |
| *** psachin has quit IRC | 18:15 | |
| *** bnemec is now known as beekneemech | 18:16 | |
| *** jmlowe has joined #openstack-nova | 18:17 | |
| openstackgerrit | Merged openstack/nova master: Stop building docs with (test-)requirements.txt https://review.opendev.org/691391 | 18:21 |
| mriedem | dansmith: that's an override for what's in the common file | 18:21 |
| mriedem | otherwise you just get what's in "$ref": "common_payloads/AggregatePayload.json#", | 18:22 |
| dansmith | so I can just put my stuff in the common file? I mean, that seemed to work fine, but didn't know if it wasn't "right" | 18:22 |
| dansmith | if so, the rev I just pushed may be acceptable then | 18:23 |
| mriedem | it's a little weird to have that much stuff in the common file but not necessarily wrong, the only field you override is the host one | 18:24 |
| *** takamatsu has quit IRC | 18:24 | |
| mriedem | i'd probably just leave it until we have more samples that re-use the common payload and it no longer makes sense, | 18:25 |
| mriedem | er yeah, that's it | 18:25 |
| dansmith | yeah, I mean, doesn't seem like much point unless you need to sub things | 18:25 |
| *** kaisers_away is now known as kaisers | 18:25 | |
| *** kaisers is now known as kaisers_away | 18:26 | |
| *** ricolin has quit IRC | 18:31 | |
| openstackgerrit | Eric Fried proposed openstack/python-novaclient master: Stop supporting and testing python2 https://review.opendev.org/691365 | 18:33 |
| *** markvoelker has quit IRC | 18:36 | |
| *** markvoelker has joined #openstack-nova | 18:38 | |
| *** efried has quit IRC | 18:44 | |
| *** efried has joined #openstack-nova | 18:46 | |
| openstackgerrit | Eric Fried proposed openstack/os-vif master: Drop python2 support and testing https://review.opendev.org/691364 | 18:56 |
| *** gmann is now known as gmann_afk | 18:57 | |
| openstackgerrit | Eric Fried proposed openstack/os-vif master: Drop python2 support and testing https://review.opendev.org/691364 | 19:00 |
| openstackgerrit | Eric Fried proposed openstack/os-vif master: Drop python2 support and testing https://review.opendev.org/691364 | 19:00 |
| *** zbr has joined #openstack-nova | 19:01 | |
| *** eharney has quit IRC | 19:05 | |
| *** xek_ has quit IRC | 19:05 | |
| *** xek_ has joined #openstack-nova | 19:05 | |
| *** KeithMnemonic has quit IRC | 19:10 | |
| melwitt | I dunno if anyone is looking at the docs job failure yet, looks like psycopg missing libpq-dev package? https://zuul.opendev.org/t/openstack/build/57fdb73f89084fa9b845561ec724e11d/log/job-output.txt#664 | 19:10 |
| *** KeithMnemonic has joined #openstack-nova | 19:11 | |
| *** mkrai has quit IRC | 19:11 | |
| dansmith | pretty sure mriedem already had a fix up for that | 19:11 |
| efried | yeah, it merged | 19:11 |
| efried | https://review.opendev.org/#/c/691391/2 | 19:12 |
| efried | you fast approved it dansmith :P "pretty sure" indeed. | 19:12 |
| dansmith | efried: I didn't look at her link before answering, hence my pretty sure | 19:12 |
| *** KeithMnemonic has quit IRC | 19:14 | |
| *** KeithMnemonic has joined #openstack-nova | 19:15 | |
| *** beekneemech has quit IRC | 19:16 | |
| *** TxGirlGeek has joined #openstack-nova | 19:16 | |
| *** bnemec has joined #openstack-nova | 19:18 | |
| *** JamesBenson has joined #openstack-nova | 19:25 | |
| *** READ10 has quit IRC | 19:27 | |
| melwitt | oh ok, I missed the discussion and didn't see an ML thread | 19:27 |
| melwitt | glad it's fixed | 19:28 |
| *** lifeless has quit IRC | 19:29 | |
| *** TxGirlGeek has quit IRC | 19:36 | |
| *** tbachman has quit IRC | 19:37 | |
| mriedem | we SEV1 IPL'ed that APAR | 19:42 |
| mriedem | efried: those py2 removal patches are going to be the end of one of us | 19:43 |
| efried | mriedem: I figured there would be some churn. I'm a zuul dunce to begin with. | 19:43 |
| efried | but I feel like we're ahead of the game anyway, we've got months to get it sorted. | 19:44 |
| mriedem | way to jinx yourself | 19:44 |
| openstackgerrit | Eric Fried proposed openstack/os-vif master: Drop python2 support and testing https://review.opendev.org/691364 | 19:47 |
| melwitt | IPL and APAR, had to google those | 19:51 |
| *** nweinber_ has quit IRC | 19:56 | |
| *** looking4somethin has joined #openstack-nova | 19:57 | |
| efried | mriedem: join us in -release if you please? | 19:57 |
| looking4somethin | yes | 19:58 |
| looking4somethin | mriedem are you talking to me? | 19:59 |
| efried | looking4somethin: sorry, you arrived in the middle of a conversation | 20:01 |
| *** jawad_axd has joined #openstack-nova | 20:01 | |
| looking4somethin | awesome! | 20:01 |
| efried | looking4somethin: Have you tried randomizing your placement allocation candidates? | 20:02 |
| efried | landing on one compute isn't really a bug | 20:02 |
| efried | I can't remember if we pack or spread by default -- dansmith? | 20:02 |
| looking4somethin | not really | 20:02 |
| looking4somethin | how can I do it. | 20:02 |
| melwitt | efried: pack is default | 20:03 |
| *** artom has quit IRC | 20:03 | |
| efried | looking4somethin: there you go ^ so by default you'll go to one compute until it's "full". | 20:03 |
| efried | If you prefer to spread, you can do things with weighers. | 20:03 |
| melwitt | you need to adjust some config options if you would prefer VMs to spread first onto compute hosts | 20:04 |
| looking4somethin | that's it then. however I have observed some spreading previously but right now one compute is getting everything. | 20:04 |
| melwitt | you can use https://docs.openstack.org/nova/rocky/configuration/config.html#placement.randomize_allocation_candidates to have placement randomize the computes it returns to nova | 20:05 |
| melwitt | you can use https://docs.openstack.org/nova/rocky/configuration/config.html#filter_scheduler.host_subset_size to make nova choose randomly from a larger subset of hosts | 20:06 |
| efried | melwitt: If there's a weigher in play that packs by default, that won't actually help (unless the deployment is bigger than the ?limit) | 20:06 |
| melwitt | oh, I see | 20:06 |
| melwitt | yeah | 20:06 |
| efried | to spread, I thought you had to implement a weigher that weighs emptier hosts heavier. | 20:07 |
| looking4somethin | efried how I can do that | 20:07 |
| melwitt | you may have to adjust individual weighers multipliers if any of them are doing packing behavior | 20:07 |
| efried | blind leading blind here... | 20:07 |
| looking4somethin | to use the emptier hosts above all others | 20:07 |
| *** eharney has joined #openstack-nova | 20:08 | |
| looking4somethin | in nova.conf right? | 20:08 |
| melwitt | there is also https://docs.openstack.org/nova/rocky/configuration/config.html#filter_scheduler.shuffle_best_same_weighed_hosts if you want to randomize hosts that are all weighed the same | 20:08 |
| melwitt | yeah nova.conf | 20:08 |
| efried | hm, CPUWeigher has a docstring that says spread is the default. | 20:08 |
| efried | ditto RAMWeigher | 20:09 |
| melwitt | here's the docs for all the weighers so you have to read those to see which one might be causing behavior you don't like by default https://docs.openstack.org/nova/latest/user/filter-scheduler.html#weights | 20:09 |
| efried | phew, an rtfm answer, thanks melwitt | 20:09 |
| looking4somethin | thanks melwitt | 20:10 |
| *** gmann_afk is now known as gmann | 20:11 | |
| looking4somethin | how can I replace (in nova.conf) nova.scheduler.weights.all_weighers by nova.scheduler.weights.CPUWeigher or just to select one weigher | 20:18 |
| looking4somethin | I want to allocate to a node that have the most vcpus available | 20:19 |
| *** mdbooth has quit IRC | 20:19 | |
| efried | looking4somethin: It looks to me like you would say | 20:24 |
| efried | [scheduler] | 20:24 |
| efried | weight_classes = 'nova.scheduler.weights.cpu.CPUWeigher' | 20:24 |
| *** maciejjozefczyk has joined #openstack-nova | 20:25 | |
| looking4somethin | efried I will try it tomorrow, thanks | 20:31 |
| efried | good luck | 20:31 |
| efried | sweet dreams | 20:31 |
| efried | (are made of this) | 20:31 |
| mriedem | melwitt: efried: isn't that twice this week someone has been in here asking how to randomize allocations? wasn't eandersson asking about the same thing? | 20:34 |
| mriedem | maybe we need a more obvious doc about the various knobs used to make that happen | 20:35 |
| mriedem | since it seems like there are a few things to look at | 20:35 |
| efried | except I think in both cases randomize turned out not to be the answer. | 20:35 |
| mriedem | well, i don't mean the actual placement randomize option, | 20:35 |
| mriedem | but shuffling a host within the same weighted subset | 20:35 |
| eandersson | There are three options, and all seem very similar to me (especially if not reading the source code first) | 20:36 |
| *** looking4somethin has quit IRC | 20:36 | |
| mriedem | my point is, can we get people to (1) stop reading source code and (2) find what they are looking for in the docs? | 20:36 |
| eandersson | 100% this ^ | 20:36 |
| mriedem | i'm thinking about it b/c i've been working on a troubleshooting doc for orphaned allocations | 20:36 |
| mriedem | which i'm about to birth | 20:37 |
| * mriedem gets the ice chips | 20:37 | |
| eandersson | btw we did like 6k cold migrations and live migrations with Rocky | 20:38 |
| eandersson | Don't ask me why :p | 20:39 |
| eandersson | And 99% were successful | 20:39 |
| eandersson | We had some really bad failures | 20:39 |
| eandersson | The worst was some sort of neutron port corruption | 20:39 |
| eandersson | where the port was on the wrong compute, and in some cases completely corrupt in the neutron db | 20:39 |
| eandersson | But at least no orphaned placement allocations so that is great | 20:40 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: doc: add troubleshooting guide for cleaning up orphaned allocations https://review.opendev.org/691427 | 20:44 |
| mriedem | eandersson: port issues with the host binding details specifically? because someone else had reported issues with live migrations and weird port binding UniqueConstraint issues | 20:45 |
| eandersson | Yea I think so | 20:45 |
| eandersson | I can probably dig up some more details | 20:45 |
| eandersson | but nothing much in the logs unfortunately | 20:45 |
| *** jawad_axd has quit IRC | 20:46 | |
| eandersson | live migrations actually worked pretty well overall in Rocky | 20:46 |
| eandersson | But only when emptying one host and live migrating all of them into an empty host | 20:47 |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/stein: libvirt: Ignore volume exceptions during post_live_migration https://review.opendev.org/691282 | 20:47 |
| *** kaisers_away is now known as kaisers | 20:47 | |
| *** kaisers is now known as kaisers_away | 20:48 | |
| mriedem | eandersson: https://review.opendev.org/#/c/653506/ | 20:48 |
| mriedem | ^ was the solution for the other person that reported that issue | 20:48 |
| mriedem | so far obviously there hasn't been enough motivation to pick that back up and address comments | 20:49 |
| eandersson | I am not too worried about it at the moment as live migrations only works in the above scenario for us | 20:50 |
| eandersson | but maybe I can upgrade to Train in the lab and see if I can reproduce it. | 20:50 |
| *** markvoelker has quit IRC | 20:50 | |
| eandersson | And test that patch out. | 20:50 |
| *** KeithMnemonic has quit IRC | 21:02 | |
| mriedem | i'm out | 21:08 |
| mriedem | o/ | 21:08 |
| *** mriedem has quit IRC | 21:08 | |
| *** markvoelker has joined #openstack-nova | 21:23 | |
| *** maciejjozefczyk has quit IRC | 21:26 | |
| *** markvoelker has quit IRC | 21:33 | |
| *** xek_ has quit IRC | 21:41 | |
| *** xek has joined #openstack-nova | 21:42 | |
| *** JamesBen_ has joined #openstack-nova | 21:59 | |
| *** JamesBenson has quit IRC | 22:00 | |
| *** JamesBen_ has quit IRC | 22:04 | |
| *** ociuhandu has joined #openstack-nova | 22:43 | |
| *** kaisers_away is now known as kaisers | 22:45 | |
| *** kaisers is now known as kaisers_away | 22:45 | |
| *** ivve has quit IRC | 22:47 | |
| *** gyee has quit IRC | 22:53 | |
| *** tbachman has joined #openstack-nova | 22:55 | |
| *** macz has quit IRC | 22:55 | |
| *** ociuhandu has quit IRC | 23:04 | |
| *** luksky has quit IRC | 23:07 | |
| *** jawad_axd has joined #openstack-nova | 23:11 | |
| *** jawad_axd has quit IRC | 23:16 | |
| *** markvoelker has joined #openstack-nova | 23:16 | |
| *** markvoelker has quit IRC | 23:28 | |
| *** tbachman has quit IRC | 23:36 | |
| openstackgerrit | Merged openstack/nova stable/rocky: cleanup evacuated instances not on hypervisor https://review.opendev.org/687550 | 23:37 |
| openstackgerrit | Merged openstack/nova stable/rocky: Add functional test for resize crash compute restart revert https://review.opendev.org/687563 | 23:37 |
| openstackgerrit | Merged openstack/nova stable/rocky: Prevent init_host test to interfere with other tests https://review.opendev.org/687862 | 23:37 |
| *** igordc has quit IRC | 23:42 | |
| *** jawad_axd has joined #openstack-nova | 23:51 | |
| *** jawad_axd has quit IRC | 23:55 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!