opendevreview | melanie witt proposed openstack/nova master: nova-manage: Add --max_rows option to 'db purge' command https://review.opendev.org/c/openstack/nova/+/927339 | 01:07 |
---|---|---|
*** bauzas_ is now known as bauzas | 01:19 | |
*** bauzas_ is now known as bauzas | 03:02 | |
*** bauzas_ is now known as bauzas | 07:37 | |
opendevreview | Michael Still proposed openstack/nova master: libvirt: Add extra specs for USB redirection. https://review.opendev.org/c/openstack/nova/+/927354 | 07:50 |
mikal | sean-k-mooney: that's the extra specs for USB device redirection finished I hope. | 07:50 |
jayaanand_ | https://www.irccloud.com/pastebin/WNKStFUI/ | 08:15 |
jayaanand_ | i am using multi-node devstack setup to troubleshoot customer issue. Devstack is deployed with latest code. during live migration i am facing below issue. your suggestion is deeply appreciate. | 08:16 |
opendevreview | Fabian Wiesel proposed openstack/nova master: Add more password generation options https://review.opendev.org/c/openstack/nova/+/865669 | 08:17 |
frickler | jayaanand_: are you using ovn or ovs? you'll likely need to check neutron logs for the cause of that port binding failure | 08:20 |
jayaanand_ | https://www.irccloud.com/pastebin/w55E78ST/ | 08:24 |
jayaanand_ | i am following link https://docs.openstack.org/devstack/latest/guides/multinode-lab.html for multi node setup. didn't perform any neutron configuration for live migration. Neutron logs has below information | 08:24 |
jayaanand_ | both ovn and ovs services are enabled in local.conf | 08:24 |
opendevreview | Fabian Wiesel proposed openstack/nova master: Add more password generation options https://review.opendev.org/c/openstack/nova/+/865669 | 08:36 |
frickler | jayaanand_: I think auniyal had similar issues following that guide, which likely is outdated. mixing ovn and ovs isn't a good idea, likely the config for the compute node needs to be updated. see also https://bugs.launchpad.net/devstack/+bug/2060802 | 08:43 |
*** __ministry is now known as Guest1708 | 08:51 | |
jayaanand_ | thank you! @frickler. i really appreciate your quick response. let me try setup with OVN only | 09:20 |
opendevreview | Balazs Gibizer proposed openstack/nova stable/2023.2: Functional test test_boot_reschedule_with_proper_pci_device_count https://review.opendev.org/c/openstack/nova/+/926554 | 10:17 |
opendevreview | Balazs Gibizer proposed openstack/nova stable/2023.2: Fix PCI passthrough cleanup on reschedule https://review.opendev.org/c/openstack/nova/+/926555 | 10:17 |
*** ralonsoh_ is now known as ralonsoh | 11:04 | |
*** ralonsoh__ is now known as ralonsoh | 12:42 | |
*** __ministry is now known as Guest1728 | 13:53 | |
*** bauzas_ is now known as bauzas | 14:32 | |
opendevreview | Merged openstack/nova stable/2023.2: Functional test test_boot_reschedule_with_proper_pci_device_count https://review.opendev.org/c/openstack/nova/+/926554 | 14:43 |
gibi | bauzas: Uggla: I finished the re-review of the manila series up until https://review.opendev.org/c/openstack/nova/+/871642/41 I found no new major issue. But there are open comments from the past and left couple new comments here and there to fix. I also verified locally the basic workflow with devstack (including the open manila lock fix). So far so good. I would like to test a bit more like | 14:51 |
gibi | notifications and rescue with shares. | 14:51 |
Uggla | gibi, thx for the review and feedbacks, I will have a look ASAP. | 14:53 |
*** bauzas_ is now known as bauzas | 15:05 | |
mnaser | has anyone observed nova-api memory usage grow non stop | 15:19 |
mnaser | i am seeing this in zed (yeah.. it's an older environment) | 15:21 |
mnaser | using uwsgi in this case | 15:22 |
bauzas | mnaser: did you run a GMR ? | 15:25 |
bauzas | https://docs.openstack.org/nova/latest/reference/gmr.html#generating-a-gmr | 15:25 |
bauzas | in the past, we had internally memory greeding on nova-compute, we also used TCP backdoors on nova-compute to get memory details | 15:28 |
bauzas | https://docs.openstack.org/nova/latest/configuration/config.html#DEFAULT.backdoor_port | 15:28 |
mnaser | bauzas: i did not get a chance, i thought gmr is mostly giving us config + tracebacks i think, no? it seems it slowly grows till we kill it at 8gb | 15:46 |
bauzas | true, but you'll see all the greenthreads | 15:47 |
bauzas | my guess is that some greenthread is not closed | 15:48 |
mnaser | hmm yeah i just have another env and its like | 15:53 |
mnaser | almost 1.1g per nova-api process | 15:53 |
mnaser | https://usercontent.irccloud-cdn.com/file/F0hC2xtG/image.png | 15:53 |
mnaser | gr, uwsgi intercepts sigusr2 for its own purposes | 15:56 |
gibi | mnaser: you need to use the file trigger of GMR | 16:07 |
gibi | https://github.com/openstack/oslo.reports/blob/master/oslo_reports/opts.py#L30 | 16:08 |
*** ykarel is now known as ykarel|away | 16:09 | |
*** __ministry is now known as Guest1744 | 17:21 | |
opendevreview | melanie witt proposed openstack/python-novaclient master: functional: Handle multiple networks https://review.opendev.org/c/openstack/python-novaclient/+/927249 | 18:37 |
opendevreview | melanie witt proposed openstack/nova master: Adding sysctl changes for post-copy migration https://review.opendev.org/c/openstack/nova/+/908201 | 19:07 |
opendevreview | melanie witt proposed openstack/nova master: Adding sysctl changes for post-copy migration https://review.opendev.org/c/openstack/nova/+/908201 | 19:08 |
opendevreview | Merged openstack/nova master: libvirt: call get_capabilities() with all CPUs online https://review.opendev.org/c/openstack/nova/+/926218 | 19:22 |
opendevreview | Merged openstack/nova stable/2023.2: add functional repoducer for bug 2065927 https://review.opendev.org/c/openstack/nova/+/922985 | 19:34 |
opendevreview | Merged openstack/nova stable/2023.2: retry write_sys call on device busy https://review.opendev.org/c/openstack/nova/+/922986 | 20:59 |
*** haleyb is now known as haleyb|out | 21:26 | |
opendevreview | Merged openstack/python-novaclient master: functional: Handle multiple networks https://review.opendev.org/c/openstack/python-novaclient/+/927249 | 21:54 |
opendevreview | sean mooney proposed openstack/nova master: add pyproject.toml to support pip 23.1 https://review.opendev.org/c/openstack/nova/+/899753 | 23:30 |
opendevreview | Merged openstack/nova stable/2023.2: Fix PCI passthrough cleanup on reschedule https://review.opendev.org/c/openstack/nova/+/926555 | 23:43 |
opendevreview | Merged openstack/nova stable/2024.1: hardware: Correct log https://review.opendev.org/c/openstack/nova/+/927110 | 23:43 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!