| gmaan | dansmith: i checked/tested it, it is same reason why you are not seeing in-progress task in log because of the order of RPC server wait and manager shutdown. rpcserver.wait <it waits and finishes the stop_instance> -> manager.graceful_shutdown() <there is no task to log> this is log example https://pastebin.com/yj96YiRJ | 02:02 |
|---|---|---|
| gmaan | and with https://review.opendev.org/c/openstack/nova/+/996583, the order is rpcserver.stop <stop any new request> -> manager.graceful_shutdown() <it logs all in-progress tasks> -> rpcserver.wait() <continue waiting for first RPC server tasks to finish> . This is log example with this change and you can see the proper in-progress task logging https://pastebin.com/q0Mm9bNF | 02:03 |
| gmaan | Aug 11 01:28:44 ubuntu-resolute nova-compute[289050]: INFO nova.manager [-] Graceful shutdown initiated with 1 in-progress tasks: stop_instance(instance=c4b95ab0-1098-45a9-b03e-7139e1ce5bfc, request_id=req-9746ce32-bcb0-4913-8861-b1499d6abfd6, elapsed=8.216098441998838) | 02:04 |
| opendevreview | Takashi Kajinami proposed openstack/nova master: Stub kernel support check of AMD-SEV in tests https://review.opendev.org/c/openstack/nova/+/999780 | 02:04 |
| opendevreview | Ghanshyam Maan proposed openstack/nova master: Task tracking mechanism for graceful shutdown https://review.opendev.org/c/openstack/nova/+/996299 | 02:06 |
| gmaan | dansmith: ^^ i added the exact logs checks in the tests | 02:07 |
| gmaan | dansmith: This is a better example where I started 1 start, 2 stop instance operations. It logs all in-progress at start, logs as soon as any task is completed, and keeps logging overall progress every 10 sec; at the end, it summarizes the number of completed and failed tasks. https://pastebin.com/3fLsiMwG | 02:47 |
| opendevreview | Ghanshyam Maan proposed openstack/nova master: Task tracking mechanism for graceful shutdown https://review.opendev.org/c/openstack/nova/+/996299 | 03:50 |
| opendevreview | Ghanshyam Maan proposed openstack/nova master: Track and log the main RPC server in-progress task https://review.opendev.org/c/openstack/nova/+/996583 | 04:14 |
| opendevreview | Ghanshyam Maan proposed openstack/nova master: Unify the thread poool executors into a central factory https://review.opendev.org/c/openstack/nova/+/998571 | 04:14 |
| opendevreview | Ghanshyam Maan proposed openstack/nova master: Shutdown thread pool executors during service shutdown https://review.opendev.org/c/openstack/nova/+/1000211 | 04:14 |
| opendevreview | Ghanshyam Maan proposed openstack/nova master: Add doc and release notes for the graceful shutdown task tracking https://review.opendev.org/c/openstack/nova/+/997141 | 04:15 |
| opendevreview | Ghanshyam Maan proposed openstack/nova master: Task tracking mechanism for graceful shutdown https://review.opendev.org/c/openstack/nova/+/996299 | 04:27 |
| opendevreview | Ghanshyam Maan proposed openstack/nova master: Track and log the main RPC server in-progress task https://review.opendev.org/c/openstack/nova/+/996583 | 04:27 |
| opendevreview | Ghanshyam Maan proposed openstack/nova master: Unify the thread poool executors into a central factory https://review.opendev.org/c/openstack/nova/+/998571 | 04:27 |
| opendevreview | Ghanshyam Maan proposed openstack/nova master: Shutdown thread pool executors during service shutdown https://review.opendev.org/c/openstack/nova/+/1000211 | 04:27 |
| opendevreview | Ghanshyam Maan proposed openstack/nova master: Add doc and release notes for the graceful shutdown task tracking https://review.opendev.org/c/openstack/nova/+/997141 | 04:27 |
| opendevreview | Kubilay Kaptanoglu proposed openstack/nova master: Fix simple-tenant-usage state schema for deleted instances https://review.opendev.org/c/openstack/nova/+/1000415 | 08:09 |
| *** mhen_ is now known as mhen | 10:36 | |
| opendevreview | Rocky proposed openstack/nova master: Add workaround to skip cross-cell service version check https://review.opendev.org/c/openstack/nova/+/1000442 | 12:02 |
| *** LarsErik1 is now known as LarsErikP | 12:18 | |
| opendevreview | Kubilay Kaptanoglu proposed openstack/nova master: Fix simple-tenant-usage state schema for deleted instances https://review.opendev.org/c/openstack/nova/+/1000415 | 13:02 |
| opendevreview | Daniel Marques Caires proposed openstack/nova master: nova: cast set_host_enabled on disable https://review.opendev.org/c/openstack/nova/+/998464 | 13:42 |
| dansmith | gmaan: hmm, I'm not sure I understand, but let me apply that on top while I let the caffeine soak in and see if it helps | 13:43 |
| dansmith | gmaan: nova-compute still exits immediately | 13:46 |
| opendevreview | Anton Iacobaeus proposed openstack/nova master: doc: Add documentation for Intel TDX https://review.opendev.org/c/openstack/nova/+/1000081 | 14:11 |
| opendevreview | Anton Iacobaeus proposed openstack/nova master: libvirt: reject_mem_enc_instances https://review.opendev.org/c/openstack/nova/+/1000082 | 14:11 |
| opendevreview | Anton Iacobaeus proposed openstack/nova master: libvirt: Add os_firmware_secure https://review.opendev.org/c/openstack/nova/+/1000472 | 14:11 |
Generated by irclog2html.py 4.1.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!