Wednesday, 2025-05-07

ishanwar[m]Hi Everyone... (full message at <https://matrix.org/oftc/media/v1/media/download/ATMsTmYRC_O_5NLksmXpDcjurxmdUL5FvXvyOxE41THD5qlnXpbAklDgHgDUmLVge3chX9vGZMMSxjhL6pv2-jxCeW8Xnj2gAG1hdHJpeC5vcmcvcVNBSnNRU2tBaXZkck1PcEJLQVBLYWN6>)06:13
opendevreviewIshan Shanware proposed openstack/nova master: [FEAT]: using quota_details to optimize validate networks [FIX]: added error handling for .get() statements [FIX]: pep8 formatting fixed for changes  https://review.opendev.org/c/openstack/nova/+/94898806:54
opendevreviewIshan Shanware proposed openstack/nova master: [FEAT]: using quota_details to optimize validate networks [FIX]: added error handling for .get() statements [FIX]: pep8 formatting fixed for changes  https://review.opendev.org/c/openstack/nova/+/94520406:56
ishanwar[m]<ishanwar[m]> "Hi Everyone..." <- I want to get this merged so need your help 06:58
sean-k-mooneyishanwar[m]: the failed indicate taht your missing mocking09:25
sean-k-mooneyyou added 09:26
sean-k-mooney    @mock.patch(09:26
sean-k-mooney        "nova.network.neutron.API.has_quota_details_extension",09:26
sean-k-mooney        new=mock.Mock(return_value=True),09:26
sean-k-mooney    )09:26
sean-k-mooneybut you only did that to your test09:26
sean-k-mooneythe function you added is called in several other test that do not have the mock in place09:26
sean-k-mooneyso for the 5 failing test you also need to mock the call to has_quota_details_extension09:27
gibisean-k-mooney: dansmith: FYI I noted some memory consumption numbers with the reduced scatter-gather pool size in https://review.opendev.org/c/openstack/nova/+/948450/comments/9ff461df_ec6381b2 It seems we have a good handle on managing memory consumption by managing the pool size. 12:05
gibi40 threads -> 122MB RSS, 5 threads -> 85MB RSS, eventlet based scheduler 56MB RSS12:07
sean-k-mooneycool that looks reasonable. although we are planning to have multiple pools in some cases12:14
sean-k-mooneyi guess for conductor api and schduelr we likely will only need the scater gater pool12:14
sean-k-mooneyand for the compute we will only need the io one12:14
sean-k-mooneyout side of the oslo.messaging one12:14
sean-k-mooneyso we are proably fine12:15
sean-k-mooneyi belive in my paches i reused the generic io threadpool for ceph but if we are removing that expict usage anyway and leavign the librbd/rados package handel that internally then that fine too12:16
gibiyeah currently I have no data abou the pool in oslo.messaging. But obviously that is changed too as soon as we switched off monkey patching12:16
gibibut we have a config option to limit that pool too (default is 64)12:17
sean-k-mooneyi assume that if that is configurable it will be expsoed as an oslo.messaging config option which we will jsut inherit12:17
gibiyepp12:17
gibiit is12:17
sean-k-mooneycool12:17
sean-k-mooney64 seam a little higher then i woudl expect but we can role with it and see12:17
sean-k-mooneyfor the conductor or schduler i guess that might be reasonable to have 64 RPCs in flight at once12:18
sean-k-mooneythe api and comptue dont really need it that large12:18
sean-k-mooneytooling and admins can tune it however once we gain experince iwth the impact on scaling12:19
gibiyepp12:23
gibiI will include a list of tunables in a new doc 12:23
*** ralonsoh is now known as ralonsoh_out15:15
opendevreviewBalazs Gibizer proposed openstack/nova master: Translate scatter-gather to futurist  https://review.opendev.org/c/openstack/nova/+/94796615:40
opendevreviewBalazs Gibizer proposed openstack/nova master: Use futurist for _get_default_green_pool()  https://review.opendev.org/c/openstack/nova/+/94807215:40
opendevreviewBalazs Gibizer proposed openstack/nova master: Replace utils.spawn_n with spawn  https://review.opendev.org/c/openstack/nova/+/94807615:40
opendevreviewBalazs Gibizer proposed openstack/nova master: Add spawn_on  https://review.opendev.org/c/openstack/nova/+/94807915:40
opendevreviewBalazs Gibizer proposed openstack/nova master: Move ComputeManager to use spawn_on  https://review.opendev.org/c/openstack/nova/+/94818615:40
opendevreviewBalazs Gibizer proposed openstack/nova master: Move ConductorManager to use spawn_on  https://review.opendev.org/c/openstack/nova/+/94818715:40
opendevreviewBalazs Gibizer proposed openstack/nova master: Make nova.utils.pass_context private  https://review.opendev.org/c/openstack/nova/+/94818815:40
opendevreviewBalazs Gibizer proposed openstack/nova master: Rename DEFAULT_GREEN_POOL to DEFAULT_EXECUTOR  https://review.opendev.org/c/openstack/nova/+/94808615:40
opendevreviewBalazs Gibizer proposed openstack/nova master: Make the default executor configurable  https://review.opendev.org/c/openstack/nova/+/94808715:40
opendevreviewBalazs Gibizer proposed openstack/nova master: Print ThreadPool statistics  https://review.opendev.org/c/openstack/nova/+/94834015:40
opendevreviewBalazs Gibizer proposed openstack/nova master: WIP: allow service to start with threading  https://review.opendev.org/c/openstack/nova/+/94831115:40
opendevreviewBalazs Gibizer proposed openstack/nova master: DNM:Run nova-next with n-sch in threading mode  https://review.opendev.org/c/openstack/nova/+/94845015:40
*** __ministry is now known as Guest1536016:06
opendevreviewBalazs Gibizer proposed openstack/nova master: Add spawn_on  https://review.opendev.org/c/openstack/nova/+/94807919:58
opendevreviewBalazs Gibizer proposed openstack/nova master: Move ComputeManager to use spawn_on  https://review.opendev.org/c/openstack/nova/+/94818619:58
opendevreviewBalazs Gibizer proposed openstack/nova master: Move ConductorManager to use spawn_on  https://review.opendev.org/c/openstack/nova/+/94818719:58
opendevreviewBalazs Gibizer proposed openstack/nova master: Make nova.utils.pass_context private  https://review.opendev.org/c/openstack/nova/+/94818819:58
opendevreviewBalazs Gibizer proposed openstack/nova master: Rename DEFAULT_GREEN_POOL to DEFAULT_EXECUTOR  https://review.opendev.org/c/openstack/nova/+/94808619:58
opendevreviewBalazs Gibizer proposed openstack/nova master: Make the default executor configurable  https://review.opendev.org/c/openstack/nova/+/94808719:58
opendevreviewBalazs Gibizer proposed openstack/nova master: Print ThreadPool statistics  https://review.opendev.org/c/openstack/nova/+/94834019:58
opendevreviewBalazs Gibizer proposed openstack/nova master: WIP: allow service to start with threading  https://review.opendev.org/c/openstack/nova/+/94831119:58
opendevreviewBalazs Gibizer proposed openstack/nova master: DNM:Run nova-next with n-sch in threading mode  https://review.opendev.org/c/openstack/nova/+/94845019:58

Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!