| opendevreview | Joan Gilabert proposed openstack/watcher master: Remove unused methods from NovaHelper https://review.opendev.org/c/openstack/watcher/+/971219 | 10:25 |
|---|---|---|
| opendevreview | Ivan Anfimov proposed openstack/watcher-dashboard master: Migrate setup configuration to pyproject.toml https://review.opendev.org/c/openstack/watcher-dashboard/+/961476 | 10:35 |
| opendevreview | Ivan Anfimov proposed openstack/watcher-dashboard master: Migrate setup configuration to pyproject.toml https://review.opendev.org/c/openstack/watcher-dashboard/+/961476 | 10:35 |
| opendevreview | Ivan Anfimov proposed openstack/watcher-dashboard master: Migrate setup configuration to pyproject.toml https://review.opendev.org/c/openstack/watcher-dashboard/+/961476 | 10:36 |
| opendevreview | Merged openstack/watcher master: Skip resize actions in pre_condition phase https://review.opendev.org/c/openstack/watcher/+/977773 | 11:02 |
| opendevreview | Merged openstack/watcher-dashboard master: Migrate setup configuration to pyproject.toml https://review.opendev.org/c/openstack/watcher-dashboard/+/961476 | 11:27 |
| amoralej | Watcher IRC meeting is starting in 25 minutes, remember to add your topics to https://etherpad.opendev.org/p/openstack-watcher-irc-meeting | 11:36 |
| *** amoralej_ is now known as amoralej | 12:00 | |
| amoralej | it's meeting time | 12:00 |
| amoralej | #startmeeting Watcher Meeting 26-Feb-2026 | 12:01 |
| opendevmeet | Meeting started Thu Feb 26 12:01:05 2026 UTC and is due to finish in 60 minutes. The chair is amoralej. Information about MeetBot at http://wiki.debian.org/MeetBot. | 12:01 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 12:01 |
| opendevmeet | The meeting name has been set to 'watcher_meeting_26_feb_2026' | 12:01 |
| amoralej | Who is around today? | 12:01 |
| jgilaber | o/ | 12:01 |
| amoralej | courtedy ping: sean-k-mooney chandankumar rlandy dviroel | 12:03 |
| dviroel | o/ | 12:03 |
| amoralej | you still can add topics to https://etherpad.opendev.org/p/openstack-watcher-irc-meeting | 12:03 |
| amoralej | let's start with the agenda | 12:04 |
| chandankumar | o/ | 12:04 |
| sean-k-mooney | o/ | 12:04 |
| amoralej | #topic using tags to better classify bugs | 12:05 |
| amoralej | this is follow-up from last meeting | 12:05 |
| rlandy | o/ | 12:05 |
| amoralej | so, apparently there is already a good number of tags | 12:05 |
| amoralej | it's mainly that we are not consistent using them | 12:06 |
| jgilaber | yes I copied that list from a bug page | 12:06 |
| jgilaber | most of them are empty | 12:06 |
| amoralej | actually, I'd try to keep it smaller and create some clear classification criteria | 12:07 |
| amoralej | we could add tags as part of the triage process | 12:07 |
| opendevreview | Joan Gilabert proposed openstack/watcher master: Deprecate prometheus datasource in favor of aetos https://review.opendev.org/c/openstack/watcher/+/966672 | 12:08 |
| amoralej | jgilaber, I think you added the topic, you have some idea about it? | 12:08 |
| jgilaber | not much, this came up at the end of last week's meeting | 12:09 |
| jgilaber | +1 to add them during triage | 12:09 |
| sean-k-mooney | amoralej: yes i add them on ocation | 12:10 |
| amoralej | so, I think tags like perf, text, technical-debt, are good, also by service, api, decision-engine and applier, client | 12:10 |
| jgilaber | I'm not sure which ones we could remove though, they all seem useful | 12:10 |
| sean-k-mooney | and i have updated the tag a few times to make them offical or not | 12:10 |
| sean-k-mooney | so its somethign we shoudl start doing durign triage and review them form time to time | 12:10 |
| amoralej | yep | 12:10 |
| amoralej | doing it in the meetings will help us to be consistent over time | 12:11 |
| amoralej | #agreed tags will be added to the bugs during bug triage in watcher meetings | 12:11 |
| dviroel | yeah, the ones listed seems all useful | 12:11 |
| dviroel | +1 | 12:11 |
| amoralej | so, there are some bugs to be triage later in the call, we will start today :) | 12:12 |
| amoralej | can I move to next topic or want to add something else about this one? | 12:12 |
| amoralej | #topic Feature Freeze for Gazpacho is tomorrow | 12:13 |
| amoralej | we can check the status of the ongoing features | 12:14 |
| amoralej | #link https://etherpad.opendev.org/p/watcher-2026.1-status | 12:14 |
| amoralej | wrt eventlet removal, it is finished? | 12:15 |
| amoralej | dviroel, i'd say only some testing leftovers are pending to merge? | 12:15 |
| dviroel | amoralej: no, everything that was expected to merge is already in | 12:16 |
| dviroel | there are some DNM patches up, just for testing | 12:16 |
| amoralej | cool | 12:16 |
| amoralej | #info eventlet removal is finished for Gazpacho release | 12:16 |
| amoralej | wrt migration to openstacksdk, it's mostly done also, right? | 12:17 |
| sean-k-mooney | actully technially feature feeze is today | 12:17 |
| sean-k-mooney | as in end of day today | 12:17 |
| jgilaber | yes, only one small patch pending for the nova helper migration to the sdk | 12:17 |
| amoralej | thanks sean-k-mooney | 12:17 |
| jgilaber | #link https://review.opendev.org/c/openstack/watcher/+/977919/2 | 12:18 |
| amoralej | that requires new release from openstacksdk, right? | 12:18 |
| sean-k-mooney | the general rule is if its approved todya but need recheck we allow that untile monday without any special dicussion ectra | 12:18 |
| jgilaber | nope this one is a follow up fix for a unit test | 12:18 |
| sean-k-mooney | ill tak a look at that again after the meeting | 12:18 |
| amoralej | ack | 12:18 |
| jgilaber | https://review.opendev.org/c/openstack/watcher/+/975498/26 is the one that needs a new openstacksdk release | 12:18 |
| sean-k-mooney | so there is that and the removal of the reqries right? | 12:18 |
| jgilaber | but that is not strictly required | 12:18 |
| sean-k-mooney | so to patche left in that series | 12:19 |
| jgilaber | yes, but I consider the removal of the retries decorator optional | 12:19 |
| sean-k-mooney | ok | 12:19 |
| jgilaber | since the existing implementation is functional | 12:19 |
| sean-k-mooney | we could perhaps consier that a bug fix | 12:19 |
| amoralej | https://review.opendev.org/c/openstack/releases/+/976935 didn't include the fix, right? | 12:20 |
| sean-k-mooney | correct | 12:20 |
| jgilaber | no, I pushed the fix yesterday | 12:20 |
| sean-k-mooney | the non clinet lib freeze was 2 weeks ago | 12:20 |
| amoralej | ok, so that will need to wait for next release | 12:21 |
| sean-k-mooney | ya | 12:21 |
| sean-k-mooney | that ok i think | 12:21 |
| jgilaber | yes, I'm ok with waiting for next cycle | 12:21 |
| amoralej | unfortunatelly it ads changes in config, but yeah, as you said, even without that patch we are not using novaclient | 12:21 |
| amoralej | so, moving out of novaclient is done in this release | 12:22 |
| dviroel | yeah, so we are done with sdk for this cycle too, nice work jgilaber++ | 12:22 |
| amoralej | #info migration from novaclient to openstacksdk is done | 12:22 |
| jgilaber | thanks for the reviews! | 12:22 |
| amoralej | #info replacing the nova_retries decorator by openstacksdk implementation will be done in next release | 12:22 |
| amoralej | yeah, great work jgilaber++ | 12:23 |
| amoralej | wrt skip actions automatically on pre_condition, only https://review.opendev.org/c/openstack/watcher/+/977340 is pending on +W | 12:23 |
| amoralej | let me know if you want me to do some additional change | 12:24 |
| sean-k-mooney | ill skim it quickly after the meeting but i think we can proceed | 12:25 |
| dviroel | yeah, I was waiting to see if sean-k-mooney has some comments in the latest PS, since was reviewing before.. | 12:25 |
| amoralej | ack | 12:25 |
| dviroel | but joan and I seems to agree in all | 12:25 |
| sean-k-mooney | i think we need ot make sure we are not conflaitng up and enabled in general | 12:25 |
| sean-k-mooney | but that can be a follow up | 12:25 |
| dviroel | ack | 12:26 |
| sean-k-mooney | so ill just veriy the current state of the latest and appvoe if no other issues | 12:26 |
| amoralej | good, thanks | 12:26 |
| sean-k-mooney | what about the related volume migrate actions | 12:26 |
| sean-k-mooney | https://review.opendev.org/c/openstack/watcher/+/976393 | 12:26 |
| amoralej | if anything is needed you can ping me to do fast | 12:26 |
| sean-k-mooney | ah those are approved | 12:26 |
| amoralej | yes, it's in the gate now | 12:26 |
| sean-k-mooney | waht was the resolution there | 12:27 |
| sean-k-mooney | did we skip fail or make it faile if all actions skipped? | 12:27 |
| amoralej | we moved non-existing destination pool or type to failed | 12:27 |
| amoralej | for consistency with others | 12:27 |
| sean-k-mooney | ack | 12:27 |
| dviroel | yeah | 12:28 |
| amoralej | about state for actionplans when all actions are skipped is a different topic, we can discuss separatedly in ptg or meeting | 12:28 |
| sean-k-mooney | the only concern i had with that is if a continuous audit ever fail i belive it will never run again correct | 12:29 |
| amoralej | no | 12:29 |
| sean-k-mooney | but that a prexisitng issue and it would have failed anyway at runtime | 12:29 |
| amoralej | status of actionplans and audits i think is not related | 12:29 |
| sean-k-mooney | ack | 12:29 |
| amoralej | I'd say... | 12:29 |
| sean-k-mooney | lets revisiti all of this at the ptg | 12:29 |
| amoralej | i can test | 12:29 |
| amoralej | yes | 12:29 |
| amoralej | there is a couple of pending patches related to features for Gazpacho | 12:30 |
| amoralej | https://review.opendev.org/c/openstack/watcher/+/966672 | 12:30 |
| amoralej | that's prometheus datasource deprecation | 12:30 |
| amoralej | we need to merge it if we want to get the deprecation in this release, what we agreed i think | 12:30 |
| dviroel | i'm reviewing this one atm, it would be good to merge | 12:31 |
| jgilaber | I rebased it a few minutes ago, it had a conflict with the monasca removal patch | 12:31 |
| amoralej | I think I reviewed a previous PS, but yeah, i need to take a look again | 12:32 |
| sean-k-mooney | ya we shodl proceed with teh deprection but i have not looked at it yet | 12:32 |
| amoralej | the other one i chandankumar patch on the watcher-dashboard https://review.opendev.org/c/openstack/watcher-dashboard/+/958209 | 12:33 |
| sean-k-mooney | im ok with that exented into the rc period | 12:33 |
| amoralej | sean-k-mooney reviewed it yesterday, chandankumar you think you will have time to send a new PS soon? | 12:33 |
| sean-k-mooney | amoralej: that im less happy with form a code quality perspecitve. its functional but there is a lot wrong with the approch | 12:33 |
| chandankumar | I am working on addressing the sean mooney comments | 12:34 |
| sean-k-mooney | i would say we could grant it a Feature Feeze excption till say the next irc meetign but if its not ready by then let hold it and do it next cycle | 12:35 |
| sean-k-mooney | with the playwritght tests you have on top | 12:35 |
| dviroel | +1 | 12:36 |
| chandankumar | fine by me | 12:36 |
| amoralej | btw, the playwright test is great, thanks chandankumar for that | 12:36 |
| sean-k-mooney | yep they will help alot going forward | 12:37 |
| amoralej | yes, it will | 12:37 |
| amoralej | so, I think that's it about features for Gazpacho | 12:37 |
| amoralej | am i missing something? | 12:37 |
| sean-k-mooney | i think there was one other minor thing but its escaping me now | 12:38 |
| sean-k-mooney | oh not a feature but the release note prelude patch rlandy is working on | 12:38 |
| amoralej | right, there is patch for that too | 12:38 |
| sean-k-mooney | we shoudl also submit the a marketing highlits patch to the release repo for wtacher in the next week | 12:38 |
| amoralej | https://review.opendev.org/c/openstack/watcher/+/976015 | 12:39 |
| amoralej | we could also add the improvements in decision-engine and applier scalability by adding / fixing the service monitors | 12:40 |
| amoralej | I will comment there | 12:40 |
| amoralej | let's move to the next topic | 12:41 |
| dviroel | yeah, I already chat with rlandy about updates wrt to eventlet-removal progress | 12:41 |
| amoralej | #topic TC/PTL elections period: https://governance.openstack.org/election/ | 12:41 |
| amoralej | #info https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/SD2BCBYWOMYMVCW46I6PEIXRPJYV3EWT/ | 12:41 |
| amoralej | so for watcher in 2026.2 we have dviroel as ptl candidate | 12:42 |
| amoralej | https://governance.openstack.org/election/#ptl-candidates | 12:42 |
| amoralej | thanks dviroel++ | 12:42 |
| sean-k-mooney | yep +1 | 12:42 |
| dviroel | oh, yeah I added the topic | 12:42 |
| rlandy | apologies sean-k-mooney dviroel - on concurrent meetings - will update those patches this week for review | 12:42 |
| dviroel | there are two projects (barbican/horizon) that have 2 candidates for voting | 12:43 |
| dviroel | rlandy: no worries | 12:43 |
| sean-k-mooney | dviroel: one thing you will need to do once that happesn is reappoint release liasons and laison in genreal since that is doen in a diffent place for ptl projects | 12:43 |
| sean-k-mooney | for ptl project the release liasosn need to be listed in the releases repo | 12:43 |
| sean-k-mooney | the security/tact laisson are in the same place however | 12:43 |
| dviroel | ack sean-k-mooney, thanks for the reminder | 12:44 |
| amoralej | let's move to bugs topic | 12:45 |
| dviroel | yep | 12:45 |
| amoralej | #topic bugs triage | 12:45 |
| amoralej | #info https://bugs.launchpad.net/watcher/+bug/2141951 Audits with workload_stabilization strategy takes very long to execute | 12:46 |
| amoralej | that's the last one of the perf related bugs | 12:46 |
| amoralej | in this case affects to workload_stabilization which takes long time, ~ 30 minutes in a 32kvms environment | 12:46 |
| amoralej | se we could set as medium ? | 12:47 |
| amoralej | we'll need to review the algorithm we use | 12:47 |
| sean-k-mooney | that sound reasonable to me | 12:48 |
| amoralej | one thing i was considering is to pre-identify the set of hosts candidates to be source / destinatination of vm migrations | 12:48 |
| sean-k-mooney | we need to look at both the algroutime of the computeationand how we are gatherign the prometeheus metrics | 12:48 |
| amoralej | instead of analyze always all the vms | 12:48 |
| amoralej | yes, that's correct | 12:49 |
| sean-k-mooney | ya and or makeing the algortiem lazy so that we only compute the moves up to the limit | 12:49 |
| amoralej | given that we calculate standard deviation in the first seconds of the strategy, we can now which host are further of the average | 12:49 |
| sean-k-mooney | i.e. the limtis form the parmars on how may migration we can do ectra | 12:49 |
| amoralej | yeah | 12:50 |
| sean-k-mooney | ya so we can start with the host that are most overloaded | 12:50 |
| amoralej | exactly | 12:50 |
| sean-k-mooney | there are proably a lot of optimisation that cna be applied | 12:50 |
| sean-k-mooney | this is boarderline a feature for what its worth | 12:51 |
| sean-k-mooney | but im not agains considering it a bug i just dont knwo if we should backport it or not | 12:51 |
| sean-k-mooney | we can determin that based on the final solution we proceed with | 12:51 |
| amoralej | it will depend on the fix | 12:51 |
| amoralej | yep | 12:51 |
| sean-k-mooney | so tags | 12:51 |
| sean-k-mooney | is the log tiem on the applier or desgsion engine | 12:52 |
| sean-k-mooney | the descison engine correct? | 12:52 |
| amoralej | perf and decision-engine | 12:52 |
| amoralej | i'd say | 12:52 |
| dviroel | +1 | 12:52 |
| sean-k-mooney | cool added ill make perf a standard tag | 12:52 |
| dviroel | +1 | 12:53 |
| amoralej | yeah, there is no perf i think | 12:53 |
| sean-k-mooney | there is now :) | 12:53 |
| sean-k-mooney | tags cna be anythign as it freefrom by defualt | 12:53 |
| sean-k-mooney | but you will see them colored diffently based on if they are offical tags form the project | 12:54 |
| amoralej | done | 12:54 |
| amoralej | thanks | 12:54 |
| amoralej | #info https://bugs.launchpad.net/watcher/+bug/2142208 | 12:54 |
| amoralej | that's from jgilaber | 12:54 |
| sean-k-mooney | i dont knowif we shoudl trust that guy :P the keep findign and reporting bugs | 12:55 |
| jgilaber | that is a collection of the calls to nova helper which assumed that the api calls returned None | 12:55 |
| amoralej | :D | 12:55 |
| sean-k-mooney | ah ok | 12:55 |
| sean-k-mooney | so they were not handelign the raised excption before | 12:56 |
| jgilaber | it should be easy to fix, I think I'll propose a patch after FF | 12:56 |
| sean-k-mooney | so this is the tracker for the oens we commented on durign the revew | 12:56 |
| jgilaber | yes, the places that I originally fixed in the openstacksdk patches | 12:56 |
| amoralej | which importance it has? | 12:57 |
| sean-k-mooney | so i woudl say high | 12:57 |
| sean-k-mooney | at least medium but i think it woudl be good to fix these before RC1 | 12:57 |
| sean-k-mooney | not high enough to justify an RC2 | 12:57 |
| jgilaber | agreed | 12:57 |
| sean-k-mooney | but worth workig on now rather then after the releawe | 12:57 |
| amoralej | yep | 12:58 |
| amoralej | i started working in removing nova calls from zone_migration btw, but that will be for next release | 12:58 |
| sean-k-mooney | tags, i guess just descion-engine and appler | 12:58 |
| amoralej | so we can fix the current issues | 12:58 |
| amoralej | yep, it's mostly applier but some in decision-engine too | 12:58 |
| dviroel | i would like to not have the calls to nova in the zone_migration, but this is another LP | 12:59 |
| amoralej | yes | 12:59 |
| amoralej | i just mentioned because that part of the code is affected by this one too | 12:59 |
| dviroel | yep | 12:59 |
| amoralej | we are out of time | 13:00 |
| amoralej | we can do the rest of bugs next week? | 13:00 |
| jgilaber | I think so | 13:01 |
| sean-k-mooney | sure | 13:01 |
| amoralej | ack | 13:01 |
| amoralej | so i think that's it for today | 13:01 |
| amoralej | thanks dviroel for volunteering for next meeting | 13:01 |
| dviroel | o/ | 13:01 |
| amoralej | and thanks all for joining today! | 13:01 |
| jgilaber | thanks amoralej! | 13:01 |
| dviroel | amoralej++ | 13:02 |
| amoralej | #endmeeting | 13:02 |
| opendevmeet | Meeting ended Thu Feb 26 13:02:14 2026 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 13:02 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/watcher_meeting_26_feb_2026/2026/watcher_meeting_26_feb_2026.2026-02-26-12.01.html | 13:02 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/watcher_meeting_26_feb_2026/2026/watcher_meeting_26_feb_2026.2026-02-26-12.01.txt | 13:02 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/watcher_meeting_26_feb_2026/2026/watcher_meeting_26_feb_2026.2026-02-26-12.01.log.html | 13:02 |
| amoralej | btw, if you have a chance, I expect https://review.opendev.org/c/openstack/watcher/+/977786 to reduce CI flakiness | 13:02 |
| opendevreview | Merged openstack/watcher master: Skip volume_migrate actions in pre_condition phase https://review.opendev.org/c/openstack/watcher/+/976393 | 13:06 |
| sean-k-mooney | ok i think i have reviewd all the things that need review | 13:22 |
| sean-k-mooney | if not let me know | 13:22 |
| opendevreview | chandan kumar proposed openstack/watcher-dashboard master: Add skip action feature with microversion support https://review.opendev.org/c/openstack/watcher-dashboard/+/958209 | 13:53 |
| opendevreview | chandan kumar proposed openstack/watcher-dashboard master: [poc]Add Playwright-based E2E testing framework https://review.opendev.org/c/openstack/watcher-dashboard/+/970353 | 13:55 |
| opendevreview | chandan kumar proposed openstack/watcher-dashboard master: Add Playwright integration test for skip action workflow https://review.opendev.org/c/openstack/watcher-dashboard/+/976594 | 13:55 |
| chandankumar | setting -1 for above patch, need to address comments (hopefully ready by tomorrow) | 13:56 |
| opendevreview | Merged openstack/watcher master: Add retry_on_deadlock decorators to missing database methods https://review.opendev.org/c/openstack/watcher/+/976293 | 14:01 |
| opendevreview | Merged openstack/watcher master: Fix ironic metal_helper unit test assert https://review.opendev.org/c/openstack/watcher/+/977919 | 14:01 |
| opendevreview | Joan Gilabert proposed openstack/watcher master: Fix exception handling for find_instance calls https://review.opendev.org/c/openstack/watcher/+/978077 | 14:28 |
| opendevreview | Joan Gilabert proposed openstack/watcher master: Deprecate prometheus datasource in favor of aetos https://review.opendev.org/c/openstack/watcher/+/966672 | 14:40 |
| amoralej | sean-k-mooney, https://review.opendev.org/c/openstack/watcher/+/977935 that's for https://bugs.launchpad.net/watcher/+bug/2142486 that we were discussing some days ago | 14:52 |
| opendevreview | Merged openstack/watcher master: Check Audit state in the decision-engine before starting the execution https://review.opendev.org/c/openstack/watcher/+/977786 | 14:59 |
| opendevreview | Merged openstack/watcher master: Skip change_nova_service_state actions in pre_condition phase https://review.opendev.org/c/openstack/watcher/+/977340 | 15:00 |
| opendevreview | chandan kumar proposed openstack/watcher-dashboard master: Add skip action feature with microversion support https://review.opendev.org/c/openstack/watcher-dashboard/+/958209 | 15:03 |
| opendevreview | chandan kumar proposed openstack/watcher-dashboard master: Add skip action feature with microversion support https://review.opendev.org/c/openstack/watcher-dashboard/+/958209 | 15:05 |
| opendevreview | chandan kumar proposed openstack/watcher-dashboard master: Add skip action feature with microversion support https://review.opendev.org/c/openstack/watcher-dashboard/+/958209 | 15:18 |
| opendevreview | chandan kumar proposed openstack/watcher-dashboard master: [poc]Add Playwright-based E2E testing framework https://review.opendev.org/c/openstack/watcher-dashboard/+/970353 | 15:19 |
| opendevreview | chandan kumar proposed openstack/watcher-dashboard master: Add Playwright integration test for skip action workflow https://review.opendev.org/c/openstack/watcher-dashboard/+/976594 | 15:19 |
| chandankumar | sean-k-mooney: Hello, thank you for the detailed review, I tried to address most of the comment here https://review.opendev.org/c/openstack/watcher-dashboard/+/958209/, might missed few to address few comments | 15:23 |
| chandankumar | Please have a look, I will update once agin tomorrow | 15:23 |
| opendevreview | Joan Gilabert proposed openstack/watcher master: Fix exception handling for find_instance calls https://review.opendev.org/c/openstack/watcher/+/978077 | 15:30 |
| opendevreview | Merged openstack/watcher master: Add regression test for retry_on_deadlock decorator https://review.opendev.org/c/openstack/watcher/+/977248 | 15:34 |
| *** dviroel is now known as dviroel_afk | 15:45 | |
| *** dviroel_afk is now known as dviroel | 17:01 | |
| opendevreview | Merged openstack/watcher master: Control length of status_message on Action failures https://review.opendev.org/c/openstack/watcher/+/977935 | 17:10 |
Generated by irclog2html.py 4.1.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!