Thursday, 2025-05-15

opendevreviewJaromír Wysoglad proposed openstack/watcher-specs master: Support multitenancy with Prometheus datasource  https://review.opendev.org/c/openstack/watcher-specs/+/94980407:26
opendevreviewJaromír Wysoglad proposed openstack/watcher-specs master: Support multitenancy with Prometheus datasource  https://review.opendev.org/c/openstack/watcher-specs/+/94980408:54
opendevreviewJoan Gilabert proposed openstack/watcher master: Check logs in some cinder and nova helper tests  https://review.opendev.org/c/openstack/watcher/+/94918709:15
opendevreviewJoan Gilabert proposed openstack/watcher master: Fix incorrect logging format  https://review.opendev.org/c/openstack/watcher/+/82255909:15
opendevreviewJoan Gilabert proposed openstack/watcher master: Check logs in some cinder and nova helper tests  https://review.opendev.org/c/openstack/watcher/+/94918710:56
opendevreviewJoan Gilabert proposed openstack/watcher master: Fix incorrect logging format  https://review.opendev.org/c/openstack/watcher/+/82255910:56
opendevreviewJoan Gilabert proposed openstack/watcher master: Add test for missing destination in zone migration  https://review.opendev.org/c/openstack/watcher/+/94886511:00
opendevreviewJoan Gilabert proposed openstack/watcher master: Handle missing dst parameters in zone_migration  https://review.opendev.org/c/openstack/watcher/+/94886611:00
dviroel#startmeeting watcher12:01
opendevmeetMeeting started Thu May 15 12:01:04 2025 UTC and is due to finish in 60 minutes.  The chair is dviroel. Information about MeetBot at http://wiki.debian.org/MeetBot.12:01
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.12:01
opendevmeetThe meeting name has been set to 'watcher'12:01
dviroelhi all, who's around?12:01
jgilabero/12:01
chandankumaro/12:02
rlandyo/12:02
mtemboo/12:02
dviroelcourtesy ping: amoralej12:02
dviroeli proposed the courtesy ping list in one of the past meetings12:02
dviroelthe idea is that, if you put your nick there, you are going to receive a ping at the beggining of the meetings ... unless you are already here, i can skip your nick :) 12:03
dviroellet's start with today's meeting agenda12:03
dviroel#link https://etherpad.opendev.org/p/openstack-watcher-irc-meeting#L36 (Meeting agenda)12:04
dviroelfeel free to add your own topics to the agenda12:04
dviroelthere is a topic to place your changes that requires attention from reviewers12:04
dviroelas also a bug triage topic, if you want to bring any for discussion12:05
dviroelstarting with the first one12:05
dviroel#topic Eventlet Removal12:05
dviroelthe plan here is to circle this topic every week12:06
dviroelto follow up progress for this goal, get some feedback and call for actions12:06
dviroelthis is the etherpad that we capture progress and discussions around eventlet removal in watcher12:07
dviroel#link https://etherpad.opendev.org/p/watcher-eventlet-removal12:07
dviroelat the top, there are some changes that were already proposed, but this is just a start12:07
dviroelto prepare for next changes12:08
dviroelso i am calling for review of these ones12:08
dviroel#link https://review.opendev.org/c/openstack/watcher/+/949641 (Move eventlet command scripts to a different dir)12:08
dviroel#link https://review.opendev.org/c/openstack/watcher/+/949658 (Remove deprecated executor in message handling servers)12:08
dviroelwe can capture discussions in the etherpad or in the code review12:09
dviroelor even here in the irc channel12:09
dviroelok, next thing in this topic is12:09
dviroelmaas (metal as a service) support12:10
dviroeli want to highlight that the maas integration which will be affect by the eventlet removal12:10
dviroelthe asyncio compatible call in the code will require change and testing12:11
dviroelsee12:11
dviroel#link https://opendev.org/openstack/watcher/src/commit/1b12e808827ac64d3972443927fc2d070c227023/watcher/common/utils.py#L17312:11
dviroelbut the point is that we don't have the knowledge and cycle to work on this feature12:11
jgilaberdo we have any testing for it currently=12:11
jgilaber?12:11
dviroelnot even how to test it12:11
dviroeljgilaber: no12:12
dviroelwe miss a CI testing and more documentation too12:12
dviroelwhile chatting with sean-k-mooney these days12:12
jgilaberack, should we like we did for the monasca and grafana datasources?12:13
jgilabermark as deprecated and see if someone is interested in it?12:13
dviroelwe discussed about marking it as an experimental feature during this cycle12:13
dviroeland call for maintainers12:13
jgilaberthat sounds good to me12:13
sean-k-mooneyo/12:13
dviroelin case we don't find any, we could mark it as deprecated in the next cycle12:13
dviroeland for removal in the following one12:14
* dviroel sean-k-mooney o/ - talking about maas support12:14
sean-k-mooneyack12:14
sean-k-mooneythis kind of ties back into one fo the ptg topics12:14
sean-k-mooneyto add a supprot level matrics to our docs12:15
sean-k-mooneyi think the maas supprot is perhaps the first but not nessisarly the last one to be consierd experimental12:15
dviroelyes, we miss that in our docs for sure12:15
sean-k-mooneywe also do not have testing of the ironic integration but we may be able to fill that gap more easilly since there are ironci devstack jobs so we can likely borrow some config form them12:16
sean-k-mooneyfor nwo it would also consider markign ironic as expermintal applying the same logic but that can be done sepreatly12:16
sean-k-mooneyi dont belive there is a maas devstack plugin or a refence job we can pull from to close the maas gap ourselves12:17
dviroelagree12:17
dviroelso the proposal is to call for maintainers of the maas in the ML12:18
dviroelsince it will be affected by the eventlet removal12:18
dviroeland we lack testing or knowledge on this to maintain it12:18
sean-k-mooneywell that adn the fact is has no docs or integration testing12:18
sean-k-mooneyso we dont really knwo how to deploy it even if there was a bug with it to fix it12:19
dviroelexactly12:19
sean-k-mooneyi am wawre that there was some ubuntu charm installer supprot12:19
sean-k-mooneyhowever they have moved on to sunbeam12:19
sean-k-mooneyand i dont belive its supproted there12:19
sean-k-mooneyso im not sure if any activly devloped installer currently suprpot deploying in this mode12:20
sean-k-mooneyanyway i agree with your propsoal12:20
dviroel#action dviroel to send an email to mailing list to call for maintainers of the maas support12:20
dviroelok, anything else in this topic? 12:22
dviroel#topic call for reviews12:23
dviroel1. Set keystone_client default interface to internal12:23
dviroel#link https://review.opendev.org/c/openstack/watcher/+/94832212:23
sean-k-mooneyi think we ended up defaulting to public?12:23
jgilaberyes, I changed that in the last patchset12:24
sean-k-mooneyya so long term we shoudl replace our current config option 12:24
sean-k-mooneywith valid_interface form oslo12:24
sean-k-mooneyvalid_interfaces is a preferncally orderd list12:24
sean-k-mooneyso we can eventually default to internal,public12:25
sean-k-mooneyand it will use the internal endpoint if its aviabel but fall back to public which should always exist12:25
sean-k-mooneyi think that woudl be a ncie wishlist feature for all the clients12:25
dviroelyeah, that's a got rfe12:25
sean-k-mooneybut we may want to consider that as part of moving to the openstack sdk12:25
dviroels/got/good12:25
sean-k-mooneyi have approved https://review.opendev.org/c/openstack/watcher/+/94832212:26
dviroelthanks sean-k-mooney 12:26
dviroelmoving to the next one12:26
jgilaberthanks!12:26
dviroel2. Migrate value column of efficacy indicator on load12:26
dviroel#link https://review.opendev.org/c/openstack/watcher/+/94964012:27
jgilaberThis is a follow up from https://review.opendev.org/c/openstack/watcher/+/94519912:27
dviroelit is a new one (at least for me) 12:27
dviroelack12:27
jgilaberin that patch we modified the db schema for efficacy indicators12:27
jgilaberand we could read the old column as fallback, but we're not updating the db back to use the old column12:28
jgilaberthis patch implements that12:28
sean-k-mooneyyes its a followup ot "heal the db over time" it will eventually allow us to drop the old column12:28
dviroelack, going to take a look afterwards, tks jgilaber12:29
jgilaberthanks!12:29
sean-k-mooneythe alternitive would have been a "blocker" onlien migration to be ran prior to upgradign to the release where the old colmn is remvoed12:29
sean-k-mooneywe likely wont do the removal until 2026.2 or later12:29
sean-k-mooneybut the sooner we have the migration code the lower the impact12:29
sean-k-mooneyi have added ot my review list12:30
dviroelnext, also from jgilaber12:30
dviroel3. Add test for missing destination in zone migration12:30
dviroel#link https://review.opendev.org/c/openstack/watcher/+/94886512:30
dviroeland 4. Handle missing dst parameters in zone_migration12:30
dviroel#link https://review.opendev.org/c/openstack/watcher/+/94886612:30
dviroelwhich are related12:30
sean-k-mooneyright the first one is the repoducer for https://bugs.launchpad.net/watcher/+bug/2108988 it should have Related-Bug: #210898812:31
jgilaberthey are a reproducer and fix for https://bugs.launchpad.net/watcher/+bug/2108988, which we discussed last week I think12:31
sean-k-mooneyin the commit12:31
jgilaberyes, in short, the zone_migration strategy is not handling correctly the cases where the destination is not set by the user12:32
sean-k-mooneyquick glance both look ok12:32
dviroelis it a fix that we plan to backport?12:32
jgilaberfor both instance and storage migration12:32
jgilaberI think this one we could backport12:32
sean-k-mooneythat a good question12:33
sean-k-mooneyi think it can be backported potentially 12:33
jgilaberit's only changing the strategy code12:33
jgilaberthe parameters are the same12:33
dviroeli miss a release note for that, but I will review the patch afterwards12:34
jgilaberyes, I just realized that, I'll add it after the meeting12:34
sean-k-mooneywe shoudl have  a release note in the second patch yes12:34
sean-k-mooneylooking at the input parmater schema12:34
sean-k-mooneythe dst_node was intended to be optional12:34
sean-k-mooneyso this is really just fixing that12:34
sean-k-mooneyand reconsiling the implemetion with the schema12:35
sean-k-mooneyalthough12:36
sean-k-mooneydest_pool is also ment to be optional but we are treating that as an error12:36
sean-k-mooneywe can continue this in the gerrit review but if we are going to require the dst_pool we may want to udpate the schema but we might decied to do that in a differnt12:36
sean-k-mooneypatch12:36
dviroelsean-k-mooney: ack, thanks for raising this, we can continue in the review yes12:37
sean-k-mooneyim inclined to split the fix into two patches one for the compute part and one for  the storage part12:37
jgilaberthat one is more complicated and I'm not sure that what I implemented is the best approach, but yes, let's discuss it in the patch12:37
jgilaberthat would be fair12:38
dviroeltks jgilaber for working on these12:38
jgilabernp! thanks for the discussion12:38
dviroelwe have 2 more in the list12:38
dviroel5. add tests for host_maintenance strategy with backup node12:39
dviroel#link https://review.opendev.org/c/openstack/watcher-tempest-plugin/+/94794412:39
dviroelfrom chandankumar12:39
dviroelok, adding tests,  i will review afterwards..12:39
chandankumarthis cr adds tempest tests for host maintenance strategy with backnode. we have recently fixed the host maintenance strategy with backup node, it will extend the coverage.12:40
dviroelchandankumar: ack, tks12:40
dviroeland12:40
dviroel6. use get_host_for_server to get server host12:40
dviroel#link https://review.opendev.org/c/openstack/watcher-tempest-plugin/+/94955712:40
chandankumarwe had a nice discussion on this cr related to getting host name of compute server. the second cr is a follow of that12:41
dviroelright, i remember that12:41
sean-k-mooneyi think it would be ok to proceed with this12:41
chandankumartempest scenario manager provides get_host_for_server method https://github.com/openstack/tempest/blob/master/tempest/scenario/manager.py#L1347 that I will using it in all scenario12:42
sean-k-mooneyalthough i see althoguh we apprently need a promoation for the operator job to pass12:42
sean-k-mooneybased on https://review.opendev.org/c/openstack/watcher-tempest-plugin/+/947944/comments/cf2d8a7a_45ef8a9912:42
chandankumaryes we need a promotion for operator job to pass which is blocked on different reason12:42
sean-k-mooneyso we may want ot alter how this works by default12:43
sean-k-mooneywe might want the master job to alwasy use master watcher form opendev12:43
sean-k-mooneyand have the content provider build those contianer and avoid usign the rdo content12:44
sean-k-mooneywe can discuss that seperatly12:44
sean-k-mooneybut that would eb closer to how we test with devstack12:44
chandankumarsean-k-mooney: that's a nice suggestion to build watcher from source always. I will add it to my backlog.12:44
dviroelgreat, tks chandankumar  - lets continue this discussion afterwards then12:45
dviroelthats all for review in the etherpad for today12:45
opendevreviewMerged openstack/watcher master: Set keystone_client default interface to public  https://review.opendev.org/c/openstack/watcher/+/94832212:45
dviroel#topic bug triage12:45
dviroelhttps://bugs.launchpad.net/watcher/+bug/2108994 (apscheduler retrieving decimal.Decimal via sqlalchemy)12:46
dviroel#undo12:46
opendevmeetRemoving item from minutes: #link https://bugs.launchpad.net/watcher/+bug/210899412:46
dviroel#link https://bugs.launchpad.net/watcher/+bug/2108994 (apscheduler retrieving decimal.Decimal via sqlalchemy)12:46
dviroelthis is a new one12:47
sean-k-mooneyhum12:49
sean-k-mooneythis feels like we are again not usign the correct types12:50
sean-k-mooneyso12:51
sean-k-mooneyits reported again 2023.212:51
sean-k-mooneyagainst12:51
sean-k-mooneywhich is eol12:51
sean-k-mooneyand its missing some of the squlight backports i thik12:52
dviroelhum good point12:52
sean-k-mooneyif this can be replicated on master we coudl fix it but if not then i think we would close eol12:52
dviroelright12:53
sean-k-mooneyi think this is yet another place where we shoudl not be using decimal12:53
sean-k-mooneyi wonder if the colume is declard as numeric, int float or a timestampe of some type12:53
jgilaberI looked in a deployment I have active and the next_run_time column is created as a double12:54
dviroeljgilaber: hey, if you have some time, can you take a quick look in this bug? 12:54
sean-k-mooneyif we are usign decimal anywhere in watcher that is also proably a code smell for a potential bug12:54
jgilaberI assume that is where the problem is coming from the next_run_time column in the apscheduler_jobs table12:55
jgilaberI can try to look into it a bit later today12:55
dviroelack, tks jgilaber - please add your findings to the bug12:56
dviroeli will add a comment on the bug to reference this meeting logs12:57
dviroellets cover one more12:57
dviroel#link https://bugs.launchpad.net/watcher/+bug/2110895 - Drop post/patch/delete undocumented rest api call from watcher action12:57
dviroelchandankumar: o/12:57
chandankumarI was reviewing watcher apirefs doc and here is my observations: https://etherpad.opendev.org/p/watcher-apiref-audit based on comparison with watcher rest api, python-watcherclient and api refs docs.12:57
dviroelon nice12:58
sean-k-mooneyyes so whewn i did a quick code review i did not check tf this also apples to any other endpoint12:59
chandankumarthanks to sean-k-mooney analysis , We have few undocumented rest api which is not implemented12:59
dviroeli need some time to go over everything that you have there12:59
sean-k-mooneyi would suggest checkign if we ahve an other formiding api actions and remvoe them also12:59
chandankumarapart from that, we have very little docs around watcher cli13:00
chandankumarsean-k-mooney: sure13:00
dviroelchandankumar: which is the next bug in the list?13:00
chandankumaryes correct13:00
dviroel#link https://bugs.launchpad.net/watcher/+bug/2110897 - Add more docs around openstack optimize audit command in doc13:00
sean-k-mooneythe cli docs are generally auto generated form the help text13:00
chandankumaraudit command is commonly used, openstack optimize audit provides a way to update/cancel an audit13:01
chandankumarbut there is no reference in the docs. 13:01
chandankumarsean-k-mooney: It means Do we need to add examples in Cli docs? or more text there?13:01
sean-k-mooneyit depend 13:02
sean-k-mooneywe doen generally add exampel of command output13:02
sean-k-mooneyif we look at server create as an exmaple https://docs.openstack.org/python-openstackclient/latest/cli/command-objects/server.html#server-create13:03
chandankumarJust added it in the doc13:03
chandankumarEdit: just added command output in the bug13:03
sean-k-mooneywell im not really sure we need more docs13:03
sean-k-mooneyso the problem is https://docs.openstack.org/python-watcherclient/latest/cli/openstack_cli.html13:04
sean-k-mooneyshoudl be autogenerate based on the help text 13:04
sean-k-mooneybut currently its not being auto generated13:04
sean-k-mooneyso the way to fix that is to make the doc not be static13:05
sean-k-mooneyso we shoudl be replacing https://github.com/openstack/python-watcherclient/blob/master/doc/source/cli/openstack_cli.rst?plain=113:05
chandankumarah ok, let open a new bug to generate the cli docs automatically.13:06
sean-k-mooneywith autogenerate content we can likely look at other plugins for a reference on how to do that13:06
dviroelright13:06
sean-k-mooneyfor example barbican or manilla proably have examples of that13:06
dviroellets revisit this topic again next meeting chandankumar? if you could take a look on this debt13:07
chandankumardviroel: sure13:07
dviroelchandankumar: tks13:07
chandankumarI will bring it in next meeting, thank you dviroel sean-k-mooney !13:07
dviroel#topic next meeting chair13:07
dviroelif you want to be the chair next week13:08
dviroelplease add your name13:08
chandankumarI will chair for the next meeting.13:08
dviroeltks chandankumar 13:08
dviroelthat's it13:08
dviroellet's wrap up for today13:08
dviroelwe will meet again next week13:08
dviroelthank you all for participating13:08
dviroel#endmeeting13:08
opendevmeetMeeting ended Thu May 15 13:08:47 2025 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)13:08
opendevmeetMinutes:        https://meetings.opendev.org/meetings/watcher/2025/watcher.2025-05-15-12.01.html13:08
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/watcher/2025/watcher.2025-05-15-12.01.txt13:08
opendevmeetLog:            https://meetings.opendev.org/meetings/watcher/2025/watcher.2025-05-15-12.01.log.html13:08
opendevreviewJoan Gilabert proposed openstack/watcher master: Handle missing dst parameters in zone_migration  https://review.opendev.org/c/openstack/watcher/+/94886613:09

Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!