Wednesday, 2024-10-23

marioso/06:38
mariossean-k-mooney: o/ hello did you already start working on the prometheus spec? i am catching up on yesterdays notes and would like to help if i can? i am looking at the formal datasource interface you linked as well as the grafana example. if you're already working there no worries, not sure how we could split that but i am mentioning it as you asked yesterday if someone wanted to join 08:08
mariosi can help with reviews in any case ;)08:09
sean-k-mooneyi have not but normally i do that on an etherpad09:49
sean-k-mooneyi got as far as finding thoses referencee but did not have time to fully read them mysef beyond skiming them09:50
sean-k-mooneymarios: if you have time to work on this im happy to review instead09:50
sean-k-mooneyim trying to do 3 things this week. work on pre-commit, review the open reviews and set up a 3 node devstack cluseter with watcher09:52
mariossean-k-mooney: ok I will dig there and see what i can do 10:05
sean-k-mooneyfirst thing we need to do is simeiple we need to copy the most recent spec template and create the relevent folder for specs for this cycle10:06
sean-k-mooneyi can do that if you like or i can leave it to you. that a pretty non contoverial change10:07
mariosack we could just create that with the review when we are ready anyway 10:07
sean-k-mooneywe coudl yes10:07
sean-k-mooneymarios: kopecmartin i created a review dashboard for watcher based on my nova one in case its of use to ye11:24
sean-k-mooneyhttps://review.opendev.org/dashboard/?foreach=%28+project%3Aopenstack%2Fwatcher+OR%0Aproject%3Aopenstack%2Fpython-watcherclient+OR%0Aproject%3Aopenstack%2Fwatcher-specs+%29%0Astatus%3Aopen%0ANOT+owner%3Aself%0ANOT+label%3AWorkflow%3C%3D-1%0Alabel%3AVerified%3E%3D1%2Czuul%0ANOT+reviewedby%3Aself%0Abranch%3Amaster&title=Watcher+Review+Inbox&Small+patches=%28project%3Aopenstac11:24
sean-k-mooneyk%2Fwatcher+OR+project%3Aopenstack%2Fpython-watcherclient%29+NOT+label%3ACode-Review%3E%3D2%2Cself+NOT+label%3ACode-Review%3C%3D-1%2Cwatcher-core+NOT+message%3A%22DNM%22+delta%3A%3C%3D10&Needs+final+%2B2=%28project%3Aopenstack%2Fwatcher+OR+project%3Aopenstack%2Fpython-watcherclient%29+NOT+label%3ACode-Review%3E%3D2%2Cself+label%3ACode-Review%3E%3D2+limit%3A50&Bug+fix%2C+Pas11:24
sean-k-mooneysed+Zuul%2C+No+Negative+Feedback=NOT+label%3ACode-Review%3E%3D2%2Cself+NOT+label%3ACode-Review%3C%3D-1%2Cwatcher-core+message%3A%22bug%3A+%22+limit%3A50&Wayward+Changes+%28Changes+with+no+code+review+in+the+last+two+days%29=NOT+label%3ACode-Review%3C%3D-1+NOT+label%3ACode-Review%3E%3D1+age%3A2d+limit%3A50&Needs+feedback+%28Changes+older+than+5+days+that+have+not+been+review11:24
sean-k-mooneyed+by+anyone%29=NOT+label%3ACode-Review%3C%3D-1+NOT+label%3ACode-Review%3E%3D1+age%3A5d+limit%3A50&Passed+Zuul%2C+No+Negative+Feedback=NOT+label%3ACode-Review%3E%3D2+NOT+label%3ACode-Review%3C%3D-1+limit%3A50&Needs+revisit+%28You+were+a+reviewer+but+haven%27t+voted+in+the+current+revision%29=reviewer%3Aself+limit%3A50&Specs=project%3Aopenstack%2Fwatcher-specs+status%3Aopen+11:24
sean-k-mooneylimit%3A2011:24
sean-k-mooneyill put that soemwere else since that is not really usable11:24
sean-k-mooneyhttps://tinyurl.com/2rfm4f8a11:25
mariosthanks sean-k-mooney 11:53
mariosme trying to add enable watcher on my devstack box (just single node with https://docs.openstack.org/watcher/latest/contributor/devstack.html#gnocchi i.e. ceilo/gnocchi 11:55
sean-k-mooneymarios: there is a sample local.conf in tree11:57
sean-k-mooneytwo technially https://github.com/openstack/watcher/blob/master/devstack/local.conf.controller and https://github.com/openstack/watcher/blob/master/devstack/local.conf.compute11:57
sean-k-mooneyi have not used them yet but hope to later today11:57
mariossean-k-mooney: so there are two but they are for example compute and controller i think multi host setup 11:58
sean-k-mooneywatcher does not run on the comptue11:58
sean-k-mooneyits only on the contoler11:58
sean-k-mooneyi think you just need https://github.com/openstack/watcher/blob/master/devstack/local.conf.controller#L28-L3511:59
mariosthere was some required config on the compute in the devestup notes 11:59
sean-k-mooneyalso the current example is wrong in that ceilometer-api has been remvoed i bleive11:59
mariosand rerunning stack on the computes... which i thought explains the presence of those two local.conf one for cntrol one for compute12:00
sean-k-mooneythats for nova and ceilometer12:00
mariossure12:00
sean-k-mooneyso nova need to have notificaiton enabled and ceilometer need to have the ceilometer-compute data collector12:00
mariosthe example has that set for nova 12:01
sean-k-mooneyyep12:01
mariosi mean: [[post-config|$NOVA_CONF]]12:01
marios[DEFAULT]12:01
marioscompute_monitors=cpu.virt_driver12:01
sean-k-mooneyso there are no watcher compoent on the computes12:01
mariossure 12:02
mariosbut still ther are two separate local.conf for devstack 12:02
sean-k-mooneyyep but you could do it all in one12:02
sean-k-mooneythe onley reason multinode make more sense12:02
mariosi am trying with just that config for now will see how it goes 12:02
sean-k-mooneyis almost all the watcher fucntionatly expect multiple nodes12:02
mariosi mean the example given in https://docs.openstack.org/watcher/latest/contributor/devstack.html#gnocchi12:02
marioswould be nice to enable prometheus in local.conf ;)12:03
sean-k-mooneyok that is proably a more uptodate example12:03
sean-k-mooneywith that said the gnocci dep is somethign we will be activly swapping out so we shoudl proably include a prometus example in teh watcher repo as part of that work12:04
sean-k-mooneymarios: untill we add that supprot to devstack you have 2 options12:04
sean-k-mooneythe local.conf is actully source so you can litrally add `sudo apt get install prometheus -y` or you can create a local.sh beside the local.conf and put the install there12:05
sean-k-mooneywhat we actully will want to do in devstack is supprot installing all the prometheus compoents on the contoler and just the node-exporer on the computes12:06
sean-k-mooneythe compute can use SERVICE_HOST as the prometious host or we can added a dedicated one when we do the devstack change12:07
sean-k-mooneymarios: just one comment on the doc, nova has never required shared storage for live migration.12:10
sean-k-mooneyif watcher does then thats a bug and we shoudl fix that but we can verify that later.12:11
marios++/opt/stack/watcher-dashboard/devstack/plugin.sh:init_watcher_dashboard:16  python3 /opt/stack/hori12:11
mariosModuleNotFoundError: No module named 'django'12:11
sean-k-mooneythis is proably related to the golbal virtual env12:12
sean-k-mooneymy guess is the watcher-dashbaord devstack plugin does not supprot that properly12:12
*** rlandy_ is now known as rlandy12:37
gmanndansmith: to fix the grenade job, we need to merge this stable/2024.2 first https://review.opendev.org/c/openstack/watcher/+/93306218:27
dansmithgot it.. maybe we should wait for chenker to see it tonight, and if not, perhaps just ninja it in since it's just trivial infra?18:30
dansmithI certainly don't want to start flooding stuff in without earlier cores being okay with things18:30
gmanndansmith: ack18:31
sean-k-mooneyi have not directly checked the patch yet but i can confirm with master watcher-db-manage is not aviabel outside the venv https://paste.opendev.org/show/b65Y9sFKEs5UehRRGMQp/18:31
sean-k-mooneyso that alines with creatign the symlink and the WATCHER_BIN_DIR prefix18:32
sean-k-mooneyit also fixes the job but form my point of view this si a nice targeted fix18:33
sean-k-mooneywith that said espicly ptg week we are not in a rush to merge this today18:33
sean-k-mooneyso lets see if chenker has any concerns18:33
gmannyeah, grenade job passing with this can be seen in this change https://review.opendev.org/c/openstack/watcher/+/932963/518:33
gmannor I think I can make depens-on of stable/2024.1 on master change itself so that we do not need to recheck it again and it will be clear to know passing result18:34
opendevreviewGhanshyam proposed openstack/watcher master: Run watcher-db-manage in grenade testing from venv  https://review.opendev.org/c/openstack/watcher/+/93304618:34
gmannwe should be able to see grenade job green in this only ^^18:35
sean-k-mooneyah i see yo dropped the other depends on18:35
sean-k-mooneyoh rahter you added it to the master version18:35
sean-k-mooneyya that will show it but you already demonstrated that here too https://review.opendev.org/c/openstack/watcher/+/932963/518:36
sean-k-mooneyif we add `Depends-On: https://review.opendev.org/c/openstack/watcher/+/933062` to mater patches then the job passes18:36
gmannI will keep 932963 as separate because that will wait to merge until we are migrating CI to Noble and in case people want to see grenade passing on master on same change of GLOBAL_VENV change18:45
sean-k-mooneywe likely need a simier change for the watcher-dashboard plugin19:22
sean-k-mooneyim currently deploying iwthout that 19:22
sean-k-mooneyhttps://github.com/openstack/watcher-dashboard/blob/master/devstack/plugin.sh does not seam to have any change for the global venv19:24
sean-k-mooneymarios django issue https://github.com/openstack/watcher-dashboard/blob/master/devstack/plugin.sh#L16 ithink s jsut because it snot using the vnenv19:26
sean-k-mooneythe horrizon plugin is less of a prioarity in the shrot term but something we should eventually look into19:27
sean-k-mooneyoctivai is using $PYTHON https://github.com/openstack/octavia-dashboard/blob/master/devstack/plugin.sh#L11 as is heat19:31
sean-k-mooneydevstack exports that properly into the env here https://github.com/openstack/devstack/blob/a1376e6f8cbc08cb7e0d37bdb8cfdeb8c5585e41/inc/python#L49-L5219:34

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!