| *** suzhengwei has joined #openstack-masakari | 00:42 | |
| *** bhagyashris_ has joined #openstack-masakari | 01:01 | |
| *** bhagyashris has quit IRC | 01:09 | |
| *** suzhengwei_ has joined #openstack-masakari | 02:48 | |
| *** suzhengwei has quit IRC | 02:53 | |
| *** suzhengwei_ has quit IRC | 04:20 | |
| *** opendevreview has quit IRC | 04:26 | |
| *** suzhengwei_ has joined #openstack-masakari | 05:35 | |
| yoctozepto | #startmeeting masakari | 06:01 |
|---|---|---|
| opendevmeet | Meeting started Tue Jun 8 06:01:06 2021 UTC and is due to finish in 60 minutes. The chair is yoctozepto. Information about MeetBot at http://wiki.debian.org/MeetBot. | 06:01 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 06:01 |
| opendevmeet | The meeting name has been set to 'masakari' | 06:01 |
| yoctozepto | #topic Roll-call | 06:01 |
| yoctozepto | \o/ | 06:01 |
| suzhengwei_ | o | 06:02 |
| yoctozepto | hi suzhengwei_ | 06:02 |
| suzhengwei_ | yoctozepto: hi | 06:03 |
| *** XinxinShen has joined #openstack-masakari | 06:03 | |
| yoctozepto | ok, let's start | 06:06 |
| yoctozepto | #topic Agenda | 06:06 |
| yoctozepto | * Roll-call | 06:07 |
| yoctozepto | * Agenda | 06:07 |
| yoctozepto | * Announcements | 06:07 |
| yoctozepto | * Review action items from the last meeting | 06:07 |
| yoctozepto | * CI status | 06:07 |
| yoctozepto | * Backports pending reviews | 06:07 |
| yoctozepto | * Xena planning -> https://etherpad.opendev.org/p/masakari-xena-ptg | 06:07 |
| yoctozepto | * Open discussion | 06:07 |
| *** bhagyashris_ is now known as bhagyashris | 06:08 | |
| yoctozepto | #topic Announcements | 06:08 |
| yoctozepto | no major announcements | 06:08 |
| yoctozepto | but I have fixed the devstack functional tests job in masakari | 06:09 |
| yoctozepto | and added it to the periodic pipeline | 06:09 |
| yoctozepto | so we can observe its daily results | 06:09 |
| yoctozepto | the breakage was due to devstack switching to ovn | 06:10 |
| yoctozepto | we had a bunch of overrides but they turned out to be incompatible | 06:10 |
| yoctozepto | so I restored more defaults | 06:11 |
| yoctozepto | #topic Review action items from the last meeting | 06:12 |
| yoctozepto | there were none | 06:12 |
| yoctozepto | #topic CI status | 06:12 |
| yoctozepto | really green now | 06:12 |
| yoctozepto | #topic Backports pending reviews | 06:13 |
| yoctozepto | none | 06:14 |
| yoctozepto | #topic Xena planning -> https://etherpad.opendev.org/p/masakari-xena-ptg | 06:14 |
| jopdorp | Morning | 06:16 |
| yoctozepto | hi jopdorp | 06:16 |
| yoctozepto | anyone has anything to report/discuss on Xena progress | 06:16 |
| yoctozepto | I admit to not having much time to focus on these | 06:16 |
| jopdorp | Nothing from me for now | 06:17 |
| suzhengwei_ | I want to talk about one spec. https://review.opendev.org/c/openstack/masakari-specs/+/734017 | 06:18 |
| yoctozepto | ok | 06:18 |
| suzhengwei_ | It pass the Zuul check in October 2020. But now it failed. There is no changes. | 06:20 |
| yoctozepto | ah, you mean the job failure | 06:20 |
| yoctozepto | ah yes, I read the details from it and copied them as a comment | 06:20 |
| yoctozepto | yeah, the error is not clear about the reason for unreadability | 06:21 |
| yoctozepto | I guess one needs to download the patchset locally and debug | 06:21 |
| yoctozepto | give me a moment | 06:22 |
| yoctozepto | the error is the same locally | 06:25 |
| *** opendevreview has joined #openstack-masakari | 06:29 | |
| opendevreview | Radosław Piliszek proposed openstack/masakari-specs master: host monitor by consul https://review.opendev.org/c/openstack/masakari-specs/+/734017 | 06:29 |
| yoctozepto | fixed it | 06:30 |
| yoctozepto | suzhengwei_: ^ | 06:30 |
| suzhengwei_ | oh. thanks | 06:31 |
| yoctozepto | you are welcome | 06:31 |
| jopdorp | Great | 06:32 |
| yoctozepto | #topic Open discussion | 06:33 |
| suzhengwei_ | last meeting we talk about how to reduce host failover time. | 06:34 |
| yoctozepto | yes | 06:34 |
| suzhengwei_ | We haven't reached an agreement. | 06:35 |
| yoctozepto | looking | 06:38 |
| yoctozepto | I thought we had | 06:38 |
| suzhengwei_ | We agree to evacuate instances after nova-compute down. | 06:38 |
| suzhengwei_ | We disagree with whether to wait for nova-compute disabled. | 06:39 |
| yoctozepto | yes - we either (1) wait for it to be down or (2) force it down | 06:39 |
| yoctozepto | we disable nova-compute when we know it is down | 06:39 |
| yoctozepto | and don't wait any longer | 06:39 |
| yoctozepto | that was my thinking | 06:40 |
| yoctozepto | the 1/2 could be configurable because we don't know about fencing | 06:40 |
| yoctozepto | the default would be 1 to keep the current/safe one | 06:40 |
| yoctozepto | the disabling is masakari's extra feature that we ensure for the user | 06:43 |
| yoctozepto | we should not wait on that | 06:43 |
| yoctozepto | the current behaviour is a bug | 06:43 |
| yoctozepto | I hope I am clear now | 06:43 |
| suzhengwei_ | yep. We can add our thought on the etherpad. | 06:46 |
| yoctozepto | ok | 06:48 |
| suzhengwei_ | I hit the bug agian in my env today. https://bugs.launchpad.net/masakari-monitors/+bug/1930361. | 06:49 |
| opendevmeet | Launchpad bug 1930361 in masakari-monitors "hostmonitor hangs after notifications send failed" [Critical,In progress] - Assigned to suzhengwei (sue.sam) | 06:49 |
| suzhengwei_ | ku | 06:50 |
| yoctozepto | I've done a writeup on https://etherpad.opendev.org/p/masakari-xena-ptg as you asked | 06:54 |
| yoctozepto | L261 and below | 06:55 |
| yoctozepto | please comment/amend as you see fit | 06:55 |
| yoctozepto | regarding bug #1930361 | 06:55 |
| opendevmeet | bug 1930361 in masakari-monitors "hostmonitor hangs after notifications send failed" [Critical,In progress] https://launchpad.net/bugs/1930361 - Assigned to suzhengwei (sue.sam) | 06:55 |
| yoctozepto | I am curious - what is the error being reported? | 06:55 |
| yoctozepto | perhaps we should guard against that specific one instead of all possible? | 06:56 |
| yoctozepto | that said, I know we have a solution in https://review.opendev.org/c/openstack/masakari-monitors/+/794162 | 06:56 |
| suzhengwei_ | It is easily to produce. While keystone or masakari-api out of service, trigger one host failure. | 06:57 |
| yoctozepto | and it just needs unit tests to be adapted | 06:57 |
| yoctozepto | ah, it fails on contacting the api | 06:58 |
| yoctozepto | ok | 06:58 |
| yoctozepto | added to the bug report | 06:58 |
| yoctozepto | I hope to get some time to play more with this this week | 06:59 |
| yoctozepto | meanwhile, thank you for the meeting | 06:59 |
| yoctozepto | I must switch to another one | 06:59 |
| yoctozepto | #endmeeting | 06:59 |
| opendevmeet | Meeting ended Tue Jun 8 06:59:54 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 06:59 |
| opendevmeet | Minutes: http://eavesdrop.openstack.org/meetings/masakari/2021/masakari.2021-06-08-06.01.html | 06:59 |
| opendevmeet | Minutes (text): http://eavesdrop.openstack.org/meetings/masakari/2021/masakari.2021-06-08-06.01.txt | 06:59 |
| opendevmeet | Log: http://eavesdrop.openstack.org/meetings/masakari/2021/masakari.2021-06-08-06.01.log.html | 06:59 |
| *** XinxinShen has quit IRC | 07:06 | |
| *** suzhengwei__ has joined #openstack-masakari | 09:10 | |
| *** suzhengwei_ has quit IRC | 09:17 | |
| *** suzhengwei__ has quit IRC | 13:00 | |
| *** suzhengwei__ has joined #openstack-masakari | 15:53 | |
| *** suzhengwei__ has quit IRC | 16:03 | |
| *** suzhengwei__ has joined #openstack-masakari | 18:55 | |
| *** suzhengwei__ has quit IRC | 19:05 | |
| *** suzhengwei__ has joined #openstack-masakari | 21:58 | |
| *** suzhengwei__ has quit IRC | 22:17 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!