Wednesday, 2019-08-14

*** sapd1_x has joined #openstack-self-healing03:15
*** sapd1_x has quit IRC04:08
*** tojuvone has quit IRC04:31
*** tojuvone has joined #openstack-self-healing04:31
*** zhangchi has joined #openstack-self-healing08:47
ricolino/08:51
aspiershi ricolin08:54
*** witek has joined #openstack-self-healing08:57
ricolinaspiers, howdy09:01
aspiershey ricolin :) how are you doing?09:01
aspiersgoing to Shanghai?09:01
aspiersI got my place confirmed09:02
ricolinaspiers, I'm for sure:)09:02
aspierscool09:02
ricolinaspiers, good to have you there09:02
aspiersI can't remember where you live?09:02
ricolinTaiwan/Taipei09:02
aspiersah ok09:03
aspiersa lot closer to Shanghai than I am ;-)09:03
ricolinaspiers, it's next door for me:)09:03
aspiersyep :)09:03
aspiersthat must be a nice change for your OpenStack summits!09:03
aspiersnormally you have a huge trip09:03
ricolinyeah, I think I will do a lot of haha to all the jetlag you guys have:)09:04
aspiershahah09:04
aspiersfor sure!09:04
aspiersXD09:04
aspierslike I do to the Americans when we have it in Europe XD09:04
ricolinaspiers, totally09:05
aspiersanyone else around for a quick self-healing meeting? witek / tojuvone maybe?09:05
ricolinFYI, there's a wired situation for ceilometer metering I think not just for auto-scaling case, might also related to self-healing09:06
ricolinhttp://lists.openstack.org/pipermail/openstack-discuss/2019-August/008216.html09:06
aspierslooking09:06
aspiersit seems like the issue is resolved? https://github.com/gnocchixyz/gnocchi/issues/104409:07
ricolinI been told the real issue is not in gnocchi but aodh, hope that's also not a problem too09:09
* ricolin is searching for the irc log09:10
ricolinaspiers, http://eavesdrop.openstack.org/irclogs/%23heat/%23heat.2019-08-07.log.html#t2019-08-07T07:20:3709:12
witekhi aspiers and ricolin09:12
aspiershi witek!09:12
aspiersdid you guys see https://logs.opendev.org/38/675138/4/check/openstack-tox-docs/344de18/html/testing/tools-list.html ?09:12
ricolinI did not have time to look into for detail here, so maybe not a problem at all09:12
* ricolin was referring the metering stuff09:13
witekaspiers: no, thanks for reference09:15
aspierswitek: https://review.opendev.org/#/c/675138/09:16
aspierswitek: sorry I forgot to add you before09:16
witekadded myself now09:17
ricolinaspiers, what exactly is that table referring? tests each tool can perform?09:19
aspiersnot just tests09:20
aspiersfunctionality09:20
ricolinaspiers, right! functionality! also just leave some comment in line09:25
aspiersthanks09:25
aspiersricolin: yes, looks like you agree with my last comment09:26
ricolingreat works!09:26
ricolind09:26
ricolind'oh!09:26
aspiersI only just posted it a few minutes ago :)09:27
ricolinWILL FASTER THAN YOU NEXT TIME...(murmuring)09:29
aspiershahaha :)09:30
ricolinwitek, do you happen to know about the answer about http://lists.openstack.org/pipermail/openstack-discuss/2019-August/008216.html  :)09:32
witekno, I don't, I just followed the discussion09:37
* ricolin also post this ML in #openstack-auto-scaling09:40
*** tojuvone has quit IRC10:01
*** tojuvone has joined #openstack-self-healing10:01
*** zhangchi has quit IRC10:10
*** ricolin has quit IRC16:29
*** ihti has joined #openstack-self-healing16:32
*** ekcs has joined #openstack-self-healing16:57
*** witek has quit IRC17:15
aspiersoops, lost track of time17:17
aspiershi ekcs17:17
*** ekcs has quit IRC17:18
*** ekcs has joined #openstack-self-healing17:19
aspiershi ekcs17:21
ekcshi aspiers !17:25
ekcshow’s it been?17:25
aspiersbusy :)17:25
aspiersyou?17:26
aspiersI got approved for Shanghai btw17:26
aspiersDid you see https://review.opendev.org/#/c/675138/ ?17:26
aspiersI think we need to resurrect the plan to try and make something happen with testing17:27
ekcsoh very good!17:27
ekcsah yes I skimmed it but havevn’t done a review.17:27
ihtihi17:28
aspiershi ihti17:29
aspiersekcs: ihti is the author of that review17:29
ekcshi ihti !17:29
aspiersihti: ekcs is co-chair of the SIG17:29
ekcsthe patch looks like a very helpful reference.17:30
ihtiaspiers, ah okay17:30
aspiers3 counts as critical mass, so ... :)17:30
aspiers#startmeeting self-healing17:30
openstackMeeting started Wed Aug 14 17:30:35 2019 UTC and is due to finish in 60 minutes.  The chair is aspiers. Information about MeetBot at http://wiki.debian.org/MeetBot.17:30
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.17:30
*** openstack changes topic to " (Meeting topic: self-healing)"17:30
openstackThe meeting name has been set to 'self_healing'17:30
aspiers#topic automated testing17:30
*** openstack changes topic to "automated testing (Meeting topic: self-healing)"17:30
aspiersihti: anything you want to bring up?17:30
aspiersfor the minutes ...17:31
aspiers#link https://review.opendev.org/#/c/675138/ adds a list of testing frameworks to the SIG repo17:31
ihtinot much from my side yet, playing around with Rally on a dev setup17:31
aspierscool17:31
aspiersthe matrix clearly shows an awful lot of overlap17:31
aspiersit occurred to me that we should try to get all the maintainers of the various tools to review that matrix17:32
ihtiyes, it have, rally covering most of the features17:32
aspiersas they may be able to offer extra info17:32
ihtiyes, that would be very helpful with and would make the whole list more accurate17:33
aspiers#link https://logs.opendev.org/38/675138/4/check/openstack-tox-docs/344de18/html/testing/tools-list.html Zuul build of the new doc17:33
aspiersYardstick + Doctor also seems to cover everything17:33
ihti+NFV bench17:34
aspiersihti: Oh I just noticed, Eris is not in there yet17:34
aspiersI guess that's intentional?17:34
ihtiyes17:34
ihtias it will be worked on so i thought not include it yet?17:34
ihtinot sure17:35
aspiersI think it would be better to include it, but add a new column "maturity"17:35
aspierse.g. unfinished/alpha/beta/immature/mature17:35
ihtithat's good idea.17:36
aspiersalso maybe another column for "OpenStack-specific"17:36
aspierssince tools like Jepsen are agnostic17:36
aspiersand there is no column for performance testing, unless that is under "Scalability testing"?17:37
aspiersbut I think they are different things17:37
aspiersso separate columns would be useful17:37
ihti'Openstack-specific' one I added but then removed it afterwards, as I jepsen was the only one falling in that category17:37
aspiersHmm17:37
aspiersOK, so maybe change the Jepsen cell to read "Jepsen (not specific to OpenStack)"17:38
aspiersAnother suggestion: add a separate column for reliability testing17:39
ihtiFor performance I thought it overlaps with 'data plane testing'? I could be off17:39
aspierssince the ability to inject disruptions / failures is separate from the ability to test resilience against them17:39
aspiersI think we need performance testing for control plane operations oto17:39
aspierstoo17:39
ihtiokay I will mention that for jepsen17:40
aspiersso no, I would consider performance testing somewhat separate to data plane17:40
aspierscontrol plane operations can be slow17:40
ihtialright17:40
aspiersespecially things like failover17:40
aspiersSorry, I am just thinking of this new feedback now :)17:41
ihtino worries, I appreciate it :)17:41
aspiersAnother column we need is around the level of community activity17:41
aspiersSome of these tools are dead17:41
aspiersThat is an important datapoint17:41
ihtialright, yes that's true17:41
aspiersOther tools are not dead, but only have a few contributors17:42
ihtinot update for a couple of years17:42
aspiersso a column "size of active community" would help17:42
aspiersbut maybe it's not just size, but also level of activity17:42
aspierse.g. 2 contributors could do total of 500 commits in a month, or 20 contributors could do total of 10 commits in a month ...17:43
aspiersThese are important considerations when designing a full solution17:43
ihtithat makes sense and can be easily gathered by having a look at repos17:45
ekcsyea maybe instead of putting up a static “grade” we can just link to the repo activities page.17:45
aspierswell it's useful to be able to compare them all at a glance17:47
aspiersthat's kind of the point of this matrix17:47
aspiersany cell could change, but that's OK :)17:47
ekcsyea that makes sense too.17:47
ihtiI can add both a link and value17:48
aspiersperfect!17:48
ihtito each sell17:48
ihti*cell17:48
aspiersthat would be great17:48
aspierssorry, so it seems I asked for like 59 new columns :)17:48
ihtiI think its good and makes the decision making process much easier17:49
aspiersyes17:49
aspiersmaybe once you've updated the matrix we can try to contact the communities of the various tools for feedback17:49
aspierssome of them are already cc'd on the review17:50
aspiersbut we'll need to find others probably17:50
aspiersihti, ekcs: OK anything else on this topic?17:50
ihticool17:50
ekcsgreat17:50
ihtino17:50
ihtino topic from my side17:51
aspiersso we can move on, or end the meeting17:51
aspiersekcs: anything to discuss about Shanghai at this point, or anything else?17:51
aspiersihti: thanks a LOT for all your great work so far!17:51
aspiersit's hugely appreciated17:51
ekcsnot really. my focus now is just to find time to complete this task finally: https://storyboard.openstack.org/#!/story/200564117:51
ihtithanks for the reviews and feedback :)17:52
ekcsthank you ihti !17:52
aspiersekcs: oh nice, that would be great!!17:52
aspiersihti: BTW soon we should email openstack-discuss announcing this new doc17:52
aspiersmaybe we can announce after merging17:52
aspiersOK, sounds like we are done for today17:53
ihtiyes, after reviews by the tool devs is done, it would be good idea to spread it out17:53
aspiersyup17:53
aspiersit will help restart the discussion around how to fix this17:53
aspiersihti: don't hesitate to ask me if you have any questions or need support on anything17:54
aspierssee you both online, bye for now! o/17:55
ihtiaspiers, sure i will, thanks very much till now :)17:55
aspiers:)17:55
ekcsbye!17:55
aspiers#endmeeting17:55
*** openstack changes topic to "https://wiki.openstack.org/wiki/Self_healing_SIG | https://storyboard.openstack.org/#!/project/openstack/self-healing-sig"17:55
ihtibye! :)17:55
openstackMeeting ended Wed Aug 14 17:55:31 2019 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)17:55
openstackMinutes:        http://eavesdrop.openstack.org/meetings/self_healing/2019/self_healing.2019-08-14-17.30.html17:55
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/self_healing/2019/self_healing.2019-08-14-17.30.txt17:55
openstackLog:            http://eavesdrop.openstack.org/meetings/self_healing/2019/self_healing.2019-08-14-17.30.log.html17:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!