Thursday, 2019-09-05

*** trident has joined #openstack-monasca00:03
*** bobh has joined #openstack-monasca00:35
*** bobh has quit IRC00:42
*** bobh has joined #openstack-monasca00:45
*** bobh has quit IRC01:00
*** bobh has joined #openstack-monasca01:39
*** bobh has quit IRC01:44
*** bobh has joined #openstack-monasca01:53
*** bobh has quit IRC01:54
*** bobh has joined #openstack-monasca02:09
*** bobh has quit IRC02:43
*** bobh has joined #openstack-monasca02:46
*** bobh has quit IRC02:50
*** openstackgerrit has quit IRC06:51
*** trident has quit IRC07:21
*** ivve has joined #openstack-monasca07:27
*** trident has joined #openstack-monasca07:29
*** trident has quit IRC07:34
*** trident has joined #openstack-monasca07:43
*** dougsz has joined #openstack-monasca08:17
*** witek_ has joined #openstack-monasca08:35
*** mbindlish_ has joined #openstack-monasca08:49
*** trident has quit IRC09:01
*** trident has joined #openstack-monasca09:09
*** openstackgerrit has joined #openstack-monasca09:29
openstackgerritThomas Bechtold proposed openstack/monasca-statsd master: Switch to openstackdocstheme  https://review.opendev.org/67998309:29
brtknrwitek_: what do the 3 zuul failures in this review mean: https://review.opendev.org/#/c/674484/09:31
brtknrlooks like monasca-tempest-python2-influxdb is related to the influxdb client version but the other two seem unrelated to my change09:31
*** witek_ has quit IRC10:09
*** witek has joined #openstack-monasca10:14
*** arseni-lipinski has joined #openstack-monasca10:14
brtknrwitek: dougsz and I also wannted to reach a decision on this change: https://review.opendev.org/#/q/topic:story/2006204+(status:open+OR+status:merged)10:24
brtknrwe have a better understand of why the show tag key/value queries return approximately accurate results10:25
brtknrits because the accuracy is defined by the shard duration10:25
brtknre.g. if a show tag key/value query where time < now()-1h and now()-2h returns the result for the entire day if the shard duration is 1 day10:27
brtknrthis is an improvement over the current situation where the entire database is searched which is inefficient, but this the result is not 100% accurate10:27
dougszbrtknr: The main concern I have is that with the above behaviour, in for example a Grafana dashboard which runs a query to get the hostnames for the current time window, you could end up with hostnames *outside* of the time window, and this could be confusing to users.10:28
dougszIt's a shame we hit this behaviour, because otherwise, I think it would be a very useful improvement.10:29
dougszI suppose to be fair, the existing hostname query in a Grafana dashboard returns hostnames for all time, which is even worse10:30
brtknrthats correct, the correct fix is to do a nested SELECT query but that is comparitively slower10:30
dougszOn a DB where the query across all time takes a few minutes, how long does the SELECT query take?10:32
dougszMaybe it's not as fast as your current implementation, but if it's always better than the existing implementation then that could be a path forwards.10:33
brtknri cant get the result for the SELECT query because it seems to time out10:52
brtknr"SHOW TAG VALUES WITH KEY=hostname" runs in 2 seconds on our p3 project10:53
brtknr'SELECT DISTINCT("hostname") from (SELECT "hostname","value" FROM /.*/)'10:54
brtknrthe second one times out10:54
brtknrmind that the first query is scanning the entire database10:54
brtknri am trying a time bound query now10:58
brtknrthis query which is an hour time window takes 18 seconds: 'SELECT DISTINCT("hostname") from (SELECT * FROM /.*/ WHERE time >= 1564081121495ms AND time < 1564084721497ms GROUP BY *)'11:01
brtknrA 1 day time window times out after 1 minute11:03
brtknron the other hand, the equavalent tag query takes 0.9s:11:04
brtknr"SHOW TAG VALUES WITH KEY=hostname WHERE time >= 1564081121495ms AND time < 1564084721497ms"11:04
brtknrreal    0m0.927s11:04
brtknruser    0m0.014s11:04
brtknrsys     0m0.009s11:04
*** witek has quit IRC12:06
*** coreycb has joined #openstack-monasca12:56
coreycbhi folks is witek still the PTL for monasca? i've not been able to get in touch with him via email.12:57
*** witek has joined #openstack-monasca12:58
coreycbgood timing, witek is monasca-analytics on your radar for the python3-train community goal? the goal deadline is a week from this friday12:58
coreycbhttps://review.opendev.org/#/q/topic:python3-train%20status:open%20(%20label:Verified-1%20OR%20label:Verified-2%20)12:58
*** pcaruana has quit IRC13:10
openstackgerritAdrian Czarnecki proposed openstack/monasca-api master: Exclude influxdb 5.2.3 for python  https://review.opendev.org/68040513:19
openstackgerritBharat Kunwar proposed openstack/monasca-persister master: Exclude influxdb 5.2.3 for python  https://review.opendev.org/68041213:37
openstackgerritBharat Kunwar proposed openstack/monasca-persister master: Implement separate db per tenancy  https://review.opendev.org/67448413:38
openstackgerritBharat Kunwar proposed openstack/monasca-persister master: Tool to migrate existing data to db per tenant  https://review.opendev.org/67979413:38
*** mbindlish_ has quit IRC13:39
*** arseni-lipinski has quit IRC13:39
*** pcaruana has joined #openstack-monasca13:39
openstackgerritBharat Kunwar proposed openstack/monasca-api master: Implement separate db per tenancy  https://review.opendev.org/67447813:40
brtknradriancz: hope you dont mind that I copied your commit to monasca-persister13:41
openstackgerritBharat Kunwar proposed openstack/monasca-persister master: Exclude influxdb 5.2.3 for python  https://review.opendev.org/68041213:43
openstackgerritBharat Kunwar proposed openstack/monasca-persister master: Implement separate db per tenancy  https://review.opendev.org/67448413:43
openstackgerritBharat Kunwar proposed openstack/monasca-persister master: Tool to migrate existing data to db per tenant  https://review.opendev.org/67979413:43
adrianczNo, i don't go ahead  : )13:44
openstackgerritBharat Kunwar proposed openstack/monasca-persister master: Exclude influxdb 5.2.3 for python  https://review.opendev.org/68041213:45
openstackgerritBharat Kunwar proposed openstack/monasca-persister master: Implement separate db per tenancy  https://review.opendev.org/67448413:45
openstackgerritBharat Kunwar proposed openstack/monasca-persister master: Tool to migrate existing data to db per tenant  https://review.opendev.org/67979413:45
adriancz@brtknr thanks for this change, i totally forgot to add this change to persister13:49
brtknradriancz: np :) i was really confused about why the global requirements wasn't having any effect to the CI, didn't realise a local change was also necessary13:49
*** pcaruana has quit IRC14:12
brtknradriancz: any idea why the python2 test still fails? https://review.opendev.org/#/c/680405/14:20
adrianczno idea14:21
adrianczi will check this tomorrow14:24
brtknradriancz: thanks14:27
adrianczdevstack  still install influxdb=5.2.3, https://zuul.opendev.org/t/openstack/build/ea6b33df80ff454e86ec9f26900a3a45/log/job-output.txt#1597214:30
*** piotrowskim has quit IRC14:58
brtknradriancz: hmm15:17
brtknradriancz: https://opendev.org/openstack/requirements/src/branch/master/upper-constraints.txt looks like the generated upper-constraints.txt is incorrect15:31
*** altlogbot_0 has quit IRC16:01
*** irclogbot_2 has quit IRC16:02
*** altlogbot_0 has joined #openstack-monasca16:02
*** irclogbot_2 has joined #openstack-monasca16:04
brtknradriancz: should get fixed when this merges: https://review.opendev.org/#/c/679916/216:06
*** irclogbot_2 has quit IRC16:07
*** irclogbot_1 has joined #openstack-monasca16:08
*** ivve has quit IRC16:19
*** spsurya has quit IRC16:48
*** witek has quit IRC16:54
*** dougsz has quit IRC17:00
*** adriancz has quit IRC17:06
*** trident has quit IRC19:09
*** trident has joined #openstack-monasca19:20
*** joadavis has quit IRC20:37
*** joadavis has joined #openstack-monasca20:46
-openstackstatus- NOTICE: Gerrit is being restarted to pick up configuration changes. Should be quick. Sorry for the interruption.21:14
*** sum12 has quit IRC22:14
*** sum12 has joined #openstack-monasca22:16

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!