15:30:57 #startmeeting Performance Team 15:30:58 Meeting started Tue Dec 13 15:30:57 2016 UTC and is due to finish in 60 minutes. The chair is DinaBelova. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:30:59 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 15:31:01 The meeting name has been set to 'performance_team' 15:31:10 hey folks o/ 15:31:24 o/ 15:31:27 hi 15:31:31 o/ 15:31:50 let's wait for a couple of moments 15:32:00 and see if someone else is gonna join 15:32:52 ok, so let's get started 15:33:00 today we have no action items to cover 15:33:09 so we may jump to the tests section 15:33:14 #topic Current progress on the planned tests 15:33:21 msimonin the floor is yours :) 15:33:50 ok 15:33:52 :) 15:34:07 So we are progressing on multisite deployment 15:34:14 multiregion I mean 15:34:51 how many regions are you planning to have now? 15:35:06 we now have a first version of the deployment script that allows multiregion deployment and latencies enforcement 15:35:18 it's still under discussion 15:35:24 ack :) 15:35:38 basically we will evaluate different scenario of distribution of openstack services 15:35:56 multiregion is one scenario possible since it's supported by Openstack by default 15:36:47 another example would be to put every control services somewhere and compute far from them 15:36:59 far in term of latencies and bandwidth 15:37:15 yeah, it looks interesting - I think you can try to use shaker to evaluate this 15:37:21 Sure ! 15:37:25 :) 15:37:35 By the way I answered to Ilya in the ml 15:37:49 ack - personally I did not take a look 15:37:56 I need to check it 15:37:57 thanks 15:38:03 What is preferable, answering in the ml or answering in gerrit ? 15:38:14 gerrit is ok :) 15:38:24 and less official :D 15:38:29 even for prospective discussion ? 15:38:40 ah ok :) 15:38:52 well, in fact you can try whatever variant is ok for you :) 15:39:23 ok, anything else to share? 15:39:30 By the way I've uploaded the whitepaper to hal.inria.fr 15:39:44 The link should be ok 15:39:48 Let me check 15:40:02 #link https://hal.inria.fr/hal-01415522 15:40:12 ack, I see it 15:40:14 thanks 15:40:23 cool 15:41:00 This doesn't include multisite consideration yet 15:41:16 sure, you just started :) 15:41:24 o/ 15:41:27 spn o/ 15:42:12 msimonin anything else sir? 15:42:24 I think that's all 15:42:27 I have 15:42:30 ack, thank you 15:42:35 ok, from Mirantis side we're still collecting issues we observed so far in one place 15:43:00 are these issues posted somewhere ? 15:43:14 and proceeding with workloads testing - so the basic idea is to have bunches of VMs (slices) having different apps installed on each one 15:43:22 like magento, wordpress, etc 15:43:36 and run these apps specific traffic aganst those VMs 15:43:57 and see through monitoring how the overall health of the cloud looks like 15:44:10 on all layers - system, k8s, OpenStack 15:44:21 right now env deployment is in progress :) 15:44:49 I guess in December we should have several results to share 15:45:09 and published to performance docs 15:45:16 I'll keep you folks updated on this 15:45:30 for now that's all from my side 15:45:40 spn not yet sir 15:45:45 as we're collecting them so far 15:45:48 I think I forgot, what is your monitoring stack ? 15:45:54 prometheus + ? 15:46:03 msimonin prometheus + collectd + telegraf 15:46:17 and grafana for visualization 15:46:20 DinaBelova: ack 15:46:23 thanks 15:46:34 sure 15:47:02 do we have akrzos here? 15:47:26 any news sir regarding the tests / experiments running in Red Hat? :) 15:47:26 Hello 15:47:28 I'm here 15:47:48 I have hardware to run Telemetry Scale with Ceph now 15:47:53 yay! :) 15:48:00 so I have begun some experiements with it 15:48:24 #info akrzos has started experiments with new HW for Telemetry Scale with Ceph 15:48:26 I beleive I'll be able to share results in the performance-docs repo when I complete it 15:48:36 akrzos thanks, good to know 15:48:44 I guess LDT folks will be really happy :) 15:48:55 dinabelova just wondering what is is your backend for grafana? 15:49:28 spn need to check, don't know for sure :) that part was done by one of my teammates, will double check 15:49:54 #action DinaBelova check what grafana backend is Mirantis using 15:49:55 I thought you guys had influx and promotheus 15:50:18 oh, spn did you mean where do we collect data? 15:50:26 yeah, akrzos is right 15:50:36 or the actuall database that grafana uses I beleive is sqlite 15:50:46 ya like graphite-whisper, influx innodb etc 15:50:47 (stores dashboards, snapshots) 15:51:22 spn, yeah that should be influx with prometheus-specific data 15:51:35 I had problems with whisper not retaining more than a year worth of data 15:51:44 dinabelova that sounds good 15:51:45 spn: I'm using a carbon/graphite/whispher with collectd (collection) 15:52:28 akrzos me too same but grafana does not shown if the data is too old and is on whisper 15:52:52 interesting, akrzos do you observe the same? 15:52:56 spn: perhaps your storage schema expires after ~180 days? 15:53:13 ex storage schema - https://github.com/openstack/browbeat/blob/master/ansible/install/roles/graphite/files/storage-schemas.conf#L16 15:53:24 1 hour for 180days 15:53:26 akrzos thanks I will look at that 15:53:49 can that retention be like forever? 15:54:12 you'll have to whispher re-size to get your metrics to stick around longer if you want to keep what you already have and create a "larger" schema 15:54:25 spn: so whispher allocates upfront 15:54:42 so you can't really configure "forever" 15:55:03 we have been debating switching out of grpahite because of this similiarlly 15:55:42 i can discuss our reasoning why but don't want to take over the meeting! 15:55:55 akrzos I agree 15:56:01 ack :) thank you folks 15:56:18 it looks like we may smoothly go to the next item 15:56:25 #topic New core position in OSprofiler 15:56:37 this might be interesting for tovin07__ 15:56:38 :) 15:56:49 we have new core position in OSprofiler 15:56:50 oh 15:56:56 congratulations vbala :) 15:57:09 so tovin07__ - more reviews are going to come :) 15:57:10 thanks :) 15:57:18 congratulations vipin 15:57:30 DinaBelova: yes 15:57:31 vbala has been really active in osprofiler in last several months 15:57:41 #link http://stackalytics.com/?user_id=vbala&module=osprofiler&metric=marks 15:57:42 thanks tovin07__ 15:57:50 #link http://stackalytics.com/?user_id=vbala&module=osprofiler&metric=commits 15:58:09 so that's good thing to have him having core reviewers rights now 15:58:22 vbala I'll add you to the Gerrit core reviewers group today 15:58:39 ok 15:58:39 #info vbala has become a new core reviewer in OSProfiler 15:59:06 * tovin07__ feel so promising 15:59:11 vbala and from my side - I'm really glad you're joining me :) 15:59:14 tovin07__ ;) 16:00:00 I guess that was a small congratulations topic with no much comments to be added :) 16:00:09 so we may go to open discussion 16:00:16 +1 16:00:17 #topic Open Discussion 16:00:29 any topics for cover olks? 16:00:33 folks*** 16:00:43 msimonin akrzos vbala ? 16:00:57 One small thing 16:01:07 I may have forget to mention I uploaded a json grafana dashboard a week or two ago into grafana.net for any other to use 16:01:09 sure 16:01:20 akrzos link please :) 16:01:25 thats nice 16:01:34 i am living on grafana these days. 16:01:38 DinaBelova: https://grafana.net/dashboards/1021 16:01:46 #link https://grafana.net/dashboards/1021 16:02:01 #info Grafana board used by akrzos ^^ 16:02:18 msimonin what did you want to mention sir? 16:02:19 I just received a mail asking to upload the slides for the Barcelona summit presentation 16:02:31 akrzos can you share the collectd.conf as well ? 16:02:49 You should have received it as well 16:02:56 msimonin interesting :) did not notice it 16:02:57 I can upload the slides 16:03:09 msimonin can you send me please an email topic? 16:03:13 and feel free to upload slides for sure 16:03:19 If it's fine with you and alex 16:03:39 yes, sure, from whom was the email? from OpenStack folks? 16:03:45 DinaBelova: Important Speaker Information for OpenStack Summit in Barcelona, Spain 16:03:53 ack, lemme check 16:04:00 Yeah i got one too 16:04:05 from OpenStack Speaker Support team (do-not-reply@openstack.org) 16:04:11 oh, I see 16:04:17 sure, please upload the lides 16:04:22 slides*** 16:04:27 ok I'll do it 16:04:39 thank you sir :) 16:04:57 yeah, I got this email about 30 minutes ago :) 16:05:00 whn meeting has started 16:05:06 so I did not see it :) 16:05:56 akrzos going back to spn 's question - can you share the collectd.conf you're using? 16:07:11 it looks like akrzos was lost in sending the slides :) 16:07:44 DinaBelova: uploaded ours :) 16:07:52 msimonin ack 16:08:21 sorry back 16:08:24 #action akrzos check if collectd.conf can be shared to complete the monitoring picture (request from spn) 16:08:29 ah :) 16:08:30 it should be attached 16:08:33 to grafana.net 16:08:42 spn ^^ 16:09:01 yes. I just saw it. sorry for the noise 16:09:05 no worries 16:09:12 ok, anything else folks? 16:09:39 it looks like we're done for today 16:09:48 thanks everyone for joining 16:09:53 #endmeeting