Wednesday, 2018-07-04

*** yamamoto has quit IRC00:04
*** rossella_s has quit IRC00:23
*** rossella_s has joined #openstack-meeting-300:23
*** harlowja has joined #openstack-meeting-300:26
*** harlowja has quit IRC00:27
*** rossella_s has quit IRC00:33
*** rossella_s has joined #openstack-meeting-300:35
*** rossella_s has quit IRC00:45
*** rossella_s has joined #openstack-meeting-300:46
*** yamamoto has joined #openstack-meeting-301:00
*** yamamoto has quit IRC01:06
*** hongbin has joined #openstack-meeting-301:27
*** liangbo has joined #openstack-meeting-301:52
*** yamamoto has joined #openstack-meeting-302:02
*** yamamoto has quit IRC02:07
*** psachin has joined #openstack-meeting-302:41
*** jamesmcarthur has joined #openstack-meeting-302:47
*** jamesmcarthur has quit IRC02:51
*** yamamoto has joined #openstack-meeting-303:04
*** yamamoto has quit IRC03:09
*** lpetrut has joined #openstack-meeting-303:46
*** liangbo has quit IRC03:53
*** gcb has quit IRC03:53
*** hongbin has quit IRC03:55
*** chyka has joined #openstack-meeting-303:59
*** iyamahat has joined #openstack-meeting-304:03
*** chyka has quit IRC04:04
*** yamamoto has joined #openstack-meeting-304:05
*** yamamoto has quit IRC04:13
*** yamahata has joined #openstack-meeting-304:14
*** yamamoto has joined #openstack-meeting-304:18
*** lpetrut has quit IRC04:28
*** alex_xu has quit IRC04:49
*** pgadiya has joined #openstack-meeting-304:57
*** pgadiya has quit IRC04:57
*** alex_xu has joined #openstack-meeting-304:57
*** jamesmcarthur has joined #openstack-meeting-305:04
*** cshastri has joined #openstack-meeting-305:05
*** jamesmcarthur has quit IRC05:08
*** alex_xu has quit IRC05:13
*** alex_xu has joined #openstack-meeting-305:15
*** e0ne has joined #openstack-meeting-305:42
*** e0ne has quit IRC05:53
*** liangbo has joined #openstack-meeting-305:54
*** iyamahat has quit IRC06:05
*** Luzi has joined #openstack-meeting-306:18
*** iyamahat has joined #openstack-meeting-306:19
*** lpetrut has joined #openstack-meeting-306:22
*** iyamahat has quit IRC06:35
*** wanghao_ has joined #openstack-meeting-306:41
*** wanghao has quit IRC06:43
*** rmart04 has joined #openstack-meeting-306:59
*** e0ne has joined #openstack-meeting-307:20
*** ianychoi has quit IRC07:20
*** tssurya has joined #openstack-meeting-307:36
*** alexchadin has joined #openstack-meeting-307:53
*** alexchadin has quit IRC07:56
*** diablo_rojo has joined #openstack-meeting-308:00
*** liangbo has quit IRC08:32
*** diablo_rojo has quit IRC08:33
*** tssurya has quit IRC08:33
*** tssurya has joined #openstack-meeting-308:36
*** alexchadin has joined #openstack-meeting-308:57
*** lpetrut has quit IRC09:04
*** lpetrut has joined #openstack-meeting-309:04
*** pbourke has quit IRC09:12
*** pbourke has joined #openstack-meeting-309:13
*** MarkBaker has quit IRC09:15
*** yamahata has quit IRC09:17
*** MarkBaker has joined #openstack-meeting-309:27
*** wanghao_ has quit IRC09:39
*** wanghao has joined #openstack-meeting-309:40
*** wanghao has quit IRC09:40
*** wanghao has joined #openstack-meeting-309:41
*** wanghao has quit IRC09:41
*** wanghao has joined #openstack-meeting-309:41
*** wanghao has quit IRC09:42
*** wanghao has joined #openstack-meeting-309:42
*** wanghao has quit IRC09:43
*** wanghao has joined #openstack-meeting-309:43
*** wanghao has quit IRC09:43
*** wanghao has joined #openstack-meeting-309:44
*** wanghao has quit IRC09:44
*** wanghao has joined #openstack-meeting-309:44
*** wanghao has quit IRC09:45
*** wanghao has joined #openstack-meeting-309:45
*** alexchadin has quit IRC10:21
*** alexpilotti has joined #openstack-meeting-310:24
*** alexpilo_ has joined #openstack-meeting-310:28
*** alexpilotti has quit IRC10:29
*** alexpilo_ has quit IRC10:38
*** alexpilotti has joined #openstack-meeting-310:40
*** alexpilotti has quit IRC10:48
*** alexpilotti has joined #openstack-meeting-310:50
*** alexpilotti has quit IRC10:53
*** alexpilotti has joined #openstack-meeting-310:54
*** alexchadin has joined #openstack-meeting-311:01
*** chyka has joined #openstack-meeting-311:11
*** chyka has quit IRC11:15
*** alexpilo_ has joined #openstack-meeting-311:28
*** alexpilotti has quit IRC11:30
*** alexpilo_ has quit IRC11:44
*** alexpilotti has joined #openstack-meeting-311:45
*** peereb has joined #openstack-meeting-311:52
*** psachin` has joined #openstack-meeting-311:58
*** psachin has quit IRC11:59
*** alexpilo_ has joined #openstack-meeting-312:05
*** alexpilotti has quit IRC12:08
*** alexpilo_ has quit IRC12:11
*** raildo has joined #openstack-meeting-312:17
*** yamamoto has quit IRC12:33
*** yamamoto has joined #openstack-meeting-312:54
*** yamamoto has quit IRC12:54
*** yamamoto has joined #openstack-meeting-312:55
*** cshastri has quit IRC13:02
*** zhipeng has joined #openstack-meeting-313:42
*** namnh has joined #openstack-meeting-313:53
*** zhipeng has quit IRC14:07
*** lpetrut has quit IRC14:11
*** lpetrut has joined #openstack-meeting-314:34
*** Luzi has quit IRC14:35
*** rmascena has joined #openstack-meeting-314:42
*** raildo has quit IRC14:44
*** hongbin has joined #openstack-meeting-314:51
*** witek has joined #openstack-meeting-314:54
*** pandiyan has joined #openstack-meeting-314:56
*** yamahata has joined #openstack-meeting-314:57
*** koji has joined #openstack-meeting-314:58
*** rmart04 has quit IRC14:58
*** dougsz has joined #openstack-meeting-314:59
*** amofakhar has joined #openstack-meeting-315:00
witek#startmeeting monasca15:01
openstackMeeting started Wed Jul  4 15:01:08 2018 UTC and is due to finish in 60 minutes.  The chair is witek. Information about MeetBot at http://wiki.debian.org/MeetBot.15:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:01
*** openstack changes topic to " (Meeting topic: monasca)"15:01
openstackThe meeting name has been set to 'monasca'15:01
jgrasslerHello15:01
witekHello everyone15:01
amofakharHello15:01
kojihello15:01
witeknice to see you15:01
witekhere the agenda:15:02
witekhttps://etherpad.openstack.org/p/monasca-team-meeting-agenda15:02
witek#topic Kafka upgrade15:02
*** openstack changes topic to "Kafka upgrade (Meeting topic: monasca)"15:02
witekwe've done some testing with upgrading Apache Kafka15:02
witekto ver. 1.0.115:02
witeklog message format has been changed since Kafka 0.1015:03
witekbut there is an option to set it to the old format15:03
witekwe've run the tests for a couple of days with proposed settings15:04
witekand haven't observed any issues15:04
amofakharnice15:04
witekthe throughput is the same as before15:04
witektested on single node installation15:04
jgrasslerYay. So I get to build a new Kafka package once we've got the consumers updated... :-)15:05
witekit would be nice, if you could also do some testing in your environments15:06
jgrasslerI'll try to squeeze that in somehow...15:06
jgrasslerMay take a while, though - I'll have to roll a Kafka 1.0.1 package first, and Java being Java that may come with unexpected excitement.15:07
witekyes, with packaging it gets more effort15:08
witekon the related topic, we also make comparison of throughput of different Kafka clients15:09
witekhere is the WIP:15:09
witekhttps://github.com/monasca/monasca-perf/pull/2815:09
witekit seems, confluent-kafka is the preferred option15:10
witekwe've managed to get better values for pykafka than presented in graphs, but still much lower than confluent15:10
*** Guest64549 has joined #openstack-meeting-315:11
witekamofakhar: have you been doing some testing with Kafka clients?15:12
Guest64549sorry i was disconnected15:12
Guest64549yes we did some tests before15:12
*** amofakhar has quit IRC15:12
*** Guest64549 has quit IRC15:13
witekI remember you've been opting for confluent during the PTG15:13
witekseems Amir has some connectivity problems15:13
*** amofakhar has joined #openstack-meeting-315:14
amofakharyes we did some tests before15:14
*** tssurya has quit IRC15:14
amofakharI think we can do the same with this new version15:14
witekamofakhar: have you tested confluent client?15:15
amofakharI think, but i am not sure because some other persons did it before15:16
witekOK, could you please check on this, I'll ping you in the next days15:17
amofakharsure15:17
witekmy current idea is to remove pykafka from global-requirements and exchange with confluent15:18
witekbut want to be sure it's the right approach before doing that15:18
jgrasslerI stil need to look into packaging that, too...15:18
amofakharconfluent-kafka-python ?15:19
witekjgrassler: yes, true15:19
witekamofakhar: yes15:19
jgrasslerYes. It's a bit more complicated than regular Python modules since it comes with a C component.15:19
jgrasslerThe next point on the agenda prevented me from that so far :-)15:19
witekright, let's move on :)15:19
witek#topic Alembic support15:20
*** openstack changes topic to "Alembic support (Meeting topic: monasca)"15:20
jgrasslerYeah, so we've got a command line DB management tool now.15:20
jgrasslerhttps://review.openstack.org/#/c/580174/15:20
jgrasslerIt can deal with a configuration database schema that was created from a legacy SQL script schema.15:21
witekso the command is `monasca_db`15:21
jgrasslerYes.15:21
jgrasslerIt detects the schema by computing a SHA1 checksum of the active schema in a (hopefully) canonical form.15:22
witekshould we document the usage somewhere apart from online help?15:22
jgrasslerAbsolutely.15:22
jgrasslerMaybe we can add that as an extra task on the story.15:22
witekyes, we can do that15:23
jgrasslerAnyway, the most important thing about reviewing is probably the list of fingerprints: it would be a good idea to compute the fingerprints on as many (and weird) environments as possible.15:23
jgrasslerFor the canonical representation may not quite cut it, yet, and contain a few things that vary across environments.15:24
*** rmascena is now known as raildo15:24
*** haruki has joined #openstack-meeting-315:24
jgrasslerIf so we'll need to either add fingerprints or (preferably) fix the canonical representation.15:25
witekwhat do you mean with canonical representation?15:25
jgrasslerI linked to a testing script for generating fingerprints of all legacy revisions, along with expected output in the review comments.15:26
jgrasslerA representation that (ideally) doesn't change if you run it in an environment with (1) a default database charset of UTF-8 and (2) a default database charset of koi-8.15:27
*** alexchadin has quit IRC15:28
jgrasslerInternally (see fingerprint.py), fingerprinting dumps the database into an sorted list of sqlalchemy.Table objects and serializes that into a textual representation.15:28
jgrasslerI try to control for environmental factors and irrelevant information by stripping out a few things, but I may not have caught everything.15:29
witekOK, thanks I'll try to test it in our env15:30
jgrasslerThanks :-)15:30
witekI think we can move on15:31
witek#topic deployment15:31
*** openstack changes topic to "deployment (Meeting topic: monasca)"15:31
pandiyanHi All15:32
witekhi pandiyan15:32
pandiyanI think am facing issue for 4 weeks being try to deploy in different than upstream method.15:32
pandiyanshortly i explain, following upstream docker compose, where removed keystone and passed corresponding values for keystone wherever required15:33
pandiyanhttp://paste.openstack.org/show/725024/15:33
*** e0ne has quit IRC15:34
pandiyanwitek:  i need guidelines to deploy15:34
pandiyanhere my grafana docker compose file http://paste.openstack.org/show/725025/15:34
pandiyanhere my kafka_zookeeper compose which support swarm mode, which is not unique like upstream http://paste.openstack.org/show/725029/15:35
pandiyanHere the issue, when am running "monasca setup" on compute node getting ERROR like this http://paste.openstack.org/show/725033/15:35
pandiyanBut in ctl node able to see metrics http://paste.openstack.org/show/725031/15:36
pandiyanwhether those monasca-setup issues is expected witek15:36
pandiyanI know this meeting is mostly for development discussion, but i looking help from deployment point of view as well being operator. please15:37
witekprobably not all of them are expected, but in general not critical15:38
pandiyanwitek: is it fine to ignore those ?15:38
witekmonasca-setup tries to run all detection plugins and fails on some15:38
witekyou can configure the needed plugins manually afterwards15:38
*** namnh_ has joined #openstack-meeting-315:39
pandiyanmay i know why influxDB plugin issue is there in that ERROR15:39
pandiyanERROR: Plugin for influxdb-relay will not be configured.15:39
pandiyanERROR: monasca-persister process has not been found. Plugin for monasca-persister will not be configured. ERROR: Supervisord process exists but configuration file was not found and no arguments were given.15:39
witekthe reasons can be different from one case to another15:40
witeksome of the plugins are process checks15:40
kojilet me confirm, so the error messages are happened when you run monasca-setup on the server where monasca is running?15:41
jgrasslerAnd there's a different detection plugin for each metrics plugin.15:41
harukiCurrent monasca setup output "ERROR" when the process or service is not running and failed to detect the process or service15:41
pandiyanwitek:  as per my customised docker compose files , whether this is expected15:41
pandiyanjgrassler: yes15:41
jgrasslerSome of them have detection heuristics that do not work everywhere, unfortunately...15:42
*** namnh has quit IRC15:42
witekyes, it's expected that some plugins fail, e.g. when given service is not running15:42
pandiyanjgrassler: sorry, docker monasca is running on different server, created keystone endpoint and trying to install & run monasca agent on compute node15:42
jgrasslerI know roughly what you are dealing with. I fixed some of these. And then I went back and fixed my fixes because I'd overlooked corner cases... :-)15:43
kojiin my opinion, the error message which says just not exist should be change the log level to INFO15:43
pandiyanin devstack also same kind of error where all are running in single node15:44
witekyes, we could file bugs for these and try to fix15:44
jgrasslerpandiyan: if you are running monasca-setup on a machine where the other monasca services are not running, the detection of Monasca services on that node is absolutely going to fail, yes. They're not there after all.15:44
jgrasslerIf some of these errors are reported on single-node Devstack that is more likely to be an actual problem.15:45
kojiand i think the current monasca-setup doesn't support monasca docker monitoring15:45
pandiyanjgrassler: may  i know what you mean here by monasca services here ?15:45
jgrasslerIn that case, please file bug reports with enough information for us to reproduce the problem.15:45
jgrasslerpandiyan: monasca-persister for instance. That is a Monasca service (part of Monasca).15:45
jgrasslerpandiyan: if you run monasca-setup on a machine where there _is_ no monasca-persister (because monasca-persister runs on a different machine), it will wail to detect its presence of course.15:46
witekInfluxDB also is normally not installed on OpenStack nodes15:47
jgrasslerThat's not really an error (monasca-setup is a bit overzealous about reporting "errors", unfortunately)15:47
pandiyanjgrassler: got it, but here all monasca services are running in docker by mapping to existing openstack-keystone, so dont think need services should run on each ndoe where running monaca agent15:47
witekno, it's just monasca-setup complaining15:48
jgrasslerpandiyan: exactly.15:48
pandiyanjgrassler: i know one person has delivered same way as i do from other organisation, unfortunately dont have his contact15:48
jgrasslerpandiyan: monasca-setup tries to detect _all_ services it's got metrics plugins for (well, most). If some of these happen not to be present, that's not a problem.15:48
pandiyanalso would like to know how can i check data populated inside influxDB here15:49
*** chyka has joined #openstack-meeting-315:49
jgrassler`monasca metric-list` would give you an overview at least.15:50
pandiyanjgrassler: say i have 500 compute nodes, and runniing monasca docker compose in seperate server and did keystone integration, in that case do how can i have moansca services in 500 nodes15:51
witekyes, you can use monasca client15:51
witekor query db directly15:51
witekhttps://docs.influxdata.com/influxdb/v1.3/guides/querying_data/15:51
jgrasslerYou can access InfluxDB directly, too, but I'd have to look that up myself (it's rarely necessary).15:51
witekif API is working, InfluxDB is working as well15:51
pandiyanwitek: i tried from localhost where docker influx is runniing its saying connection refused15:51
pandiyanwhere able to connect mysql15:52
witekcheck port forwarding15:52
harukiyou can check the metrics which are collected in Influxdb as below15:53
harukidocker exec -it <influx container ID> /bin/sh15:53
harukiinflux15:53
harukiuse mon15:53
pandiyanharuki: samething what ever u said i did15:53
harukishow series15:54
kojiwhich command failed?15:54
koji`influx`?15:54
*** tssurya has joined #openstack-meeting-315:55
pandiyanharuki: inside docker i can able to connect but not from outside15:55
pandiyanlet me ask my final question15:55
pandiyanHow can i pass keystone values to grafana in environment variable15:56
pandiyanhere my grafana-dockercompose http://paste.openstack.org/show/725025/15:56
pandiyanhow can i pass dependent keystone values to grafana in environment variables15:56
witekGRAFANA_USERNAME and GRAFANA_PASSWORD for grafana-init don't work?15:57
pandiyanthats working witek , but i want to login grafana with keystone user15:57
witekopen http://grafana_host:300015:57
witekand log in15:58
*** amofakhar has quit IRC15:58
pandiyani mean keystone credentials, we have 1000+ customers, so i want them to login grafana with their keystone credentials15:58
witekyes, they can log in with their Keystone credentials15:59
witekthese are mapped from Keystone users and projects to Grafana users and organisations15:59
pandiyanno even for me i am not able to login with keystone.. i am using whatever i have passed "GRAFANA_USERNAME and GRAFANA_PASSWORD "15:59
pandiyani think as i said something missing when i removed keystone as per upstream for grafana16:00
pandiyansee here i have removed keystone dependecy http://paste.openstack.org/show/725025/16:00
pandiyansorry here http://paste.openstack.org/show/725037/16:01
witekshould be working16:02
witekyou may try to log in with some user with 'admin' role16:03
pandiyani have admin role16:03
witekoh, the hour passed16:03
witekI have to close the meeting16:03
witeksorry16:03
pandiyanokay witek understood16:03
witek#endmeeting16:03
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"16:03
openstackMeeting ended Wed Jul  4 16:03:55 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:03
openstackMinutes:        http://eavesdrop.openstack.org/meetings/monasca/2018/monasca.2018-07-04-15.01.html16:03
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/monasca/2018/monasca.2018-07-04-15.01.txt16:04
openstackLog:            http://eavesdrop.openstack.org/meetings/monasca/2018/monasca.2018-07-04-15.01.log.html16:04
*** haruki has quit IRC16:04
*** koji has quit IRC16:04
*** e0ne has joined #openstack-meeting-316:21
*** peereb has quit IRC16:21
*** sherit has joined #openstack-meeting-316:24
*** e0ne has quit IRC16:25
*** sherit has left #openstack-meeting-316:26
*** lhx_ has joined #openstack-meeting-316:32
*** bobh has joined #openstack-meeting-316:39
*** namnh_ has quit IRC16:40
*** lhx_ has quit IRC16:53
*** pandiyan has quit IRC16:53
*** namnh has joined #openstack-meeting-317:08
*** e0ne has joined #openstack-meeting-317:08
*** raildo has quit IRC17:10
*** namnh has quit IRC17:11
*** raildo has joined #openstack-meeting-317:11
*** bobh has quit IRC17:14
*** salv-orlando has joined #openstack-meeting-317:15
*** salv-orlando has quit IRC17:19
*** namnh has joined #openstack-meeting-317:35
*** dougsz has quit IRC17:39
*** namnh has quit IRC17:39
*** psachin` has quit IRC17:58
*** tssurya has quit IRC17:59
*** tssurya has joined #openstack-meeting-318:00
*** alexpilotti has joined #openstack-meeting-318:12
*** salv-orlando has joined #openstack-meeting-318:16
*** salv-orlando has quit IRC18:21
*** alexpilotti has quit IRC18:30
*** alexpilotti has joined #openstack-meeting-318:33
*** namnh has joined #openstack-meeting-318:34
*** e0ne has quit IRC18:36
*** alexpilotti has quit IRC18:38
*** namnh has quit IRC18:39
*** alexpilotti has joined #openstack-meeting-318:53
*** alexpilotti has quit IRC18:58
*** liangbo has joined #openstack-meeting-319:01
*** liangbo has quit IRC19:07
*** salv-orlando has joined #openstack-meeting-319:16
*** salv-orlando has quit IRC19:21
*** alexpilotti has joined #openstack-meeting-319:34
*** alexpilotti has quit IRC19:43
*** alexpilotti has joined #openstack-meeting-319:52
*** alexpilotti has quit IRC20:10
*** alexpilotti has joined #openstack-meeting-320:15
*** salv-orlando has joined #openstack-meeting-320:17
*** raildo has quit IRC20:18
*** namnh has joined #openstack-meeting-320:22
*** salv-orlando has quit IRC20:22
*** lpetrut has quit IRC20:24
*** namnh has quit IRC20:27
*** alexpilotti has quit IRC20:28
*** alexpilotti has joined #openstack-meeting-320:35
*** alexpilotti has quit IRC20:40
*** alexpilotti has joined #openstack-meeting-321:02
*** salv-orlando has joined #openstack-meeting-321:18
*** alexpilotti has quit IRC21:18
*** alexpilotti has joined #openstack-meeting-321:20
*** salv-orlando has quit IRC21:23
*** alexpilotti has quit IRC21:33
*** alexpilotti has joined #openstack-meeting-321:37
*** alexpilo_ has joined #openstack-meeting-321:38
*** alexpilotti has quit IRC21:41
*** alexpilo_ has quit IRC21:55
*** alexpilotti has joined #openstack-meeting-321:59
*** namnh has joined #openstack-meeting-322:10
*** namnh has quit IRC22:15
*** salv-orlando has joined #openstack-meeting-322:19
*** hongbin has quit IRC22:19
*** alexpilotti has quit IRC22:20
*** salv-orlando has quit IRC22:23
*** alexpilotti has joined #openstack-meeting-322:25
*** tssurya has quit IRC22:34
*** namnh has joined #openstack-meeting-322:36
*** tssurya has joined #openstack-meeting-322:36
*** alexpilotti has quit IRC22:37
*** alexpilotti has joined #openstack-meeting-322:38
*** namnh has quit IRC22:40
*** tssurya has quit IRC22:41
*** alexpilotti has quit IRC22:42
*** namnh has joined #openstack-meeting-322:42
*** namnh has quit IRC22:46
*** alexpilotti has joined #openstack-meeting-322:50
*** namnh has joined #openstack-meeting-322:52
*** namnh has quit IRC23:03
*** alexpilotti has quit IRC23:13
*** salv-orlando has joined #openstack-meeting-323:19
*** salv-orlando has quit IRC23:24
*** chyka has quit IRC23:34
*** alexpilotti has joined #openstack-meeting-323:36
*** alexpilotti has quit IRC23:50
*** alexpilotti has joined #openstack-meeting-323:52
*** ywat has joined #openstack-meeting-323:54
*** alexpilotti has quit IRC23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!