rook | The new format seems overly complicated | 00:12 |
---|---|---|
rook | andreykurilin boris-42 anyone i can chat with about the new schema? | 00:12 |
andreykurilin__ | rook you can try to ping ikhudoshin when he will be online | 00:14 |
andreykurilin__ | Or just leave comments to patch:) | 00:14 |
rook | andreykurilin__ is it just a patch right now? | 00:15 |
rook | it hasn't been implemented? | 00:15 |
andreykurilin__ | took are you talking about new task format or new db schema? | 00:16 |
rook | andreykurilin__ sorry, the VMTask scenario output | 00:16 |
andreykurilin__ | Oh | 00:16 |
andreykurilin__ | :) | 00:16 |
andreykurilin__ | Ok | 00:16 |
rook | https://github.com/openstack/rally/blob/master/doc/specs/implemented/improve_scenario_output_format.rst | 00:17 |
andreykurilin__ | You should try to ping amaretskiy | 00:17 |
andreykurilin__ | He should be online in 7-8 hours | 00:17 |
andreykurilin__ | Lol | 00:17 |
rook | lol | 00:18 |
rook | grand | 00:18 |
rook | he hasn't moved over? | 00:19 |
andreykurilin__ | No | 00:19 |
andreykurilin__ | So amaretskiy was working on proposal and new implementation of scenario output | 00:20 |
rook | please don't change the json | 00:20 |
rook | :D | 00:20 |
andreykurilin__ | )))) | 00:21 |
rook | lol does that mean yes? | 00:24 |
andreykurilin__ | It means nothing)) I don't use custom scenario output, so I don't know how is it:) | 00:25 |
andreykurilin__ | If it so bad, we can raise this topic at Monday's weekly meeting | 00:26 |
*** pvaneck_ has quit IRC | 00:26 | |
*** KevinE has quit IRC | 00:29 | |
andreykurilin__ | Ok, I'm not boris-42 , so I need to sleep sometimes:) please, ping tomorrow amaretskiy and he will answer all your questions about scenario output. He should be available till ~16:00 UTC or something like that | 00:29 |
rook | :D | 00:32 |
*** yingjun has joined #openstack-rally | 00:33 | |
openstackgerrit | Merged openstack/rally: Add Senlin plugin for profile and cluster https://review.openstack.org/301522 | 00:45 |
*** diogogmt has quit IRC | 00:46 | |
*** maeca1 has quit IRC | 00:47 | |
openstackgerrit | chenhb proposed openstack/rally: [WIP] Add NovaServers.boot_server_and_multiple_attach_volume https://review.openstack.org/351445 | 00:58 |
*** abalutoiu__ has joined #openstack-rally | 01:02 | |
openstackgerrit | chenhb proposed openstack/rally: [WIP] Add NovaServers.boot_server_and_multiple_attach_volume https://review.openstack.org/351445 | 01:04 |
*** abalutoiu_ has quit IRC | 01:06 | |
openstackgerrit | chenhb proposed openstack/rally: [WIP] Add NovaServers.boot_server_and_multiple_attach_volume https://review.openstack.org/351445 | 01:14 |
*** yanyanhu has joined #openstack-rally | 01:28 | |
*** sskripnick has quit IRC | 01:29 | |
*** yingjun has quit IRC | 01:37 | |
*** yingjun has joined #openstack-rally | 01:37 | |
*** liuyulong has quit IRC | 01:52 | |
*** liuyulong has joined #openstack-rally | 01:53 | |
*** dave-mcc_ has joined #openstack-rally | 02:17 | |
*** dave-mccowan has quit IRC | 02:17 | |
openstackgerrit | Brooke Trimble proposed openstack/rally: Clarify docs around results report https://review.openstack.org/351459 | 02:21 |
*** maeca1 has joined #openstack-rally | 02:22 | |
openstackgerrit | chenhb proposed openstack/rally: Add NovaServers.boot_server_and_multiple_attach_volume https://review.openstack.org/351445 | 02:47 |
*** dave-mcc_ has quit IRC | 02:59 | |
*** lutostag has quit IRC | 03:17 | |
openstackgerrit | chenhb proposed openstack/rally: Add NovaServers.boot_server_and_multiple_attach_volume https://review.openstack.org/351445 | 03:40 |
*** yingjun has quit IRC | 03:59 | |
*** yingjun has joined #openstack-rally | 04:00 | |
*** yingjun has quit IRC | 04:04 | |
*** liuyulong has quit IRC | 04:21 | |
*** liuyulong has joined #openstack-rally | 04:28 | |
*** yingjun has joined #openstack-rally | 04:29 | |
*** abalutoiu__ has quit IRC | 04:45 | |
*** yingjun has quit IRC | 04:53 | |
*** yingjun has joined #openstack-rally | 04:53 | |
*** yingjun has quit IRC | 04:58 | |
*** maeca1 has quit IRC | 05:17 | |
*** rcernin has joined #openstack-rally | 05:31 | |
*** e0ne has joined #openstack-rally | 05:31 | |
*** abalutoiu has joined #openstack-rally | 05:37 | |
*** yingjun has joined #openstack-rally | 05:38 | |
*** psuriset has quit IRC | 05:45 | |
*** psuriset has joined #openstack-rally | 06:10 | |
*** ashishg_ has joined #openstack-rally | 06:19 | |
*** psuriset has quit IRC | 06:23 | |
*** kavithas has joined #openstack-rally | 06:29 | |
*** psuriset has joined #openstack-rally | 06:45 | |
*** e0ne has quit IRC | 06:51 | |
*** yingjun has quit IRC | 06:56 | |
*** yamamot__ has joined #openstack-rally | 07:00 | |
*** amaretskiy has joined #openstack-rally | 07:16 | |
*** yingjun has joined #openstack-rally | 07:19 | |
*** amaretskiy has quit IRC | 07:20 | |
*** abalutoiu has quit IRC | 07:23 | |
*** rdas has joined #openstack-rally | 07:24 | |
*** amaretskiy has joined #openstack-rally | 07:26 | |
*** abalutoiu has joined #openstack-rally | 07:45 | |
*** openstackgerrit has quit IRC | 08:03 | |
*** openstackgerrit has joined #openstack-rally | 08:03 | |
*** tesseract- has joined #openstack-rally | 08:16 | |
*** kavithas has quit IRC | 08:46 | |
openstackgerrit | Merged openstack/rally: Clarify docs around results report https://review.openstack.org/351459 | 09:13 |
*** e0ne has joined #openstack-rally | 09:14 | |
*** ashishg_ has quit IRC | 09:19 | |
*** yingjun has quit IRC | 09:23 | |
*** yingjun has joined #openstack-rally | 09:23 | |
*** yingjun has quit IRC | 09:29 | |
*** yingjun has joined #openstack-rally | 09:30 | |
*** abehl has joined #openstack-rally | 09:30 | |
*** sskripnick has joined #openstack-rally | 09:36 | |
*** yingjun has quit IRC | 09:55 | |
*** yanyanhu has quit IRC | 10:12 | |
*** yamamot__ has quit IRC | 10:24 | |
*** sskripnick has quit IRC | 10:29 | |
*** arcimboldo has joined #openstack-rally | 10:34 | |
*** tosky has joined #openstack-rally | 10:43 | |
*** yamamoto has joined #openstack-rally | 11:19 | |
rook | amaretskiy: ping - question regarding the new format for VMTask scenario outpiut | 11:36 |
rook | output | 11:36 |
amaretskiy | rook: hi | 11:38 |
amaretskiy | rook: what is the question? | 11:38 |
rook | amaretskiy: seems like the new output is built to drive a rally webpage. | 11:39 |
rook | amaretskiy: however, what if I don't necessarily care about the webpage, but want the results to be reported within the Rally JSON? | 11:40 |
amaretskiy | rook: you can add custom data inside scenario code by calling method add_output() | 11:40 |
rook | https://gist.githubusercontent.com/jtaleric/42f8a7fa179fdf16957b759f34a083d1/raw/bf9cd0069a2fda16f663bfefa0be24995ea48de5/result.json | 11:40 |
amaretskiy | this method will actually add the data to iteration results | 11:40 |
rook | amaretskiy ^ is a example data set i generate | 11:40 |
rook | so, could I just send that dict? or do I need to format it? | 11:41 |
amaretskiy | data should b ein proper format in order to be correctly displayed in html report Scenario Data tab | 11:41 |
rook | it seems it is a list of lists | 11:41 |
amaretskiy | however this data exists in result spermanently | 11:41 |
amaretskiy | you can run rally task results <uuid> > results.json | 11:41 |
rook | as long as the results end up in the Rally JSON as well, I am good :) | 11:41 |
amaretskiy | and find this data in the json | 11:42 |
rook | good | 11:42 |
amaretskiy | rook: the format of "data" differs depending of value of "plugin_name" | 11:42 |
amaretskiy | because different charts requires different imput format | 11:42 |
rook | amaretskiy so is it a freeform field? | 11:43 |
rook | as mentioned I don't care about the charts | 11:43 |
amaretskiy | for example pie chart differs from lines and from generic html table | 11:43 |
rook | I am shipping the Rally JSON to Elastic, and building dashboards. | 11:43 |
rook | i see | 11:43 |
amaretskiy | no, this is not a freeform field in a fact, but it is not validated yet (i'm planning to add this validation) | 11:44 |
amaretskiy | there will be issues in html if you use "plugin_name": "Pie" but in "data": <data format for StackedArea> | 11:44 |
amaretskiy | i will add a validation later | 11:44 |
amaretskiy | you can find examples in docs and docstrings about data format for each chart plugin | 11:45 |
*** yamamoto has quit IRC | 11:45 | |
amaretskiy | rook: https://rally.readthedocs.io/en/latest/plugin/plugin_reference.html#processing-output-charts | 11:45 |
amaretskiy | rook: real-code example: https://github.com/openstack/rally/blob/master/rally/plugins/common/scenarios/dummy/dummy.py#L116-L172 | 11:46 |
*** yamamoto has joined #openstack-rally | 11:47 | |
amaretskiy | rook: this is how it shown in html: http://logs.openstack.org/20/297020/48/check/gate-rally-dsvm-rally/c713f56/rally-plot/results.html.gz#/Dummy.dummy_output/output | 11:47 |
rook | amaretskiy: ill check it out | 11:47 |
amaretskiy | if you need to find this data only in JSON then you can do not care about format a lot until you try to render HTML - you can expirience issues in report.... | 11:48 |
*** adiantum has joined #openstack-rally | 11:49 | |
amaretskiy | *experience | 11:49 |
rook | amaretskiy so addative vs complete? | 11:51 |
amaretskiy | additive: this is a common question about reports :) | 11:51 |
*** yamamoto has quit IRC | 11:51 | |
amaretskiy | additive is a data for generic charts | 11:52 |
amaretskiy | these charts are processed for all iterations | 11:52 |
amaretskiy | complete is a complete chart - it is shown for this explicit iteration | 11:52 |
amaretskiy | in other words, iteration generates complete chart | 11:53 |
rook | do i have to use both, or can I just use one? | 11:53 |
rook | from the examples I see both being used | 11:53 |
amaretskiy | in opposite to providing a value for one point for chart where another points are taken from other iterations | 11:53 |
amaretskiy | you can use any :) | 11:54 |
amaretskiy | any types, any charts : ) | 11:54 |
amaretskiy | Scenario Data tab is very flexible :) | 11:54 |
amaretskiy | rook: for example, here is only additive: https://github.com/openstack/rally/blob/master/rally/plugins/common/scenarios/dummy/dummy.py#L122-L127 | 11:55 |
amaretskiy | you can call add_output() many times | 11:56 |
openstackgerrit | Merged openstack/rally: [Plugins] Fix vm.utils._run_command_over_ssh https://review.openstack.org/325189 | 11:56 |
amaretskiy | all data will be saved :) | 11:56 |
*** arcimboldo has quit IRC | 11:57 | |
amaretskiy | rook: by the way, I remember you asked about Rally-as-a-Service someday, you can take a look at this demo patch: https://review.openstack.org/#/c/336636/ | 12:01 |
*** dave-mccowan has joined #openstack-rally | 12:08 | |
rook | amaretskiy: sure... | 12:21 |
rook | amaretskiy: I have a cool plugin that does some complex work. | 12:21 |
rook | hence the question regarding addative/complete output | 12:22 |
amaretskiy | rook: do not hesitate to contact me about reports :) | 12:23 |
rook | https://review.openstack.org/#/c/345522 amaretskiy | 12:25 |
rook | amaretskiy plugin creates a jump-host (single fip) and eventually n number of pairs of guests to run things like uperf (netperf but better :D ) | 12:27 |
amaretskiy | great, that is the time to draw nice charts with results :) | 12:28 |
openstackgerrit | Anton Studenov proposed openstack/rally: [spec] New Tasks Configuration section - hook https://review.openstack.org/350748 | 12:31 |
rook | amaretskiy well, our framework takes Rally Json's and ships it to ElasticSerach, then we build Kibana dashboards :) | 12:40 |
amaretskiy | rook: headshot :) | 12:40 |
rook | amaretskiy for historical reasons | 12:41 |
*** stpierre has joined #openstack-rally | 12:45 | |
*** catintheroof has quit IRC | 12:53 | |
*** catintheroof has joined #openstack-rally | 13:05 | |
*** yamamoto has joined #openstack-rally | 13:08 | |
*** Deng has quit IRC | 13:10 | |
*** matthewli_ has joined #openstack-rally | 13:16 | |
*** rdas has quit IRC | 13:26 | |
*** diogogmt has joined #openstack-rally | 13:32 | |
*** maeca1 has joined #openstack-rally | 13:41 | |
openstackgerrit | Alexander Maretskiy proposed openstack/rally: [Doc] Remove stale page miscellaneous/concepts.rst https://review.openstack.org/351747 | 13:47 |
*** catintheroof has quit IRC | 14:00 | |
*** openstackgerrit has quit IRC | 14:03 | |
*** openstackgerrit has joined #openstack-rally | 14:03 | |
*** e0ne has quit IRC | 14:05 | |
*** e0ne has joined #openstack-rally | 14:05 | |
*** catintheroof has joined #openstack-rally | 14:07 | |
*** lutostag has joined #openstack-rally | 14:14 | |
*** diogogmt has quit IRC | 14:23 | |
*** yamamoto has quit IRC | 14:27 | |
openstackgerrit | Alexander Maretskiy proposed openstack/rally: [Reports] Expand menu if there is only one menu group https://review.openstack.org/351770 | 14:32 |
*** diogogmt has joined #openstack-rally | 14:35 | |
*** e0ne has quit IRC | 14:42 | |
*** yamamoto has joined #openstack-rally | 14:45 | |
*** diogogmt has quit IRC | 14:48 | |
*** abalutoiu has quit IRC | 14:50 | |
*** diogogmt has joined #openstack-rally | 14:52 | |
*** adiantum has quit IRC | 14:53 | |
*** yamamoto has quit IRC | 14:57 | |
*** yamamoto has joined #openstack-rally | 15:11 | |
*** e0ne has joined #openstack-rally | 15:17 | |
*** e0ne has quit IRC | 15:19 | |
*** tesseract- has quit IRC | 15:21 | |
*** rcernin has quit IRC | 15:26 | |
*** klindgren_ has joined #openstack-rally | 15:30 | |
*** klindgren has quit IRC | 15:33 | |
*** yamamoto has quit IRC | 15:35 | |
*** abehl has quit IRC | 15:54 | |
*** amaretskiy has quit IRC | 16:02 | |
*** davideagnello has joined #openstack-rally | 16:04 | |
*** pcaruana has quit IRC | 16:05 | |
*** KevinE has joined #openstack-rally | 16:07 | |
*** KevinE has quit IRC | 16:07 | |
*** KevinE has joined #openstack-rally | 16:08 | |
*** davideagnello has quit IRC | 16:12 | |
*** davideagnello has joined #openstack-rally | 16:13 | |
*** kuladeep has joined #openstack-rally | 16:43 | |
*** kuladeep has quit IRC | 16:43 | |
*** diogogmt has quit IRC | 17:11 | |
*** diogogmt has joined #openstack-rally | 17:14 | |
*** matthewli_ has quit IRC | 17:15 | |
*** itlinux has quit IRC | 17:15 | |
*** davideagnello has quit IRC | 17:20 | |
*** diogogmt has quit IRC | 17:23 | |
*** tosky has quit IRC | 17:27 | |
*** davideagnello has joined #openstack-rally | 17:27 | |
*** diogogmt has joined #openstack-rally | 17:30 | |
*** e0ne has joined #openstack-rally | 17:44 | |
*** abehl has joined #openstack-rally | 17:45 | |
*** sskripnick has joined #openstack-rally | 17:55 | |
*** lutostag has quit IRC | 18:05 | |
*** e0ne_ has joined #openstack-rally | 18:07 | |
*** e0ne has quit IRC | 18:07 | |
*** davideagnello has quit IRC | 18:21 | |
*** davideagnello has joined #openstack-rally | 18:30 | |
*** e0ne_ is now known as e0ne | 18:46 | |
*** catintheroof has quit IRC | 19:00 | |
*** sskripnick has quit IRC | 19:01 | |
*** lutostag has joined #openstack-rally | 19:17 | |
*** e0ne has quit IRC | 19:29 | |
*** davideagnello has quit IRC | 19:33 | |
*** davideagnello has joined #openstack-rally | 19:34 | |
*** dave-mccowan has quit IRC | 19:45 | |
*** dave-mccowan has joined #openstack-rally | 19:45 | |
*** dave-mccowan has quit IRC | 19:50 | |
*** dave-mccowan has joined #openstack-rally | 19:57 | |
*** liuyulong_ has joined #openstack-rally | 20:00 | |
*** liuyulong has quit IRC | 20:01 | |
*** sskripnick has joined #openstack-rally | 20:10 | |
*** davideagnello has quit IRC | 20:22 | |
*** davideagnello has joined #openstack-rally | 20:31 | |
*** yamamoto has joined #openstack-rally | 21:09 | |
*** yamamoto has quit IRC | 21:16 | |
*** davideagnello has quit IRC | 21:40 | |
*** davideagnello has joined #openstack-rally | 21:52 | |
*** yamamoto has joined #openstack-rally | 21:59 | |
*** bkopilov has quit IRC | 22:09 | |
*** bkopilov has joined #openstack-rally | 22:12 | |
*** maeca1 has quit IRC | 22:21 | |
*** dave-mccowan has quit IRC | 22:24 | |
*** yamamoto has quit IRC | 22:26 | |
*** yamamoto has joined #openstack-rally | 22:57 | |
*** davideagnello has quit IRC | 22:58 | |
*** davideagnello has joined #openstack-rally | 23:06 | |
*** KevinE has quit IRC | 23:19 | |
*** davideagnello has quit IRC | 23:20 | |
*** yamamoto has quit IRC | 23:41 | |
*** yamamoto has joined #openstack-rally | 23:41 | |
*** yamamoto has quit IRC | 23:41 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!