Wednesday, 2016-02-03

*** yingjun has joined #openstack-rally00:22
*** kjorgensen has quit IRC00:24
*** absubram has quit IRC00:31
*** arnoldje has quit IRC00:36
openstackgerritSergey Skripnick proposed openstack/rally: Add heat siege workload scenario  https://review.openstack.org/27251000:39
*** pvaneck has quit IRC00:56
*** harshs has quit IRC01:02
openstackgerritJulian Edwards proposed openstack/rally: Make Rally cope with unversioned keystone URL  https://review.openstack.org/27497701:05
*** Aish has quit IRC01:14
openstackgerritSergey Skripnick proposed openstack/rally: Add heat siege workload scenario  https://review.openstack.org/27251001:18
*** baker has joined #openstack-rally01:27
*** baker_ has joined #openstack-rally01:27
*** baker has quit IRC01:32
*** redixin has quit IRC01:40
openstackgerritli,chen proposed openstack/rally: Using 'dt' as alias for datetime imports  https://review.openstack.org/26995801:41
*** chenli has joined #openstack-rally01:42
*** baker_ has quit IRC01:45
*** baker has joined #openstack-rally01:46
*** chenli_ has joined #openstack-rally01:58
*** chenli has quit IRC02:00
*** chenli_ is now known as chenli02:00
*** baohua has joined #openstack-rally02:05
*** baker has quit IRC02:08
*** baker has joined #openstack-rally02:10
*** baker has quit IRC02:13
*** baker has joined #openstack-rally02:18
*** Aish has joined #openstack-rally02:21
*** Aish has left #openstack-rally02:21
*** baker has quit IRC02:22
*** akrzos has quit IRC02:23
openstackgerritBo Chi proposed openstack/rally: Use dict and set comprehension instead of using dict() and set()  https://review.openstack.org/27344902:31
*** agrebennikov has quit IRC02:33
*** chenli has quit IRC02:35
openstackgerritJulian Edwards proposed openstack/rally: Make Rally cope with unversioned keystone URL  https://review.openstack.org/27497702:51
*** chenli has joined #openstack-rally02:53
*** harshs has joined #openstack-rally02:57
*** harshs has quit IRC02:59
*** rook-laptop has quit IRC03:02
*** paco20151113 has joined #openstack-rally03:08
*** fsopenstack has joined #openstack-rally03:16
*** akrzos has joined #openstack-rally03:24
*** rook-laptop has joined #openstack-rally03:28
*** akrzos has quit IRC03:29
*** rook-laptop has quit IRC03:36
*** yingjun has quit IRC03:46
*** fsopenstack has quit IRC03:48
*** fsopenstack has joined #openstack-rally03:51
*** baker has joined #openstack-rally03:52
*** fsopenstack has quit IRC04:07
*** baker_ has joined #openstack-rally04:15
*** baker has quit IRC04:18
*** akrzos has joined #openstack-rally04:36
openstackgerritJulian Edwards proposed openstack/rally: Make Rally cope with unversioned keystone URL  https://review.openstack.org/27497704:37
*** harshs has joined #openstack-rally04:39
*** akrzos has quit IRC04:39
*** fsopenstack has joined #openstack-rally05:04
*** fsopenstack has quit IRC05:21
*** harshs has quit IRC05:35
*** baker_ has quit IRC05:42
*** baker has joined #openstack-rally05:51
*** baker has quit IRC05:56
*** tfreger has joined #openstack-rally06:03
*** harshs has joined #openstack-rally06:06
*** madhu_ak has quit IRC06:13
*** neeti has joined #openstack-rally06:24
*** jaypipes has quit IRC06:26
*** psuriset has quit IRC06:36
*** anshul has joined #openstack-rally06:40
*** tfreger1 has joined #openstack-rally06:45
*** tfreger has quit IRC06:45
openstackgerritvigny_wu proposed openstack/rally: Add the scenario of list-flavors  https://review.openstack.org/27552306:47
*** yfried has quit IRC06:55
*** tfreger1 has quit IRC07:05
*** harshs has quit IRC07:07
*** tfreger has joined #openstack-rally07:21
*** neeti has quit IRC07:36
*** yfried has joined #openstack-rally07:38
*** neeti has joined #openstack-rally07:45
*** mvk_ has quit IRC07:56
*** chandidas has joined #openstack-rally08:03
*** boris-42 has joined #openstack-rally08:18
*** amaretskiy has joined #openstack-rally08:20
*** neeti has quit IRC08:26
*** neeti has joined #openstack-rally08:27
*** mvk_ has joined #openstack-rally08:27
*** neeti has quit IRC08:32
*** yingjun has joined #openstack-rally08:48
*** tfreger has quit IRC08:57
*** yingjun has quit IRC09:00
*** yingjun has joined #openstack-rally09:00
*** yingjun has quit IRC09:04
*** tfreger has joined #openstack-rally09:13
openstackgerritvigny_wu proposed openstack/rally: Add the scenario of list-flavors  https://review.openstack.org/27552309:22
*** tfreger has quit IRC09:23
*** adiantum has joined #openstack-rally09:34
*** tfreger has joined #openstack-rally09:39
*** neeti has joined #openstack-rally09:43
*** e0ne has joined #openstack-rally09:45
*** yingjun has joined #openstack-rally09:59
*** e0ne has quit IRC10:05
*** chenli has quit IRC10:16
*** neeti has quit IRC10:19
*** rook-laptop has joined #openstack-rally10:27
*** neeti has joined #openstack-rally10:31
*** e0ne has joined #openstack-rally10:51
*** bigjools has joined #openstack-rally11:14
*** arxcruz has joined #openstack-rally11:14
*** psuriset has joined #openstack-rally11:18
*** boris-42 has quit IRC11:43
ikhudoshynboris-42 andreykurilin amaretskiy rvasilets guys I'd like to draw yr attention to the patch https://review.openstack.org/#/c/27497711:55
amaretskiy ikhudoshyn: ok11:55
ikhudoshynpls take a look on the discussion in comments as well and share  yr thoughts11:55
openstackgerritIllia Khudoshyn proposed openstack/rally: Fix Ceilometer scenarios against Keystone API v3  https://review.openstack.org/27564711:59
andreykurilinikhudoshyn, I'll look at it a bit later12:01
*** chandidas has quit IRC12:03
*** rook-laptop has quit IRC12:03
*** rook-laptop has joined #openstack-rally12:08
*** baohua has quit IRC12:34
-openstackstatus- NOTICE: Infra running with lower capacity now, due to a temporary problem affecting one of our nodepool providers. Please expect some delays in your jobs. Apologies for any inconvenience caused.12:40
*** Ritesh_ has joined #openstack-rally12:41
*** Ritesh_ has quit IRC12:42
*** rook-laptop has quit IRC12:42
*** qwebirc71559 has joined #openstack-rally12:43
*** qwebirc71559 has quit IRC12:43
*** Sravani has joined #openstack-rally12:45
*** gubouvier has joined #openstack-rally12:50
*** akrzos has joined #openstack-rally12:51
openstackgerritPiyush Raman Srivastava proposed openstack/rally: Add list subnets/routers/FIPs to NetworkWrapper  https://review.openstack.org/27225112:56
openstackgerritIllia Khudoshyn proposed openstack/rally: Fix Ceilometer scenarios against Keystone API v3  https://review.openstack.org/27564712:57
SravaniHi, Does Rally has REST APIs? If yes, would anyone please provide the documnetation links for the same? Thanks in advance.12:58
*** openstackgerrit has quit IRC13:02
*** openstackgerrit has joined #openstack-rally13:03
*** MaxPC has joined #openstack-rally13:05
*** rook-laptop has joined #openstack-rally13:08
*** tosky has joined #openstack-rally13:17
yfriedamaretskiy: andreykurilin: re https://bugs.launchpad.net/rally/+bug/151017513:27
openstackLaunchpad bug 1510175 in Rally "Rally task detailed 95%ile Response Times different from HTML graphics report" [High,Triaged]13:27
yfriedwhich value is the right one? HTML or JSON?13:27
amaretskiyyfried: JSON shoudl have the same value as in HTML13:28
amaretskiyyfried: because JSON data is calculated after we get all task results, but HTML calculates it on-the-fly, so this allows to process huge amount of data without high memory usage13:29
yfriedamaretskiy: the bug says they are different, so I'm wondering which is the right one13:30
amaretskiyyfried: here is the place whare stats is calculated for html: https://github.com/openstack/rally/blob/master/rally/task/processing/plot.py#L2813:30
*** neeti has quit IRC13:30
amaretskiyyfried: truthfully speaking - JSON is more accurate, but it does not have streaming calculation, so HTML-way is better13:31
amaretskiyyfried, the difference is rather small so HTML-way is the best13:31
amaretskiytask results (JSON) uses deprecated way and should be improved to streaming processing (like "task report" does)13:32
amaretskiyyfried https://github.com/openstack/rally/blob/master/rally/task/processing/plot.py#L72-L7413:33
yfriedrook: ^13:33
rookamaretskiy: interesting, so automating the results is a bit difficult then since we cannot rely on the stdout results.13:34
rookamaretskiy: to automate this work, we should pull the json, and calculate that way.13:35
amaretskiyrook: the difference between non-streaming calculation and streaming one is small13:35
rookamaretskiy: i disagree,.13:35
rookamaretskiy we have seen quite the difference, as well as the success rate being totally incorrect.13:35
amaretskiyrook: streaming processing can be improved to become very accurate13:35
rookthe stdout will show 100% for one test, but the HTML report will report 88% for the same test.13:36
amaretskiy rook: in any case we MUST use streaming data processing because of possible memory usage issues while processing thousands of iterations13:36
amaretskiyrook: this is a topic to improve streaming calculation, not switch back to old solution13:37
amaretskiyrook: here is a streaming processing class for statistics https://github.com/openstack/rally/blob/master/rally/task/processing/charts.py#L351-L38413:38
rookamaretskiy: so, it is recommended to ditch the stdout results, and use the JSON output13:38
amaretskiyrook: discuss this with boris-42, I'm sure he will say that we must use streaming processing13:39
rookamaretskiy: i am of the opinion to pull the raw data myself to avoid any changes that could occur within Rally.13:40
rookamaretskiy -- which would mean i could dump the JSON and import that into python/perl/etc and calculate, right?13:41
amaretskiywe have a feature of custom output tables/charts for that - you can generate arbitrary charts by the scenario13:41
rookamaretskiy: example?13:41
*** yingjun has quit IRC13:41
*** yingjun has joined #openstack-rally13:42
amaretskiyrook: http://logs.openstack.org/77/274977/5/check/gate-rally-dsvm-rally/34e285e/rally-plot/results.html.gz#/Dummy.dummy_output/output13:42
amaretskiyrook: this is relatively new improvement :)13:42
amaretskiyrook: her eis how these tables/charts are generated https://github.com/openstack/rally/blob/master/rally/plugins/common/scenarios/dummy/dummy.py#L84-L13813:43
rookamaretskiy: how do I generate results like this?13:43
rookamaretskiy: this is nice - would be great if we could start using this - instead of generating our graphs outside of Raly13:44
openstackgerritSteve Wilkerson proposed openstack/rally: Removed mutable default argument  https://review.openstack.org/27570313:44
amaretskiyrook: there is an improvement upcoming: https://review.openstack.org/#/c/272989/213:44
rookamaretskiy can we do run to run compares?13:44
amaretskiyrook: http://logs.openstack.org/89/272989/2/check/gate-rally-dsvm-rally/9e663dd/rally-plot/results.html.gz#/Dummy.dummy_output/output13:45
amaretskiyrook: not clear, please explain13:45
amaretskiyrook: compare scenarios runs?13:45
andreykurilinamaretskiy: if the difference between streaming processing and old way is in 12%(even sometimes), our streaming algorithms su*k.13:46
rookamaretskiy correct, lets say I run a scenario with OpenStack default config... Then I make a change to the OpenStack env, re-run the scenario - Now, I want to compare the two to show the difference.13:46
*** yingjun has quit IRC13:46
amaretskiyrook: the feature you asking is on my development right now - it even possible that I submit a first patch set today :)13:47
*** baohua has joined #openstack-rally13:48
rookamaretskiy cool13:48
amaretskiyrook: streaming calculation must be improved, not thrown out13:48
rookamaretskiy we would make use of that in Browbeat -- we are wrapping different Rally scenarios with changes to the infrastructure to show how those changes impact the env.13:48
amaretskiyrook: here is a causer https://github.com/openstack/rally/blob/master/rally/common/streaming_algorithms.py#L154-L18113:49
rookright now we are building the graphs external to Rally13:49
rookbut we have been using the stdout results...13:49
rookwhich has been a thorn in our side.13:49
amaretskiyrook: you need to have all the graphs in rally html report, right?13:50
rookamaretskiy: nope, not necessarily.13:51
openstackgerritChris St. Pierre proposed openstack/rally: Add wrapper for Glance API versions  https://review.openstack.org/26496413:52
amaretskiyrook: feel free to discuss with me any problems/features related to reports13:53
amaretskiyrook: right now I'm not planning to fix streaming calculation (working on another high priority task), but this is an important task for close future13:54
*** abehl has joined #openstack-rally13:56
openstackgerritChris St. Pierre proposed openstack/rally: Create new types.convert()  https://review.openstack.org/24946214:02
openstackgerritChris St. Pierre proposed openstack/rally: Convert ResourceType classes to plugins  https://review.openstack.org/24946314:02
openstackgerritChris St. Pierre proposed openstack/rally: Convert existing scenarios to new types plugins  https://review.openstack.org/24946414:02
rookamaretskiy can you please at least document the issue on readthedocs?14:07
rookamaretskiy: and mention which source is the *right* source to use.14:07
rookgiven the issue?14:07
rookI think that might be a good first step.14:07
amaretskiyrook: I think that this info is for launchpad bug, not docs14:08
amaretskiyI will add a comment to a bug on launchpad14:08
amaretskiyrook: maybe discuss this on our weekly rally meeting?14:09
amaretskiyrook https://wiki.openstack.org/wiki/Meetings/Rally14:10
rookamaretskiy i think it is important for users to understand that they *will* see a difference. it is totally confusing and gives users a lack of confidence in the numbers rally generates.14:10
rookwhich, that is the most important thing to Rally, is the results it generates.14:10
*** rvasilets has joined #openstack-rally14:12
rookamaretskiy do you disagree?14:17
amaretskiyrook: agree about bug priority, not about mentioning the bug in documentation14:17
amaretskiyrook: we have special resource for management bugs14:18
amaretskiyrook: I've added a descriptive comment to bug14:19
rookalright...14:19
rookguess we can agree to disagree ;P14:20
amaretskiyrook: :)14:20
amaretskiyrook: let's talk about this on our weekly meeting14:20
*** jjmb has quit IRC14:21
amaretskiyroot: meeting is a great place because most members of rally team can participate14:21
amaretskiy*rook14:21
rooksure, ill think about joining :)14:21
rooki used to join - but got buried with other things14:22
amaretskiyrook: great :)14:22
amaretskiyrook: great :)  <-- abiut joining14:22
amaretskiy*about14:22
*** absubram has joined #openstack-rally14:33
*** absubram_ has joined #openstack-rally14:34
openstackgerritPiyush Raman Srivastava proposed openstack/rally: Add list subnets/routers/FIPs to NetworkWrapper  https://review.openstack.org/27225114:36
*** absubram has quit IRC14:38
*** absubram_ is now known as absubram14:38
*** baohua has quit IRC14:50
*** redixin has joined #openstack-rally14:57
redixinhiyo14:59
ikhudoshynhi redixin14:59
*** ylobankov has joined #openstack-rally15:02
*** adiantum has quit IRC15:13
*** boris-42 has joined #openstack-rally15:16
*** ylobanko_ has joined #openstack-rally15:17
*** ylobankov has quit IRC15:17
*** baker has joined #openstack-rally15:27
*** harshs has joined #openstack-rally15:30
*** fsopenstack has joined #openstack-rally15:35
*** arnoldje has joined #openstack-rally15:41
*** fsopenstack has quit IRC15:41
*** tfreger has quit IRC15:49
*** absubram has quit IRC15:58
*** paco20151113 has quit IRC16:04
*** yfried has quit IRC16:08
ikhudoshynboris-42: andreykurilin redixin amaretskiy rvasilets guys! this is to enable keystone v3 api by default and add dedicated v2 job https://review.openstack.org/#/c/274668/16:08
ikhudoshynplease come and look! I'd like to be sure it's fine for us before I ping infra team16:09
ikhudoshynand pls don't forget https://review.openstack.org/#/c/274700/16:10
*** yfried has joined #openstack-rally16:12
*** fsopenstack has joined #openstack-rally16:13
rvasiletsok16:13
*** baker has quit IRC16:14
*** fsopenstack has quit IRC16:16
*** fsopenstack has joined #openstack-rally16:17
*** yfried has quit IRC16:18
*** fsopenstack has quit IRC16:21
*** yfried has joined #openstack-rally16:21
*** fsopenstack has joined #openstack-rally16:22
*** rook-laptop has quit IRC16:24
*** baker has joined #openstack-rally16:25
*** agrebennikov has joined #openstack-rally16:30
*** rook-laptop has joined #openstack-rally16:31
*** shausy has joined #openstack-rally16:34
*** anshul has quit IRC16:39
*** abehl has quit IRC16:39
*** NikitaKonovalov has quit IRC16:47
*** aarefiev has quit IRC16:48
*** aarefiev has joined #openstack-rally16:48
*** NikitaKonovalov has joined #openstack-rally16:49
*** cmkirkla has joined #openstack-rally16:52
*** e0ne has quit IRC16:59
*** itlinux has quit IRC17:02
agrebennikovboris-42, any suggestions on my problem?17:05
*** adiantum has joined #openstack-rally17:10
*** yfried_ has joined #openstack-rally17:11
*** tosky has quit IRC17:12
*** yfried has quit IRC17:14
*** absubram has joined #openstack-rally17:14
*** mvk_ has quit IRC17:16
*** fsopenstack has quit IRC17:22
*** baker has quit IRC17:23
*** baker has joined #openstack-rally17:24
*** baker has quit IRC17:26
*** cmkirkla has quit IRC17:28
*** cmkirkla has joined #openstack-rally17:30
*** anshul has joined #openstack-rally17:37
*** abehl has joined #openstack-rally17:37
*** harshs has quit IRC17:41
*** fsopenstack has joined #openstack-rally17:44
*** yfried_ has quit IRC17:51
*** madhu_ak has joined #openstack-rally17:59
*** josdotso has joined #openstack-rally18:02
*** arxcruz has quit IRC18:02
*** baker has joined #openstack-rally18:02
*** ylobanko_ has quit IRC18:03
*** rook-laptop has quit IRC18:16
*** shausy has quit IRC18:20
*** e0ne has joined #openstack-rally18:24
*** pvaneck has joined #openstack-rally18:27
*** rook-laptop has joined #openstack-rally18:37
*** mvk_ has joined #openstack-rally18:41
*** psuriset has quit IRC18:45
*** josdotso has quit IRC18:46
*** yfried_ has joined #openstack-rally18:58
*** cmkirkla has quit IRC19:00
*** harshs has joined #openstack-rally19:01
*** cmkirkla has joined #openstack-rally19:08
*** ylobankov has joined #openstack-rally19:10
*** rook-laptop has quit IRC19:12
*** absubram has quit IRC19:19
*** e0ne has quit IRC19:35
*** cmkirkla has quit IRC19:35
*** rook-laptop has joined #openstack-rally19:37
*** ylobankov has quit IRC19:40
*** boris-42 has quit IRC19:43
*** kjorgensen has joined #openstack-rally19:44
*** ylobankov has joined #openstack-rally19:44
*** cmkirkla has joined #openstack-rally19:47
*** abehl has quit IRC19:48
*** anshul has quit IRC19:48
*** Aish has joined #openstack-rally19:49
*** ylobankov has quit IRC19:56
*** absubram has joined #openstack-rally20:01
*** cmkirkla has quit IRC20:02
*** ningy has joined #openstack-rally20:12
ningy@here could anyone point me to an example of using ddt module?20:21
*** akrzos_ has joined #openstack-rally20:31
*** akrzos has quit IRC20:32
*** psuriset has joined #openstack-rally20:35
redixinningy: https://github.com/openstack/rally/blob/master/tests/unit/plugins/openstack/scenarios/neutron/test_network.py#L354-L37120:36
redixinningy: it will call test_create_and_list_floating_ips twice passing different arguments (listed in @ddt.data)20:37
ningythanks @redixin20:40
*** Aish has quit IRC20:44
*** Aish has joined #openstack-rally20:45
*** absubram has quit IRC20:55
*** boris-42 has joined #openstack-rally21:14
*** psuriset has quit IRC21:18
*** psuriset has joined #openstack-rally21:37
*** psuriset has quit IRC21:50
*** madhu_ak has quit IRC21:51
*** ylobankov has joined #openstack-rally21:52
*** madhu_ak has joined #openstack-rally21:55
*** psuriset has joined #openstack-rally22:03
*** kjorgensen has quit IRC22:06
*** psuriset has quit IRC22:19
*** rook-laptop has quit IRC22:30
*** ylobankov has quit IRC22:30
*** psuriset has joined #openstack-rally22:32
*** ylobankov has joined #openstack-rally22:45
*** psuriset has quit IRC22:46
*** MaxPC has quit IRC22:48
*** rook-laptop has joined #openstack-rally22:55
*** arnoldje has quit IRC23:06
*** kjorgensen has joined #openstack-rally23:07
*** absubram has joined #openstack-rally23:09
*** baker has quit IRC23:14
*** ningy has quit IRC23:22
*** e0ne has joined #openstack-rally23:24
*** MaxPC has joined #openstack-rally23:24
*** e0ne has quit IRC23:33
openstackgerritMerged openstack/rally: Removed mutable default argument  https://review.openstack.org/27570323:35
*** ylobankov has quit IRC23:43
*** MaxPC has quit IRC23:45

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!