Tuesday, 2015-04-21

*** openstack has joined #openstack-rally00:36
*** davideagnello has quit IRC01:18
openstackgerritPavel Boldin proposed openstack/rally: Refactor run_command_over_ssh, add script_args  https://review.openstack.org/17337101:21
openstackgerritPavel Boldin proposed openstack/rally: Add `LogCatcher' context  https://review.openstack.org/17445401:21
*** mwagner_lap has joined #openstack-rally01:37
*** echoingumesh has quit IRC02:04
*** echoingumesh has joined #openstack-rally02:04
*** echoingumesh has quit IRC02:09
*** softCloud has quit IRC02:29
*** harlowja is now known as harlowja_away02:35
*** harlowja_away is now known as harlowja02:37
*** PerfBeing has joined #openstack-rally02:38
*** exploreshaifali has quit IRC02:46
*** exploreshaifali has joined #openstack-rally02:47
*** PerfBeing has quit IRC02:54
*** PerfBeing has joined #openstack-rally02:55
*** PerfBeing has quit IRC02:59
*** Lily__ has quit IRC03:00
*** exploreshaifali has quit IRC03:30
*** tfreger has joined #openstack-rally03:43
*** harlowja is now known as harlowja_away03:56
*** panbalag has quit IRC04:10
*** yfried|afk is now known as yfried__04:18
*** davideagnello has joined #openstack-rally04:19
*** pradeep1 has quit IRC04:21
*** echoingumesh has joined #openstack-rally04:23
*** davideagnello has quit IRC04:24
*** echoingumesh has quit IRC04:29
*** echoingumesh has joined #openstack-rally04:30
*** davideagnello has joined #openstack-rally04:33
*** echoingumesh has quit IRC04:34
*** yfried__ is now known as yfried|afk04:36
*** yfried|afk is now known as yfried__04:38
*** rdas has joined #openstack-rally04:42
*** pradeep has joined #openstack-rally04:45
*** yfried__ is now known as yfried|afk04:52
*** PerfBeing has joined #openstack-rally04:57
*** yfried|afk is now known as yfried__05:01
*** vkmc has quit IRC05:02
*** vkmc has joined #openstack-rally05:08
*** davideagnello has quit IRC05:19
*** PerfBeing has quit IRC05:29
*** PerfBeing has joined #openstack-rally05:29
*** afazekas has quit IRC05:31
*** PerfBeing has quit IRC05:34
*** neeti has joined #openstack-rally05:42
*** anshul has joined #openstack-rally05:43
*** yfried__ has quit IRC05:44
*** echoingumesh has joined #openstack-rally05:55
*** echoingumesh has quit IRC06:00
*** echoingumesh has joined #openstack-rally06:04
*** rdas has quit IRC06:19
*** nkhare has joined #openstack-rally06:20
*** rdas has joined #openstack-rally06:22
*** yfried__ has joined #openstack-rally06:33
*** rdas has quit IRC06:45
*** yfried__ is now known as yfried|afk06:47
*** yfried|afk is now known as yfried__06:59
*** echoingumesh has quit IRC07:01
*** echoingumesh has joined #openstack-rally07:02
*** echoingumesh has quit IRC07:07
*** pcaruana has quit IRC07:11
openstackgerritPradeep K Surisetty proposed openstack/rally: Add shelve and unshelve scenario  https://review.openstack.org/17575107:38
*** tfreger1 has joined #openstack-rally07:48
*** tfreger has quit IRC07:49
*** arxcruz has joined #openstack-rally07:49
*** pradeep has quit IRC07:50
*** karimb has joined #openstack-rally07:53
*** pradeep has joined #openstack-rally07:54
*** Miouge has joined #openstack-rally07:58
*** pbandzi has joined #openstack-rally08:17
*** rdas has joined #openstack-rally08:25
*** e0ne has joined #openstack-rally08:34
*** coolsvap|afk is now known as coolsvap08:45
*** coolsvap is now known as coolsvap|afk08:46
*** fhubik has joined #openstack-rally08:50
openstackgerritPradeep K Surisetty proposed openstack/rally: Add Nova shelve and unshelve scenario  https://review.openstack.org/17575108:52
*** fhubik is now known as fhubik_afk09:06
*** pbandzi has quit IRC09:19
*** pbandzi has joined #openstack-rally09:20
*** yfried__ is now known as yfried|afk09:21
openstackgerritCyril Roelandt proposed openstack/rally: task report: generate a JUnit report  https://review.openstack.org/17166409:26
*** fhubik_afk is now known as fhubik09:30
*** tosky has joined #openstack-rally09:34
*** yfried|afk is now known as yfried__09:34
openstackgerritPradeep K Surisetty proposed openstack/rally: Add Nova shelve and unshelve scenario  https://review.openstack.org/17575109:36
*** yfried__ is now known as yfried|afk09:48
*** yfried|afk is now known as yfried__09:50
*** cdent has joined #openstack-rally09:59
*** yfried__ is now known as yfried|afk10:01
*** e0ne is now known as e0ne_10:02
*** e0ne_ is now known as e0ne10:04
*** oanufriev has joined #openstack-rally10:04
*** boris-42 has quit IRC10:05
*** tfreger1 has quit IRC10:08
*** boris-42 has joined #openstack-rally10:08
*** msdubov_ has joined #openstack-rally10:09
*** yfried|afk is now known as yfried__10:13
openstackgerritPradeep K Surisetty proposed openstack/rally: Add Nova shelve and unshelve scenario  https://review.openstack.org/17575110:16
*** neeti has quit IRC10:18
*** igormarnat is now known as imarnat10:19
*** tfreger has joined #openstack-rally10:21
*** pbandzi has quit IRC10:24
*** pbandzi has joined #openstack-rally10:25
*** kkuznetsova has joined #openstack-rally10:28
*** imarnat is now known as igormarnat10:30
*** e0ne is now known as e0ne_10:33
*** e0ne_ is now known as e0ne10:34
*** igormarnat is now known as imarnat10:34
*** fhubik is now known as fhubik_afk10:40
*** imarnat is now known as igormarnat10:41
*** igormarnat is now known as imarnat10:51
*** imarnat is now known as igormarnat10:52
*** igormarnat is now known as imarnat10:56
*** imarnat is now known as igormarnat10:57
kkuznetsovaHi, colleagues. Can you help me? How can I run scenario with user with member or admin role?10:58
*** tosky_ has joined #openstack-rally11:02
*** tosky_ has quit IRC11:02
*** tosky has quit IRC11:03
svashekasomehow use admin_clients or clients base on something)11:04
svashekaguys right now it's impossible to submit review request to rally gerrit11:06
svashekaI believe it's cause of change of repo url11:06
svashekaso probably this should be changed in gerrit also11:06
svashekaor it could be my local issue?11:07
*** tosky has joined #openstack-rally11:07
openstackgerritsvasheka proposed openstack/rally: Add keystone create_update_and_delete_tenant scenario  https://review.openstack.org/16545011:07
*** panbalag has joined #openstack-rally11:08
openstackgerritBoris Pavlovic proposed openstack/rally: [DO NOT MERGE] Testing coverage job  https://review.openstack.org/17555811:08
openstackgerritBoris Pavlovic proposed openstack/rally: Improve coverage job  https://review.openstack.org/17555711:08
boris-42msdubov_: ^11:16
msdubov_boris-42 thanks11:17
*** igormarnat is now known as imarnat11:20
*** redixin has joined #openstack-rally11:27
openstackgerritCyril Roelandt proposed openstack/rally: task report: generate a JUnit report  https://review.openstack.org/17581711:29
openstackgerritCyril Roelandt proposed openstack/rally: task report: generate a JUnit report  https://review.openstack.org/17166411:31
*** mwagner_lap has quit IRC11:38
openstackgerritPavel Boldin proposed openstack/rally: Refactor run_command_over_ssh, add script_args  https://review.openstack.org/17337111:43
openstackgerritPavel Boldin proposed openstack/rally: Refactor run_command_over_ssh, add script_args  https://review.openstack.org/17337111:44
boris-42msdubov_: nope11:48
boris-42msdubov_: I mean comments above11:48
boris-42msdubov_: with questions11:48
*** nkhare has quit IRC11:49
msdubov_svasheka, seems like you have solved the problem?11:51
msdubov_svasheka, Anyway one of the options is to clone the repo from openstack11:51
msdubov_svasheka, And just "git fetch ..." your patch from gerrit using the link provided by review.openstack.org on the page of your patch11:52
*** fhubik_afk is now known as fhubik11:53
*** yingjun has joined #openstack-rally11:54
msdubov_kkuznetsova, Rally has the "roles" context that may help you11:54
msdubov_kkuznetsova, https://github.com/openstack/rally/blob/master/rally/benchmark/context/roles.py11:54
*** softCloud has joined #openstack-rally11:55
kkuznetsovaOK, thanks11:55
*** pradeep has quit IRC11:57
*** tfreger has quit IRC12:01
openstackgerritAlexander Gubanov proposed openstack/rally: Adds Nova floating IPs bulk tests  https://review.openstack.org/16805412:07
openstackgerritBoris Pavlovic proposed openstack/rally: [DO NOT MERGE] Testing coverage job  https://review.openstack.org/17555812:14
openstackgerritBoris Pavlovic proposed openstack/rally: Improve coverage job  https://review.openstack.org/17555712:14
openstackgerritBoris Pavlovic proposed openstack/rally: [DO NOT MERGE] Testing coverage job  https://review.openstack.org/17555812:16
openstackgerritBoris Pavlovic proposed openstack/rally: Improve coverage job  https://review.openstack.org/17555712:16
*** tfreger has joined #openstack-rally12:18
*** mwagner_lap has joined #openstack-rally12:19
*** aix has joined #openstack-rally12:21
*** yingjun has quit IRC12:22
openstackgerritBoris Pavlovic proposed openstack/rally: [DO NOT MERGE] Testing coverage job  https://review.openstack.org/17555812:25
openstackgerritBoris Pavlovic proposed openstack/rally: Improve coverage job  https://review.openstack.org/17584112:25
*** yingjun has joined #openstack-rally12:27
*** pradeep has joined #openstack-rally12:27
openstackgerritBoris Pavlovic proposed openstack/rally: [DO NOT MERGE] Testing coverage job  https://review.openstack.org/17555812:28
openstackgerritBoris Pavlovic proposed openstack/rally: Improve coverage job  https://review.openstack.org/17584112:28
*** yingjun has quit IRC12:28
yfried__boris-42: do we have a mtg today?12:33
boris-42yfried__: yes12:34
yfried__boris-42: what time?12:34
yfried__boris-42: agenda?12:34
boris-42yfried__: previous one12:34
boris-42yfried__: no agenda yet12:34
yfried__boris-42: :(:(12:34
boris-42yfried__: we should make some corrections12:34
boris-42yfried__: I will write in mailing list12:34
yfried__boris-42: I assume you have SOME agenda for tonight. could you please post is somewher?12:35
yfried__boris-42: I'm hitting this error Invalid scenario argument: 'Could not open samples/tasks/support/instance_dd_test.sh with mode 4 for parameter script'12:36
yfried__trying to execute a script from cloned setup. what's up with that?12:37
boris-42yfried__: maybe some bugs12:38
boris-42yfried__: have to go12:38
*** imarnat is now known as igormarnat12:59
*** pbandzi has quit IRC13:00
*** igormarnat is now known as imarnat13:03
*** e0ne is now known as e0ne_13:04
*** e0ne_ is now known as e0ne13:06
*** kiran-r has joined #openstack-rally13:11
openstackgerritChris St. Pierre proposed openstack/rally: Add scenario to modify Cinder volume metadata  https://review.openstack.org/17489413:14
*** e0ne is now known as e0ne_13:16
*** tfreger has quit IRC13:17
*** anshul has quit IRC13:20
*** e0ne_ is now known as e0ne13:21
openstackgerritCyril Roelandt proposed openstack/rally: task report: generate a JUnit report  https://review.openstack.org/17166413:22
*** e0ne is now known as e0ne_13:26
*** e0ne_ is now known as e0ne13:26
*** imarnat is now known as igormarnat13:29
*** igormarnat is now known as imarnat13:31
*** kiran-r has quit IRC13:37
openstackgerritVadim Rovachev proposed openstack/rally: Fix validation for rps parameter  https://review.openstack.org/17016013:39
openstackgerritSergey Skripnick proposed openstack/rally: Improve coverage job  https://review.openstack.org/17555713:46
openstackgerritSergey Skripnick proposed openstack/rally: Add new script for rally-gate jobs  https://review.openstack.org/17554913:56
openstackgerritSergey Skripnick proposed openstack/rally: Fix creating user in keystone v3 wrapper  https://review.openstack.org/17550413:56
openstackgerritSergey Skripnick proposed openstack/rally: Improve coverage job  https://review.openstack.org/17584113:56
openstackgerritArx Cruz proposed openstack/rally: Adding FunctionalMixin class  https://review.openstack.org/14683814:01
openstackgerritMike Durnosvistov proposed openstack/rally: Server block migration scenario  https://review.openstack.org/17587514:04
*** nkhare has joined #openstack-rally14:06
*** msdubov_ has quit IRC14:07
arxcruzandreykurilin, that was really fast :D14:08
andreykurilinarxcruz: ;)14:08
yfried__andreykurilin: do you have agenda for tonight's mtg?14:10
andreykurilinyfried__: hi. no:( I think the main topics will be "news about stackforge/rally->openstack/rally", "new time for meeting" and "where will be agenda for meetings placed and who will manage it"14:13
yfried__andreykurilin: ok, I probably won't attend - memorial day here14:13
andreykurilinyfried__: ok14:15
*** karimb has quit IRC14:15
*** karimb has joined #openstack-rally14:16
*** imarnat is now known as igormarnat14:19
*** igormarnat is now known as imarnat14:19
openstackgerritSergey Skripnick proposed openstack/rally: Improve coverage job  https://review.openstack.org/17584114:28
openstackgerritAlexander Gubanov proposed openstack/rally: Adds Nova floating IPs bulk tests  https://review.openstack.org/16805414:37
openstackgerritSergey Skripnick proposed openstack/rally: Improve coverage job  https://review.openstack.org/17584114:48
openstackgerritBoris Pavlovic proposed openstack/rally: [DO NOT MERGE] Testing coverage job  https://review.openstack.org/17555814:49
*** rdas has quit IRC14:52
openstackgerritChris St. Pierre proposed openstack/rally: Add scenario to boot a server, lock it, unlock it, and delete it  https://review.openstack.org/17591214:53
*** stpierre has joined #openstack-rally14:54
*** imarnat is now known as igormarnat14:56
*** igormarnat is now known as imarnat14:59
*** jaypipes has quit IRC15:11
*** fhubik has quit IRC15:13
pradeepandreykurilin: boris-42: @ What time we have meeting?15:14
boris-42pradeep:  in 1 hrs and 45 mins15:15
boris-42pradeep: today15:15
*** arxcruz has quit IRC15:16
pradeepthanks15:17
openstackgerritSergey Skripnick proposed openstack/rally: [DO NOT MERGE] Testing coverage job  https://review.openstack.org/17555815:19
openstackgerritSergey Skripnick proposed openstack/rally: Improve coverage job  https://review.openstack.org/17584115:19
*** pradeep has quit IRC15:22
*** nkhare has quit IRC15:31
*** PerfBeing has joined #openstack-rally15:38
*** PerfBeing has quit IRC15:40
*** PerfBeing has joined #openstack-rally15:40
boris-42yfried__: so I will create wiki page with agendas15:41
*** andreykurilin__ has joined #openstack-rally15:41
*** yfried__ is now known as yfried|afk15:44
*** PerfBeing is now known as prashantS15:45
*** yfried|afk is now known as yfried__15:50
*** yfried__ has quit IRC15:55
*** prashantS has quit IRC16:14
*** prashantS has joined #openstack-rally16:15
*** prashantS has quit IRC16:19
*** davideagnello has joined #openstack-rally16:20
openstackgerritSergey Skripnick proposed openstack/rally: [DO NOT MERGE] Testing coverage job  https://review.openstack.org/17555816:27
openstackgerritSergey Skripnick proposed openstack/rally: Improve coverage job  https://review.openstack.org/17584116:27
openstackgerritSergey Skripnick proposed openstack/rally: Add new script for rally-gate jobs  https://review.openstack.org/17554916:28
openstackgerritSergey Skripnick proposed openstack/rally: Fix creating user in keystone v3 wrapper  https://review.openstack.org/17550416:28
openstackgerritSergey Skripnick proposed openstack/rally: WIP: Add manifest file and split jobs  https://review.openstack.org/17597316:28
meteorfoxboris-42: hey, I re-ran the test again. Here's the data16:29
meteorfoxhttps://gist.github.com/meteorfox/03063532e731adc9bc0c16:29
meteorfoxboris-42: much better16:29
meteorfoxboris-42: there's still overhead but not as a bad as before16:30
boris-42meteorfox: yep16:30
*** jaypipes has joined #openstack-rally16:30
boris-42meteorfox: rally is bad when duration is 1ms16:30
*** exploreshaifali has joined #openstack-rally16:30
meteorfoxboris-42: yeah, I know python overhead, and data transformation dominates and that scale16:31
meteorfox*at that scale16:31
meteorfoxboris-42: so how can we solve this generally16:31
meteorfox?16:32
meteorfoxcreate_network incurs the keystone call, but delete does not16:32
*** pradeep has joined #openstack-rally16:35
*** imarnat is now known as igormarnat16:39
*** msdubov_ has joined #openstack-rally16:39
*** exploreshaifali has quit IRC16:40
*** e0ne has quit IRC16:45
*** pradeep has quit IRC16:49
meteorfoxboris-42:  the problem seems to me that we are measuring too high on the stack (of level of abstractions). If we could somehow get the timings just before sending the request and receiving the response16:49
meteorfoxboris-42: my concern is that the client could also introduce regressions16:50
*** prashantS has joined #openstack-rally16:53
openstackgerritMerged openstack/rally: Add keystone create_update_and_delete_tenant scenario  https://review.openstack.org/16545016:55
openstackgerritMerged openstack/rally: Add Nova shelve and unshelve scenario  https://review.openstack.org/17575116:57
openstackgerritMerged openstack/rally: [Docs] Various fixes  https://review.openstack.org/17463916:57
*** harlowja_away is now known as harlowja16:57
*** karimb has quit IRC16:57
boris-42meteorfox: meeting17:03
boris-42kun_huang: meeting17:03
boris-42meteorfox: I will takl about this afert meeting17:04
meteorfoxboris-42: ok17:04
boris-42I want all *17:04
boris-42in IRC17:04
boris-42stpierre: softCloud serverascode rmk redixin ptoohill prashantS  panbalag oanufriev nithyag_  and others meeting in #openstack-meeting17:05
boris-42jseutter: jlk frickler frickler dmellado darkhuy ^17:06
boris-42apal: akuznetsova aix ^17:06
openstackgerritSergey Skripnick proposed openstack/rally: [DO NOT MERGE] Testing coverage job  https://review.openstack.org/17555817:19
openstackgerritSergey Skripnick proposed openstack/rally: Improve coverage job  https://review.openstack.org/17584117:19
*** igormarnat is now known as imarnat17:22
boris-42#startmeeting testing17:25
openstackMeeting started Tue Apr 21 17:25:51 2015 UTC and is due to finish in 60 minutes.  The chair is boris-42. Information about MeetBot at http://wiki.debian.org/MeetBot.17:25
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.17:25
openstackThe meeting name has been set to 'testing'17:25
boris-42#endmeeting17:25
openstackMeeting ended Tue Apr 21 17:25:58 2015 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)17:26
openstackMinutes:        http://eavesdrop.openstack.org/meetings/testing/2015/testing.2015-04-21-17.25.html17:26
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/testing/2015/testing.2015-04-21-17.25.txt17:26
openstackLog:            http://eavesdrop.openstack.org/meetings/testing/2015/testing.2015-04-21-17.25.log.html17:26
boris-42^ lol it works17:26
meteorfoxlol17:26
*** msdubov_ has quit IRC17:27
*** tosky has quit IRC17:29
*** msdubov_ has joined #openstack-rally17:29
*** e0ne has joined #openstack-rally17:33
*** e0ne is now known as e0ne_17:33
*** e0ne_ is now known as e0ne17:34
*** imarnat is now known as igormarnat17:36
*** aix has quit IRC17:37
*** e0ne is now known as e0ne_17:44
openstackgerritChris St. Pierre proposed openstack/rally: Add Nova lock and unlock scenario  https://review.openstack.org/17591217:45
*** e0ne_ is now known as e0ne17:45
*** msdubov_ has quit IRC17:50
*** e0ne is now known as e0ne_17:51
meteorfoxboris-42: hey, I'm going to grab something to eat now17:51
boris-42meteorfox: sure17:52
*** e0ne_ has quit IRC17:56
*** yfried__ has joined #openstack-rally17:56
*** igormarnat is now known as imarnat17:57
*** echoingumesh has joined #openstack-rally17:59
openstackgerritSergey Skripnick proposed openstack/rally: Improve coverage job  https://review.openstack.org/17584118:03
*** cdent has quit IRC18:03
*** e0ne has joined #openstack-rally18:10
*** prashantS has quit IRC18:18
*** prashantS has joined #openstack-rally18:19
*** prashantS has quit IRC18:21
*** prashantS has joined #openstack-rally18:21
davideagnelloboris-42: when running benchmarks in a task, is there any way to extract logs from your test target openstack through rally?18:36
*** openstackgerrit has quit IRC18:37
*** openstackgerrit has joined #openstack-rally18:37
*** davideagnello has quit IRC18:41
*** davideagnello has joined #openstack-rally18:44
openstackgerritSergey Skripnick proposed openstack/rally: [DO NOT MERGE] Testing coverage job  https://review.openstack.org/17555818:48
openstackgerritSergey Skripnick proposed openstack/rally: Improve coverage job  https://review.openstack.org/17584118:48
*** pbandzi has joined #openstack-rally18:49
openstackgerritSergey Skripnick proposed openstack/rally: Fix creating user in keystone v3 wrapper  https://review.openstack.org/17550418:50
*** redixin has quit IRC18:50
*** darkhuy has quit IRC19:00
*** darkhuy has joined #openstack-rally19:01
*** prashant_ has joined #openstack-rally19:15
*** prashantS has quit IRC19:18
*** psd has joined #openstack-rally19:20
*** imarnat is now known as igormarnat19:30
*** prashant_ has quit IRC19:31
*** prashantS has joined #openstack-rally19:32
*** prashantS has quit IRC19:36
*** echoingumesh has quit IRC19:56
*** echoingumesh has joined #openstack-rally19:57
*** echoingumesh has quit IRC20:01
*** prashantS has joined #openstack-rally20:01
*** prashantS has quit IRC20:05
*** prashantS has joined #openstack-rally20:06
*** echoingumesh has joined #openstack-rally20:07
*** andreykurilin__ has quit IRC20:09
*** andreykurilin__ has joined #openstack-rally20:12
*** e0ne is now known as e0ne_20:17
*** psd has quit IRC20:29
boris-42meteorfox: soo20:39
boris-42Miouge: you around?20:39
boris-42Miouge: sry20:39
boris-42meteorfox: you around?20:39
meteorfoxboris-42: yes20:39
boris-42meteorfox: so20:40
boris-42meteorfox: overhead is not created by rally or python or python clients20:40
boris-42meteorfox: overhead is related to keystone authentication that takes mesuarable time20:40
boris-42meteorfox: this can be imporved if we will use instead of users credentials token directly20:41
*** echoingumesh has quit IRC20:41
meteorfoxboris-42: well there is still 'overhead', after doing authentication first, it improved. But the response time reported is still 50% higher than what Gatling, and the neutron log reports20:42
meteorfoxboris-42: I think we are not measuring the 'right' thing20:42
meteorfoxboris-42: in my opinion, we should be as close as possible to the HTTP request call, unless it's an action that involves several http calls20:43
boris-42meteorfox: why?20:43
boris-42meteorfox: it is not real life usage20:43
boris-42meteorfox: measuring not real life usage is wasting time20:43
boris-42meteorfox: but I am not QA/Perf/Scale Engineer just dev20:44
meteorfoxboris-42: It's about reducing variables, and variance. The system under test is the openstack services, not the clients20:44
meteorfoxboris-42: not all interactions are with those clients libraries20:45
*** cdent has joined #openstack-rally20:45
meteorfoxboris-42: the problem with measuring at this 'level of abstraction' is that the layers below it can introduce performance regressions without us knowing20:47
meteorfoxboris-42: for example, somebody, accidentally could introduce a slow step in one of the Rally scenarios, or client abstractions20:48
meteorfoxboris-42: then one wastes times finding if it's a real regression or not20:48
*** pbandzi has quit IRC20:49
*** openstackgerrit has quit IRC20:52
*** openstackgerrit has joined #openstack-rally20:52
*** igormarnat is now known as imarnat21:00
boris-42meteorfox: waht I saw from real life is that21:02
*** psd_mo has joined #openstack-rally21:02
boris-42meteorfox: that python clients and rally are not the problem21:03
boris-42meteorfox: usually all issues and regressions are related to services21:03
boris-42meteorfox: so we are working on some http base for benchmarking21:03
boris-42meteorfox: but except few little case it won't make sense whether you are using python clients or directly http21:04
*** imarnat is now known as igormarnat21:05
*** igormarnat is now known as imarnat21:06
*** exploreshaifali has joined #openstack-rally21:07
meteorfoxboris-42: true. services are more likely to introduce regressions than clients, and/or rally21:07
meteorfoxboris-42: I think one way we could at least tackle this issue, is by somehow capturing the lower level timings21:08
meteorfoxboris-42: I think novaclient has --timings supports21:08
meteorfoxand can bubble up these timings21:08
*** imarnat is now known as igormarnat21:09
meteorfoxwe could still leave the measurements at the 'atomic_actions' level, but have the options to also gather the response times of the HTTP calls emitted from an atomic_action21:09
boris-42meteorfox: so me and andreykurilin21:09
boris-42meteorfox: were thinking about this21:10
boris-42meteorfox: unfortunately request lib doesn't support request handlers21:10
boris-42meteorfox: so it is quite hard to measure duration of HTTP requests21:10
boris-42meteorfox: but it will be really nice to collect such info as well21:10
meteorfoxboris-42: hmm... I see.\21:11
boris-42meteorfox: so maybe we can improve request lib21:12
meteorfoxboris-42: is this the python-requests library?21:13
boris-42meteorfox: https://github.com/kennethreitz/requests/21:14
boris-42meteorfox: ^ even openstack decided to use this and not reimplement own21:14
meteorfoxboris-42: ok21:14
meteorfoxboris-42: it's a very good library21:14
meteorfoxboris-42: we could this. http://docs.python-requests.org/en/latest/api/#requests.Response.elapsed21:16
meteorfoxuse*21:16
boris-42meteorfox: not sure how (in we don't touch clients)21:17
boris-42meteorfox: what about mokney patching this https://github.com/kennethreitz/requests/blob/master/requests/adapters.py#L323 ?)21:17
boris-42meteorfox: and localthread variable21:17
boris-42meteorfox: that will collect all requests from single thread?21:17
boris-42meteorfox: let me try21:19
meteorfoxboris-42: ok, the more I think about your suggestion of monkey patching, the more I think is the way to go21:29
*** e0ne_ has quit IRC21:31
openstackgerritBoris Pavlovic proposed openstack/rally: [WIP] Split Rally framework and plugins  https://review.openstack.org/17609221:38
boris-42meteorfox: so it is actually quite simple thing21:40
boris-42meteorfox: btw what do you think about that patch ^21:40
meteorfoxboris-42: cool21:41
boris-42meteorfox: that patch?21:41
* meteorfox checking cool patch that boris-42 wrote21:41
meteorfoxboris-42: those are just renames? is that the right patch?21:42
boris-42meteorfox: yep21:43
boris-42meteorfox: end patch will be just renames21:43
boris-42meteorfox: and in few places name changes21:43
boris-42the idea is to move all plugins from framework21:43
boris-42to separated place21:43
boris-42so the framework will be simpler to learn21:43
meteorfoxboris-42: ok, I thought this was related to the monkey patching21:43
boris-42nope21:44
meteorfoxboris-42: I think is a good idea. plus it helps with your other goals of separating rally-core from the extensions21:45
boris-42meteorfox: yep baby steps21:46
boris-42meteorfox: okay will ifnish this patch today soon21:46
meteorfoxboris-42: do you think 'context' should be plural, like 'contexts'21:46
boris-42idk=)21:46
*** karimb has joined #openstack-rally21:46
boris-42is it proper/21:46
boris-42not english expert21:46
boris-42meteorfox: ^21:47
*** mwagner_lap has quit IRC21:47
meteorfoxboris-42: i'm thinking that since that is package that contains multiple contexts, it should be name contexts21:47
meteorfoxboris-42: and 'contexts' is valid english21:47
boris-42meteorfox: ok then contexts21:48
*** stpierre has quit IRC21:50
*** harlowja is now known as harlowja_away22:00
*** harlowja_away is now known as harlowja22:05
*** andreykurilin__ has quit IRC22:14
*** prashantS has quit IRC22:25
*** prashantS has joined #openstack-rally22:25
*** prashantS has quit IRC22:30
*** mwagner_lap has joined #openstack-rally22:32
*** cdent has quit IRC22:35
*** prashantS has joined #openstack-rally22:44
openstackgerritSergey Skripnick proposed openstack/rally: [DO NOT MERGE] Testing coverage job  https://review.openstack.org/17555822:57
openstackgerritSergey Skripnick proposed openstack/rally: Improve coverage job  https://review.openstack.org/17584122:57
*** ibiris is now known as ibiris_away22:59
openstackgerritSergey Skripnick proposed openstack/rally: Add new script for rally-gate jobs  https://review.openstack.org/17554923:00
openstackgerritSergey Skripnick proposed openstack/rally: Fix creating user in keystone v3 wrapper  https://review.openstack.org/17550423:00
*** prashantS has quit IRC23:00
*** prashantS has joined #openstack-rally23:00
*** prashantS has quit IRC23:05
*** psd_mo has quit IRC23:05
*** darkhuy has quit IRC23:34
*** exploreshaifali has quit IRC23:44
*** rook_ has quit IRC23:49
openstackgerritSergey Skripnick proposed openstack/rally: [DO NOT MERGE] Testing coverage job  https://review.openstack.org/17555823:50
openstackgerritSergey Skripnick proposed openstack/rally: Improve coverage job  https://review.openstack.org/17584123:50
openstackgerritSergey Skripnick proposed openstack/rally: Fix creating user in keystone v3 wrapper  https://review.openstack.org/17550423:51
*** ibiris_away is now known as ibiris23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!