Tuesday, 2015-06-09

*** mahito has joined #openstack-rally00:08
*** suneelb has quit IRC00:14
*** dmorita has joined #openstack-rally00:15
openstackgerritPavel Boldin proposed openstack/rally: Add command-dict option to specify command args  https://review.openstack.org/17701600:31
openstackgerritPavel Boldin proposed openstack/rally: Add command_customizer context  https://review.openstack.org/18322700:31
openstackgerritPavel Boldin proposed openstack/rally: Add boot_runcommand_delete_custom_image scenario  https://review.openstack.org/18322800:31
openstackgerritPavel Boldin proposed openstack/rally: Make `boot_runcommand_delete' accept command-dict  https://review.openstack.org/17701400:31
openstackgerritPavel Boldin proposed openstack/rally: Add command-dict option to upload a local command  https://review.openstack.org/17701500:31
*** yingjun has joined #openstack-rally00:52
*** briandowns has joined #openstack-rally00:55
*** BitSmith has joined #openstack-rally01:00
*** yingjun has quit IRC01:10
*** yingjun has joined #openstack-rally01:10
openstackgerritJohn Wu proposed openstack/rally: [Swift] Add additional Swift scenarios  https://review.openstack.org/18579302:10
openstackgerritJohn Wu proposed openstack/rally: [Swift] Add objects context class  https://review.openstack.org/17957802:10
*** BitSmith has quit IRC02:15
*** georgem1 has joined #openstack-rally02:19
openstackgerritLi Yingjun proposed openstack/rally: Validate tenant related scenarios when using keystone v3  https://review.openstack.org/18132102:23
*** davideagnello has quit IRC02:35
*** davideagnello has joined #openstack-rally02:41
*** georgem1 has quit IRC02:45
*** mahito has quit IRC02:49
*** zhiyan has quit IRC03:06
*** meteorfox has quit IRC03:06
*** serverascode has quit IRC03:06
*** kun_huang has quit IRC03:07
*** MaxPC has joined #openstack-rally03:17
*** mahito has joined #openstack-rally03:21
*** kiran-r has joined #openstack-rally03:21
*** MaxPC has quit IRC03:22
*** harlowja has quit IRC03:22
*** harlowja_ has joined #openstack-rally03:22
*** mahito has quit IRC03:26
*** mahito has joined #openstack-rally03:47
*** coolsvap|afk is now known as coolsvap04:00
*** psuriset has joined #openstack-rally04:00
*** ajiang has left #openstack-rally04:08
*** yingjun has quit IRC04:08
*** kiran-r has quit IRC04:14
*** nihilifer has quit IRC04:16
*** kiran-r has joined #openstack-rally04:19
*** MaxPC has joined #openstack-rally04:19
*** MaxPC has quit IRC04:24
*** yfried has quit IRC04:27
*** aswadr has joined #openstack-rally04:40
*** psuriset has quit IRC04:44
*** tfreger has joined #openstack-rally04:53
*** yingjun has joined #openstack-rally04:56
*** psd has joined #openstack-rally04:58
*** mahito has quit IRC05:04
*** boris-42 has quit IRC05:04
*** mahito has joined #openstack-rally05:06
openstackgerritKiran proposed openstack/rally: Add validator to check parameter inside a dictionary argument  https://review.openstack.org/18833405:06
*** nihilifer has joined #openstack-rally05:08
openstackgerritKiran proposed openstack/rally: Add validator to check parameter inside a dictionary argument  https://review.openstack.org/18833405:09
openstackgerritKiran proposed openstack/rally: Add validator to check parameter inside a dictionary argument  https://review.openstack.org/18833405:13
*** yingjun_ has joined #openstack-rally05:17
*** yingjun has quit IRC05:17
*** mahito has quit IRC05:22
*** yingjun_ has quit IRC05:25
*** yfried has joined #openstack-rally05:27
*** e0ne has joined #openstack-rally05:29
*** kiranr has joined #openstack-rally05:33
*** kiranr has quit IRC05:35
*** kiranr has joined #openstack-rally05:35
*** rdas has joined #openstack-rally05:37
*** kiranr has quit IRC05:37
*** kiran-r has quit IRC05:37
*** kiranr has joined #openstack-rally05:37
*** kiranr has quit IRC05:41
*** mahito has joined #openstack-rally05:42
*** kiran-r has joined #openstack-rally05:42
*** kiran-r has quit IRC05:44
*** kiran-r has joined #openstack-rally05:44
*** mahito has quit IRC05:44
*** mahito has joined #openstack-rally05:45
*** kiran-r has quit IRC05:47
*** kiran-r has joined #openstack-rally05:47
*** e0ne has quit IRC05:47
*** kiran-r has quit IRC05:48
*** kiran-r has joined #openstack-rally05:48
*** pbandzi has joined #openstack-rally05:50
*** kiran-r has quit IRC05:50
*** mpopow has quit IRC05:50
*** kiran-r has joined #openstack-rally05:50
*** kiran-r has quit IRC05:54
*** kiran-r has joined #openstack-rally05:55
*** kiran-r has quit IRC05:55
*** kiran-r has joined #openstack-rally05:55
*** tfreger has quit IRC05:56
*** kiran-r has quit IRC05:56
*** kiran-r has joined #openstack-rally05:57
*** kiran-r has quit IRC05:58
*** kiran-r has joined #openstack-rally05:58
*** kiran-r has quit IRC05:59
*** kiran-r has joined #openstack-rally05:59
*** kiran-r has quit IRC06:00
*** kiran-r has joined #openstack-rally06:00
*** kiran-r has quit IRC06:00
*** kiran-r has joined #openstack-rally06:00
*** karmatronic has joined #openstack-rally06:01
*** kiran-r has quit IRC06:01
*** kiran-r has joined #openstack-rally06:01
*** kiran-r has quit IRC06:02
*** kiran-r has joined #openstack-rally06:02
*** kiran-r has quit IRC06:03
*** briandowns has quit IRC06:04
*** kiran-r has joined #openstack-rally06:05
*** kiran-r has quit IRC06:06
*** kiran-r has joined #openstack-rally06:06
*** karmatronic has quit IRC06:06
*** kiran-r has quit IRC06:07
*** kiran-r has joined #openstack-rally06:07
*** yingjun has joined #openstack-rally06:08
*** kiran-r has quit IRC06:09
*** kiran-r has joined #openstack-rally06:09
*** kiran-r has quit IRC06:14
*** kiran-r has joined #openstack-rally06:14
*** kiran-r has quit IRC06:18
*** kiran-r has joined #openstack-rally06:19
*** kiran-r has quit IRC06:21
*** kiran-r has joined #openstack-rally06:22
*** kiran-r has quit IRC06:23
*** kiran-r has joined #openstack-rally06:23
*** kiran-r has quit IRC06:26
*** kiran-r has joined #openstack-rally06:26
openstackgerritKiran proposed openstack/rally: Add validator to check parameter inside a dictionary argument  https://review.openstack.org/18833406:28
*** kiran-r has quit IRC06:28
*** kiran-r has joined #openstack-rally06:28
*** kiran-r has quit IRC06:29
*** kiran-r has joined #openstack-rally06:30
*** kiran-r has quit IRC06:30
*** kiran-r has joined #openstack-rally06:31
*** kiran-r has quit IRC06:31
*** kiran-r has joined #openstack-rally06:31
*** kiran-r has joined #openstack-rally06:32
*** serverascode has joined #openstack-rally06:37
*** anshul has joined #openstack-rally06:45
*** zhiyan has joined #openstack-rally06:46
*** kiran-r has quit IRC06:50
*** kiran-r has joined #openstack-rally06:50
*** kiran-r has quit IRC06:51
*** kiran-r has joined #openstack-rally06:51
*** kiran-r has quit IRC06:52
*** kiran-r has joined #openstack-rally06:52
*** kiran-r has joined #openstack-rally06:53
*** kiran-r has quit IRC06:53
*** kiran-r has joined #openstack-rally06:53
*** kiran-r has quit IRC06:55
*** kiran-r has joined #openstack-rally06:55
*** kiran-r has quit IRC06:56
*** kiran-r has joined #openstack-rally06:57
*** kiran-r has quit IRC06:58
*** kiran-r has joined #openstack-rally06:59
*** kiran-r has quit IRC07:00
*** kiran-r has joined #openstack-rally07:00
*** kiran-r has quit IRC07:00
*** arxcruz has joined #openstack-rally07:14
*** agarciam has joined #openstack-rally07:15
*** meteorfox has joined #openstack-rally07:15
yfriedyingjun: ping re https://review.openstack.org/#/c/187501/07:16
yingjunfried, sorry didn’t get the email.. will do07:17
*** yfried is now known as yfried|afk07:26
yingjunyfried|afk, reply inline07:27
*** yfried|afk is now known as yfried07:28
*** kun_huang has joined #openstack-rally07:28
*** pbandzi_ has joined #openstack-rally07:30
*** neeti has joined #openstack-rally07:32
yfriedyingjun: I'm looking at you comment again, and I think I've misled you07:32
*** pbandzi has quit IRC07:32
yfriedyingjun: the problem is in L7907:32
yfriedyingjun: it's trying to delete stuff that's already gone.07:33
yfriedyingjun: L94 is executed later07:34
yfriedyingjun: actually, in the problematic case, L94 isn't executed at all (try..else)07:34
yingjunyfried, what if is_deleted in line179 raised an exception, but the resource is still exist07:38
yfriedyingjun: if is_deleted() raises an exception, then the exception should be handled/raised as well as any kind fo exception. I don't understand the question07:41
*** PrashantS has joined #openstack-rally07:45
yingjunyfried, i mean if resource.delete() work but resource.is_deleted() broken as described in L98, self._delete_single_resource() will never be called, so the resource will never be deleted, right?07:49
*** cdent has joined #openstack-rally07:54
*** nkhare has joined #openstack-rally07:57
*** amaretskiy has joined #openstack-rally08:05
*** kiran-r has joined #openstack-rally08:07
*** PrashantS has quit IRC08:08
*** PrashantS has joined #openstack-rally08:09
*** kiran-r has quit IRC08:09
*** kiran-r has joined #openstack-rally08:09
*** fhubik has joined #openstack-rally08:12
*** kiran-r has quit IRC08:12
*** kiran-r has joined #openstack-rally08:12
*** kiran-r has quit IRC08:13
*** kiran-r has joined #openstack-rally08:13
*** PrashantS has quit IRC08:13
yfriedyingjun: you want to a try and invoke in case of exception? I'm open to other suggestions08:15
yingjunyfried, that’s what i mean:)08:17
*** kiran-r has quit IRC08:20
*** kiran-r has joined #openstack-rally08:20
*** karimb has joined #openstack-rally08:24
*** amalinow|2 has joined #openstack-rally08:25
*** karmatronic has joined #openstack-rally08:31
*** karmatronic has quit IRC08:31
*** amalinow|2 has quit IRC08:32
*** amalinow|2 has joined #openstack-rally08:32
*** amalinow has joined #openstack-rally08:33
*** amalinow|2 has quit IRC08:33
*** karmatronic has joined #openstack-rally08:35
*** kiran-r has quit IRC08:36
*** kiran-r has joined #openstack-rally08:36
*** karimb has quit IRC08:36
*** karmatronic has quit IRC08:37
yfriedandreykurilin: yingjun: amaretskiy: http://paste.openstack.org/show/276981/08:37
yfriedmy unittest fails on master. am I missing something?08:37
openstackgerritYair Fried proposed openstack/rally: Avoid cleanup of deleted resources  https://review.openstack.org/18750108:38
amaretskiyyfried: remova all *pyc08:38
amaretskiy*remove08:38
yfriedyingjun: ^ please see my patch08:38
amaretskiyok08:38
*** karimb has joined #openstack-rally08:39
yingjunyfried, ok08:40
yfriedamaretskiy: tnx. fixed08:40
*** e0ne has joined #openstack-rally08:46
*** kiran-r has quit IRC08:49
*** kiran-r has joined #openstack-rally08:50
*** kiran-r has quit IRC08:50
*** kiran-r has joined #openstack-rally08:50
*** Miouge has joined #openstack-rally08:59
*** psd_ has joined #openstack-rally09:03
*** aix has joined #openstack-rally09:05
*** psd has quit IRC09:06
*** fhubik is now known as fhubik_afk09:08
openstackgerritYair Fried proposed openstack/rally: Feature request Uninstall and version.  https://review.openstack.org/18554309:13
*** igormarnat is now known as imarnat09:22
*** tosky has joined #openstack-rally09:32
*** dmorita has quit IRC09:34
*** Miouge has quit IRC09:36
*** yingjun has quit IRC09:41
*** fhubik_afk is now known as fhubik09:45
*** yfried is now known as yfried|afk09:48
*** redixin has joined #openstack-rally09:53
*** aix has quit IRC09:53
*** agarciam has quit IRC09:56
*** e0ne is now known as e0ne_10:02
*** yfried|afk is now known as yfried10:03
*** aix has joined #openstack-rally10:05
*** fhubik is now known as fhubik_afk10:08
*** kvk has joined #openstack-rally10:12
*** e0ne_ has quit IRC10:12
*** psd_ is now known as psd10:13
*** yfried is now known as yfried|afk10:14
*** e0ne has joined #openstack-rally10:21
*** kiranr has joined #openstack-rally10:25
*** redixin has quit IRC10:27
*** kiran-r has quit IRC10:28
*** redixin has joined #openstack-rally10:29
*** fhubik_afk is now known as fhubik10:32
*** yfried|afk is now known as yfried10:34
*** yingjun has joined #openstack-rally10:43
*** redixin has quit IRC10:46
*** redixin has joined #openstack-rally10:47
*** yingjun has quit IRC10:48
openstackgerritBoris Pavlovic proposed openstack/rally: Feature request improve install script  https://review.openstack.org/18554310:52
*** boris-42 has joined #openstack-rally10:53
*** yingjun has joined #openstack-rally10:57
*** nkhare has quit IRC11:02
*** coolsvap is now known as coolsvap|afk11:12
yfriedboris-42: re https://review.openstack.org/#/c/187501/11:14
yfriedboris-42: I remember we discussed this, and that it should be solved by another patch/spec. could you please post this to the comments?11:15
boris-42yfried: I left comment to point the spec11:18
boris-42yfried: in any case I am not against that patch, I just need to analyze it better11:18
yfriedboris-42: tnx. I'm not offended, I just like everything to be doc'ed because I have terrible memory11:19
yfriedboris-42: tnx11:19
boris-42yfried: cleaunp is very important topic but plugin base is more important =)11:20
*** coolsvap|afk is now known as coolsvap11:23
boris-42yfried https://review.openstack.org/#/c/160142/13/rally/common/plugin/plugin.py11:24
boris-42yfried: because it's not wrapper11:24
boris-42yfried: wrapper means that you are wrapping function by another one11:25
boris-42yfried: e..g you return another object function*11:25
*** arxcruz has quit IRC11:25
*** tosky has quit IRC11:26
*** tosky has joined #openstack-rally11:26
*** coolsvap is now known as coolsvap|afk11:27
*** yfried is now known as yfried|afk11:29
*** mahito has quit IRC11:31
*** fhubik is now known as fhubik_afk11:33
*** e0ne is now known as e0ne_11:34
*** MaxPC has joined #openstack-rally11:35
*** nkhare has joined #openstack-rally11:35
*** MaxPC has quit IRC11:39
*** e0ne_ has quit IRC11:40
*** arxcruz has joined #openstack-rally11:40
openstackgerritBoris Pavlovic proposed openstack/rally: Fix formatting of maintainers section in docs   https://review.openstack.org/18906111:40
openstackgerritBoris Pavlovic proposed openstack/rally: Fix formatting of maintainers section in docs   https://review.openstack.org/18906111:40
*** aswadr has quit IRC11:41
*** yfried|afk is now known as yfried11:42
*** aswadr has joined #openstack-rally11:43
*** imarnat is now known as igormarnat12:00
*** jaypipes has joined #openstack-rally12:02
*** fhubik_afk is now known as fhubik12:02
*** igormarnat is now known as imarnat12:03
openstackgerritBoris Pavlovic proposed openstack/rally: Future improvment of plugin base  https://review.openstack.org/16014212:05
openstackgerritBoris Pavlovic proposed openstack/rally: Switch to plugin base deployengines and serverproviders  https://review.openstack.org/15261212:05
openstackgerritBoris Pavlovic proposed openstack/rally: Switch to plugin base: context, sla, runners  https://review.openstack.org/15064712:05
boris-42yfried: andreykurilin redixin ^ let's finish this task?12:06
openstackgerritIgor Degtiarov proposed openstack/rally: [Ceilometer] Add  scenario for events and traits  https://review.openstack.org/18051412:06
*** georgem1 has joined #openstack-rally12:13
*** yingjun has quit IRC12:13
*** georgem1 has joined #openstack-rally12:13
*** yfried is now known as yfried|afk12:13
*** e0ne has joined #openstack-rally12:14
openstackgerritIgor Degtiarov proposed openstack/rally: [Ceilometer] Add  scenario for events and traits  https://review.openstack.org/18051412:14
*** imarnat is now known as igormarnat12:15
*** igormarnat is now known as imarnat12:16
*** yfried|afk is now known as yfried12:19
*** e0ne is now known as e0ne_12:21
*** e0ne_ is now known as e0ne12:21
openstackgerritMerged openstack/rally: Fix Designate record deletion utility function  https://review.openstack.org/18935412:25
yfriedboris-42: reviewed12:28
openstackgerritNikita Konovalov proposed openstack/rally: Improved wait_for benchmark helper  https://review.openstack.org/17246612:28
yfriedboris-42: re plugin namespace: I understand the code of this, but not the why/how12:29
yfriedboris-42: could you please add this to doc?12:29
*** e0ne is now known as e0ne_12:30
*** imarnat is now known as igormarnat12:30
*** igormarnat is now known as imarnat12:31
yfriedboris-42: https://review.openstack.org/#/c/152612/5/rally/deploy/engine.py,cm "def configure"12:33
*** georgem1 has quit IRC12:33
yfriedboris-42: why?12:33
*** MaxPC has joined #openstack-rally12:34
*** mwagner_afk has quit IRC12:35
*** e0ne_ has quit IRC12:35
yfriedNikitaKonovalov: https://review.openstack.org/#/c/172466/17..19/rally/benchmark/utils.py,cm12:42
NikitaKonovalovyfried: hi12:42
yfriedNikitaKonovalov: is this WIP?12:42
boris-42yfried: it very important12:43
NikitaKonovalovyfried: it is not WIP12:43
yfriedboris-42: re namespace - I'm not saying it isn't. just that I don't understand it...12:44
NikitaKonovalovyfried: that huge diff is due to the rebase I guess12:44
yfriedNikitaKonovalov: I'm asking about pavel's comments. you haven't addressed them yet12:45
NikitaKonovalovyfried: yes, I've added the checks he asked for12:46
yfriedNikitaKonovalov: sorry. my bad. I missed it. please ignore my nagging12:48
yfriedNikitaKonovalov: +2ed12:48
NikitaKonovalovyfried: thanks12:48
*** yingjun has joined #openstack-rally12:48
openstackgerritYair Fried proposed openstack/rally: [Sahara] More debug logging  https://review.openstack.org/17049112:49
openstackgerritKirill Shileev proposed openstack/rally: Configurable timeout feature request  https://review.openstack.org/18969112:50
openstackgerritMerged openstack/rally: Feature request improve install script  https://review.openstack.org/18554312:51
*** georgem1 has joined #openstack-rally12:55
*** e0ne has joined #openstack-rally12:55
yfriedboris-42: https://review.openstack.org/#/c/189061/612:57
*** stpierre has joined #openstack-rally12:58
*** neeti has quit IRC12:59
*** imarnat is now known as igormarnat13:00
*** kiranr has quit IRC13:02
*** philibar has joined #openstack-rally13:13
openstackgerritBoris Pavlovic proposed openstack/rally: Further improvment of plugin base  https://review.openstack.org/16014213:14
openstackgerritBoris Pavlovic proposed openstack/rally: Switch to plugin base deployengines and serverproviders  https://review.openstack.org/15261213:14
openstackgerritBoris Pavlovic proposed openstack/rally: Switch to plugin base: context, sla, runners  https://review.openstack.org/15064713:14
*** agarciam has joined #openstack-rally13:16
boris-42yfried: https://review.openstack.org/#/c/152612/13:23
*** nihilifer has quit IRC13:23
yfriedboris-42: https://review.openstack.org/#/c/160142/14..15/rally/exceptions.py,cm what about these comments?13:28
boris-42yfried: uh I forgot to press review button13:30
boris-42yfried: done13:31
yfriedboris-42: why get red of notfound?13:31
yfriedboris-42: it's a useful superclass13:32
boris-42yfried: okay if you would prefer13:34
boris-42yfried: I don't care too much at this point about that13:34
*** igormarnat is now known as imarnat13:34
yfriedboris-42: tnx. if you are pushing a new patch, there are some typo13:35
yfrieds13:35
yfriedboris-42: 1sec13:35
openstackgerritBoris Pavlovic proposed openstack/rally: Further improvment of plugin base  https://review.openstack.org/16014213:37
openstackgerritBoris Pavlovic proposed openstack/rally: Switch to plugin base deployengines and serverproviders  https://review.openstack.org/15261213:37
openstackgerritBoris Pavlovic proposed openstack/rally: Switch to plugin base: context, sla, runners  https://review.openstack.org/15064713:37
boris-42yfried: ^ too late my friend=)13:38
yfriedboris-42: are you going to fix those typos?13:39
boris-42yfried: lemme take a look13:39
boris-42yfried: sure13:39
yfriedboris-42: tnx13:39
boris-42yfried: https://review.openstack.org/#/c/160142/15/rally/common/plugin/plugin.py13:48
*** exploreshaifali has joined #openstack-rally13:48
boris-42yfried: please write full sentence you are asking me to change back to what I have to change to this one..13:49
yfriedboris-42: Function decorator that adds plugin behavior to function.13:49
*** ajiang has joined #openstack-rally13:53
openstackgerritBoris Pavlovic proposed openstack/rally: Further improvment of plugin base  https://review.openstack.org/16014213:54
openstackgerritBoris Pavlovic proposed openstack/rally: Switch to plugin base deployengines and serverproviders  https://review.openstack.org/15261213:54
openstackgerritBoris Pavlovic proposed openstack/rally: Switch to plugin base: context, sla, runners  https://review.openstack.org/15064713:54
*** kiran-r has joined #openstack-rally13:54
boris-42yfried: ^ done13:55
yfriedboris-42: LGTM +213:56
boris-4281 online in IRC lol13:57
boris-42current record=)13:57
*** imarnat is now known as igormarnat13:58
*** igormarnat is now known as imarnat14:00
*** asrangne has joined #openstack-rally14:13
*** aswadr has quit IRC14:16
*** yingjun has quit IRC14:18
openstackgerritRoman Vasilets proposed openstack/rally: Remove deprecated code  https://review.openstack.org/18807714:30
openstackgerritRoman Vasilets proposed openstack/rally: Remove deprecated code  https://review.openstack.org/18807714:31
openstackgerritKiran proposed openstack/rally: Add validator to check parameter inside a dictionary argument  https://review.openstack.org/18833414:45
*** yfried is now known as yfried|afk14:48
openstackgerritChris St. Pierre proposed openstack/rally: Add Heat scenario to test scaling policies  https://review.openstack.org/17843614:48
*** yfried|afk is now known as yfried14:49
*** imarnat is now known as igormarnat14:51
georgem1boris-42: I'm trying to run the boot-runcommand-delete.json task with a ping_test.sh and I get this error: http://pastebin.com/YePK5eB314:54
*** igormarnat is now known as imarnat14:55
georgem1if I run the http://ping_test.sh/ manually it outputs only json14:55
*** jaypipes has quit IRC14:57
*** yfried has quit IRC15:00
*** frayedknot has quit IRC15:01
*** frayedknot has joined #openstack-rally15:01
stpierregeorgem1: does the JSON that it outputs validate against the RESULT_SCHEMA? https://github.com/openstack/rally/blob/master/rally/benchmark/runner.py#L11615:01
stpierrei think it needs to match the scenario_output portion15:02
*** fhubik is now known as fhubik_afk15:02
georgem1stpierre: thanks for reply, I changed the script to echo "{15:04
georgem1    \"The Ping result is\": $ping_res}" and I'l try again15:04
stpierreas long as $ping_res is a number that should work15:04
stpierrei'm guessing the output schema is so restrictive so that SLAs can be applied to the output, but it'd sure be nice to have an alternative to boot_runcommand_delete() that didn't require very narrow JSON output15:05
boris-42stpierre: yep15:05
*** e0ne is now known as e0ne_15:08
*** exploreshaifali has quit IRC15:12
*** nihilifer has joined #openstack-rally15:14
*** kiran-r has quit IRC15:17
*** karimb has quit IRC15:18
*** e0ne_ has quit IRC15:18
*** nkhare has quit IRC15:20
*** philibar has left #openstack-rally15:21
*** philibar has joined #openstack-rally15:22
*** arxcruz has quit IRC15:23
*** e0ne has joined #openstack-rally15:23
boris-42stpierre: btw it's not on level of benchmark*15:25
boris-42stpierre: it's level on scenario runner *15:25
boris-42stpierre: and forcing format of output is required by many things15:25
boris-42stpierre: including rally task report and rally task detailed commands15:25
*** fhubik_afk is now known as fhubik15:27
*** agarciam has quit IRC15:28
*** aix has quit IRC15:29
*** agarciam has joined #openstack-rally15:30
georgem1stpierre and boris-42: the ping test failed again :( http://pastebin.com/YePK5eB315:31
stpierre$ping_res is empty, not a number15:31
georgem1the second run starts after the ==============================================================================15:31
georgem1stpierre: If I run the script locally the output is: {15:33
georgem1    "The Ping result is": 0}15:33
boris-42georgem1: hm15:34
boris-42georgem1: that should work15:34
boris-42georgem1: ah no15:35
boris-42georgem1: https://github.com/openstack/rally/blob/master/rally/benchmark/runner.py#L129-L14215:35
boris-42georgem1:  {"data": {"The ping result is": 0}}15:35
boris-42georgem1: should be the output15:35
stpierrethat must be an older version of rally, the ScriptError message was fixed three months ago (425f8031)15:36
openstackgerritAndrey Kurilin proposed openstack/rally: Modify GetResourceErrorStatus exception  https://review.openstack.org/18977715:36
stpierrei'd recommend updating at some point, too15:36
boris-42stpierre: this schema is old Like rally=)15:36
stpierrerally is a very fast-moving target15:36
boris-42stpierre: but this schema is very very old=)15:36
georgem1boris-42: ok, I'll update, change the output of the script and try again, thanks for help15:36
stpierreyeah, but a new version of rally would actually report the error instead of silently swallowing it :)15:37
boris-42stpierre: =)))15:37
boris-42stpierre: btw plugin base is comming!15:37
boris-42stpierre: https://review.openstack.org/#/c/160142/15:37
stpierrei started to look at that, but got as far as metaclasses before i decided to let smarter people than me +2 it15:38
boris-42stpierre: +)))15:40
*** aix has joined #openstack-rally15:41
boris-42stpierre: so one base for all plugins will allow us to do magic)15:41
georgem1Can I use Rally to check the health of existing environment where I'm only a normal user? I've looked at http://boris-42.me/rally-can-generate-load-with-passed-users-now/ but it still requires admin creds15:42
boris-42georgem1: yep15:43
boris-42georgem1: I am working on dropping that15:43
openstackgerritAndrey Kurilin proposed openstack/rally: Remove 'pyc' files before running tests  https://review.openstack.org/18978115:45
openstackgerritMichal Rostecki proposed openstack/rally: Convert Rally to the new Devstack plugin model  https://review.openstack.org/18978315:46
openstackgerritMichal Rostecki proposed openstack/rally: Convert Rally to the new Devstack plugin model  https://review.openstack.org/18462915:49
*** pbandzi_ has quit IRC15:50
*** yfried has joined #openstack-rally15:59
*** cdent has quit IRC16:01
*** e0ne is now known as e0ne_16:03
*** PrashantS has joined #openstack-rally16:04
*** PrashantS has quit IRC16:05
*** PrashantS has joined #openstack-rally16:05
kairat_kushaevboris-42: Hello16:06
kairat_kushaevboris-42: Do you know which folder is current when I am launching heat templates with rally?16:07
kairat_kushaevboris-42: Is it regarding this patch https://review.openstack.org/#/c/178751/. I tried to use your approach(use ~) and approach that works on my local env (patchset 13) but that doesn't work.16:08
*** e0ne_ is now known as e0ne16:09
kairat_kushaevUnfortunately, I succeed with the full path only.16:09
kairat_kushaevPerhaps you have some ideas about it16:10
*** redixin has quit IRC16:11
boris-42kairat_kushaev: I will think about it16:12
kairat_kushaevOk16:13
*** frayedknot has quit IRC16:17
*** frayedknot has joined #openstack-rally16:21
*** amalinow has quit IRC16:23
*** yfried has quit IRC16:23
openstackgerritMerged openstack/rally: Further improvment of plugin base  https://review.openstack.org/16014216:25
*** amaretskiy has quit IRC16:33
*** nihilifer has quit IRC16:34
*** suneelb has joined #openstack-rally16:37
*** e0ne has quit IRC16:38
*** aix has quit IRC16:39
stpierreboris-42: do you know of any prior art for the hacking rule you've asked me to write? looking at pep8 plugins, this doesn't seem fun to write at all -- getting the logical line replaces all strings with 'xxxxxx', so i can't check the string itself for multiple %(...)s unless i reconstruct the string myself from physical lines.16:46
*** nihilifer has joined #openstack-rally16:51
*** exploreshaifali has joined #openstack-rally16:54
boris-42stpierre: hm16:54
boris-42stpierre: here are all hacking rules https://github.com/openstack/rally/blob/master/tests/hacking/checks.py16:54
boris-42stpierre: that we have in Rally specific16:55
*** psd has quit IRC16:56
openstackgerritMichal Rostecki proposed openstack/rally: Convert Rally to the new Devstack plugin model  https://review.openstack.org/18462916:57
georgem1hmm, I have a few questions about the security around rally tasks16:57
georgem1It seems that if I use the cirros image it's going to create a security group allowing wide access to the test instance and use ssh key to connect to it, but it doesn't really matter as the cirros has built-in known creds16:58
boris-42georgem1: first of all you can use any image that you want*16:59
*** fhubik has quit IRC16:59
boris-42georgem1: the second thing it's just plugin for Rally (it's not something hardcoded in Rally framework)17:00
stpierreyeah, i've looked at the hacking rules for a number of projects and can't find anything similar. most rules are either fairly simple regexes (which would work if the pep8 logical line didn't do string replacement, or if i manually rebuilt a logical line myself) or AST parsers, which would just kick the can down the road -- i'd still have to reconstruct the string manually.17:00
boris-42georgem1: the third thing is that maybe I am wrong but without secruity group you won't be able to ssh instance?17:00
georgem1boris-42: I know, it's just that I was a bit surprised to see the wide open access17:00
boris-42stpierre: so why not making regexp check for covering that case?17:00
boris-42georgem1: it's only related to VMTask benchmark17:01
stpierrebecause of the difficulty of reconstructing the entire string from multiple physical lines17:01
stpierrebut i think that's what i'm going to have to do17:01
georgem1boris-42: maybe limit to port 22 then?17:01
boris-42georgem1: it's limited no?17:01
georgem1right now is: {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "tenant_id": "xxx", "port_range_max": 65535, "security_group_id": "xxx", "port_range_min": 1, "ethertype": "IPv4", "id": "xxx"}17:01
boris-42georgem1: https://github.com/openstack/rally/blob/master/rally/plugins/openstack/context/secgroup.py#L8917:02
boris-42georgem1: so be free to report a bug and restrict it17:02
*** anshul has quit IRC17:02
*** jaypipes has joined #openstack-rally17:02
stpierrethe 'allow_ssh' context is significantly more than it claims to be :)17:03
boris-42georgem1: btw does it make any sense? I mean this is test VM that will be deleted just after test is finished?17:03
boris-42georgem1: I mean it doesn't sound for me like something very critical?)17:03
boris-42maybe I am wrong..17:03
*** agarciam has quit IRC17:03
georgem1boris-42: the cleanup can fail and there is a window of vulnerability while anybody who scans the network will discover a cirros instance waiting there17:04
stpierreif that's a concern, i'd suggest not using cirros17:05
georgem1if the instance is ubuntu is more secure as it only allows key-based access by default, but still not a good practice to open the sec group more than necessary17:05
stpierreas it turns out, automatically determining what is necessary is deeply nontrivial17:05
stpierrei looked at this briefly, but was quickly overwhelmed by the complexity that variance in network topology can add to the problem. it's by no means as simple as just opening the security group to the IP address(es) of the box running rally.17:06
georgem1I limit access to cirros instances to the admin, it's just that you should document what happens during a Rally task so users can asses the implications and choices they make in terms of images used, etc17:06
boris-42georgem1: stpierre okay guys17:10
boris-42I belive that we should make more strict rules17:10
boris-42for allow_ssh17:10
georgem1my use case for Rally is to run some simple tasks at regular intervals to deep test the health of the environment, the ping test which should be simple it's not working yet though :(17:10
boris-42but this is some kind of low priority bug =)17:10
boris-42georgem1: so what now happens?17:11
georgem1http://pastebin.com/dekq0kW617:11
georgem1if you run the script you'll see the output generated, which should match rally's needs, but for some reason it's different in the html report's error output17:12
boris-42georgem1: so it says clear reason17:13
boris-42georgem1: {"data": {"The Ping result is": }}17:13
boris-42georgem1: ^ there is no value for "The Ping result is"17:14
boris-42seems like your $ping_res17:14
boris-42is empty17:14
georgem1can one of you please adapt the script so this task completes? I see there is no value, but please try to run the script locally17:14
boris-42georgem1: one moment17:14
*** akuznetsova has quit IRC17:14
*** akuznetsova has joined #openstack-rally17:14
boris-42georgem1: so your script is invalid =(17:15
boris-42it outputs17:15
boris-42what you would like to return exit code?17:16
boris-42georgem1: ^17:16
georgem1the output of that script should be: {"data": {"The Ping result is": 0}}  with exit status 017:18
georgem1or I can change to ouput: {"data": {"The Ping packet loss to www.google.com is": 0}}17:19
boris-42georgem1: so why not using $?17:19
boris-42georgem1: for exit code17:19
georgem1boris-42: I'm not sure I understand how to use the exit code of the script… if there is packet loss I want that to be captured in the rally task as well, so if I go back to historical reports I can see that17:21
boris-42georgem1: ok17:21
georgem1how should my ping_test.sh script look like so the rally boot-runcommand-delete scenario pass?17:22
boris-42georgem1: as I said17:23
boris-42georgem1: your script is returning invalid output17:23
boris-42georgem1: {"data": {"The Ping result is": }}17:23
boris-42^ this is what it returns17:23
boris-42georgem1: and it should return17:23
boris-42{"data": {"The Ping result is": 0}}17:23
boris-42^ that will be valid17:24
*** e0ne has joined #openstack-rally17:24
georgem1ok, but why is returns ^ when running it manually it returns {"data": {"The Ping result is": 0}}17:24
stpierreit works on my workstation (centos 7, bash 4.2.46) so i'm guessing there's something in the grep that's a newer feature17:24
boris-42georgem1: in macos it returns ""17:24
boris-42georgem1: seems like grep versions are different17:25
georgem1ok, so it is a problem with the grep inside the cirros image17:25
boris-42georgem1: so we need to tune grep stuff17:25
stpierrehas anyone actually tested it on cirros?17:25
boris-42stpierre: VMTask?17:25
georgem1I'll try with a ubuntu image, thanks again17:25
stpierreyour script17:25
stpierre*the script17:25
stpierrei've tested vmtask plenty on cirros :)17:25
boris-42stpierre: +)17:26
boris-42georgem1: so seems like usuing ubuntu is the best choice17:26
boris-42georgem1: to avoid some strange issues with old versions of various stuff17:26
boris-42georgem1: btw17:28
georgem1yeap, cirros doesn't know the -P option for grep17:28
boris-42georgem1: in rally we have place for contribution such scripts17:28
stpierrecompiling PCRE into cirros would probably triple the image size17:29
boris-42georgem1: https://github.com/openstack/rally/tree/master/samples/tasks/support17:29
stpierreyou could also use sed instead of grep: ping -c 5 -q 8.8.8.8 | sed -n '/packet loss/ { s/.*\?\([[:digit:]]\+\)% packet loss.*/\1/; p}'17:29
*** asrangne has quit IRC17:30
boris-42stpierre: ^ bash nazi =) at least here I can say that ^_^17:31
*** exploreshaifali has quit IRC17:31
georgem1thanks stpierre and boris-42, I'm re-runing the scenario using a ubuntu image but I'm fairly confident it will work17:31
boris-42georgem1: so VMTaks benchmark is tested in our gates (CI)17:32
boris-42georgem1: very well17:32
boris-42georgem1: so there shouldn't be any big surprise17:32
*** tosky has quit IRC17:37
*** imarnat is now known as igormarnat17:42
*** rdas has quit IRC17:49
*** frayedknot has quit IRC17:57
*** frayedknot has joined #openstack-rally17:58
boris-42georgem1: so please contribute back your script=)17:59
boris-42georgem1: maybe sed version that works in cirros=)17:59
georgem1sure18:02
openstackgerritMerged openstack/rally: Remove 'pyc' files before running tests  https://review.openstack.org/18978118:13
openstackgerritMerged openstack/rally: Switch to plugin base: context, sla, runners  https://review.openstack.org/15064718:17
*** harlowja_ has quit IRC18:18
*** amaretskiy has joined #openstack-rally18:19
*** harlowja has joined #openstack-rally18:25
*** mwagner_afk has joined #openstack-rally18:26
*** suneelb1 has joined #openstack-rally18:34
*** suneelb has quit IRC18:38
*** frayedknot has quit IRC18:44
*** frayedknot has joined #openstack-rally18:47
*** openstackgerrit has quit IRC18:48
*** openstackgerrit has joined #openstack-rally18:48
openstackgerritMichal Rostecki proposed openstack/rally: Convert Rally to the new Devstack plugin model  https://review.openstack.org/18462918:51
*** mwagner_afk has quit IRC19:06
*** e0ne has quit IRC19:15
*** briandowns has joined #openstack-rally19:16
*** suneelb has joined #openstack-rally19:37
*** suneelb1 has quit IRC19:37
openstackgerritChris St. Pierre proposed openstack/rally: Eliminated string formatting with single mapping key  https://review.openstack.org/18935519:39
openstackgerritChris St. Pierre proposed openstack/rally: Better mocking for self.[admin_]clients in Scenario tests  https://review.openstack.org/18855419:39
stpierreboris-42: dude, this fucking hacking rule :(19:39
boris-42stpierre: ahahaha19:39
boris-42stpierre: what happend whole rally is broken?)19:39
stpierrenah, there were only a dozen or so changes to make. but writing the rule was... very, very interesting.19:40
openstackgerritBoris Pavlovic proposed openstack/rally: Switch to plugin base deployengines and serverproviders  https://review.openstack.org/15261219:41
boris-42stpierre: =)19:42
boris-42stpierre: did you seem my rule that protects us from using ' ?)19:42
boris-42stpierre: https://github.com/openstack/rally/blob/master/tests/hacking/checks.py#L288-L33719:43
stpierreyeah, it's like that.19:43
boris-42stpierre: hehe=)19:43
boris-42stpierre: what I can say19:43
boris-42stpierre: it's the only way if you would like to keep clean project19:43
boris-42stpierre: this will fail https://review.openstack.org/#/c/189355/2/rally/cli/commands/deployment.py19:45
stpierrehah, d'oh19:45
openstackgerritChris St. Pierre proposed openstack/rally: Eliminated string formatting with single mapping key  https://review.openstack.org/18935519:47
openstackgerritChris St. Pierre proposed openstack/rally: Better mocking for self.[admin_]clients in Scenario tests  https://review.openstack.org/18855419:47
boris-42stpierre: yep it fails http://paste.openstack.org/show/278676/ =)19:48
boris-42stpierre: hehe19:48
*** frayedknot has quit IRC19:57
*** frayedknot has joined #openstack-rally20:00
openstackgerritOpenStack Proposal Bot proposed openstack/rally: Updated from global requirements  https://review.openstack.org/18946320:05
boris-42stpierre: LOL https://review.openstack.org/#/c/189355/3/tests/hacking/checks.py20:05
stpierrei told you20:05
boris-42stpierre: it's my stupid decorator LOL=)20:06
stpierrehah, didn't realize that was yours. i figure i'll try to submit a follow-up patch to fix it (eventually)20:07
boris-42stpierre: it's not hard to fix it, but I had issues by adding *args20:07
boris-42stpierre: something at that point didn't work .... don't remember actually20:07
stpierreyeah, since it requires logical_line it needs to be fairly clever20:08
boris-42stpierre: you can add lines/tokens to all hacking methods20:08
boris-42stpierre: and pass them through that skip_line...20:08
boris-42stpierre: and there is some issue with  %ids20:09
boris-42stpierre: it shouldn't pass ..20:09
stpierreit's passing because '%ids' isn't a valid format string at all, so N353 doesn't apply here, and apparently that line isn't covered by unit tests20:09
stpierreor rather, it is valid -- it's '%i', followed immediately by the literal 'ds'20:10
boris-42stpierre: ya seems like valid %i + ds20:13
stpierreyeah, but not relevant to N35320:16
*** MaxPC has quit IRC20:19
*** MaxPC has joined #openstack-rally20:20
*** boris-42 has quit IRC20:22
*** boris-42 has joined #openstack-rally20:24
*** philibar has quit IRC20:27
openstackgerritChris St. Pierre proposed openstack/rally: Eliminated string formatting with single mapping key  https://review.openstack.org/18935520:31
openstackgerritChris St. Pierre proposed openstack/rally: Better mocking for self.[admin_]clients in Scenario tests  https://review.openstack.org/18855420:31
*** stpierre has quit IRC20:42
*** darkhuy_ has joined #openstack-rally20:51
*** frayedknot has quit IRC20:53
*** briandowns has quit IRC20:55
*** frayedknot has joined #openstack-rally20:56
*** briandow_ has joined #openstack-rally20:59
*** suneelb has quit IRC21:00
*** suneelb has joined #openstack-rally21:01
*** stpierre has joined #openstack-rally21:10
*** georgem1 has quit IRC21:16
*** MaxPC has quit IRC21:21
*** karimb has joined #openstack-rally21:35
*** darkhuy_ has quit IRC21:37
*** mwagner_afk has joined #openstack-rally21:45
*** briandow_ has quit IRC21:45
*** georgem1 has joined #openstack-rally21:49
*** briandowns has joined #openstack-rally21:51
*** briandowns has quit IRC21:54
*** briandowns has joined #openstack-rally21:54
*** briandowns has quit IRC21:58
*** suneelb has quit IRC22:06
*** suneelb1 has joined #openstack-rally22:06
*** davideagnello has quit IRC22:16
*** davideagnello has joined #openstack-rally22:19
*** Prashan__ has joined #openstack-rally22:31
*** PrashantS has quit IRC22:35
*** Prashan__ has quit IRC22:36
*** georgem1 has quit IRC22:36
*** karimb has quit IRC22:41
*** stpierre has quit IRC23:01
*** briandowns has joined #openstack-rally23:08
*** suneelb1 has quit IRC23:42
*** harlowja has quit IRC23:42
*** harlowja has joined #openstack-rally23:43

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!