Tuesday, 2015-05-12

« Monday, 2015-05-11 Index Wednesday, 2015-05-13 »
*** botang has joined #openstack-rally00:36
*** klindgren__ has quit IRC00:43
*** dmorita has joined #openstack-rally00:48
*** imarnat is now known as igormarnat00:54
*** pradeep has quit IRC00:56
*** ChanServ changes topic to "☁ Rally RoadMap: http://goo.gl/JZkmwY ☁ Review Dashboard: http://goo.gl/YuCJfl ☁ IRC logs http://irclog.perlgeek.de/openstack-rally ☁ Key persons to ask: boris-42, yfried, msdubov, rediskin, andreykurilin, amaretskiy ☁ Documentation: https://rally.readthedocs.org/en/latest/ ☁ To publish changes to Rally: https://rally.readthedocs.org/en/latest/contribute.html"00:56
-openstackstatus- NOTICE: Gerrit has been downgraded to version 2.8 due to the issues observed today. Please report further problems in #openstack-infra.00:56
*** botang has quit IRC01:16
*** botang has joined #openstack-rally01:21
*** botang has quit IRC01:48
*** botang has joined #openstack-rally02:03
*** pradeep has joined #openstack-rally02:11
*** jjmb has quit IRC02:29
*** jjmb has joined #openstack-rally02:31
*** dpaterson has quit IRC02:50
*** yingjun has joined #openstack-rally03:05
*** avico has quit IRC03:17
*** baker has joined #openstack-rally03:18
*** avico has joined #openstack-rally03:19
*** yingjun_ has joined #openstack-rally03:37
*** yingjun has quit IRC03:41
*** pradeep has quit IRC03:53
*** yingjun_ has quit IRC03:54
*** yingjun has joined #openstack-rally03:54
*** baker has quit IRC03:58
*** yingjun has quit IRC03:59
*** baker has joined #openstack-rally04:04
*** baker has quit IRC04:21
*** tfreger has joined #openstack-rally04:22
*** rdas has joined #openstack-rally04:37
*** anshul has joined #openstack-rally04:40
*** jaypipes has quit IRC04:40
*** jaypipes has joined #openstack-rally04:56
*** yingjun has joined #openstack-rally05:00
*** yfried has quit IRC05:01
*** pradeep has joined #openstack-rally05:41
*** ibiris_away is now known as ibiris06:10
*** yingjun has quit IRC06:15
*** coolsvap|afk is now known as coolsvap06:18
*** coolsvap is now known as coolsvap|afk06:21
*** agarciam has quit IRC06:24
*** pradeep has quit IRC06:25
*** coolsvap|afk has quit IRC06:28
*** coolsvap has joined #openstack-rally06:29
*** yingjun has joined #openstack-rally06:37
*** kiran-r has joined #openstack-rally06:50
*** agarciam has joined #openstack-rally06:54
*** kiran-r has quit IRC06:55
*** pradeep has joined #openstack-rally07:01
*** neeti has joined #openstack-rally07:24
*** exploreshaifali has joined #openstack-rally07:28
openstackgerritVitaly Gusev proposed openstack/rally: [Ceilometer] Add CeilometerNovaMetrics.get_nova_notifications scenario  https://review.openstack.org/15480307:40
*** openstackstatus has quit IRC07:52
*** openstack has joined #openstack-rally07:54
*** exploreshaifali has quit IRC07:54
*** karimb has joined #openstack-rally08:01
*** tfreger1 has joined #openstack-rally08:02
*** tfreger has quit IRC08:03
*** arxcruz has joined #openstack-rally08:03
*** exploreshaifali has joined #openstack-rally08:04
*** yfried has joined #openstack-rally08:05
*** nkhare has joined #openstack-rally08:10
openstackgerritMikhail Dubov proposed openstack/rally: Release 0.0.4  https://review.openstack.org/18049808:11
*** pradeep has quit IRC08:13
openstackgerritmaplelabs proposed openstack/rally: Loadbalancer Member and pool functionality support  https://review.openstack.org/18218908:17
*** e0ne has joined #openstack-rally08:17
*** e0ne is now known as e0ne_08:17
*** yingjun has quit IRC08:17
*** kiran-r has joined #openstack-rally08:18
*** redixin has joined #openstack-rally08:19
*** pradeep has joined #openstack-rally08:21
*** yingjun has joined #openstack-rally08:23
yfriedboris-42: was there a meeting last night?08:31
*** jjmb1 has joined #openstack-rally08:38
*** jjmb has quit IRC08:40
*** jjmb has joined #openstack-rally08:45
*** jjmb has quit IRC08:45
openstackgerritYuriy Nesenenko proposed openstack/rally: Add Cinder create_backup volume scenario  https://review.openstack.org/16717108:45
*** jjmb has joined #openstack-rally08:45
*** jjmb has quit IRC08:45
*** jjmb has joined #openstack-rally08:46
*** e0ne_ is now known as e0ne08:46
*** e0ne is now known as e0ne_08:46
*** arxcruz has quit IRC08:52
*** arxcruz has joined #openstack-rally08:53
*** e0ne_ is now known as e0ne08:55
*** tfreger1 has quit IRC08:55
*** yfried is now known as yfried|afk08:57
*** yfried|afk is now known as yfried09:01
openstackgerritIgor Degtiarov proposed openstack/rally: [Ceilometer] Add  scenario for events and traits  https://review.openstack.org/18051409:04
*** tfreger has joined #openstack-rally09:09
*** aix has joined #openstack-rally09:16
*** fhubik has joined #openstack-rally09:22
*** exploreshaifali has quit IRC09:23
openstackgerritNikita Konovalov proposed openstack/rally: Wait for status  https://review.openstack.org/17246609:31
openstackgerritNikita Konovalov proposed openstack/rally: [Sahara] More debug logging  https://review.openstack.org/17049109:31
openstackgerritNikita Konovalov proposed openstack/rally: [Sahara] Split EDP context  https://review.openstack.org/17768209:32
*** yingjun has quit IRC09:36
*** kiranr has joined #openstack-rally09:37
*** fhubik is now known as fhubik_afk09:40
*** kiran-r has quit IRC09:40
*** kiranr is now known as kiran-r09:50
*** aswadr has joined #openstack-rally09:51
yfriedandreykurilin1: tnx09:54
yfriedboris-42: https://review.openstack.org/#/c/168849/ could you please take a look?09:55
*** cdent has joined #openstack-rally09:55
*** kiranr has joined #openstack-rally09:56
andreykurilin1yfried: np:)09:57
*** kiran-r has quit IRC09:58
*** kiranr has quit IRC10:00
openstackgerritmaplelabs proposed openstack/rally: corrected pep8 errors  https://review.openstack.org/18222110:07
*** rdas has quit IRC10:11
*** yfried is now known as yfried|afk10:18
openstackgerritmaplelabs proposed openstack/rally: LoadBalancer member and pool functionalities  https://review.openstack.org/18222310:21
*** e0ne is now known as e0ne_10:21
openstackgerritmaplelabs proposed openstack/rally: corrected pep8 errors  https://review.openstack.org/18222110:22
*** yfried|afk is now known as yfried10:23
*** kiran-r has joined #openstack-rally10:27
*** yfried is now known as yfried|afk10:34
*** kiran-r has quit IRC10:37
*** yfried|afk is now known as yfried10:38
*** e0ne_ is now known as e0ne10:39
openstackgerritKairat Kushaev proposed openstack/rally: Add scenario for heat resource group  https://review.openstack.org/17875110:40
openstackgerritKairat Kushaev proposed openstack/rally: Pass parameters, files and env  for heat stacks  https://review.openstack.org/17863110:40
openstackgerritKairat Kushaev proposed openstack/rally: Add create-snapshot-restore-delete stack scenario  https://review.openstack.org/17903710:40
*** kiran-r has joined #openstack-rally10:41
kairat_kushaevpradeep: Hello, could you please explain in more details why do I need to update fakes here https://review.openstack.org/#/c/179037/?10:42
*** fhubik_afk is now known as fhubik10:47
*** coolsvap is now known as coolsvap|afk10:52
*** yfried is now known as yfried|afk10:54
*** yfried|afk is now known as yfried10:57
*** nkhare has quit IRC11:01
*** anshul has quit IRC11:10
*** tosky has joined #openstack-rally11:11
openstackgerritIgor Degtiarov proposed openstack/rally: [Ceilometer] Add  scenario for events and traits  https://review.openstack.org/18051411:13
*** nkhare has joined #openstack-rally11:14
boris-42yfried: one question https://review.openstack.org/#/c/168849/11:16
boris-42yfried: why del verifier11:16
yfriedboris-42: you are actually right, since I'm assigning a new value11:18
yfriedboris-42: I'll remove it11:18
boris-42yfried: thanks11:20
boris-42yfried: otherwise lgtm11:21
openstackgerritKairat Kushaev proposed openstack/rally: Add create-snapshot-restore-delete stack scenario  https://review.openstack.org/17903711:21
openstackgerritYair Fried proposed openstack/rally: Adds tempest re-install to API/CLI  https://review.openstack.org/16884911:21
yfriedboris-42: ^ new version11:21
yfriedandreykurilin1: ^11:21
openstackgerritSergey Skripnick proposed openstack/rally: Improve installation script  https://review.openstack.org/16241811:23
kairat_kushaevboris-42: Hello, do you propose to update rally-tests for all scenarios here: https://review.openstack.org/#/c/178631/?11:24
*** anshul has joined #openstack-rally11:30
openstackgerritMikhail Dubov proposed openstack/rally: [Spec] Enhance Rally API  https://review.openstack.org/18224511:30
openstackgerritVitaly Gusev proposed openstack/rally: [Ceilometer] Add CeilometerNovaMetrics.get_nova_pollsters scenario  https://review.openstack.org/16038711:33
pradeepkairat_kushaev:  under FakeHeatClient , stacks doesnt have snapshot defined11:36
pradeepkiran-r:  you might want to take a look at it tests/unit/fakes.py11:37
pradeepkairat_kushaev:  Did u run tox?11:38
kairat_kushaevkairat_kushaev: yep, it is ok with my patch. I am not using any Fakes. so Why should I update FakeHeatClient?11:38
*** karimb has quit IRC11:42
*** stpierre has joined #openstack-rally11:43
*** karimb has joined #openstack-rally11:46
*** nkhare has quit IRC11:47
*** exploreshaifali has joined #openstack-rally11:57
*** e0ne is now known as e0ne_12:00
*** nkhare has joined #openstack-rally12:01
openstackgerritJens Rosenboom proposed openstack/rally: Fix security groups cleanup  https://review.openstack.org/17942812:02
pradeepkairat_kushaev: if you dont see any failuers with tox, then fine.12:02
kairat_kushaevpradeep: ok12:02
openstackgerritYair Fried proposed openstack/rally: Split SLA to base and plugins  https://review.openstack.org/18050912:03
openstackgerritYair Fried proposed openstack/rally: Split scenarios under Plugins  https://review.openstack.org/18173812:03
openstackgerritYair Fried proposed openstack/rally: Split runners to base and plugins  https://review.openstack.org/18090412:03
yfriedboris-42: ^ please take a look when you have the time12:03
openstackgerritmaplelabs proposed openstack/rally: LoadBalancer member and pool functionalities(corrected)  https://review.openstack.org/18222312:04
*** jjmb has quit IRC12:05
boris-42yfried: thank you fro working on that I will12:06
yfriedboris-42: sure12:09
openstackgerritRoman Vasilets proposed openstack/rally: Add deploy environment murano benchmark  https://review.openstack.org/17162512:12
openstackgerritMikhail Dubov proposed openstack/rally: [Spec] Enhance Rally API  https://review.openstack.org/18224512:15
openstackgerritmaplelabs proposed openstack/rally: LoadBalancer member and pool functionalities(corrected)  https://review.openstack.org/18222312:15
*** nkhare has quit IRC12:16
*** aix has quit IRC12:17
openstackgerritmaplelabs proposed openstack/rally: LoadBalancer member and pool functionalities(corrected)  https://review.openstack.org/18222312:18
*** MaxPC has joined #openstack-rally12:24
*** aix has joined #openstack-rally12:28
*** e0ne_ is now known as e0ne12:34
boris-42yfried: one nit here https://review.openstack.org/#/c/180509/12:43
boris-42yfried: in docs12:44
boris-42yfried: rest seems ok12:44
*** rdas has joined #openstack-rally12:44
yfriedboris-42: tnx12:45
openstackgerritRoman Vasilets proposed openstack/rally: Add functional test for task samples  https://review.openstack.org/18140012:45
*** fhubik is now known as fhubik_afk12:56
boris-42yfried: so otherwise lgtm12:57
*** pradeep has quit IRC12:57
openstackgerritMikhail Dubov proposed openstack/rally: [Spec] Enhance Rally API  https://review.openstack.org/18224512:57
*** fhubik_afk is now known as fhubik13:00
yfriedboris-42: I'm working on context now and I'm not sure how to handle cleanup - is it common or openstack?13:04
yfriedboris-42: or maybe it should remain in base13:04
*** igormarnat is now known as imarnat13:04
*** kiran-r has quit IRC13:06
*** tfreger has quit IRC13:07
openstackgerritSergey Skripnick proposed openstack/rally: Improve installation script  https://review.openstack.org/16241813:13
openstackgerritYair Fried proposed openstack/rally: Split SLA to base and plugins  https://review.openstack.org/18050913:13
openstackgerritYair Fried proposed openstack/rally: Split scenarios under Plugins  https://review.openstack.org/18173813:13
openstackgerritYair Fried proposed openstack/rally: Split runners to base and plugins  https://review.openstack.org/18090413:13
openstackgerritYair Fried proposed openstack/rally: [Context] Split context into plugins  https://review.openstack.org/18228413:13
openstackgerritJens Rosenboom proposed openstack/rally: Fix security groups cleanup  https://review.openstack.org/17942813:16
openstackgerritYair Fried proposed openstack/rally: Split SLA to base and plugins  https://review.openstack.org/18050913:18
openstackgerritYair Fried proposed openstack/rally: Split scenarios under Plugins  https://review.openstack.org/18173813:18
openstackgerritYair Fried proposed openstack/rally: [Context] Split context into plugins  https://review.openstack.org/18228413:18
openstackgerritYair Fried proposed openstack/rally: Split runners to base and plugins  https://review.openstack.org/18090413:18
openstackgerritMerged openstack/rally: Adds tempest re-install to API/CLI  https://review.openstack.org/16884913:31
*** neeti has quit IRC13:41
*** georgem1 has joined #openstack-rally13:45
*** asrangne has joined #openstack-rally13:47
*** stpierre has quit IRC13:47
openstackgerritNikita Konovalov proposed openstack/rally: [Sahara] Improve Image context  https://review.openstack.org/16685913:48
georgem1If I run a rally task (NovaServers.boot_and_delete_server) with concurrency: 50 and times: 10, does it mean that it will start 50 instances at a time, delete them and repeat 10 times?13:48
georgem1because the task finished successfully but I don't see 500 deleted instances when I run: nova list --all-ten --deleted | grep rally | wc -l13:49
yfriedgeorgem1: it will start 10 instances at a time. repeat 5 times13:49
yfriedgeorgem1: ^ ideally13:49
*** exploreshaifali has quit IRC13:49
yfriedgeorgem1: afaik, in practice what you are saying is, "do this task 50 times" and "dedicate 10 workers to it"13:50
openstackgerritMerged openstack/rally: Setup volume detach timings separately  https://review.openstack.org/17908713:50
*** aswadr has quit IRC13:50
yfriedgeorgem1: so if the first op takes inite time due to some error, the 9 remaining threads will have to devide 49 ops as they see fit13:51
georgem1yfried: this is the task http://pastebin.com/bhfCnxt613:51
yfriedgeorgem1: am I clear?13:51
yfriedthe total number of ops (VMs created) will be 5013:51
yfriedgeorgem1: ^ and since the scenario is "_and_delete" - each op will delete its own VM.13:52
*** baker has joined #openstack-rally13:52
*** baker has quit IRC13:53
georgem1yfried: I thought that it means it will start 50 instances and delete them 10 times in a row: http://en.wikipedia.org/wiki/Concurrency_%28computer_science%2913:53
yfriedgeorgem1: if you run "boot_server" server instead, 50 VMs will be created and the scenario will finish. THEN, cleanup will delete all 5013:53
*** baker has joined #openstack-rally13:53
yfriedgeorgem1: that's a very common misunderstanding13:53
*** e0ne is now known as e0ne_13:53
yfriedgeorgem1: take a look at https://rally.readthedocs.org/en/latest/ and if it seems unclear, you are welcom to open a bug and/or edit the doc13:54
*** stpierre has joined #openstack-rally13:54
yfriedgeorgem1: btw, if you take a look at the results.html file you'll things more clearly13:54
*** e0ne_ is now known as e0ne13:55
*** rook has quit IRC13:55
georgem1yfried: the report shows a count of 10 for the iteration, so it did 10 iterations of 5 instances (I assume), which is different than what you said13:57
*** rook has joined #openstack-rally13:58
georgem1ok, so if I want to have 50 instances started once and then deleted and repeat the process 10 times, I should change to concurrency: 500 and times: 1013:59
*** fhubik is now known as fhubik_afk13:59
yfriedgeorgem1: could you please share your HTML?14:00
yfriedgeorgem1: times:500, concurrency:1014:00
yfriedgeorgem1: but maby RPS runner might suite you better?14:01
*** tosky has quit IRC14:02
*** tosky has joined #openstack-rally14:02
georgem1http://picpaste.com/Screen_Shot_2015-05-12_at_10.02.12_AM-DwVcNSlU.png14:02
*** baker has quit IRC14:04
*** baker has joined #openstack-rally14:05
georgem1yfried: yeah, I definitely don't understand how this works… I tried again with   "concurrency": 500,  "times": 10 and the count of deleted instances containing the word rally went up by only 1014:06
yfriedboris-42: andreykurilin1: redixin: amaretskiy: where's the design summit agenda/etherpads re Rally?14:07
yfriedgeorgem1: I can't help you with screen captures. I need to see the actual HTML file14:08
yfriedgeorgem1: what do you mean "count of deleted instances containing the word rally"14:08
georgem1yfried: this is how I see how many instances were created by rally14:09
yfriedgeorgem1: are you doing "nova list | grep rally | grep delete" | wc -l14:09
yfriedgeorgem1: or something like that?14:09
georgem1nova list --all-ten --deleted | grep rally | wc -l14:09
georgem1yes14:09
yfriedgeorgem1: that wouldn't work14:09
georgem1why?14:09
yfriedgeorgem1: please consider that you are actually looking at the VMs *currently being deleted*14:09
yfriedgeorgem1: some VMs might be deleted faster, prior or after you are executing teh query14:10
georgem1yfried: no, I'm pretty sure I see instances deleted long time ago14:10
boris-42yfried: it's openstack14:13
boris-42yfried: for now14:13
yfriedboris-42: what do you mean?14:13
yfriedgeorgem1: ok. I was unfamiliar with the "--deleted" option14:13
* yfried rechecking georgem1 command14:14
andreykurilin1yfried: https://libertydesignsummit.sched.org/type/design+summit/rally#.VVIKmeRZ5Qs14:14
boris-42yfried: rally cleanup context14:14
boris-42yfried: is for now openstack14:14
yfriedboris-42: you want me to move the entire cleanup dir under plugins.openstack? ok but it seems that it should have something in common, for WHEN we have non-openstack scenario/resources14:15
openstackgerritChris St. Pierre proposed openstack/rally: Add Heat scenario to test scaling policies  https://review.openstack.org/17843614:15
boris-42yfried: it's not common at all14:15
boris-42yfried: there is nothing common inside it for now14:15
yfriedboris-42: I understand. just thinking ahead14:16
yfriedboris-42: some base/abstarct14:16
boris-42yfried: someday when somebody decide to do something abstract based on what we have14:16
boris-42yfried: we will handle it properly14:16
yfriedandreykurilin1: any rally talks in the main summit?14:16
*** fhubik_afk is now known as fhubik14:18
yfried[17:06] <georgem1> yfried: yeah, I definitely don't understand how this works… I tried again with   "concurrency": 500,  "times": 10 and the count of deleted instances containing the word rally went up by only 1014:18
yfriedgeorgem1: ^ so this is in line with what I've said - "times:10" means that you will be launching 10 VMs total.14:19
yfriedgeorgem1: you've dedicated 500 threads to do so (which is, obviously, an overkill)14:19
yfriedgeorgem1: so are you good? have you looked at RPS runner, seems like it's exactly what you are looking for14:20
*** fhubik is now known as fhubik_afk14:20
*** fhubik_afk is now known as fhubik14:22
openstackgerritSergey Skripnick proposed openstack/rally: Improve installation script  https://review.openstack.org/16241814:25
openstackgerritChris St. Pierre proposed openstack/rally: Fix security groups cleanup  https://review.openstack.org/17942814:29
georgem1yfried: thanks for help, I'll do some reading on the RPS runner14:31
yfriedgeorgem1: sure. but does my explanation make sense to you?14:31
georgem1yfried: yes, it does now14:32
yfriedgeorgem1: great. glad I could help14:34
*** baker has quit IRC14:45
yfriedboris-42: now I need another core with the patience to go over these patches...14:45
yfriedboris-42: msdubov: https://review.openstack.org/#/q/topic:bp/split-plugins,n,z how do I add these to the next release?14:46
*** fhubik is now known as fhubik_afk14:51
*** fhubik_afk is now known as fhubik14:51
*** e0ne is now known as e0ne_14:51
*** fhubik is now known as fhubik_afk14:51
*** jaypipes has quit IRC14:54
openstackgerritAlexander Maretskiy proposed openstack/rally: [Fuel] Add Fuel scenario `list_environments'  https://review.openstack.org/17873114:57
*** e0ne_ is now known as e0ne14:58
*** baker has joined #openstack-rally15:03
*** anshul has quit IRC15:03
*** baker has quit IRC15:04
openstackgerritNikita Konovalov proposed openstack/rally: Wait for status  https://review.openstack.org/17246615:04
*** baker has joined #openstack-rally15:04
*** kiran-r has joined #openstack-rally15:08
*** fhubik_afk is now known as fhubik15:11
*** kiranr has joined #openstack-rally15:11
boris-42yfried: OH https://review.openstack.org/#/c/182284/215:11
boris-42yfried: a lot of files=)15:11
*** cdent has quit IRC15:12
*** kiran-r has quit IRC15:13
*** aswadr has joined #openstack-rally15:14
*** fhubik has quit IRC15:14
yfriedboris-42: every file that uses "context"15:16
yfriedboris-42: https://review.openstack.org/#/c/181738/4 a lot more15:17
boris-42yfried: split it please15:17
boris-42yfried: to few patches15:17
*** asrangne has quit IRC15:17
*** arxcruz has quit IRC15:17
boris-42yfried: you don't need to move everything in one step *15:17
*** pradeep has joined #openstack-rally15:19
yfriedboris-42: considering that some tests use "plugins.openstack.scenario" stuff it would make the patches unnecessary complex15:20
*** aswadr has quit IRC15:20
yfriedboris-42: better handle each plugin in a single patch. it's hell to sort as ti is15:20
boris-42yfried: I am asking another thing15:21
boris-42yfried: directories are mostly indpenedent15:21
boris-42yfried: except nova/vm15:21
boris-42yfried: so you can move few directories of scenarios in each patch15:21
boris-42yfried: e.g. zaqar, murano, mistral, designate can be move in one patch15:22
boris-42yfried: after that nova, vm in another15:22
boris-42yfried: glance, cinder, sahara and rest in third15:22
boris-42and so on15:22
yfriedboris-42: I'd rather not. it was a hard work to do this as it was. splitting it would be even harder15:26
*** kiranr has quit IRC15:26
boris-42yfried: why do you think so?15:26
boris-42yfried: it's a bit hell for reviewer https://review.openstack.org/#/c/181738/15:27
*** klindgren has joined #openstack-rally15:27
yfriedboris-42: because it means that's i'll have to revert PARTS of this patch in order to split it15:28
yfriedboris-42: I know these are a lot of files, but the biggest change to a single is 12 lines.15:29
boris-42yfried: yep but I can't even check that you moved everything properly..=( with proper names15:30
boris-42and there is no typos in files15:30
boris-42filenames..15:30
yfriedboris-42: the move was done using pycharm's refactor, so the filenames should be intact15:30
yfriedboris-42: but I understand what you are saying15:31
yfriedboris-42: I'll try15:31
openstackgerritRoman Vasilets proposed openstack/rally: Add deploy environment murano benchmark  https://review.openstack.org/17162515:38
*** jaypipes has joined #openstack-rally15:45
*** agarciam has quit IRC15:54
*** klindgren has quit IRC15:57
*** gema_ has quit IRC15:59
*** gema_ has joined #openstack-rally16:01
*** klindgren has joined #openstack-rally16:02
*** gema_ has quit IRC16:07
*** gema_ has joined #openstack-rally16:08
yfriedboris-42: it's too hard to split this retroactively https://review.openstack.org/#/c/181738/4/rally/common/opts.py,cm16:10
openstackgerritSergey Skripnick proposed openstack/rally: Improve installation script  https://review.openstack.org/16241816:10
yfriedboris-42: btw, if the names were wrong, the tests would have failed, as some imports are strings and some are python syntax16:11
*** exploreshaifali has joined #openstack-rally16:11
*** openstackgerrit_ has quit IRC16:11
yfriedboris-42: so it's enough to look at the name changes in the test files and you don't need to look that the diff list in gerrit16:12
yfriedboris-42: sorry that's it's too long. I'll try to split the work better in the furure16:12
*** davideagnello has quit IRC16:17
*** davideagnello has joined #openstack-rally16:19
*** davideagnello has quit IRC16:25
*** davideagnello has joined #openstack-rally16:26
yfriedboris-42: when is the rally mtg?16:34
yfriedredixin: amaretskiy: andreykurilin1: ^16:36
yfriedmeteorfox: ^^16:36
amaretskiy yfried: we have rescheduled meetings to wednesday16:39
amaretskiyin mailing list16:39
yfriedamaretskiy: so tomorrow?16:39
amaretskiyunfortunately wiki is not updated https://wiki.openstack.org/wiki/Rally#Where_can_I_discuss_.26_propose_changes.3F16:39
*** gema_ has quit IRC16:39
amaretskiy yfried I guess - yes :)16:39
rookamaretskiy yfried is there any place I can get more information on rps?16:41
rookcomparing rps / constant ?16:41
*** gema_ has joined #openstack-rally16:41
*** karimb has quit IRC16:43
boris-42yfried: okay16:43
boris-42rook: so what you are interested in?16:43
boris-42rook: contant - has contant amount of workers per whole test16:44
boris-42rook: rps - has not constant amount of workers per whole test16:44
boris-42rook: rps - will start new iteration each (1 / rps) second16:44
boris-42rook: constant - will start new iteration when some of previous iteration get finished*16:45
boris-42rook: ^ that's the whole difference16:45
rookboris-42 thanks!16:45
rookboris-42 with SLA do we have a mechanism to increase load on successful iterations? ( i had this scripted previously )16:46
rookfor example : if I ran the VMTask scenario, with concurrency of 100 and times 100.. if that returns success, i would want to increase concurrency and times, to 150/150 for example.16:47
rookto simulate a bootstorm.16:47
rookthe desired outcome would be, it would keep increasing N instances, until i could no longer sustain the SLA16:47
boris-42rook: so for now we are supporting only aborting load on SLA failure16:48
boris-42rook: to do what you want you can implement own runner16:49
rookboris-42 hm ok16:50
boris-42rook: basically you can extend rps runner to do the ramp stuff16:51
boris-42rook: or we can extend it16:51
rookboris-42: i have scripted this outside of Rally in the past.16:52
rookmight make sense to bring the logic into Rally at some point.16:52
boris-42rook: https://github.com/openstack/rally/blob/master/rally/benchmark/runners/rps.py#L142-L21416:52
boris-42rook: so I am not sure that we will be able to do the next steps based on SLA results16:53
boris-42rook: because it affects engine16:53
rookokay16:53
openstackgerritNikita Konovalov proposed openstack/rally: [Sahara] More debug logging  https://review.openstack.org/17049116:53
boris-42rook: at least you can push feature requres16:54
boris-42rook: so we will implement this at some point of time https://github.com/openstack/rally/tree/master/doc/feature_request16:54
openstackgerritAlexander Maretskiy proposed openstack/rally: [Fuel] Add Fuel scenario `list_environments'  https://review.openstack.org/17873116:55
*** yfried has quit IRC16:55
*** PerfBeing has joined #openstack-rally16:55
*** amaretskiy has quit IRC17:01
*** dmorita has quit IRC17:02
*** ptoohill has quit IRC17:02
*** ptoohill has joined #openstack-rally17:02
*** dmorita has joined #openstack-rally17:03
openstackgerritRoman Vasilets proposed openstack/rally: Add deploy environment murano benchmark  https://review.openstack.org/17162517:04
*** vkmc has quit IRC17:04
*** vkmc has joined #openstack-rally17:05
openstackgerritRoman Vasilets proposed openstack/rally: Add deploy environment murano benchmark  https://review.openstack.org/17162517:08
rookboris-42: is vmtask scenario back to defaulting to floating ip?17:15
rookNM - i was looking at a old repo.17:18
rookgood to go.17:18
*** baker has quit IRC17:20
*** harlowja has quit IRC17:22
*** harlowja has joined #openstack-rally17:22
boris-42rook: it works with both17:22
boris-42rook: fixed/floating17:23
rookyup17:23
rookboris-42: i had to change branches ;)17:23
*** imarnat is now known as igormarnat17:23
boris-42rook: heh17:24
boris-42rook: we have a lot of changes recently17:25
*** igormarnat is now known as imarnat17:29
*** baker has joined #openstack-rally17:31
*** baker has quit IRC17:31
*** baker has joined #openstack-rally17:32
openstackgerritRoman Vasilets proposed openstack/rally: Add deploy environment murano benchmark  https://review.openstack.org/17162517:32
*** baker has quit IRC17:36
*** baker has joined #openstack-rally17:37
*** exploreshaifali has quit IRC17:41
*** e0ne is now known as e0ne_17:47
*** pradeep has quit IRC17:53
*** rdas has quit IRC17:54
*** e0ne_ is now known as e0ne17:56
*** e0ne has quit IRC17:59
*** georgem1 has left #openstack-rally18:01
*** pradeep has joined #openstack-rally18:08
*** pradeep has quit IRC18:16
*** imarnat is now known as igormarnat18:26
boris-42stpierre: so what do you think about the very last version https://review.openstack.org/#/c/162418/ ?18:26
*** cdent has joined #openstack-rally18:29
*** exploreshaifali has joined #openstack-rally18:29
stpierrelemme take a look. i was waiting for it to pass gate first :)18:31
jlkboris-42: ping; might have found a comment bug, not positive.  https://github.com/openstack/rally/blob/master/rally/benchmark/scenarios/nova/servers.py#L327  says it'll make a volume, but I don't see anything in that test about a volume18:32
boris-42jlk: can you fix it please?)18:35
jlksure, I just wanted to confirm that the test doesn't actually do a volume18:35
boris-42jlk: seems like we missed copy paste bug=(18:35
boris-42jlk: yep docstring is wired18:35
boris-42jlk: so we should fix docstring18:36
jlkfixing18:36
boris-42jlk: btw comment regarding to cleanup is bad as well18:36
jlkI just noticed that too :)18:37
boris-42jlk: actually we should sit down someday18:38
jlkyes18:38
boris-42jlk: and just do the docstring cleanup18:38
boris-42jlk: we are doing it periodically18:39
*** baker has quit IRC18:39
openstackgerritJesse Keating proposed openstack/rally: Fixup resize_server docstring to match reality  https://review.openstack.org/18240518:40
boris-42jlk: ^ +2+1ed18:42
*** igormarnat is now known as imarnat18:42
*** baker has joined #openstack-rally18:50
*** baker has quit IRC18:50
*** baker has joined #openstack-rally18:51
*** e0ne has joined #openstack-rally18:51
boris-42stpierre: thanks for review18:54
stpierrenp. sorry i keep -1'ing this :(18:54
boris-42redixin: so seems like your patch is almost ready for merging18:54
boris-42redixin: there are few comments from me and stpierre18:54
redixinboris-42, nice18:55
boris-42redixin: nothing serious just nitpicks mostly18:56
*** yfried has joined #openstack-rally18:57
*** imarnat is now known as igormarnat18:59
*** exploreshaifali has quit IRC19:01
jlkboris-42: hi there.19:10
jlkI want to run a resize test with confirm, and then another without confirm (to ensure resize revert works)19:11
jlkbut if I make two tests in the same file and that's the only difference, rally seems to only do one test19:11
boris-42jlk: nope19:12
jlkmaybe it's my older version of rally?19:12
boris-42jlk: nope19:12
boris-42jlk: seems like you are putting bad input file19:12
jlkmaybe19:12
boris-42jlk: paste it19:12
jlkjust a tic19:12
jlkoooh19:12
jlkif i want two runs under the same name, do I just make two list entries under the name block?19:13
* jlk tries that first19:13
boris-42jlk: https://rally.readthedocs.org/en/latest/tutorial/step_2_running_multple_benchmarks_in_a_single_task.html19:15
boris-42jlk: ^ this is what you are looking for19:15
boris-42jlk: I agree that current input format is odd19:15
jlkboris-42: yeah I had the yaml wrong19:15
jlkis yaml or json preferred?19:15
boris-42jlk: any19:15
*** openstackgerrit_ has joined #openstack-rally19:16
jlkbingo19:16
jlkgot it to work19:16
boris-42jlk: heh new format is much better...19:17
boris-42jlk: https://github.com/openstack/rally/blob/master/doc/specs/in-progress/new_rally_input_task_format.rst19:17
jlkyeah, one of my epics this sprint is to upgrade our rally19:17
jlkneat19:18
boris-42jlk: what version do you use of rally?19:18
*** aix has quit IRC19:18
jlkhrm, let me see if I can discover that19:19
boris-42jlk: there should be any issues to move from 0.0.1 -> 0.0.419:19
boris-42shoulndn't*19:19
jlk0.0.119:19
boris-42jlk: not sure that it's the first version..19:19
jlkit might not be19:19
boris-42jlk: how did you install it? git clone && install_rally.sh?19:19
jlkyeah19:19
boris-42jlk: can you show me the git log -1 ?19:20
jlkjust a sec, running a test from that cli19:20
jlkour install is somewhat janky because it was a "spike", a trial. We never did the work to fully SCM it19:20
openstackgerritMerged openstack/rally: [Sahara] Improve Image context  https://review.openstack.org/16685919:21
boris-42jlk: how old installation is?19:21
boris-42jlk: if it is about 1/2 year then upgrade should be smooth19:22
jlkhrm. less than 6 months old?19:22
boris-42jlk: download new code and reinstall it19:22
boris-42jlk: yep19:22
jlkmuch less because I've only been here for 6~ months19:22
boris-42jlk: so you should do next thing (remember the hash of commit where you are now)19:23
jlkyeah my card is to do that, install the new version, change our templates a bit, and show people how to do one-shot executions on a specific cluster with run-time template definitions19:23
boris-42jlk: backup DB19:23
boris-42jlk: download new code and try to run it with the same DB19:23
boris-42jlk: it should work19:23
jlkI don't even think we need the old db around19:23
boris-42jlk: ah then it's super simple19:24
boris-42jlk: you can do it even now19:24
jlkoh, question. If I wanted to re-use parts of rally to render html from result json, is that easy to do? We're thinking about embedding rally results into our internal CMDB19:24
jlkbut instead of storing pre-rendered html we want to store the json19:24
boris-42jlk: so rally task report19:24
boris-42jlk: accept both N json files and UUIDs of task19:25
boris-42jlk: you can even mix them19:25
jlkah good.19:25
boris-42jlk: it will create single HTML page19:25
*** openstackgerrit_ has quit IRC19:25
jlkyeah, we dump out the html right now and just toss it in a directory, which is not great19:26
jlkwe'd rather associate the runs with the customer/cluster, so we can look back and show results on-demand19:26
jlkbut without either storing raw html or writing our own renderer. Seems  using report would be good enough19:27
*** jjmb has joined #openstack-rally19:30
*** jjmb has quit IRC19:31
boris-42jlk: be back soon19:33
boris-42jlk: why not storing to Rally db everytyhing?19:33
boris-42jlk: btw?)19:33
jlkBecause I'm not sure I want to introduce another API/DB that we have to keep running/monitored/backedup/etc..19:34
jlkI'd rather our rally be as stateless as possible and store the data in our existing system19:34
jlkboris-42: will there be structure in the future to do things like "ensure I can still ping/ssh to the host during the test" type stuff? Like if I wanted to boot, ping, resize, ping, resize confirm/revert, ping ?19:36
jlkboris-42: our install is from 930394d3e9afcbef20976eefefb9e72bd7fa498e, jan 20th19:39
*** turul_ has joined #openstack-rally19:46
*** botang has quit IRC19:47
*** botang has joined #openstack-rally19:48
*** afazekas has quit IRC19:50
*** igormarnat is now known as imarnat20:09
*** PerfBeing has quit IRC20:11
*** PerfBeing has joined #openstack-rally20:12
*** karimb has joined #openstack-rally20:13
*** PerfBeing has quit IRC20:16
*** imarnat is now known as igormarnat20:24
*** igormarnat is now known as imarnat20:24
boris-42jlk: ok20:25
boris-42jlk: so what you want is actually boot_and_bounce_server20:26
boris-42jlk: but a bit extended wiht ping/ssh stuff20:26
jlkperhaps, but I was specifically looking to test w/ resize20:26
jlksince resize or migrate will send the instance elsewhere20:27
jlknot necessary for the minimum viable product though.20:27
boris-42jlk: so you can extend the boot_and_bounce server20:28
jlkah20:28
boris-42jlk: to add resize action20:28
boris-42jlk: or migrate20:29
jlkmakes sense20:29
boris-42jlk: it was actually already attempt20:29
boris-42jlk: for livemigrate20:29
*** logan2 has quit IRC20:33
*** openstackgerrit has quit IRC20:37
*** openstackgerrit has joined #openstack-rally20:37
*** e0ne has quit IRC20:52
*** e0ne has joined #openstack-rally20:53
*** imarnat is now known as igormarnat20:55
openstackgerritChris St. Pierre proposed openstack/rally: Add Nova scenario to boot multiple servers in one request  https://review.openstack.org/17685820:57
*** e0ne has quit IRC21:03
openstackgerritMerged openstack/rally: Fixup resize_server docstring to match reality  https://review.openstack.org/18240521:04
*** PerfBeing has joined #openstack-rally21:07
*** ibiris is now known as ibiris_away21:27
*** igormarnat is now known as imarnat21:29
openstackgerritMerged openstack/rally: Split SLA to base and plugins  https://review.openstack.org/18050921:38
*** imarnat is now known as igormarnat21:39
*** igormarnat is now known as imarnat21:40
*** cdent has quit IRC21:47
openstackgerritRoman Vasilets proposed openstack/rally: Add deploy environment murano benchmark  https://review.openstack.org/17162521:52
*** karimb has quit IRC21:57
*** tosky has quit IRC22:02
*** tosky has joined #openstack-rally22:03
*** stpierre has quit IRC22:03
*** MaxPC has quit IRC22:10
*** jaypipes has quit IRC22:13
*** logan2 has joined #openstack-rally22:18
*** redixin has quit IRC22:23
*** PerfBeing has quit IRC22:26
*** baker has quit IRC22:26
*** PerfBeing has joined #openstack-rally22:26
*** botang has quit IRC22:29
*** botang has joined #openstack-rally22:31
*** PerfBeing has quit IRC22:32
*** davideagnello has quit IRC22:56
*** davideagnello has joined #openstack-rally22:56
*** imarnat is now known as igormarnat23:20
*** igormarnat is now known as imarnat23:22
*** imarnat is now known as igormarnat23:25
*** igormarnat is now known as imarnat23:39
*** PerfBeing has joined #openstack-rally23:40
*** imarnat is now known as igormarnat23:43
*** igormarnat is now known as imarnat23:44
*** PerfBeing has quit IRC23:59
*** jjmb has joined #openstack-rally23:59
*** PerfBeing has joined #openstack-rally23:59
« Monday, 2015-05-11 Index Wednesday, 2015-05-13 »

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!