Thursday, 2016-03-31

*** mvk_ has quit IRC00:03
*** pvaneck has quit IRC00:12
*** diogogmt has joined #openstack-rally00:22
*** davideag_ has quit IRC00:23
*** rpromyshlennikov has quit IRC00:23
*** rpromyshlennikov has joined #openstack-rally00:35
*** mvk_ has joined #openstack-rally00:37
*** omar_rally_noob has joined #openstack-rally00:39
*** mkrcmari__ has quit IRC00:40
*** adiantum has quit IRC00:43
omar_rally_noobhow do you know exactly what a task is doing for example https://github.com/openstack/rally/blob/master/samples/tasks/scenarios/authenticate/keystone.json I understand the task is going to create 3 tenants with 50 users in each tenant and auth 100 times with 5db transactions at a time.00:43
omar_rally_noobdoes the task produce logs or detailed output, all i get are results from running these tasks00:45
*** yingjun has joined #openstack-rally00:49
*** stpierre has joined #openstack-rally00:54
*** stpierre has quit IRC00:55
boris-42omar_rally_noob: hi01:06
*** baohua has joined #openstack-rally01:07
boris-42omar_rally_noob: you can run "rally task results" to get all data in JSON or "rally task report" to get HTML reports01:07
boris-42omar_rally_noob: as well you can run rally -v task start ... to get logs of running rally01:07
boris-42or -vd to get debug01:07
*** omar_rally_noob has quit IRC01:07
*** akrzos has quit IRC01:41
*** ilbot3 has quit IRC01:45
*** yanyanhu has joined #openstack-rally01:47
*** ilbot3 has joined #openstack-rally01:48
*** yanyanhu has quit IRC01:57
*** yanyanhu has joined #openstack-rally01:58
*** harshs has quit IRC02:02
*** akrzos has joined #openstack-rally02:07
openstackgerritYanyan Hu proposed openstack/rally: Add basic support for Senlin service  https://review.openstack.org/29810902:32
openstackgerritMerged openstack/rally: Change deployment model schema  https://review.openstack.org/27682102:57
*** yanyanhu has quit IRC03:05
*** yanyanhu has joined #openstack-rally03:06
*** ajo_ has joined #openstack-rally03:27
*** rpromysh1 has joined #openstack-rally03:30
*** dmellado_ has joined #openstack-rally03:31
*** ajo has quit IRC03:32
*** rpromyshlennikov has quit IRC03:32
*** dmellado has quit IRC03:32
*** serverascode has quit IRC03:33
*** serverascode has joined #openstack-rally03:39
*** akrzos has quit IRC04:06
*** dratushnyy has joined #openstack-rally04:15
*** ushkalim has quit IRC04:31
*** rdas has joined #openstack-rally04:39
*** arnoldje has quit IRC04:49
*** shausy has joined #openstack-rally04:59
*** rcernin has joined #openstack-rally04:59
*** dratushnyy has quit IRC05:09
*** dratushnyy has joined #openstack-rally05:09
*** dratushnyy has quit IRC05:10
*** sverma has joined #openstack-rally05:28
*** shausy has quit IRC05:39
*** shausy has joined #openstack-rally05:39
*** dratushnyy has joined #openstack-rally05:43
*** lazy_prince has quit IRC05:44
*** pcaruana has quit IRC05:49
*** lazy_prince has joined #openstack-rally05:53
*** e0ne has joined #openstack-rally05:56
*** rdas has quit IRC05:56
openstackgerritBoris Pavlovic proposed openstack/rally: Reduce default speed of users creation in users context  https://review.openstack.org/29975705:57
*** rdas has joined #openstack-rally05:57
*** ushkalim has joined #openstack-rally06:09
*** lazy_prince has quit IRC06:15
*** e0ne has quit IRC06:24
*** lazy_prince has joined #openstack-rally06:24
*** bkopilov has quit IRC06:24
*** winston-d_ has joined #openstack-rally06:32
*** bkopilov has joined #openstack-rally06:36
*** tesseract has joined #openstack-rally06:49
*** tesseract is now known as Guest1103706:49
*** akamyshnikova has joined #openstack-rally06:51
*** e0ne has joined #openstack-rally07:15
*** e0ne has quit IRC07:18
*** abehl has joined #openstack-rally07:24
*** arxcruz has joined #openstack-rally07:30
*** pcaruana has joined #openstack-rally07:41
*** permalac has joined #openstack-rally07:48
openstackgerritBoris Pavlovic proposed openstack/rally: Calculate duration of load more accurate  https://review.openstack.org/29859007:48
*** rdas has quit IRC07:54
openstackgerritSrinivas Sakhamuri proposed openstack/rally: Use glance wrapper for nova and cinder  https://review.openstack.org/29878707:55
*** klindgren has quit IRC07:56
*** klindgren has joined #openstack-rally07:57
openstackgerritMerged openstack/rally: Reduce default speed of users creation in users context  https://review.openstack.org/29975707:57
openstackgerritMerged openstack/rally: Actually delete result_batch arrays  https://review.openstack.org/29863607:59
*** amaretskiy has joined #openstack-rally08:02
*** permalac has quit IRC08:06
*** permalac has joined #openstack-rally08:25
*** rpromysh1 has quit IRC08:27
*** rpromyshlennikov has joined #openstack-rally08:27
*** e0ne has joined #openstack-rally08:28
*** e0ne has quit IRC08:29
openstackgerritMerged openstack/rally: [Reports] Various fixes for load profile chart  https://review.openstack.org/29862208:32
*** e0ne has joined #openstack-rally08:34
*** e0ne has quit IRC08:35
*** adiantum has joined #openstack-rally08:38
openstackgerritRodion Promyshlennikov proposed openstack/rally: Move Credentials initialization to OSClients  https://review.openstack.org/29452008:43
openstackgerritRodion Promyshlennikov proposed openstack/rally: Make Credential class plugin based  https://review.openstack.org/29452108:43
*** adiantum has quit IRC08:43
*** rdas has joined #openstack-rally08:44
openstackgerritRodion Promyshlennikov proposed openstack/rally: Add support for multi-credentials deployment  https://review.openstack.org/29720208:44
*** adiantum has joined #openstack-rally08:48
openstackgerritAndrey Kurilin proposed openstack/rally: DO NOT MERGE: print more debug messages for neutron scenario  https://review.openstack.org/28852209:20
*** yingjun has quit IRC09:24
*** e0ne has joined #openstack-rally09:30
*** baohua has quit IRC09:35
*** e0ne has quit IRC09:37
openstackgerritMerged openstack/rally: Calculate duration of load more accurate  https://review.openstack.org/29859009:40
*** sverma has quit IRC09:41
*** e0ne has joined #openstack-rally09:42
*** mkrcmari__ has joined #openstack-rally09:44
*** tosky has joined #openstack-rally09:45
openstackgerritBoris Pavlovic proposed openstack/rally: [WIP] OMG performance what are you doing? stohp please!!  https://review.openstack.org/29859109:46
openstackgerritBoris Pavlovic proposed openstack/rally: [Reports] Fix calc of running iterations in parallel  https://review.openstack.org/29983309:46
*** mvk_ has quit IRC09:47
*** mvk_ has joined #openstack-rally09:52
*** yanyanhu has quit IRC09:54
*** yanyanhu has joined #openstack-rally09:55
*** yanyanhu has quit IRC09:55
*** mkrcmari__ has quit IRC09:55
*** rook-lappy has quit IRC10:05
*** mkrcmari__ has joined #openstack-rally10:13
*** e0ne has quit IRC10:15
*** mvk_ has quit IRC10:17
*** e0ne has joined #openstack-rally10:17
*** klindgren has quit IRC10:20
*** e0ne has quit IRC10:20
*** klindgren has joined #openstack-rally10:20
*** e0ne has joined #openstack-rally10:21
*** e0ne has quit IRC10:22
*** e0ne has joined #openstack-rally10:23
*** e0ne has quit IRC10:24
*** mvk_ has joined #openstack-rally10:28
*** mkrcmari__ has quit IRC10:32
*** winston-d_ has quit IRC10:42
*** permalac has quit IRC10:44
*** dmellado_ is now known as dmellado10:52
*** rdas has quit IRC10:59
*** e0ne has joined #openstack-rally11:17
*** e0ne has quit IRC11:18
*** bigjools has quit IRC11:22
*** e0ne has joined #openstack-rally11:23
*** bigjools has joined #openstack-rally11:24
*** bigjools has quit IRC11:24
*** bigjools has joined #openstack-rally11:24
*** e0ne has quit IRC11:26
*** sverma has joined #openstack-rally11:26
*** sverma has quit IRC11:28
*** sverma has joined #openstack-rally11:33
openstackgerritMerged openstack/rally: devstack: support to be enabled with different plugin name  https://review.openstack.org/29623911:33
*** e0ne has joined #openstack-rally11:35
openstackgerritPiyush Raman Srivastava proposed openstack/rally: Show Missing Argument Error raised by Argparse  https://review.openstack.org/29834911:38
openstackgerritDmitry Ratushnyy proposed openstack/rally: [CLI] Display task errors in human-friendly form  https://review.openstack.org/29472711:40
*** adiantum has quit IRC11:40
openstackgerritChris St. Pierre proposed openstack/rally: Add Cinder volume_types context  https://review.openstack.org/29540311:41
*** e0ne has quit IRC11:41
*** akrzos has joined #openstack-rally11:54
*** yingjun has joined #openstack-rally11:57
*** e0ne has joined #openstack-rally11:59
*** e0ne has quit IRC12:00
*** adiantum has joined #openstack-rally12:05
*** e0ne has joined #openstack-rally12:11
*** e0ne has quit IRC12:13
*** kbaikov has quit IRC12:14
*** akrzos has quit IRC12:26
*** akrzos has joined #openstack-rally12:27
*** moravec has quit IRC12:30
*** MaxPC has joined #openstack-rally12:44
openstackgerritIllia Khudoshyn proposed openstack/rally: Refactor DB shema for task results  https://review.openstack.org/29702012:45
openstackgerritAlexander Maretskiy proposed openstack/rally: [Reports] Fix calc of running iterations in parallel  https://review.openstack.org/29983312:48
*** shausy has quit IRC12:49
*** e0ne has joined #openstack-rally12:50
*** dmellado is now known as dmellado|lunch12:50
*** e0ne has quit IRC12:51
openstackgerritAlexander Maretskiy proposed openstack/rally: [WIP] OMG performance what are you doing? stohp please!!  https://review.openstack.org/29859112:51
openstackgerritMerged openstack/rally: [Reports] Refactor processing.plot.plot  https://review.openstack.org/29411913:02
openstackgerritMerged openstack/rally: [Reports] Move angular directive to separate file  https://review.openstack.org/29859713:02
openstackgerritAndrey Kurilin proposed openstack/rally: Use existing_users in TestTaskSamples  https://review.openstack.org/29991913:04
*** mvk_ has quit IRC13:06
*** MaxPC has quit IRC13:15
*** yingjun has quit IRC13:19
*** yingjun has joined #openstack-rally13:20
*** baohua has joined #openstack-rally13:22
*** stpierre has joined #openstack-rally13:24
*** yingjun has quit IRC13:24
*** MaxPC has joined #openstack-rally13:29
*** diogogmt has quit IRC13:30
*** e0ne has joined #openstack-rally13:32
*** dratushnyy has quit IRC13:34
*** diogogmt has joined #openstack-rally13:35
*** dpaterson has joined #openstack-rally13:38
*** moravec has joined #openstack-rally13:40
openstackgerritYanyan Hu proposed openstack/rally: Add basic support for Senlin service  https://review.openstack.org/29810913:41
*** permalac has joined #openstack-rally13:45
*** klkumar has joined #openstack-rally13:46
*** arnoldje has joined #openstack-rally13:47
*** kbaikov has joined #openstack-rally13:47
*** e0ne has quit IRC13:52
*** permalac has quit IRC13:53
*** baohua has quit IRC13:53
*** diogogmt has quit IRC13:54
*** e0ne has joined #openstack-rally13:54
*** dmellado|lunch is now known as dmellado13:54
*** baohua has joined #openstack-rally13:54
*** e0ne has quit IRC13:56
*** pkarikh has joined #openstack-rally14:01
*** pkarikh has left #openstack-rally14:02
*** rook-lappy has joined #openstack-rally14:05
*** ushkalim has quit IRC14:06
openstackgerritAndrey Kurilin proposed openstack/rally: Use existing_users in TestTaskSamples  https://review.openstack.org/29991914:06
*** baohua has quit IRC14:07
*** baohua has joined #openstack-rally14:08
*** ushkalim has joined #openstack-rally14:17
*** baohua_ has joined #openstack-rally14:18
*** baohua has quit IRC14:21
*** rook-lappy has quit IRC14:22
*** e0ne has joined #openstack-rally14:29
*** e0ne has quit IRC14:29
openstackgerritRoman Vasilets proposed openstack/rally: Add exact error message into runcommand_heat scenario  https://review.openstack.org/29999914:38
openstackgerritRoman Vasilets proposed openstack/rally: [Docs] Anniversary patch  https://review.openstack.org/30000314:42
*** mvk_ has joined #openstack-rally14:42
*** e0ne has joined #openstack-rally14:45
openstackgerritSrinivas Sakhamuri proposed openstack/rally: Make glance web uploads streamable  https://review.openstack.org/29780814:46
*** zhenq has joined #openstack-rally14:51
*** yingjun has joined #openstack-rally15:00
*** ushkalim has quit IRC15:01
*** e0ne has quit IRC15:01
openstackgerritAndrey Kurilin proposed openstack/rally: Use existing_users in TestTaskSamples  https://review.openstack.org/29991915:07
*** abehl has quit IRC15:08
*** ushkalim has joined #openstack-rally15:13
*** klkumar has quit IRC15:17
*** baohua_ has quit IRC15:22
*** arxcruz has quit IRC15:25
*** baohua has joined #openstack-rally15:27
*** e0ne has joined #openstack-rally15:37
*** tosky has quit IRC15:38
*** e0ne has quit IRC15:40
*** adiantum has quit IRC15:43
*** e0ne has joined #openstack-rally15:44
*** e0ne has quit IRC15:46
*** e0ne has joined #openstack-rally15:47
*** baohua has quit IRC15:50
*** klkumar has joined #openstack-rally15:53
*** harshs has joined #openstack-rally15:53
*** harshs has quit IRC15:53
*** jaypipes has joined #openstack-rally15:55
*** e0ne has quit IRC15:58
*** yingjun has quit IRC16:01
*** pcaruana has quit IRC16:08
*** e0ne has joined #openstack-rally16:11
*** amaretskiy has quit IRC16:22
*** arnoldje has quit IRC16:26
*** davideagnello has joined #openstack-rally16:30
*** e0ne has quit IRC16:32
*** pvaneck has joined #openstack-rally16:42
*** e0ne has joined #openstack-rally16:47
*** e0ne has quit IRC16:50
*** diogogmt has joined #openstack-rally17:01
*** Guest11037 has quit IRC17:05
*** tosky has joined #openstack-rally17:05
*** rcernin has quit IRC17:06
*** lezbar has quit IRC17:13
openstackgerritMerged openstack/rally: Fix validate_args function in cliutils  https://review.openstack.org/29356917:28
*** dratushnyy has joined #openstack-rally17:34
boris-42@stpierre hi17:37
boris-42@stpierre http://logs.openstack.org/33/299833/2/check/gate-rally-dsvm-neutron-rally/c064f03/rally-plot/resources_diff.txt.gz17:37
boris-42stpierre: ^ this looks bad17:37
stpierrei don't think that's a new problem17:40
stpierrelooks like it may have somehow been caused by https://review.openstack.org/#/c/27263817:43
stpierreyep, loads of tracebacks here: http://logs.openstack.org/38/272638/14/check/gate-rally-dsvm-neutron-rally/40927c3/console.html.gz17:45
*** ushkalim has quit IRC17:46
boris-42stpierre: please be very accurate when you are working on such things like cleanup17:46
boris-42it's very easy to mess up everything17:46
stpierrewe need to get the resource checks to influence the success of the job17:47
stpierrethat review was +2'd by four separate cores17:47
stpierreif five of us could overlook the same thing, that's a problem with the gate IMO17:48
-openstackstatus- NOTICE: Job failures for missing traceroute packages are in the process of being fixed now, ETA 30 minutes to effectiveness for new jobs17:49
boris-42stpierre: the problem is that core team started thinking that if it pass gates patch is OK and works for any cases17:50
stpierrewe should strive to make that the case17:50
stpierrepeople are really good at screwing up, and they always will be. if there's an unexpected increase in resources, that should fail the job.17:50
boris-42stpierre: it's imposible, there will be always ways to find how to break it without braking gates17:50
stpierrethat doesn't mean we should just give up17:51
stpierrewe should get as close as we can17:51
boris-42stpierre: so I agree that there is room for improvement for Ci17:51
boris-42stpierre: so the problem here is that WE (as a core team) KNOW that we are NOT testing cleanup very well17:51
stpierrewell, i'm making a concrete suggestion for how to do it17:51
boris-42in gates17:51
stpierreso let's test it better. we've got the data, we just need to make it fail the job17:52
boris-42stpierre: yep we can hardocde the amount of possible failuers17:52
boris-42stpierre: however it won't be ideal17:52
stpierredon't let the perfect be the enemy of the good. it'd be more ideal than it is right now17:52
boris-42can you try to analyze the reason of failuers?17:53
stpierreit's pretty obvious17:54
*** klkumar has quit IRC17:54
stpierreand is hopefully a one-line fix17:54
boris-42stpierre: ok I will wait for patch17:55
boris-42stpierre: btw17:55
boris-42https://github.com/openstack/rally/blob/master/tests/ci/osresources.py#L29817:55
boris-42stpierre: ^17:55
boris-42stpierre: so seems like we should hardcode here len of changes that we are allowing17:56
boris-42stpierre: or even do the better job and just fail if there are any changes17:56
openstackgerritChris St. Pierre proposed openstack/rally: Cleanup: Fix getting name from neutron resources  https://review.openstack.org/30012117:57
stpierrewe need to make it a bit smarter, since there are some resources we expect -- 'default' security groups and the _member_ role at a minimum, it looks like17:58
stpierrebut i think we can probably filter those out, and then check for any additional changes17:58
stpierrethat'd be better than just failing on > 3 changes17:58
stpierrei'll try to get that done this afternoon17:58
boris-42stpierre: thanks18:14
*** diogogmt_ has joined #openstack-rally18:16
*** harshs has joined #openstack-rally18:16
*** diogogmt has quit IRC18:17
*** diogogmt_ is now known as diogogmt18:17
*** shausy has joined #openstack-rally18:17
*** shausy has quit IRC18:28
*** mvk_ has quit IRC18:36
*** openstackgerrit has quit IRC19:03
*** openstackgerrit has joined #openstack-rally19:04
openstackgerritChris St. Pierre proposed openstack/rally: Test: don't stringify cloud resources until printing  https://review.openstack.org/30015719:04
openstackgerritChris St. Pierre proposed openstack/rally: Test: Distinguish expected added resources  https://review.openstack.org/30015819:04
openstackgerritChris St. Pierre proposed openstack/rally: Test: Fail jobs if resources are added or removed  https://review.openstack.org/30015919:04
openstackgerritKevin Benton proposed openstack/rally: Allow max_avg_sla per atomic actions  https://review.openstack.org/29846219:26
boris-42stpierre: ping19:28
stpierrepong19:28
boris-42stpierre: I talk to kevinbenton19:28
boris-42stpierre: he said that it is known issue that you can't delete security group in neutron19:28
boris-42stpierre: so he will try to fix this on neutron side19:29
stpierreright19:29
stpierresame is true in nova-net19:29
boris-42stpierre: btw you patch works19:29
boris-42stpierre: going to merge it19:29
boris-42stpierre: so he checked he is saying that we need to delete security groups as a admin19:29
boris-42stpierre: so this seems like not a hard to fix stuff19:29
stpierreok19:30
boris-42stpierre: here is the patch https://review.openstack.org/#/c/296402/219:31
stpierreit looks like we set admin_required=True on the base NeutronMixin, but that isn't inherited19:31
boris-42stpierre: however it is not properly written19:31
boris-42stpierre: so actually it's a bit hard to fix bug19:32
boris-42stpierre: because if we are running with existing users and without admin (which will be possible in future) we shouldn't even try to delete default secruity group19:32
boris-42stpierre: seems like some refactoring will be required here19:33
stpierrei dunno, lots of the cleanup resources require admin. it seems reasonable to just set admin_required on NeutronSecurityGroup for now. admittedly it's not perfectly forward-looking, but it should be a one-line fix for an actual bug, and it will be just one of a large list of things that require refactoring later.19:35
stpierrei.e., we don't seem to lose anything by fixing it now19:35
boris-42stpierre: nope it is not19:36
boris-42stpierre: please let not make our life harder and harder19:37
stpierrethat doesn't make it any harder than it already is19:37
boris-42stpierre: each hack that we are adding is making rally less maintable19:37
boris-42stpierre: it makes it harder to make non-admin mode19:37
boris-42stpierre: I have an idea how to fix it19:37
stpierreit fixes a real actual bug in one line, and there are twelve other places that already ahve admin_required19:37
boris-42stpierre: it creates another one19:38
stpierrewe can't just refuse to fix minor, simple bugs any time they conflict with some future idea that isn't even a spec yet19:38
boris-42stpierre: actually it creates 2 bugs19:38
boris-421) if you are using existing users, you will delete default security group of it (which is bad idea)19:39
boris-422) scenarios that don't require actually admin will start requiring it19:39
stpierrethat second one isn't a bug, because if they need to clean up security groups then they do actually require admin19:39
boris-42stpierre: sorry but I am already working 2 years for making non admin19:40
boris-42stpierre: and had to refactor whole Rally to achieve that19:40
boris-42stpierre: even plugin base was related to this task19:40
boris-42stpierre: and creating rally context*19:40
stpierrei've gotta say, the amount of time we're spending spinning our wheels and not merging real fixes to actual bugs, or important features that are desperately needed, because of these distant pipe dream features is starting to get quite frustrating.19:40
boris-42stpierre: and current cleanups are trying to achieve this19:41
boris-42stpierre: so there is way to fix this19:41
boris-42stpierre: btw you don't need to be a admin to cleanup security groups19:41
boris-42stpierre: just for default security group19:41
stpierreright, but if we want to do a complete job of cleanup, that's part of it.19:41
boris-42stpierre: so19:42
boris-42stpierre: there is another way19:42
stpierreok19:42
boris-42stpierre: btw19:42
boris-42stpierre: the code is rally19:43
boris-42stpierre: why this doesn't cleanup default security groups?19:43
boris-42https://github.com/openstack/rally/blob/master/rally/plugins/openstack/context/keystone/users.py#L124-L13919:43
stpierrethat is an excellent question19:44
stpierrei suspect that *is* cleaning up most of them, since we're only seeing a single default security group in the osresources output19:44
stpierreso the question is where that one stray secgroup is coming from19:44
stpierrewhich might have a much simpler answer19:44
boris-42stpierre: so19:47
boris-42stpierre: it's interesting stuff19:48
stpierrelooks like both of the 'default' security groups are for the 'service' tenant19:48
stpierrewhich is created by devstack19:48
stpierreso it should show up in the pre-rally inventory AFAICT19:48
-openstackstatus- NOTICE: Any jobs which erroneously failed on missing traceroute packages should be safe to recheck now19:55
*** arnoldje has joined #openstack-rally19:56
*** dratushnyy has quit IRC20:02
boris-42stpierre: btw could you take a look at this patch https://review.openstack.org/#/c/299833/220:08
boris-42stpierre: it's like quite bad bug20:09
openstackgerritMerged openstack/rally: Cleanup: Fix getting name from neutron resources  https://review.openstack.org/30012120:16
*** moravec has quit IRC20:38
openstackgerritChris St. Pierre proposed openstack/rally: Test: Distinguish expected added resources  https://review.openstack.org/30015820:46
openstackgerritChris St. Pierre proposed openstack/rally: Test: Fail jobs if resources are added or removed  https://review.openstack.org/30015920:46
openstackgerritChris St. Pierre proposed openstack/rally: Test: don't stringify cloud resources until printing  https://review.openstack.org/30015720:46
*** harshs has quit IRC21:11
*** stpierre has quit IRC21:21
*** luzC has left #openstack-rally21:25
*** dpaterson has quit IRC21:28
*** harshs has joined #openstack-rally21:44
*** MaxPC has quit IRC22:07
openstackgerritMerged openstack/rally: Allow max_avg_sla per atomic actions  https://review.openstack.org/29846222:12
*** arnoldje has quit IRC22:38
*** harshs has quit IRC23:20
*** tosky has quit IRC23:32
*** moravec has joined #openstack-rally23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!