| *** harshs has joined #openstack-rally | 00:00 | |
| *** yingjun has joined #openstack-rally | 00:25 | |
| *** pvaneck has quit IRC | 00:39 | |
| *** emagana has quit IRC | 00:54 | |
| *** baker has quit IRC | 01:01 | |
| *** yeungp has joined #openstack-rally | 01:13 | |
| *** yingjun has quit IRC | 01:29 | |
| *** yingjun has joined #openstack-rally | 01:29 | |
| *** arnoldje has joined #openstack-rally | 01:31 | |
| *** ilbot3 has quit IRC | 01:45 | |
| *** nadeem has joined #openstack-rally | 01:46 | |
| *** ilbot3 has joined #openstack-rally | 01:48 | |
| *** yingjun has quit IRC | 01:50 | |
| *** boris-42 has quit IRC | 02:08 | |
| *** yunpengli has joined #openstack-rally | 02:09 | |
| *** yunpengli has quit IRC | 02:09 | |
| *** dmorita has joined #openstack-rally | 02:19 | |
| *** yingjun has joined #openstack-rally | 02:33 | |
| *** harshs has quit IRC | 02:33 | |
| *** baker has joined #openstack-rally | 02:47 | |
| *** baker has quit IRC | 02:49 | |
| *** yingjun has quit IRC | 02:52 | |
| *** yingjun has joined #openstack-rally | 02:54 | |
| *** boris-42 has joined #openstack-rally | 02:58 | |
| *** puranamr has joined #openstack-rally | 03:26 | |
| *** yingjun_ has joined #openstack-rally | 03:48 | |
| *** yingjun has quit IRC | 03:51 | |
| *** puranamr has quit IRC | 03:58 | |
| *** puranamr has joined #openstack-rally | 03:58 | |
| *** puranamr has quit IRC | 04:00 | |
| *** yingjun_ has quit IRC | 04:01 | |
| *** yingjun has joined #openstack-rally | 04:01 | |
| *** puranamr has joined #openstack-rally | 04:02 | |
| *** puranamr has quit IRC | 04:05 | |
| *** puranamr has joined #openstack-rally | 04:06 | |
| *** yingjun has quit IRC | 04:06 | |
| *** puranamr has quit IRC | 04:08 | |
| *** baker has joined #openstack-rally | 04:10 | |
| *** puranamr has joined #openstack-rally | 04:12 | |
| *** puranamr has quit IRC | 04:18 | |
| *** puranamr has joined #openstack-rally | 04:19 | |
| *** baker has quit IRC | 04:21 | |
| *** baker has joined #openstack-rally | 04:21 | |
| *** puranamr has quit IRC | 04:22 | |
| *** puranamr has joined #openstack-rally | 04:23 | |
| *** puranamr has quit IRC | 04:30 | |
| *** puranamr has joined #openstack-rally | 04:32 | |
| *** puranamr has quit IRC | 04:34 | |
| *** puranamr_ has joined #openstack-rally | 04:34 | |
| *** emagana has joined #openstack-rally | 04:37 | |
| *** puranamr_ has quit IRC | 04:39 | |
| *** puranamr has joined #openstack-rally | 04:41 | |
| *** yfried has quit IRC | 05:10 | |
| *** psd has joined #openstack-rally | 05:16 | |
| *** puranamr has quit IRC | 05:16 | |
| *** harshs has joined #openstack-rally | 05:20 | |
| *** emagana has quit IRC | 05:31 | |
| *** arnoldje has quit IRC | 05:40 | |
| *** baker has quit IRC | 05:40 | |
| *** harshs_ has joined #openstack-rally | 05:41 | |
| *** harshs has quit IRC | 05:43 | |
| *** harshs_ is now known as harshs | 05:43 | |
| *** puranamr has joined #openstack-rally | 05:48 | |
| *** puranamr has quit IRC | 05:49 | |
| *** puranamr has joined #openstack-rally | 05:51 | |
| *** harshs has quit IRC | 05:59 | |
| *** harshs has joined #openstack-rally | 06:00 | |
| *** yfried has joined #openstack-rally | 06:01 | |
| *** yfried_ has joined #openstack-rally | 06:04 | |
| *** yfried has quit IRC | 06:05 | |
| *** yingjun has joined #openstack-rally | 06:14 | |
| *** pythonguy has quit IRC | 06:15 | |
| *** pythonguy has joined #openstack-rally | 06:16 | |
| yfried_ | jaredrohe: still here? | 06:20 |
|---|---|---|
| *** neeti has joined #openstack-rally | 06:21 | |
| openstackgerrit | Yair Fried proposed openstack/rally: [spec] Refactoring scenario utils https://review.openstack.org/172831 | 06:24 |
| boris-42 | jaredrohe: you should update your plugins | 06:26 |
| boris-42 | jaredrohe: plugins of varions 0.0.4 and 0.1.x are not compatible | 06:26 |
| *** puranamr has quit IRC | 06:26 | |
| boris-42 | jaredrohe: about keystone v3 it is supporeted for quite long amount of time | 06:26 |
| boris-42 | jaredrohe: and 0.0.4 works with keystone v3 | 06:27 |
| boris-42 | jaredrohe: internally in Mirantis we are testing clouds with keystone v3 | 06:27 |
| yfried_ | boris-42: how are you? | 06:27 |
| boris-42 | yfried_: hi there | 06:27 |
| boris-42 | yfried_: almost good | 06:27 |
| yfried_ | boris-42: almost? | 06:27 |
| boris-42 | yfried_: wife's bike was stolen | 06:27 |
| boris-42 | =( | 06:27 |
| yfried_ | boris-42: that's bad. | 06:28 |
| yfried_ | boris-42: was it insured? | 06:28 |
| boris-42 | yfried_: nope | 06:29 |
| boris-42 | yfried_: they stole it from our renters storage | 06:29 |
| yfried_ | boris-42: back home? (Russia?) | 06:29 |
| boris-42 | yfried_: so I am trying to get compensation from them | 06:29 |
| boris-42 | yfried_: hm? | 06:30 |
| boris-42 | yfried_: not it happened here in US in common storage for aparts | 06:30 |
| *** kiran-r has joined #openstack-rally | 06:30 | |
| *** yingjun has quit IRC | 06:34 | |
| *** yingjun has joined #openstack-rally | 06:34 | |
| *** yingjun has quit IRC | 06:38 | |
| *** rajesht_ has joined #openstack-rally | 06:39 | |
| *** adiantum_ has joined #openstack-rally | 06:43 | |
| yfried_ | boris-42: ok. hope you get full compensation. | 06:46 |
| yfried_ | boris-42: re https://review.openstack.org/#/c/172831/22 | 06:46 |
| yfried_ | boris-42: I need some help with the mechanism of self.services() | 06:47 |
| yfried_ | boris-42: I was thinking about something similar to the self.clients mechanism (with caching, etc...) | 06:47 |
| yfried_ | boris-42: don't know how to make it, though | 06:48 |
| *** adiantum_ has quit IRC | 06:51 | |
| *** adiantum has quit IRC | 06:55 | |
| boris-42 | yfried_: so let's not do the any caching in services | 06:57 |
| boris-42 | yfried_: it's not the purpose of service to do the optimal stuff | 06:58 |
| boris-42 | yfried_: they need to generate real and in clear way load | 06:58 |
| boris-42 | yfried_: caching in oslclients is done because it is typical usage of cloud | 06:58 |
| boris-42 | yfried_: you don't generate for each request new token | 06:59 |
| boris-42 | yfried_: you are generating it once and using | 06:59 |
| boris-42 | yfried_: as well as creating any of clients | 06:59 |
| *** rdas has joined #openstack-rally | 07:00 | |
| *** harshs has quit IRC | 07:15 | |
| *** anshul has joined #openstack-rally | 07:32 | |
| *** arxcruz has joined #openstack-rally | 07:35 | |
| openstackgerrit | Merged openstack/rally: [PLUGINS] Follow symlinks in plugin discovery https://review.openstack.org/234702 | 07:54 |
| *** fhubik has joined #openstack-rally | 07:56 | |
| *** fhubik is now known as fhubik_brb | 07:56 | |
| boris-42 | yfried_: btw could you please review patches from 2 guys | 08:01 |
| boris-42 | yfried_: Chris and Pavel | 08:02 |
| yfried_ | boris-42: will do | 08:02 |
| boris-42 | yfried_: thanks we really need to review more... | 08:02 |
| *** fhubik_brb is now known as fhubik | 08:02 | |
| *** yingjun has joined #openstack-rally | 08:09 | |
| openstackgerrit | Endre Karlson proposed openstack/rally: Add Designate API V2 support https://review.openstack.org/229350 | 08:21 |
| *** amaretskiy has joined #openstack-rally | 08:31 | |
| *** aix has joined #openstack-rally | 08:35 | |
| *** adiantum has joined #openstack-rally | 08:36 | |
| *** vponomaryov has joined #openstack-rally | 08:36 | |
| *** psd has quit IRC | 08:46 | |
| *** kiranr has joined #openstack-rally | 08:57 | |
| *** kiran-r has quit IRC | 08:57 | |
| *** cdent has joined #openstack-rally | 08:59 | |
| *** exploreshaifali has joined #openstack-rally | 08:59 | |
| *** berendt has joined #openstack-rally | 09:01 | |
| *** amaretskiy has quit IRC | 09:04 | |
| *** redixin has joined #openstack-rally | 09:16 | |
| *** amaretskiy has joined #openstack-rally | 09:20 | |
| *** e0ne has joined #openstack-rally | 09:26 | |
| *** yfried_ is now known as yfried|afk | 09:30 | |
| *** yfried|afk is now known as yfried_ | 09:31 | |
| *** yingjun has quit IRC | 09:33 | |
| openstackgerrit | Sergey Skripnick proposed openstack/rally: Add neutron quota info only if neutron available https://review.openstack.org/234950 | 09:33 |
| *** aix has quit IRC | 09:43 | |
| *** exploreshaifali has quit IRC | 09:48 | |
| *** exploreshaifali has joined #openstack-rally | 09:50 | |
| *** aix has joined #openstack-rally | 09:58 | |
| *** psd has joined #openstack-rally | 09:58 | |
| *** tosky has joined #openstack-rally | 09:59 | |
| openstackgerrit | Sergey Skripnick proposed openstack/rally: Add neutron quota info only if neutron available https://review.openstack.org/234950 | 10:08 |
| *** dmorita has quit IRC | 10:25 | |
| *** aix has quit IRC | 10:26 | |
| *** aix has joined #openstack-rally | 10:37 | |
| *** rvasilets has joined #openstack-rally | 10:43 | |
| *** kbaikov has quit IRC | 10:48 | |
| openstackgerrit | Andrey Kurilin proposed openstack/rally: WIP! Add new context plugin to support different API versions https://review.openstack.org/232546 | 10:50 |
| openstackgerrit | Andrey Kurilin proposed openstack/rally: Add ability to specify service types for clients https://review.openstack.org/235255 | 10:50 |
| *** kiranr has quit IRC | 10:59 | |
| rajesht_ | since we have cleanup module in rally, can we remove all delete resource calls from all scenarios ?? | 10:59 |
| boris-42 | rajesht_: nope | 11:01 |
| boris-42 | rajesht_: because we will get different loads | 11:01 |
| boris-42 | rajesht_: no-deletion -> scale testing | 11:02 |
| boris-42 | rajesht_: deletion -> performance testing under load | 11:02 |
| *** yeungp has quit IRC | 11:02 | |
| rajesht_ | boris-42: in that case, is this comment valid https://review.openstack.org/#/c/234644/1/rally/plugins/openstack/scenarios/nova/servers.py | 11:03 |
| boris-42 | kun_huang: ^ | 11:06 |
| boris-42 | kun_huang: nope comment is not OK | 11:06 |
| boris-42 | rajesht_: ^ | 11:06 |
| boris-42 | rajesht_: you can make special argument do_delete | 11:06 |
| rajesht_ | boris-42: so the delete call should be there ?? | 11:06 |
| boris-42 | rajesht_: yep | 11:07 |
| boris-42 | rajesht_: but you can add do_delete argument | 11:07 |
| boris-42 | rajesht_: True/False and if it is specified or not you can change behaviour | 11:07 |
| rajesht_ | boris-42: how ?? let me check | 11:07 |
| rajesht_ | boris-42: is do_delete implemented in any scenario ? | 11:07 |
| boris-42 | rajesht_: add argument to function | 11:07 |
| boris-42 | rajesht_: https://github.com/openstack/rally/blob/master/rally/plugins/openstack/scenarios/mistral/workbooks.py#L45 | 11:08 |
| boris-42 | rajesht_: like here | 11:08 |
| *** fhubik is now known as fhubik_brb | 11:08 | |
| openstackgerrit | Yaroslav Lobankov proposed openstack/rally: Adding command to show tempest.conf https://review.openstack.org/234126 | 11:08 |
| rajesht_ | boris-42: thanks, will try with that. | 11:09 |
| *** fhubik_brb is now known as fhubik | 11:09 | |
| openstackgerrit | Chris St. Pierre proposed openstack/rally: Handle tracebacks in chart generation https://review.openstack.org/232742 | 11:09 |
| *** fhubik is now known as fhubik_brb | 11:10 | |
| rajesht_ | boris-42: in that case, I need to add do_delete parameter in json and yaml scripts as well | 11:11 |
| rajesht_ | boris-42: right ?? | 11:11 |
| boris-42 | rajesht_: yep you may add them | 11:14 |
| rajesht_ | boris-42: will upload a patchset soon | 11:15 |
| rajesht_ | boris-42: thanx for your time :) | 11:15 |
| boris-42 | rajesht_: I am going to sleep | 11:16 |
| boris-42 | 4:16 a.m. | 11:16 |
| rajesht_ | boris-42: 0_0 | 11:16 |
| rajesht_ | boris-42: from where are you ?? | 11:16 |
| rajesht_ | boris-42: Good night sleep well | 11:17 |
| boris-42 | rajesht_ San Jose US | 11:17 |
| *** yfried_ is now known as yfried|afk | 11:25 | |
| *** rdas has quit IRC | 11:30 | |
| *** kbaikov has joined #openstack-rally | 11:32 | |
| ekarlso | boris-42: rvasilets can I get some looks at the designate patches ? | 11:40 |
| *** mwagner_ has quit IRC | 11:41 | |
| rvasilets | ekarlso, Hi will look at you patches | 11:41 |
| *** yfried|afk is now known as yfried_ | 11:44 | |
| openstackgerrit | Yaroslav Lobankov proposed openstack/rally: Adding command to show tempest.conf https://review.openstack.org/234126 | 11:47 |
| *** adiantum has quit IRC | 11:48 | |
| *** adiantum has joined #openstack-rally | 12:06 | |
| *** e0ne has quit IRC | 12:06 | |
| openstackgerrit | Merged openstack/rally: [Sahara] Add support for proxy node https://review.openstack.org/212036 | 12:07 |
| *** kbaikov has quit IRC | 12:11 | |
| *** _hanhart has joined #openstack-rally | 12:12 | |
| *** fhubik_brb is now known as fhubik | 12:18 | |
| *** _hanhart has quit IRC | 12:21 | |
| openstackgerrit | Roman Vasilets proposed openstack/rally: [WIP] Change rps by function https://review.openstack.org/234195 | 12:22 |
| *** kbaikov has joined #openstack-rally | 12:24 | |
| openstackgerrit | Andrey Kurilin proposed openstack/rally: Add ability to specify service types for clients https://review.openstack.org/235255 | 12:32 |
| *** puranamr has joined #openstack-rally | 12:33 | |
| *** neeti has quit IRC | 12:35 | |
| *** MaxPC has joined #openstack-rally | 12:36 | |
| *** aix has quit IRC | 12:37 | |
| *** _hanhart has joined #openstack-rally | 12:37 | |
| *** aix has joined #openstack-rally | 12:37 | |
| *** puranamr has quit IRC | 12:43 | |
| *** afazekas has quit IRC | 12:43 | |
| *** puranamr has joined #openstack-rally | 12:45 | |
| *** albertw has quit IRC | 12:45 | |
| *** albertw has joined #openstack-rally | 12:46 | |
| *** _hanhart has quit IRC | 12:46 | |
| *** adiantum_ has joined #openstack-rally | 12:47 | |
| *** stpierre has joined #openstack-rally | 12:47 | |
| openstackgerrit | Chris St. Pierre proposed openstack/rally: Implement new random name generator for scenario plugins https://review.openstack.org/226385 | 12:49 |
| openstackgerrit | Chris St. Pierre proposed openstack/rally: Implement new random name generator for wrapper plugins https://review.openstack.org/226387 | 12:49 |
| openstackgerrit | Chris St. Pierre proposed openstack/rally: Remove old random name generator https://review.openstack.org/226388 | 12:49 |
| *** MaxPC has quit IRC | 12:50 | |
| *** MaxPC has joined #openstack-rally | 12:51 | |
| *** adiantum_ has quit IRC | 12:51 | |
| *** afazekas has joined #openstack-rally | 12:52 | |
| *** adiantum has quit IRC | 13:06 | |
| openstackgerrit | Alexander Maretskiy proposed openstack/rally: [Reports] Add an option for embedding JS/CSS libs into report https://review.openstack.org/235335 | 13:22 |
| *** puranamr has quit IRC | 13:27 | |
| *** puranamr has joined #openstack-rally | 13:32 | |
| *** yfried_ has quit IRC | 13:35 | |
| *** adiantum has joined #openstack-rally | 13:36 | |
| *** stannie1 has quit IRC | 13:39 | |
| openstackgerrit | Andrey Kurilin proposed openstack/rally: WIP! Add new context plugin to support different API versions https://review.openstack.org/232546 | 13:42 |
| *** MaxPC1 has joined #openstack-rally | 13:45 | |
| *** MaxPC has quit IRC | 13:46 | |
| openstackgerrit | Andrey Kurilin proposed openstack/rally: WIP: check simple cinder scenario with V2 API https://review.openstack.org/235352 | 13:46 |
| *** emagana has joined #openstack-rally | 13:47 | |
| *** anshul has quit IRC | 13:49 | |
| *** yfried_ has joined #openstack-rally | 13:49 | |
| *** yfried_ is now known as yfried|afk | 13:49 | |
| openstackgerrit | Andrey Kurilin proposed openstack/rally: WIP: try to use keystoneclient.client.Client https://review.openstack.org/235360 | 13:51 |
| *** fhubik is now known as fhubik_brb | 13:51 | |
| *** yfried|afk has quit IRC | 13:54 | |
| openstackgerrit | Chris St. Pierre proposed openstack/rally: Use network context for Neutron scenarios https://review.openstack.org/210612 | 13:59 |
| *** fhubik_brb is now known as fhubik | 14:00 | |
| openstackgerrit | Roman Vasilets proposed openstack/rally: [WIP] Change rps by function https://review.openstack.org/234195 | 14:01 |
| *** kir has joined #openstack-rally | 14:08 | |
| kir | Hi all, I've got the following after git pull ./install_rally.sh -d ~/VE/rally: PluginWithSuchNameExists: Plugin with such name: `base_context` already exists in `default` namespace. Any clue on that? | 14:10 |
| *** coolsvap has quit IRC | 14:12 | |
| *** arxcruz has quit IRC | 14:12 | |
| *** baker has joined #openstack-rally | 14:13 | |
| *** coolsvap has joined #openstack-rally | 14:14 | |
| *** mwagner_ has joined #openstack-rally | 14:18 | |
| openstackgerrit | Roman Vasilets proposed openstack/rally: [WIP] Change rps by function https://review.openstack.org/234195 | 14:19 |
| *** MaxPC1 has quit IRC | 14:20 | |
| *** MaxPC has joined #openstack-rally | 14:20 | |
| *** exploreshaifali has quit IRC | 14:20 | |
| *** puranamr has quit IRC | 14:21 | |
| *** MaxPC has quit IRC | 14:26 | |
| *** MaxPC has joined #openstack-rally | 14:28 | |
| openstackgerrit | Yaroslav Lobankov proposed openstack/rally: Adding command to show tempest.conf https://review.openstack.org/234126 | 14:29 |
| *** MaxPC1 has joined #openstack-rally | 14:35 | |
| *** arnoldje has joined #openstack-rally | 14:35 | |
| *** MaxPC has quit IRC | 14:35 | |
| *** MaxPC has joined #openstack-rally | 14:48 | |
| *** MaxPC1 has quit IRC | 14:48 | |
| openstackgerrit | Andrey Kurilin proposed openstack/rally: WIP: try to use keystoneclient.client.Client https://review.openstack.org/235360 | 14:49 |
| *** aix has quit IRC | 15:02 | |
| *** emagana has quit IRC | 15:03 | |
| openstackgerrit | Andrey Kurilin proposed openstack/rally: WIP! Add new context plugin to support different API versions https://review.openstack.org/232546 | 15:06 |
| openstackgerrit | Andrey Kurilin proposed openstack/rally: WIP: check simple cinder scenario with V2 API https://review.openstack.org/235352 | 15:06 |
| stpierre | kir: i've never seen that, but i'd be tempted to nuke the virtualenv and start fresh, if that's an option | 15:07 |
| *** yfried has joined #openstack-rally | 15:13 | |
| *** yfried has quit IRC | 15:19 | |
| *** puranamr has joined #openstack-rally | 15:22 | |
| *** e0ne has joined #openstack-rally | 15:25 | |
| *** puranamr has quit IRC | 15:27 | |
| *** openstackgerrit has quit IRC | 15:31 | |
| *** openstackgerrit has joined #openstack-rally | 15:31 | |
| *** arxcruz has joined #openstack-rally | 15:33 | |
| *** ukinau has joined #openstack-rally | 15:43 | |
| *** arxcruz has quit IRC | 15:52 | |
| *** rvasilets has quit IRC | 15:55 | |
| *** fhubik has quit IRC | 15:56 | |
| jaredrohe | yfried_: yes, I'm here!! | 16:02 |
| *** puranamr has joined #openstack-rally | 16:02 | |
| *** ehaselwanter has joined #openstack-rally | 16:08 | |
| *** puranamr has quit IRC | 16:10 | |
| *** puranamr has joined #openstack-rally | 16:11 | |
| *** puranamr has quit IRC | 16:18 | |
| *** puranamr has joined #openstack-rally | 16:19 | |
| openstackgerrit | Andrey Kurilin proposed openstack/rally: WIP! Add new context plugin to support different API versions https://review.openstack.org/232546 | 16:19 |
| boris-42 | jaredrohe: did you see my messages? | 16:20 |
| *** puranamr has quit IRC | 16:21 | |
| *** MaxPC has quit IRC | 16:23 | |
| *** MaxPC has joined #openstack-rally | 16:24 | |
| *** puranamr has joined #openstack-rally | 16:25 | |
| *** MaxPC1 has joined #openstack-rally | 16:26 | |
| openstackgerrit | Andrey Kurilin proposed openstack/rally: WIP: check simple cinder scenario with V2 API https://review.openstack.org/235352 | 16:27 |
| *** puranamr has quit IRC | 16:27 | |
| *** MaxPC has quit IRC | 16:28 | |
| *** puranamr has joined #openstack-rally | 16:28 | |
| boris-42 | stpierre: I really don't know what to do about this https://review.openstack.org/#/c/232742/ | 16:29 |
| boris-42 | stpierre: because like it is hiding the bug in scenarios ... | 16:30 |
| *** e0ne has quit IRC | 16:30 | |
| stpierre | how do we distinguish between a hidden bug and an expected failure? | 16:30 |
| boris-42 | stpierre: ? | 16:33 |
| stpierre | the case i'm trying to solve is where a scenario contains a call that it expects to fail. it's not a bug -- it knows the action is going to fail and expects that. if the action succeeded, that would denote a problem. | 16:33 |
| stpierre | the case you're trying to avoid is where an overaggressive 'except' clause hides an error in a scenario | 16:34 |
| stpierre | how do we distinguish between those two cases? | 16:34 |
| boris-42 | stpierre: it is the bug | 16:40 |
| boris-42 | stpierre: in scenario | 16:40 |
| stpierre | how is that a bug? | 16:40 |
| boris-42 | stpierre: you must gurantee the consistance of atomic actions | 16:40 |
| stpierre | so no scenario can ever expect something to fail? | 16:40 |
| stpierre | that seems unnecessarily restrictive | 16:40 |
| boris-42 | stpierre: it can fail | 16:40 |
| stpierre | so no successful scenario can ever expect something to fail? | 16:41 |
| boris-42 | stpierre: but you can't do the hiding of atomic in such way | 16:41 |
| boris-42 | stpierre: yep | 16:41 |
| boris-42 | stpierre: or it is success or it is failed | 16:41 |
| stpierre | given the number of people who use rally as a testing tool, and given that this worked until very recently, i'm guessing that this is going to break a lot of local rally plugins. i know it'll break a bunch of ours. | 16:41 |
| stpierre | and if we're going to be that restrictive, i think we should probably convert everything to using optional_atomic_action() instead of atomic_action(), so that we can have expected failures | 16:42 |
| boris-42 | stpierre: that is bad actually | 16:43 |
| boris-42 | stpierre: or we need to change whole model of everything in rally related to atomic actions | 16:43 |
| boris-42 | stpierre: and all reporting | 16:43 |
| stpierre | why? it a) has worked just fine heretofore; and b) with a small patch can continue to work fine. no model changes are necessary. | 16:43 |
| boris-42 | stpierre: nope id didn't work fine before | 16:43 |
| boris-42 | stpierre: like we have bug in cinder scenario | 16:44 |
| stpierre | well we never noticed whatever was broken about it | 16:44 |
| boris-42 | stpierre: that was creating random amount of atomic actions | 16:44 |
| boris-42 | stpierre: it was showing success rate of some of atomic actions 60% | 16:44 |
| boris-42 | stpierre: I noticed that.. | 16:44 |
| stpierre | i'm not sure i understand how that's related to this patch | 16:44 |
| stpierre | but if you prefer, i'd be happy to submit a new patch that basically just does s/atomic_action/optional_atomic_action/ so that we can have expected failures, without having failed atomic actions in a successful scenario | 16:46 |
| boris-42 | stpierre: I do not understand the concept of failed atomic actions at all | 16:47 |
| boris-42 | stpierre: we don't support that and never had supported | 16:47 |
| stpierre | well, it worked :) | 16:47 |
| boris-42 | stpierre: well it was not supported | 16:47 |
| *** ehaselwanter has quit IRC | 16:47 | |
| boris-42 | stpierre: I belive we should stop hacking around it | 16:47 |
| *** amaretskiy has quit IRC | 16:47 | |
| stpierre | that's fine. would you accept a patch that does s/atomic_action/optional_atomic_action/ ? | 16:48 |
| boris-42 | stpierre: and make support of it without hacks if you need it | 16:48 |
| boris-42 | stpierre: I do not understand how that will help you | 16:48 |
| stpierre | because then i can disable the atomic action timer for things i expect to fail | 16:48 |
| boris-42 | stpierre: why not just fixing the atomic action mechanism it self | 16:49 |
| stpierre | i guess i don't understand what the fix would be. | 16:49 |
| boris-42 | stpierre: so it deffintely should be in atomic actions | 16:49 |
| boris-42 | stpierre: not hack in reports | 16:49 |
| boris-42 | stpierre: there shouldn't be any difference whatever atomic raised exception or not | 16:49 |
| *** puranamr has quit IRC | 16:50 | |
| stpierre | so, the atomic action timer should catch the exception, capture timing information, and then reraise the exception? | 16:50 |
| openstackgerrit | Chris St. Pierre proposed openstack/rally: Implement new random name generator for scenario plugins https://review.openstack.org/226385 | 16:51 |
| openstackgerrit | Chris St. Pierre proposed openstack/rally: Implement new random name generator for wrapper plugins https://review.openstack.org/226387 | 16:51 |
| openstackgerrit | Chris St. Pierre proposed openstack/rally: Remove old random name generator https://review.openstack.org/226388 | 16:51 |
| boris-42 | stpierre: yep | 16:52 |
| boris-42 | stpierre: as well I have some idea about overall refactoring atomic_actions | 16:52 |
| stpierre | okay, let me see how that'll work | 16:52 |
| boris-42 | stpierre: that will work just perfectly | 16:52 |
| boris-42 | stpierre: in any case seeems like we need to have error field in atomic actions | 16:53 |
| *** puranamr has joined #openstack-rally | 16:53 | |
| boris-42 | stpierre: in any case it looks all a bit ugly | 16:53 |
| boris-42 | =) | 16:53 |
| boris-42 | stpierre: how it should be displayed | 16:54 |
| boris-42 | even if we keep errors in atomic actions | 16:54 |
| boris-42 | how we should show it on graphs? | 16:54 |
| boris-42 | like overall success is 100% but success of some specific atomic actions is 60%? | 16:54 |
| boris-42 | how would you explain that to the customer?) | 16:55 |
| boris-42 | stpierre: ^ | 16:55 |
| *** puranamr has quit IRC | 16:55 | |
| stpierre | "There's a bug in Rally" :) | 16:55 |
| boris-42 | stpierre: but it is not the bug | 16:56 |
| boris-42 | stpierre: in your opinion | 16:56 |
| stpierre | that's not true at all. there's clearly a bug in that scenario. but there is no bug in a scenario that expects a given action to fail, and sees it fail, so that overall success is 100% but some specific actions have a success rate of 0%. that's expected. the bug in your case is that 60% success of some actions but 100% success overall is unexpected -- that's not how it should work. | 16:57 |
| *** puranamr has joined #openstack-rally | 17:02 | |
| boris-42 | stpierre: I don' t see the difference between to cases that you described | 17:04 |
| *** puranamr has quit IRC | 17:04 | |
| boris-42 | stpierre: if my manager or his manager see in reports | 17:04 |
| boris-42 | stpierre: that there is test case with atomic_action that has success rate 60% and overall success 100% he will call me and say WTF? | 17:05 |
| stpierre | the difference is the expectation. in one case failure is expected, in the other case it's not. without that context, there is no difference in isolation. but in reality, there is. | 17:05 |
| boris-42 | stpierre: (it already happend) | 17:05 |
| stpierre | so that scenario clearly needs to be fixed. | 17:05 |
| *** puranamr has joined #openstack-rally | 17:05 | |
| stpierre | conversely, if my manager sees a test case that's testing instance quotas, and sees 11 successful boot_server actions instead of 10 successful and one failed, then he will call me and say the same thing. | 17:06 |
| *** adiantum has quit IRC | 17:07 | |
| boris-42 | stpierre: he won't see 11 boot_servers successfully | 17:07 |
| boris-42 | stpierre: he will see 10 | 17:07 |
| boris-42 | stpierre: in any case current hack in reports is not good long term solution | 17:07 |
| boris-42 | stpierre: I will start spec about atomic actions | 17:08 |
| boris-42 | stpierre: as we are moving to version 0.2.0 and we have window of changing internal data of rally | 17:08 |
| boris-42 | stpierre: let's refactor them to collect all infromation required for reports | 17:08 |
| boris-42 | stpierre: and make them in proper order withou OrderdDict | 17:08 |
| boris-42 | stpierre: add to them timestamps and so on | 17:08 |
| boris-42 | stpierre: as well we can think about "expected error" story | 17:09 |
| *** puranamr has quit IRC | 17:10 | |
| *** harshs has joined #openstack-rally | 17:13 | |
| *** bitblt has joined #openstack-rally | 17:13 | |
| *** pvaneck has joined #openstack-rally | 17:13 | |
| boris-42 | stpierre: http://logs.openstack.org/13/233913/2/experimental/gate-rally-dsvm-cue-rabbitmq/df83264/console.html#_2015-10-15_17_15_39_572 | 17:21 |
| boris-42 | stpierre: these guys are facing the same issues=( | 17:21 |
| *** cdent has quit IRC | 17:22 | |
| stpierre | it looks like making all atomic actions collect timing info is a one-line fix, and it seems to work. i'm gonna go grab lunch, but when i get back i'll get unit tests working and have this submitted later today | 17:25 |
| stpierre | thanks for pointing me in the right direction | 17:25 |
| openstackgerrit | Merged openstack/rally: Add task format converter https://review.openstack.org/211160 | 17:32 |
| *** cdent has joined #openstack-rally | 17:43 | |
| *** spyderdyne has joined #openstack-rally | 17:45 | |
| *** spyderdyne has quit IRC | 18:01 | |
| *** e0ne has joined #openstack-rally | 18:09 | |
| ekarlso | what's wronghere guys: https://review.openstack.org/#/c/229350/ | 18:10 |
| ekarlso | I dont get any errors on my tox :/ | 18:10 |
| kir | sometimes I have 2015-10-15 12:31:56.483 3004 INFO rally.task.runner [-] Task 80dd159e-211e-4e87-8738-810d2bee4d96 | ITER: 9 END: Error BadRequest: Multiple possible networks found, use a Network ID to be more specific. (HTTP 400) (Request-ID: req-a0547cd5-22b1-40bb-8bdf-014a466db5ce) | 18:10 |
| kir | this network is created as a context, is it a way to get rid of that without specifying net ID? | 18:11 |
| *** exploreshaifali has joined #openstack-rally | 18:13 | |
| *** bitblt has quit IRC | 18:16 | |
| openstackgerrit | Yaroslav Lobankov proposed openstack/rally: Adding command to show tempest.conf https://review.openstack.org/234126 | 18:18 |
| openstackgerrit | Yaroslav Lobankov proposed openstack/rally: Adding command to show tempest.conf https://review.openstack.org/234126 | 18:21 |
| *** MaxPC1 has quit IRC | 18:21 | |
| *** MaxPC has joined #openstack-rally | 18:21 | |
| openstackgerrit | Merged openstack/rally: Fix random miss in comsumer/publisher broker https://review.openstack.org/234257 | 18:22 |
| *** cdent has quit IRC | 18:23 | |
| stpierre | ekarlso: 2015-10-15 09:31:43.165 | Build timed out (after 70 minutes). Marking the build as failed. | 18:27 |
| stpierre | looks like it needs a recheck | 18:27 |
| openstackgerrit | Yaroslav Lobankov proposed openstack/rally: Changing URL to repo to pull Tempest from https://review.openstack.org/235538 | 18:29 |
| openstackgerrit | Yaroslav Lobankov proposed openstack/rally: Changing URL to repo to pull Tempest from https://review.openstack.org/235538 | 18:31 |
| *** spyderdyne has joined #openstack-rally | 18:32 | |
| *** adiantum has joined #openstack-rally | 18:35 | |
| *** klindgren_ has joined #openstack-rally | 18:54 | |
| *** klindgren has quit IRC | 18:57 | |
| *** adiantum has quit IRC | 18:59 | |
| *** tosky has quit IRC | 19:00 | |
| *** arnoldje has quit IRC | 19:05 | |
| *** MaxPC has quit IRC | 19:05 | |
| *** MaxPC has joined #openstack-rally | 19:06 | |
| openstackgerrit | Chris St. Pierre proposed openstack/rally: Capture timing information for failed atomic actions https://review.openstack.org/235554 | 19:15 |
| *** arnoldje has joined #openstack-rally | 19:20 | |
| *** e0ne has quit IRC | 19:25 | |
| *** MaxPC has quit IRC | 19:30 | |
| *** MaxPC has joined #openstack-rally | 19:30 | |
| openstackgerrit | Yaroslav Lobankov proposed openstack/rally: Adding command to show tempest.conf https://review.openstack.org/234126 | 19:48 |
| *** baker has quit IRC | 19:50 | |
| *** adiantum has joined #openstack-rally | 19:51 | |
| *** adiantum has quit IRC | 20:00 | |
| *** berendt has quit IRC | 20:03 | |
| *** arnoldje has quit IRC | 20:05 | |
| *** MaxPC has quit IRC | 20:08 | |
| *** MaxPC has joined #openstack-rally | 20:08 | |
| *** MaxPC has quit IRC | 20:12 | |
| *** MaxPC1 has joined #openstack-rally | 20:13 | |
| *** boris-42 has quit IRC | 20:18 | |
| *** spyderdyne has quit IRC | 20:31 | |
| *** emagana has joined #openstack-rally | 20:32 | |
| *** mwagner_ has quit IRC | 20:34 | |
| *** MaxPC1 has quit IRC | 20:37 | |
| *** baker has joined #openstack-rally | 20:40 | |
| *** stpierre has quit IRC | 20:57 | |
| *** harshs has quit IRC | 21:06 | |
| *** jjmb has joined #openstack-rally | 21:11 | |
| *** jjmb has quit IRC | 21:11 | |
| *** mwagner_ has joined #openstack-rally | 21:21 | |
| *** darkhuy has quit IRC | 21:26 | |
| *** darkhuy has joined #openstack-rally | 21:29 | |
| *** aix has joined #openstack-rally | 21:42 | |
| *** adiantum has joined #openstack-rally | 21:50 | |
| *** adiantum1 has joined #openstack-rally | 22:08 | |
| *** adiantum has quit IRC | 22:10 | |
| *** adiantum1 is now known as adiantum | 22:10 | |
| openstackgerrit | Yaroslav Lobankov proposed openstack/rally: Changing URL to repo to pull Tempest from https://review.openstack.org/235538 | 22:11 |
| *** harshs has joined #openstack-rally | 22:12 | |
| *** yfried has joined #openstack-rally | 22:20 | |
| *** yfried has quit IRC | 22:20 | |
| *** baker has quit IRC | 22:34 | |
| *** adiantum has quit IRC | 22:39 | |
| *** adiantum has joined #openstack-rally | 22:39 | |
| openstackgerrit | Marcela Bonell proposed openstack/rally: New command to install Tempest's plugins in rally verify. https://review.openstack.org/235605 | 22:40 |
| *** exploreshaifali has quit IRC | 22:49 | |
| *** redixin has quit IRC | 22:49 | |
| *** adiantum has quit IRC | 22:54 | |
| *** baker has joined #openstack-rally | 22:57 | |
| *** baker_ has joined #openstack-rally | 22:57 | |
| *** baker has quit IRC | 23:01 | |
| *** vipul has quit IRC | 23:31 | |
| *** baker has joined #openstack-rally | 23:31 | |
| *** vipul has joined #openstack-rally | 23:31 | |
| *** albertw has quit IRC | 23:33 | |
| *** baker_ has quit IRC | 23:34 | |
| *** albertw has joined #openstack-rally | 23:34 | |
| *** bapalm has quit IRC | 23:34 | |
| *** bapalm has joined #openstack-rally | 23:39 | |
| *** coolsvap has quit IRC | 23:54 | |
| *** aix has quit IRC | 23:54 | |
| *** pvaneck has quit IRC | 23:54 | |
| *** psd has quit IRC | 23:54 | |
| *** madhu_ak has quit IRC | 23:54 | |
| *** klindgren_ has quit IRC | 23:54 | |
| *** davidlenwell has quit IRC | 23:54 | |
| *** ukinau has quit IRC | 23:54 | |
| *** meteorfox has quit IRC | 23:54 | |
| *** serverascode has quit IRC | 23:54 | |
| *** gema has quit IRC | 23:54 | |
| *** mitz_ has quit IRC | 23:54 | |
| *** NikitaKonovalov has quit IRC | 23:54 | |
| *** gus has quit IRC | 23:54 | |
| *** vaidy_ril has quit IRC | 23:54 | |
| *** mgagne has quit IRC | 23:54 | |
| *** ChanServ has quit IRC | 23:54 | |
| *** baker has quit IRC | 23:54 | |
| *** svasheka has quit IRC | 23:54 | |
| *** mwagner_ has quit IRC | 23:54 | |
| *** kbaikov has quit IRC | 23:54 | |
| *** vponomaryov has quit IRC | 23:54 | |
| *** ilbot3 has quit IRC | 23:54 | |
| *** kbyrne has quit IRC | 23:54 | |
| *** bapalm has quit IRC | 23:54 | |
| *** albertw has quit IRC | 23:54 | |
| *** vipul has quit IRC | 23:54 | |
| *** pythonguy has quit IRC | 23:54 | |
| *** hughsaunders has quit IRC | 23:55 | |
| *** harshs has quit IRC | 23:55 | |
| *** emagana has quit IRC | 23:55 | |
| *** jaypipes has quit IRC | 23:55 | |
| *** zhiyan has quit IRC | 23:55 | |
| *** frickler has quit IRC | 23:55 | |
| *** davideag_ has quit IRC | 23:55 | |
| *** logan2 has quit IRC | 23:55 | |
| *** kun_huang has quit IRC | 23:55 | |
| *** jesusaurus has quit IRC | 23:55 | |
| *** igormarnat has quit IRC | 23:55 | |
| *** vkmc has quit IRC | 23:55 | |
| *** openstackgerrit has quit IRC | 23:55 | |
| *** amit213 has quit IRC | 23:55 | |
| *** avico has quit IRC | 23:55 | |
| *** akuznetsova has quit IRC | 23:55 | |
| *** kambiz has quit IRC | 23:55 | |
| *** dmellado has quit IRC | 23:55 | |
| *** darkhuy has quit IRC | 23:55 | |
| *** tuvenen_ has quit IRC | 23:55 | |
| *** jaredrohe has quit IRC | 23:55 | |
| *** marcoceppi has quit IRC | 23:55 | |
| *** pc-pothole has quit IRC | 23:55 | |
| *** psuriset has quit IRC | 23:55 | |
| *** rmk has quit IRC | 23:55 | |
| *** BaQs has quit IRC | 23:55 | |
| *** afazekas has quit IRC | 23:55 | |
| *** nadeem has quit IRC | 23:55 | |
| *** harlowja has quit IRC | 23:55 | |
| *** andreykurilin has quit IRC | 23:55 | |
| *** chenli has quit IRC | 23:55 | |
| *** ekarlso has quit IRC | 23:55 | |
| *** kevinbenton has quit IRC | 23:55 | |
| *** rook has quit IRC | 23:55 | |
| *** raginbajin has quit IRC | 23:55 | |
| *** kir has quit IRC | 23:55 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!