*** mahito has joined #openstack-rally | 00:05 | |
*** yeungp has quit IRC | 00:36 | |
openstackgerrit | Boris Pavlovic proposed openstack/rally: DO NOT MERGE: only one neutron task https://review.openstack.org/190796 | 00:43 |
---|---|---|
openstackgerrit | Boris Pavlovic proposed openstack/rally: Testing that old lib for MySQL works better https://review.openstack.org/190882 | 00:45 |
*** dmorita has joined #openstack-rally | 00:55 | |
*** mahito has quit IRC | 01:00 | |
*** mahito has joined #openstack-rally | 01:02 | |
*** yingjun has joined #openstack-rally | 01:33 | |
*** stpierre has quit IRC | 01:37 | |
*** pboldin has quit IRC | 01:49 | |
*** mahito has quit IRC | 02:01 | |
*** mahito has joined #openstack-rally | 02:03 | |
*** yingjun has quit IRC | 02:25 | |
*** yingjun has joined #openstack-rally | 02:27 | |
*** kiran-r has joined #openstack-rally | 03:12 | |
*** yingjun has quit IRC | 03:18 | |
*** mwagner_afk has joined #openstack-rally | 03:20 | |
openstackgerrit | maplelabs proposed openstack/rally: Add Neutron Loadbalancer v1 create and list pool https://review.openstack.org/182685 | 03:37 |
*** dpaterson has quit IRC | 03:41 | |
*** kiran-r has quit IRC | 03:45 | |
*** kiran-r has joined #openstack-rally | 03:51 | |
*** kiranr has joined #openstack-rally | 03:55 | |
*** kiran-r has quit IRC | 03:55 | |
*** kiranr has quit IRC | 04:02 | |
*** arxcruz has quit IRC | 04:13 | |
*** frickler has quit IRC | 04:31 | |
*** rdas has joined #openstack-rally | 04:54 | |
*** frickler has joined #openstack-rally | 04:54 | |
openstackgerrit | Mahito OGURA proposed openstack/rally: Change "find" command path in tox.ini https://review.openstack.org/190920 | 04:58 |
*** mahito has quit IRC | 05:02 | |
openstackgerrit | Thomas Bechtold proposed openstack/rally: Move sphinx from requirements to test-requirements https://review.openstack.org/190921 | 05:07 |
openstackgerrit | Thomas Bechtold proposed openstack/rally: Remove psycopg2 from requirements https://review.openstack.org/190931 | 05:11 |
*** kiran-r has joined #openstack-rally | 05:17 | |
*** kiran-r has quit IRC | 05:21 | |
*** kiran-r has joined #openstack-rally | 05:21 | |
*** yfried has joined #openstack-rally | 05:22 | |
*** exploreshaifali has joined #openstack-rally | 06:01 | |
*** nihilifer has joined #openstack-rally | 06:03 | |
*** yingjun has joined #openstack-rally | 06:11 | |
*** exploreshaifali has quit IRC | 06:14 | |
*** anshul has joined #openstack-rally | 06:26 | |
*** pbandzi has joined #openstack-rally | 06:40 | |
*** agarciam has joined #openstack-rally | 06:43 | |
*** neeti has joined #openstack-rally | 06:50 | |
*** anshul has quit IRC | 06:54 | |
*** anshul has joined #openstack-rally | 07:06 | |
openstackgerrit | maplelabs proposed openstack/rally: Add Neutron Loadbalancer v1 create and list pool https://review.openstack.org/182685 | 07:20 |
*** amalinow has joined #openstack-rally | 07:32 | |
*** frickler_ has joined #openstack-rally | 07:37 | |
*** frickler_ has quit IRC | 07:37 | |
*** karimb has joined #openstack-rally | 07:42 | |
*** arxcruz has joined #openstack-rally | 07:43 | |
*** igormarnat is now known as imarnat | 08:08 | |
*** yingjun has quit IRC | 08:14 | |
*** kiranr has joined #openstack-rally | 08:15 | |
*** kiran-r has quit IRC | 08:15 | |
*** kiranr has quit IRC | 08:15 | |
*** kiranr has joined #openstack-rally | 08:16 | |
*** kiranr is now known as kiran-r | 08:18 | |
*** yingjun has joined #openstack-rally | 08:22 | |
*** cdent has joined #openstack-rally | 08:35 | |
*** e0ne has joined #openstack-rally | 08:38 | |
*** fhubik has joined #openstack-rally | 08:42 | |
*** imarnat is now known as igormarnat | 08:44 | |
*** anshul has quit IRC | 08:44 | |
*** rook has quit IRC | 08:47 | |
*** vipul has quit IRC | 08:47 | |
*** rook has joined #openstack-rally | 08:48 | |
*** vipul has joined #openstack-rally | 08:48 | |
*** vponomaryov has quit IRC | 08:53 | |
*** vponomaryov has joined #openstack-rally | 08:53 | |
*** e0ne has quit IRC | 08:57 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: Add benchmark for Manila list share servers operation https://review.openstack.org/190981 | 08:59 |
*** yingjun has quit IRC | 09:03 | |
*** karimb has quit IRC | 09:03 | |
*** nkhare has joined #openstack-rally | 09:08 | |
*** anshul has joined #openstack-rally | 09:11 | |
openstackgerrit | Igor Degtiarov proposed openstack/rally: [Ceilometer] Add scenario for events and traits https://review.openstack.org/180514 | 09:15 |
*** karimb has joined #openstack-rally | 09:18 | |
*** yingjun has joined #openstack-rally | 09:20 | |
*** aix has joined #openstack-rally | 09:22 | |
*** karimb has quit IRC | 09:23 | |
*** tosky has joined #openstack-rally | 09:23 | |
*** yingjun has quit IRC | 09:38 | |
*** karimb has joined #openstack-rally | 09:56 | |
*** aix has quit IRC | 10:00 | |
*** e0ne has joined #openstack-rally | 10:04 | |
*** e0ne is now known as e0ne_ | 10:04 | |
*** e0ne_ is now known as e0ne | 10:06 | |
*** yfried has quit IRC | 10:10 | |
*** Miouge has joined #openstack-rally | 10:20 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: Add scenario for creation and deletion of Manila security services https://review.openstack.org/190999 | 10:23 |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: Add scenario for creation and deletion of Manila security services https://review.openstack.org/190999 | 10:24 |
*** aix has joined #openstack-rally | 10:28 | |
*** amaretskiy has joined #openstack-rally | 10:31 | |
*** dmorita has quit IRC | 10:35 | |
*** karimb has quit IRC | 10:58 | |
*** fhubik is now known as fhubik_afk | 11:07 | |
*** karimb has joined #openstack-rally | 11:12 | |
*** pboldin has joined #openstack-rally | 11:16 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: [Manila] Add scenario for attach of security service to share network https://review.openstack.org/191016 | 11:20 |
openstackgerrit | Andrey Kurilin proposed openstack/rally: Add role assignment in keystone wrapper for both v2 and v3 https://review.openstack.org/188553 | 11:22 |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: [Manila] Add base benchmark for list shares operation https://review.openstack.org/184553 | 11:28 |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: [Manila] Add context for Manila quotas https://review.openstack.org/188484 | 11:31 |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: [Manila] Add scenario for creation and deletion of Manila shares https://review.openstack.org/190667 | 11:32 |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: [Manila] Add scenario for creation and deletion of Manila share networks https://review.openstack.org/190724 | 11:34 |
*** fhubik_afk is now known as fhubik | 11:35 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: [Manila] Add scenario for creation and deletion of Manila share networks https://review.openstack.org/190724 | 11:36 |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: [Manila] Add scenario for creation and listing of Manila share networks https://review.openstack.org/190737 | 11:37 |
*** e0ne is now known as e0ne_ | 11:38 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: [Manila] Add scenario for creation and listing of Manila share networks https://review.openstack.org/190737 | 11:40 |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: [Manila] Add benchmark for Manila list share servers operation https://review.openstack.org/190981 | 11:43 |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: [Manila] Add scenario for creation and deletion of security services https://review.openstack.org/190999 | 11:45 |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: [Manila] Add scenario for attach of security service to share network https://review.openstack.org/191016 | 11:46 |
*** e0ne_ has quit IRC | 11:49 | |
openstackgerrit | Igor Degtiarov proposed openstack/rally: [Ceilometer] Add scenario for events and traits https://review.openstack.org/180514 | 11:50 |
*** rdas has quit IRC | 12:11 | |
*** stpierre has joined #openstack-rally | 12:17 | |
*** oanufriev has joined #openstack-rally | 12:18 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: [Manila] Add share networks context for existing users https://review.openstack.org/185423 | 12:26 |
boris-42 | kbaikov: ping | 12:36 |
*** pboldin has quit IRC | 12:37 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: [Manila] Add share networks context for existing users https://review.openstack.org/185423 | 12:37 |
kbaikov | boris-42: pong!!! sorry. some work interfered. but i remember | 12:38 |
boris-42 | kbaikov: so just one suggestion | 12:39 |
boris-42 | kbaikov: fix setup.cfg | 12:40 |
boris-42 | kbaikov: to copy samples in proper place | 12:40 |
kbaikov | boris-42: what? where? is it about the specs? | 12:41 |
boris-42 | kbaikov: s? | 12:42 |
boris-42 | kbaikov: https://bugs.launchpad.net/rally/+bug/1461894 | 12:42 |
openstack | Launchpad bug 1461894 in Rally "Add samples to docker image " [Medium,Triaged] - Assigned to kbaikov (kbaikov) | 12:42 |
kbaikov | boris-42: i see | 12:43 |
kbaikov | boris-42: thank you | 12:43 |
*** dpaterson has joined #openstack-rally | 12:50 | |
*** nkhare has quit IRC | 12:50 | |
*** fhubik is now known as fhubik_afk | 12:52 | |
*** fhubik_afk is now known as fhubik | 12:53 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: [Manila] Add context for Manila with autocreated resources + benchmark https://review.openstack.org/187643 | 12:53 |
openstackgerrit | Chris St. Pierre proposed openstack/rally: Add Heat scenario to test scaling policies https://review.openstack.org/178436 | 12:56 |
boris-42 | stpierre: ping | 12:58 |
stpierre | boris-42: pong | 12:58 |
*** fhubik has quit IRC | 12:59 | |
boris-42 | stpierre: http://logs.openstack.org/80/190880/2/check/gate-rally-dsvm-neutron-neutron/2a7f451/logs/screen-q-svc.txt.gz?level=TRACE | 13:00 |
boris-42 | stpierre: something is wrong | 13:00 |
*** e0ne has joined #openstack-rally | 13:01 | |
stpierre | i'd say so | 13:01 |
stpierre | is this blocking neutron gates too, or just us? | 13:02 |
boris-42 | stpierre: rally neutron jobs (in neutron) are blocked as well | 13:04 |
stpierre | well i guess that's good -- they've got a vested interest in fixing it, too | 13:05 |
stpierre | i saw that you tried an older mysql library -- did that help any? | 13:05 |
boris-42 | stpierre: as you see from logs | 13:09 |
boris-42 | stpierre: nope | 13:09 |
stpierre | oh :( | 13:10 |
boris-42 | stpierre: so I really don't know what is failing | 13:19 |
*** pbandzi has quit IRC | 13:21 | |
*** nihilifer has quit IRC | 13:22 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: [Manila] Add context for Manila with autocreated resources + benchmark https://review.openstack.org/187643 | 13:41 |
*** kiran-r has quit IRC | 13:49 | |
kbaikov | is this being worked on? https://blueprints.launchpad.net/rally/+spec/verification-import | 14:02 |
*** psd has joined #openstack-rally | 14:03 | |
boris-42 | kbaikov: so we can talk with dpaterson | 14:03 |
boris-42 | kbaikov: not sure that he started working on this | 14:03 |
dpaterson | boris-42: I did get started a while back but got derailed due to other responsibilities. | 14:04 |
boris-42 | kbaikov: but I belive it should be done in athoer way | 14:04 |
boris-42 | kbaikov: dpaterson like we can just add abbility to generate html/compare results from raw resutls | 14:04 |
dpaterson | boris-42, kbaikov: I am open to suggestions. boris-42 having the results live in the database as a psuedo deployment is pretty useful for future reporting | 14:06 |
dpaterson | The problem is keeping the results in the file system kind of sucks long term | 14:06 |
boris-42 | dpaterson: ah sounds reasonable | 14:07 |
boris-42 | dpaterson: so yep we should think about that stuff | 14:07 |
dpaterson | boris-42: the other alternative is to deploy rally at customer sites and provide merge mechanism | 14:07 |
dpaterson | Which can be done right at database level pretty easily. | 14:08 |
boris-42 | dpaterson: ya we talk before about that functionallity | 14:08 |
dpaterson | boris-42: at the end of the day what would be very useful is to have a single repository with all results accross qa stamps and from field. | 14:08 |
boris-42 | dpaterson: and I like idea of merging dbs | 14:08 |
dpaterson | boris-42: I'd actually prefer deploying rally out in field as it provides much more than just verfication but getting cleanup working against production cloud is a bit tricky right now. Why I am hoping getting a proper cli and integration points in tempest will make this much better. | 14:10 |
boris-42 | dpaterson: ok | 14:10 |
boris-42 | stpierre: so I will try to debug with neutron | 14:15 |
boris-42 | stpierre: and find the patch that breaks everything | 14:15 |
boris-42 | stpierre: I believe it's on neutron side.. | 14:15 |
stpierre | yeah, i agree. it'd be nice if we could find a way to replicate it locally and 'git bisect' it | 14:16 |
stpierre | but i have never been successful at getting a kilo devstack with neutron running | 14:16 |
*** neeti has quit IRC | 14:16 | |
stpierre | although i don't understand how a single commit could have caused the issue if neutron is gated on rally | 14:18 |
stpierre | oh, it's non-voting | 14:19 |
*** Miouge has quit IRC | 14:20 | |
boris-42 | stpierre: ya | 14:22 |
boris-42 | stpierre: it's not the first time | 14:22 |
stpierre | looking at https://jenkins05.openstack.org/job/gate-rally-dsvm-neutron-neutron/, looks like it broke between 10:38 and 11:41 (presumably UTC) yesterday | 14:23 |
*** marcoceppi has quit IRC | 14:25 | |
boris-42 | stpierre: https://github.com/openstack/neutron/commit/a643070e835329e547a2c183dc1edc831ab900e0 | 14:29 |
boris-42 | stpierre: maybe this patch? | 14:29 |
boris-42 | stpierre: nope seems like it works good https://review.openstack.org/#/c/188585/ | 14:31 |
stpierre | ours broke between 11:03 and 17:22: https://jenkins05.openstack.org/job/gate-rally-dsvm-neutron-rally/ | 14:31 |
stpierre | nothing merged to either rally or neutron between 11:03 and 11:41 yesterday :/ | 14:32 |
stpierre | version bump to one of the libraries, maybe? | 14:32 |
*** yeungp has joined #openstack-rally | 14:35 | |
*** marcoceppi has joined #openstack-rally | 14:35 | |
*** marcoceppi has joined #openstack-rally | 14:35 | |
stpierre | http://ur1.ca/mt112 | 14:35 |
*** nihilifer has joined #openstack-rally | 14:37 | |
*** rhalkyard has joined #openstack-rally | 14:38 | |
*** rhalkyard has quit IRC | 14:38 | |
stpierre | pyOpenSSL looks interesting | 14:41 |
stpierre | i've pinned pyOpenSSL to 0.13 in your review that reverts the switch to PyMySQL, see if that helps | 14:42 |
*** exploreshaifali has joined #openstack-rally | 14:43 | |
*** yeungp has quit IRC | 14:45 | |
*** yeungp has joined #openstack-rally | 14:46 | |
boris-42 | stpierre: as usually it's ahrd to say | 14:49 |
*** e0ne is now known as e0ne_ | 14:49 | |
*** e0ne_ is now known as e0ne | 14:55 | |
*** anshul has quit IRC | 14:56 | |
*** exploreshaifali has quit IRC | 15:02 | |
*** oanufriev has quit IRC | 15:04 | |
*** PrashantS has joined #openstack-rally | 15:08 | |
*** mgagne has joined #openstack-rally | 15:08 | |
*** kbaikov has quit IRC | 15:10 | |
boris-42 | stpierre: oh good | 15:16 |
boris-42 | stpierre: need to create new VM... | 15:16 |
*** e0ne is now known as e0ne_ | 15:18 | |
*** e0ne_ is now known as e0ne | 15:27 | |
boris-42 | stpierre: this may help https://review.openstack.org/#/c/191010/ | 15:34 |
boris-42 | stpierre: it was just merged | 15:34 |
stpierre | oooOOooooo | 15:37 |
boris-42 | stpierre: ya | 15:38 |
*** lutostag has quit IRC | 15:43 | |
*** lutostag has joined #openstack-rally | 15:45 | |
meteorfox | so is VMTasks.boot_runcommand_delete the only approach to execute a benchmark? It's fine if it just runs 1 or 2 commands, provided that the image supports such commands, but it doesn't seem like a good approach to run more complex benchmarks, which involve setting up a disks (raid, partition, ext4 formatting, etc), installing packages, and dependencies, | 15:47 |
meteorfox | etc. Plus the installation, and configuration of the benchmark can change drastically from image to image, and even flavors | 15:47 |
meteorfox | boris-42: ^^ | 15:47 |
boris-42 | meteorfox: so for now it is | 15:47 |
stpierre | currently, yes. i'm not sure rally is (currently) the best tool for running arbitrary benchmarks across VMs | 15:48 |
boris-42 | meteorfox: but we are working as I said before on another thing | 15:48 |
boris-42 | meteorfox: context that creates servers topology | 15:48 |
boris-42 | meteorfox: and scenario that executes via http/ssh/... some commands inside these servers | 15:48 |
boris-42 | meteorfox: to trigger tool that works isnide VM and after that collect all results | 15:48 |
meteorfox | boris-42: ok | 15:49 |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: Add create_and_list_share scenario for Manila https://review.openstack.org/188833 | 15:50 |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: [Manila] Add context for Manila with autocreated resources + benchmark https://review.openstack.org/187643 | 15:51 |
boris-42 | meteorfox: so I hope pboldin will be online | 15:51 |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: [Manila] Add create_and_list_share scenario for Manila https://review.openstack.org/188833 | 15:52 |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: [Manila] Add create_and_list_share scenario for Manila https://review.openstack.org/188833 | 15:55 |
*** PrashantS has quit IRC | 16:01 | |
*** PrashantS has joined #openstack-rally | 16:02 | |
*** klindgren_ has quit IRC | 16:03 | |
*** Prashan__ has joined #openstack-rally | 16:04 | |
*** PrashantS has quit IRC | 16:04 | |
*** arxcruz has quit IRC | 16:08 | |
*** frickler_ has joined #openstack-rally | 16:14 | |
*** frickler_ has quit IRC | 16:14 | |
*** kiran-r has joined #openstack-rally | 16:14 | |
*** amalinow has quit IRC | 16:14 | |
*** exploreshaifali has joined #openstack-rally | 16:17 | |
*** exploreshaifali has quit IRC | 16:17 | |
*** agarciam has quit IRC | 16:21 | |
*** e0ne has quit IRC | 16:24 | |
*** klindgren has joined #openstack-rally | 16:27 | |
*** exploreshaifali has joined #openstack-rally | 16:28 | |
*** karimb has quit IRC | 16:31 | |
*** amaretskiy has quit IRC | 16:37 | |
boris-42 | stpierre: uh oh almost 300 patches in check queue | 16:40 |
stpierre | we'll have results in no time! | 16:40 |
boris-42 | stpierre: =)) | 16:44 |
*** cdent_ has joined #openstack-rally | 16:49 | |
*** cdent has quit IRC | 16:50 | |
*** cdent_ is now known as cdent | 16:50 | |
*** rook has quit IRC | 16:58 | |
*** rook has joined #openstack-rally | 16:58 | |
boris-42 | stpierre: okay soon we will get info | 16:59 |
boris-42 | stpierre: https://jenkins03.openstack.org/job/gate-rally-dsvm-neutron-rally/1158/console | 17:00 |
*** exploreshaifali has quit IRC | 17:00 | |
*** adiantum has quit IRC | 17:10 | |
*** kiran-r has quit IRC | 17:10 | |
*** adiantum has joined #openstack-rally | 17:10 | |
* boris-42 Aleluia seems like rally gates are fixed!! | 17:14 | |
*** jaypipes has joined #openstack-rally | 17:22 | |
darkhuy | boris-42: https://github.com/openstack/rally/blob/master/rally/plugins/openstack/scenarios/cinder/volumes.py#L259 | 17:23 |
darkhuy | naming on this is confusing when compare to boot_servers | 17:24 |
boris-42 | darkhuy: agreee | 17:24 |
boris-42 | darkhuy: but at this moment we are not able to change in simple way naming and depracate stuff | 17:24 |
boris-42 | darkhuy: need to finish plugin base before that... | 17:24 |
darkhuy | boris-42: got it | 17:25 |
darkhuy | boris-42: I should be able to comment out the two delete calls locally, and should work the same as boot_server yes? | 17:25 |
boris-42 | darkhuy: actually you can copy paste this code in ~/.rally/plugins/ | 17:26 |
boris-42 | darkhuy: and do what you want =) | 17:26 |
darkhuy | boris-42: =D | 17:26 |
boris-42 | darkhuy: they will be autodiscovered | 17:26 |
*** Prashan__ has quit IRC | 17:28 | |
*** PrashantS has joined #openstack-rally | 17:29 | |
*** agarciam has joined #openstack-rally | 17:31 | |
*** agarciam has quit IRC | 17:32 | |
*** PrashantS has quit IRC | 17:33 | |
*** cdent has quit IRC | 17:37 | |
*** kiran-r has joined #openstack-rally | 17:43 | |
*** e0ne has joined #openstack-rally | 18:00 | |
*** PrashantS has joined #openstack-rally | 18:07 | |
*** tosky has quit IRC | 18:12 | |
*** e0ne has quit IRC | 18:13 | |
*** e0ne has joined #openstack-rally | 18:19 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: [Manila] Add base benchmark for list shares operation https://review.openstack.org/184553 | 18:21 |
*** aix has quit IRC | 18:22 | |
*** psd has quit IRC | 18:24 | |
*** e0ne is now known as e0ne_ | 18:25 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: [Manila] Add context for Manila quotas https://review.openstack.org/188484 | 18:29 |
*** kiran-r has quit IRC | 18:30 | |
*** e0ne_ has quit IRC | 18:30 | |
*** jaypipes is now known as leakypipes | 18:33 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: [Manila] Add context for Manila quotas https://review.openstack.org/188484 | 18:34 |
openstackgerrit | Merged openstack/rally: Add role assignment in keystone wrapper for both v2 and v3 https://review.openstack.org/188553 | 18:35 |
*** klindgren has quit IRC | 18:39 | |
*** leakypipes has quit IRC | 18:41 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: [Manila] Add context for Manila quotas https://review.openstack.org/188484 | 18:42 |
*** jaypipes has joined #openstack-rally | 18:43 | |
*** jaypipes is now known as leakypipes | 18:50 | |
mgagne | I "discovered" rally and hope to use it to validate our openstack installer against an ephemeral deployment created by Jenkins. The deployment is discoverable at a well known location just like devstack. We already have a smoke test and would like to replace with rally. | 18:57 |
mgagne | How do you suggest we use rally? We use Jenkins to run our tests. Should we preinstall rally on our slaves, pre-add our deployment and simply ask a job to execute rally against the deployment? | 18:58 |
mgagne | I would also like to keep track of previous results. Do you suggest I install a centralized database for this purpose? Is it a well known use case or do people just publish the HTML somewhere and call it a day? | 19:00 |
stpierre | mgagne: preinstalled with a deployment already created would certainly be a simple way to start; you can get more dynamic/ephemeral in the future if you need to (and maintaining state in Jenkins is shit, so you'll probably at least want to). | 19:04 |
stpierre | rally can produce both HTML and JSON output, so you might be able to throw the JSON in MongoDB or something like that | 19:04 |
stpierre | or just timestamped HTML, linked from the Jenkins build output | 19:04 |
mgagne | right, I already scp stuff to a server, might add rally output too | 19:05 |
mgagne | anyone installing rally with puppet? =) | 19:05 |
mgagne | heresy you might say, use ansible! | 19:06 |
stpierre | i'm not, but if I were i'd just build $distro packages to keep it simple | 19:06 |
mgagne | yea, packages ^^' | 19:06 |
mgagne | ok so pre-installed rally with pre-configured deployments and scp output somewhere | 19:07 |
mgagne | is ./rally-jobs in the project a well known location by rally or is some magic involved by openstack infra to make us of it? | 19:08 |
stpierre | the other option would be to have the jenkins job run install_rally.sh itself to get a fresh install in the build directory on each run | 19:08 |
stpierre | which might not be the worst idea ever | 19:08 |
stpierre | magic is involved | 19:08 |
mgagne | alright | 19:08 |
openstackgerrit | Chris St. Pierre proposed openstack/rally: Update Dockerfile to use new install_rally.sh https://review.openstack.org/191194 | 19:09 |
mgagne | we unfortunately don't have ephemeral slaves so we try to avoid sudo or anything installing stuff globally at the job level | 19:09 |
*** e0ne has joined #openstack-rally | 19:09 | |
*** PrashantS has quit IRC | 19:10 | |
*** PrashantS has joined #openstack-rally | 19:10 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: [Manila] Add context for Manila quotas https://review.openstack.org/188484 | 19:14 |
*** PrashantS has quit IRC | 19:16 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack/rally: [Manila] Add context for Manila quotas https://review.openstack.org/188484 | 19:16 |
*** e0ne is now known as e0ne_ | 19:18 | |
*** PrashantS has joined #openstack-rally | 19:19 | |
*** e0ne_ is now known as e0ne | 19:22 | |
*** vponomaryov has quit IRC | 19:23 | |
boris-42 | mgagne: hi there | 19:42 |
mgagne | hi | 19:42 |
boris-42 | meteorfox: about rally-jobs in repo (it's magic from infra and our functional tests) | 19:43 |
boris-42 | meteorfox: sorry | 19:43 |
boris-42 | mgagne: ^ | 19:43 |
meteorfox | np | 19:44 |
mgagne | right so I would need to dig into infra and find the actual job definition | 19:44 |
boris-42 | mgagne: this is script that we run https://github.com/openstack/rally/blob/master/tests/ci/rally-gate.sh | 19:44 |
boris-42 | mgagne: on each patch against various devstack deployments | 19:44 |
*** yeungp has quit IRC | 19:45 | |
boris-42 | mgagne: so if you need to keep all results (the best way is to have postgres/mysql server) and change rally.conf connection string | 19:45 |
mgagne | which assumes a zuul environment | 19:45 |
boris-42 | mgagne: to install rally you have 3 official ways =) | 19:45 |
mgagne | -> BASE and ZUUL_PROJECT | 19:45 |
boris-42 | 1) install_rally.sh | 19:45 |
boris-42 | 2) docker image https://registry.hub.docker.com/u/rallyforge/rally/ | 19:46 |
boris-42 | 3) murano application https://github.com/openstack/murano-apps/tree/master/Rally/package | 19:46 |
boris-42 | there will be soon ansible | 19:46 |
boris-42 | https://review.openstack.org/#/c/186248/ | 19:46 |
boris-42 | mgagne: ^ | 19:46 |
mgagne | as I suffer from stockholm syndrome, I'm working on a puppet manifest for it | 19:47 |
*** PrashantS has quit IRC | 19:47 | |
*** PrashantS has joined #openstack-rally | 19:48 | |
mgagne | true about mysql database, I might use it later, scp looks much more simple to setup for now (from my perspective) | 19:48 |
boris-42 | mgagne: so if we decide to keep puppet modules | 19:49 |
boris-42 | mgagne: we will need to work on gating stuff | 19:49 |
boris-42 | mgagne: to ensure that puppet manifest are working correctly =0 | 19:50 |
mgagne | yep | 19:50 |
mgagne | for now it's just a POC in my own infra | 19:50 |
boris-42 | mgagne: btw one more thing that we are supporting now is rally task report --junit | 19:51 |
mgagne | oh, that sounds cool, I'll try it | 19:52 |
boris-42 | mgagne: one thing that it is not implmeneted is SLA stuff | 19:52 |
boris-42 | mgagne: like we should put errors to benchmarks that failed | 19:52 |
*** PrashantS has quit IRC | 19:52 | |
boris-42 | mgagne: this block needs improvement https://github.com/openstack/rally/blob/master/rally/cli/commands/task.py#L593-L603 | 19:53 |
mgagne | we will see where this POC leads us =) | 19:53 |
boris-42 | mgagne: so if you would like to improve --junit that will be nice... | 19:53 |
mgagne | boris-42: might not be working on SLA for now, mainly working on replacing a custom made smoke test with something else supported by the community | 19:53 |
mgagne | yep, will keep that in mind | 19:54 |
boris-42 | mgagne: SLA are required (without SLA everything will pass 100%) no matter what happend=) | 19:54 |
mgagne | really? :O | 19:54 |
boris-42 | mgagne: yep | 19:56 |
boris-42 | mgagne: this is done mostly because of negative testing | 19:56 |
boris-42 | mgagne: e.g. set quotas cpu 1 and run 5 vms check that you get 4 failures =) | 19:56 |
boris-42 | mgagne: so by default everything jut works=) | 19:57 |
mgagne | I see | 19:57 |
boris-42 | stpierre: okay let's get rid of deprecated stuff https://review.openstack.org/#/c/188077/ | 20:02 |
*** PrashantS has joined #openstack-rally | 20:06 | |
*** klindgren has joined #openstack-rally | 20:06 | |
*** stpierre has quit IRC | 20:07 | |
*** frickler has quit IRC | 20:07 | |
*** dmellado has quit IRC | 20:07 | |
*** NikitaKonovalov has quit IRC | 20:07 | |
*** frickler_ has joined #openstack-rally | 20:07 | |
*** stpierre has joined #openstack-rally | 20:07 | |
*** dmellado has joined #openstack-rally | 20:07 | |
*** NikitaKonovalov has joined #openstack-rally | 20:12 | |
openstackgerrit | Chris St. Pierre proposed openstack/rally: Update Dockerfile to use new install_rally.sh https://review.openstack.org/191194 | 20:18 |
*** e0ne has quit IRC | 20:19 | |
boris-42 | stpierre: hey I saw already 2 times https://review.openstack.org/#/c/184553/ | 20:19 |
boris-42 | stpierre: that py26 job stuck... | 20:19 |
*** anshul has joined #openstack-rally | 20:21 | |
*** oanufriev has joined #openstack-rally | 20:28 | |
stpierre | that's exciting | 20:38 |
mgagne | Is there a way to call recreate and not crash if deployment does not exist yet? In fact, I would like an idempotent version of rally deployment create --name=existing --filename=existing.json | 20:45 |
stpierre | rally deployment show foo || rally deployment create --name=foo --filename foo.json | 20:56 |
stpierre | or: if rally deployment show foo >& /dev/null; then rally deployment recreate ... ; else rally deployment create ... ; fi | 20:57 |
stpierre | depending on what you want | 20:58 |
openstackgerrit | Merged openstack/rally: Eliminated string formatting with single mapping key https://review.openstack.org/189355 | 20:59 |
openstackgerrit | Merged openstack/rally: Remove deprecated code https://review.openstack.org/188077 | 21:00 |
*** frayedknot has quit IRC | 21:02 | |
*** davideagnello has quit IRC | 21:08 | |
*** darkhuy has quit IRC | 21:08 | |
*** davideagnello has joined #openstack-rally | 21:08 | |
*** darkhuy has joined #openstack-rally | 21:10 | |
*** dpaterson has quit IRC | 21:10 | |
*** klindgren has quit IRC | 21:15 | |
*** klindgren has joined #openstack-rally | 21:16 | |
-openstackstatus- NOTICE: Gerrit will be offline for project renames between 22:00 and 22:30 UTC | 21:44 | |
*** ChanServ changes topic to "Gerrit will be offline for project renames between 22:00 and 22:30 UTC" | 21:44 | |
boris-42 | mgagne: heh maybe it will be interesting to create Jenkins plugin | 21:49 |
boris-42 | mgagne: for Rally | 21:49 |
boris-42 | mgagne: I don't have enough expirience with Jenkins but maybe some day | 21:49 |
-openstackstatus- NOTICE: Gerrit is offline for project renames. ETA 20:30 | 22:05 | |
*** ChanServ changes topic to "Gerrit is offline for project renames. ETA 20:30" | 22:05 | |
*** oanufriev has quit IRC | 22:05 | |
-openstackstatus- NOTICE: Gerrit is offline for project renames. ETA 22:40 | 22:09 | |
*** ChanServ changes topic to "Gerrit is offline for project renames. ETA 22:40" | 22:09 | |
*** PrashantS has quit IRC | 22:11 | |
*** PrashantS has joined #openstack-rally | 22:11 | |
*** PrashantS has quit IRC | 22:16 | |
*** BitSmith has joined #openstack-rally | 22:19 | |
*** leakypipes has quit IRC | 22:26 | |
*** PrashantS has joined #openstack-rally | 22:38 | |
*** PrashantS has quit IRC | 22:40 | |
*** PrashantS has joined #openstack-rally | 22:40 | |
*** ChanServ changes topic to "Gerrit is offline for project renames. ETA 20:30" | 22:43 | |
-openstackstatus- NOTICE: Gerrit is back online. Zuul reconfiguration for renamed projects is still in progress, ETA 23:30. | 22:44 | |
*** PrashantS has quit IRC | 22:44 | |
*** ChanServ changes topic to "☁ Rally RoadMap: http://goo.gl/JZkmwY ☁ Review Dashboard: http://goo.gl/YuCJfl ☁ IRC logs http://irclog.perlgeek.de/openstack-rally ☁ Key persons to ask: boris-42, yfried, msdubov, rediskin, andreykurilin, amaretskiy ☁ Documentation: https://rally.readthedocs.org/en/latest/ ☁ To publish changes to Rally: https://rally.readthedocs.org/en/latest/contribute.html" | 22:50 | |
*** anshul has quit IRC | 23:01 | |
*** BitSmith has quit IRC | 23:02 | |
*** klindgren has quit IRC | 23:04 | |
boris-42 | stpierre: btw my favouirte piece of code in Rally =) | 23:18 |
*** openstackgerrit has quit IRC | 23:22 | |
*** openstackgerrit has joined #openstack-rally | 23:22 | |
*** davideag_ has joined #openstack-rally | 23:23 | |
*** davideag_ has quit IRC | 23:25 | |
*** davideagnello has quit IRC | 23:27 | |
*** klindgren has joined #openstack-rally | 23:36 | |
boris-42 | stpierre: https://github.com/openstack/rally/blob/52bd8076b6b3a579ed3ac2b69a293122dbce2e01/rally/benchmark/context/base.py#L108-L129 | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!