| *** catintheroof has joined #openstack-performance | 00:25 | |
| *** boyfawkes has quit IRC | 00:26 | |
| *** chyka has joined #openstack-performance | 00:29 | |
| *** chyka has quit IRC | 00:33 | |
| *** boyfawkes has joined #openstack-performance | 00:42 | |
| *** tovin07_ has joined #openstack-performance | 00:48 | |
| *** catintheroof has quit IRC | 01:02 | |
| *** rfolco has joined #openstack-performance | 01:04 | |
| *** rfolco has quit IRC | 01:04 | |
| *** boyfawkes has quit IRC | 01:56 | |
| *** harlowja has quit IRC | 02:06 | |
| *** aojea has joined #openstack-performance | 02:21 | |
| *** aojea has quit IRC | 02:25 | |
| *** harlowja has joined #openstack-performance | 02:50 | |
| *** harlowja has quit IRC | 03:56 | |
| *** boyfawkes has joined #openstack-performance | 04:04 | |
| *** harlowja has joined #openstack-performance | 04:07 | |
| *** boyfawkes has quit IRC | 04:22 | |
| *** harlowja has quit IRC | 04:33 | |
| *** dimtruck is now known as zz_dimtruck | 04:48 | |
| *** boyfawkes has joined #openstack-performance | 05:01 | |
| *** ggherdov-_ has joined #openstack-performance | 05:07 | |
| *** harlowja has joined #openstack-performance | 05:11 | |
| *** boyfawkes has quit IRC | 05:14 | |
| *** Dinesh_Bhor has quit IRC | 05:14 | |
| *** akrzos has quit IRC | 05:14 | |
| *** SpamapS has quit IRC | 05:14 | |
| *** ggherdov- has quit IRC | 05:14 | |
| *** akrzos has joined #openstack-performance | 05:15 | |
| *** boyfawkes has joined #openstack-performance | 05:21 | |
| *** Dinesh_Bhor has joined #openstack-performance | 05:21 | |
| *** SpamapS has joined #openstack-performance | 05:23 | |
| *** boyfawkes has quit IRC | 05:30 | |
| *** aojea has joined #openstack-performance | 05:34 | |
| *** aojea has quit IRC | 05:41 | |
| *** boyfawkes has joined #openstack-performance | 05:44 | |
| *** harlowja has quit IRC | 06:02 | |
| *** rmart04 has joined #openstack-performance | 06:52 | |
| *** rmart04 has quit IRC | 06:57 | |
| *** pcaruana has joined #openstack-performance | 07:19 | |
| *** aojea has joined #openstack-performance | 07:24 | |
| *** aojea_ has joined #openstack-performance | 07:27 | |
| *** aojea has quit IRC | 07:30 | |
| *** ilyashakhat has quit IRC | 09:19 | |
| *** boyfawkes has quit IRC | 09:41 | |
| *** boyfawkes has joined #openstack-performance | 09:57 | |
| *** abalutoiu__ has joined #openstack-performance | 10:00 | |
| *** abalutoiu_ has quit IRC | 10:03 | |
| *** rook is now known as rook|mobile | 10:15 | |
| *** tovin07_ has quit IRC | 10:18 | |
| *** jkilpatr has quit IRC | 10:38 | |
| *** jkilpatr has joined #openstack-performance | 11:18 | |
| *** rmart04 has joined #openstack-performance | 11:34 | |
| *** catintheroof has joined #openstack-performance | 12:05 | |
| *** zz_dimtruck is now known as dimtruck | 12:16 | |
| *** jkilpatr has quit IRC | 12:24 | |
| *** rfolco has joined #openstack-performance | 12:26 | |
| *** rfolco_ has joined #openstack-performance | 12:28 | |
| *** rfolco has quit IRC | 12:31 | |
| *** dimtruck is now known as zz_dimtruck | 12:40 | |
| *** jkilpatr has joined #openstack-performance | 12:40 | |
| *** rook|mobile is now known as rook-tower | 12:45 | |
| *** openstackgerrit has joined #openstack-performance | 13:32 | |
| openstackgerrit | Artem Yasakov proposed openstack/performance-docs master: Kube-proxy performance test plan and report https://review.openstack.org/452257 | 13:32 |
|---|---|---|
| *** tovin07 has joined #openstack-performance | 13:36 | |
| openstackgerrit | Oleg Basov proposed openstack/performance-docs master: ETCD health research: test results https://review.openstack.org/451892 | 14:09 |
| *** tovin07 has quit IRC | 14:16 | |
| *** msimonin has joined #openstack-performance | 14:34 | |
| *** zz_dimtruck is now known as dimtruck | 14:37 | |
| *** abalutoiu has joined #openstack-performance | 14:46 | |
| *** abalutoiu__ has quit IRC | 14:48 | |
| *** Guest52040 has joined #openstack-performance | 15:14 | |
| *** rama_y__ has joined #openstack-performance | 15:28 | |
| *** rcherrueau has joined #openstack-performance | 15:28 | |
| DinaBelova | #startmeeting Performance Team | 15:29 |
| openstack | Meeting started Tue Apr 4 15:29:51 2017 UTC and is due to finish in 60 minutes. The chair is DinaBelova. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:29 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:29 |
| openstack | The meeting name has been set to 'performance_team' | 15:29 |
| DinaBelova | hello folks! | 15:30 |
| rcherrueau | o/ | 15:30 |
| DinaBelova | rcherrueau akrzos o/ | 15:30 |
| DinaBelova | I have a strange feeling we won't have too many people today :) | 15:30 |
| DinaBelova | rcherrueau let's wait for a few moments :) | 15:31 |
| rcherrueau | yep | 15:31 |
| DinaBelova | it might be a chance we're alone today :D | 15:31 |
| rcherrueau | :D | 15:31 |
| *** msimonin has quit IRC | 15:32 | |
| *** tovin07 has joined #openstack-performance | 15:32 | |
| tovin07 | o/ | 15:32 |
| DinaBelova | tovin07 o/ | 15:32 |
| DinaBelova | ok, so there are three of us :D me, tovin07 and rcherrueau :D | 15:32 |
| tovin07 | ýe | 15:33 |
| tovin07 | ýeyes | 15:33 |
| rcherrueau | tovin07: o/ | 15:33 |
| tovin07 | rcherrueau: hi | 15:33 |
| DinaBelova | I think we need to get started (no action items from last meeting, so we can jump to current progress) | 15:33 |
| DinaBelova | #topic Current progress on the planned tests | 15:33 |
| DinaBelova | rcherrueau the floor is yours sir :) | 15:33 |
| DinaBelova | any news? | 15:33 |
| rcherrueau | This weeks I spent most of time implementing a new feature in Enos that lets you define a set of OpenStack characteristics | 15:34 |
| rcherrueau | eg, different number of compute nodes: 10, 100, 1000; network delay between groups of nodes: 50ms, 100ms ; topology of services location ... | 15:34 |
| rcherrueau | The idea, then, is to automatically build all possible configurations by sweeping on theses characteristics and run Enos with each configuration | 15:35 |
| DinaBelova | rcherrueau btw, is it possible to add to perf docs the methodology you're using to get the testing with network delays? | 15:35 |
| rcherrueau | ie, first run with 10 computes and a network delay of 50ms, second run with 100 computes and a network delay of 50 ms, ..., sixth run with 1000 computes and a network delay of 100 ms. | 15:35 |
| DinaBelova | I mean, I know you're going to do that anyway for summit | 15:35 |
| rcherrueau | DinaBelova: oh yes, can you put an action for that? | 15:35 |
| DinaBelova | but I wonder when you're planning to add this to the docs | 15:35 |
| DinaBelova | sure | 15:35 |
| DinaBelova | #action rcherrueau add OpenStack testing under networking delays (e.g. multisite deployment) methodology to performance docs | 15:36 |
| DinaBelova | thanks | 15:36 |
| rcherrueau | With this new feature it let us easily define a large set of configurations and let Enos do the performance evaluation in the background. | 15:36 |
| DinaBelova | rcherrueau as for the feature - got your point | 15:37 |
| DinaBelova | I believe for several tests it's going to be quite convinient | 15:37 |
| rcherrueau | yes | 15:37 |
| rcherrueau | And that's all on my side | 15:37 |
| DinaBelova | anything else to share? | 15:37 |
| DinaBelova | ok | 15:37 |
| DinaBelova | ok, from my side | 15:37 |
| DinaBelova | several test plans / tets results have been uploaded on review | 15:37 |
| DinaBelova | #info ETCD health in k8s clouds under load https://review.openstack.org/451892 | 15:38 |
| DinaBelova | #info kube-proxy performance evaluation https://review.openstack.org/452257 | 15:38 |
| DinaBelova | #info Ceph RBD performance testing https://review.openstack.org/452246 | 15:38 |
| DinaBelova | #info containerized OpenStack upgrades testing https://review.openstack.org/451419 | 15:39 |
| DinaBelova | there were other changes as well, but I mentioned them last meeting | 15:39 |
| DinaBelova | and I think that's all for now from my side :) | 15:40 |
| rcherrueau | DinaBelova: Did you find something interesting? I mean if you compare with previous tests outside of container | 15:40 |
| DinaBelova | rcherrueau I'd say we need to dig deeper to the upgrades if that will be possible next testing cycle | 15:40 |
| DinaBelova | and the reliability | 15:40 |
| DinaBelova | I believe k8s as a platform can provide better results | 15:40 |
| DinaBelova | than the ones we've seen | 15:41 |
| DinaBelova | in terms of control plane availability during those operations | 15:41 |
| rcherrueau | DinaBelova: OK got it | 15:41 |
| DinaBelova | rcherrueau although that will take some additional effort - we need to understand what the impact on our schedule and tasks that will be | 15:42 |
| DinaBelova | there might be a chance our team will be switched a bit more to some internal tasks in future (no clarity so far) | 15:42 |
| DinaBelova | so further tasks discussion is quite hot right now :D | 15:42 |
| rcherrueau | DinaBelova: ack | 15:43 |
| openstackgerrit | David Burnazyan proposed openstack/performance-docs master: Ceph RBD test results https://review.openstack.org/452246 | 15:43 |
| openstackgerrit | Merged openstack/performance-docs master: Indicating the location tests directory in oslo_debug_helper https://review.openstack.org/443530 | 15:43 |
| DinaBelova | and as only Inria and Mirantis are presented today (in terms of testing :D) we may go further :D | 15:43 |
| DinaBelova | #topic Open Discussion | 15:43 |
| rcherrueau | DinaBelova: I will take a look later, but could you explain a little bit how your perform your upgrade testing? | 15:43 |
| DinaBelova | rcherrueau sure | 15:43 |
| rcherrueau | how you* | 15:44 |
| tovin07 | this week | 15:44 |
| tovin07 | I continue to work on some OSprofiler patch | 15:44 |
| tovin07 | however, there is no other comment on SQL/function result patch | 15:44 |
| DinaBelova | tovin07 link please :) | 15:44 |
| * tovin07 looking | 15:44 | |
| DinaBelova | rcherrueau ^^ I believe you guys promised to take a look on SQL/function result patch | 15:45 |
| rcherrueau | tovin07: I take a look and wanna try it, but my osprofiler still not works when I go with a kolla-deploymnet :( | 15:45 |
| tovin07 | #link https://review.openstack.org/#/c/450072/ | 15:45 |
| tovin07 | rcherrueau: the issue with ceilometer? | 15:46 |
| rcherrueau | tovin07: However I look at the example you provide into your commit message and it's exactly what I need! | 15:46 |
| rama_y__ | Hello, I would appreciate taking a look at this patch: https://review.openstack.org/#/c/358142/ | 15:47 |
| tovin07 | rama_y: long time no see :D | 15:47 |
| rcherrueau | tovin07: Actually, last week you advice me to look into RMQ queues. | 15:47 |
| rama_y__ | I was able to get trace output sometime back; now, I am not getting the trace with the same code. | 15:47 |
| rama_y__ | Hi tovin07 | 15:47 |
| rama_y__ | Hi DinaBelova | 15:48 |
| DinaBelova | rcherrueau as for the upgrades. We were testing major upgrade from Mitaka to Newton using fuel-ccp. Overall process is described as "use new OpenStack services image and redeploy needed containers". At the same time we were running rally tests to check the control plane availablity. Right now we're doing to the same with shaker to check data plane (some issues with heat observed) | 15:48 |
| tovin07 | rama_y__: do you know what may be wrong? | 15:48 |
| rcherrueau | tovin07: After inspecting this, it appears that there are no messages related to OSProfiler in the queue. | 15:48 |
| DinaBelova | rama_y__ o/ | 15:48 |
| DinaBelova | nice to see you around againt | 15:48 |
| rama_y__ | I think ceilometer | 15:48 |
| *** aojea_ has quit IRC | 15:49 | |
| rcherrueau | tovin07: So, I set up manually the value of `messaging` into `[profiler]` to `rabbitmq://` but still nothing | 15:49 |
| tovin07 | rama_y__: did you try with other drivers? such as: redis or mongodb | 15:49 |
| tovin07 | rcherrueau: rabbitmq:// will not work | 15:49 |
| rama_y__ | tovin07: no | 15:49 |
| *** chyka has joined #openstack-performance | 15:50 | |
| * rcherrueau look into its configuration file | 15:50 | |
| tovin07 | rcherrueau: messaging:// means that OSprofiler will use default message queue that define to work with oslo.messaging | 15:50 |
| rcherrueau | tovin07: sorry I wanna say: `connection_string = messaging://` | 15:51 |
| tovin07 | rama_y__: let give them (redis, mongodb) a try and figure out why | 15:51 |
| tovin07 | rcherrueau: default connection_string is set to messaging:// | 15:51 |
| rcherrueau | tovin07: However, I figured out that there is no osprofiler filter in the keystong-paste.ini file during a kolla-ansible deployment | 15:51 |
| tovin07 | Oh | 15:51 |
| DinaBelova | rcherrueau ok, so if with messaging:// there is nothing in queues, it means the error is earlier in the stack. the most common case is some misconfiguration of the profiler on the OpenStack service-level | 15:51 |
| rcherrueau | tovin07: Maybe this is the root of my problem? | 15:51 |
| tovin07 | yes | 15:52 |
| DinaBelova | rcherrueau it surely might be :) check all those files pleasef | 15:52 |
| DinaBelova | for all services you'd like to have profiling from | 15:52 |
| rcherrueau | It's ok for nova, glance, ... but not for keystone | 15:52 |
| DinaBelova | missing of osprofiler there mean no WSGI middlware will be added -> no profiling | 15:52 |
| *** rmart04 has quit IRC | 15:52 | |
| tovin07 | which version of keystone that you use when kolla deploy it? | 15:53 |
| rcherrueau | tovin07: master | 15:53 |
| rcherrueau | but kolla override this file | 15:54 |
| tovin07 | oh | 15:54 |
| tovin07 | so, there’s a problem with kolla in this case | 15:54 |
| tovin07 | kolla should keep osprofiler filter | 15:54 |
| rcherrueau | But still no sure this is the root of my problem because nova api-paste.ini, glance, ... are correctly set | 15:55 |
| *** hieulq_ has joined #openstack-performance | 15:55 | |
| *** rfolco_ has quit IRC | 15:56 | |
| rcherrueau | Anyway I can change it and perform a new deployment, then see if it works or not. | 15:56 |
| tovin07 | did you try to get a trace with nova or glance client? | 15:56 |
| rcherrueau | tovin07: yes, not directly with nova client but something like `openstack server create ... --os-profile SECRET_KEY` | 15:57 |
| tovin07 | that command is correct, as I see | 15:57 |
| rcherrueau | DinaBelova: Sorry, maybe this is not the right time and place to discuss about that. | 15:58 |
| DinaBelova | rcherrueau it's ok :) | 15:58 |
| tovin07 | rcherrueau: it’s ok :D | 15:58 |
| *** hieulq__ has joined #openstack-performance | 15:58 | |
| DinaBelova | we're here exactly for those discussions :) | 15:58 |
| tovin07 | rama_y__: do you have any (more) information about your case? | 15:59 |
| tovin07 | rcherrueau: you can change driver to redis or mongodb to debug/trouble-shoot it easier | 16:00 |
| rcherrueau | tovin07: maybe you should proceed with patches you wanna talk about at start of open discussion. I will try to update the keystone-paste.ini and see what is happening. I will also try with mongodb | 16:00 |
| rama_y__ | tovin07, no; I will retry the testing and will let you know. | 16:00 |
| rcherrueau | tovin07: DinaBelova: thanks for your help | 16:01 |
| DinaBelova | rcherrueau no problem sir | 16:01 |
| DinaBelova | you're welcome | 16:01 |
| tovin07 | because osprofiler flow with those drivers is simpler than flow of ceilometer case | 16:01 |
| tovin07 | rcherrueau: no problem at all | 16:01 |
| *** pcaruana has quit IRC | 16:01 | |
| rama_y__ | Thanks tovin07, DinaBelova | 16:01 |
| DinaBelova | ok, anything else to cover today? | 16:01 |
| DinaBelova | rama_y__ you're welcome | 16:02 |
| tovin07 | rcherrueau: about sql/function result | 16:02 |
| rcherrueau | tovin07: should I change the value of `connection_string` if I go with mongodb? | 16:02 |
| tovin07 | the demo fits your need | 16:02 |
| *** hieulq_ has quit IRC | 16:02 | |
| tovin07 | rcherrueau: yes, change it to something like: mongodb://localhost:27017 | 16:02 |
| tovin07 | change localhost to your mongodb IP | 16:02 |
| rcherrueau | tovin07: OK thanks. | 16:02 |
| tovin07 | and for redis: redis://localhost:6379 | 16:03 |
| rcherrueau | OK got it | 16:04 |
| tovin07 | rama_y__: you should recheck the configuration files, check the rabbitmq profiler.info queue, check mysql in panko schema | 16:04 |
| DinaBelova | rcherrueau tovin07 rama_y__ - ok, it looks like we went through the progress and issues | 16:04 |
| tovin07 | If you see any trace info in it, it means that osprofiler worked | 16:04 |
| rcherrueau | tovin07: And then, if I want the result with the osprofiler cli, I guess I have to link mongodb also? | 16:05 |
| rama_y__ | Ok, thanks. | 16:05 |
| tovin07 | rcherrueau: yes, add —connection-string | 16:05 |
| tovin07 | DinaBelova: :D | 16:05 |
| rcherrueau | tovin07: OK thanks a lot. | 16:05 |
| DinaBelova | tovin07 yeah, I see :D | 16:05 |
| DinaBelova | tovin07 all of the details :) | 16:06 |
| tovin07 | at the end | 16:06 |
| DinaBelova | tovin07 yes sir? | 16:06 |
| DinaBelova | tovin07 anything else? | 16:07 |
| tovin07 | rcherrueau: could you review some infor in my patch about sql/function result? (closely) | 16:07 |
| tovin07 | then I will update and make that patch better | 16:07 |
| tovin07 | DinaBelova: end for now :D | 16:07 |
| DinaBelova | rcherrueau I may add and action item on you :D | 16:08 |
| DinaBelova | for the review :D | 16:08 |
| DinaBelova | so next time you'll have to get it reviewed :D | 16:08 |
| rcherrueau | tovin07: yes I can, but do not expect review on How you implement it, because I don't know how osprofiler works under the hood | 16:08 |
| tovin07 | rcherrueau: so, let look at the representation of results | 16:09 |
| DinaBelova | rcherrueau true, but it'll be cool to get it reviewed anyway - inria was requesting this feature :) | 16:09 |
| rcherrueau | tovin07: I can comment the output. Is it OK for you | 16:09 |
| tovin07 | Yes | 16:09 |
| DinaBelova | #action rcherrueau review tovin07 's osprofiler patch with sql/function result https://review.openstack.org/#/c/450072/ | 16:09 |
| rcherrueau | OK Good | 16:09 |
| DinaBelova | ok, thank you folks for participating | 16:10 |
| DinaBelova | see you next week | 16:10 |
| DinaBelova | bye! | 16:10 |
| tovin07 | bye | 16:10 |
| rcherrueau | bye | 16:10 |
| DinaBelova | #endmeeting | 16:10 |
| openstack | Meeting ended Tue Apr 4 16:10:14 2017 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:10 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/performance_team/2017/performance_team.2017-04-04-15.29.html | 16:10 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/performance_team/2017/performance_team.2017-04-04-15.29.txt | 16:10 |
| tovin07 | thank you all! | 16:10 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/performance_team/2017/performance_team.2017-04-04-15.29.log.html | 16:10 |
| *** tovin07 has left #openstack-performance | 16:12 | |
| openstackgerrit | David Burnazyan proposed openstack/performance-docs master: Ceph RBD test results https://review.openstack.org/452246 | 16:12 |
| *** hieulq__ has quit IRC | 16:21 | |
| *** hieulq__ has joined #openstack-performance | 16:22 | |
| *** hieulq__ has quit IRC | 16:25 | |
| *** rama_y__ has quit IRC | 16:26 | |
| *** rfolco has joined #openstack-performance | 16:27 | |
| *** msimonin has joined #openstack-performance | 16:33 | |
| *** tovin07 has joined #openstack-performance | 17:05 | |
| *** tovin07 has quit IRC | 17:06 | |
| *** tovin07 has joined #openstack-performance | 17:06 | |
| *** tovin07 has quit IRC | 17:06 | |
| *** rcherrueau has quit IRC | 17:26 | |
| *** Guest52040 has quit IRC | 17:28 | |
| openstackgerrit | Oleg Basov proposed openstack/performance-docs master: ETCD health: test plan https://review.openstack.org/453273 | 17:32 |
| *** dimtruck is now known as zz_dimtruck | 19:05 | |
| *** msimonin has quit IRC | 19:09 | |
| *** aojea has joined #openstack-performance | 19:24 | |
| *** harlowja has joined #openstack-performance | 19:24 | |
| *** msimonin has joined #openstack-performance | 19:25 | |
| *** msimonin has quit IRC | 19:26 | |
| *** msimonin has joined #openstack-performance | 19:43 | |
| *** msimonin has quit IRC | 19:44 | |
| *** msimonin has joined #openstack-performance | 20:04 | |
| *** jkilpatr has quit IRC | 20:45 | |
| *** zz_dimtruck is now known as dimtruck | 20:53 | |
| *** aojea has quit IRC | 21:11 | |
| *** aojea has joined #openstack-performance | 21:15 | |
| *** aojea_ has joined #openstack-performance | 21:16 | |
| *** aojea has quit IRC | 21:16 | |
| *** jkilpatr has joined #openstack-performance | 21:23 | |
| *** rfolco has quit IRC | 21:33 | |
| *** dimtruck is now known as zz_dimtruck | 21:41 | |
| *** aojea_ has quit IRC | 21:57 | |
| *** zz_dimtruck is now known as dimtruck | 22:08 | |
| *** msimonin has quit IRC | 22:40 | |
| *** catintheroof has quit IRC | 22:57 | |
| *** chyka has quit IRC | 23:29 | |
| *** dimtruck is now known as zz_dimtruck | 23:35 | |
| *** zz_dimtruck is now known as dimtruck | 23:46 | |
| *** rook-tower is now known as rook | 23:49 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!