| *** chyka_ has quit IRC | 00:38 | |
| *** tovin07_ has joined #openstack-performance | 00:52 | |
| *** markvoelker has joined #openstack-performance | 01:17 | |
| *** harlowja has quit IRC | 02:32 | |
| *** markvoelker has quit IRC | 03:06 | |
| *** markvoelker has joined #openstack-performance | 04:56 | |
| *** pcaruana has joined #openstack-performance | 06:56 | |
| *** AlexeyAbashkin has joined #openstack-performance | 07:56 | |
| *** rmart04 has joined #openstack-performance | 08:05 | |
| *** tovin07_ has quit IRC | 08:38 | |
| *** arcolife has joined #openstack-performance | 08:38 | |
| *** hieulq has quit IRC | 08:38 | |
| *** tovin07_ has joined #openstack-performance | 08:38 | |
| *** hieulq has joined #openstack-performance | 08:38 | |
| *** aojea has joined #openstack-performance | 08:59 | |
| *** arcolife has quit IRC | 09:22 | |
| *** aojea has quit IRC | 09:42 | |
| *** aojea has joined #openstack-performance | 09:56 | |
| *** rmart04 has quit IRC | 10:36 | |
| *** tovin07_ has quit IRC | 10:43 | |
| *** chyka has joined #openstack-performance | 10:51 | |
| *** chyka has quit IRC | 10:55 | |
| *** AlexeyAbashkin has quit IRC | 11:02 | |
| *** AlexeyAbashkin has joined #openstack-performance | 11:02 | |
| *** aojea has quit IRC | 11:40 | |
| *** arcolife has joined #openstack-performance | 11:48 | |
| *** arcolife has quit IRC | 12:00 | |
| *** aojea has joined #openstack-performance | 12:16 | |
| *** jkilpatr has quit IRC | 12:18 | |
| *** aojea_ has joined #openstack-performance | 12:22 | |
| *** aojea has quit IRC | 12:24 | |
| *** aojea has joined #openstack-performance | 12:27 | |
| *** aojea_ has quit IRC | 12:30 | |
| *** yujunz[away] has joined #openstack-performance | 12:31 | |
| *** yujunz[away] has quit IRC | 12:31 | |
| *** aojea_ has joined #openstack-performance | 12:32 | |
| *** aojea has quit IRC | 12:35 | |
| *** aojea has joined #openstack-performance | 12:37 | |
| *** aojea_ has quit IRC | 12:40 | |
| *** aojea_ has joined #openstack-performance | 12:42 | |
| *** aojea has quit IRC | 12:45 | |
| *** aojea has joined #openstack-performance | 12:48 | |
| *** aojea_ has quit IRC | 12:51 | |
| *** jkilpatr has joined #openstack-performance | 12:54 | |
| *** aojea has quit IRC | 12:55 | |
| *** rmart04 has joined #openstack-performance | 13:18 | |
| *** AlexeyAbashkin has quit IRC | 13:52 | |
| *** AlexeyAbashkin has joined #openstack-performance | 14:00 | |
| *** tovin07 has joined #openstack-performance | 14:02 | |
| *** aojea has joined #openstack-performance | 14:04 | |
| *** rmart04 has quit IRC | 14:13 | |
| *** markvoelker has quit IRC | 14:40 | |
| *** yujunz has joined #openstack-performance | 15:02 | |
| *** markvoelker has joined #openstack-performance | 15:13 | |
| *** markvoelker has quit IRC | 15:16 | |
| *** yujunz has quit IRC | 15:24 | |
| *** markvoelker has joined #openstack-performance | 15:25 | |
| *** rmart04 has joined #openstack-performance | 15:27 | |
| DinaBelova | #startmeeting Performance Team | 15:30 |
|---|---|---|
| openstack | Meeting started Tue Jan 9 15:30:03 2018 UTC and is due to finish in 60 minutes. The chair is DinaBelova. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:30 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:30 |
| *** openstack changes topic to " (Meeting topic: Performance Team)" | 15:30 | |
| openstack | The meeting name has been set to 'performance_team' | 15:30 |
| DinaBelova | okay, let's see if someone has survived the holiday season | 15:30 |
| DinaBelova | tovin07 o/ | 15:31 |
| DinaBelova | ilyashakhat o/ | 15:33 |
| tovin07 | o/ | 15:34 |
| DinaBelova | wow, I see a survivor :) | 15:34 |
| DinaBelova | tovin07 I have a feeling we'll be alone today | 15:35 |
| DinaBelova | :D | 15:35 |
| tovin07 | I saw that ilyashakhat publish a patch a few minutes ago in cinder | 15:35 |
| tovin07 | hope that he can join us | 15:35 |
| DinaBelova | okay, let's wait for a few more moments | 15:36 |
| ilyashakhat | hi! | 15:37 |
| ilyashakhat | I'm here | 15:37 |
| DinaBelova | yay! | 15:37 |
| DinaBelova | good to see both of you :) | 15:37 |
| DinaBelova | okay, let's proceed | 15:37 |
| DinaBelova | no action items for a while | 15:37 |
| DinaBelova | so switching to the current status | 15:37 |
| DinaBelova | #topic Current status | 15:37 |
| *** openstack changes topic to "Current status (Meeting topic: Performance Team)" | 15:37 | |
| DinaBelova | tovin07 how are you doing sir? anything to share? | 15:38 |
| tovin07 | yes | 15:38 |
| tovin07 | a little bit | 15:38 |
| tovin07 | when testing ilyashakhat's patch https://review.openstack.org/#/c/519664/ | 15:39 |
| tovin07 | I found an issue with OSProfiler in Nova | 15:39 |
| tovin07 | http://paste.openstack.org/show/641262/ | 15:39 |
| tovin07 | and it is related to this change (from very long time ago) https://review.openstack.org/#/c/254703/20/nova/utils.py | 15:40 |
| tovin07 | line 1174 - 1175 from `spawn` function | 15:41 |
| ilyashakhat | I also so this trace couple of times.. | 15:41 |
| DinaBelova | it's interesting :) I can swear that 11 months ago it used to work :D | 15:41 |
| tovin07 | yes | 15:41 |
| ilyashakhat | for me the issue happens rarely | 15:41 |
| DinaBelova | tovin07 ilyashakhat it's quite interesting | 15:42 |
| DinaBelova | as obviously what the lines you've tovin07 mentioned is doing is just initiating profiler if not context with it is in place | 15:43 |
| tovin07 | as I see here, because we re-initialize osprofiler when it is already initialized will clear current profiler object | 15:43 |
| tovin07 | --> the self._name queue will be empty | 15:43 |
| DinaBelova | oh, yeah, it might be the reason | 15:43 |
| tovin07 | I think we should have `a check` here | 15:43 |
| DinaBelova | tovin07 can you provide a patch? | 15:44 |
| DinaBelova | it looks like minor one | 15:44 |
| tovin07 | yes, I will | 15:44 |
| DinaBelova | cool | 15:44 |
| DinaBelova | thank you | 15:44 |
| ilyashakhat | why this re-initialization is needed? | 15:44 |
| DinaBelova | ilyashakhat frankly speaking I'm not sure - patch ir really old and I do not remember the details | 15:45 |
| tovin07 | Boris Pavlovic | 15:45 |
| tovin07 | Jan 19, 2016 | 15:45 |
| tovin07 | Patch Set 19: Code-Review-1 | 15:45 |
| tovin07 | We need to handle green threads as well, like here: | 15:45 |
| tovin07 | https://github.com/boris-42/nova/commit/6f81fbc45db8ed02c723e534f4a0780845e4d1a8 | 15:45 |
| tovin07 | that's the reason | 15:45 |
| DinaBelova | additionally iyour link is 404 not found to me :) | 15:46 |
| tovin07 | after this comment, DinaBelova adds these code to the utils.py file | 15:46 |
| tovin07 | yes, it 404 for now | 15:46 |
| tovin07 | I cannot find any cache of that link on the web too | 15:46 |
| DinaBelova | yeah, I se this comment | 15:47 |
| DinaBelova | I guess it was not accurate change introduced occasionally without a check | 15:47 |
| DinaBelova | thanks tovin07 for finding it | 15:48 |
| ilyashakhat | btw, profiler state is defined as threading.local() - does it mean to stay per green thread too? | 15:48 |
| ilyashakhat | (that may be a reason why re-initialization is needed) | 15:49 |
| DinaBelova | it was supposed to be so | 15:49 |
| DinaBelova | tovin07 anything else to add? | 15:51 |
| ilyashakhat | so the issue in Nova may occur when there is already some profiling data and then a new thread is forked | 15:51 |
| DinaBelova | ilyashakhat yes, it looks like this | 15:51 |
| ilyashakhat | so we need to properly 'fork' profiler state too | 15:52 |
| DinaBelova | and this is happening not too often | 15:52 |
| DinaBelova | that's why we do not see it too much | 15:52 |
| ilyashakhat | yeah... | 15:52 |
| ilyashakhat | let's move on | 15:52 |
| DinaBelova | ack | 15:52 |
| tovin07 | ah | 15:53 |
| DinaBelova | tovin07 anything else to share? | 15:53 |
| tovin07 | I see this happen with `openstack server create` and some other commands | 15:53 |
| DinaBelova | tovin07 ack | 15:54 |
| DinaBelova | ilyashakhat let's proceed with you :) anything to share with us? how did your holidays go? | 15:54 |
| ilyashakhat | holidays went well :) so I don't have much to share ;) | 15:55 |
| DinaBelova | ilyashakhat :D | 15:55 |
| DinaBelova | that's good too :D | 15:55 |
| ilyashakhat | I've posted a patch to Cinder to fix initialization of WSGI | 15:55 |
| ilyashakhat | similar patch in Nova still hangs | 15:55 |
| tovin07 | yes | 15:55 |
| tovin07 | i tested your cinder patch too | 15:56 |
| DinaBelova | yeah, I see it | 15:56 |
| DinaBelova | nova patch is quite old... | 15:56 |
| DinaBelova | well, Nova review queue sometimes may go crazy | 15:56 |
| *** aojea has quit IRC | 15:56 | |
| tovin07 | however, I see that traces from cinder are quite short | 15:56 |
| DinaBelova | although for 2 lines patch it looks a bit overkill | 15:56 |
| tovin07 | DinaBelova, yes | 15:57 |
| ilyashakhat | tovin07, yes, I see only wsgi events -- looks like there's some more issue | 15:57 |
| DinaBelova | it looks like new year brought more gifts than expected :) | 15:58 |
| DinaBelova | more bugs :D | 15:58 |
| DinaBelova | from my side nothing specific to share | 15:59 |
| tovin07 | I will reach nova cores in nova channel to get another +2 and A+1 for ilyashakhat patch | 15:59 |
| DinaBelova | tovin07 thanks | 15:59 |
| ilyashakhat | thanks! | 15:59 |
| DinaBelova | #topic Open Discussion | 15:59 |
| *** openstack changes topic to "Open Discussion (Meeting topic: Performance Team)" | 15:59 | |
| DinaBelova | okay, so tovin07 ilyashakhat - our brave holiday survivors - anything to share in addition? | 16:00 |
| DinaBelova | :) | 16:00 |
| ilyashakhat | I have :) | 16:00 |
| DinaBelova | ilyashakhat shoot | 16:00 |
| ilyashakhat | I'm going to finish https://review.openstack.org/#/c/521385/ | 16:00 |
| tovin07 | thanks ilyashakhat | 16:00 |
| DinaBelova | yaaay | 16:01 |
| ilyashakhat | so we will have `trace list` command | 16:01 |
| DinaBelova | it's good to hear | 16:01 |
| ilyashakhat | DinaBelova, do we have any deadline to release and be included into Q? | 16:01 |
| ilyashakhat | (if it's not too late already) | 16:01 |
| DinaBelova | well, we did not have too many changes | 16:02 |
| tovin07 | usually no, but osprofiler is under oslo umbrella | 16:02 |
| DinaBelova | yeah | 16:02 |
| tovin07 | therefore, it will depend on oslo release cycle | 16:02 |
| ilyashakhat | Final non-client library release deadline: January 18 | 16:03 |
| DinaBelova | ilyashakhat so we have some time | 16:03 |
| DinaBelova | a bit but still | 16:03 |
| ilyashakhat | ok | 16:03 |
| DinaBelova | thanks ilyashakhat | 16:04 |
| DinaBelova | anything else? | 16:04 |
| tovin07 | nope | 16:05 |
| tovin07 | :D | 16:05 |
| DinaBelova | it looks like nope :) if so, thanks tovin07 and ilyashakhat for showing up :) | 16:05 |
| ilyashakhat | nope | 16:05 |
| DinaBelova | have a nice evening! | 16:05 |
| DinaBelova | #endmeeting | 16:05 |
| *** openstack changes topic to "OpenStack performance discussions - testing, bottlenecks, etc. Performance-related changes on review - https://etherpad.openstack.org/p/perf-zoom-zoom (tools, bottlenecks, etc.)" | 16:05 | |
| openstack | Meeting ended Tue Jan 9 16:05:17 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:05 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/performance_team/2018/performance_team.2018-01-09-15.30.html | 16:05 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/performance_team/2018/performance_team.2018-01-09-15.30.txt | 16:05 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/performance_team/2018/performance_team.2018-01-09-15.30.log.html | 16:05 |
| ilyashakhat | thank you! | 16:05 |
| ilyashakhat | bye :) | 16:05 |
| tovin07 | thank you! :D | 16:05 |
| *** rmart04 has quit IRC | 16:06 | |
| *** aojea has joined #openstack-performance | 16:07 | |
| *** rajulk has joined #openstack-performance | 16:07 | |
| *** markvoelker has quit IRC | 16:09 | |
| *** jkilpatr_ has joined #openstack-performance | 16:24 | |
| *** jkilpatr has quit IRC | 16:26 | |
| *** markvoelker has joined #openstack-performance | 16:37 | |
| *** chyka has joined #openstack-performance | 16:52 | |
| *** aojea has quit IRC | 17:00 | |
| *** aojea has joined #openstack-performance | 17:00 | |
| *** aojea has quit IRC | 17:00 | |
| *** AlexeyAbashkin has quit IRC | 17:02 | |
| *** jkilpatr has joined #openstack-performance | 17:09 | |
| *** jkilpatr_ has quit IRC | 17:09 | |
| *** tovin07 has quit IRC | 17:16 | |
| *** markvoelker has quit IRC | 17:47 | |
| *** aojea has joined #openstack-performance | 18:11 | |
| *** aojea_ has joined #openstack-performance | 18:15 | |
| *** jkilpatr has quit IRC | 18:17 | |
| *** aojea has quit IRC | 18:17 | |
| *** aojea has joined #openstack-performance | 18:19 | |
| *** aojea_ has quit IRC | 18:22 | |
| *** aojea_ has joined #openstack-performance | 18:25 | |
| *** AlexeyAbashkin has joined #openstack-performance | 18:26 | |
| *** aojea has quit IRC | 18:28 | |
| *** aojea has joined #openstack-performance | 18:29 | |
| *** AlexeyAbashkin has quit IRC | 18:30 | |
| *** aojea_ has quit IRC | 18:32 | |
| *** aojea_ has joined #openstack-performance | 18:35 | |
| *** jkilpatr has joined #openstack-performance | 18:38 | |
| *** aojea has quit IRC | 18:38 | |
| *** aojea has joined #openstack-performance | 18:40 | |
| *** aojea has quit IRC | 18:40 | |
| *** aojea has joined #openstack-performance | 18:42 | |
| *** aojea_ has quit IRC | 18:43 | |
| *** aojea_ has joined #openstack-performance | 18:45 | |
| *** aojea has quit IRC | 18:48 | |
| *** aojea has joined #openstack-performance | 18:50 | |
| *** aojea_ has quit IRC | 18:53 | |
| *** aojea_ has joined #openstack-performance | 18:55 | |
| *** aojea has quit IRC | 18:58 | |
| *** aojea has joined #openstack-performance | 19:01 | |
| *** aojea_ has quit IRC | 19:04 | |
| *** aojea_ has joined #openstack-performance | 19:06 | |
| *** aojea has quit IRC | 19:09 | |
| *** aojea has joined #openstack-performance | 19:12 | |
| *** markvoelker has joined #openstack-performance | 19:13 | |
| *** markvoelker has quit IRC | 19:13 | |
| *** aojea_ has quit IRC | 19:15 | |
| *** aojea_ has joined #openstack-performance | 19:16 | |
| *** aojea has quit IRC | 19:19 | |
| *** aojea has joined #openstack-performance | 19:22 | |
| *** markvoelker has joined #openstack-performance | 19:23 | |
| *** aojea_ has quit IRC | 19:25 | |
| *** aojea has quit IRC | 19:25 | |
| *** harlowja has joined #openstack-performance | 19:33 | |
| *** harlowja_ has joined #openstack-performance | 19:41 | |
| *** markvoelker has quit IRC | 19:42 | |
| *** markvoelker has joined #openstack-performance | 19:43 | |
| *** harlowja has quit IRC | 19:43 | |
| *** markvoelker has quit IRC | 19:48 | |
| *** harlowja_ has quit IRC | 19:55 | |
| *** harlowja has joined #openstack-performance | 19:55 | |
| *** markvoelker has joined #openstack-performance | 20:33 | |
| *** rajulk has quit IRC | 20:37 | |
| *** markvoelker has quit IRC | 21:13 | |
| *** markvoelker has joined #openstack-performance | 21:13 | |
| *** markvoelker has quit IRC | 21:17 | |
| *** pcaruana has quit IRC | 21:38 | |
| *** threestrands has joined #openstack-performance | 21:44 | |
| *** threestrands has quit IRC | 21:44 | |
| *** threestrands has joined #openstack-performance | 21:44 | |
| *** aojea has joined #openstack-performance | 21:54 | |
| *** aojea_ has joined #openstack-performance | 21:59 | |
| *** AlexeyAbashkin has joined #openstack-performance | 22:00 | |
| *** aojea_ has quit IRC | 22:02 | |
| *** aojea has quit IRC | 22:02 | |
| *** AlexeyAbashkin has quit IRC | 22:05 | |
| *** yee37932 has joined #openstack-performance | 22:26 | |
| *** yee379 has quit IRC | 22:28 | |
| *** markvoelker has joined #openstack-performance | 22:29 | |
| *** markvoelker has quit IRC | 22:30 | |
| *** zerick_ has quit IRC | 22:33 | |
| *** zerick has joined #openstack-performance | 22:34 | |
| *** zerick has quit IRC | 22:49 | |
| *** markvoelker has joined #openstack-performance | 23:11 | |
| *** markvoelker has quit IRC | 23:11 | |
| *** AlexeyAbashkin has joined #openstack-performance | 23:22 | |
| *** AlexeyAbashkin has quit IRC | 23:27 | |
| *** markvoelker has joined #openstack-performance | 23:43 | |
| *** markvoelker has quit IRC | 23:43 | |
| *** yujunz has joined #openstack-performance | 23:44 | |
| *** yujunz has quit IRC | 23:45 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!