| *** Guest557 has quit IRC | 00:01 | |
| *** Guest557 has joined #heat | 00:16 | |
| *** rcernin_ has joined #heat | 00:34 | |
| *** rcernin has quit IRC | 00:37 | |
| *** edmondsw_ has joined #heat | 00:52 | |
| *** edmondsw has quit IRC | 00:55 | |
| *** hongbin has joined #heat | 01:02 | |
| *** namnh has joined #heat | 01:05 | |
| *** edmondsw_ has quit IRC | 01:29 | |
| *** rcernin_ has quit IRC | 02:09 | |
| *** ramishra has joined #heat | 02:27 | |
| *** homeski has joined #heat | 02:36 | |
| *** edmondsw has joined #heat | 02:44 | |
| *** edmondsw has quit IRC | 02:49 | |
| *** skramaja has joined #heat | 03:08 | |
| *** hongbin has quit IRC | 03:23 | |
| *** ivve has joined #heat | 04:05 | |
| *** ramishra has quit IRC | 04:08 | |
| *** ramishra has joined #heat | 04:10 | |
| *** ramishra has quit IRC | 04:23 | |
| *** ramishra has joined #heat | 04:25 | |
| *** edmondsw has joined #heat | 04:32 | |
| *** edmondsw has quit IRC | 04:37 | |
| *** links has joined #heat | 04:37 | |
| *** lifeless has quit IRC | 04:52 | |
| *** flwang1 has quit IRC | 04:59 | |
| *** rcernin has joined #heat | 05:20 | |
| *** jtomasek has joined #heat | 05:49 | |
| *** jtomasek has quit IRC | 05:49 | |
| *** jtomasek has joined #heat | 05:50 | |
| *** ramishra has quit IRC | 06:13 | |
| *** ramishra has joined #heat | 06:14 | |
| *** edmondsw has joined #heat | 06:21 | |
| *** edmondsw has quit IRC | 06:26 | |
| *** dmellado has joined #heat | 06:41 | |
| *** neatherweb has joined #heat | 06:53 | |
| *** hjensas has quit IRC | 06:54 | |
| *** armaan has joined #heat | 07:01 | |
| *** rcernin has quit IRC | 07:01 | |
| *** links has quit IRC | 07:38 | |
| *** hjensas has joined #heat | 07:47 | |
| *** hjensas has joined #heat | 07:47 | |
| *** links has joined #heat | 07:55 | |
| *** ysandeep has joined #heat | 07:57 | |
| *** AlexeyAbashkin has joined #heat | 07:57 | |
| *** armaan has quit IRC | 08:01 | |
| *** armaan has joined #heat | 08:01 | |
| *** links has quit IRC | 08:04 | |
| *** flwang1 has joined #heat | 08:07 | |
| *** sshnaidm has quit IRC | 08:09 | |
| *** shardy has joined #heat | 08:09 | |
| *** edmondsw has joined #heat | 08:09 | |
| *** edmondsw has quit IRC | 08:14 | |
| *** links has joined #heat | 08:18 | |
| *** neatherweb has quit IRC | 08:21 | |
| *** armaan has quit IRC | 08:23 | |
| *** armaan has joined #heat | 08:23 | |
| *** derekh has joined #heat | 08:35 | |
| *** serlex has joined #heat | 08:36 | |
| *** gfidente has joined #heat | 08:42 | |
| hjensas | Any cores around to have a look at these https://review.openstack.org/#/q/topic:story/2001988+(status:open+OR+status:merged) ? | 08:49 |
|---|---|---|
| *** dbecker has joined #heat | 08:50 | |
| *** lifeless has joined #heat | 08:55 | |
| *** flwang1 has quit IRC | 09:10 | |
| *** pbourke has joined #heat | 09:11 | |
| *** flwang1 has joined #heat | 09:26 | |
| *** armaan has quit IRC | 09:33 | |
| *** sshnaidm has joined #heat | 09:34 | |
| *** armaan has joined #heat | 09:36 | |
| *** armaan has quit IRC | 09:38 | |
| *** armaan has joined #heat | 09:42 | |
| *** armaan has quit IRC | 09:55 | |
| *** armaan has joined #heat | 09:57 | |
| *** lifeless has quit IRC | 10:03 | |
| *** lifeless has joined #heat | 10:04 | |
| *** namnh has quit IRC | 10:19 | |
| openstackgerrit | Tovin Seven proposed openstack/python-heatclient master: Trivial: Update pypi url to new url https://review.openstack.org/563054 | 10:51 |
| *** d0ugal has quit IRC | 10:54 | |
| *** szaher has joined #heat | 10:54 | |
| *** d0ugal has joined #heat | 10:56 | |
| *** lifeless has quit IRC | 11:10 | |
| *** armaan has quit IRC | 11:43 | |
| *** armaan has joined #heat | 11:43 | |
| *** angus_salkeld has joined #heat | 12:06 | |
| angus_salkeld | wave ... howdy | 12:07 |
| angus_salkeld | long time no see :-O | 12:07 |
| *** edmondsw has joined #heat | 12:09 | |
| *** skramaja has quit IRC | 12:11 | |
| *** skramaja has joined #heat | 12:13 | |
| *** angus_salkeld has quit IRC | 12:17 | |
| *** armaan has quit IRC | 12:18 | |
| *** armaan has joined #heat | 12:18 | |
| strigazi | Hello, how can I remove the deleted services from the db? I have a lot that are down | 12:20 |
| strigazi | found it https://github.com/openstack/heat/blob/master/heat/cmd/manage.py#L75 | 12:22 |
| *** jistr is now known as jistr|mtg | 12:36 | |
| *** serlex has quit IRC | 12:52 | |
| *** zaneb has joined #heat | 13:00 | |
| *** jistr|mtg is now known as jistr | 13:04 | |
| *** mchlumsky has joined #heat | 13:10 | |
| *** jmlowe has quit IRC | 13:15 | |
| *** flwang1 has quit IRC | 13:19 | |
| *** skramaja has quit IRC | 13:28 | |
| *** nicolasbock has joined #heat | 13:29 | |
| *** armaan has quit IRC | 13:31 | |
| *** armaan has joined #heat | 13:32 | |
| *** flwang1 has joined #heat | 13:36 | |
| *** flwang1 has quit IRC | 13:41 | |
| *** armaan has quit IRC | 13:52 | |
| *** armaan has joined #heat | 13:52 | |
| *** sshnaidm_ has joined #heat | 13:54 | |
| *** jmlowe has joined #heat | 13:55 | |
| *** sshnaidm has quit IRC | 13:57 | |
| *** hjensas has quit IRC | 14:05 | |
| *** hjensas has joined #heat | 14:06 | |
| *** hjensas has quit IRC | 14:06 | |
| *** hjensas has joined #heat | 14:06 | |
| *** felipemonteiro has joined #heat | 14:07 | |
| *** dopplergange has quit IRC | 14:07 | |
| *** felipemonteiro_ has joined #heat | 14:08 | |
| *** links has quit IRC | 14:09 | |
| *** nicolasbock has quit IRC | 14:11 | |
| *** felipemonteiro has quit IRC | 14:12 | |
| *** flwang1 has joined #heat | 14:21 | |
| *** serlex has joined #heat | 14:25 | |
| *** felipemonteiro_ has quit IRC | 14:31 | |
| *** hongbin has joined #heat | 14:42 | |
| *** ayoung has joined #heat | 14:45 | |
| *** sshnaidm_ has quit IRC | 15:06 | |
| *** nicolasbock has joined #heat | 15:09 | |
| *** flwang1 has quit IRC | 15:15 | |
| *** sshnaidm_ has joined #heat | 15:19 | |
| strigazi | Hello heat team, I send this email regarding the number of db connections: http://lists.openstack.org/pipermail/openstack-operators/2018-June/015447.html Can you have a look? | 15:21 |
| therve | strigazi: https://github.com/openstack/heat/blob/master/heat/engine/service.py#L374 I think | 15:22 |
| strigazi | therve: this is an issue only in heat? | 15:26 |
| therve | strigazi: I don't know | 15:27 |
| strigazi | therve: I should have, 1 thread executor per engine? | 15:27 |
| therve | 1 thread executor? | 15:28 |
| strigazi | therve: 1 thread per engine | 15:28 |
| therve | No you have a bunch of threads | 15:30 |
| therve | executor_thread_pool_size | 15:30 |
| *** armaan has quit IRC | 15:31 | |
| strigazi | I'm not sure if it is related, the issue is trying to fix is the queue limit? " QueuePool limit of size 5 overflow 10 reached" | 15:33 |
| therve | strigazi: I guess I don't know if max_overflow is respected in that situation | 15:35 |
| therve | as apparently you set it to 0 | 15:35 |
| strigazi | therve: even if it is not respected as 0, it will be overwritten with worker_pool_size, isn't this the number of api workers? (in my case 2) | 15:37 |
| therve | strigazi: No, executor_thread_pool_size | 15:37 |
| strigazi | therve: hmm, so 64 | 15:38 |
| *** felipemonteiro has joined #heat | 15:38 | |
| strigazi | therve: executor_thread_pool_size is per process? | 15:39 |
| therve | Yeah | 15:39 |
| *** flwang1 has joined #heat | 15:40 | |
| strigazi | so in my formula max_overflow becomes 64 and the end result 2752 | 15:41 |
| zaneb | max_overflow should be respected unless it is set to -1 https://docs.openstack.org/oslo.db/ocata/api/oslo_db.options.html | 15:48 |
| *** sshnaidm_ has quit IRC | 15:48 | |
| zaneb | also API workers don't connect to the DB, only engine workers | 15:48 |
| strigazi | zaneb: it is respected unless someone overrides it: https://github.com/openstack/heat/blob/stable/ocata/heat/engine/service.py#L419 | 15:49 |
| zaneb | ah right, so it will be at least the size of your thread pool | 15:52 |
| strigazi | yes | 15:52 |
| zaneb | because otherwise you start getting errors like https://bugs.launchpad.net/heat/+bug/1491185 because there are greenthreads that can't get a DB connection | 15:53 |
| openstack | Launchpad bug 1491185 in OpenStack Heat "convergence: QueuePool limit of size 5 overflow 10 reached" [Medium,Fix released] - Assigned to Anant Patil (ananta) | 15:53 |
| strigazi | What is a reasonable number of threads? | 15:54 |
| strigazi | I think I'll try 4, 4 engines with 4 threads | 15:55 |
| openstackgerrit | Zane Bitter proposed openstack/heat master: Import Zuul setting from project-config https://review.openstack.org/576193 | 16:00 |
| *** shardy has quit IRC | 16:03 | |
| *** hjensas has quit IRC | 16:05 | |
| *** nicolasbock has quit IRC | 16:08 | |
| *** AlexeyAbashkin has quit IRC | 16:11 | |
| *** sshnaidm_ has joined #heat | 16:16 | |
| strigazi | therve: zaneb Do you have any recommendation for the ratio between cores, engines and threads? | 16:18 |
| *** sshnaidm_ is now known as sshnaidm|afk | 16:20 | |
| *** nicolasbock has joined #heat | 16:20 | |
| zaneb | not really | 16:21 |
| zaneb | I mean, the defaults are our recommendation, in the sense that if we recommended something else, we'd have changed the defaults | 16:21 |
| zaneb | which is to say, we don't really know | 16:21 |
| strigazi | well, you need a safeguard for what the db accepts :) | 16:22 |
| zaneb | it's a tradeoff between number of DB connections and how long you want to wait | 16:22 |
| *** gfidente is now known as gfidente|afk | 16:22 | |
| zaneb | theoretically there's nothing you can't do with 1 greenthread per worker | 16:23 |
| *** nicolasbock has quit IRC | 16:24 | |
| zaneb | but you certainly won't be maxing out your CPU utilisation that way, since each thread spends most of its time sleeping | 16:24 |
| strigazi | I'll report tmr on performance, I have 4 vms, 8 cores, 16GB ram, 2 api, 2 api-cfn, 4 engine, 4 max_pool, 18 executor_thread_pool_size, 18 max_overflow | 16:24 |
| zaneb | (so you would be better off with fewer workers (saves RAM) but >1 greenthread) | 16:24 |
| *** nicolasbock has joined #heat | 16:24 | |
| zaneb | that sounds pretty reasonable | 16:25 |
| *** dopplergange has joined #heat | 16:25 | |
| strigazi | thanks, I'll test tmr | 16:26 |
| *** armaan has joined #heat | 16:36 | |
| *** ysandeep has quit IRC | 16:42 | |
| *** felipemonteiro_ has joined #heat | 16:43 | |
| *** felipemonteiro has quit IRC | 16:47 | |
| *** hjensas has joined #heat | 16:50 | |
| *** hjensas has joined #heat | 16:50 | |
| *** derekh has quit IRC | 17:01 | |
| *** d0ugal has quit IRC | 17:12 | |
| *** nicolasbock has quit IRC | 17:25 | |
| *** d0ugal has joined #heat | 17:26 | |
| *** armaan has quit IRC | 17:37 | |
| *** ndahiwade has joined #heat | 17:44 | |
| zaneb | ramishra: I had to rebase https://review.openstack.org/553639 but it should be a trivial re-review | 18:05 |
| *** armaan has joined #heat | 18:21 | |
| *** armaan has quit IRC | 18:23 | |
| openstackgerrit | Zane Bitter proposed openstack/heat-tempest-plugin master: Include file content in scenario tests https://review.openstack.org/533269 | 18:31 |
| openstackgerrit | Zane Bitter proposed openstack/heat-tempest-plugin master: Add test for remote nested stacks https://review.openstack.org/532635 | 18:31 |
| *** crose has joined #heat | 18:31 | |
| *** AlexeyAbashkin has joined #heat | 18:32 | |
| *** AlexeyAbashkin has quit IRC | 18:35 | |
| *** AlexeyAbashkin has joined #heat | 18:38 | |
| *** crose has quit IRC | 18:39 | |
| openstackgerrit | Zane Bitter proposed openstack/heat master: Improve error reporting for missing nested template https://review.openstack.org/537994 | 18:40 |
| *** AlexeyAbashkin has quit IRC | 18:45 | |
| *** sshnaidm|afk has quit IRC | 18:49 | |
| *** jmlowe has quit IRC | 18:50 | |
| *** armaan has joined #heat | 18:54 | |
| *** jmlowe has joined #heat | 19:11 | |
| *** ndahiwade has quit IRC | 19:23 | |
| *** sshnaidm|afk has joined #heat | 19:24 | |
| *** lifeless has joined #heat | 19:26 | |
| *** flwang1 has quit IRC | 19:33 | |
| *** edmondsw has quit IRC | 19:39 | |
| *** ndahiwade has joined #heat | 19:53 | |
| *** ndahiwade has quit IRC | 19:58 | |
| *** armaan has quit IRC | 20:02 | |
| *** armaan has joined #heat | 20:02 | |
| *** felipemonteiro_ has quit IRC | 20:08 | |
| *** felipemonteiro__ has joined #heat | 20:08 | |
| *** serlex has quit IRC | 20:25 | |
| *** ndahiwade has joined #heat | 20:38 | |
| *** armaan has quit IRC | 20:40 | |
| *** armaan has joined #heat | 20:41 | |
| openstackgerrit | Zane Bitter proposed openstack/heat master: Handle resource plugins without default_client_name https://review.openstack.org/537708 | 20:43 |
| openstackgerrit | Zane Bitter proposed openstack/heat master: Retry resource creation on conflict https://review.openstack.org/537709 | 20:43 |
| openstackgerrit | Zane Bitter proposed openstack/heat master: Ignore exceptions getting FloatingIP dependencies https://review.openstack.org/489276 | 20:47 |
| *** gfidente|afk has quit IRC | 20:58 | |
| *** flwang1 has joined #heat | 21:05 | |
| openstackgerrit | Zane Bitter proposed openstack/heat-tempest-plugin master: Include file content in scenario tests https://review.openstack.org/533269 | 21:18 |
| openstackgerrit | Zane Bitter proposed openstack/heat-tempest-plugin master: Add test for remote nested stacks https://review.openstack.org/532635 | 21:18 |
| openstackgerrit | Zane Bitter proposed openstack/heat-tempest-plugin master: Move Octavia tests to scenario tests https://review.openstack.org/576269 | 21:18 |
| *** lifeless has quit IRC | 21:21 | |
| *** lifeless has joined #heat | 21:22 | |
| *** armaan has quit IRC | 21:27 | |
| *** armaan has joined #heat | 21:28 | |
| *** EmilienM is now known as EmilienM_PTO | 21:45 | |
| *** ndahiwade has quit IRC | 21:47 | |
| *** ndahiwade has joined #heat | 21:47 | |
| *** jmlowe has quit IRC | 21:56 | |
| *** jmlowe has joined #heat | 22:00 | |
| *** felipemonteiro_ has joined #heat | 22:01 | |
| *** felipemonteiro__ has quit IRC | 22:05 | |
| *** jmlowe has quit IRC | 22:17 | |
| *** felipemonteiro_ has quit IRC | 22:25 | |
| *** jmlowe has joined #heat | 22:30 | |
| *** lifeless_ has joined #heat | 22:32 | |
| *** lifeless has quit IRC | 22:32 | |
| *** rcernin has joined #heat | 22:36 | |
| *** hongbin has quit IRC | 22:40 | |
| *** boris_42_ has joined #heat | 22:54 | |
| *** lifeless_ has quit IRC | 23:05 | |
| *** lifeless has joined #heat | 23:06 | |
| *** lifeless has quit IRC | 23:43 | |
| *** lifeless has joined #heat | 23:46 | |
| *** ndahiwade has quit IRC | 23:53 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!