| *** ricolin has joined #heat | 00:05 | |
| *** lnxnut has quit IRC | 00:07 | |
| *** GonZo2000 has joined #heat | 00:25 | |
| *** GonZo2000 has quit IRC | 00:25 | |
| *** GonZo2000 has joined #heat | 00:25 | |
| *** hieulq has joined #heat | 00:41 | |
| *** kiennt26 has joined #heat | 00:50 | |
| *** hoolio has quit IRC | 01:12 | |
| *** hoolio has joined #heat | 01:15 | |
| *** lnxnut has joined #heat | 01:34 | |
| *** lnxnut has quit IRC | 02:01 | |
| *** GonZo2000 has quit IRC | 02:43 | |
| *** nicolasbock_ has quit IRC | 03:16 | |
| *** lnxnut has joined #heat | 03:28 | |
| *** links has joined #heat | 03:48 | |
| *** lnxnut has quit IRC | 03:55 | |
| *** gouthamr has joined #heat | 03:55 | |
| *** gouthamr has quit IRC | 04:30 | |
| *** logan- has quit IRC | 05:18 | |
| *** logan- has joined #heat | 05:21 | |
| *** lnxnut has joined #heat | 05:22 | |
| *** kiennt26 has quit IRC | 05:26 | |
| *** livelace has joined #heat | 05:36 | |
| *** mdnadeem has joined #heat | 05:40 | |
| *** logan- has quit IRC | 05:48 | |
| *** lnxnut has quit IRC | 05:50 | |
| *** logan- has joined #heat | 05:53 | |
| *** ivve has quit IRC | 06:05 | |
| *** serlex has joined #heat | 06:14 | |
| *** jtomasek has joined #heat | 06:24 | |
| *** ivve has joined #heat | 06:29 | |
| *** shardy has joined #heat | 06:37 | |
| *** rcernin has joined #heat | 07:04 | |
| *** livelace-link has joined #heat | 07:10 | |
| *** jprovazn has joined #heat | 07:14 | |
| *** lnxnut has joined #heat | 07:17 | |
| *** jprovazn has quit IRC | 07:19 | |
| *** lnxnut has quit IRC | 07:44 | |
| *** hjensas has joined #heat | 07:45 | |
| *** kiennt26 has joined #heat | 07:52 | |
| *** kiennt26 has quit IRC | 07:56 | |
| *** jprovazn has joined #heat | 08:01 | |
| *** kiennt26 has joined #heat | 08:02 | |
| *** gfidente has joined #heat | 08:07 | |
| *** gfidente has joined #heat | 08:07 | |
| *** lnxnut has joined #heat | 08:11 | |
| *** lnxnut has quit IRC | 08:15 | |
| *** namnh has joined #heat | 08:16 | |
| *** cmyster has joined #heat | 08:29 | |
| *** derekh has joined #heat | 08:30 | |
| *** gkadam has joined #heat | 08:33 | |
| *** mdavidson has joined #heat | 08:37 | |
| *** ioggstream has joined #heat | 08:56 | |
| *** armaan has joined #heat | 08:58 | |
| armaan | folks, I see this warning in logs after stack creation/deletion time out. https://github.com/openstack/heat/blob/stable/newton/heat/engine/stack.py#L914 | 09:02 |
|---|---|---|
| armaan | Do you think I should increase heat api/engine workers? | 09:02 |
| ricolin | armaan, I don't think to increase workers will do any help on this case. Any figure out what cause timeout?:) | 09:07 |
| armaan | ricolin: stack deletion also runs in to timeout, not sure -- from where to begin the investigation? | 09:08 |
| ricolin | Any error or exception in log? or in `openstack stack event`? | 09:10 |
| *** lnxnut has joined #heat | 09:13 | |
| armaan | ricolin: no error or exception in log | 09:20 |
| *** kei-ichi has quit IRC | 09:20 | |
| *** dbecker has joined #heat | 09:21 | |
| armaan | ricolin: openstack stack event http://paste.openstack.org/show/622452/ | 09:21 |
| *** kei-ichi has joined #heat | 09:21 | |
| ricolin | Any resource stuck in in progress or failed? | 09:23 |
| armaan | ricolin: http://paste.openstack.org/show/622453/ | 09:27 |
| *** yangyapeng has quit IRC | 09:29 | |
| *** yangyapeng has joined #heat | 09:29 | |
| *** yangyapeng has quit IRC | 09:34 | |
| armaan | ricolin: Do you think increasing the rpc timeouts might help here? | 09:35 |
| ricolin | maybe something wrong with database during initial the stack, know anyway to reproduce it? | 09:36 |
| ricolin | for rpc time, depends on what loading you have with your rpc, but to increasing rpc timeouts (unless you pre set the timeout time to very limited number) don't think that can help big | 09:38 |
| ricolin | still, you can try it | 09:38 |
| armaan | ricolin: yes, i can reproduce it by simply trying to create/delete another stack | 09:38 |
| *** lnxnut has quit IRC | 09:39 | |
| *** Roedy has quit IRC | 09:41 | |
| *** mdnadeem has quit IRC | 09:41 | |
| ricolin | There must be something wrong with your environment from setting the stack to inprogress to resource request(through rpc) during create stack. | 09:44 |
| *** mdnadeem has joined #heat | 09:44 | |
| ricolin | running on branch Master? | 09:44 |
| armaan | ricolin: Newton. I already have like 30 stacks in SUSPEND state and they resume just fine. It is only from few days we are seeing occasional delete failures and today we started seeing create failures. | 09:46 |
| *** mdnadeem is now known as mdnadeem|afk | 09:49 | |
| ricolin | Maybe investigate on logs for heat engine services see if anything there during create stack | 09:50 |
| ricolin | BTW you can use like `OpenStack stack abandon` to remove those stack we grenerate out for test | 09:51 |
| *** kiennt26 has quit IRC | 09:51 | |
| armaan | ricolin: but if we do that then we will have remove the stack resources manually, correct? | 09:51 |
| ricolin | normally yes, but in your case, all resource stuck in init complete. So I don't think any of those resource actually exists | 09:52 |
| *** mdnadeem|afk is now known as mdnadeem | 09:58 | |
| *** lnxnut has joined #heat | 10:07 | |
| *** Roedy has joined #heat | 10:09 | |
| *** lnxnut has quit IRC | 10:11 | |
| *** Roedy has quit IRC | 10:18 | |
| *** namnh has quit IRC | 10:23 | |
| armaan | ricolin: Ok, i am going to start investigation with Neutron, whether heat engine requests for network related resources timed out. | 10:25 |
| *** pbourke has quit IRC | 10:50 | |
| *** pbourke has joined #heat | 10:52 | |
| *** cmyster has quit IRC | 10:59 | |
| *** nicolasbock_ has joined #heat | 11:01 | |
| *** cmyster has joined #heat | 11:01 | |
| *** cmyster has joined #heat | 11:01 | |
| *** ioggstream has quit IRC | 11:02 | |
| *** lnxnut has joined #heat | 11:08 | |
| *** nicolasbock_ has quit IRC | 11:10 | |
| *** livelace has quit IRC | 11:18 | |
| *** nicolasbock_ has joined #heat | 11:23 | |
| *** ricolin has quit IRC | 11:27 | |
| *** livelace has joined #heat | 11:34 | |
| *** lnxnut has quit IRC | 11:36 | |
| *** dprince has joined #heat | 11:59 | |
| *** lnxnut has joined #heat | 12:03 | |
| *** catintheroof has joined #heat | 12:06 | |
| *** catinthe_ has joined #heat | 12:07 | |
| *** catintheroof has quit IRC | 12:08 | |
| *** pradk has joined #heat | 12:10 | |
| *** lnxnut has quit IRC | 12:21 | |
| *** dyasny has joined #heat | 12:28 | |
| *** pradk has quit IRC | 12:30 | |
| *** jcoufal has joined #heat | 12:56 | |
| *** links has quit IRC | 12:59 | |
| *** jmlowe has joined #heat | 13:04 | |
| *** lnxnut has joined #heat | 13:19 | |
| *** jcoufal_ has joined #heat | 13:22 | |
| *** blomquisg_gone is now known as blomquisg | 13:22 | |
| *** jcoufal has quit IRC | 13:24 | |
| *** jcoufal has joined #heat | 13:32 | |
| *** jcoufal_ has quit IRC | 13:33 | |
| *** lnxnut has quit IRC | 13:45 | |
| *** pradk has joined #heat | 13:51 | |
| *** bnemec has joined #heat | 13:53 | |
| *** hongbin has joined #heat | 14:08 | |
| *** armaan has quit IRC | 14:09 | |
| *** armaan has joined #heat | 14:09 | |
| *** ricolin has joined #heat | 14:10 | |
| *** kiennt26 has joined #heat | 14:19 | |
| *** armaan has quit IRC | 14:48 | |
| *** armaan has joined #heat | 14:48 | |
| *** ccamacho has quit IRC | 15:06 | |
| *** lnxnut has joined #heat | 15:13 | |
| *** ricolin has quit IRC | 15:23 | |
| *** ricolin has joined #heat | 15:24 | |
| *** lnxnut has quit IRC | 15:32 | |
| *** ioggstream has joined #heat | 15:32 | |
| *** crose has joined #heat | 15:34 | |
| *** ricolin has quit IRC | 15:35 | |
| *** kiennt26 has quit IRC | 15:36 | |
| *** rcernin has quit IRC | 15:41 | |
| *** armaan has quit IRC | 15:42 | |
| *** armaan has joined #heat | 15:43 | |
| *** jistr is now known as jistr|off|mtg | 15:48 | |
| *** jistr|off|mtg is now known as jistr | 15:49 | |
| *** gouthamr has joined #heat | 15:54 | |
| *** jmlowe has quit IRC | 16:00 | |
| *** chlong has joined #heat | 16:06 | |
| *** armaan has quit IRC | 16:10 | |
| *** ioggstream has quit IRC | 16:29 | |
| *** lnxnut has joined #heat | 16:30 | |
| *** jtomasek has quit IRC | 16:32 | |
| *** lnxnut has quit IRC | 16:43 | |
| *** chlong has quit IRC | 16:58 | |
| *** derekh has quit IRC | 16:59 | |
| *** crose has quit IRC | 17:00 | |
| *** gkadam has quit IRC | 17:01 | |
| *** mdnadeem has quit IRC | 17:02 | |
| *** armaan has joined #heat | 17:08 | |
| *** dyasny_ has joined #heat | 17:09 | |
| *** jmlowe has joined #heat | 17:09 | |
| *** harlowja has joined #heat | 17:10 | |
| *** dyasny has quit IRC | 17:11 | |
| *** chlong has joined #heat | 17:15 | |
| *** gouthamr has quit IRC | 17:21 | |
| *** chlong has quit IRC | 17:30 | |
| *** chlong has joined #heat | 17:31 | |
| *** lnxnut has joined #heat | 17:40 | |
| *** shardy has quit IRC | 17:52 | |
| *** lnxnut has quit IRC | 17:55 | |
| *** gouthamr has joined #heat | 17:57 | |
| *** jmlowe has quit IRC | 17:58 | |
| *** jmlowe has joined #heat | 17:59 | |
| *** bnemec has quit IRC | 18:04 | |
| *** jmlowe has quit IRC | 18:09 | |
| *** jmlowe has joined #heat | 18:10 | |
| *** jmlowe has quit IRC | 18:17 | |
| *** jmlowe has joined #heat | 18:21 | |
| *** jmlowe has quit IRC | 18:39 | |
| *** gfidente has quit IRC | 18:39 | |
| *** jmlowe has joined #heat | 18:39 | |
| *** chlong has quit IRC | 18:45 | |
| *** chlong has joined #heat | 18:47 | |
| *** gfidente has joined #heat | 18:51 | |
| *** gfidente has joined #heat | 18:51 | |
| *** lnxnut has joined #heat | 18:52 | |
| *** rcernin has joined #heat | 18:54 | |
| *** lnxnut has quit IRC | 19:05 | |
| *** chlong_ has joined #heat | 19:09 | |
| *** jmlowe has quit IRC | 19:15 | |
| *** jmlowe has joined #heat | 19:22 | |
| *** jmlowe has quit IRC | 19:27 | |
| *** jmlowe has joined #heat | 19:34 | |
| *** catinthe_ has quit IRC | 19:47 | |
| *** catintheroof has joined #heat | 19:48 | |
| *** jmlowe has quit IRC | 19:51 | |
| *** jmlowe has joined #heat | 19:53 | |
| *** lnxnut has joined #heat | 20:03 | |
| *** jprovazn has quit IRC | 20:05 | |
| *** gouthamr has quit IRC | 20:06 | |
| *** dprince has quit IRC | 20:18 | |
| *** lnxnut has quit IRC | 20:21 | |
| *** gouthamr has joined #heat | 20:25 | |
| *** ccamacho has joined #heat | 20:27 | |
| *** bnemec has joined #heat | 20:37 | |
| *** gfidente has quit IRC | 20:52 | |
| *** jmlowe has quit IRC | 21:00 | |
| *** serlex has quit IRC | 21:08 | |
| *** ccamacho has quit IRC | 21:14 | |
| *** catintheroof has quit IRC | 21:14 | |
| *** lnxnut has joined #heat | 21:19 | |
| *** chlong_ has quit IRC | 21:20 | |
| *** chlong has quit IRC | 21:20 | |
| *** lnxnut has quit IRC | 21:31 | |
| *** flwang1 has joined #heat | 21:36 | |
| *** jcoufal has quit IRC | 21:37 | |
| *** askb has joined #heat | 21:44 | |
| *** blomquisg is now known as blomquisg_gone | 21:44 | |
| *** yassine has quit IRC | 21:54 | |
| *** yassine has joined #heat | 21:57 | |
| *** rcernin has quit IRC | 22:02 | |
| *** pradk has quit IRC | 22:07 | |
| *** armaan_ has joined #heat | 22:26 | |
| *** armaan_ has quit IRC | 22:27 | |
| *** lnxnut has joined #heat | 22:28 | |
| *** armaan has quit IRC | 22:29 | |
| *** gouthamr has quit IRC | 22:38 | |
| *** lnxnut has quit IRC | 22:38 | |
| *** nicolasbock_ has quit IRC | 22:45 | |
| *** jmlowe has joined #heat | 23:10 | |
| *** jmlowe has quit IRC | 23:20 | |
| *** hongbin has quit IRC | 23:30 | |
| *** jmlowe has joined #heat | 23:31 | |
| *** jmlowe has quit IRC | 23:34 | |
| *** lnxnut has joined #heat | 23:36 | |
| *** jmlowe has joined #heat | 23:41 | |
| *** lnxnut has quit IRC | 23:45 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!