Monday, 2017-09-04

*** yangyapeng has joined #heat00:00
*** yangyapeng has quit IRC00:04
*** dyasny has quit IRC00:07
*** EricGonczer_ has joined #heat00:27
*** dyasny has joined #heat00:50
*** dyasny has quit IRC00:50
*** yangyapeng has joined #heat01:01
*** dixiaoli has joined #heat01:11
*** kei1 has quit IRC01:46
*** kei1 has joined #heat01:47
*** yangyapeng has quit IRC01:58
*** yangyapeng has joined #heat01:59
*** yangyape_ has joined #heat02:02
*** yangyapeng has quit IRC02:06
*** liusheng has quit IRC02:12
*** liusheng has joined #heat02:12
*** yangyapeng has joined #heat02:12
*** Shunli has joined #heat02:13
*** yangyape_ has quit IRC02:15
*** ricolin_ has joined #heat02:40
*** EricGonczer_ has quit IRC02:41
*** kbaegis has joined #heat02:58
*** GonZo2000 has quit IRC03:00
*** ramishra has joined #heat03:01
*** zhurong_ has joined #heat03:23
*** zhurong_ has quit IRC03:25
*** flg_ has joined #heat03:27
*** ricolin_ has quit IRC03:31
*** ricolin has joined #heat03:32
*** flg_ has quit IRC03:32
*** nicolasbock has quit IRC03:41
openstackgerritJeremy Liu proposed openstack/heat master: Add missing 'of' in order description  https://review.openstack.org/45443103:47
*** gkadam has joined #heat03:48
*** kbaegis has quit IRC03:53
*** kbaegis has joined #heat03:54
*** skramaja has joined #heat04:06
*** wangbo has joined #heat04:08
*** links has joined #heat04:19
*** wangbo has quit IRC04:25
*** shan has joined #heat05:03
*** wangbo has joined #heat05:17
*** hjensas has quit IRC05:45
*** kbaegis has quit IRC05:48
*** kbaegis has joined #heat05:48
*** hoonetorg has quit IRC06:05
*** ccamacho has joined #heat06:08
*** kbaegis1 has joined #heat06:17
*** kbaegis has quit IRC06:17
*** serlex has joined #heat06:18
*** hoonetorg has joined #heat06:19
*** jprovazn has joined #heat06:34
*** yangyapeng has quit IRC06:39
*** yangyapeng has joined #heat06:47
*** rcernin has quit IRC06:52
*** rcernin has joined #heat06:52
*** ccard_ has joined #heat06:58
*** hjensas has joined #heat06:58
*** LanceHaig has joined #heat07:12
*** jtomasek has joined #heat07:23
*** rcernin has quit IRC07:41
*** ioggstream has joined #heat07:44
*** shadower has joined #heat07:44
*** LanceHaig has quit IRC07:49
*** shardy has joined #heat07:50
*** LanceHaig has joined #heat07:54
*** LanceHaig has quit IRC07:54
*** LanceHaig has joined #heat07:54
*** flg_ has joined #heat07:59
*** LanceHaig has quit IRC08:01
*** dbecker has joined #heat08:04
*** shan is now known as shan|brb08:08
*** LanceHaig has joined #heat08:10
*** LanceHaig has quit IRC08:10
*** LanceHaig has joined #heat08:10
*** serlex has quit IRC08:12
*** LanceHaig has quit IRC08:16
*** LanceHaig_ has joined #heat08:16
ioggstreamhi@all08:20
*** derekh has joined #heat08:26
*** shadower has quit IRC08:29
*** shadower has joined #heat08:30
*** shadower has quit IRC08:32
*** shadower has joined #heat08:32
*** shan|brb is now known as shan08:34
*** gmoro has joined #heat08:44
*** LanceHaig has joined #heat08:48
*** LanceHaig_ has quit IRC08:50
*** serlex has joined #heat08:50
*** nicolasbock has joined #heat08:55
*** LanceHaig_ has joined #heat09:00
*** LanceHaig has quit IRC09:03
*** LanceHaig has joined #heat09:09
*** LanceHaig_ has quit IRC09:09
*** phuoc_ has joined #heat09:10
*** cmyster has quit IRC09:21
ioggstreamI'm trying to replace OS::Heat::WaitConditionHandle with UpdateWaitConditionHandle in here https://github.com/redhat-openstack/openshift-on-openstack/blob/master/node.yaml#L76809:28
*** Shunli has quit IRC09:28
ioggstreambut despite the https://docs.openstack.org/heat/latest/template_guide/openstack.html#OS::Heat::UpdateWaitConditionHandle it's not identical to  WaitConditionHandle, as it has not the same attributes and iiuc it inherits by aws_wch.WaitConditionHandle https://github.com/openstack/heat/blob/master/heat/engine/resources/openstack/heat/wait_condition_handle.py#L22209:31
*** LanceHaig has quit IRC09:34
*** LanceHaig_ has joined #heat09:34
ioggstreamiiuc  I have to call that url with cfn-signal09:35
*** dixiaoli has quit IRC09:38
*** flg_ has quit IRC09:38
*** nicolasbock has quit IRC09:39
ioggstreamin that case, dropping a line in the doc would be very nice :D09:41
*** LanceHaig has joined #heat09:45
*** LanceHaig has quit IRC09:45
*** LanceHaig has joined #heat09:45
*** LanceHaig_ has quit IRC09:45
*** LanceHaig has quit IRC09:53
*** LanceHaig has joined #heat09:53
*** LanceHaig has joined #heat09:53
*** yassine has quit IRC10:03
*** wangbo has quit IRC10:07
openstackgerritMerged openstack/heat master: Add missing 'of' in order description  https://review.openstack.org/45443110:17
*** yassine has joined #heat10:25
*** flg_ has joined #heat10:29
*** shan has quit IRC10:37
*** ygl has joined #heat10:40
yglhi all10:40
yglI am facing an issue in deletion of my heat stack10:41
yglit says ERROR heat.engine.resource ConnectionFailed: Connection to neutron fail10:41
yglbut my neutron is functioning well10:41
yglcan someone help me please10:42
yglConnectionFailed: Connection to neutron failed: None: Max retries exceeded with url: /v2.0/extensions.json (Caused by None)10:43
*** yangyapeng has quit IRC10:44
*** yangyapeng has joined #heat10:45
yglcan someone help me please10:46
ioggstreamygl: grep -i crit /var/log/*/*.log # on all controller10:46
ioggstreamygl: grep -i err /var/log/*/*.log # on all controller10:47
ioggstreamyou may want to filter by the timestamp of the error10:47
yglioggstream: 2017-09-04 10:16:38.881 115982 CRITICAL neutron [req-a2bc06a6-dc29-4b1c-8e2f-bf98e6ffc268 - - - - -] RuntimeError: Exit code: -15; Stdin: ; Stdout: ; Stderr: Signal 15 (TERM) caught by ps (procps-ng version 3.3.10).10:48
yglioggstream: but my neutron services are running well10:48
ioggstreamygl: investigate more on logs.10:49
ioggstreamygl: you may have temporary error10:49
ioggstreamygl: a sigterm is strange enough imho10:49
ioggstreamso investigate on *all logs* (messages, dmesg, audit) around the sigterm10:50
*** yangyapeng has quit IRC10:50
ioggstreamto check if it's related10:50
yglioggstream: it is only happening when I try deleting a stack10:50
ioggstreamygl: yes but it's unusual10:50
ioggstreamgrep -i error ....10:51
yglioggstream: how to reset this warning and make heat go ahead with deletion10:51
ioggstreamygl: reissue stack delete10:51
ioggstreamand eventually use stack resource signal if there are resources requesting singals10:52
ioggstreamo stack resource list --nested-depth 20 stack-name | grep -v COMPLETE  # try this10:52
yglioggstream: how to check that signal thing ?10:53
ioggstreamygl: if you have resources waiting for signal (if you have, you should know because you wrote the templates - eg. os::heat::waitconditionhandle)10:54
yglioggstream: i see this error when executing the above command10:54
yglioggstream: ERROR: HEAT-E99001 Service neutron is not available for resource type OS::Neutron::SecurityGroup, reason: Connection to neutron failed: None: Max retries exceeded with url: /v2.0/extensions.json (Caused by None)10:54
ioggstreamygl: I don't cover this10:55
ioggstreamygl: that "None" stuff seems a bug to me10:55
ioggstreamwhich osp version?10:56
ioggstreamopenstack10:56
yglioggstream: mitaka10:56
ioggstreamversion10:56
ioggstreamredhat?10:56
yglnope10:56
yglmitaka on ubuntu10:56
ioggstreamcan't help. I'd check if all controllers are correctly working10:57
ioggstreamor grep the error in the source10:57
yglioggstream: i have only one conttroller and it is working fine. I have restarted all heat servcies10:57
yglioggstream: i am observing issues only when deleting the heat stacks10:58
*** wangbo has joined #heat10:58
yglcan anyone help me please10:58
ioggstreamcan you create single securitygroup outside your template?10:59
ioggstreamygl iptables ok, right?11:00
yglioggstream: yes11:01
ioggstreamanyway, check if you can reproduce the issue with a single heat template with a single securitygroup resource11:02
ioggstreamand if you can create other neutron resources eg. a network11:02
ioggstreamif the issue is only with secgroup or with all neutron components11:02
yglioggstream: whenever i try to create a heat template it is showing this error11:04
yglioggstream: ERROR: HEAT-E99001 Service neutron is not available for resource type OS::Neutron::SecurityGroup, reason: Connection to neutron failed: None: Max retries exceeded with url: /v2.0/extensions.json (Caused by None)11:05
ioggstreamygl: I'd check sources too11:06
yglioggstream: means ?11:06
ioggstreamheat source files11:06
ioggstreamyou should get a backtrace11:07
ioggstreamwith python sources where the error happened11:07
*** links has quit IRC11:07
ioggstreampaste your heat template pls11:07
yglioggstream: the stack was successfully launched and was running well. There were some too many connection issues with mysql and then when I tried to delete the stack it is showing this error11:10
*** shardy is now known as shardy_lunch11:10
yglioggstream: i dont think it has something to do with template11:10
ioggstreamygl: how's your mysql now?11:11
ioggstreamconnections and processes?11:11
ioggstreamthis could be related to the TERM stuff11:12
yglioggstream: it is fine and I am able to create neutron networks and delete them successfully11:12
ioggstreamcan you do it via heat?11:12
yglioggstream: the problem is with the heat itself. it is unable to make connections to neutron11:12
yglioggstream: no11:12
ioggstreamyou can't create networks via heat11:12
yglioggstream: no11:12
yglit is throwing the error11:13
ioggstreamdo you have free connections on mysql?11:13
yglioggstream: yes11:13
ioggstreamhaproxy11:13
ioggstream?11:13
yglioggstream: yes11:13
ioggstreamcan you use heat in another tenant?11:14
yglioggstream: all the tenants r facing the same problem11:14
yglioggstream: can we reset the heat connections to neutron through any method11:15
yglioggstream: other than service restarts11:15
ioggstreamafaik heat doesn't hold persistent connections to any service11:15
yglioggstream: service restarts are also not heping much11:15
yglioggstream: hmm11:15
ioggstreamyou could instead check if you mess something in mysql so that heat is not referencing the right resource11:16
ioggstreamor if it cannot authenticate correctly to neutron11:16
ioggstream(eg. it tries to connect, but mysql responds slowly and heat doesn't see replies)11:17
ioggstreamI usually get all those infos reading all logs in a given timeframe11:17
ioggstreamand compare them all11:17
ioggstreameventually increasing verbosity and checking sources11:18
ioggstreambut I'm not that into heat for guessworking that ;)11:18
*** links has joined #heat11:21
yglcan some one help me please11:22
ioggstreamygl: lunch... post logs on pastebin and I'll try to check them11:26
ioggstreamremove secret stuff ;)11:26
yglioggstream: which logs in particular11:27
*** pbourke has quit IRC11:29
ramishraygl: I would  heck if the  'security-group' neutron extension is available 'neutron ext-list | grep security-group'11:30
*** pbourke has joined #heat11:31
yglramishra: its there11:31
ramishraygl: possibly something wronmg with your neutron setup, from the error it looks like heat is getting an error when checking for extensions, I would check neutron logs to see what's logged there11:40
openstackgerritHarald JensÃ¥s proposed openstack/heat master: Exclude updated networks - match actual interface state  https://review.openstack.org/47196911:40
*** links has quit IRC11:42
*** catintheroof has joined #heat11:43
*** shardy_lunch is now known as shardy11:44
*** serlex has quit IRC11:47
*** links has joined #heat11:57
*** gkadam has quit IRC12:02
*** ygl has quit IRC12:11
*** serlex has joined #heat12:16
*** dr_gogeta86 has quit IRC12:26
*** skramaja has quit IRC12:35
*** yangyapeng has joined #heat12:37
*** dr_gogeta86 has joined #heat12:41
*** dr_gogeta86 has quit IRC12:41
*** dr_gogeta86 has joined #heat12:41
*** yangyapeng has quit IRC12:42
*** yangyapeng has joined #heat12:42
*** EricGonczer_ has joined #heat12:43
*** EricGonczer_ has quit IRC12:44
*** nicolasbock has joined #heat13:10
*** hjensas has quit IRC13:46
*** kbaegis1 has quit IRC13:49
*** kbaegis has joined #heat13:50
*** wangbo has quit IRC14:07
*** dbellant has joined #heat14:13
*** ccamacho has quit IRC14:36
*** ccamacho has joined #heat14:37
*** links has quit IRC14:40
*** nicolasbock has quit IRC15:00
*** EricGonczer_ has joined #heat15:01
*** flg_ has quit IRC15:22
*** dbecker_ has joined #heat15:30
*** dbecker has quit IRC15:34
*** gkadam has joined #heat15:35
*** ccamacho has quit IRC15:38
*** dbellant has quit IRC15:40
*** yassine has quit IRC15:46
*** hongbin has joined #heat15:48
*** yassine has joined #heat15:55
*** catintheroof has quit IRC16:05
*** catintheroof has joined #heat16:06
*** catintheroof has quit IRC16:06
*** yangyapeng has quit IRC16:09
*** yangyapeng has joined #heat16:09
*** yangyapeng has quit IRC16:13
*** kbaegis has quit IRC16:29
*** kbaegis has joined #heat16:29
*** kbaegis1 has joined #heat16:35
*** kbaegis has quit IRC16:38
*** gkadam has quit IRC16:50
*** gkadam has joined #heat16:51
*** ricolin has quit IRC16:57
*** serlex has quit IRC16:57
*** derekh has quit IRC16:57
*** gkadam has quit IRC17:07
*** catintheroof has joined #heat17:07
*** flg_ has joined #heat17:31
*** LanceHaig has quit IRC17:33
*** EricGonczer_ has quit IRC17:34
*** ramishra has quit IRC17:38
*** EricGonczer_ has joined #heat17:56
*** rcernin has joined #heat17:57
*** EricGonczer_ has quit IRC18:11
*** armaan has joined #heat18:13
*** armaan_ has joined #heat18:16
*** yangyapeng has joined #heat18:17
*** armaan has quit IRC18:17
*** armaan__ has joined #heat18:18
*** ioggstream has quit IRC18:19
*** yangyapeng has quit IRC18:21
*** armaan_ has quit IRC18:22
*** hongbin has quit IRC18:25
*** simondodsley_ has joined #heat18:30
*** higgins` has joined #heat18:30
*** htruta` has joined #heat18:36
*** higgins has quit IRC18:37
*** htruta has quit IRC18:37
*** simondodsley has quit IRC18:37
*** simondodsley_ is now known as simondodsley18:37
*** armaan__ has quit IRC18:39
*** armaan has joined #heat18:39
*** shadower has quit IRC18:42
*** shadower has joined #heat18:42
*** jprovazn has quit IRC18:55
*** shardy has quit IRC19:18
*** catintheroof has quit IRC19:26
*** flg_ has quit IRC19:26
*** EricGonczer_ has joined #heat19:29
*** armaan has quit IRC19:30
*** catintheroof has joined #heat19:30
*** dbecker_ has quit IRC19:37
*** ioggstream has joined #heat19:45
*** yangyapeng has joined #heat20:04
*** yangyapeng has quit IRC20:11
*** jose-phillips has quit IRC20:22
*** kbaegis1 has quit IRC20:26
*** kbaegis has joined #heat20:27
*** rcernin has quit IRC20:45
*** catintheroof has quit IRC20:46
*** hongbin has joined #heat20:59
*** ioggstream has quit IRC21:14
*** yangyapeng has joined #heat21:15
*** yangyapeng has quit IRC21:20
*** jtomasek has quit IRC21:44
*** yangyapeng has joined #heat22:03
*** yangyapeng has quit IRC22:08
*** EricGonczer_ has quit IRC22:37
*** rwsu has joined #heat22:59
*** hongbin has quit IRC23:44
*** EricGonczer_ has joined #heat23:49

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!