Wednesday, 2014-03-26

*** kgriffs is now known as kgriffs_afk00:00
*** blomquisg has joined #heat00:02
*** Trozz has joined #heat00:03
*** duncanjw has quit IRC00:03
*** pvaneck has quit IRC00:05
*** DaveJ__ has quit IRC00:17
*** mestery has quit IRC00:23
openstackgerritA change was merged to openstack/heat: Change router's prop name agent_id to l3_agent_id  https://review.openstack.org/8271600:25
*** matsuhashi has joined #heat00:27
*** alexheneveld has quit IRC00:32
*** duncanjw has joined #heat00:33
*** blomquisg has quit IRC00:38
*** lindsayk has quit IRC00:41
*** gokrokve has joined #heat00:42
*** alexheneveld has joined #heat00:43
*** kfox1111 has quit IRC00:44
*** blomquisg has joined #heat00:51
*** duncanjw has quit IRC01:03
openstackgerritA change was merged to openstack/heat: Make OS::Nova::Server networks property updatable  https://review.openstack.org/7429901:05
*** aweiteka has joined #heat01:06
*** matsuhashi has quit IRC01:12
*** matsuhashi has joined #heat01:14
*** sdake_ has quit IRC01:15
*** sdake has quit IRC01:16
*** networkn8 has quit IRC01:16
*** nosnos has joined #heat01:27
*** ramishra has joined #heat01:30
*** sdake has joined #heat01:35
*** sdake_ has joined #heat01:35
*** Linz has quit IRC01:37
*** duncanjw has joined #heat01:44
*** blomquisg has quit IRC01:45
*** alexpilotti has quit IRC01:47
*** zaneb has quit IRC01:48
*** zaneb has joined #heat01:49
*** mkollaro has quit IRC01:51
*** matsuhashi has quit IRC02:00
*** julienvey has joined #heat02:04
*** matsuhashi has joined #heat02:08
*** duncanjw has quit IRC02:20
*** alexheneveld has quit IRC02:25
*** harlowja is now known as harlowja_away02:27
*** alexheneveld has joined #heat02:27
*** DandyPandy_ has quit IRC02:27
*** aweiteka has quit IRC02:30
*** saurabhs1 has quit IRC02:32
*** DandyPandy has joined #heat02:33
*** fandi has quit IRC02:34
*** lazy_prince has quit IRC02:39
*** killer_prince has joined #heat02:39
*** nati_ueno has quit IRC02:42
*** julienvey has quit IRC02:45
*** ramishra has quit IRC02:45
*** ramishra has joined #heat02:45
*** ramishra has quit IRC02:50
*** alexheneveld has quit IRC02:53
*** ramishra has joined #heat02:54
*** alexheneveld has joined #heat02:55
*** alexheneveld_ has joined #heat02:57
*** alexheneveld has quit IRC02:59
*** alexheneveld_ is now known as alexheneveld02:59
openstackgerritRabi Mishra proposed a change to openstack/heat: Provides ability to reference existing neutron resources  https://review.openstack.org/8285303:01
*** ramishra has quit IRC03:02
*** ramishra has joined #heat03:02
*** ramishra has quit IRC03:07
*** zns has quit IRC03:12
*** qinjin has joined #heat03:13
*** matsuhashi has quit IRC03:15
*** nosnos has quit IRC03:28
*** samstav has quit IRC03:34
*** gokrokve has quit IRC03:37
*** gokrokve_ has joined #heat03:38
*** gokrokve_ has quit IRC03:42
*** wchrisj has quit IRC03:43
*** sgordon has joined #heat03:44
*** ramishra has joined #heat03:46
*** blamar has quit IRC03:46
*** mestery has joined #heat03:51
*** killer_prince is now known as lazy_prince03:53
*** blamar has joined #heat03:56
*** blamar has quit IRC03:57
*** tango has joined #heat03:58
*** blamar has joined #heat03:58
*** nati_ueno has joined #heat04:02
*** gokrokve has joined #heat04:07
*** blamar has quit IRC04:10
*** gokrokve has quit IRC04:13
*** nkhare has joined #heat04:14
*** david-lyle has joined #heat04:16
*** sgordon has quit IRC04:20
*** duncanjw has joined #heat04:21
*** pablosan has quit IRC04:22
*** pablosan has joined #heat04:22
*** matsuhashi has joined #heat04:25
*** mestery has quit IRC04:25
*** duncanjw has quit IRC04:25
*** cmyster has joined #heat04:26
cmystermorning04:27
*** wwallnrr__ has quit IRC04:30
*** nosnos has joined #heat04:36
*** lipinski1 has quit IRC04:38
*** blamar has joined #heat04:46
*** cfriesen has joined #heat05:03
*** ramishra_ has joined #heat05:04
*** ramishra has quit IRC05:07
*** skraynev_afk is now known as skraynev05:22
skraynevMorning05:22
openstackgerritRabi Mishra proposed a change to openstack/heat: Provides ability to reference existing neutron resources  https://review.openstack.org/8285305:28
*** lazy_prince has quit IRC05:28
*** nanjj has joined #heat05:34
openstackgerritJun Jie Nan proposed a change to openstack/heat: Adjust user_data_format for server with deployment  https://review.openstack.org/8299205:44
*** fandi has joined #heat05:44
nanjjstevebaker: I tried several other approaches, only the one you mentioned works05:46
*** e0ne has joined #heat05:55
*** tango has quit IRC05:57
*** nati_ueno has quit IRC05:57
*** lazy_prince has joined #heat06:00
*** IlyaE has joined #heat06:03
*** gokrokve has joined #heat06:08
openstackgerritJenkins proposed a change to openstack/heat: Imported Translations from Transifex  https://review.openstack.org/7256606:09
*** alexheneveld_ has joined #heat06:10
*** sdake has quit IRC06:12
*** alexheneveld has quit IRC06:12
*** alexheneveld_ is now known as alexheneveld06:12
*** sdake_ has quit IRC06:12
*** bvandenh has quit IRC06:13
*** gokrokve has quit IRC06:13
*** yogesh_ has joined #heat06:18
*** IlyaE has quit IRC06:18
*** saju_m has joined #heat06:19
*** duncanjw has joined #heat06:22
*** sdake has joined #heat06:24
*** sdake has joined #heat06:24
*** Darnoth has quit IRC06:25
*** duncanjw has quit IRC06:26
*** tnurlygayanov_ has joined #heat06:27
*** sdake_ has joined #heat06:27
*** tnurlygayanov has quit IRC06:27
*** alexheneveld_ has joined #heat06:29
*** alexheneveld has quit IRC06:31
*** alexheneveld_ is now known as alexheneveld06:31
openstackgerritSergey Kraynev proposed a change to openstack/heat: Initial validation of functions  https://review.openstack.org/8248606:32
*** duncanjw has joined #heat06:32
openstackgerritSergey Kraynev proposed a change to openstack/heat: Validation functions for resources and outputs  https://review.openstack.org/8248706:32
*** matsuhashi has quit IRC06:33
*** matsuhashi has joined #heat06:35
*** duncanjw has quit IRC06:37
*** cfriesen has quit IRC06:38
*** chen has joined #heat06:40
chenhello, anyone here ?? I'm a new user to heat, just installed one on CentOS. I copied template file from https://github.com/openstack/heat-templates/blob/master/hot/servers_in_existing_neutron_network_no_floating_ips.yaml, and try to run it. But I get error :"ERROR: Unknown resource Type : OS::Neutron::SecurityGroup"06:42
chenAnyone know why this happen ??06:42
*** IlyaE has joined #heat06:43
openstackgerritSergey Kraynev proposed a change to openstack/heat: Validation functions for resources and outputs  https://review.openstack.org/8248706:45
*** e0ne has quit IRC06:47
*** e0ne has joined #heat06:48
*** e0ne has quit IRC06:51
openstackgerrithuangtianhua proposed a change to openstack/heat: Make sure NetworkInterfaces and SubnetId updatable  https://review.openstack.org/8020906:56
*** IlyaE has quit IRC07:03
*** matsuhas_ has joined #heat07:03
*** matsuhas_ has quit IRC07:04
*** alexheneveld has quit IRC07:05
*** matsuhas_ has joined #heat07:06
*** tspatzier has joined #heat07:06
*** matsuhashi has quit IRC07:07
*** saju_m has quit IRC07:13
openstackgerritRabi Mishra proposed a change to openstack/heat: Provides ability to reference existing neutron resources  https://review.openstack.org/8285307:18
*** yogesh_ has quit IRC07:19
*** yogesh_ has joined #heat07:19
*** ramishra_ has quit IRC07:34
*** jprovazn has joined #heat07:39
*** matsuhas_ has quit IRC07:59
openstackgerritJun Jie Nan proposed a change to openstack/heat-templates: Software config hook for configuring with Chef  https://review.openstack.org/8022908:02
openstackgerritJun Jie Nan proposed a change to openstack/heat-templates: Add one example to show deploy sequence  https://review.openstack.org/8175708:02
openstackgerritJun Jie Nan proposed a change to openstack/heat-templates: Software config hook to provision using shell scripts  https://review.openstack.org/7029708:02
openstackgerritJun Jie Nan proposed a change to openstack/heat-templates: Software config hook to provision using puppet  https://review.openstack.org/7063908:02
openstackgerritJun Jie Nan proposed a change to openstack/heat-templates: Software config hook to provision using cfn-init  https://review.openstack.org/7975908:02
openstackgerritJun Jie Nan proposed a change to openstack/heat-templates: os-refresh-config script to invoke config hooks  https://review.openstack.org/7975808:02
*** matsuhashi has joined #heat08:04
*** bvandenh has joined #heat08:08
*** gokrokve has joined #heat08:08
*** gokrokve has quit IRC08:12
cmysterchen: what version ?08:15
cmysterHi BTW08:15
shardymorning all08:15
cmystermorning shardy08:15
*** tomek_adamczewsk has joined #heat08:15
therveGood morning!08:18
chencmyster Havana08:21
cmysterchecn take a look here http://docs.openstack.org/developer/heat/template_guide/openstack.html#OS::Neutron::SecurityGroup seems like it *is* there...08:21
cmysterchen: pastebin yer template please ?08:21
*** jstrachan has joined #heat08:21
cmystermorning therve08:21
chencmyster http://paste.openstack.org/show/74319/08:23
chencmyster I directly copied it from github08:23
*** yogesh_ has quit IRC08:25
*** pas-ha has quit IRC08:26
thervechen, What's your heat version is the question I think08:27
cmysterchen: strange, cazn you please paste the command you tried ?08:27
cmysterwith all the parameters08:27
chentherve I installed it using "yum install...."08:27
thervechen, I'm sure you can get some information out of yum then08:28
skraynevchen, cmyster: I suppose that OS::Neutron::SecurityGroup just not available in havana release08:28
chenheat stack-create mystack --template-file=servers_in_existing_neutron_network_no_floating_ips.yaml --parameters="image=base_image;flavor=m1.small;net_id=da3b99ed-a806-4a9e-9a3d-1aa7ebdc0cd5;subnet_id=010f0972-e28b-44fd-b759-5b2288022111;key_name=key_b-compute04"08:28
cmysterchen: continuing from therve's question and which repo ? Havana official08:28
chentherve no....08:28
thervechen, Then we can't help you08:29
shardychen: I assume it's RDO?  rpm -qa | grep heat | fpaste08:29
cmystermight be skraynev, I don't remember when it go in08:29
skraynevcmyster: it was merged 11 Nov  2013 (according to git history)08:29
skraynevcmyster: and i have not seen backport to havana08:30
*** pas-ha has joined #heat08:30
cmysterwell there you go :)08:30
*** duncanjw has joined #heat08:30
chenshardy therve cmyster : http://paste.openstack.org/show/74320/08:30
chenskraynev o.....so, what  template file should I use ?08:31
cmysterchen: I guess as skraynev its too old and does not have it supported.08:31
cmysteras skraynev said*08:32
cmysterteehee skraynev is probably not THAT old08:32
chencmyster e... so, I have to install from source code ?08:32
skraynevcmyster: lol =)08:32
skraynevchen: I see two solution:08:32
cmysterchen: Icehouse is not out yet, but you might give it a go via devstack08:33
shardychen: there are RDO preview packages for icehouse08:33
cmysterdepends on what you want to do. for a short POC it might be enough08:33
skraynevchen: first is use master of devstack (heat)08:33
cmysterya or that08:33
shardyhttp://repos.fedorapeople.org/repos/openstack/openstack-icehouse/08:33
cheno... I just want to have a try, to understand what is heat used for at this time....08:34
skraynevou.. shardy says truth for RDO08:34
cmysterthen either should be fine imo. RDO might be quicker08:34
chenok. let me have a try.08:35
cmysterand now for something completely different. this template is not producing any output... ideas? http://paste.openstack.org/show/74321/08:35
skraynevchen: from other side you could try "old" templates08:35
chenskraynev o, would like to try the "old"08:36
skraynevwhich were added before havana release.08:36
chenskraynev so do need to change repos, no affection to other services08:37
skraynevunfortunately you should check a date of each template in this case08:37
*** jistr has joined #heat08:37
cmysterchen: you can have a look at https://github.com/openstack/heat-templates/blob/master/cfn/F17 there are pretty 'old' templates there08:37
skraynevagree with cmyster about relevant status these templates08:38
cmysterchen: https://github.com/openstack/heat-templates/blob/master/cfn/F17/getting_started.template might be perfect08:39
skraynevchen: change repo of what? if only heat... it may be dangerous, because heat use other clients which should be updated in this case too08:39
*** alexheneveld has joined #heat08:40
chencmyster It is a template of AWS.....  :(08:40
shardychen: For HOT I'd suggest https://github.com/openstack/heat-templates/blob/master/hot/F20/WordPress_Native.yaml08:40
shardyTry that with the official Fedora 20 cloud image:08:40
cmysterchen: well you did say: chen  > o... I just want to have a try, to understand what is heat used for at this time....08:41
shardyhttp://openstack.redhat.com/forum/discussion/959/get-fedora-20-now/p108:41
chencmyster y...08:41
cmysterya08:41
*** ifarkas has joined #heat08:42
skraynevshardy: related question about F20. AFAIK heat is included in devstack by default. But we still should set desired images or download them in glance manually, right?08:42
*** chandankumar_ has joined #heat08:42
chenThanks guys. I would try WordPress_Native.yaml !08:43
shardyskraynev: http://docs.openstack.org/developer/heat/getting_started/on_devstack.html08:43
shardyYou can just update IMAGE_URLS and devstack will install the F20 image for you08:43
shardyor download them and add to glance if you prefer :)08:43
skraynevshardy: gotcha, just dream about default F20 instead centose images in glance without additional changes in localrc file ;)08:44
*** chen has quit IRC08:44
shardyskraynev: just export it all from your login profile instead of localrc and your dream will come true ;)08:51
skraynevshardy: thumbs up! :)08:52
*** liang has joined #heat08:53
*** TonyBurn has joined #heat08:55
*** duncanjw has quit IRC08:56
*** tspatzier has quit IRC08:57
*** tomek_adamczewsk has quit IRC09:00
*** duncanjw has joined #heat09:01
*** tomek_adamczewsk has joined #heat09:07
cmysterguys, regarding my earlier question, is the template legit ?09:08
*** derekh has joined #heat09:11
*** tspatzier has joined #heat09:12
*** gokrokve has joined #heat09:13
*** gokrokve has quit IRC09:13
*** gokrokve has joined #heat09:14
openstackgerritJun Jie Nan proposed a change to openstack/heat: Adjust user_data_format for server with deployment  https://review.openstack.org/8299209:14
*** tspatzier has quit IRC09:15
*** gokrokve has quit IRC09:16
*** gokrokve has joined #heat09:17
*** liang has quit IRC09:17
*** liang has joined #heat09:17
*** gokrokve has quit IRC09:21
shardycmyster: template looks OK to me, investigating as I also see no outputs09:22
cmystersmells buggish09:23
*** Trozz has quit IRC09:28
*** Trozz has joined #heat09:29
*** Trozz_ has joined #heat09:30
*** Trozz_ has quit IRC09:30
*** Trozz has quit IRC09:30
openstackgerritThomas Herve proposed a change to openstack/heat: Raise and catch a specific error during validation  https://review.openstack.org/7128709:31
*** Trozz has joined #heat09:31
*** Trozz_ has joined #heat09:31
*** mich5225 has joined #heat09:32
*** Trozz has quit IRC09:33
*** Trozz_ has quit IRC09:33
*** mich5225 has quit IRC09:33
*** Trozz has joined #heat09:33
*** giulivo has joined #heat09:39
*** e0ne has joined #heat09:39
*** Trozz has quit IRC09:39
*** Trozz has joined #heat09:40
*** Trozz has quit IRC09:40
*** qinjin has quit IRC09:41
*** derekh has quit IRC09:42
*** derekh has joined #heat09:42
*** Trozz has joined #heat09:43
*** gokrokve has joined #heat09:44
*** Trozz has quit IRC09:45
openstackgerritThomas Herve proposed a change to openstack/python-heatclient: Skip timeout_mins when not specify  https://review.openstack.org/8301709:48
*** tomek_adamczewsk has quit IRC09:54
*** tomek_adamczewsk has joined #heat09:55
*** alexheneveld_ has joined #heat10:00
*** alexheneveld has quit IRC10:00
*** alexheneveld_ is now known as alexheneveld10:00
*** faramir1 has joined #heat10:06
*** nanjj has quit IRC10:07
*** matsuhashi has quit IRC10:09
*** tspatzier has joined #heat10:11
*** tspatzier has quit IRC10:15
*** DaveJ__ has joined #heat10:16
*** chandankumar_ has quit IRC10:22
*** alexheneveld has quit IRC10:25
*** mkollaro has joined #heat10:25
*** Trozz has joined #heat10:31
*** Trozz has quit IRC10:34
*** matsuhashi has joined #heat10:39
*** Trozz has joined #heat10:41
*** Trozz has quit IRC10:42
*** networkn8 has joined #heat10:44
*** Trozz has joined #heat10:44
*** Trozz has quit IRC10:45
*** tomek_adamczewsk has quit IRC10:45
*** mojorison has quit IRC10:50
*** alexheneveld_ has joined #heat10:53
*** che-arne has joined #heat10:54
*** mkollaro has quit IRC10:54
*** tomek_adamczewsk has joined #heat10:54
*** dmakogon_ is now known as denis_makogon11:03
*** julienvey has joined #heat11:07
*** liang has quit IRC11:08
*** julienvey has quit IRC11:08
*** duncanjw has quit IRC11:12
*** rpothier_ has quit IRC11:13
*** saju_m has joined #heat11:21
*** fandi has quit IRC11:21
*** e0ne has quit IRC11:23
*** Trozz has joined #heat11:23
*** Trozz has quit IRC11:23
*** e0ne has joined #heat11:23
*** tspatzier has joined #heat11:25
*** tspatzier has quit IRC11:26
*** e0ne has quit IRC11:29
*** Trozz has joined #heat11:29
*** Trozz has quit IRC11:36
*** ppetit has joined #heat11:38
*** julienvey has joined #heat11:41
*** gokrokve has quit IRC11:45
*** gokrokve has joined #heat11:46
*** nkhare has quit IRC11:47
*** gokrokve has quit IRC11:50
openstackgerritSergey Kraynev proposed a change to openstack/heat: Adding validation algorithm for get attr functions  https://review.openstack.org/8248811:52
*** gokrokve has joined #heat11:57
*** jstrachan has quit IRC11:59
*** e0ne has joined #heat12:00
*** Trozz has joined #heat12:02
*** Trozz has quit IRC12:03
*** julienvey has quit IRC12:03
*** wchrisj has joined #heat12:04
*** e0ne has quit IRC12:04
*** ppetit has quit IRC12:04
*** e0ne has joined #heat12:05
*** Slower has quit IRC12:05
*** sgordon has joined #heat12:08
*** fandi has joined #heat12:09
*** duncanjw has joined #heat12:09
*** e0ne has quit IRC12:10
*** matsuhashi has quit IRC12:10
*** matsuhashi has joined #heat12:11
*** julienvey has joined #heat12:12
*** matsuhas_ has joined #heat12:13
*** matsuhashi has quit IRC12:13
*** e0ne has joined #heat12:14
*** aweiteka has joined #heat12:14
*** mkollaro has joined #heat12:15
*** lipinski has joined #heat12:18
*** dims_ has quit IRC12:18
*** julienvey has quit IRC12:18
*** mkollaro has quit IRC12:21
*** dims_ has joined #heat12:21
*** e0ne_ has joined #heat12:23
*** duncanjw has quit IRC12:23
*** e0ne has quit IRC12:23
*** e0ne has joined #heat12:25
*** david-lyle has quit IRC12:27
*** rpothier_ has joined #heat12:27
*** e0ne_ has quit IRC12:28
openstackgerritA change was merged to openstack/heat: Fix creating docker containers  https://review.openstack.org/8245712:34
*** mkollaro has joined #heat12:36
*** julienvey has joined #heat12:37
*** ppetit has joined #heat12:48
sdake_morning12:52
*** gokrokve has quit IRC12:53
chmouelsdake_: good morning12:53
*** gokrokve has joined #heat12:53
*** gokrokve has quit IRC12:57
thervechmouel, I asked a question on https://bugs.launchpad.net/heat/+bug/1297122 btw12:57
uvirtbotLaunchpad bug 1297122 in heat "Docker plugin name conflict with docker library" [Undecided,In progress]12:57
*** tomek_adamczewsk has quit IRC12:59
chmoueltherve: cool ansered there (i get too much bug reports floating by my mailbox to gets the one directly answered to my requests)13:02
*** tomek_adamczewsk has joined #heat13:02
therveHum okay13:02
thervechmouel, __import__ then13:02
chmouelisn't that a bit hacky?13:03
therveRenaming is disruptive. Python supports namespaces just fine :)13:03
therveYou can use importlib too13:03
chmouelby just fine you mean just fine in python3 ?13:05
chmouelcan do the importlib I thought that module wasn't working at first so i didn't expect much people using it13:06
chmoueland the renaming would be harmless13:06
*** e0ne_ has joined #heat13:07
*** gokrokve has joined #heat13:07
*** matsuhas_ has quit IRC13:07
therveNo I mean just fine in general13:08
thervechmouel, You break documentation too13:10
*** e0ne has quit IRC13:10
chmouelyeah saw that, well i guess i'd use the 'fine' importlib :)13:10
therveI wonder if that works in that case though13:11
therveMaybe you do need renaming? We don't install it in the "docker" namespace?13:11
chmouelI don't think so, it only get confused during the testrunning13:12
chmouelmay need some invstigation13:12
*** achampion has quit IRC13:12
*** arbylee has joined #heat13:14
*** alexheneveld_ has quit IRC13:14
*** blomquisg has joined #heat13:14
*** arbylee has quit IRC13:16
*** arbylee has joined #heat13:18
*** arbylee has quit IRC13:18
*** arbylee has joined #heat13:19
*** tspatzier has joined #heat13:19
*** faramir1 has quit IRC13:20
*** hazmat has quit IRC13:21
*** rbuilta has joined #heat13:22
*** tspatzier has quit IRC13:28
*** jcru has joined #heat13:29
*** arbylee has quit IRC13:30
*** arbylee has joined #heat13:30
*** nosnos has quit IRC13:35
sdake_anyone know how I would go about running the databsae migrations13:40
zanebsdake_: heat-manage --help13:41
sdake_zaneb thanks :)13:41
chmouel:)13:41
*** samstav has joined #heat13:41
* IgorYozhikov is now away: went away...13:43
*** IgorYozhikov is now known as IYozhikov_away13:43
*** lazy_prince is now known as killer_prince13:46
*** asalkeld has joined #heat13:48
skraynevguys, should default value (which defined in property schema) be used during update?13:51
skraynevf.e. I have property with default = []13:51
*** ppetit_ has joined #heat13:51
*** ppetit_ has quit IRC13:51
skraynev1. create stack with [val1, val2]13:51
skraynev2. update stack and don't mention this value in template13:52
skraynevin this case prop_diff, thinks that value is None, instead []13:52
skraynevzaneb, shardy ^^13:53
*** randallburt has joined #heat13:53
*** randallburt has joined #heat13:53
zanebskraynev: that seems like bug13:54
zaneb*a* bug13:54
skraynevzaneb: hm. so expected behavior is use default value during update, right?13:54
*** ppetit has quit IRC13:55
*** vijendar has joined #heat13:56
zanebskraynev: that makes sense to me13:57
skraynevthx, will ask stevebaker also )13:58
*** skraynev is now known as skraynev_going_h13:59
*** skraynev_going_h is now known as skraynev_afk13:59
*** achampion has joined #heat14:00
pas-haguys, can someone point me to a chat where to ask devstack-related questions?14:00
larskspas-ha: Possibly #openstack.14:00
sdake_pas-ha #openstack-dev14:01
pas-hasdake_, larsks: thnx14:01
sdake_I don't think tehre is a devstack specific channel14:01
sdake_pas-ha https://wiki.openstack.org/wiki/IRC for future reference14:01
dims_stevebaker, (or anyone else). OpenStackClients lookups a nova service from the keystone catalog that auth_url points to. When multi_cloud is switched on, i can't seem to find where the auth_url is set in the context based on the headers of the incoming request14:02
*** tspatzier has joined #heat14:02
*** IlyaE has joined #heat14:03
*** vijendar has quit IRC14:03
sdake_dims| someone complained about that in a review - but the review was for documentation changes14:03
sdake_so I'd suggest filing a bug14:03
sdake_so it gets tracked14:03
*** cmyster has quit IRC14:03
*** vijendar has joined #heat14:03
*** samstav has quit IRC14:04
*** andersonvom has joined #heat14:04
shardyzaneb, sdake: interested to get your feedback on bug #1297761 when you get a moment14:04
uvirtbotLaunchpad bug 1297761 in heat "No validation of top-level template keys" [Undecided,New] https://launchpad.net/bugs/129776114:05
shardyfollows on from the resource-level custom-keys discussion, turns out we don't validate the top-level keys at all14:05
shardyI thought we did, or at least at one point we did..14:05
dims_sdake, will do, also another problem is get_admin_context has no clue about auth_url as well it always picks up from config so periodic watcher has no clue either14:05
sdake_dims_ tbh I dont' quite understand what is required to fix it, but I know the review in question where it was brought up was only doc changes, so it was +2'ed14:06
*** varora has left #heat14:06
therveshardy, Did we?14:06
sdake_so getting it in the bug tracker would help people discuss it, unless you have a solution ready to rock :)14:06
therveValidation has always been quite loose :)14:06
dims_sdake, yep!14:07
zanebshardy: yeah, we probably didn't ever do that in HOT14:07
zanebshardy: I thought we did for cfn templates though?14:07
shardyzaneb: I've tested and neither format raises an error14:08
shardyat least on Icehouse, I've only tested HOT on Havana14:08
zanebit's probably the same then14:08
shardyI may start a ML thread about it, as it's pretty unhelpful to user to silently accept malformed templates, but I'm worried folks may be making use of the current behavior14:09
* shardy is thinking of the template-metadata stuff which was previously discussed and rejected14:09
shardyturns out we allowed it all along :\14:09
*** duncanjw has joined #heat14:09
zanebshardy: I don't think anybody will be doing superset-stuff, because the API of the Template class doesn't allow you to access it14:10
zanebshardy: shhhhhhh14:10
sdake_i think hot is pretty well described in the spec14:10
shardyzaneb: Yeah, that is what I'm hoping14:10
sdake_people operating outside of the spec  - well atleast they have a spec they SHOULD be using14:10
sdake_if they are using things that are bugs, essentially exploiting heat, I really don't have a problem with their templates breaking14:10
shardyOk I'll just post a patch fixing it and we can discuss in the review14:11
zanebsdake_: agree but we _will_ need a db migration to clean up their templates14:11
sdake_our parser should be very pendantic imo :)14:11
zaneb+114:11
sdake_zaneb yes, I'm working on that ?14:11
sdake_as we discussed yesterday14:11
shardysdake_: well I kinda agree, but e.g tspatzier's recent patch for custom resource keys shows there is already some (ab)use of our lax validation14:12
sdake_I guess I dont know all the conditions14:12
shardytspatzier: Ok, you're here ^^14:12
shardyany feedback appreciated before I break everybody and get shouted at (again) ;)14:12
sdake_shardy yes and I think we want to draw a clear line in the sand about that :)14:12
zanebsdake_: maybe add deleting extraneous keys to that migration?14:12
tspatzierhey shardy, what is the discussion?14:12
sdake_zaneb I was going to make some separate migrations14:12
tspatzierwhether we should be really strict?14:12
sdake_since they are separeate bugs14:12
*** samstav has joined #heat14:12
shardytspatzier: It's about strict enforcement/validation of top-level template keys (sections)14:13
shardytspatzier: e.g atm we silently allow a mis-spelt resources or outputs section14:13
shardyref https://bugs.launchpad.net/heat/+bug/129776114:13
uvirtbotLaunchpad bug 1297761 in heat "No validation of top-level template keys" [Undecided,New]14:13
sdake_strict enforcement is necessary, the fact that we aren't strict now is because the parsers need love, not because that is our intention :)14:13
shardytspatzier: my opinion is we should do strict validation and reject malformed section keys, but given your recent custom-keys patch I'd like to discuss it first :)14:14
tspatzierabandoned my patch already. I am all for strict validation14:14
shardytspatzier: Ok, I'll post a patch which enforces section validation, thanks14:15
*** cfriesen has joined #heat14:15
tspatziershardy: we have discussed internally and I am fine with strict checking. Let's do it now to not cause further confusion going forward.14:15
shardytspatzier: +114:15
sdake_+1 lets have pain soone rrather then later14:15
tspatzierif something else is needed, let's add it to HOT in a coordinated fashion, i.e. BP, discuss, document ...14:15
sdake_hot has really turned out nicely14:16
sdake_I was suspect early on :)14:16
*** Darnoth has joined #heat14:16
sdake_nice job tspatzier :)14:16
tspatziersdake_, yep, I also like it taking off14:16
*** alexheneveld has joined #heat14:17
tspatzierthanks sdake_14:17
tspatziershardy: so are you working on that bug you linked above?14:18
shardytspatzier: I was about to start, unless you'd like to take it :)14:20
shardylooked at some code but not really written a fix or tests yet14:20
shardy(it was only reported this morning)14:20
dims_sdake, fyi - https://bugs.launchpad.net/heat/+bug/129788014:21
uvirtbotLaunchpad bug 1297880 in heat "multi_cloud : looking up services from keystone catalog - possible issues" [Undecided,New]14:21
*** sabeen has joined #heat14:22
tspatziershardy: I could look into it. Have to see what the best code is, but the logic would be: everything that is in hot_spec.rst will pass, everything else will be rejected.14:22
shardyI think it's fairly simple, we just need to raise an exception if *Template is created with a key not in SECTIONS as defined in each class14:23
tspatziershardy: right, that's what I thought14:23
shardyand work out a place we can do it (e.g on create) which won't break every existing template stored in the DB if it contains invalid keys14:24
shardyor have a migration which removes all invalid keys I guess14:24
tspatzierhm, have to think about the existing templates in the DB14:24
sdake_shardy migrations are what we are doing imo :)14:25
tspatzieryes, we did it for the last syntax checking patches14:25
sdake_we need a migration for version and parameters too14:25
sdake_if I can figure out how to get an older version of heat running, I'd submit some patches :)14:26
tspatziershardy: so I take this bug if you like. I guess you like, right ;-)14:29
randallburtsdake_:  going to run a spell checker in a sqlalchemy migration? ;)14:29
chmouelthat should not just crash right http://pastie.org/pastes/8970418/text?key=w13retcbbb3vsh99t2cya it should come back something to the user?14:29
*** rcleere has joined #heat14:30
*** tomek_adamczewsk has quit IRC14:30
randallburttspatzier:  we've been seeing failed calls to stack-list when we show deleted stacks because of the lack of validation earlier on. Couldn't we just not validate on stack-list/stack-show?14:31
sdake_randallburt I investigated that14:31
sdake_it is untidy at best14:31
tspatzierrandallburt: so you mean if we do strict checking on create, we never have to validate again?14:32
randallburttspatzier:  and UPDATE too, but sure.14:32
sdake_the code base doesn't support that model easily14:32
*** tomek_adamczewsk has joined #heat14:33
tspatzierso for HOT, most is done in the translate code today. Parameters are done in the param schema code.14:33
randallburtsdake_:  Yeah, I imagine instantiating the full business object for lists and shows is a bit problemmatic, however, we already re-validate before every operation, so I wonder if its just not removing the calls to validate in constructors and whatnot.14:33
sdake_whenever a stack object is instantiated, (on any API operation) the entire thing is parsed14:33
*** vijendar has quit IRC14:33
sdake_it is not removing validate calls14:33
sdake_there is no validate call to remotge14:33
sdake_to remove14:33
sdake_when you do something like stack list, the template is parsed14:34
shardytspatzier: If you have time to work on it, feel free :)14:34
sdake_the template parsing doesn't call "hey validate this" it does validation inline with parsing14:34
randallburt sdake_ template_format.parse still validates keys?14:34
randallburtsdake_:  poop.14:34
tspatziershardy: ok, I'll take it14:34
shardytspatzier: thanks!14:34
sdake_perhaps a better long term solution is to provide a separate validate operation independent of the parsing14:35
sdake_but I think given the number of days we have left to fix that, that would be pretty invasive14:35
sdake_eg, two steps -> validate, then parse14:35
sdake_the parser always assumes the validation is correct14:35
sdake_right now parsing and validation are jammed together14:35
*** e0ne has joined #heat14:36
sdake_randallburt I am just not keen to essentially rewrite the parsers to support that model for rc114:37
randallburtsdake_:  yeah, def sounds tricky. just a thought, though. For now, data migrations catch *most* things, but when stuff is misspelled or in the wrong place, it can be hard to detect/fix.14:37
jasondsdake_: i noticed that.  made fixing difficult https://bugs.launchpad.net/heat/+bug/1296747  ended up having to remove validation for nova keypair14:37
uvirtbotLaunchpad bug 1296747 in heat "Nova keypair cannot be updated" [High,Fix committed]14:37
randallburtsdake_:  agreed,14:37
tspatziersdake_: agree on the long term cleanup. For now, it would do a minimal fix for the bug I guess.14:37
sdake_tspatzier which bug are you talking about14:37
sdake_so far, there are two I knwo of14:37
sdake_people can specify wacky version #s, which breaks delete/list14:38
tspatzierThe one I just inherited from shardy: https://bugs.launchpad.net/heat/+bug/129776114:38
uvirtbotLaunchpad bug 1297761 in heat "No validation of top-level template keys" [Undecided,New]14:38
sdake_people can specify mixed hot/cfn parameters which breaks delete/list14:38
*** alexpilotti has joined #heat14:39
tspatziersdake_: the parameter syntax should have been fixed a few weeks back by some schema code refactoring we did.14:39
*** daveed has quit IRC14:39
*** e0ne_ has quit IRC14:39
sdake_tspatzier, if people have old templates in their db with mixed cfn/hot parameters, they cannot be listed/deleted14:39
tspatziersdake_: understand. But there have been migrate db patches coming in.14:40
sdake_tspatzier there is no migrate patch for params14:40
sdake_working on that atm14:40
tspatzierI thought andrew_plunk was working on one.14:41
sdake_tspatzier I am working on https://bugs.launchpad.net/bugs/1296859 - actually14:42
uvirtbotLaunchpad bug 1296859 in heat "stack-list throws an error if any stack returned contains a template error" [Medium,Triaged]14:42
*** chandan_kumar has quit IRC14:42
sdake_tspatzier I don't see any params bug in rc1 assigned to andrew_plunk14:42
sdake_but I think we can't backport db migrations, so ideally this is something we  need to fix before rc114:42
tspatzierThis is the migrate script I remember: https://github.com/openstack/heat/blob/master/heat/db/sqlalchemy/migrate_repo/versions/037_migrate_hot_template.py14:42
sdake_cool so looks like parameters is handled14:43
tspatziersdake_: your bug is re template version. For that one I cannot remember of a db script.14:44
*** skraynev_afk is now known as skraynev14:44
sdake_tspatzier right14:44
sdake_there is none definately for version14:44
tspatzierresources and outputs should be handled as well: the 041 script14:44
sdake_cool so we are all set then once I finish up14:44
*** chandankumar_ has joined #heat14:45
tspatzierright, and I will take care of the top level keys in course of fixed the bug I took14:45
tspatziers/fixed/fixing/14:45
*** chandankumar_ has quit IRC14:46
*** mestery has joined #heat14:46
*** chandan_kumar has joined #heat14:47
*** jmckind has joined #heat14:48
*** chandan_kumar has quit IRC14:48
*** chandan_kumar has joined #heat14:48
tspatziersdake_, shardy: if I throw an error message in the fix, is there some i18n lock-down I should be aware of?14:49
sdake_we are in string freeze14:50
tspatzierso no new error message? just throw e.g. a KeyError?14:51
shardyHmm, I was thinking we'd want a new InvalidTemplateSection exception14:52
tspatziershardy: would that involve translation? The exception name itself is very self-explaining14:53
*** andersonvom_ has joined #heat14:53
*** david-lyle has joined #heat14:53
*** radez_g0n3 is now known as radez14:54
shardytspatzier: well this is the patch I'd just started, but it would involve a new string14:54
shardyhttp://paste.fedoraproject.org/88795/45593139/14:54
shardyI wonder if we can just ask for a string-freeze exception for it14:54
shardybetter to raise a descriptive error in one language than a non-descriptive one in all of them imo14:54
*** chandan_kumar has quit IRC14:55
tspatziershardy: agree14:55
shardyIf that's not allowed then I guess raise a generic error and we fix in Juno14:55
*** andersonvom has quit IRC14:55
tspatziershardy: I can include this in my fix. If people reject, we do the generic error thing.14:56
shardy+114:56
*** chandan_kumar has joined #heat14:57
*** bvandenh has quit IRC15:02
*** chandan_kumar has quit IRC15:03
*** jstrachan has joined #heat15:04
*** mestery has quit IRC15:05
*** tspatzier has quit IRC15:07
openstackgerritAnderson Mesquita proposed a change to openstack/heat: Add OS:Barbican:Order resource  https://review.openstack.org/8190615:08
openstackgerritAnderson Mesquita proposed a change to openstack/heat: Add OS:Barbican:Secret resource  https://review.openstack.org/7935515:08
*** chandan_kumar has joined #heat15:09
*** andrew_plunk has joined #heat15:11
*** jstrachan has quit IRC15:13
*** andersonvom_ has quit IRC15:14
*** andersonvom has joined #heat15:14
*** ppetit has joined #heat15:16
*** wchrisj has quit IRC15:18
*** lsmola_ has quit IRC15:19
*** pas-ha has quit IRC15:19
*** tspatzier has joined #heat15:23
*** samstav has quit IRC15:25
openstackgerritZane Bitter proposed a change to openstack/heat: Fail if non-existent security group referenced  https://review.openstack.org/8155815:27
*** lsmola_ has joined #heat15:34
*** randallburt has quit IRC15:34
*** Linz has joined #heat15:35
*** ifarkas has quit IRC15:36
lipinskiIs there a way to convert a string to a json object or separated list?15:36
lipinskiI'm trying to pass a list (which is an output of one resource) to the networks property of a server ({ network: 'public' }), but the engine is recognizing it as a string, not a Map15:37
*** Linz has quit IRC15:39
*** ifarkas has joined #heat15:40
*** saju_m has quit IRC15:43
*** Linz has joined #heat15:44
shardylipinski: You can specify an index to select the item you want from the list via get_attr:15:45
shardyhttp://docs.openstack.org/developer/heat/template_guide/hot_spec.html#intrinsic-functions15:45
lipinskishardy: I have a resource with an output of obj: { network: "public" }15:45
shardylipinski: which resource?15:46
*** spzala has joined #heat15:46
lipinskiI try to pass that to a networks property of a OS::Nova::Server via networks:[  { get_attr: [ my_res, obj ] } ]15:46
lipinskishardy: a provider resource15:46
lipinskiI get: networks Property error : networks: 0 "{u'network': u'public'}" is not a map15:46
lipinskiSo, it is getting the data I want.  It's just that it seems to be regocnizing the result ot get_attr as a string and not interpreting it as a JSON15:47
*** ifarkas has quit IRC15:48
thervelipinski, Can you work around by just returning "public"?15:48
therveI think attributes have to be strings for now15:48
*** samstav has joined #heat15:48
lipinskitherve: it's a deep problem that has another issue I'm trying to work around - not being able to determine list sizes nor being able to merge lists15:49
lipinskiI'm trying to have one resource build a list of networks that I pass to OS::Nova::Server.  The "builder" resource will pass back an arbitrary number of networks15:50
*** samstav has quit IRC15:50
lipinskiI was trying to have it return a list, and just pass that onto OS::Nova::Server - but I keep running into this string vs list vs map/json issue.15:50
lipinskiI was hoping that since other OS resources can return attributes other than strings that I could too.15:51
*** kgriffs_afk is now known as kgriffs15:51
shardyLooks like all nested stack attributes do get converted to strings:15:51
shardyhttps://github.com/openstack/heat/blob/master/heat/engine/stack_resource.py#L32515:51
shardylipinski: if you can raise a bug with some minimal examples demonstrating what you're trying to do that would be most helpful15:52
*** wchrisj has joined #heat15:52
lipinskiI'm guessing that provider resources are then subclasses of stack resources15:52
shardylipinski: yup, provider resources are nested stacks15:53
lipinskiWhen I create a stack from the provide resource itself, the attribute seems to be recognized in the output as a json:15:55
lipinski... "output_value": { "network": "private" }, ...15:55
*** duncanjw has quit IRC15:58
*** killer_prince has quit IRC15:59
*** killer_prince has joined #heat15:59
*** radez is now known as radez_g0n315:59
*** mestery has joined #heat16:01
openstackgerritSteven Hardy proposed a change to openstack/heat: Don't log exception for None timeout_mins  https://review.openstack.org/8310916:02
*** radez_g0n3 is now known as radez16:02
jasondanybody else want to weigh in on a HOT "mappings" section?  https://review.openstack.org/#/c/81918/16:03
shardyjasond: Is there a reason why you can't use parameter declarations in the environment instead?16:05
*** TonyBurn has quit IRC16:05
*** wchrisj has quit IRC16:05
*** lsmola_ has quit IRC16:06
jasondshardy: the mapping needs to be coupled to the template16:06
*** ppetit has quit IRC16:06
shardyjasond: well an environment is coupled with the template at the API level16:07
*** tomek_adamczewsk has quit IRC16:07
*** wchrisj has joined #heat16:07
shardyjasond: perhaps providing some example use-cases would be helpful?16:07
jasondshardy: did you read through the comments?16:07
therveYeah I'm not sure I understand the "image name-to-image ID mapping" example16:07
therveimage have names already?16:07
jasondtherve: http://dunsmor.com/pastebin/1395850105.txt16:08
*** tomek_adamczewsk has joined #heat16:09
jasondtherve: the global image name-to-id mappings change16:09
*** sgordon has quit IRC16:09
therveSo you hide which images that you use. Hum...16:09
jasondtherve: and that greatly reduces the reliability of any user-data scripts16:09
jasondtherve: what do you mean?16:09
thervejasond, Why?16:09
jasondtherve: because the environment that the userdata script was developed for has changed16:10
therveI mean you don't pass a real image, you pass a name that the template translates. With hardcoded values in your template that make it hard to port16:10
shardytherve: +116:10
jasondtherve: how does it translate the name?16:11
thervejasond, Sorry I don't understand what you just said16:11
shardyI personally prefer the direction we've been headed, which is to make the stack template as reusable as possible, and have most things which can change defined in the environment16:11
*** julienvey has quit IRC16:11
shardyThe smarter constraint stuff makes that even easier, as you can query the service rather than having a hard-coded list16:11
*** wchrisj has quit IRC16:12
shardyAs for the name/id thing, I like the approach of making the underlying resource do the lookup by name when we find a name rather than ID16:12
shardye.g like already happens in some resources16:12
jasondtherve: when the teamplate author develops a user-data script, they test it by running it against a particular image.  but if the image has changed, that script can easily fail16:12
*** randallburt has joined #heat16:13
shardyjasond: So they define an image ID in their environment, and re-test everything when they make a change to the environment file (which can be reused for all their stack templates)16:13
shardyIf you have 1000 stack templates to maintain, surely that's much easier than having to sed the lot with hard-coded id's?16:14
thervejasond, Well okay, so that's solved by having a constraint on the images. Mappings don't change that.16:14
shardyIf a mapping definition does get added, I'd much prefer it to be in the environment rather than the template itself16:14
jasondshardy: that's at the heat-level.  the mapping needs to be at the template-level16:14
*** skraynev is now known as skraynev_afk16:14
shardyjasond: well my argument is that it doesn't ;)16:15
therveNote that it *may* be useful. I was personally thinking about an "attributes" or "variables" section when you can stuff reusable data16:15
radixgood morning16:15
shardydecoupling the declarative model from changes in the environment is exactly what the environment file is for IMO16:15
tspatziershardy, therve, jasond: just to restate what I wrote in the review: I also think this rather belongs to environment, since in the template it makes the template non-portable.16:16
*** julienvey has joined #heat16:16
*** killer_prince has quit IRC16:17
*** killer_prince has joined #heat16:18
*** samstav has joined #heat16:19
*** varora has joined #heat16:20
jasondshardy, tspatzier, therve: let me try to give an example.  if a rackspace customer develops a template with a user-data script, they test it against a specific CentOS 6.5 image.  if the Heat environment changes the image id that CentOS 6.5 maps to, their user-data script could break16:20
*** lsmola_ has joined #heat16:20
*** e0ne_ has joined #heat16:21
jasonda key point is that this is a template that the end user maintains/supports16:21
*** jstrachan has joined #heat16:22
jasondthey have no control over heat16:22
therveThey can still specify an environment though16:22
tspatzierjasond: but if you code the image ID in the template and give the template to somebody else, it won't work if there are different image ID in the other guy's openstack.16:22
therve"if" :)16:22
shardyjasond: can't they maintain their own environment (in addition to whatever you provide via the global environment)?16:22
shardytheir environment will always take precedence, so they have control and "the Heat environment" will never change16:23
shardyunless they change it :)16:23
tspatzieragree, shardy. That's how it should be.16:23
shardyas tspatzier says, it's also much better from a reusability perspective16:24
*** e0ne has quit IRC16:24
randallburtwhy not both? enable an in-template map and have it be overridable via environment?16:24
jasondbut then the template wouldn't be complete without the environment file16:24
*** duncanjw has joined #heat16:25
*** jstrachan has quit IRC16:25
jasondit's vital information that would have to be kept in the environment file16:25
shardyimagine they want to use the same template in dev, test and production, uh, environments, with different image id's or paramters controlling network setup, logging etc - having it hard-coded in the template is just a headache16:25
tspatzierjasond: could we do something like: if mapping exists in environment, use it. If not, do lookup by name. Seems like this would need to be done in the resource.16:25
shardyjasond: agree, but that's what the environment is *for*16:25
openstackgerritJenkins proposed a change to openstack/heat: Updated from global requirements  https://review.openstack.org/7668916:26
jasondshardy: well it would be an optional feature16:27
shardyIMO it makes no difference to the user if the "vital" information exists in the environment, the template, or on a bit of paper the user types in as parameters, other than defining it in the environement is much more convenient from a reuse perspective16:27
andrew_plunkI like the idea of the environment having the ability to "map" parameter values passed into a template (which can be overridden by a user specified environment).16:27
randallburttspatzier:  seems a little too specific to images and flavors grated thats where the original problems cropped up.16:27
shardyjasond: I guess the point is to promote use of environments to avoid some of the bad points of CFN, such as hard-coded URL's and mappings in their templates16:28
randallburtisn't the level of effort the "same" if the user has to maintain their own environment file or just change a mapping stanza in the template?16:28
tspatzierrandallburt: this is re my comment on doing it in the resource? Then maybe not in the general resource class, but in those that need to do those kinds of lookups by name.16:28
jasondrandallburt: how would that work?  an environment file per template?16:29
randallburttspatzier:  k. just think that whatever solution should be generic enough to satisfy similar issues around values16:29
tspatzierrandallburt: sure16:29
randallburtand don't get me wrong; I was never a fan of the mapping section in CFN, but I def understand jasond's concern around the requirement to have a mapping file to make a given template work.16:30
randallburtbut moving that mapping from the template to the environment seems same/same to me.16:30
randallburtits still something a user will need to change and maintain as the template itself changes.16:31
therveI'm still not sold on the use case TBH16:32
therveSure the script can break. But maybe not.16:32
*** asalkeld has quit IRC16:32
tspatzierrandallburt: sure, it has to be maintained. But on the other hand, you might also end up editing lots of templates instead of one env as shardy has mentioned before.16:32
jasondtherve: we've found out that the script does break, and often16:32
tspatzierI am also not yet convinced we need mappings in the template. This opens the door for ugly mis-uses for hardcoded, environment specific stuff in the template.16:33
lipinskishardy: I opened https://bugs.launchpad.net/heat/+bug/1297938 for the provider attribute string thing.  Let me know if this looks sufficient..16:34
uvirtbotLaunchpad bug 1297938 in heat "Provider Resource Attributes forced to string type" [Undecided,New]16:34
*** duncanjw has quit IRC16:35
thervejasond, But do you really solve something by hardcoding the values? Surely it doesn't make it work with the image I want to use16:35
shardylipinski: lgtm, thanks16:35
jasondtherve, tspatzier, shardy: the existence of a user-data script makes the template less portable.  the mappings section doesn't make it less portable than it already is16:35
lipinskishardy: thanks.16:35
*** wchrisj has joined #heat16:36
tspatzierjasond: with the new software-orchestration stuff we have a way of living without inlined user-data scripts.16:36
shardyjasond: well that's the problem we've been trying to solve software-config16:36
tspatzierYou can actually decouple the software definitions from the infrastructure for different environments.16:36
randallburttspatzier:  that remains to be well proven and is something for the future, not the same problem really16:36
therverandallburt, mappings are a thing for the future :)16:37
shardyjasond: moving in the direction of making the main template declaration more portable, hence my comment that this is a step in the wrong direction, IMHO16:37
tspatzierrandallburt: partly agree. But that is the direction. And I would rather make this solid instead of introducing a quick fix.16:37
therveA quick fix that has incidence on the overall template structure16:38
therveYou need to cover more use-cases IMHO16:38
shardyjasond: e.g now, you could have a completely reusable top-level declarative model, with all the imperative parts specified via the environment16:38
shardyvariables/constants in the environment and e.g abstracted software config via provider resources or pulled in via get_file16:39
tspatziercould this be a topic for the design summit?16:39
tspatzierI mean, the general structure going forward with software config, decoupling from infrastructure etc.16:40
tspatzierjust a thought16:40
shardytspatzier: topic title "quick fixes vs long term roadmap" ;)16:40
tspatzier;-)16:40
shardyI agree it would be a good topic for discussion16:40
jasondtspatzier: i think we've discussed it enough.  you all raise some good points.  we'll try to find an alternate fix.  thanks for the discussion16:40
tspatzierjasond: maybe we don't call it fix. Let's come up with a clean solution that also solves similar use cases in the future?16:41
jasondtspatzier: we'll we're in the situation where we're having to support templates with user-data scripts16:42
jasond*well16:42
tspatzierunderstand. but what I meant with clean solution was a way for have the data you need somewhere where it is intuitive, and then promote this model.16:43
tspatzierbtw. shardy: is there some good documentation on how you work with environments, provider templates etc.? I have been asked by colleagues. I think somebody talked about some blogs. But is there something in the docs already?16:44
jasondtspatzier: using environment files is the only option, right?16:44
*** vijendar has joined #heat16:45
shardytspatzier: I wrote a simple example in a blog post:16:45
shardyhttp://hardysteven.blogspot.co.uk/2013/10/heat-providersenvironments-101-ive.html16:45
shardytspatzier: we probably need to improve the actual docs16:45
tspatzierjasond: at least this is what's there today, and I think we should extend this if necessary for your use case.16:45
shardymaybe I'll try to refactor the blog example into a docs howto page or something16:45
tspatziershardy: thanks! We can think of something for the template guide. There are many folks asking for it, and unless one has followed all past discussions, it is hard to figure out who it works.16:46
jasondtspatzier: i'll mess around and see how it works.  will revisit this if necessary.  thanks16:46
tspatziersounds good jasond16:46
shardytspatzier: There is http://docs.openstack.org/developer/heat/template_guide/environment.html16:47
*** radez is now known as radez_g0n316:47
shardybut probably need something a little more introductory in the docs somewhere, and definitely more examples in heat-templates16:47
tspatziershardy: I know this part. But I guess we need something along a sample use case, how you would split a big template into several provider templates, use them, bind them in the environment etc.16:48
*** mestery has quit IRC16:49
lipinskishardy: did you see the bug I filed yesterday about provider resources with a file:/// reference?  I could not get resource_registry to work via (passed) environment file because of that issue.16:49
shardylipinski: I didn't - IIRC you shoudn't need to pass file:/// as python-heatclient resolves local paths by default16:50
lipinskiyes - I could just use the filename without the file:///.  But, then it was a relative path and if I was not in the directory of the file(s), it wouldn't work.  Anyways, there was another issue preventing me from using (passed) environment files and that is nested resources not working either.16:51
lipinskiI had ot switch to a resource_registry in /etc/heat/environment.d  to get that to work.16:51
shardylipinski: you mean propagating the environment to the nested stacks?16:51
shardyThat is either by design or a known issue, depending on your perspective16:51
shardyYou can pass the parameters from the top level template into each nested resource as a workaround16:52
lipinskishardy: I guess.  I have a template with a provider resource.  That provider resource refers to another provider resource.  The second one wouldn't recognize the resource16:52
lipinskiCan you pass a resource registry?16:52
shardylipinski: Aha, yeah we should fix that, and IMO also provide a way to specify parameters globally in the environment16:53
shardylipinski: what's the bug #?16:53
*** saurabhs has joined #heat16:54
shardynvm found it16:54
lipinskishardy: you're faster than me :)16:54
*** gokrokve has quit IRC16:55
zaneblipinski: so here's the issue... say you register a provider for OS::Nova::Server that contains an OS::Nova::Server16:56
lipinskizaneb: circular?16:56
zanebif we pass the environment on, it's turtles all the way down16:56
zanebso that's why we don't16:56
zanebiirc it's possible to just specify a URL as the resource type though (not using the environment)16:57
lipinskididn't know you could have circular providers like that.  (I actually thought I did that accidentally and encountered an engine error)16:57
*** chandan_kumar has quit IRC16:57
zaneblipinski: well, you can't because we don't pass the environment down to a provider template :)16:57
zanebbut if we did, you could16:58
shardyzaneb: that's a good point, perhaps using anonymous type: foo.yaml providers would work16:58
*** harlowja_away is now known as harlowja16:58
lipinskizaneb: I think circular refernces/providers is another issue.16:58
*** gokrokve_ has joined #heat16:58
lipinskiok - another question then.  Can I define a resource_registry in a template (e.g., in my "parent" provider)?16:58
zanebshardy: ++16:58
*** retr0h has joined #heat16:59
therveshardy, What do you mean by anonymous types?16:59
zaneblipinski: no, resource_registry is purely an environment thing16:59
zanebtherve: where the 'type' is just a URL to a provider template16:59
shardypersonally I'm not a fan of that interface though, I much prefer the explicit mapping via the type alias in the environment17:00
lipinskizaneb: Then there's no way to have two layers of providers (template -> provider resource -> provider resource) with passed environment17:00
therveSo that works already right?17:00
zanebtherve: I believe so17:00
shardytherve: type: foo.yaml instead of type: My::Descriptive::Type17:00
therveYeah that's what I've been fixing recently :)17:00
*** nati_ueno has joined #heat17:00
*** Slower has joined #heat17:00
zaneblipinski: not in the environment, but you can do what shardy just said, and specify the provider directly in the (provider) template, rather than the environment, and get two levels of providers17:01
harlowjazaneb but i want my duck17:02
harlowjalol17:02
harlowjawhy u take away my pet duck17:02
zaneblol17:02
lipinskizaneb: ok - didn't know that was possible to reference  type: <template_url>.  Personally, I agree with shardy that that is ugly, but that will work17:02
*** tomek_adamczewsk has quit IRC17:02
therveIn practice it's not bad :)17:03
lipinskitherve: agreed.  Unless you are making a set of templates that are portable.  (Depending on how file path resolution is done - which I have yet to try)17:03
tspatzierzaneb: do you have a sec? I need a pointer related to a bug I discussed with shardy earlier: https://bugs.launchpad.net/heat/+bug/129776117:03
uvirtbotLaunchpad bug 1297761 in heat "No validation of top-level template keys" [Undecided,New]17:03
zanebtspatzier: sure17:04
tspatzierzaneb: so far we did much of the keyword checking for HOT in the _translate function in HOTemplate, or in the schema classes.17:04
tspatzier_translate does not work for top-level sections since this is called in __geitem__ only. Is there some general validate code as a good entry point?17:05
*** wchrisj has quit IRC17:05
*** duncanjw has joined #heat17:06
*** tomek_adamczewsk has joined #heat17:06
zanebtspatzier: hmm, I take it you don't want to do it in __init__?17:06
tspatzierzaneb: that was one idea. Like introduce a validate func in the template class and let each sub-class implement it.17:06
tspatzierI would probably do nothing in CfnTemplate, but add the code to fix the bug in HOTemplate.17:07
zanebI actually think we should fix CfnTemplate too17:07
tspatzierOk, so we could just check if top-level keys are in SECTIONS17:07
zanebyep, +117:07
zanebbut separate validate() method sounds good17:08
*** alexheneveld has quit IRC17:08
zanebI would call it from approximately here: https://github.com/openstack/heat/blob/master/heat/engine/parser.py#L33817:08
tspatzierOk, let me give it a try. I just wanted to make sure I don't introduce this method if such code is already hidden somewhere else.17:08
*** mestery has joined #heat17:09
*** pvaneck has joined #heat17:09
* zaneb wonders if https://review.openstack.org/#/c/82487/ shouldn't be called from there too17:09
*** alexheneveld has joined #heat17:09
tspatzierzaneb: ok, I would have called the validate() method from __init__ but can also put it there17:10
*** sgordon has joined #heat17:10
*** jistr has quit IRC17:10
zanebtspatzier: if we put it there it might not break Heat if there are existing stacks in the database that don't pass17:11
zaneband we can save a database migration to fix them17:11
zanebmaybe.17:11
tspatzierwe discussed adding a db migrate step for this. You think we could get around it?17:11
*** e0ne_ has quit IRC17:15
*** duncanjw has quit IRC17:16
*** tomek_adamczewsk has quit IRC17:17
*** Slower has quit IRC17:19
*** kgriffs is now known as kgriffs_afk17:22
*** Slower has joined #heat17:27
zanebtspatzier: I think so, iirc Stack.validate() only gets called on create and update, it shouldn't get called on existing templates, so we should be able to improve validation without a db migration17:27
zaneb*should* being the operative word ;) you'd have to check17:27
tspatzierzaneb: thanks. I'll try it out :-)17:28
*** scollier_ has joined #heat17:31
*** scollier has quit IRC17:32
SpamapSI filed a blueprint around validation btw..17:36
*** IlyaE has quit IRC17:37
SpamapShttps://blueprints.launchpad.net/heat/+spec/user-friendly-template-errors17:38
SpamapStspatzier: ^^17:38
SpamapSSomething to consider when talking about validation. If you haven't seen it yet.. our validation errors are.. REALLY painful to actually use.17:38
SpamapS(btw we should never validate things already accepted)17:39
SpamapScrap happens. Just deal with it at runtime for those.17:39
tspatzierSpamapS: thanks for the pointer. I think some of the items are recorded as bugs already. The fix for the bug I am working on will only partly address the bp for now. So overall there will be more work to be done. But I definitely agree this makes sense!17:40
*** julienvey has quit IRC17:40
*** gokrokve_ has quit IRC17:41
*** erecio has joined #heat17:42
*** tspatzier has quit IRC17:48
*** saurabhs has quit IRC17:50
*** IlyaE has joined #heat17:53
*** radez_g0n3 is now known as radez17:57
*** saju_m has joined #heat17:57
*** saurabhs has joined #heat18:00
*** lindsayk has joined #heat18:01
openstackgerritSteven Hardy proposed a change to openstack/heat: Update heat.conf.sample for keystoneclient 0.7  https://review.openstack.org/8315118:01
shardy^^ Looks like a new keystone release just happened and it's breaking us in the gate18:01
*** derekh has quit IRC18:04
shardyhmm, actually that looks wrong18:04
* shardy curses at generate_sample.sh18:04
SpamapSshardy: +2'd.. left a comment, but it seems to me like that is a generated file and thus should be kicked out of the git repo18:04
*** lindsayk has quit IRC18:05
shardySpamapS: I somewhat agree, other than generate_sample.sh sometimes does some crazy stuff and AFAIK all other projects also check theirs in18:05
SpamapSshardy: o/` dramatic music o/`  To the mailing list!!18:06
shardySpamapS: anything which avoids us breaking every keystoneclient release gets +2 from me..18:06
* SpamapS leaps onto the pole leading to the bat cave.. err.. mailing list18:06
shardylike, why has it removed clients_trove and replaced it with repeated duplicate options for clients_swift?!18:08
*** duncanjw has joined #heat18:08
SpamapSsent18:10
SpamapSshardy: ruh roh18:10
zanebshardy: what version of the generate script did you use18:12
zaneb?18:12
shardyzaneb: the version in heat master18:12
*** asalkeld has joined #heat18:12
shardyso, we're broken by keystoneclient, but have no way to update our config?18:13
zanebI just left a comment with a link to the bug causing it, but that shouldn't be present in Heat master...18:13
zaneboh crap18:13
shardyi.e the gate expects whatever wrong stuff generate_sample spits out?18:13
zanebI know why18:13
zanebthe 'fix' in oslo-incubator that caused it was just a temporary workaround18:13
zanebthe 'real fix' was applied to oslo.config18:14
SpamapSzaneb: see my ML post. This is really silly IMO.18:14
zanebso any update to olso.config would break us18:14
* shardy sighs18:14
shardyOk I'll abandon my broken patch and we can work out an alternate plan18:14
zanebSpamapS: haven't got it yet, but will do18:14
SpamapSshardy: Perhaps we can be be pioneers and remove it from our git tree first. :)18:15
* SpamapS completes the drive by and goes to lunch18:15
sdakezaneb if I run heat-manage db_sync shouldn't it call upgrade every time I run it?18:17
sdakeor does it only do so once18:17
*** alexheneveld has quit IRC18:17
*** duncanjw has quit IRC18:18
zanebsdake: it'll upgrade to the latest version I believe18:18
zanebbut once you're at the latest version, there's no more upgrades to do18:19
*** yogesh has joined #heat18:19
sdakeis there any way to get it to un-upgrade18:19
zanebso to test your migration again, you'd downgrade and then upgrade18:19
sdakehow do you downgrade?18:19
zanebgood question, I've never done it with heat-manage18:20
sdakeis has no downgrade command18:20
sdakeoh well I'll figure out how to test htanks18:20
zanebsdake: sounds like a feature we could add ;)18:20
zanebcan you not pass a revision to db-sync?18:21
sdakeyup thta works thanks18:21
sdakezaneb we are going to have to stick with the whitelist - i think it may hav ebeen possible for people to put non-dates in the version field18:23
zanebtrue18:24
zanebmaybe always rewrite non-dates?18:24
sdakeya that could work18:24
sdakeIs there something that parses dates besides date()?18:25
zanebmight be something in openstack.common18:25
sdakei'll check that out18:25
zanebopenstack.common.timeutils uses the iso8601 library18:28
zanebparse_isotime in timeutils might do what you want18:28
shardyzaneb: do you have a handle on what needs to happen re the conf.sample?18:28
zanebshardy: it's a mess18:29
shardyzaneb: I'm about to stop for some dinner before the meeting and would be good to get the gate unblocked18:29
shardyzaneb: agree18:29
zanebI put up patches and they got knocked back18:29
zanebit's hard to find something that works for both us and Nova18:29
sdakezaneb strptime18:29
zanebsdake: that could also work18:30
sdakeparse_isotime includes date and time18:30
*** e0ne has joined #heat18:30
shardyzaneb: Ok, I replied to SpamapS thread saying yes-but-no, I guess we can discuss later18:30
shardybbiab18:30
*** spzala has quit IRC18:41
*** mkollaro has quit IRC18:44
*** andersonvom_ has joined #heat18:45
*** andersonvom has quit IRC18:47
*** mkollaro has joined #heat18:48
*** tango has joined #heat18:51
*** varora has left #heat18:55
*** asalkeld has quit IRC18:57
*** jcru has quit IRC19:03
*** randallburt1 has joined #heat19:03
*** mkollaro has quit IRC19:03
*** randallburt has quit IRC19:03
*** andrew_plunk has quit IRC19:03
*** kgriffs_afk is now known as kgriffs19:04
*** sjmc7 has joined #heat19:07
*** spzala has joined #heat19:08
openstackgerritSergey Kraynev proposed a change to openstack/heat: Initial validation of functions  https://review.openstack.org/8248619:09
openstackgerritZane Bitter proposed a change to openstack/heat: Temporary fix for config file generation  https://review.openstack.org/8317819:10
openstackgerritSergey Kraynev proposed a change to openstack/heat: Validation functions for resources and outputs  https://review.openstack.org/8248719:10
*** wchrisj has joined #heat19:14
*** erecio has quit IRC19:16
openstackgerritSergey Kraynev proposed a change to openstack/heat: Validation functions for resources and outputs  https://review.openstack.org/8248719:18
*** andrew_plunk has joined #heat19:19
*** andrew_plunk has quit IRC19:25
*** sabeen has quit IRC19:33
*** spzala has quit IRC19:38
*** andrew_plunk has joined #heat19:38
openstackgerritSergey Kraynev proposed a change to openstack/heat: Adding validation algorithm for get attr functions  https://review.openstack.org/8248819:39
*** asalkeld has joined #heat19:46
*** john-n-seattle2 has left #heat19:46
*** rbuilta has quit IRC19:47
*** skraynev_afk is now known as skraynev19:54
skraynevzaneb: are you here?19:54
zanebI sure am19:54
*** mspreitz has joined #heat19:54
*** tspatzier has joined #heat19:55
skraynevzaneb: when I validate GetAttr  , I use attribute schema19:55
zaneboh, the meeting is in 5mins?19:55
* zaneb has been looking at next week's calendar all week19:55
zanebskraynev: right19:56
*** bgorski has joined #heat19:56
skraynevzaneb: but if remember we wants that this function also returnt attribute are not presented in attribute schema, but appeared in property schema19:57
zanebsince when?19:57
zanebI've never heard of that19:57
*** randallburt1 has quit IRC19:57
*** jergerber has joined #heat19:58
skraynevHm. in one of review stevebaker said, that we should not duplicate property in attribute schema,  because we could get it from properties19:59
stevebakerhmmwha?19:59
skraynevhe-he, but it's not possible now19:59
zanebI'll let stevebaker take this one ;)20:00
stevebakermeeting time20:00
zanebsaved by the bell20:00
*** andrew_plunk has quit IRC20:01
skraynevdiscuss it later...20:02
*** randallburt has joined #heat20:03
*** radez is now known as radez_g0n320:04
*** jcru has joined #heat20:04
*** kebray has joined #heat20:05
*** andrew_plunk has joined #heat20:05
sdake_stevebaker couple hours until migration patch sorted out20:06
*** e0ne has quit IRC20:07
*** saju_m has quit IRC20:11
*** andersonvom_ has quit IRC20:22
*** andersonvom has joined #heat20:23
*** afarrell has joined #heat20:25
*** jprovazn is now known as jprovazn_afk20:25
afarrellhello - looking to contribute to heat. specifically, tosca translation...20:25
*** afarrell_ has joined #heat20:27
asalkeldhi afarrell20:27
asalkeldwe are in #openstack-meeting20:27
afarrellhi - pleased to meet you20:27
afarrellok, thanks!20:28
SpamapShm20:28
SpamapSCVE-2014-2525 is _critical_ for Heat users.20:28
uvirtbotSpamapS: ** RESERVED ** This candidate has been reserved by an organization or individual that will use it when announcing a new security problem.  When the candidate has been publicized, the details for this candidate will be provided. (http://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2014-2525)20:28
asalkeldlibyaml?20:29
*** saju_m has joined #heat20:30
zanebSpamapS: link?20:30
*** BillArnold has joined #heat20:33
*** david-lyle has quit IRC20:34
SpamapSoh mitre, catch up with the times20:34
SpamapShttps://bugs.debian.org/cgi-bin/bugreport.cgi?bug=74273220:35
uvirtbotDebian bug 742732 in libyaml "libyaml: CVE-2014-2525: input sanitization errors" [Grave,Fixed]20:35
SpamapSasalkeld: correct20:35
SpamapSstevebaker: btw, I made this today.. might be useful to link to it from some software-config docs: https://wiki.openstack.org/wiki/OsCollectConfig20:36
*** saju_m has quit IRC20:37
*** afarrell_ has quit IRC20:38
skraynevzaneb, stevebaker: all is ok, it was bug in my memories. I incorrect rewording stevebakers words about properties. it just was related with that we already know these values and should not present them in attribute schema20:40
*** sabeen has joined #heat20:44
*** sabeen has quit IRC20:44
*** sabeen has joined #heat20:44
stevebakerSpamapS: purdy!20:46
*** BillArnold_ has joined #heat20:49
*** BillArnold has quit IRC20:49
*** varora has joined #heat20:51
*** e0ne has joined #heat20:57
*** kfox1111 has joined #heat20:58
tspatzierafarrell: so you wanted to talk about the TOSCA work?21:01
sdakerandallburt your ug was in response to the mistral workflow idea?21:01
mspreitzI also do not like the mistral answer21:01
zanebrandallburt, skraynev: wait, are we talking parameters or properties?21:01
skraynevrandallburt: original version is default ?21:01
randallburtsdake:  yup21:01
shardySpamapS, stevebaker: has anyone considered making a resource which runs diskimage-builder?21:02
skraynevzaneb: about properties21:02
mspreitzI also think update should not replace default with previous value21:02
* zaneb may have been talking about the wrong thing21:02
randallburtskraynev:  parameters21:02
skraynevhe-he21:02
afarrellthomas - just trying to find the window that your message popped up in!21:02
zanebok, you two decide between you21:02
randallburtshardy:  we have, but its tricky since you'd need a sandboxed environment for building the user's images21:02
stevebakerI was thinking about reimplementing harestarter to "taint" a resource for UpdateReplace then trigger a stack update21:02
zanebwhat the question is, then I'll answer it ;)21:02
shardyrandallburt: can't you just use a VM as the sandbox and implement it via a provider template?21:02
tspatzierafarrell: What time zone are you in? It's getting late here, so would be good to have a chat tomorrow at a time that works for both of us.21:03
shardyrandallburt: then have a URL output as an attribute, which is then passed to an OS::Glance::ImageUploader resource?21:03
skraynevzaneb, randallburt: we could define properties using parameters sections (I think it's possible too)21:03
shardyrandallburt: that is the idea I had while discussing ideas with some Tuskar folks last week21:03
mspreitzshardy: interesting discussion around image building21:04
skraynev zaneb, randallburt: but in reality it's two different situations21:04
openstackgerritJason Dunsmore proposed a change to openstack/heat: Don't use SSH in Rackspace::Cloud::Server  https://review.openstack.org/8321821:04
stevebakershardy: I'd like to try implementing a "work" nested stack which deletes the nested stack when it goes to complete, but captures the outputs. You could perform all sorts of compute tasks with that21:04
zanebskraynev: now I don't even know what you're talking about21:04
openstackgerritRichard Lee proposed a change to openstack/heat: Add admin_pass as attribute to CloudServer  https://review.openstack.org/7274521:04
shardyrandallburt: I'm trying to decide if it's worth hacking out a PoC to see if it works, or if anyone already has21:04
randallburtshardy:  sure, but you'd want to then delete that once you've built and moved the image to Glance. will probably take more time than you've saved in the end.21:04
openstackgerritRichard Lee proposed a change to openstack/heat: Add save_admin_pass property to CloudServer  https://review.openstack.org/7948121:04
afarrellHi Thomas21:04
afarrellI'm in New Zealand - understand that it might be late in CET!21:04
skraynevzaneb: ok. we have resource with property  which has default value []21:05
afarrellSo no worries, I can message later...21:05
tspatzierafarrell: 10am for you now?21:05
skraynevzaneb: create this resource with [val1 , val2]21:05
afarrellYes that's it21:05
shardyrandallburt: the motivation wasn't really time, more definition of the images and usage of the images in one set of templates21:05
zanebskraynev: ok, it is properties right, not parameters because you mentioned prop_diff before21:05
shardystevebaker: Interesting idea21:05
sdakere ha restarter if the implementation is wrong lets fix it, if its in the wrong place lets figure out a migration plan21:05
zanebskraynev: so randallburt is just confusing things ;)21:05
skraynevzaneb: then update this resource using template we this property are not mentioned21:05
randallburtshardy:  I don't have any working code around that is worth keeping, so hack on. I think something like this would have lots of good uses if done right.21:06
zanebskraynev: right, right, I get all that21:06
stevebakersdake: +121:06
sdakezaneb the general "jam it into mistral" seems unsatifying to me because it leaves alot to the imagination21:06
randallburtzaneb, skraynev most likely I am confusing things.21:06
afarrelltspatzier - if you could send email address via linked in, then I will send bio and background info21:06
sdakeeg I think it would end up without a real implementation21:06
shardystevebaker: I was thinking maybe we could do the image building via SoftwareConfig, where you have a SoftwareConfig resource encapsulate the DiB elements, and a deployment hook which runs DiB21:06
skraynevzaneb: =) ok.21:06
randallburtshardy:  seems a little overkill to me21:06
tspatzierafarrell: ok, I'll send you a mail and we go from there. Happy to have the discussion :-)21:06
shardyrandallburt: but I want to play with all the new toys! ;D21:07
stevebakershardy: yes, but in a work stack21:07
skraynevzaneb: solution is using new value or default. right?21:07
randallburtshardy:  lol, there is that ;)21:07
afarrelltspatizer - cool, thanks.  Much appreciated21:07
zanebskraynev: use the default21:07
afarrelltspatizer - have a good eve :-)21:07
*** e0ne has quit IRC21:07
sdakerandallburt does rackspace have any interest in the harestarter functionality being in heat?21:08
stevebakerafarrell: there is this tool too, for tosca -> hot translation http://git.openstack.org/cgit/stackforge/heat-translator/21:08
sdakeor don't really care?21:08
skraynevzaneb: kk21:08
mspreitzre default: REST means use the default21:08
shardystevebaker: In this case, you couldn't delete the stack until the image has been downloaded, so you'd need a signal-driven decommisioning of the work stack21:08
afarrellstevebaker: thanks for the link.  will check it out...21:08
randallburtsdake:  I can't speak for "Rackspace", but I personally don't have strong opinions either way21:08
zanebsdake: HARestarter, and anything else that requires a periodic task, makes scaling heat-engine a pig21:08
sdakei get the periodic task argument21:09
zanebin fact, it probably makes it impossible at the moment21:09
shardyzaneb: HARestarter doesn't require a periodic task if you use ceilometer for alarms21:09
skraynevzaneb: randallburt gave my other idea: what we should to do if this property has reference on parameter21:09
stevebakershardy: we would probably need some manner of glance image21:09
stevebakershardy: glance resource21:09
shardystevebaker: Yeah I was thinking a simple plugin which takes a URL and uploads it21:09
zanebskraynev: um, use the parameter value?21:10
stevebakershardy: yep21:10
skraynevzaneb: yeap. I got answer while describe a situation ;)21:10
stevebakershardy: streaming the image data in a signal response is probably a non-starter ;)21:10
*** tspatzier has quit IRC21:11
*** wchrisj has quit IRC21:11
asalkeldand i was nono'ed for task like resource ideas:/21:11
asalkeldglance uploading ...21:11
mspreitzasalkeld: think of it as returning a value via a reference21:12
skraynevzaneb: we have three ways - use corresponding parameter ,  use default value of parameter if parameter was not passed, get error from client if parameter was not passed and had not default value.21:12
shardystevebaker: I was suggesting you just expose a URL where the image can be downloaded (run httpd on the vm for example) and point the OS::Glance::Uploader resource at it21:12
stevebakershardy: yes. uploading to swift and passing a swift url is another option21:13
mspreitzre default: in a REST interface the input is state, not a delta operation.  The interpretation should be uniform, not depend on previous state.21:13
skraynevzaneb: anyway thx. for the help.21:13
shardystevebaker: Ya, probably a few ways to approach it21:13
zanebimage building and HA-restarting are two examples of things that are workflows (verbs, not nouns), and therefore belong in a workflow service, not in Heat. If we had such a service already we would not be thinking about putting them in Heat21:13
asalkeldmspreitz, what ever makes you feel happy with it;)21:13
* skraynev go to sleep21:13
skraynevgood night all21:14
shardystevebaker: Ok, if nobody's already doing it I may take a look into it21:14
*** skraynev is now known as skraynev_afk21:14
zanebmspreitz: explain PATCH then21:14
*** aweiteka has quit IRC21:14
mspreitzzaneb: OK, I was thinking of PUT21:14
zaneb:)21:14
mspreitzI think UPDATE is more like PUT than PATCH21:14
zanebyes, and in fact it does use PUT21:15
*** afarrell has quit IRC21:15
zanebnow, if there were an option to do PATCH on an update...21:15
stevebakerwe need a PATCH update as well, its not friendly to require restating the template and all parameters21:15
zaneb++21:15
stevebakerwe have a bug for that21:16
mspreitzYes I can see that having both is handy.  Let's not confuse them into one thing21:16
zanebmspreitz: +121:16
*** jprovazn_afk has quit IRC21:16
stevebakera separate workflow service could always trigger work items expressed as heat templates21:17
mspreitzHas anybody tried achieving HA restarting via ASG with alarm on population too low?21:17
stevebakerzaneb: ^21:17
shardymspreitz: Yes, you can have a heartbeat alarm and trigger scale-up if e.g the instance in the group os powered off or crashes21:18
asalkeldmspreitz, how does it know the health?21:18
mspreitzAnd: wouldn't that be off by one (or more) if the ASG is not already on top of this?21:18
zanebstevebaker: yes, in some cases I think that's likely (e.g. triggering stack updates wouldn't be uncommon, most likely)21:18
shardyasalkeld: Is there a ceilo agent now, or do we still bounce stats via heat-api-cloudwatch?21:19
mspreitzThe ASG maintains its own "desired count", what HA restarting is not about changing the "desired count"21:19
SpamapSshardy: that would require an API which runs diskimage-builder21:19
shardylast time I checked we still had to use cfn-push-stats21:19
*** lifeless has quit IRC21:19
asalkeldshardy, it bounces21:19
SpamapSshardy: which people have indeed considered21:19
shardySpamapS: I was suggesting build a VM, install DiB, build image via SoftwareConfig hook, make image available via webserver21:19
stevebakerasalkeld: what does it bounce to? a ceilo API call?21:19
shardySpamapS: e.g via a provider resource21:20
mspreitzasalkeld: right, ceilo today may count instances but not their health21:20
asalkeldstevebaker, yeah redirects at the api21:20
asalkeldfrom heat-cfn to ceilo-api21:20
SpamapSshardy: yet another use case for a vm that goes away before the stack reaches COMPLETE21:20
mspreitzshardy: oh, where do I read about heartbeat alarm?21:20
shardyasalkeld: coolm thanks21:20
stevebakerasalkeld: does python-ceilometerclient cli expose those calls? we could call ceilo directly from the server21:21
asalkeldsure21:21
asalkeldjust auth21:21
SpamapSshardy: I'd want that image to be pushed into swift though, not made available via webserver21:21
asalkeldyou won't want user/pass on the intance21:21
sdakezaneb harestarter as a verb - eg workflow - understand the argument - just need a migration path if it doesn't belong in heat21:21
SpamapSshardy: or even better, glance :)21:21
shardymspreitz: https://github.com/openstack/heat-templates/blob/master/cfn/F17/WordPress_Single_Instance_With_IHA.template21:21
stevebakerasalkeld: the only hard bit would be getting it working with the heat domain credentials21:22
asalkeldSpamapS, we are building this in solum21:22
*** e0ne has joined #heat21:22
SpamapSshardy: Still there's a pretty good use case there for a dedicated API which just builds images for users.21:22
asalkeld(image customization)21:22
SpamapSasalkeld: Yeah thats what I figured, somebody would build an API for that.21:22
SpamapSthough I hope it is based on "at the end the image uploads an image" and not solely on nova snapshots.21:22
SpamapSerr21:22
SpamapSat the end the program uploads an image21:23
asalkeldSpamapS, https://github.com/stackforge/solum/blob/master/solum/builder/controllers/v1/image.py21:23
zanebsdake: the migration path starts with deprecating it so that nobody else gets sucked into using it :)21:23
asalkeldsuper crude atm21:23
shardySpamapS: yeah I was thinking expose a URL to avoid putting credentials in the VM, then have a (python) plugin which does the uploading to glance21:24
asalkeldSpamapS, we might move from that to using jenkins/x-workflow thingy to actually do the building21:25
*** afarrell has joined #heat21:25
SpamapSasalkeld: [ insert image builder heat template here ] is how I'd do it. .. too many ways to skin that cat.21:26
asalkeldSpamapS, it needs to be super fast for docker images21:26
asalkeldso don't want to start vms to build21:27
sdakezaneb i see how it starts not how it ends :)21:27
SpamapSasalkeld: right, so your heat template there is Docker::Container ...21:27
asalkelddocker building on docker is *special*21:27
asalkeldneed special privileges etc..21:28
zanebsdake: a journey of a thousand miles begins with a single step ;)21:29
asalkeldmaybe heat could grow something like nodepoop21:29
asalkeldlol21:29
mspreitzshardy: I see how WordPress_Single_Instance_With_IHA.template checks for health.  But to respond by hitting a scale-up webhook is off, the problem is not the count in the ASG, the problem is that the count has diverged from useful reality21:29
asalkeldSpamapS,  maybe heat could grow something like nodepool21:29
asalkeldand that might be helpful for things like this21:30
asalkeldbut again sounds like workflow workers21:30
*** tspatzier has joined #heat21:30
*** tspatzier has quit IRC21:31
SpamapSasalkeld: Actually that's the second use case for node pool like behavior in Heat I"ve heard this week.21:31
SpamapSasalkeld: the other was for LBaaS where they spin up extra LB nodes and don't assign them to users until a previous one goes down for some reason.21:31
shardymspreitz: No it hasn't, you maintain exactly $n active at any one time21:32
asalkeldyeah we were thinking of it in solum for jenkins workers21:32
asalkeld(as a replacement for nodepool)21:32
mspreitzSpamapS: we are talking about a nodepool resource type, or something built into heat?21:32
stevebakersurely dib isn't safe to run on anything other than a disposable vm21:32
mspreitzshardy: does ASG *maintain* now?21:32
SpamapSmspreitz: just hearing use cases for "pool of similar nodes" in Heat a lot.21:32
SpamapSstevebaker: +121:32
shardymspreitz: I guess we'd need the scale-down parameters to ensure the correct one gets killed on scaledown21:33
shardymspreitz: there is a bp for that21:33
SpamapSstevebaker: but you can have it un-used in a pool waiting to go.. then build.. then dispose.21:33
stevebakerSpamapS: right, I understand21:33
asalkeldstevebaker, or at least run a small number of jobs21:33
asalkeldand then dispose21:33
stevebaker+1 nodepoop21:33
asalkeldto reduce the exposure21:33
asalkeld;)21:33
*** rpothier_ has quit IRC21:34
SpamapSasalkeld: I see no difference between 2 and inifinity in that respect.. the 1st job pwns the box, all others are pwned.21:34
asalkeldsure, actually could also use pause/resume here21:35
mspreitzshardy: maybe I got lost.  As far as I know, ASG does not *maintain* today.  I thought I heard earlier today a suggestion that making an alarm that is triggered by too low working population hit a scale-up policy's webhook could work around lack of maintaining.  Now I think we are agreeing it will not, at least without more stuff going on.21:35
asalkeldcreate 100 vm's and pause them21:35
asalkeldsuspend21:36
mspreitzIf we could make a composite policy that scales down by removing the dead/broken members and then scales up again, that would be a valid response21:37
shardymspreitz: well right now, you can define an alarm which will scale up if there is too low working population, and it will scale back down if the broken node comes back online21:37
shardymspreitz: but there are several other (possibly better) ways to satisfy the HARestarter use-case, some of which I mentioned earlier21:38
mspreitzshardy: that was in the meeting, right?21:39
shardymspreitz: yes, stuff like triggering a node rebuild via an alarm, or doing a signal initiated resource converge21:40
shardyneither of which are possible today21:40
mspreitzshardy: thanks.  Gotta go now.21:40
*** asalkeld is now known as asalkeld_bbq21:44
asalkeld_bbqlater food time21:45
radixhuh I did not notice to_hot21:50
*** randallburt has quit IRC21:51
*** andersonvom has quit IRC21:53
radixshardy: a resource that runs diskimage-builder is a pretty cool idea21:54
*** andersonvom has joined #heat21:54
radixso is one that boots an instance, runs some config, and saves the result as an image21:54
radixmspreitz: "maintain" is probably going to get a lot of attention next cycle, there are several convergence/error correcting blueprints21:57
radixthere's still some question about how the error states will actually be detected21:57
*** kgriffs_afk has joined #heat21:59
*** mspreitz has quit IRC21:59
*** kgriffs_afk has left #heat22:00
*** afarrell has quit IRC22:02
*** afarrell_ has joined #heat22:02
*** blamar has quit IRC22:03
*** andersonvom has quit IRC22:09
*** rcleere has quit IRC22:09
*** achampion has quit IRC22:19
*** vijendar has quit IRC22:23
*** yogesh has quit IRC22:26
kfox1111Is there a way to respond to a review?22:28
radixkfox1111: kinda? you have to add your own review22:28
*** jergerber has quit IRC22:28
kfox1111https://review.openstack.org/#/c/82903/  Thomas left me a review, and the second part says the templates are not hot, but I ran the autoconvert tool on it. Not sure whats not hot about it.22:30
*** andrew_plunk has quit IRC22:31
kfox1111I'm going to post a new version with the documentation change, but don't want to loose track of the other comment.22:31
stevebakerkfox1111: just make sure you keep the same Change-Id in the commit comment22:32
*** jmckind has quit IRC22:37
kfox1111ah. ok. thanks.22:38
*** blamar has joined #heat22:42
kfox1111So, when I ammend the commit, I delete the old commit message and replace it with the new comments, along with keeping the change-id?22:44
radixkfox1111: not sure what you mean about replacing it with the new comments22:44
radixyes, you can update the commit message, just leave the change-id22:44
kfox1111or should I leave the commit message alone, commit the new change, then review it to make the comment?22:45
kfox1111Ah, yeah. I think I see how it works. the comment goes in the top right of the web page. The reviews show up below.22:46
*** IlyaE has quit IRC22:47
openstackgerritKevin Fox proposed a change to openstack/heat-templates: Add a scalable ElasticSearch cluster set of templates in Hot format.  https://review.openstack.org/8290322:48
*** e0ne has quit IRC22:49
stevebakerSpamapS: I'm trying to figure out how to use the new split out deployments json files22:52
*** blamar has quit IRC22:53
stevebakerSpamapS: before I could just have an oac template {{deployments}}22:53
SpamapSstevebaker: they're merged22:54
SpamapSstevebaker: trouble with {{deployments}} is that now you end up having to prefix _everything_ with {{deployments.deploymentname.....}} and deploymentname is not necessarily going to be known22:54
stevebakerSpamapS: but other hooks need the inputs and outputs, thats all gone22:54
SpamapSstevebaker: it isn't gone, or at least, it shouldn't be22:55
SpamapSstevebaker: If it is, file a bug, I meant to leave it behind. Entirely possible I didn't. :P22:55
stevebakerok22:56
SpamapSstevebaker: the config should be gone, but not the inputs.22:56
SpamapSas in, the config part should go into its own file, but deployments and inputs should stay behind22:56
stevebakerSpamapS: where would the inputs be? cfn.json?22:56
SpamapSstevebaker: right22:56
SpamapSstevebaker: though IMO, if you want access.. put it in config.. ;)22:57
SpamapSwhich may be why that use case was lost.. because in my head.. I'm like "no.. don't do that."22:57
*** duncanjw has joined #heat22:57
stevebakerI probably need to do something else for my {{deployments}} template anyway. oac gives it read-everyone permissions22:58
*** harlowja has quit IRC22:58
*** blomquisg has quit IRC23:00
openstackgerritRichard Lee proposed a change to openstack/heat: Add save_admin_pass property to CloudServer  https://review.openstack.org/7948123:00
openstackgerritRichard Lee proposed a change to openstack/heat: Add admin_pass as attribute to CloudServer  https://review.openstack.org/7274523:00
*** arbylee has quit IRC23:00
*** afarrell_ has quit IRC23:03
*** harlowja has joined #heat23:03
*** duncanjw has quit IRC23:06
*** afarrell has joined #heat23:07
SpamapSstevebaker: oac will keep existing perms23:07
SpamapSstevebaker: so install -m 0640 -o root -g root /dev/null /your/dest/file before hand works23:07
*** bgorski has quit IRC23:07
*** Trozz has joined #heat23:10
*** sgordon has quit IRC23:10
*** dims_ has quit IRC23:12
*** kebray has quit IRC23:13
*** blomquisg has joined #heat23:14
*** IlyaE has joined #heat23:14
*** afarrell has quit IRC23:15
openstackgerritSteven Dake proposed a change to openstack/heat: Migrate invalid template versions in database  https://review.openstack.org/8324123:15
openstackgerritZane Bitter proposed a change to openstack/heat: Update heat.conf.sample  https://review.openstack.org/8324223:15
stevebakerSpamapS: ok, use install to install my oac template?23:16
SpamapSstevebaker: no23:17
SpamapSstevebaker: the destination file23:17
SpamapSstevebaker: if it already exists, oac will copy its perms/owner to the new version23:17
stevebakerooooh23:17
stevebakeran empty file23:17
SpamapSright23:17
*** pablosan is now known as ZZpablosan23:18
SpamapSyou can touch and chmod too.. but I'm an install fan myself ;)23:18
*** duncanjw has joined #heat23:18
stevebakerright23:18
SpamapSstevebaker: if you go by the tests I added for deployments support, we left whether or not deployments still exists in 'cfn' undefined.23:20
stevebakerSpamapS: I think I have a fix. do I need to raise a bug?23:20
SpamapSstevebaker: but in the code, I see we delete it from the original.23:20
SpamapSstevebaker: no if you have a fix, just fire away23:21
stevebakerrighto23:21
SpamapSstevebaker: please do make sure we test that though.. so we don't accidentally destroy it again ;)23:21
stevebakeryep23:21
SpamapSstevebaker: I wish all pieces of tripleO were as small as os-collect-config sometimes. :-P23:22
*** nati_ueno has quit IRC23:23
stevebakerits about to get bigger, I'll write a deployment api collector after this23:23
*** nati_ueno has joined #heat23:23
SpamapSstevebaker: I actually wondered about separating this into a new thing, instead of a collector, call it a distributor.23:24
SpamapSstevebaker: that way if we encounter it in the heat native api (instead of cfn) we'd just run through the same code path.23:24
*** faramir1 has joined #heat23:25
stevebakerthat makes sense23:26
*** asalkeld_bbq has quit IRC23:26
*** alexpilotti has quit IRC23:28
*** duncanjw has quit IRC23:29
*** dims_ has joined #heat23:30
*** sjmc7 has quit IRC23:32
*** IlyaE has quit IRC23:37
*** sabeen has quit IRC23:37
*** duncanjw has joined #heat23:38
*** saurabhs has quit IRC23:39
*** Trozz has quit IRC23:40
*** ZZpablosan is now known as pablosan23:43
*** afarrell has joined #heat23:50
stevebakerSpamapS: another thing, you're writing out .json files but much config will not be json syntax23:51
*** QinJin has joined #heat23:56
*** Victor_HU_ has joined #heat23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!