Wednesday, 2014-01-22

stevebakerlifeless: can you cast your mind back to your preserve_ephemeral heat patch?00:00
*** slong has joined #heat00:03
*** gokrokve has quit IRC00:04
*** slong_ has quit IRC00:04
*** gokrokve has joined #heat00:04
* SpamapS would help but EOD00:05
SpamapSstevebaker: we should probably adapt to pass with/without that arg present in novaclient, since it is optional.00:06
SpamapSanyway.. bad timing.. have to run00:06
*** gokrokve has quit IRC00:09
lifelessstevebaker: yes00:13
lifelessstevebaker: wassup ?00:13
*** mkollaro1 has quit IRC00:23
stevebakerlifeless: did you actually have issues passing preserve_ephemeral=False to older novaclient? or was it defensive?00:28
*** rongze has joined #heat00:35
lifelessstevebaker: its a new keyword parameter00:36
lifelessstevebaker: mmm, but yes the older does have **kwargs there00:37
lifelessstevebaker: however, it gets passed down to _action as a **kwargs too00:38
lifelessstevebaker: it's possibly harmless to pass it to earlier versions. Why?00:38
*** topol has joined #heat00:39
*** rongze has quit IRC00:40
stevebakerlifeless: because git master novaclient changes the method signature that needs to be mocked, and I can't see a way of getting mox to handle old and new novaclient https://bugs.launchpad.net/heat/+bug/127136700:41
stevebakerlifeless: one easy fix is to always pass preserve_ephemeral00:41
*** giulivo has quit IRC00:42
lifelesshuh00:43
lifelessI don't see the change in master00:43
lifelesshow did that land without breaking heat in the gate?00:45
*** kebray_ has quit IRC00:45
stevebakerdo we test against released novaclient? That would explain it00:45
*** sgran has quit IRC00:45
lifelessor your unit tests are not run as part of landing novaclient changes00:45
lifelessbut since you run novaclient code, they should be00:46
lifelesswant a bug about that?00:46
lifelessanyhow00:46
lifelessare heat merge proposals now failing check ?00:46
stevebakernot yet. just locally for me with git novaclient00:47
stevebakerit hadn't occured to me that we should gate heat unit tests on client changes00:47
lifelessthe rule is 'if your tests can be broken by a change to X, you should tell X that before X can land their change'00:47
lifelessin general00:48
lifelessso either isolate heat more00:48
lifelessor mutually gate00:48
lifelessanyhow00:48
lifelessyes you may be testing with pip novaclient00:48
lifelesswhich would mean that when novaclient releases you'll have a firedrill00:48
*** sgran has joined #heat00:48
stevebakeryep.00:50
lifelessstevebaker: ok, so - sure, passing preserve_ephemeral unconditionally seems like a reasonable workaround00:51
lifelessits a it uck aesthetically but whatever :)00:51
stevebakerhey, it makes *our* code cleaner ;)00:51
* stevebaker kicks down00:51
*** IlyaE has joined #heat00:53
*** topol has quit IRC00:56
openstackgerritSteve Baker proposed a change to openstack/heat: Always specify preserve_ephemeral on server rebuild  https://review.openstack.org/6829401:06
*** blamar has joined #heat01:08
*** pvaneck has quit IRC01:11
*** blomquisg has quit IRC01:17
*** mestery has quit IRC01:18
*** rpothier has joined #heat01:29
*** blomquisg has joined #heat01:30
*** Linz has quit IRC01:31
*** Linz has joined #heat01:31
*** harlowja has joined #heat01:33
*** nosnos has joined #heat01:35
*** pablosan_ has joined #heat01:43
*** rongze has joined #heat01:46
*** Linz has quit IRC01:46
*** pablosan has quit IRC01:46
*** kebray_ has joined #heat01:46
*** Linz has joined #heat01:51
*** Linz has quit IRC01:51
*** Linz has joined #heat01:51
*** IlyaE has quit IRC02:01
*** renlt has joined #heat02:05
*** rpothier has quit IRC02:08
*** rpothier has joined #heat02:09
*** dims has quit IRC02:11
*** kebray_ has quit IRC02:19
*** michchap has quit IRC02:24
*** michchap has joined #heat02:25
*** andrew_plunk has joined #heat02:28
radixzaneb: thanks for the review02:36
zanebradix: does that explain it better?02:37
radixzaneb: yep :)02:37
zanebcool :)02:37
radixzaneb: by the way, since you're here, I can tell you about the change to the changing_instances function02:37
radixzaneb: basically, it relied on comparing the str() of dicts, and that's broken02:37
radixand unfortunately, there is no "partition" function for lists in Python, so I had to write some for loops with conditionals02:37
zanebbroken in what sense?02:38
radixstr(dict) has an unreliable order of keys. I ran into it in testing02:38
radixthat shourd probably be another patch :)02:38
radixshould*02:39
zanebhmmm02:39
zanebthat's surprising, because strings should have the same hashes02:40
radixit's not the hashing that's the problem, it's the str(dict)02:40
radixit will return keys in different orders02:40
radixbecause dict keys aren't ordered02:41
zanebwell, they're ordered in the order they're found in the hash table ;)02:41
radixright, which is not the sort order of the keys, or in any way reliable02:41
radixI actually had test failures because of it02:42
zanebbut I guess that order depends on the size of the hash table?02:42
zanebintersting02:42
radixand maybe the circumstances of the addition of keys to the dict?02:42
zanebyes, I think depending on how you added keys to the dict that could affect the size of the hash table it's using02:43
zaneband that in turn could affect the key order02:43
zanebtricky02:43
radixanother way to fix that would be to implement an immutable mapping class with a value-based __hash__02:43
radixand still use the same set logic02:43
radixanyway, I can file a separate bug for taht02:44
zanebradix: I suggest using json.dump(template, sort_keys=True)02:44
zanebbut yes, separate bug++ :)02:44
radixoh, that's probably good too :)02:45
zanebthere was a frozendict (immutable dict) class proposed for the standard library once02:46
zanebBDFL rejected it though :/02:46
radixyeah :(02:46
radixthe rationale was pretty... eh, I disagreed with it, I'll say that :)02:46
zanebI haven't actually read it02:46
zanebanyway, not relying on Python serialisation is probably a Good Thing02:47
zanebat some point I want to create a ResourceTemplate class02:48
radixplease don't make it subclass dict :P02:48
zanebthat would just be a template snippet for a resource02:48
*** ktbenton has joined #heat02:48
*** ktbenton has quit IRC02:48
zanebright, yeah the point would be to *not* subclass dict02:48
radix:)02:48
zanebwe need some sort of abstraction for HOT vs cfn02:49
zanebthere is too much poking around in dicts by the resources02:49
zanebanyway, it could be a proper hashable02:50
*** erkules_ has joined #heat02:51
stevebakerzaneb: do we have a set of blueprints for typing of template data?02:51
zanebstevebaker: I'm gonna say yes02:52
zanebby 'typing', you mean...02:52
zanebseparating cfn & HOT?02:52
stevebakerso that our code isn't full of rumaging through dicts02:52
*** erkules has quit IRC02:53
openstackgerritPablo Andres Fuente proposed a change to openstack/heat: HOT templates get_attr allows extra attributes  https://review.openstack.org/6756202:55
*** andrew_plunk has quit IRC03:00
*** slong_ has joined #heat03:01
*** slong has quit IRC03:01
zanebstevebaker: there is this one https://blueprints.launchpad.net/heat/+spec/schema-code-consolidation03:09
zanebstevebaker: but you make a good point, I'm not sure if there are bps for the rest of the stuff that has to happen03:09
stevebakersomething we just need to chip away at I guess03:10
*** liang has joined #heat03:11
openstackgerritLee Li proposed a change to openstack/python-heatclient: Reuse Resource from oslo  https://review.openstack.org/6712003:12
openstackgerritPablo Andres Fuente proposed a change to openstack/heat: Native Pseudo Parameters  https://review.openstack.org/6664003:13
*** ramishra has joined #heat03:13
*** erkules_ is now known as erkules03:18
openstackgerritVijendar Komalla proposed a change to openstack/python-heatclient: python-heatclient stack-abandon support  https://review.openstack.org/6292503:27
openstackgerritVijendar Komalla proposed a change to openstack/heat: Implement adopt-stack  https://review.openstack.org/6273003:28
openstackgerritVijendar Komalla proposed a change to openstack/heat: Implement adopt-stack for nested stacks  https://review.openstack.org/6472003:28
openstackgerritChristopher Armstrong proposed a change to openstack/heat: Make LB-updating in rolling update more reliable  https://review.openstack.org/6831103:32
openstackgerritPablo Andres Fuente proposed a change to openstack/heat: Prevent access Parameters key in template dict  https://review.openstack.org/6831203:38
*** slong has joined #heat03:43
*** slong_ has quit IRC03:43
*** harlowja is now known as harlowja_away03:54
*** gokrokve has joined #heat03:55
openstackgerritLee Li proposed a change to openstack/python-heatclient: Remove unused method 'bool_from_string' from utils  https://review.openstack.org/6831703:58
openstackgerritLiang Chen proposed a change to openstack/heat: Marconi message queue resource implementation  https://review.openstack.org/6103604:23
*** akuznetsov has joined #heat04:25
*** spzala has quit IRC04:28
*** gokrokve has quit IRC04:28
liangtherve, there?04:28
*** gokrokve has joined #heat04:29
*** arbylee has joined #heat04:45
*** nkhare has joined #heat04:48
*** arbylee has quit IRC04:49
*** rongze has quit IRC04:52
*** gokrokve has quit IRC04:53
*** faramir1 has joined #heat04:57
*** faramir1 has quit IRC05:03
*** chandankumar_ has joined #heat05:08
*** rongze has joined #heat05:23
*** gokrokve has joined #heat05:25
openstackgerritAngus Salkeld proposed a change to openstack/heat: Update olso gettextutils  https://review.openstack.org/6775805:26
openstackgerritAngus Salkeld proposed a change to openstack/heat: Update oslo db  https://review.openstack.org/6775905:26
openstackgerritAngus Salkeld proposed a change to openstack/heat: Update oslo modules  https://review.openstack.org/6775705:26
*** rongze has quit IRC05:28
*** rongze has joined #heat05:35
*** rongze has quit IRC05:40
openstackgerritA change was merged to openstack/heat: new method 'HeatTestCase.patchobject'  https://review.openstack.org/6723405:45
openstackgerritA change was merged to openstack/heat: heat_keystoneclient migrate auth_token/service_catalog to v3 API  https://review.openstack.org/6664905:51
openstackgerritA change was merged to openstack/heat: Turn block_device_mapping.volume_size to int  https://review.openstack.org/6680405:51
*** e0ne has joined #heat05:53
openstackgerritA change was merged to openstack/heat: Fix incorrect resource types in docs/comment/code  https://review.openstack.org/6740405:53
openstackgerritA change was merged to openstack/heat: Refactor MySQL long text support  https://review.openstack.org/6740605:54
openstackgerritA change was merged to openstack/python-heatclient: Raise traceback on error when using CLI and -debug  https://review.openstack.org/6613605:54
*** e0ne has quit IRC05:54
*** IlyaE has joined #heat06:02
*** blamar has quit IRC06:08
*** IlyaE has quit IRC06:10
*** aignatov_ is now known as aignatov06:17
*** rongze has joined #heat06:17
*** pablosan_ has quit IRC06:20
*** blamar has joined #heat06:23
*** IlyaE has joined #heat06:26
*** tzumainn has quit IRC06:30
*** IlyaE has quit IRC06:32
*** nosnos_ has joined #heat06:43
*** nosnos has quit IRC06:43
*** tomek_adamczewsk has joined #heat06:54
shardymorning all07:16
*** aignatov is now known as aignatov_07:20
skraynevhello guys07:21
skraynevSpamapS: sorry, I read your message just now.07:22
*** ramishra has quit IRC07:27
*** ramishra has joined #heat07:28
*** ramishra has quit IRC07:32
*** Linz has quit IRC07:38
*** Linz has joined #heat07:41
*** jistr has joined #heat07:43
*** aignatov_ is now known as aignatov07:54
*** e0ne has joined #heat07:54
*** ramishra has joined #heat07:56
openstackgerritJenkins proposed a change to openstack/heat: Imported Translations from Transifex  https://review.openstack.org/6450407:59
*** yogesh has joined #heat08:00
skraynevshardy: have you a one minute?08:01
sgranhi all08:05
sgranI'm a little confused, I think08:05
sgranin the grizzly neutron/loadbalacner resource, it seems that you must supply an address to the vip, although the neutron api doesn't mandate this08:05
*** jprovazn has joined #heat08:06
sgranin HEAD, it looks like this might not be the case any more?  I'm not sure, though08:06
*** aignatov is now known as aignatov_08:06
sgranI was just going to start looking at how to make it an optional parameter, but it looks like it might already be optional - I wanted to check and see if anyone knows for sure08:06
thervesgran, I know for sure it's optional08:08
shardyskraynev: Hi, sure08:16
skraynevshardy: I only wanted ask you about how do we get updated list of requirements?08:17
*** ramishra has quit IRC08:18
skraynevshardy: I mean: Should it be automatically or somebody make patch with this changes (fetch changes from global-requirements)?08:18
shardyskraynev: You get the patch merged into openstack/requirements then there is a bot which automatically sends us a patch syncing us to the global requirements repo08:18
*** renlt has quit IRC08:18
shardyskraynev: previously it was a manual process, but AFAIK it's all automated now08:19
skraynevshardy: Well, I agree with you. I asked, because it's confused see bot's patch https://review.openstack.org/#/c/68240/ and other manual https://review.openstack.org/#/c/68017/08:20
skraynevshardy: I understand, that it different changes, but I worry, that it;s right way. Should we review and approve manual patches now?08:22
*** SergeyLukjanov_ is now known as SergeyLukjanov08:23
shardyskraynev: I would prefer we worked out why the automated sync is wrong08:23
shardyskraynev: It would not be the first time the bot got broken and the automated sync was wrong..08:24
*** tomek_adamczewsk has quit IRC08:24
shardybut we should ping the infra guys and work out what is broken08:24
shardyskraynev: Your patch hasn't yet merged?08:27
shardyhttps://github.com/openstack/requirements/blob/master/global-requirements.txt08:27
skraynevshardy: not yet, it wait approve)08:27
shardySo it's impossible to merge the manual patch anyway, it should be abandoned and we should chase some folks to approve the requirements patch08:28
sgrantherve: thank you :) That saved me some effort.  Now to backport that ...08:31
skraynevshardy: well, when autosync will be to work correct, should we add -1 to manual update patch?08:31
shardyskraynev: I already have08:32
skraynevshardy: yeap) I have gotten your comments in ML notification)08:33
thervesgran, To grizzly? That might be a tough one08:34
sgranyes, I expect it to be :)08:34
sgraner, no, sorry08:34
sgranI was working against grizzly08:34
sgranI've upgraded my test setup to havana08:34
sgranso less so08:34
sgransorry, more coffee needed :)08:34
therveYou get a lot of other benefits in Havana, too08:34
sgranyeah, I'm tying up a few loose ends before wider deployment now08:35
shardysgran: That would definitely be my suggestion, Havana unless you're really stuck with grizzly08:35
sgranso far I'm really happy08:35
sgranbut it will still be a little work to backport the patch - I see you've rewritten the way schemas are validated08:35
shardysgran: Have you figured out which bug # needs to be backported?08:37
sgranI don't think there is a bug number08:37
sgranI think that when the schema validation was redone, the status changed from required to optional08:37
therveHum that would surprise me08:37
shardyOk, or the patch which fixed it, we'll definitely need a bug and a reference to a commit in master to do a stable/havana backport08:38
sgranI'm looking at db4f855eb8c7675aec8510b0056056057925282a08:38
shardysgran: Normally, you'd mark an existing fix committed bug as havana-backport-potential so the PTL will spot it08:38
sgranhttp://paste.debian.net/77737/08:39
sgranI'll investigate today and see if I can come up with anything08:39
sgranI might also just live with a local patch.  Icehouse isn't that far away08:39
thervesgran, Yeah that changes the syntax, but the meaning is the same08:40
therveIt wasn't required at that time08:40
sgranok08:40
sgranthen let me figure out what's going wrong - it definitely doesn't work in havana without an address being passed.  I'll see if I can see if it's just a bug.  I thought that the absence of a default meant that it was required and stopped there08:40
shardysgran: please don't live with a local patch if it's are real problem, report it as a bug so we can backport something & other users can benefit08:42
shardys/are/a08:42
*** cmyster has joined #heat08:44
sgransure.  As I say, I thought it was just a schema issue that's now resolved.  From what I'm hearing, it might be a real bug08:44
sgranI'll let you know later today08:44
*** cmyster has quit IRC08:45
*** giulivo has joined #heat08:45
*** cmyster has joined #heat08:46
openstackgerritSergey Kraynev proposed a change to openstack/heat: Adding first_address attribute for port resource  https://review.openstack.org/6783608:51
*** tsmadds has joined #heat08:55
*** derekh has joined #heat09:03
openstackgerritZhang Yang proposed a change to openstack/heat: add the validation of MaxSize ,MinSize and DesiredCapacity  https://review.openstack.org/6761809:08
*** aignatov_ is now known as aignatov09:10
sgranok, so, ignore me09:14
sgranit works just fine.  I definitely have it on my TODO list as not working, but this might be from an earlier snapshot09:15
sgranbut the version in havana is fine, so sorry to waste people's time :)09:15
*** derekh has quit IRC09:18
*** mkollaro has joined #heat09:24
*** SergeyLukjanov is now known as SergeyLukjanov_a09:27
*** SergeyLukjanov_a is now known as SergeyLukjanov_09:28
*** ramishra has joined #heat09:29
*** Linz has quit IRC09:32
*** ramishra has quit IRC09:33
*** ramishra has joined #heat09:34
*** aignatov is now known as aignatov_09:34
*** Linz has joined #heat09:35
*** aignatov_ is now known as aignatov09:37
*** jistr has quit IRC09:37
*** SergeyLukjanov_ is now known as SergeyLukjanov09:40
*** SergeyLukjanov is now known as SergeyLukjanov_09:47
*** aignatov is now known as aignatov_09:49
*** aignatov_ is now known as aignatov09:53
openstackgerritJun Jie Nan proposed a change to openstack/heat: A cloud-config resource based on SoftwareConfig  https://review.openstack.org/6321409:54
openstackgerritJun Jie Nan proposed a change to openstack/heat: A multipart cloud-init resource based on SoftwareConfig  https://review.openstack.org/6321509:54
openstackgerritJun Jie Nan proposed a change to openstack/heat: Resource type for software configuration  https://review.openstack.org/6762109:54
openstackgerritJun Jie Nan proposed a change to openstack/heat: A cloud-config resource based on SoftwareConfig  https://review.openstack.org/6321409:56
openstackgerritJun Jie Nan proposed a change to openstack/heat: A multipart cloud-init resource based on SoftwareConfig  https://review.openstack.org/6321509:56
*** jistr has joined #heat09:57
*** alexpilotti has joined #heat09:58
liangtherve, Hi10:10
therveliang, Hello!10:10
liangtherve, thanks for the review - https://review.openstack.org/#/c/61036/610:11
liangI just talk to Marconi people, and we agree that the version info should be taken care of by the client lib10:12
*** akuznetsov has quit IRC10:12
therveYeah that all version in the endpoint thing is weird10:12
liangyeah10:13
*** akuznetsov has joined #heat10:13
therveliang, Presumably we can wait for the client change to land then?10:13
liangtherve,  well, it will make the endpoint configuration easier. But perhaps we can still proceed with the plugin patch?10:15
liangtherve,  BTW, I don't very get what you mean exactly by "directories are missing __init__.py files"10:16
liangI don't quite get ...10:17
therveOh10:18
*** yogesh has quit IRC10:18
therveliang, forget it, it's just that they are empty so no created by the diff, sorry10:18
therveliang, I'm a bit reluctant to merge something that doesn't work out of the box with devstack. But I don't want to block your work either10:19
liangtherve, no worries. I feel the same way actually, that why I made this attempt - https://review.openstack.org/#/c/60754 . Thanks for the review again ;)10:20
*** derekh has joined #heat10:35
*** liang has quit IRC10:39
shardyAnyone else having issues with the review interface jumping to the wrong location when you try to add a comment today?10:43
cmysterI had an issue with firefox crashing altogether10:47
cmysterin review that is10:48
cmysterbut I'm not adding comments yet...10:49
shardycmyster: I seem to have the opposite problem, firefox 26.0 works but Chrome 32.0.1700.77 doesn't10:50
cmysteridk, ff  24.0 kept crashing, chrome latest works fine but as I said I am not inserting comments yet10:51
cmystershardy: pm ?10:56
shardycmyster: ?10:57
cmysterjust need a quick private question if you don't mind10:57
shardycmyster: Ok, but in general you can just ask heat questions here10:58
cmysterI know10:58
*** michchap has quit IRC11:06
*** michchap has joined #heat11:06
*** amritanshu_RnD has joined #heat11:08
*** gokrokve has quit IRC11:11
*** e0ne_ has joined #heat11:17
*** e0ne has quit IRC11:21
*** aignatov is now known as aignatov_11:26
*** rongze has quit IRC11:26
*** rongze has joined #heat11:27
*** yogesh has joined #heat11:28
*** derekh has quit IRC11:29
*** rongze has quit IRC11:31
*** yogesh has quit IRC11:33
*** jeju has joined #heat11:34
jejuhi11:34
jejuwhere can I get some heat templates to test autoscaling with ceilometer?11:35
shardyjeju: https://github.com/openstack/heat-templates/blob/master/cfn/F17/AutoScalingCeilometer.yaml11:36
shardyYou may need to tweak it slightly to work with Fedora20 or some other distro11:36
*** mkollaro has quit IRC11:36
jejushardy, thanks...but I forgot to mention that I don't want to use loadbalancer :|11:37
shardyjeju: You'll have to cut/paste your own template then11:38
shardyjeju: we welcome contributions if you find the existing examples don't contain what you need11:40
shardyAlso note there's a minimal template example for every resource in the template guide:11:40
shardyhttp://docs.openstack.org/developer/heat/template_guide/index.html11:41
jejushadower, actually i'm trying this template: http://pastebin.com/V7NYJDvR11:41
jejuops11:41
jejushardy,  actually i'm trying this template: http://pastebin.com/V7NYJDvR11:41
jejui'm using devstack, my stack is deployed correctly,but no alarm is triggered :(11:42
shardyjeju: I'd use the ceilometer CLI tool to check the alarms have been correctly created, then check the heat-engine logs for errors around the alarm notification11:44
cmysteris it not being triggered or not being sent/received11:44
shardySounds like probably a ceilometer issue11:45
jejushardy, mmm alarm-list returns an empty table :|11:48
shardyjeju: but the ceilometer alarm resources are CREATE_COMPLETE?11:48
shardyheat resource-list <stack>11:48
jejushardy, CPUlarmHigh | OS::Ceilometer::Alarm  | CREATE_COMPLETE | 2014-01-22T11:49:08Z11:50
*** aignatov_ is now known as aignatov11:50
jejushardy, mmm maybe I spotted a problem http://pastebin.com/nWyUVYuW11:53
jejuinsufficient data!?11:53
shardyIt means the alarm has insufficient metric datapoints to evaluate against the threshold11:54
shardymaybe the ceilometer agent collecting cpu metrics is not working or enabled?11:54
jejushardy, in the ceilometer-acompute screen I see:11:55
jeju2014-01-22 12:53:52.000 17335 AUDIT ceilometer.pipeline [-] Flush pipeline cpu_pipeline11:55
jejuso I think is working...11:56
jejuhow can I check?11:56
shardyjeju: some combination of ceilometer meter-list and sample-list I guess11:57
* shardy is not a ceilometer expert11:58
shardythere are folks over in #openstack-metering who I'm sure can help11:58
jejushardy, thank you :)11:59
*** gokrokve has joined #heat12:06
*** nkhare has quit IRC12:06
*** ramishra_ has joined #heat12:09
*** rongze has joined #heat12:09
*** ramishra has quit IRC12:11
jejuanother question... have I to use an image with the cnftools to works with that template? Like F17-x86_64-cfntools or can I use a normal cloud image  https://fedoraproject.org/en/get-fedora#clouds ?12:12
*** gokrokve has quit IRC12:12
*** sergmelikyan has quit IRC12:12
shardyjeju: From Fedora20 the normal cloud image contains heat-cfntools, so you can just use that12:13
jejushardy, thanks :)12:13
*** tspatzier has joined #heat12:13
shardyjeju: There are pre-built older images here: http://fedorapeople.org/groups/heat/prebuilt-jeos-images/12:13
*** rongze has quit IRC12:14
*** dims has joined #heat12:14
jejummm...can I manually trigger an alarm for test pourposes?12:15
*** ifarkas has quit IRC12:16
*** bgorski has joined #heat12:17
*** ifarkas has joined #heat12:17
shardyjeju: Yes, try ceilometer alarm-state-set12:19
*** asalkeld has quit IRC12:19
shardyalso you can curl -X POST the URL of the ScalingPolicy directly, removing ceilometer from the loop completely12:19
jejushardy, thanks!!12:21
*** alexpilotti has quit IRC12:22
*** aignatov is now known as aignatov_12:26
jejubye!12:31
*** jeju has quit IRC12:31
*** rongze has joined #heat12:39
*** rpothier has quit IRC12:53
*** SnowDust has joined #heat12:53
*** scollier has joined #heat12:57
openstackgerritThomas Herve proposed a change to openstack/heat: Don't pass empty security groups in port creation  https://review.openstack.org/6807312:58
*** gokrokve has joined #heat13:01
*** gokrokve has quit IRC13:06
sdakemorning13:07
shardyHi sdake13:08
*** ramishra_ has quit IRC13:10
*** aignatov_ is now known as aignatov13:11
*** tsmadds has quit IRC13:19
*** radez_g0n3 is now known as radez13:21
*** tsmadds has joined #heat13:21
*** tspatzier has quit IRC13:24
*** tspatzier has joined #heat13:25
*** aweiteka has joined #heat13:29
*** tspatzier has quit IRC13:35
*** gilliard has joined #heat13:35
*** tspatzier has joined #heat13:35
*** derekh has joined #heat13:35
*** rongze has quit IRC13:37
*** blomquisg has quit IRC13:38
*** rpothier has joined #heat13:39
*** jdob has joined #heat13:39
*** achampion has quit IRC13:39
*** pafuent has joined #heat13:43
*** rongze has joined #heat13:47
*** SnowDust has quit IRC13:49
*** akuznetsov has quit IRC13:49
*** tnurlygayanov_ has joined #heat13:51
*** tnurlygayanov has quit IRC13:51
*** aignatov is now known as aignatov_13:57
*** mestery has joined #heat13:57
*** tzumainn has joined #heat14:01
*** gokrokve has joined #heat14:02
*** akuznetsov has joined #heat14:04
*** gokrokve has quit IRC14:06
*** jasond` has joined #heat14:07
*** aignatov_ is now known as aignatov14:09
*** mkollaro has joined #heat14:10
*** ramishra has joined #heat14:11
*** tspatzier has quit IRC14:11
*** matsuhashi has joined #heat14:14
*** rongze_ has joined #heat14:14
sdakehttp://imgur.com/n7l6n8C14:15
*** ramishra has quit IRC14:16
*** rongze has quit IRC14:16
cmystermornin sdake14:17
*** rongze has joined #heat14:17
*** rongze_ has quit IRC14:19
*** Linz has quit IRC14:19
*** Linz has joined #heat14:19
*** jcru has joined #heat14:20
sdakehey cmyster14:20
cmysterI'm going over all the docs I can find. will start working with you soon enough ;)14:20
radixshardy: replied to your review. basically, there aren't two resources we're comparing - just a resource and a template14:21
radix(also, good morning heaters)14:21
*** vijendar has joined #heat14:21
shardyradix: Yeah, I was wondering if we should just create the resource objects to compare14:22
shardymaybe that's too much overhead though14:22
*** rongze_ has joined #heat14:22
radixyou mean by applying the update? that would start disabling the instances before we have a chance to remove them from the LB14:22
radixwhich is the purpose of this function, to determine which instances to remove from the LB temporarily during an update14:22
openstackgerritPablo Andres Fuente proposed a change to openstack/heat: Use a HeatIdentifier instance to create Parameters  https://review.openstack.org/6825714:23
shardyNo, I just mean use the template to create an object (not to actually create anything, just a transient resource object which we discard)14:23
shardyMaybe it's a dumb idea, it was a pre-coffee review :)14:23
radixhehe :) well, I guess that would work, but it does seem like unnecessary LoC14:24
radixI'm not super happy about converting them to a string fwiw, but unfortunately frozendict doesn't exist :)14:25
*** rongze has quit IRC14:25
*** arbylee has joined #heat14:27
pscheieI'm trying to spin up a stack but getting a 'quota exceeded' error, says I've already used 998912 of 100000014:31
pscheieBut in nova quota-show, it says the quota is 5000000 (because I just set it to that)14:31
*** alexpilotti has joined #heat14:31
pscheieIs there some place else quotas on memory are imposed?14:32
*** ramishra has joined #heat14:32
shardyzaneb: around?14:35
*** andersonvom has joined #heat14:41
*** Linz has quit IRC14:43
*** arbylee has quit IRC14:43
*** arbylee has joined #heat14:44
*** matsuhashi has quit IRC14:45
*** pablosan has joined #heat14:48
*** rongze_ has quit IRC14:49
pscheieSo, it appears that while I've raised the RAM quota for a specific tenant, it's the default quota limit that I'm hitting for some reason.14:49
openstackgerritPablo Andres Fuente proposed a change to openstack/heat: Native Pseudo Parameters  https://review.openstack.org/6664014:50
pscheieEven though I'm exporting the OS_TENANT_NAME env variable when calling heat.14:50
openstackgerritSwann Croiset proposed a change to openstack/heat: Add autoscaling notifications  https://review.openstack.org/6208714:53
scroisetradix, stevebaker : ^^^^ should address your concerns. Let me know14:54
*** tims has joined #heat14:56
openstackgerritPablo Andres Fuente proposed a change to openstack/heat: Prevent access Parameters key in template dict  https://review.openstack.org/6831214:56
*** bvandenh has quit IRC14:57
*** nosnos_ has quit IRC14:57
*** tims1 has joined #heat14:58
*** tspatzier has joined #heat14:59
*** arbylee1 has joined #heat15:00
*** tims has quit IRC15:00
*** arbylee1 has quit IRC15:00
*** arbylee1 has joined #heat15:01
*** alexpilotti has quit IRC15:01
*** gokrokve has joined #heat15:03
*** arbylee has quit IRC15:04
*** rongze has joined #heat15:05
*** dims has quit IRC15:08
*** gokrokve has quit IRC15:08
*** dims has joined #heat15:09
*** gokrokve has joined #heat15:09
radixhmm15:12
radixI guess heat has lots of code in __init__.py files15:12
*** alexpilotti has joined #heat15:15
*** achampion has joined #heat15:20
*** rongze has quit IRC15:22
openstackgerritAnderson Mesquita proposed a change to openstack/heat: Add API support for stack preview  https://review.openstack.org/6840615:27
openstackgerritAnderson Mesquita proposed a change to openstack/heat: Add StackResource specific preview behavior  https://review.openstack.org/6840715:27
openstackgerritAnderson Mesquita proposed a change to openstack/heat: Add preview for NestedStack  https://review.openstack.org/6840815:27
openstackgerritAnderson Mesquita proposed a change to openstack/heat: Add preview for ResourceGroup  https://review.openstack.org/6840915:27
openstackgerritAnderson Mesquita proposed a change to openstack/heat: Add preview for InstanceGroup  https://review.openstack.org/6841015:27
openstackgerritAnderson Mesquita proposed a change to openstack/heat: Add preview for TemplateResource  https://review.openstack.org/6841115:27
openstackgerritAnderson Mesquita proposed a change to openstack/heat: Add preview for LoadBalancer  https://review.openstack.org/6841215:27
openstackgerritAnderson Mesquita proposed a change to openstack/heat: Add engine preview stack with Template and Params  https://review.openstack.org/6557615:27
*** blomquisg has joined #heat15:28
*** SergeyLukjanov_ is now known as SergeyLukjanov15:33
*** amritanshu_RnD has quit IRC15:43
*** akuznetsov has quit IRC15:47
*** cmyster has quit IRC15:47
*** aignatov is now known as aignatov_15:49
*** cmyster has joined #heat15:51
therveGod neutron15:51
therveWhy are you so awful15:52
*** akuznetsov has joined #heat15:55
*** jprovazn has quit IRC15:58
*** chandankumar_ has quit IRC15:58
radixheh15:59
*** nkhare has joined #heat16:00
*** achampio1 has joined #heat16:00
*** achampion has quit IRC16:00
*** chandankumar_ has joined #heat16:01
*** sballe has joined #heat16:02
*** jamieh has joined #heat16:02
*** rcleere has joined #heat16:02
*** achampio1 has quit IRC16:04
*** achampion has joined #heat16:05
*** gokrokve has quit IRC16:05
*** andersonvom1 has joined #heat16:06
*** andersonvom is now known as Guest6328616:06
*** andersonvom1 is now known as andersonvom16:06
*** SergeyLukjanov is now known as SergeyLukjanov_a16:07
*** Guest63286 has quit IRC16:07
*** SergeyLukjanov_a is now known as SergeyLukjanov_16:08
*** achampion has quit IRC16:09
*** achampion has joined #heat16:10
zanebshardy: pong16:10
shardyzaneb: Hey, quick question about the new update code..16:10
shardywhereabouts do we compare the old/new resource to see if it needs updating?16:11
zanebit moved recently16:11
shardyI couldn't spot it post-refactor16:11
zanebI think it's now in the resource itself16:11
*** arbylee has joined #heat16:12
zanebhttps://github.com/openstack/heat/blob/master/heat/engine/resource.py#L50716:12
*** arbylee has quit IRC16:12
*** arbylee has joined #heat16:12
zanebhttps://github.com/openstack/heat/commit/c22d7e317af9fbc1140fed0fa496cdb791dd76f116:12
zanebshardy: ^16:12
shardyzaneb: Aha, I think I even reviewed that patch then completely forgot about it :)16:13
shardyzaneb: thanks16:13
zanebnp :)16:13
bgorskiHi all16:13
shardyzaneb: This is ref my comment on radix's patch https://review.openstack.org/#/c/68311/16:13
shardyzaneb: I was trying to figure out if there's a cleaner, more update-ish way to do the comparison there16:13
bgorskiI was off for awhile.16:14
shardybgorski: o/16:14
*** kebray_ has joined #heat16:14
*** pafuent has quit IRC16:14
bgorskiI have a question about changing the requirements16:14
zanebshardy: there is, but not for now16:14
bgorskiI need to bump up the keystoneclient version to the 0.4.216:14
*** arbylee1 has quit IRC16:15
bgorskiWhat is the right way to do that?16:15
zanebshardy: as I was saying to radix last night, what I want to do is to implement a ResourceTemplate class. That will help us abstract the differences between HOT and cfn templates, and we can also make it hashable16:15
shardybgorski: submit a patch to openstack/requirements, then a bot will propose a change to heat syncing after it gets merged16:15
shardyzaneb: Ok, sounds good - I couldn't get away from the feeling that comparing sets of json strings wasn't the way to go long term16:16
zanebshardy: agreed, long term there are better ideas. short term this is pretty good16:17
shardybut I didn't have any fully-formed idea of a good alternative :)16:17
zanebI'll leave a comment to that effect16:17
shardyzaneb: Ok, I'll remove my objection on the patch - if you could comment re the vision for future refactoring that would be helpful, thanks16:18
shardybgorski: https://github.com/openstack/requirements16:19
*** aignatov_ is now known as aignatov16:19
*** _ruhe is now known as ruhe16:20
*** denis_makogon has quit IRC16:20
radixzaneb, shardy: shall I add a comment to the code?16:22
radixmaybe we should have a placeholder blueprint to point at?16:22
zanebtbh I don't think a comment is necessary16:23
radixokie doke16:23
zaneba blueprint is a good idea though16:23
zanebI'll raise one16:23
shardy+1 blueprint and a comment on the review should be enough16:24
*** denis_makogon has joined #heat16:25
bgorskishardy, Thx for info I will do that16:26
*** SergeyLukjanov_ is now known as SergeyLukjanov16:28
bgorskishardy, the patch with the change I need is already in progress https://review.openstack.org/#/c/66494/16:32
*** ramishra has quit IRC16:32
*** radez has quit IRC16:33
*** jomara_ has quit IRC16:33
shardybgorski: all you can do is +1 it and wait then16:33
*** sgordon` has quit IRC16:33
*** aweiteka has quit IRC16:34
*** blomquisg has quit IRC16:34
*** pafuent has joined #heat16:36
radixzaneb: are you suggesting serialize_template be just a local in the changing_instances function, or up at the module level?16:40
zanebradix: just a local is fine16:40
radixok16:40
zanebor module level is fine16:40
zanebeither is fine ;)16:40
zanebbut I was assuming local16:40
*** nkhare has quit IRC16:41
*** ramishra has joined #heat16:42
openstackgerritChristopher Armstrong proposed a change to openstack/heat: Make LB-updating in rolling update more reliable  https://review.openstack.org/6831116:42
*** aignatov is now known as aignatov_16:42
*** e0ne_ has quit IRC16:43
*** mkollaro has quit IRC16:44
zanebradix, shardy: https://blueprints.launchpad.net/heat/+spec/resource-template-api16:44
*** radez has joined #heat16:44
*** jomara has joined #heat16:45
*** aweiteka has joined #heat16:45
openstackgerritRandall Burt proposed a change to openstack/heat: Refactor CLB to work with groups  https://review.openstack.org/6558616:45
*** cmyster has quit IRC16:45
*** ramishra has quit IRC16:46
*** blomquisg has joined #heat16:47
*** funzo has quit IRC16:47
*** funzo has joined #heat16:47
*** randallburt has joined #heat16:53
*** jomara has quit IRC16:55
*** aweiteka has quit IRC16:55
*** radez has quit IRC16:55
*** john-n-seattle1 has joined #heat16:56
*** blomquisg has quit IRC16:57
pafuentjasond: jasond`: Are you around?17:04
jasond`pafuent: yes17:05
jasond`pafuent: was just about to reply to you17:05
zanebpafuent: thanks for that comment on the function-plugins blueprint, I completely agree17:05
*** radez has joined #heat17:06
openstackgerritBartosz Górski proposed a change to openstack/heat: Adding option in config to specify region name  https://review.openstack.org/4333517:07
pafuentjasond`: Ok. Thanks. I was looking for you regarding to that. Sorry for the anxiety ;)17:07
*** Linz has joined #heat17:07
*** aweiteka has joined #heat17:08
jasond`pafuent: no problem.  i just replied17:08
pafuentzaneb: You are welcome17:09
*** jomara_ has joined #heat17:10
*** SergeyLukjanov is now known as SergeyLukjanov_17:10
openstackgerritPablo Andres Fuente proposed a change to openstack/heat: HOT templates get_attr allows extra attributes  https://review.openstack.org/6756217:14
*** pshchelo has quit IRC17:15
*** aweiteka has quit IRC17:15
*** jomara_ has quit IRC17:15
*** radez has quit IRC17:16
*** bgorski has quit IRC17:18
*** SergeyLukjanov_ is now known as SergeyLukjanov17:18
*** jomara_ has joined #heat17:20
*** Linz has quit IRC17:21
*** radez has joined #heat17:22
*** chandankumar_ has quit IRC17:24
*** aweiteka has joined #heat17:25
*** SergeyLukjanov is now known as SergeyLukjanov_17:28
*** sjmc7 has joined #heat17:28
*** pvaneck has joined #heat17:28
*** chandankumar_ has joined #heat17:29
*** jmckind has joined #heat17:30
*** jistr has quit IRC17:32
randallburtandersonvom:  could you update https://blueprints.launchpad.net/heat/+spec/preview-stack with example output? I'm having a hard time understanding the "why" of https://review.openstack.org/#/c/6841217:32
*** blamar_ has joined #heat17:40
andersonvomrandallburt: I'll take a look at it. but that was really just because LoadBalancer is technically a StackResource17:43
*** blamar has quit IRC17:43
*** blamar_ is now known as blamar17:43
randallburtandersonvom:  thanks17:43
openstackgerritAnderson Mesquita proposed a change to openstack/heat: Add preview for LoadBalancer  https://review.openstack.org/6841217:46
andersonvomrandallburt: changed the commit message to make that clear17:46
*** julienvey has left #heat17:46
andersonvombut I'll look into the bp as well17:47
randallburtandersonvom:  cool. that part I kinda got, its just the looking for the KeyPair stuff that confused me.17:47
andersonvomrandallburt: yeah, since it's a stackresource, it needs a template to be parsed, and KeyName is required, so it needed that as well17:48
randallburtandersonvom:  so if that's a required param of the nested template, It should probably be documented in the resource I would think.  I commented on the review. A weak −1 for now until i can see some example output and a response to the comment on the review. Thanks for the info!17:53
randallburtactually, andersonvom, looking at the old code, it looks like it was making that assumption all along. Still think it needs to be documented in some way, but that's probably not on you IMO.17:54
shardyzaneb: Another question about the new update logic if you have a sec?17:54
zanebgo ahead17:55
shardyzaneb: I'm wondering what the expected behavior is re the backup stack - does update really create a new stack and flip the ids, then delete the old one?17:56
zanebno17:57
shardyzaneb: I'm seeing the backup stack trigger deletion of the trust created by the initial stack, so trying to work out the expected update order before digging deeper17:57
zanebit creates the backup stack, moves resources around between them, then deletes the backup stack17:57
shardyAh, but the backup stack is a copy of everything, including the user_creds record?17:58
* shardy looks17:58
zanebnot sure17:58
zanebbut sounds like it would explain your issue17:58
shardyzaneb: No worries, I can dig myself, I just wanted to make sure I didn't have any fundamental misunderstanding of how it's supposed to work :)17:59
shardyzaneb: Yeah that is the problem, thanks18:03
zanebcool18:03
zanebhopefully that's relatively simple to fix18:04
shardyyeah, just pass a backup argument to delete and don't delete the trust18:04
*** saurabhs has joined #heat18:06
*** jasond` has quit IRC18:06
zanebffs18:07
zanebI ordered a monitor and keyboard on Monday18:07
zanebfor 3 days they have been asking questions about random businesses on streets that happen to contain some of the same words as my street18:08
zanebtoday they inform me that I got the wrong part number for "this item", and that I can't buy it because I have no upgrades. Instead I need to buy a $400 software license to some thing I have never heard of18:09
zanebI ask "which item?" and they reply "the one you ordered"18:09
*** yogesh has joined #heat18:12
zanebsdake: ^ early status report for the week :/18:12
*** derekh has quit IRC18:16
*** gokrokve has joined #heat18:17
*** SergeyLukjanov_ is now known as SergeyLukjanov18:21
openstackgerritThomas Spatzier proposed a change to openstack/heat: Enable better sub-classing of common Schema class  https://review.openstack.org/6568818:25
openstackgerritThomas Spatzier proposed a change to openstack/heat: Refactor Parameters Schema based on common Schema  https://review.openstack.org/6718318:25
openstackgerritThomas Spatzier proposed a change to openstack/heat: Move param format for template-validate to API  https://review.openstack.org/6717118:25
*** tsmadds has quit IRC18:32
*** harlowja_away is now known as harlowja18:32
*** tspatzier has quit IRC18:36
*** arbylee has quit IRC18:37
*** ruhe is now known as _ruhe18:39
*** jamieh has quit IRC18:42
*** jprovazn has joined #heat18:50
stevebakermorning18:51
shardyhi stevebaker18:51
stevebakershardy: hi18:51
*** e0ne has joined #heat18:52
*** kfox1111 has joined #heat18:55
kfox1111Anyone know why I might get this on stack create: Resource create failed: StackValidationFailed: Unknown resource Type : AWS::CloudWatch::Alarm18:56
*** andrew_plunk has joined #heat18:56
kfox1111when I don't have an alarm defined in the stack?18:56
*** blomquisg has joined #heat18:56
SpamapShow did we not stop i2 with this one: https://bugs.launchpad.net/heat/+bug/1271190 ?18:57
stevebakerhmm, I think the alt metting time is 0000 UTC on *Thursday* not Wednesday (unless I missed it?) https://wiki.openstack.org/wiki/Meetings/HeatAgenda#Weekly_Heat_.28Orchestration.29_meeting18:57
SpamapSHeat i2 is basically unusable for any use case that needs in-instance users.18:57
shardySpamapS: I marked it critical and targetted it at I-2...18:58
SpamapSshardy: yeah, Thierry just moved it and released18:58
SpamapSwhich is..18:58
SpamapSbasically broken18:58
shardystevebaker: Did he run that past you?18:58
SpamapSI mean, I don't really believe in the release milestones as anything other than "get your crap together so we can show the world what we're up to".. but at this point.. i2 is "we're up to breaking things"18:59
*** tango has joined #heat18:59
stevebakerA call was made project-wide to just cut i-2 due to the gate queue length. I don't know if there is opportunity for backports18:59
SpamapS_ah_18:59
stevebakerbut I did raise that bug explicitly as needed18:59
SpamapSso basically everybody is broken :)19:00
*** nati_ueno has joined #heat19:00
SpamapSwell as long as its _equal_19:00
stevebakeryes, really not ideal19:00
shardystevebaker: Ok, sounds really dumb, but whatever - I would think delaying it by a week would be better than releasing a bunch of stuff folks can't even test19:00
*** _ruhe is now known as ruhe19:01
stevebakershardy: that was an option, but that eats into i-3 which arguably deserves the extra time19:01
stevebakerI'm going to update the wiki to make the alt time to be Thursday 0000 UTC19:03
shardystevebaker: Well the real thing blocking everyone for progress on I-3 is the gate not the milestone19:03
SpamapSThis is a never ending argument19:03
SpamapSit is "march of death" vs. "rest and be ready"19:03
shardySpamapS: well it's frustrating when the fixes are all ready and the issue is the gate19:04
shardyOh well, nevermind19:04
stevebakeris it still in the gate?19:04
SpamapSshardy: yeah, if only we could attack the gate bugs with more people. :-P19:04
SpamapSstevebaker: queued19:04
shardystevebaker: https://review.openstack.org/#/c/68135/19:05
*** arbylee has joined #heat19:06
stevebakerIts not only gate bugs, it is also that review load is exceeding available cloud resources. Wheels are turning to increase resources. The bugs do compound that though19:06
zanebAIUI ttx believes the that i-1/i-2/i-3 releases don't mean anything, and are just dress-rehearsals for the RCs19:10
zanebpersonally, I don't understand why they exist if that is the case19:11
zaneband things like RDO absolutely do package them19:11
zaneband it is a giant PITA if they are broken and no backports are allowed19:11
shardyzaneb: +119:13
zanebstevebaker: I haven't been to one of the release meetings in this cycle. Have they gotten any better? Or still just pointless busywork?19:14
kfox1111Is it a requirement to have alarm resources even if you are not using them?19:16
kfox1111zaneb: agreed. I might have tried i2, but not now. :/19:17
stevebakerzaneb: they are a bit better, there is more of a focus on cross-project blocking issues now that ttx does a 1-1 for the release bookeeping stuff19:18
*** arbylee has quit IRC19:18
*** arbylee has joined #heat19:18
zanebstevebaker: what about stuff like 'feature x in project y is needed in project z, so we will use release icehouse-n as a synchronisation point'?19:19
zanebthat's what should be happening in those meetings IMO19:20
pafuentjasond: I can't reproduce your comment. I ran the test with your change and the tests pass. Maybe I'm missing something.19:20
*** edmund has joined #heat19:20
zanebstevebaker: e.g. we renamed quantum to neutron, so everybody update your client lib references before H-219:20
zanebsomething that never happened but should have ^19:21
stevebakerzaneb: that happens more. not that we've had anything that disruptive in this cycle19:21
zanebkfox1111: there's no conceivable way that it Heat could be complaining about a particular type of resource you don't have in your template19:22
stevebakerrecently it has been mostly brainstorming on how to improve the gate19:22
zanebstevebaker: ok, that's a good sign, thanks19:22
*** e0ne_ has joined #heat19:22
*** jprovazn has quit IRC19:22
zanebfix neutron?19:22
zanebjust throwing out ideas here19:22
*** spzala has joined #heat19:23
stevebakerTo be fair, most of the recent problems have been nova bugs and load related timeouts due to test concurrency19:23
kfox1111zaneb: That is what I was thinking, but then... I'm seeing it. :/19:23
kfox1111I'm turning up debugging logs to see if I can get more info. With debugging off, everything looks normal, just it fails with that.19:24
zanebkfox1111: is this a template you can post publicly? paste.openstack.org19:24
thervekfox1111, Are you using the AWS LoadBalancer resource?19:24
kfox1111zaneb: sure. give me a sec. Its basically just one of the heat-template examples I tweeked slightly and removed a few things to test.19:25
kfox1111therve: yeah.19:25
*** e0ne has quit IRC19:25
thervekfox1111, There you go. It creates an alarm.19:25
stevebakerSo heat i-2 tagging will be delayed until https://review.openstack.org/#/c/68135/ lands, so please keep an eye on it to nurse it through the gate19:26
zanebtherve: well spotted, thanks :)19:26
kfox1111therve: even if you didn't define one?19:26
zanebkfox1111: yes. the loadbalancer is implemented as a nested stack19:27
thervekfox1111, It does it for you. It needs one to monitor the instances.19:27
zanebthe nested stack contains an Alarm19:27
kfox1111Ah. ok.19:28
kfox1111what does it try and alarm on?19:28
*** tsmadds has joined #heat19:28
zanebkfox1111: latency. I'm not even sure why.19:31
*** topol has joined #heat19:32
*** tsmadds has quit IRC19:33
andersonvomhey folks, is there supposed to be any sort of folder structure in the contrib/ folder? i.e. does heat expect any specific folder structure?19:33
kfox1111zaneb: hmm... ok. thanks.19:37
kfox1111So, in /etc/heat/environment.d/default.yaml I have: "AWS::CloudWatch::Alarm": "OS::Heat::CWLiteAlarm" and its still complaining about not knowing about that resource type. Is that an unsupported resource in havana?19:39
*** randallburt has quit IRC19:47
radixthere's no heat meeting in 13 minutes, right?19:47
radixthis is alternate-meeting week?19:47
sdakezaneb software for a monitor, what will they think up next :)19:48
stevebakerradix: its alt meeting time19:49
radixokie doke19:49
stevebaker4hours to go19:49
zanebsdake: I'll tell you want they won't think up: "Yes, we've solved the problem and we'll deliver it overnight for free."19:49
sdakezaneb lol19:50
zanebonly "we're sorry for the inconvenience"19:51
zanebbull***t you are19:52
*** tspatzier has joined #heat19:57
*** Qin__ has joined #heat19:59
stevebakerPSA the heat meeting will be at the alternate time of 0000 UTC20:02
*** randallburt has joined #heat20:03
randallburtandersonvom:  nope, not at the moment20:07
randallburtandersonvom:  are you working on the test results stuff?20:07
*** Qin__ has quit IRC20:09
*** derekh has joined #heat20:11
skraynevHello all, Could somebody else review https://review.openstack.org/#/c/65970/ . needs other opinion on question in comment.20:11
andersonvomrandallburt: I'm trying to figure out how to generate the right docs for the contrib/ folder, so I was wondering if I can assume that plugins will always be inside contrib/**/heat/engine/plugins20:12
randallburtandersonvom:  ah, I see. So no, there's no real restriction on the organization of contrib.20:12
andersonvomrandallburt: yeah, looking at the folder right now, it doesn't. but I'm wondering if it should.20:13
andersonvommostly to be able to scale the documentation generation20:13
randallburtandersonvom:  can sphinx help you here? can you just point it at /contrib and say "go find things to document"?20:13
randallburtandersonvom:  IIRC it was stevebaker that originally wrote the resource documentation generator, he may have some pointers.20:14
andersonvomrandallburt: sort of. the thing is that we generate resource documentation separately from everything else, and when it imports heat, the configuration for plugins is the default value (/usr/lib/something)20:15
randallburtandersonvom:  ah, yeah, contrib may need some organization then or perhaps that code needs updating to account for the plugins. maybe some of both.20:15
andersonvomrandallburt: and then, the plugins are not loaded and left without docs20:15
randallburtwait, couldn't you just use the plugin loading mechanism?20:16
stevebakerit should be just a matter of adding contrib to the plugins path during docs generation20:16
randallburt^^20:16
stevebakeralso if the resource requires a lib for it to register itself then that lib will need to be in the gated requirements20:17
andersonvomstevebaker: tried that and it does most of it. but the resources don't get any docs because at that point in time, the plugin folder is not correctly set up20:17
openstackgerritPablo Andres Fuente proposed a change to openstack/heat: Use a HeatIdentifier instance to create Parameters  https://review.openstack.org/6825720:18
stevebakeralso the resourcepages directive filters by root namespace20:18
randallburtplus, the plugins we do have check that a lib is available before they register, so they won't register themselves. That'll be a problem20:18
stevebakerandersonvom: what resources are you talking specifically?20:19
andersonvomstevebaker: so, the way I got it to work was loading the plugin_dirs config option and pointing that to contrib/rackspace/..../plugins20:19
andersonvomstevebaker: let me get a list for you20:19
randallburtandersonvom:  don't forget the Docker one too, that's also missing from the published docs.20:19
randallburtat least it was the last time I bothered running the docs.20:19
randallburtyup. its missing too. there's a Rackspace section that's empty and no docker one at all. stevebaker might be worth changing that template and just use a "Contributed Plug-ins" section with some note saying they are in-tree but aren't loaded by default and may have other third-party library requirements.20:21
stevebakerrandallburt: yep20:22
randallburtandersonvom:  any of that help?20:22
openstackgerritPablo Andres Fuente proposed a change to openstack/heat: Native Pseudo Parameters  https://review.openstack.org/6664020:22
andersonvomstevebaker: so, by adding contrib to the sources, I got the modules to show up in the docs, but when I look at template_guide, the http://10.5.72.146/build/html/template_guide/rackspace.html is empty, because no plugins were loaded, since cfg.CONF.plugin_dirs points to the default places, not contrib20:23
stevebakercan you set cfg.CONF.plugin_dirs in conf.py?20:23
andersonvomstevebaker: I can, and that's what led me to ask if contrib has any structure, because I'd like to add this in a way that new plugins get added to the docs automatically20:24
stevebakerI assume just adding contrib/ is enough. Any plugins will be found20:25
randallburtwell even if they were loaded, they won't be registered since you will have missing dependencies. For example: https://github.com/openstack/heat/blob/master/contrib/docker-plugin/plugin/docker_container.py#L274-L28220:25
andersonvomstevebaker: oh, I was under the assumption you had to point to the plugins folder specifically. let me test that20:25
stevebakerI don't think so20:26
*** SergeyLukjanov is now known as SergeyLukjanov_20:28
*** tsmadds has joined #heat20:29
andersonvomstevebaker: cool. pointing to contrib solves it. I'll look into what randallburt said about the missing dependencies then20:30
randallburtandersonvom:  well if it worked, then you can ignore my chicken little routine ;)20:30
*** akuznetsov has quit IRC20:31
stevebakerandersonvom: good. Also feel free to reorganise rackspace.rst to refer to all contrib resources20:33
*** kebray_ has quit IRC20:34
randallburtstevebaker:  if its working, it might be easier/more maintainable to refactor that section like above20:34
randallburtsince there's Docker in there now too.20:34
randallburtstevebaker:  DOH! I re-read and realized that's probably what you meant.20:35
stevebakerthats ok, you can take the credit ;)20:35
randallburtno no, might just need more coffee ;)20:35
*** tsmadds has quit IRC20:35
openstackgerritPablo Andres Fuente proposed a change to openstack/heat: Prevent access Parameters key in template dict  https://review.openstack.org/6831220:36
andersonvomstevebaker: will do, thanks!20:38
*** tspatzier has quit IRC20:43
*** rcleere has quit IRC20:46
*** kebray_ has joined #heat20:49
*** SergeyLukjanov_ is now known as SergeyLukjanov20:51
*** tsmadds has joined #heat20:55
*** tsmadds has quit IRC21:01
*** SergeyLukjanov is now known as SergeyLukjanov_21:02
*** saurabhs has quit IRC21:06
*** saurabhs has joined #heat21:07
*** pafuent has left #heat21:10
*** kebray_ has quit IRC21:12
*** ruhe is now known as _ruhe21:23
*** tango|2 has joined #heat21:29
*** asalkeld has joined #heat21:30
*** tango has quit IRC21:32
larsksHello all. Should I be able to update the *outputs* of a stack without heat trying to recreate resources?21:44
larsksHuh, it blew away all my existing outputs, too.21:49
*** tsmadds has joined #heat21:57
radixso can someone remind me, if there's a stack with, say, a server in an error state, and I update-stack with an unchanged template, will the server be deleted and recreated?21:58
stevebakerzaneb: has behaviour for ^ changed at all yet?22:01
zanebradix: no :(22:02
*** tsmadds has quit IRC22:02
radixoh, ok22:02
cylizaneb:  apologies, I'm really new to this so maybe this is a stupid question.  Can we delete (just clean up) the errored/failed resources?22:03
*** derekh has quit IRC22:03
zanebcyli: ideally, yes22:04
radixso you can remove the resources from the template, update-stack, and then re-add them to the template, and update-stack, to recreate the resources?22:04
*** david-lyle has quit IRC22:06
zanebradix: you can't update a failed stack at all22:06
radixoh22:06
*** david-lyle has joined #heat22:06
zanebdelete or nothing22:06
radixright, okay. I was trying to find the code that might reject an update to a failed stack but couldn't22:06
zanebas far as I recall, anyway22:07
*** rpothier has quit IRC22:07
kfox1111Does heat without ceilometer in havana just not work with AWS::ElasticLoadBalancing::LoadBalancer?22:07
radixthat is pretty damn bad from an autoscaling perspective :(22:07
radixI mean, it's pretty damn bad for any case, heh22:07
zanebradix: https://github.com/openstack/heat/blob/master/heat/engine/parser.py#L49222:08
*** rpothier has joined #heat22:08
radixzaneb: ah ok, thanks22:09
radixI wonder if the stack-converge bps will address this somehow22:11
stevebakerI would have thought that allowing an update on a FAILED stack would be a relatively small change, compared to a full converge22:13
stevebakerjust flag all FAILED resources for UpdateReplace and do the Update22:13
radixthat'd be pretty cool22:14
radixstevebaker: shall I create a bp for this? or maybe just a mailing list thread?22:17
stevebakerradix: bingo https://review.openstack.org/#/c/62936/222:18
stevebakergive SpamapS some review love22:18
radixoh my!22:19
radixyes sir :)22:19
radixthis... changes... EVERYTHING22:19
SpamapSMy retry-on-update stuff is stuck on me testing all the scenarios22:19
SpamapSI have a new patch which will be more intelligent22:20
radixok cool22:20
SpamapSradix: it works reasonably well as it is..22:20
SpamapSuntil it doesn't22:20
radixheh22:20
SpamapSand then .. sadness22:20
radixSpamapS: well, I'll put this on my watch-list :)22:21
SpamapSlike if delete failed.. we resurrect it rather than trying the delete again ;)22:21
SpamapSit just involves actually caring about the action, not just the status22:21
radixah, right.22:21
radixso now I'm getting curious about the check-stacu bp22:22
radixer, check-stack22:23
radixlike, if it sets resource states to "FAILED", then check-stack + SpamapS-patch == convergence22:23
radix(with a cron job or something, which admittedly isn't great; some day we'll have queue-watching I'm sure...)22:23
SpamapSradix: \o/ thats exactly what I was thinking too :)22:24
SpamapSbut.. shhhh22:24
radixheh heh :)22:24
SpamapSconverge is such a cool command22:24
SpamapSit can't just be a chain of two others... can it? :)22:25
radixheat dwim22:25
SpamapS--force22:25
*** jdob has quit IRC22:27
*** mkollaro has joined #heat22:28
*** aweiteka has quit IRC22:30
*** jergerber has joined #heat22:31
*** vijendar has quit IRC22:32
*** alexpilotti has quit IRC22:34
*** alexpilotti has joined #heat22:34
zanebradix: the bp already exists https://blueprints.launchpad.net/heat/+spec/update-failure-recovery22:35
radixyeah, I figured that out based on SpamapS's patch22:35
*** bvandenh has joined #heat22:35
radixoh wait, that's a different bp22:36
sdakegoing to step out for a bit - feeling a bit ill today with cold or something bbl22:37
*** sdake is now known as sdake-ooo22:37
*** tango has joined #heat22:40
*** alexpilotti has quit IRC22:41
*** tango|2 has quit IRC22:44
*** achampion has quit IRC22:44
*** tango has quit IRC22:45
*** rpothier has quit IRC22:45
*** Winnie has joined #heat22:49
*** Winnie is now known as Guest7696522:49
*** tango has joined #heat22:50
zanebSpamapS: I added some comments for you to think about22:52
SpamapSzaneb: many thanks22:58
SpamapSzaneb: we have to get to update-failed-recovery .. or we're lost22:58
SpamapSzaneb: we cannot delete a 1000 node cloud without good reason. :)22:58
zanebI agree we have to get there22:58
*** radez is now known as radez_g0n323:00
zanebI guess the question is do we release something that might work in some specific cases, or wait until we think we have a reasonable shot at supporting it in the general case23:00
zanebI had hopes of working on that this cycle23:00
zanebhasn't happened yet though :/23:00
lifelesszaneb: why is it either-or?23:00
SpamapSzaneb: So if we extrapolate my approach for the general case.. a delete failed will just be attempted again. An update failed resource will just have update attempted again, and a create failed will be deleted/re-created.23:01
zaneblifeless: SpamapS has a patch up that makes it allowed in all cases, but only working in a subset of cases23:01
zaneblifeless: currently we just disallow it because we know it doesn't work23:01
SpamapSzaneb: at what point does this break down?23:02
* SpamapS reads the blueprint again :)23:02
zanebSpamapS: update after update-failed is broken23:02
zanebbut update after create-failed can work, so we should allow that23:02
zaneb(that's your patch)23:03
zaneband delete after delete-failed works now, I believe23:03
SpamapSzaneb: ok, so the problem is that if the update fails half-way and we don't want rollback.. we have a template which has been actualized but is not associated with the stack, right?23:03
zanebupdate after delete-failed should never work IMO. user lost rights to try to save the stack when they tried to delete it ;)23:04
SpamapSzaneb: so the next update would come along, and try to do the same deltas which have already been done?23:04
*** andersonvom has quit IRC23:04
*** dims has quit IRC23:04
SpamapSzaneb: right, delete failed should just be delete again.23:04
zanebSpamapS: yeah, so either rollback is disabled or rollback failed. then our internal state is inconsistent23:04
SpamapSzaneb: so what if on update failed and rollback disabled, we just use what is in the database to construct a template to diff against?23:05
SpamapSOr is there not enough in resources to do that?23:06
stevebakerSpamapS, zaneb, I've added a comment to the review23:06
zanebSpamapS: the resources don't store their template snippets, so we have no way of reconstructing it23:06
*** alexpilotti has joined #heat23:08
SpamapSthat would seem a relatively straight forward to handle the situation then. Store the snippets and then when an update starts, assemble the resources section from the database rather than the raw template.23:08
SpamapSthat would have a reasonable chance at making update idempotent23:09
zanebmy plan was actually to update the main template one resource at a time23:10
SpamapSsame difference really. :)23:10
SpamapSexcept if you make it per resource you can do it all in parallel. :)23:11
*** saurabhs has quit IRC23:12
SpamapSzaneb: this is nearly "the next thing" for me to tackle.. we're getting the the point where we'll have a long lived stack for our CD cloud.. and we will need an answer for when keystone hiccups during an update :)23:12
*** arbylee1 has joined #heat23:14
*** arbylee has quit IRC23:15
*** randallburt has quit IRC23:18
*** dims has joined #heat23:20
*** jcru has quit IRC23:20
*** yogesh has quit IRC23:20
SpamapSzaneb: well anyway, I completely see your point and I think I'll take your advice, focus my current approach on create failed.. and then expand on it with snippet storing and recovering from an update failed.23:21
SpamapSor I'll test rollback :)23:21
*** sballe has quit IRC23:22
*** sballe has joined #heat23:22
*** jergerber has quit IRC23:24
*** randallburt has joined #heat23:27
*** saurabhs has joined #heat23:30
tangoSpamapS: Hi Clint, we have been trying out your patch, we can give a hand in this23:33
*** sballe_ has joined #heat23:34
*** sballe has quit IRC23:35
*** jmckind has quit IRC23:36
*** bvandenh has quit IRC23:37
SpamapStango: sweet!23:39
*** pablosan has quit IRC23:45
*** pablosan has joined #heat23:49
*** andrew_plunk has quit IRC23:50
*** sjmc7 has quit IRC23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!