Thursday, 2015-11-05

*** shadower has quit IRC00:23
*** shadower has joined #tripleo00:23
openstackgerritBen Nemec proposed openstack/instack-undercloud: Fix similar vm name on instack-virt-setup script.  https://review.openstack.org/23995700:28
openstackgerritBen Nemec proposed openstack/tripleo-incubator: Add quoting variable for vnname.  https://review.openstack.org/23993900:29
*** alop has quit IRC00:30
*** jerrygb has joined #tripleo00:31
*** jerrygb has quit IRC00:32
openstackgerritBen Nemec proposed openstack/tripleo-heat-templates: Enable notifications on the overcloud  https://review.openstack.org/24142100:34
*** Marga_ has quit IRC00:39
*** Marga_ has joined #tripleo00:40
*** beagles has quit IRC00:51
*** b3nt_pin has joined #tripleo00:53
*** b3nt_pin is now known as Guest4663100:53
*** lblanchard has joined #tripleo01:22
*** panda has quit IRC01:40
*** panda has joined #tripleo01:41
*** rlandy has quit IRC01:43
*** julim has joined #tripleo01:46
*** tiswanso has joined #tripleo01:47
*** noslzzp has joined #tripleo01:56
*** rlandy has joined #tripleo01:56
openstackgerritgreghaynes proposed openstack/diskimage-builder: Add missing six requirement for svc-map element  https://review.openstack.org/23296201:57
*** weshay has quit IRC02:00
*** shivrao has quit IRC02:01
*** SlickNik has left #tripleo02:21
*** tiswanso has quit IRC02:25
*** tiswanso has joined #tripleo02:25
*** lblanchard has quit IRC02:31
*** sthillma has quit IRC02:57
*** sthillma has joined #tripleo02:58
*** sthillma has quit IRC03:01
*** tzumainn has quit IRC03:02
*** yuanying_ has joined #tripleo03:21
*** yuanying has quit IRC03:21
*** shivrao has joined #tripleo03:33
openstackgerritMerged openstack/diskimage-builder: Fix uniqueness check of initrd in fedora-minimal  https://review.openstack.org/23570503:36
*** yuanying_ has quit IRC03:36
*** shivrao_ has joined #tripleo03:36
*** shivrao has quit IRC03:38
*** shivrao_ is now known as shivrao03:38
*** lazy_prince has joined #tripleo03:39
*** untriaged-bot has joined #tripleo04:01
untriaged-botUntriaged bugs so far:04:01
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/151090104:01
openstackLaunchpad bug 1510901 in tripleo "seed's nova-compute service start fail" [Undecided,In progress] - Assigned to Cameron.C (cameron-c)04:01
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/151171504:01
openstackLaunchpad bug 1511715 in diskimage-builder "Images using draycut should have the option to pass drivers to include in build" [Undecided,New] - Assigned to Julia Kreger (juliaashleykreger)04:01
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/150914804:01
openstackLaunchpad bug 1509148 in tripleo "keystone initialize fails if undercloud can't reach overcloud public vip" [Undecided,New]04:01
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/150590004:01
openstackLaunchpad bug 1505900 in diskimage-builder "Failed to create 'wily' release with DIB_RELEASE" [Undecided,New]04:01
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/150426304:01
openstackLaunchpad bug 1504263 in tripleo "os-net-config mapping by MAC fails if trying to map in alternate order" [Undecided,Triaged]04:01
*** untriaged-bot has quit IRC04:01
*** Slower has joined #tripleo04:05
*** rlandy has quit IRC04:07
*** anande has joined #tripleo04:08
*** yuanying has joined #tripleo04:08
*** masco__ has joined #tripleo04:09
*** anande has quit IRC04:11
*** shivrao has quit IRC04:12
*** anande has joined #tripleo04:12
*** anande has quit IRC04:12
*** anande has joined #tripleo04:23
*** rlandy has joined #tripleo04:25
*** links has joined #tripleo04:26
*** tiswanso has quit IRC04:31
*** tzumainn has joined #tripleo04:32
*** anande has quit IRC04:41
*** morazi has quit IRC04:48
*** rlandy has quit IRC05:20
*** tzumainn has quit IRC05:29
*** athomas has quit IRC05:41
*** jaosorior has joined #tripleo05:53
*** killer_prince has joined #tripleo06:31
*** lazy_prince has quit IRC06:35
*** lazy_prince has joined #tripleo06:43
*** killer_prince has quit IRC06:43
*** jprovazn has joined #tripleo06:43
*** jtomasek has joined #tripleo06:50
*** lazy_prince has quit IRC06:52
*** lazy_prince has joined #tripleo06:52
*** mcornea has joined #tripleo06:55
*** lazy_prince has quit IRC06:58
*** rasca has joined #tripleo06:58
*** shivrao has joined #tripleo07:12
*** shivrao_ has joined #tripleo07:15
*** shivrao has quit IRC07:17
*** shivrao_ is now known as shivrao07:17
*** lsmola has joined #tripleo07:20
*** stendulker has joined #tripleo07:23
*** ukalifon1 has joined #tripleo07:37
*** sthillma has joined #tripleo07:38
*** shivrao has quit IRC07:40
*** Marga_ has quit IRC07:40
*** tremble has joined #tripleo07:41
*** sthillma_ has joined #tripleo07:42
*** devvesa has joined #tripleo07:42
*** Marga_ has joined #tripleo07:44
*** sthillma has quit IRC07:44
*** sthillma_ is now known as sthillma07:44
*** zigo has quit IRC07:53
jaosoriortremble: Sup dude07:56
*** zigo has joined #tripleo07:56
trembleHey jaosorior07:56
jaosoriortremble: Well, it seems that this commit merged https://review.openstack.org/#/c/230375/3907:56
jaosoriorbut it will be reverted because of the update problems07:57
jaosoriorwhich I've been trying to figure out, with no luck so far07:57
trembleyeah I noticed, there's a new CR to revert it07:57
tremblehttps://review.openstack.org/#/c/241688/07:57
jaosorioryup07:57
jaosoriorso, if we want the refacter to land, we need to figure out why it's failing07:58
tremblejaosorior: Yup, just running an upgrade now to figure out what's going on.07:58
jaosoriortremble: Let me know if you get the same issues I was getting yesterday07:58
jaosoriortremble: On the other hand, if you can review the TLS patch it would be appreciated https://review.openstack.org/#/c/231930/07:59
trembleHmm, with mine something tried to trigger a host rebuild...07:59
jaosoriortremble: what's the latest commit you have checked out?08:00
*** ifarkas has joined #tripleo08:00
tremble805368cc3d34a4dfe24a027eef5408a0a71e69ac08:00
jaosoriortremble: Which is that?08:02
tremblehttp://paste.openstack.org/show/478059/08:02
trembleOh, I know what triggered the rebuild, that's my mistake08:03
jaosoriorwhat triggered it?08:04
trembleIt's my hack to inject the new puppet-tripleo08:04
tremble(local change)08:04
* tremble cleans up and starts again08:04
*** sthillma has quit IRC08:04
jaosoriorlol dammit08:04
*** shardy has joined #tripleo08:04
trembleI actually really hate that updating userdata *always* rebuilds the nodes.  There are use cases (especially where userdata just hands off to some config management tool) where that's annoying behaviour08:05
trembleIt'd be kinda nice to be able to specify that behaviour08:06
tremblejaosorior: What was the bug you hit yesterday that prevented deletion?08:10
jaosoriortremble: the engine not finding the heat domain user08:11
jaosoriortremble: Are you hitting the same bug?08:11
tremble12015-11-05 08:11:19.393 21664 WARNING heat.engine.service [req-384d1e36-b825-4eb5-9017-a0962bc5beef - 293dc9af98c84037a0f327a80e35fb17-75c4d51d-1944-43d8-a5a4-7495c36] Access denied to resource NovaCompute08:11
jaosoriorfunky08:11
jaosoriortremble: What's the status reason you get from the resource?08:12
trembleIt's just sat there in Stack DELETE started with nothing actually changing08:13
jaosoriorwhaaa08:14
trembleI think my overcloud has gone a little wonky08:15
*** openstackgerrit has quit IRC08:16
jaosoriortremble: Well, if it's a similar issue, this is what fixed it https://review.openstack.org/#/c/234707/1/heat/engine/resources/stack_user.py08:16
*** openstackgerrit has joined #tripleo08:17
*** Marga_ has quit IRC08:27
*** Marga_ has joined #tripleo08:28
*** devvesa has quit IRC08:32
*** devvesa has joined #tripleo08:32
*** openstack has joined #tripleo08:33
*** regebro has joined #tripleo08:38
*** paramite has joined #tripleo08:51
*** aufi has joined #tripleo08:53
*** jaosorior has quit IRC08:53
*** lazy_prince has joined #tripleo08:54
*** stendulker_ has joined #tripleo09:00
*** stendulker has quit IRC09:02
*** stendulker_ has quit IRC09:04
*** jaosorior has joined #tripleo09:09
*** derekh has joined #tripleo09:09
jaosoriormarios: ping09:18
mariosjaosorior: hey o/ just reviewed the tls inject patch09:19
jaosoriormarios: I just responded09:19
mariosjaosorior: sec looking09:20
mariosjaosorior: so you're not using the nodeindex to identify the controller node, sorry. it is used to specify which certificate goes to which controller.09:21
shardyjaosorior: Hey, yesterday you hit some issues on update, which led me to believe the keystone management of endpoints is broken (at least for updates), is that correct?09:22
*** mbound has joined #tripleo09:22
shardyjaosorior: we inadvertantly landed the keystone/puppet patch, and bnemec proposed a revert in https://review.openstack.org/#/c/241688/09:22
jaosoriormarios: Yes, that's the case09:22
jaosoriorshardy: I saw, I was discussing that with tremble, and he's doing update testing on his side09:23
shardyjaosorior: Ok, thanks - manually testing isn't ideal, but it's our only option until we have CI update testing in place09:23
mariosjaosorior: sec, thinking... but it seems to me we can re-use the existing controllerextraconfigpre (it would just simplify the change is all, but it looks like it would work fine this way)09:23
cmystershardy: got a minute ?09:23
tremblemarios: I thought the Extra ones were reserved for Operators to do extra things09:23
*** gfidente has joined #tripleo09:24
jaosoriorshardy: Currently I'm doing update testing on the TLS injection and CA injection patch sets, and the update from not having these resources at all to having them and injecting certs and root certs works (update was successful)09:24
*** jistr has joined #tripleo09:24
shardycmyster: hi! sure09:24
mariosshardy: when you have a sec can you have a look at the https://review.openstack.org/#/c/231930/ its the TLS change which jaosorior has updated to use the ssl injection09:24
mariostremble: indeed09:24
shardyjaosorior: Ok, that's a useful datapoint, thanks09:24
jaosoriornow I'll do an update to changing the cert/private key09:24
tremblemarios: And TLS/SSL is a pretty standard thing that Operators will want.09:24
jaosoriorand see what happens09:24
mariostremble: so this would be the problem, if more than one was to be specified. and i hadn't thought that this is something we may want to .. yeah09:24
jaosoriormarios, more than one what?09:25
mariosthat (going to be a standard thing)...  was just wondering if it needed its own pre-config interface is all09:25
shardyand you've based your update on a master commit before 62f2237cebe941f1d5ca1b3c86df74ff1df4319a to your patch, right?09:25
jaosoriorshardy: Yeah, before spredzy's commits09:25
shardyjaosorior: Ok, thanks for clarifying09:25
mariosjaosorior: i meant you wished to specify more than one pre-config (right now we use it if cisco env, or if bigswitch env etc)09:25
jaosoriorspredzy's commits seem to fail at some point when creating keystone endpoints09:26
shardypretty paranoid about update regressions atm as there's a bunch of downstream pain related to them L:(09:26
jaosoriortrying to assign the nova endpoint, and not finding the nova service related to it09:26
jaosoriorat least that's how it failed for me09:26
jaosoriorwaiting to see if tremble stumbles upon the same09:26
shardymarios: FWIW the ResourceChain heat BP jdob has been working on is aimed at enabling easier chaining of e.g multiple ExtraConfig things together09:26
shardyfor now, the expectation is that folks will just write a tiny wrapper template09:27
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/puppet/extraconfig/pre_deploy/controller/multiple.yaml09:27
mariosshardy: i see thanks09:27
mariosjaosorior: will update my vote, thanks for pinging09:28
mariosshardy: yeah, so in theory, if we are able to chain multiple, we don't need to define a new preconfig interface per feature09:28
jaosoriormarios: Thanks for reviewing09:28
shardymarios: Yeah, that's the idea, whether it makes sense to just add one in this case is a judgement call tho09:28
shardythe idea was really that *ExtraConfig was mostly for operator enhancements and third-party integration, so I get the argument that SSL is more of a core feature which could be wired in directly09:29
mariosshardy: is that something jdob is working on for this cycle ?09:30
shardyjaosorior: Ok, thanks, if tremble also sees the nova failure, I guess we go ahead and revert, then do more investigation09:30
shardymarios: Yeah, I think so, but it's still at the spec interface-bikeshedding stage I think09:31
shardyhttps://review.openstack.org/#/c/228615/09:31
shardyI'll try to find out later if another revision is in the pipleline09:31
mariosshardy: thanks. well in any case it doesn' apply here, especially given the 'this is a common thing we will want to do anyway' aspect09:32
shardythe actual coding shouldn't be that much work09:33
gfidenteshardy, /me applying https://review.openstack.org/#/c/238194/ to 7.009:34
gfidenteshardy, is that fair to do?09:35
shardygfidente: cool, be interested to hear how it goes09:35
shardygfidente: Yes, there may be some internal rework, but it should be functional09:35
gfidenteyeah I wanted to make sure that is intended to work on 7.0 too09:35
shardygfidente: it should, but I've only tested on mitaka heat09:36
jaosorioryay, updating privatekeys/certs works09:37
*** tosky has joined #tripleo09:37
shardyderekh: Hey, just looking at the trigger merge conflicts in https://review.openstack.org/#/c/240938/09:44
shardyare you already working on another revision, or shall I attempt to rebase/push?09:44
* shardy puzzles over if we need a periodic job for the stable branch..09:47
*** olap has joined #tripleo09:51
derekhshardy: opps, I hadn't noticed the merge conflict09:52
derekhshardy: I think we do need a periodic job, I'm hoping to get them to save artifacts (e.g. images) to be used in other CI jobs09:53
openstackgerritMerged openstack/tripleo-heat-templates: Fix dependency for Ceilometer agent when using MySQL  https://review.openstack.org/23937309:53
*** adrianopetrich has quit IRC09:53
derekhshardy: if you have a rebase got for it, if not I'll sort it out in a few minutes09:53
derekh*go09:53
derekhbrb09:53
shardyderekh: Ok, I'll push what I have, cheers09:53
shardyderekh: Ok, pushed my rebase09:56
jaosoriorwhen adding the TLS parts, expecting the VIPDeployment, NodeExtraConfig and some PostDeployments to run again is normal, right?09:57
jaosoriorI guess the fact that those get updated too is to be expected09:58
tremblejaosorior: Grah, something still triggered a rebuild of the nodes.09:58
shardyjaosorior, gfidente: thanks for your comments on the project-config patch, replied09:59
jaosoriortremble: uhm... are you sure you took away the domain override commit?09:59
jaosoriortremble: Can'09:59
shardyit's not testing upgrades at all (yet), so I think we should rename later when it actually does09:59
jaosoriorCan't think of anything else that would trigger rebuilding the nodes09:59
jaosoriorshardy: Doesn't it?09:59
shardyjaosorior: no09:59
*** untriaged-bot has joined #tripleo10:00
untriaged-botUntriaged bugs so far:10:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/151090110:00
openstackLaunchpad bug 1510901 in tripleo "seed's nova-compute service start fail" [Undecided,In progress] - Assigned to Cameron.C (cameron-c)10:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/151171510:00
openstackLaunchpad bug 1511715 in diskimage-builder "Images using draycut should have the option to pass drivers to include in build" [Undecided,New] - Assigned to Julia Kreger (juliaashleykreger)10:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/150914810:00
openstackLaunchpad bug 1509148 in tripleo "keystone initialize fails if undercloud can't reach overcloud public vip" [Undecided,New]10:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/150590010:00
openstackLaunchpad bug 1505900 in diskimage-builder "Failed to create 'wily' release with DIB_RELEASE" [Undecided,New]10:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/150426310:00
openstackLaunchpad bug 1504263 in tripleo "os-net-config mapping by MAC fails if trying to map in alternate order" [Undecided,Triaged]10:00
*** untriaged-bot has quit IRC10:00
jaosoriorshardy: Ah! I think I understand now10:01
shardyjaosorior: first step is just CI testing the stable branch, then we can add upgrade/update testing when we have both stable and master tested in isolation10:01
tremblejaosorior: yeah10:01
shardycurrently we cut the branches but they have zero CI, this fixes that10:01
shardythen we have to implement update/upgrade testing next10:01
jaosoriorthat makes sense10:01
shardythis first step just runs the existing CI pointing at the stable delorean10:02
cmystershardy: update upgrade ?10:02
shardycmyster: there are (at least) two different things to test10:02
cmysteronly two? :)10:02
shardyone is update all the things and prove nothing breaks10:02
shardyI'm calling that "update"10:03
cmysterk10:03
shardye.g update the undercloud, prove you can still deploy an overcloud (potentially with mismatched versions of overcloud)10:03
shardyand maybe just do a no-op update of the overcloud to the new templates, prove nothing explodes or is replaced10:03
shardy"upgrade" is actually upgrading e.g liberty->mitaka on the overcloud10:04
shardywe have zero coverage for any of that yet, so I'm trying to start simple ;)10:04
shardyactually, let's write this down in an etherpad10:04
cmyster+110:05
shardyhttps://etherpad.openstack.org/p/tripleo-update-testing10:05
cmystershardy: alo there is stuff zaneb started, you can probably add things from it10:05
cmysteralso *10:05
shardycmyster: Ah, yeah, can you link that pls if you have it bookmarked?10:05
cmysterI'll try and find it, it was in a mailing list10:06
cmysterthankfully I can just grep10:06
jaosoriorshardy, marios, gfidente: if you guys have time to review these two patches https://review.openstack.org/#/c/231930/35  https://review.openstack.org/#/c/241200/ it would be appreciated. And the state of those is:10:08
jaosoriorshardy, marios, gfidente: They do successfully inject the specified certificates/keys and the trust anchors (cert keys need to be specified as a list depending on the number of controllers)10:09
*** rasca has quit IRC10:10
jaosoriorand the certificate is actually configured for haproxy10:10
jaosoriornow10:10
*** akrivoka has joined #tripleo10:10
jaosoriorthat by itself works10:10
jaosoriorbut it's not very useful10:10
jaosoriorbecause we need the keystone endpoints properly configured to use TLS10:10
cmystershardy: https://etherpad.openstack.org/p/tripleo-kilo-to-liberty-upgrades10:10
jaosoriorwhich is what we were attempting to do in the subsequents patches10:10
jaosoriorbut I guess the patches starting from this one: https://review.openstack.org/#/c/238887/ will be problematic since they depend on spredzy's patches that configure keystone from puppet10:11
jaosoriorbut anyway, at least https://review.openstack.org/#/c/231930/35 and https://review.openstack.org/#/c/241200/ seem to be alright regarding updates10:12
jaosoriorI've cherry picked them to the previous patch before the upgrade issues10:13
jaosoriorand tried the following scenarios:10:13
jaosorior* install overcloud with base templates without TLS and CA injection patches10:14
jaosorior* update overcloud with TLS and CA injection patches (without certs/keys and root CA)10:14
tremblejaosorior: Grah *something* has changed in the userdata....10:14
jaosorior* update overcloud injecting certs/keys and root CA10:15
jaosoriorthat scenario udpates ok10:15
jaosorioralso doing an upgrade directly putting the certs/keys from the base templates to the new ones updates without errors10:16
tremblejaosorior: I'm possibly updating from further back...10:17
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Wire Neutron ML2 plugin and OVS agent settings as arrays  https://review.openstack.org/18750610:18
jaosoriortremble: What commits do you have checked out?10:19
tremblejaosorior: OSP-D 7.1 and 805368cc3d34a4dfe24a027eef5408a0a71e69ac10:20
tremblejaosorior: shardy : http://paste.openstack.org/show/478069/10:22
*** rasca has joined #tripleo10:23
tremblejaosorior: You know what I said about userdata triggering rebuilds being annoying...10:23
trembleThe simple act of injecting10:24
tremble#cloud-config10:24
*** devvesa has quit IRC10:24
tremble{user: heat-admin}10:24
shardytremble: that should be included by default, thus won't change on update10:31
shardybut I agree, it's a gotcha to look out for10:32
trembleshardy: From osp-d 7.1 ?10:32
derekhshardy: comments added, want to update or will I ?10:32
shardytremble: Hmm, good point - we had to explcitly add that to cloud-config at one point because heat stopped injecting it10:33
shardywe need to confirm the exact timeline, that's going to be annoying if we have to exclude the userdata on update :(10:33
trembleYup...10:34
shardyderekh: If you're happy to then go for it, thanks :)10:34
derekhshardy: will do10:34
shardytremble: There was a blueprint for heat at one point proposing a template flag which restricted what could happen on update10:34
shardythat sounds like what we need here, e.g lock all server and network resources by default so they can never be updated in a destructive way10:35
trembleshardy: That would have been really nice...  I can think of multiple use cases...10:35
shardyhttps://review.openstack.org/#/c/135444/10:36
shardythe spec landed, let me look for code..10:36
shardyNo code :(10:37
trembleshardy: Trouble is that would move things to UPDATE_FAILED based on the spec...10:37
shardyI'll chat to ryansb about it later10:37
shardytremble: that's probably OK, at least as a first pass, I'd rather have a failed upate than rebuild my entire cloud10:38
trembleYeah10:38
shardyperhaps an "ignore" mode would also be useful tho10:38
shardyintegrating the existing stack update --dry-run behavior into the flow will also help10:39
shardyat least then you can prompt with a list of what will be replaced, and the operator can bail out if it looks wrong10:39
*** paramite is now known as paramite|afk10:50
*** paramite|afk is now known as paramite10:50
*** paramite is now known as paramite|afk10:50
*** adrianopetrich has joined #tripleo10:52
*** jerrygb has joined #tripleo10:58
*** masco__ has quit IRC11:07
*** tzumainn has joined #tripleo11:21
gfidenteshardy, I might be running the wrong test but I got the VirtualIP resources deleted and recreated11:26
gfidenteshardy, want to give a look yourself?11:26
gfidenteshardy, if you have sample templates to test the patch I could test those first to make sure the patch applied correctly11:29
*** paramite|afk is now known as paramite11:48
*** Marga_ has quit IRC11:57
*** devvesa has joined #tripleo11:59
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Test a update in trunk repository version  https://review.openstack.org/22978912:02
devvesaHi! I run a clean environment and I get the following error:12:05
devvesaError: Could not find class ::ironic::inspector for instack on node instack12:06
devvesaAnd yes, /etc/puppet/modules/ironic/manifest/inspector.pp is not in my undercloud machine12:06
*** Marga_ has joined #tripleo12:06
devvesa(which I built using 'instack-virt-setup')12:06
devvesaWhich is the best way to update it to current master branch?12:07
devvesaSorry: this error happened running the `tripleo.sh --undercloud` statement12:08
*** jerrygb has quit IRC12:10
shardydevvesa: Hi!  Sorry I've not seen that one, dtantsur|afk or trown|outttypeww might know when they return12:12
slagledevvesa: what version of of openstack-puppet-modules is on the undercloud?12:12
shardydevvesa: If you re-run tripleo.sh --repo-setup it should point to the latest trunk delorean12:13
slagleyea i was just checking the latest version there and it does have the inspector puppet classes in it12:13
slagleopenstack-puppet-modules-2015.2-dev.28f2f4cff9b8f35511b3b15668b10cc32419c236_41994f7f.el7.centos.noarch.rpm12:13
devvesaweird. I run the repo-setup setp just 5 minutes before run the undercloud one12:14
*** adrianopetrich has quit IRC12:15
devvesaopenstack-puppet-modules-2015.2-dev.232f6155275c8defe1d50c675d702041c108cb30_8eef2746.el7.centos.noarch12:16
slagleok so you have the version from http://trunk.rdoproject.org/centos7/current-tripleo/ instead of http://trunk.rdoproject.org/centos7/current/12:18
slaglethe --repo-setup is supposed to set this up so that openstack-puppet-modules is preferred from the current repo via an includepkgs in the yum repo conf file12:18
slagletry a yum list --show-duplicates openstack-puppet-modules12:19
slagleand check the priorities, and for the includepkgs, in the .repo files12:19
devvesaSo that means that running delorean-setup is enough?12:20
devvesaI don't need to run repo-setup?12:20
*** thrash|g0ne is now known as thrash12:22
devvesa[stack@instack yum.repos.d]$ yum list --show-duplicates | grep openstack-puppet-modules12:22
devvesaopenstack-puppet-modules.noarch         2015.2-dev.232f6155275c8defe1d50c675d702041c108cb30_8eef2746.el7.centos12:22
devvesaopenstack-puppet-modules.noarch         2015.2-dev.232f6155275c8defe1d50c675d702041c108cb30_8eef2746.el7.centos12:22
*** rasca has quit IRC12:22
*** rasca has joined #tripleo12:23
*** athomas has joined #tripleo12:24
*** athomas has quit IRC12:25
slagleyou do need to run --repo-setup12:25
*** athomas has joined #tripleo12:25
devvesaI ran both, then12:26
*** athomas has quit IRC12:27
*** athomas has joined #tripleo12:27
slaglecan you run --repo-setup -x again, and capture the output?12:28
*** olap has quit IRC12:30
devvesahttp://fpaste.org/287214/44672664/12:30
devvesa(this is a new clean VM)12:31
devvesaand after the repo-setup:12:32
devvesahttp://fpaste.org/287216/44672673/12:32
devvesastill being the dev.232f61... etc12:32
devvesaCan it be that I need to update the instack project?12:33
slagleno12:34
*** rasca has quit IRC12:35
slagleit looks like openstack-puppet-modules is gone from includepkgs, it was removed. i wasn't aware of that12:35
slagleso, what you need to do then is run "export DIB_INSTALLTYPE_puppet_modules=source"12:35
*** rasca has joined #tripleo12:35
slaglebefore tripleo.sh --undercloud12:35
slaglei guess that's required now12:35
*** regebro is now known as regebro|lunch12:35
slagleok yea, tripleo.sh was updated to match what CI does. that makes sense12:36
slagleso, you need to run that export first12:37
derekhslagle: we should probably put "export DIB_INSTALLTYPE_puppet_modules=source12:37
derekhslagle: into tripleo.sh and remove it from toci12:37
*** olap has joined #tripleo12:38
slagle+1, default it to source, but allow people to override to package if they want to12:42
*** yamahata has joined #tripleo12:45
devvesarunning the 'undercloud' now... let's see if it works12:46
devvesameanwhile, can I ask you why there are two different repos in delorean? the current and the current-tripleo ?12:46
*** Goneri has quit IRC12:50
*** jistr has quit IRC12:52
*** adrianopetrich has joined #tripleo12:54
*** dprince has joined #tripleo13:02
*** Marga_ has quit IRC13:03
*** paramite is now known as paramite|afk13:07
*** jistr has joined #tripleo13:11
*** Goneri has joined #tripleo13:11
*** jerrygb has joined #tripleo13:11
*** trown|outttypeww is now known as trown13:14
gfidentedprince, there is something about the external lb patches and upgrades which I have been through with shardy earlier today13:16
dprincegfidente: okay, whats up?13:16
*** jerrygb has quit IRC13:16
*** jayg|g0n3 is now known as jayg13:16
gfidentedprince, mainly to make upgrades to work, in addition to a heat change, we shouldn't change the port resource name from https://github.com/openstack/tripleo-heat-templates/blob/master/network/ports/internal_api.yaml#L21 into https://github.com/openstack/tripleo-heat-templates/blob/master/network/ports/vip.yaml#L3113:18
gfidentedprince, we were trying to figure what are the solutions13:18
shardydprince: the problem is, even with my heat fix to not replace nested stacks but instead update them in place, we still replace the port resource13:18
shardybecause the name of the port changes13:18
shardyinside the nested stack template13:18
shardyHeat (correctly) interprets that as a requirement for a new resource with a different name13:19
dprinceshardy: okay, probably fine13:19
dprincedo we have other ideas on the table?13:19
shardydprince: the problem is we need to enforce naming consistency so if someone swaps around the various templates e.g in network/ports/foo.yaml we don't replace things when not needed13:20
shardye.g we could enforce all port resources are called "Port" in that directory13:20
shardyhowever, folks are using the existing templates, which don't do that13:20
shardygfidente: you have an etherpad with some ideas don't you?13:21
gfidentehttps://etherpad.openstack.org/p/external-lb-and-upgrades13:22
shardydprince: basically the solution which won't break existing users is to duplicate vip.yaml so we maintain the name over upgrades13:23
*** paramite|afk is now known as paramite13:24
gfidenteshardy, dprince which seems to go well together with the existing multiple internal_api, storage, external ports implementations, even though those are effectively duplicates as well13:25
*** morazi has joined #tripleo13:27
dprincegfidente: I think that sounds reasonable13:28
dprincegfidente, shardy: if we had our upgrades job in place upstream, would it have caught this as a failure?13:29
shardydprince: Yes, assuming we also tested network isolation13:29
dprinceshardy: oh right, we'd need both I guess13:30
gfidenteshardy, so first I'd like to test the idea on the patched heat13:30
gfidenteshardy, dprince to make sure it works13:30
shardydprince: there's a ton of stuff like this we need to catch, but initially I'd like a job which deploys from t-h-t master, then does a stack-update to the posted patch13:30
dprinceshardy: ++, lets do it13:31
shardyparticularly for t-h-t that would catch a lot of things without even implementing the whole upgrade from stable thing13:31
shardy(which, obviously, we also need to test)13:31
shardydprince: Ok, I'll look into it, I guess we'd need a way to mask the delorean package built for the under-review t-h-t change, deploy, then pull in the updated package and do another overcloud deploy --templates to stack-update13:32
dprinceshardy: or just don't use a packages for the t-h-t patch in the upgrade job. Just git clone it directly, fetch the refspec, and then send the --templates location along to tripleoclient13:33
dprinceshardy: the green field (normal, non-upgrades jobs) would catch any packaging issues w/ t-h-t I think anyways13:34
shardydprince: Yeah, that may be easier13:36
*** Goneri has quit IRC13:37
*** rhallisey has joined #tripleo13:37
shardythings would get tricky if a t-h-t Depends-On a puppet change that is built into the image though13:37
shardyI'm not sure how we handle that13:37
*** weshay_xchat has joined #tripleo13:38
*** panda has quit IRC13:40
EmilienMmarios: your comment on https://review.openstack.org/#/c/191195/26/os-apply-config/controller.yaml,cm is chineese for me13:41
openstackgerritRyan Hallisey proposed openstack/tripleo-common: Deploy Docker compute role with tripleo.sh  https://review.openstack.org/23285313:41
*** panda has joined #tripleo13:41
EmilienMmarios: can you take over the patch so we can make progress on this loooooooong story?13:41
mariosEmilienM: hey o/ i just mean you don't need to include this file in the review. we aren't updating the os-apply-config templates any longer13:44
*** CheKoLyN has joined #tripleo13:45
EmilienMok13:45
mariosEmilienM: sorry if the comment was confusing. but the -1 was mainly for the ports thing bnemec pointed out13:45
EmilienMmarios: I started this patch on Jun 12 3:27 PM - can we land it soon?13:45
mariosEmilienM: (it really doesn't matter if you do/don't include that o-a-c file just saying). we could land it right now, it would then need an immediate update for those duplicate ports13:46
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Implement Advanced Firewalling support  https://review.openstack.org/19119513:48
EmilienMmarios: done ^13:48
dprinceEmilienM: +2, thanks for seeing this through13:49
EmilienMcool my pleasure13:49
mariosEmilienM: thanks updated13:49
dprinceEmilienM: if, when we split up the roles... this firewall stuff looks like it will split out fairly cleanly13:50
* dprince hopes it does anyway13:50
mariosam gonna approve based on v 26 green ci13:50
mariosobjections?13:50
EmilienMmarios: I suggest to wait13:51
dprincemarios: lets wait13:51
shardyCan we land https://review.openstack.org/#/c/238839/ - it's a Depends-On for the related project-config change enabling stable branch CI13:51
shardyplease :)13:51
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: neutron: enable nova-event-callback by default  https://review.openstack.org/22596213:52
mariosack.. EmilienM  hehe i was trying to appease the rage "can we land it soon?"!13:52
dprinceshardy: +A13:52
shardydprince: thanks!13:52
openstackgerritMerged openstack/tripleo-common: tripleo.sh initial support for stable branches  https://review.openstack.org/23883913:55
openstackgerritMerged openstack/tripleo-common: tripleo.sh initial support for stable branches  https://review.openstack.org/23883913:55
*** akuznetsov has joined #tripleo13:57
*** jaosorior has quit IRC13:57
EmilienMcan someone look this easy one: https://review.openstack.org/#/c/240538/ ?13:57
EmilienMmarios, dprince ^13:58
*** jaosorior has joined #tripleo13:58
EmilienMand also https://review.openstack.org/#/c/234325/13:58
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Implement Workers parameters  https://review.openstack.org/22947113:58
mariosEmilienM: looking14:00
*** links has quit IRC14:01
dprinceshardy: FWIW, if you have 2 +2's I think it is totally fine to +A your own patch14:02
dprinceshardy: unless it is something you want extra assurance on, feel free I think14:03
*** jerrygb has joined #tripleo14:04
openstackgerritMerged openstack/instack-undercloud: neutron: enable nova-event-callback by default  https://review.openstack.org/23432514:05
shardydprince: Ok, thanks, if it was a heat patch I probably would've done so, but I wasn't sure on the TripleO convention in that situation14:06
trembleBother, jaosorior my update is failing due to https://bugzilla.redhat.com/show_bug.cgi?id=127598614:07
openstackbugzilla.redhat.com bug 1275986 in rhel-osp-director "Director update to 7.1 fails due to httpd service restart failure" [High,New] - Assigned to calfonso14:07
*** david-lyle has joined #tripleo14:08
openstackgerritMerged openstack/tripleo-heat-templates: compute/ceilometer: use internalURL for os endpoint type  https://review.openstack.org/24053814:08
*** rlandy has joined #tripleo14:09
openstackgerritRhys Oxenham proposed openstack/tripleo-heat-templates: Add network templates for multiple NIC configuration  https://review.openstack.org/20449414:10
*** rbrady-afk has quit IRC14:11
*** rbrady has joined #tripleo14:13
*** tiswanso has joined #tripleo14:18
openstackgerritGael Chamoulaud proposed openstack/instack-undercloud: Add Puppet 4.x lint checks  https://review.openstack.org/24050514:22
openstackgerritGael Chamoulaud proposed openstack/instack-undercloud: Make puppet manifests compliant with Puppet 4.x  https://review.openstack.org/24050714:22
*** rgowrishankar has joined #tripleo14:25
*** absubram has joined #tripleo14:26
jaosoriortremble I see :/14:26
*** jaosorior has quit IRC14:26
*** jaosorior has joined #tripleo14:26
tremblejaosorior: Unrelated to our work, so probably *shouldn't* block what we're doing.14:27
jaosoriortremble: Well, my update worked14:27
jaosoriorthe HA one14:27
tremblejaosorior: Yeah it's a race condition so sometimes it'll work, sometimes not.14:27
tremblejaosorior: And I was testing the Endpoints stuff too14:28
*** lblanchard has joined #tripleo14:29
*** regebro|lunch is now known as regebro14:30
jaosoriorwell, I guess now we just need reviweers14:32
*** Goneri has joined #tripleo14:36
*** pradk has joined #tripleo14:38
*** paramite is now known as paramite|afk14:38
*** akuznetsov has quit IRC14:39
*** adrianopetrich is now known as apetrich14:39
*** paramite|afk is now known as paramite14:40
*** rlandy has quit IRC14:42
*** pradk has quit IRC14:43
*** athomas has quit IRC14:43
*** pradk has joined #tripleo14:44
*** fabbione has quit IRC14:44
*** fabbione has joined #tripleo14:45
*** athomas has joined #tripleo14:45
openstackgerritGael Chamoulaud proposed openstack/tripleo-heat-templates: Add Puppet 4.x lint checks  https://review.openstack.org/23415014:53
openstackgerritGael Chamoulaud proposed openstack/tripleo-heat-templates: Make puppet manifests compliant with Puppet 4.x  https://review.openstack.org/22566414:53
*** trown is now known as trown|outttypeww14:57
tremblejistr: You familiar with the Pacemaker/stonith code for the controllers?14:58
jistrtremble: somewhat yes :)14:59
tremblejistr: I've just hit https://bugzilla.redhat.com/show_bug.cgi?id=127598614:59
openstackbugzilla.redhat.com bug 1275986 in rhel-osp-director "Director update to 7.1 fails due to httpd service restart failure" [High,New] - Assigned to calfonso14:59
jistri think i saw some patches for that fly by IIRC15:00
* jistr searches15:00
tremblejistr: I'm wondering if we should *remove* the stonith resources if $enable_fencing == false15:00
jistrtremble: probably not as that could get rid of any manually created stonith resources. Anyway this is probably not related to stonith resources at all, just service resources i think.15:02
*** tiswanso has quit IRC15:02
tremblejistr: It looks like something else is running service restarts at the same time as puppet15:03
*** tiswanso has joined #tripleo15:03
*** rlandy has joined #tripleo15:04
jistroh i mistook it for this https://review.openstack.org/#/c/241572/15:04
tremblejistr: Only thing I can imagine restarting services would be pcs...15:04
jistrwhich is a different BZ15:04
jistrtremble: which service did you have problem with? httpd? as jprovazn mentions on the BZ, the slow httpd startup can be caused by some horizon pre-processing on startup15:05
*** david-lyle has quit IRC15:06
tremblejistr: The issue wasn't it being slow, the issue was that something *else* issued a service restart too...15:06
tremblejistr: I hit nova and httpd15:06
jistrhmm interesting... perhaps the timeout amendment patch i linked above could help with it15:08
jistrbut in httpd case it's probably more of a horizon bug rather than tripleo15:08
*** lazy_prince has quit IRC15:08
jistri remember that on a slow machine some time ago i had to disable horizon because it wasn't able to start up on the first try15:09
*** athomas has quit IRC15:09
jistrthe preprocessing took too long so systemd gave up on it15:09
tremblejistr: http://paste.openstack.org/15:09
trembleSomething triggered systemctl to try and *stop* httpd while it was still coming up15:10
openstackgerritMerged openstack/python-tripleoclient: Do not throw an error on validation when tunneling is disabled  https://review.openstack.org/22844615:11
d0ugalthrash: https://review.openstack.org/#/c/226790/ - the defaults that you have removed here, do they all match t-h-t?15:11
thrashd0ugal: yes15:12
thrashthe ones that remain are the ones that differed.15:12
d0ugalthrash: cool, thanks15:12
tremblejistr: http://paste.openstack.org/show/478105/ (sorry)15:13
d0ugalthrash: and the args removed from the docs like --cinder-lvm, did they get removed previously but never from the docs?15:13
thrashd0ugal: yes15:13
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: neutron: enable nova-event-callback by default  https://review.openstack.org/22596215:13
thrashIf they weren't in the code, I removed it from the docs.15:13
d0ugalthrash: cool, thanks - I guess we need to do a better job of looking out for that :)15:14
thrashhehe, yeah15:14
thrashd0ugal: this one too... https://review.openstack.org/#/c/235569/15:15
jistrtremble: it's stopping 10:09:09, when is the start time?15:15
tremblejistr: It's taking about 15 seconds.15:16
*** SlickNik has joined #tripleo15:18
tremblejistr: The trigger seems to be:15:23
trembleNov  5 10:09:09 localhost crmd[26468]: notice: Initiating action 34: stop httpd_stop_0 on overcloud-controller-0 (local)15:23
*** olap has quit IRC15:26
jistrok then i'm hoping gfidente's patch i linked above might help. I didn't follow the development 100%, but if i caught it right, it effectively postpones first monitor action after stop/start of the services, so if the reason pcmk stopped it there ^^ was that it thought httpd failed to start up, it could help maybe. I'm starting to look into updates now as well, i'll see which of those issues i'll hit.15:28
jistrtremble: ^15:28
tremblejistr: ack15:28
tremblejistr: I hit it because I was testing a patch which ended up restarting most of the openstack services on the controller15:29
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Add net_vip_map_external to be used for an external balancer  https://review.openstack.org/22218915:30
gfidentesorry but I'm deep down into this balancer stuff and upgrades guys :(15:31
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Make load balancer deployment optional via template param  https://review.openstack.org/22230515:32
*** paramite has quit IRC15:34
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Make load balancer deployment optional via template param  https://review.openstack.org/22230515:35
*** dprince has quit IRC15:37
EmilienMslagle: if I had to install monitoring/logging tools, where would you see them? on the controller nodes?15:38
jistrsure thing, sorry for the pingnoise15:38
slagleEmilienM: the centralized services for those tools would probably need to be on the undercloud15:39
slagleif your monitoring tool were on the overcloud, and the overcloud goes down, that doesnt seem ideal :)15:40
EmilienMslagle: your undercloud is HA now?15:40
shardyanother possiblility would be to deploy some extra nodes via a separate heat stack15:40
shardyand run the services on them15:41
slagleEmilienM: no15:42
slagleshardy: that could be an option. it comes down to either how big we can make the undercloud or how many nodes do we have to require15:43
slagleit's a tradeoff either way15:43
shardyslagle: yup, either approach could work depending on your requirements15:43
slaglei just don't think we'd want them co-located on the oc controllers15:44
slagleat least not until we have the fully composable roles15:44
slaglebut then, it's not even really a controller. it's just whatever you define it to be15:44
EmilienMI think using undercloud makes 100% sense15:45
*** rwsu has joined #tripleo15:47
*** paramite has joined #tripleo15:50
*** aufi has quit IRC15:52
*** jistr is now known as jistr|afkmtg15:53
*** shivrao has joined #tripleo15:54
*** bnemec has quit IRC15:55
*** yamahata has quit IRC15:56
*** untriaged-bot has joined #tripleo16:01
untriaged-botUntriaged bugs so far:16:01
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/151090116:01
openstackLaunchpad bug 1510901 in tripleo "seed's nova-compute service start fail" [Undecided,In progress] - Assigned to Cameron.C (cameron-c)16:01
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/151171516:01
openstackLaunchpad bug 1511715 in diskimage-builder "Images using draycut should have the option to pass drivers to include in build" [Undecided,New] - Assigned to Julia Kreger (juliaashleykreger)16:01
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/151350816:01
openstackLaunchpad bug 1513508 in diskimage-builder "Ironic IPA does not work when Swift is using https" [Undecided,New]16:01
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/150590016:01
openstackLaunchpad bug 1505900 in diskimage-builder "Failed to create 'wily' release with DIB_RELEASE" [Undecided,New]16:01
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/150426316:01
openstackLaunchpad bug 1504263 in tripleo "os-net-config mapping by MAC fails if trying to map in alternate order" [Undecided,Triaged]16:01
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/150914816:01
openstackLaunchpad bug 1509148 in tripleo "keystone initialize fails if undercloud can't reach overcloud public vip" [Undecided,New]16:01
*** untriaged-bot has quit IRC16:01
*** tiswanso has quit IRC16:02
*** paramite has quit IRC16:02
*** tiswanso has joined #tripleo16:02
*** dsneddon has quit IRC16:08
*** dsneddon has joined #tripleo16:08
*** dsneddon has quit IRC16:08
*** dsneddon_ has joined #tripleo16:08
*** jerrygb has quit IRC16:13
*** jerrygb has joined #tripleo16:15
*** sthillma has joined #tripleo16:15
openstackgerritMark Chappell proposed openstack/tripleo-heat-templates: Use PCS's maintenance mode while updating configuration  https://review.openstack.org/24214116:20
openstackgerritBen Nemec proposed openstack/instack-undercloud: Fix similar vm name on instack-virt-setup script.  https://review.openstack.org/23995716:23
*** ukalifon1 has quit IRC16:25
*** Guest46631 has quit IRC16:29
*** jerrygb has quit IRC16:31
*** jerrygb has joined #tripleo16:31
*** mkovacik has quit IRC16:32
*** pino|work_ has joined #tripleo16:32
*** tosky_ has joined #tripleo16:32
openstackgerritMark Chappell proposed openstack/tripleo-heat-templates: Use PCS's maintenance mode while updating configuration  https://review.openstack.org/24214116:33
*** b3nt_pin has joined #tripleo16:35
*** b3nt_pin is now known as Guest9124216:36
*** pino|work has quit IRC16:36
*** tiswanso has quit IRC16:36
*** tosky has quit IRC16:37
*** pino|work has joined #tripleo16:37
*** tosky__ has joined #tripleo16:37
*** tremble has quit IRC16:37
*** pino|work_ has quit IRC16:37
*** tosky_ has quit IRC16:38
*** mcornea has quit IRC16:38
*** thrash is now known as thrash|f00dz16:41
openstackgerritMerged openstack/tripleo-heat-templates: Add network templates for multiple NIC configuration  https://review.openstack.org/20449416:42
*** ifarkas has quit IRC16:46
*** tiswanso has joined #tripleo16:46
*** Guest91242 is now known as beagles16:47
*** jcooley_ has joined #tripleo16:51
*** jaosorior_ has joined #tripleo16:52
*** marios_ has joined #tripleo16:54
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Test a update in trunk repository version  https://review.openstack.org/22978916:54
*** StevenK_ has joined #tripleo16:54
*** tosky__ has quit IRC16:55
*** beagles has quit IRC16:56
*** beagles has joined #tripleo16:57
*** shivrao has quit IRC16:58
*** barra204 has joined #tripleo16:58
*** dhellmann_ has joined #tripleo17:00
*** tiswanso has quit IRC17:01
*** tiswanso has joined #tripleo17:02
*** lsmola has quit IRC17:02
*** dprince has joined #tripleo17:03
*** Ng_ has joined #tripleo17:03
*** ChanServ sets mode: +v Ng_17:03
*** jaosorior has quit IRC17:04
*** dhellmann has quit IRC17:04
*** marios has quit IRC17:04
*** Ng has quit IRC17:04
*** StevenK has quit IRC17:04
*** jcooley has quit IRC17:04
*** shakamunyi has quit IRC17:04
*** jcooley_ is now known as jcooley17:04
*** dhellmann_ is now known as dhellmann17:05
*** tosky__ has joined #tripleo17:05
*** Ng_ is now known as Ng17:06
*** alop has joined #tripleo17:07
*** apetrich has quit IRC17:08
*** bnemec has joined #tripleo17:10
*** jistr|afkmtg is now known as jistr17:14
*** pradk has quit IRC17:18
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Allow for usage of pre-allocated IPs for the controller nodes  https://review.openstack.org/22249717:20
*** pradk has joined #tripleo17:21
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Add sample environment file to document usage of pre-defined IPs  https://review.openstack.org/24160617:21
*** dsneddon_ is now known as dsneddon17:25
*** sthillma has quit IRC17:27
*** sthillma has joined #tripleo17:28
openstackgerritBen Nemec proposed openstack/python-tripleoclient: Always install yum-plugin-priorities  https://review.openstack.org/24216917:34
*** thrash|f00dz is now known as thrash17:34
* bnemec doing some hack shaving17:35
*** panda has quit IRC17:41
*** panda has joined #tripleo17:41
openstackgerritRohit Pagedar proposed openstack/tripleo-heat-templates: Adding nova parameteres to controller:  instance_name_template  use_forwarded_for  https://review.openstack.org/23496517:41
*** rpothier has joined #tripleo17:46
*** derekh has quit IRC17:48
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Add sample environment file to document usage of pre-defined IPs  https://review.openstack.org/24160617:49
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Allow for usage of pre-allocated IPs for the controller nodes  https://review.openstack.org/22249717:49
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Do not rename the nested port resource name for the VIPs  https://review.openstack.org/24217617:49
gfidentedprince, shardy turns out we didn't even need to create $network_vip.yaml becaise $network.yaml is enough https://review.openstack.org/24217617:50
gfidenteso that effectively maps back the new resource type into the pre-existing definition17:51
*** sthillma has quit IRC17:51
*** sthillma has joined #tripleo17:51
dprincegfidente: so NetName is all that was needed?17:53
gfidenteno NetName spilled in there, it's the vip.yaml to $network.yaml all that was needed17:54
gfidenteNetName was just a cleanup because there is no such a parameter anywhere, it's usually named something like ExternalNetName17:54
gfidentelet me strip that out from the change17:55
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Do not rename the nested port resource name for the VIPs  https://review.openstack.org/24217617:56
gfidentedone17:58
gfidentethe port resource in vip.yaml is named VipPort, while in the per-network.yaml is named InternalApiPort or ExternalPort17:58
*** mbound has quit IRC17:58
*** marcusvrn_ has joined #tripleo17:59
*** jistr has quit IRC18:00
*** sthillma has quit IRC18:06
*** akrivoka has quit IRC18:06
gfidenteshardy, one thing I'm left dealing with is this: https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud-without-mergepy.yaml#L110518:06
gfidenteshardy, that is an actual neutron port, not a custom type18:06
*** tiswanso has quit IRC18:06
gfidenteif I needed to make it overridable from the registry, can I create it from a nested stack with "same name" ?18:07
gfidenteControlVirtualIP ?18:07
openstackgerritBen Nemec proposed openstack/python-tripleoclient: Always install yum-plugin-priorities  https://review.openstack.org/24216918:08
*** tiswanso has joined #tripleo18:09
shardygfidente: No, not if you want to avoid the port being replaced18:13
gfidenteshardy, yeah which we want to avoid18:13
gfidenteso we're stuck with that kinda forever18:13
shardythe parent stack will see the type change from OS::Neutron::Port to a nested stack, which would trigger replacement18:13
gfidenteyeah18:14
gfidenteso I'll leave it as is18:14
gfidenteas a result18:14
gfidentewhen deploying with external balancer we can't noop ctlplane18:14
gfidentevip18:14
gfidentebut we can *not* use it though; so users will see in the undercloud neutron some control_virtual_ip which we don't use18:14
gfidentenot terrible18:14
shardygfidente: Oh, wait18:14
shardyif you just want to noop that one resource, that is probably possible18:15
gfidenteyes in general yes the only purpose is to noop it I think18:15
shardygfidente: yeah, I think we can do that without making a nested stack, sec18:15
gfidentewe can work on it later18:15
gfidentethe side-effect of not doing it is that we get an ip we don't use18:15
gfidentebut that is only for the ctplane virtual ip18:16
shardyhttp://docs.openstack.org/developer/heat/template_guide/environment.html#override-a-resource-with-a-custom-resource18:16
shardywe can override just that one resource to OS::Heat::None18:16
shardywithout changing the type in the template18:16
gfidentesec18:17
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Add net_vip_map_external to be used for an external balancer  https://review.openstack.org/22218918:18
openstackgerritMerged openstack/diskimage-builder: Add missing six requirement for svc-map element  https://review.openstack.org/23296218:18
shardyhttp://paste.fedoraproject.org/287363/4467474618:18
shardygfidente: something like that18:18
shardyalthough for kilo you will need a noop.yaml instead of OS::Heat::None18:19
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Make load balancer deployment optional via template param  https://review.openstack.org/22230518:19
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Do not rename the nested port resource name for the VIPs  https://review.openstack.org/24217618:19
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Add sample environment file to document usage of pre-defined IPs  https://review.openstack.org/24160618:19
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Allow for usage of pre-allocated IPs for the controller nodes  https://review.openstack.org/22249718:19
gfidenteOk I think this needs testing only18:19
gfidentethe nested resource_registry thing is very cool18:20
shardyYeah, we could actually use it to reduce some of the per-role template duplication I think18:22
*** devvesa has quit IRC18:23
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Allow for usage of pre-allocated IPs for the controller nodes  https://review.openstack.org/22249718:32
*** weshay_xchat has quit IRC18:32
*** weshay_xchat has joined #tripleo18:34
gfidentebnemec, how about we merge ? https://review.openstack.org/#/c/212664/918:37
gfidentewe just need to make sure the params are passed via parameter_defaults:18:37
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Allow customization of the Ceph pool names  https://review.openstack.org/21266418:39
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Allow customization of Ceph client user  https://review.openstack.org/21268618:39
gfidentebnemec ^^ rebased18:39
bnemecDid they need a rebase?18:39
gfidenteyeah the topmost18:40
*** chem has joined #tripleo18:41
bnemecgfidente: I think I'm fine with those merging.  It's going to be a problem for people already using the top-level params, but that's our fault for rushing it downstream.18:41
gfidentewell18:42
gfidenteit's a problem only if they were using parameters;18:42
gfidentenot if they were using parameter_defaults:18:42
bnemecRight, but I know at least one customer that was configuring with parameters.18:42
gfidenteAND if they were using parameters: it won't actually break things but fail validation18:42
bnemecAh, that's actually very good.18:43
chemhi, where can I find the source of "setup-endpoints" used in undercloud-post-config/os-refresh-config/post-configure.d/98-undercloud-setup in instack-undercloud, I've got this18:43
chem       https://github.com/openstack/tripleo-incubator/blob/master/scripts/setup-endpoints18:43
chem       but it doesn't take the "-s" option, so that can't be this one.  Could someone point18:43
chem       me to the right direction ?18:43
bnemecchem: It's in os-cloud-config now.18:43
chembnemec: thank you18:44
bnemechttps://github.com/openstack/os-cloud-config/blob/master/os_cloud_config/cmd/setup_endpoints.py18:44
gfidentebnemec, this one instead I am less comfortable https://review.openstack.org/#/c/210402/18:44
gfidenteI think puppet will notice the param was changed (even though its value is what the default was)18:44
*** alop has quit IRC18:45
gfidenteand try a config refresh18:45
gfidenteneeds testing though18:45
bnemecgfidente: Yeah, I'd say let's hold off on that until we have the upgrade job.18:45
bnemecThe redis one too.18:45
gfidenteredis sure would break yes because ceilometer coordingation_url is changed18:46
gfidentecoordination_url18:46
*** regebro has quit IRC18:46
bnemecIt's something we obviously need to do, but we also need to make sure there's some sort of upgrade path available.18:46
gfidenteyeah leaving for today, have fun18:46
bnemecHave a good one.18:47
*** gfidente has quit IRC18:48
*** alop has joined #tripleo18:53
chembnemec: sorry to bother you again.  Then in instack-deploy-overcloud (in instack-overcloud), "tripleo setup-endpoints" is used.  It seems to match the interface of the aforementioned script is that correct or is it another script ?18:55
bnemecchem: We're not using instack-deploy-overcloud anymore.  The endpoint setup is done either in tripleoclient now or by puppet (a change just merged to do the latter, but it will probably have to be reverted because it breaks upgrades).18:56
bnemecchem: The current workflow we're using is documented at http://docs.openstack.org/developer/tripleo-docs/18:57
*** jerrygb has quit IRC18:57
*** jerrygb has joined #tripleo18:58
bnemecchem: You might also be interested in tripleo.sh: https://github.com/openstack/tripleo-common/blob/master/scripts/tripleo.sh18:58
bnemecIt scripts a lot of the steps from the docs.18:58
chembnemec: oki, thanks I have a look.  My goal would be to fix an old "bug", https://bugzilla.redhat.com/show_bug.cgi?id=1236989, so I grep around to find a fix.18:59
openstackbugzilla.redhat.com bug 1236989 in rhel-osp-director "RFE: change computev3 service name to novav3" [Unspecified,New] - Assigned to calfonso18:59
bnemecchem: Okay, the old place to fix it would have been https://github.com/openstack/os-cloud-config/blob/master/os_cloud_config/keystone.py#L7019:02
bnemecI'm not sure where it's defined in puppet.19:02
bnemecBut puppet may not have had the bug in the first place, so it may not need to be fixed there.19:02
chembnemec: yeah, that's exactly that :)19:03
*** jerrygb has quit IRC19:03
bnemecAlthough we should probably just stop registering that endpoint, since nova v3 is no longer a thing.19:03
*** jprovazn has quit IRC19:03
chembnemec: puppet-keystone module currently chocks on service which are different only by type19:04
chembnemec: here you have nova/computev3 and nova/compute19:04
*** shivrao has joined #tripleo19:04
chembnemec: puppet-keystone will be fixed but it's a non backward comptatible fix and may takes some times19:04
chembnemec: in the meantime a simple fix would be to follow the convention described in the bug report : novav3/computev3 and nova/compute19:05
bnemecchem: Right, although I still think we need to completely remove the v3 endpoint anyway.  Nova decided against pursuing their v3 api so I can't imagine the endpoint actually works anymore.19:07
bnemecI'm fine with just fixing the name in the meantime though.19:07
chembnemec: either way is ok by me, my ultimate goal is to quickly unlock this https://review.openstack.org/#/c/23470419:08
chem(quickly == not waiting the change in puppet to have been accepted)19:09
chembnemec: so it's ok if I propose a patch that fix the the rhbz and you can decide later if the removal is appropriate, even if your point is very strong: no api, no endpoint, makes a lot of senses :)19:11
bnemecchem: Yeah, that's fine.19:12
chembnemec: great19:12
openstackgerritDan Prince proposed openstack/instack-undercloud: Set nova ironic admin_url correctly  https://review.openstack.org/24219519:14
*** electrofelix has quit IRC19:15
openstackgerritDan Prince proposed openstack/diskimage-builder: Use ironic-agent for source-repositories  https://review.openstack.org/23308819:17
*** rasca has quit IRC19:17
*** rasca has joined #tripleo19:18
openstackgerritAthlan-Guyot sofer proposed openstack/os-cloud-config: Change nova service's name for v3 to novav3.  https://review.openstack.org/24219819:24
chembnemec: ^19:25
*** tosky__ has quit IRC19:26
jaosorior_Hey bnemec, do you have some time to review the TLS patch?19:26
jaosorior_https://review.openstack.org/#/c/231930/19:27
*** Marga_ has joined #tripleo19:30
*** noslzzp has quit IRC19:31
*** adrianopetrich has joined #tripleo19:33
openstackgerritMark Chappell proposed openstack/tripleo-heat-templates: Use PCS's maintenance mode while updating configuration  https://review.openstack.org/24214119:33
*** tremble has joined #tripleo19:34
*** tremble has joined #tripleo19:34
jaosorior_tremble: was that the fix for the bug we were talking about earlier? O_O19:36
tremblejaosorior_: With a little luck, yes19:37
jaosorior_duuuude19:37
jaosorior_you da man19:37
trembleWe'll see if it works, or if the more senior devs hate it.19:37
jaosorior_tremble, If you get the chanse, can you score the root CA injection patch?19:38
tremblejaosorior_: Sure, could you take a quick look at https://review.openstack.org/#/c/241574/ too19:39
jaosorior_sure19:40
jaosorior_tremble: That looks quite straight forward19:41
tremblejaosorior_: Yup, just adds some outputs that show which certs/keys were injected in a way that doesn't compromise them19:42
jaosorior_does the pacemaker puppet module have no way to se the maintenance mode?19:45
tremblenope, ultimately it should move in there19:46
jaosorior_ok, looks good to me in the meantime19:46
trembleYeah if it works I probably need to figure out how to update the commit message to reference the appropriate bugs too19:48
jaosorior_tremble is there more than one bug reported for this>?19:49
trembleThere's a Red Hat BZ, dunno if/what the tripleo bug might be19:50
jaosorior_you can reference the red hat BZ to the patch19:51
*** mbound has joined #tripleo19:53
*** jerrygb has joined #tripleo19:53
*** aufi has joined #tripleo19:58
*** jaosorior_ has quit IRC19:58
*** johnsom has joined #tripleo19:58
*** jobewan has joined #tripleo20:00
*** jaosorior has joined #tripleo20:00
johnsomHi, I'm with the Octavia team.  We use diskimage-builder to generate our amphora service vm images.  In the past week or two the virtual size as reported by qemu-img has gone from 2147483648 bytes to 2214658048 bytes when specifying --image-size 2.  Would anyone have a pointer as to what changed?20:01
johnsomNova will no longer boot these images with a 2GB flavor20:02
*** Marga_ has quit IRC20:03
*** Marga_ has joined #tripleo20:03
*** aufi has quit IRC20:04
*** jaosorior has quit IRC20:04
*** noslzzp has joined #tripleo20:13
*** Marga_ has quit IRC20:20
*** Marga_ has joined #tripleo20:21
*** ryansb has quit IRC20:26
*** Marga_ has quit IRC20:26
*** ryansb has joined #tripleo20:28
*** ryansb has joined #tripleo20:28
openstackgerritPierre Blanc proposed openstack/tripleo-heat-templates: Fix the wrong selinux context when glance use nfs backend  https://review.openstack.org/24221120:34
*** dsneddon is now known as dsneddon_biab20:34
*** adrianopetrich has quit IRC20:43
openstackgerritMark Chappell proposed openstack/tripleo-heat-templates: Use PCS's maintenance mode while updating configuration  https://review.openstack.org/24214120:46
*** lblanchard has quit IRC20:58
openstackgerritPierre Blanc proposed openstack/tripleo-heat-templates: Fix the wrong selinux context when glance uses nfs backend  https://review.openstack.org/24221121:14
bnemecjohnsom: My guess would be this: https://github.com/openstack/diskimage-builder/commit/f84b910f152220294a723836a71586974efadede21:14
johnsomThank you!  I will check that out.  I was just pulling a commit ID from a last known good git log.21:15
bnemecMaybe we need to use 1000 as the base for calculating the size in K?  I'm not sure how the old truncate call would have been doing that.21:16
johnsomYeah, not sure.  I think we do need to make sure that 2GB in diskimage-builder == 2GB in nova flavor21:17
bnemecBut I would definitely call it a bug if you build a 2 GB image and it won't boot in a 2 GB flavor.21:17
bnemecYeah21:17
johnsomIt worked until recently21:17
johnsomI will open a bug while I try to track it down better.21:19
bnemecYeah, that change only merged a couple of weeks ago.  I'm guessing that's when you started having trouble with it.21:19
bnemecSounds good, thanks.21:19
bnemecjohnsom: Oh, I bet it's because of the $du_size + 65536 that is being run even when image size is specified now.21:21
bnemecBasically we're adding 65 MB to the image size unconditionally, which is about what the difference you mentioned above is.21:22
johnsomIt is close21:23
*** dsneddon_biab is now known as dsneddon21:25
*** jayg is now known as jayg|g0n321:25
bnemecWe should probably just put the ext4 block that's messing with size and mkfs opts back into the else so it doesn't get run when an image size is specified.21:26
johnsomhttps://bugs.launchpad.net/diskimage-builder/+bug/151362221:29
openstackLaunchpad bug 1513622 in diskimage-builder "diskimage-builder 2GB image does not boot in 2GB flavor" [Undecided,New]21:29
johnsombnemec I just ran through the numbers.  This is the issue.  I might take a pass at a patch.21:37
openstackgerritBen Nemec proposed openstack/tripleo-common: Remove yum-plugin-priorities hack  https://review.openstack.org/24222821:39
bnemecjohnsom: Cool, if you push it then I can +2 it. :-)21:39
*** dprince has quit IRC21:41
*** panda has quit IRC21:41
*** panda has joined #tripleo21:42
*** absubram has quit IRC21:44
johnsombnemec What do you think about removing the + 65536 on the size but leave the journal settings outside?  It just means that the usable space is slightly smaller, but the image size is what was requested.21:45
johnsomI think the journal setting is valid and want to retain that21:46
*** tiswanso has quit IRC21:46
*** noslzzp has quit IRC21:49
bnemecjohnsom: I'd be okay with that.  The journal setting is designed to be "safe", so it probably makes sense to always apply it.21:49
johnsomOk, cool.  Testing now21:50
*** shardy has quit IRC21:58
*** untriaged-bot has joined #tripleo22:00
untriaged-botUntriaged bugs so far:22:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/151090122:00
openstackLaunchpad bug 1510901 in tripleo "seed's nova-compute service start fail" [Undecided,In progress] - Assigned to Cameron.C (cameron-c)22:00
*** rhallisey has quit IRC22:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/151171522:00
openstackLaunchpad bug 1511715 in diskimage-builder "Images using draycut should have the option to pass drivers to include in build" [Undecided,New] - Assigned to Julia Kreger (juliaashleykreger)22:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/151350822:00
openstackLaunchpad bug 1513508 in diskimage-builder "Ironic IPA does not work when Swift is using https" [Undecided,New]22:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/150590022:00
openstackLaunchpad bug 1505900 in diskimage-builder "Failed to create 'wily' release with DIB_RELEASE" [Undecided,New]22:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/150426322:00
openstackLaunchpad bug 1504263 in tripleo "os-net-config mapping by MAC fails if trying to map in alternate order" [Undecided,Triaged]22:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/150914822:00
openstackLaunchpad bug 1509148 in tripleo "keystone initialize fails if undercloud can't reach overcloud public vip" [Undecided,New]22:00
*** untriaged-bot has quit IRC22:00
openstackgerritPierre Blanc proposed openstack/tripleo-heat-templates: Fix the wrong selinux context when glance uses nfs backend  https://review.openstack.org/24221122:00
*** thrash is now known as thrash|g0ne22:03
*** weshay_xchat has quit IRC22:08
*** tzumainn has quit IRC22:09
*** tzumainn has joined #tripleo22:13
*** rpothier has quit IRC22:14
*** Goneri has quit IRC22:15
*** Marga_ has joined #tripleo22:20
*** weshay_xchat has joined #tripleo22:23
*** pradk has quit IRC22:25
*** cwolferh has quit IRC22:29
*** alop has quit IRC22:50
*** wfoster has quit IRC22:51
*** alop has joined #tripleo22:51
*** wfoster has joined #tripleo22:52
*** morazi has quit IRC22:56
*** jerrygb has quit IRC23:08
*** StevenK_ is now known as StevenK23:21
*** nibalizer has quit IRC23:24
*** jobewan has quit IRC23:32
*** jerrygb has joined #tripleo23:33
*** sthillma has joined #tripleo23:35
openstackgerritPierre Blanc proposed openstack/tripleo-heat-templates: Fix the wrong selinux context when glance uses nfs backend  https://review.openstack.org/24221123:35
*** Marga__ has joined #tripleo23:37
*** Marga_ has quit IRC23:40
openstackgerritShiva Prasad Rao proposed openstack/tripleo-heat-templates: Add support to tag patch port for Cisco Nexus1000v VSM bringup  https://review.openstack.org/24226523:41
openstackgerritRhys Oxenham proposed openstack/tripleo-heat-templates: [WIP] Adding in support for automated Calamari Integration  https://review.openstack.org/24226723:44
*** jobewan has joined #tripleo23:44
*** jerrygb_ has joined #tripleo23:49
*** jerrygb has quit IRC23:50
*** alop_ has joined #tripleo23:52
*** alop has quit IRC23:54
*** alop_ is now known as alop23:54
*** julim has quit IRC23:56
*** alop has quit IRC23:57
*** julim has joined #tripleo23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!