Monday, 2015-11-23

*** shadower has quit IRC00:23
*** shadower has joined #tripleo00:23
openstackgerritDan Prince proposed openstack/tripleo-puppet-elements: Install puppet-mistral via puppet-modules element  https://review.openstack.org/24850301:19
*** shivrao has joined #tripleo01:25
*** julim has quit IRC01:27
*** tiswanso has joined #tripleo01:30
*** tiswanso has quit IRC01:30
*** tiswanso has joined #tripleo01:31
*** masterbound has quit IRC01:31
openstackgerritDan Prince proposed openstack/instack-undercloud: Install mistral (workflow) in the undercloud  https://review.openstack.org/24850601:42
*** jerrygb has joined #tripleo01:44
*** olap has quit IRC01:44
openstackgerritDan Prince proposed openstack/instack-undercloud: Keystone v3 support (configured via Puppet)  https://review.openstack.org/24850001:44
openstackgerritDan Prince proposed openstack/instack-undercloud: Install mistral (workflow) in the undercloud  https://review.openstack.org/24850601:44
*** weshay_xchat has quit IRC01:50
*** jerrygb has quit IRC02:05
*** masterbound has joined #tripleo02:32
*** masterbound has quit IRC02:37
*** shivrao has quit IRC02:37
*** shivrao has joined #tripleo02:55
*** jerrygb has joined #tripleo03:06
*** jerrygb has quit IRC03:11
*** Goneri has quit IRC03:18
*** Goneri has joined #tripleo03:31
*** wuhg has joined #tripleo03:56
*** cmyster has quit IRC03:59
*** untriaged-bot has joined #tripleo04:01
untriaged-botUntriaged bugs so far:04:01
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/150590004:01
openstackLaunchpad bug 1505900 in diskimage-builder "Failed to create 'wily' release with DIB_RELEASE" [Undecided,New]04:01
*** untriaged-bot has quit IRC04:01
*** aukhan has joined #tripleo04:05
*** shivrao_ has joined #tripleo04:12
*** shivrao has quit IRC04:14
*** shivrao_ is now known as shivrao04:14
*** tiswanso has quit IRC04:28
*** cmyster has joined #tripleo04:59
*** cmyster has quit IRC04:59
*** cmyster has joined #tripleo04:59
*** masco has joined #tripleo05:11
*** Goneri has quit IRC05:17
*** rcernin has joined #tripleo05:36
*** rcernin has quit IRC05:42
*** sthillma has joined #tripleo06:02
*** sthillma_ has joined #tripleo06:05
*** sthillma has quit IRC06:08
*** sthillma_ is now known as sthillma06:08
*** anande has joined #tripleo06:37
*** tremble has quit IRC06:40
*** sthillma has quit IRC06:50
*** rcernin has joined #tripleo07:07
*** jaosorior has joined #tripleo07:10
*** openstack has joined #tripleo07:18
*** shivrao has quit IRC07:22
*** olap has joined #tripleo07:23
*** ukalifon has joined #tripleo07:27
*** jerrygb has joined #tripleo07:51
*** akuznetsov has joined #tripleo07:53
*** jprovazn has joined #tripleo07:54
*** jerrygb has quit IRC07:57
*** akuznetsov has quit IRC08:01
*** tremble has joined #tripleo08:02
*** liverpooler has joined #tripleo08:11
*** liverpoo1er has joined #tripleo08:31
*** aufi has joined #tripleo08:32
openstackgerritMarek Aufart proposed openstack/tripleo-common: Add resource capabilities  https://review.openstack.org/23253408:34
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Fixup neutron constraints in older overclouds before updating  https://review.openstack.org/24857208:38
*** regebro has joined #tripleo08:40
EmilienMis there any plan (or wip) to add upgrade testing jobs?08:56
*** liverpoo1er has quit IRC08:56
*** devvesa has joined #tripleo08:56
*** anande has quit IRC08:58
*** panda has quit IRC09:04
*** panda has joined #tripleo09:05
*** athomas has joined #tripleo09:05
*** olap has quit IRC09:08
*** dtantsur|afk is now known as dtantsur09:09
*** jcoufal has joined #tripleo09:11
*** hewbrocca has joined #tripleo09:12
*** anande has joined #tripleo09:13
*** paramite has joined #tripleo09:16
*** anande has quit IRC09:19
*** anande has joined #tripleo09:19
*** shardy has joined #tripleo09:19
*** shivrao has joined #tripleo09:21
*** jistr has joined #tripleo09:27
*** shivrao has quit IRC09:34
mariosshardy: when you have a sec, can you check the comments at https://review.openstack.org/#/c/248184/ - esp. jaosorior question09:35
mariosshardy: otherwise i think we can land it (and green ci)09:35
shardymarios: hey, sure, looking09:38
mariosshardy: my assumption is the NetworkDeployment (and all associated sub-resources) will stay at create_complete, i.e. since they aren't affected by an update09:38
mariosshardy: thanks, some context ^^09:38
mariosjaosorior: this is about your question, just getting a sanity check ^^^^09:38
jaosoriormarios: Thanks dude09:39
*** liverpooler has quit IRC09:39
shardymarios: yes, unless you change the default NetworkDeploymentActions of ['CREATE'], NetworkDeployment will never do anything on update of an already deployed node09:39
shardyone corner case is, if the OS::TripleO::ObjectStorage::Net::SoftwareConfig, or any of the things input to it, change on an update, existing nodes won't be updated, but any new nodes (scale up) will get the new configuration09:40
*** derekh has joined #tripleo09:40
mariosshardy: and i guess that and all subresources stay at create_complete during the update?09:41
shardywhich, I think is reasonable and expected, but we may need to document it somewhere09:41
*** gfidente has joined #tripleo09:41
mariosshardy: yeah, well we make it clear that network config/topology/whatever changes need to happen via _mechanism_... probably we add something like yum_update.sh09:41
*** masterbound has joined #tripleo09:42
shardymarios: subresources?09:42
mariosshardy: well no, i mean, the complication here is the yum update right. so in normal circumstances, i could change my network templates and stack update, or in theory anyway09:43
mariosshardy: i meant all the related neutron resources that are created when you deploy09:43
*** mcornea has joined #tripleo09:43
shardymarios: Yes, those could still change, but the NetworkDeployment will never re-run, unless you change the NetworkDeploymentActions09:44
shardyI assume we'll want folks to be careful *not* to ever change those tho09:44
shardyand even introduce a way to lock the network resources in future, so they can't be updated by default09:44
shardy(ref the VIP replacement bug)09:44
mariosshardy: yeah. is that a heat thing being added?09:45
jaosoriorshardy: well, I guess it makes sense, and some documentation regarding this will be pushed, right?  seems to me like it might be a pretty important detail. That if the networkdeployment inputs change, then NetworkDeploymentActions needs to be used with UPDATE to make the change be reflected on all the already deployed nodes09:45
shardymarios: ryansb proposed a spec but it hasn't been implemented - I may take a look at it this cycle as I think we need it09:45
shardyhttps://github.com/openstack/heat-specs/blob/master/specs/kilo/stack-update-restrict.rst09:46
shardyjaosorior: right, we'll need some docs about that09:47
jaosoriorshardy: +1ed the CR09:47
shardyapproved!09:48
openstackgerritMerged openstack/tripleo-heat-templates: Allows for customization of NetworkDeployment actions  https://review.openstack.org/24818409:48
*** liverpooler has joined #tripleo09:49
* shardy notes it's another thing not wired in via overcloud_without_mergepy, but isn't blocking on it09:49
dtantsurhi folks, could you please merge https://review.openstack.org/#/c/248172/ ? it's breaking gate IIUC09:50
shardydtantsur: ouch, done!09:51
mariosshardy: thanks09:52
*** bvandenh has joined #tripleo09:55
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Enable trust anchor injection  https://review.openstack.org/24120009:55
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Output the SSL Certificate and Key modulus  https://review.openstack.org/24157409:55
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Inject TLS certificate and keys for the Overcloud  https://review.openstack.org/23193009:55
jaosoriorjust resolved a merge conflict there ^^09:55
*** anande_ has joined #tripleo09:56
openstackgerritMerged openstack/os-cloud-config: Don't import ironicclient exceptions from openstack.common  https://review.openstack.org/24817209:57
*** anande has quit IRC09:59
*** untriaged-bot has joined #tripleo10:00
untriaged-botUntriaged bugs so far:10:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/150590010:00
openstackLaunchpad bug 1505900 in diskimage-builder "Failed to create 'wily' release with DIB_RELEASE" [Undecided,New]10:00
*** untriaged-bot has quit IRC10:00
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Introduce domain configuration through parameter  https://review.openstack.org/23995510:00
*** olap has joined #tripleo10:03
*** jerrygb has joined #tripleo10:08
*** paramite is now known as paramite|afk10:08
*** mgould has joined #tripleo10:09
*** pblaho has joined #tripleo10:10
*** jerrygb has quit IRC10:13
*** apetrich has quit IRC10:16
*** apetrich has joined #tripleo10:17
*** paramite|afk is now known as paramite10:17
*** bvandenh has quit IRC10:35
*** akrivoka has joined #tripleo10:36
shardyderekh: Hey, can you check out https://review.openstack.org/#/c/246457/4 when you get a sec, I think it's ready to land10:36
shardyAbout to push some more tripleo-ci patches and looking to somewhat reduce the large chains of dependencies I'm currently juggling ;)10:37
derekhshardy: looking10:37
*** panda has quit IRC10:38
*** mcornea has quit IRC10:39
*** mcornea has joined #tripleo10:39
*** mcornea has quit IRC10:40
*** mcornea has joined #tripleo10:41
derekhshardy: a tripleo.sh patch is mention on that review a couple of times, is it refering to this one ? https://review.openstack.org/#/c/246447/10:41
*** paramite is now known as paramite|afk10:41
*** gfidente has quit IRC10:46
*** mkovacik has joined #tripleo10:46
shardyderekh: yup10:48
shardyderekh: I did have a Depends-On, but removed it trying to get stable Depends-On to work before that landed10:49
shardyjuggling all these on-review branches is hard, we may have to just push a bunch of stuff to stable/liberty soon in an effort to get CI going10:49
shardymy current challenge is to figure out why we're ignoring the tripleo-ci repo for stable jobs :(10:50
derekhshardy: ok, I don't think this is correct, we can't remove "echo "export $X" >> $TRIPLEO_ROOT/puppet.env"10:50
*** gchamoul is now known as gchamoul|afk10:51
derekhshardy: I'll comment on the patch, it might be easier to explain inline10:51
shardyderekh: Ok, thanks10:51
shardyderekh: the main requirement is not to build all the puppet modules from master for the stable job10:51
derekhshardy: ack10:52
shardyI'm open to other suggestions of how we do that10:52
openstackgerritJaume Devesa proposed openstack/puppet-tripleo: MidoNet services manifests  https://review.openstack.org/24418410:53
*** olaph has quit IRC10:57
*** olaph has joined #tripleo11:01
*** aukhan has quit IRC11:04
*** w__ has joined #tripleo11:11
*** gfidente has joined #tripleo11:11
*** gfidente has quit IRC11:11
*** gfidente has joined #tripleo11:11
derekhshardy: commented, I think what I'm saying makes sense11:11
*** olaph has quit IRC11:13
shardyderekh: thanks, makes sense, will update11:16
*** mcornea has quit IRC11:18
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Set puppet DIB_INSTALLTYPE in tripleo.sh not toci_instack.sh  https://review.openstack.org/24645711:26
shardyderekh: ^^ I think I understood your comments, thanks for the feedback11:27
shardywhat's the convention with chicken/egg things like when we land that we've got to land https://review.openstack.org/#/c/247543/ on stable/liberty (and some other tripleo-common patches), but CI can't pass on those yet due to other issues?11:28
shardyDo I just keep piling the Depends-On's up until things eventually pass, or take the approach that we land stuff we know is definitely needed & landed on master?11:29
derekhshardy: since we don't have the job working on stable liberty yet (i.e. we can't break it), my view would be merging things to get ci working into stable branches is ok without a pass, as long as were not breaking master11:34
*** mcornea has joined #tripleo11:34
*** hewbrocca has quit IRC11:35
derekhAnybody want to second this ? https://review.openstack.org/#/c/244643/511:36
jaosorior /query tremble duuuude11:36
shardyderekh: ack, thanks that sounds like it'll make things easier11:37
shardystarting from tripleo-common seems like a good plan11:37
tremblejaosorior: Hey11:37
jaosoriortremble: Nothing, already sent you the github link, still laughing at the brilliantness of it11:38
tremble:)11:38
derekhshardy: I think its a little weird having a master and stable version of tripleo.sh and then adding support for both versions in both versions, but we can take another look at that at some stage11:39
openstackgerritMerged openstack/tripleo-common: Update gitreview on stable/liberty  https://review.openstack.org/24464311:43
*** masterbound is now known as mbound_11:53
*** paramite|afk is now known as paramite11:53
*** regebro has quit IRC12:04
*** regebro has joined #tripleo12:05
*** paramite has quit IRC12:16
*** mbound_ has quit IRC12:28
*** mbound_ has joined #tripleo12:31
*** masco has quit IRC12:31
*** mbound_ has quit IRC12:35
*** marcusvrn_ has joined #tripleo12:35
*** hewbrocca has joined #tripleo12:35
*** jdob has joined #tripleo12:40
*** thrash|wknd is now known as thrash12:43
openstackgerritMerged openstack/tripleo-heat-templates: Add constraints and timeouts from file in single step  https://review.openstack.org/24718412:47
*** weshay_xchat has joined #tripleo12:54
*** electrofelix has joined #tripleo12:54
*** rhallisey has joined #tripleo12:56
*** jerrygb has joined #tripleo12:59
*** jerrygb has quit IRC12:59
*** jerrygb has joined #tripleo12:59
*** jerrygb_ has joined #tripleo13:00
*** jerrygb has quit IRC13:03
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Fixup neutron constraints in older overclouds before updating  https://review.openstack.org/24857213:07
*** tzumainn has joined #tripleo13:09
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add option to add metadata for the overcloud nodes  https://review.openstack.org/24355013:19
*** trown|outttypeww is now known as trown13:20
*** dprince has joined #tripleo13:20
*** gchamoul|afk is now known as gchamoul13:23
*** jayg|g0n3 is now known as jayg13:23
*** w__ has quit IRC13:24
*** w__ has joined #tripleo13:25
*** lucasagomes is now known as lucas-hungry13:28
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: WIP: Add update environment file to facilitate update when using vip.yaml  https://review.openstack.org/24869913:30
*** paramite has joined #tripleo13:31
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Set puppet DIB_INSTALLTYPE in tripleo.sh not toci_instack.sh  https://review.openstack.org/24645713:32
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: WIP: Add update environment directory and sample file  https://review.openstack.org/24869913:33
*** paramite has quit IRC13:34
*** paramite has joined #tripleo13:34
*** rbrady has quit IRC13:39
*** rbrady has joined #tripleo13:39
*** tiswanso has joined #tripleo13:42
*** mbound_ has joined #tripleo13:43
*** tiswanso has quit IRC13:44
*** tiswanso has joined #tripleo13:45
*** jistr has quit IRC13:46
*** jdob has quit IRC13:48
*** athomas has quit IRC13:59
*** Goneri has joined #tripleo13:59
*** julim has joined #tripleo13:59
openstackgerritTzu-Mainn Chen proposed openstack/tripleo-common: TripleO API v1  https://review.openstack.org/24373714:03
*** athomas has joined #tripleo14:04
*** olap has quit IRC14:10
*** paramite is now known as paramite|afk14:14
*** rpothier has joined #tripleo14:15
*** lucas-hungry is now known as lucasagomes14:18
*** rlandy has joined #tripleo14:21
*** paramite|afk is now known as paramite14:35
*** jprovazn has quit IRC14:47
*** morazi has joined #tripleo14:51
GoneriHi, can someone take a look on https://review.openstack.org/#/c/248246/ , this would help a lot to be able to deploy RDO when local_interface interface is associated to a vlan ( https://bugzilla.redhat.com/show_bug.cgi?id=1283812 )14:53
openstackbugzilla.redhat.com bug 1283812 in dib-utils "local_interface=bond0.120 in undercloud.conf create broken network configuration" [Unspecified,New] - Assigned to jslagle14:53
bnemecdprince: slagle: I think we're going to need a release of https://review.openstack.org/#/c/248172/ to unblock the tripleoclient gate.14:59
bnemecThe unit tests pull down the latest from pip, so just having it merged isn't enough.14:59
*** pradk has joined #tripleo14:59
*** julim_ has joined #tripleo15:00
*** openstackgerrit has quit IRC15:02
*** openstackgerrit has joined #tripleo15:02
*** julim has quit IRC15:02
dtantsurbnemec, oh that's why it still fails..15:02
slaglebnemec: ok, we can do that. i'm a fan of releasing whenever we need to15:03
bnemecslagle: Cool, thanks15:04
dprincebnemec: ++ release it15:04
*** bvandenh has joined #tripleo15:10
*** liverpooler has quit IRC15:11
*** jaosorior has quit IRC15:11
*** w__ is now known as olaph15:12
*** jaosorior has joined #tripleo15:12
*** jaosorior has quit IRC15:12
*** jaosorior has joined #tripleo15:13
*** jdob has joined #tripleo15:14
*** zb is now known as zaneb15:23
*** rasca has quit IRC15:28
*** rasca has joined #tripleo15:28
openstackgerritFelipe Alfaro Solana proposed openstack/tripleo-heat-templates: Ceph Puppet: implement per-pool parameters:  https://review.openstack.org/24766915:32
*** paramite is now known as paramite|afk15:35
openstackgerritRohit Pagedar proposed openstack/tripleo-heat-templates: Making nova parameters configurable  https://review.openstack.org/23496515:38
*** mgould has quit IRC15:42
*** olaph is now known as olaf15:43
*** olaf is now known as olaph15:43
*** tiswanso has quit IRC15:45
*** tiswanso has joined #tripleo15:45
*** olaph is now known as olaf15:46
*** olaf is now known as Guest77315:47
*** Guest773 is now known as olaph15:47
*** lazy_prince has joined #tripleo15:49
*** jprovazn has joined #tripleo15:50
*** jistr|mobi has joined #tripleo15:56
*** mgould has joined #tripleo15:57
*** rpodolyaka has left #tripleo15:57
rhalliseyderekh, patch to add container args for the gate -> https://review.openstack.org/#/c/248209/15:59
openstackgerritgreghaynes proposed openstack/tripleo-specs: Refer to DIB elements by URI  https://review.openstack.org/24711615:59
rhalliseyforgot to add that to my email15:59
*** olap has joined #tripleo16:00
*** paramite|afk is now known as paramite16:00
jistr|mobislagle: i haven't made it home yet, will update etherpad when i'm back16:00
derekhrhallisey: lgtm16:00
rhalliseycool thx16:00
*** untriaged-bot has joined #tripleo16:01
untriaged-botUntriaged bugs so far:16:01
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/150590016:01
openstackLaunchpad bug 1505900 in diskimage-builder "Failed to create 'wily' release with DIB_RELEASE" [Undecided,New]16:01
*** untriaged-bot has quit IRC16:01
hewbroccajistr|mobi: how is the flat16:02
*** anande_ has quit IRC16:04
hewbroccaalso16:04
*** dsneddon has joined #tripleo16:04
hewbroccagfidente, slagle are you guys all over getting the various update patches that have been proposed upstream16:04
hewbroccamerged ASAP?16:04
* hewbrocca recognizes everyone has been busy...16:06
*** shivrao has joined #tripleo16:06
*** rcernin has quit IRC16:08
*** shivrao_ has joined #tripleo16:09
jistr|mobihewbrocca: good, but we're not 1st in the queue again16:10
hewbroccaGAH16:10
hewbroccajistr|mobi: you guys gotta be quicker on the draw :)16:10
*** shivrao has quit IRC16:11
*** shivrao_ is now known as shivrao16:11
*** gchamoul is now known as gchamoul|AfK16:12
*** jaosorior has quit IRC16:12
*** Pablo|off| has joined #tripleo16:14
*** Pablo|off| is now known as pcaruana16:15
*** tremble has quit IRC16:16
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Add net_vip_map_external to be used for an external balancer  https://review.openstack.org/22218916:18
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Make load balancer deployment optional via template param  https://review.openstack.org/22230516:18
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Allow for usage of pre-allocated IPs for the controller nodes  https://review.openstack.org/22249716:18
jistr|mobihewbrocca: yea, otoh N years of money savings are involved, so one wants to be a bit careful too :)16:22
*** apetrich has quit IRC16:24
hewbroccaeasy come easy go16:24
hewbrocca:D16:24
*** apetrich has joined #tripleo16:26
*** mandre has quit IRC16:30
*** mandre has joined #tripleo16:32
*** jistr has joined #tripleo16:33
*** jistr|mobi has quit IRC16:33
slaglehewbrocca: yes, we're working through them. we need another patch still to remove the netns constraint again.16:33
slagleas the issue with 55-heat-config using tmpfs means it re-applies the old puppet manifest after yum_update.sh, causing the constraint to get re-added after we've removed it16:33
slagleso we need to also add the removal to the pacemaker resource restart script at the very end16:34
*** mkovacik has quit IRC16:35
*** mgould has quit IRC16:38
* hewbrocca facepalm16:39
hewbroccawe really gotta fix that bit...16:39
hewbroccathe not being able to fix the DIB-applied scripts, I mean16:39
slaglewell, even if we could, there's no fix we could apply to that script to get the files back16:41
slagleif you've rebooted, they're gone.16:41
jistrhmm so it actually runs puppet twice? once the old, once the new?16:41
slaglejistr: yep16:41
jistrhmm that could be a general issue, as OPM is present only the new, not guaranteed to be compatible with the original t-h-t manifest. So aside from applying things we don't want, it can fail completely.16:43
jistrhmm i'm now thinking16:43
gfidenteyeah, what is that triggers old manifest apply though?16:43
jistrif the old manifest apply is even reported to heat?16:43
*** stendulker has joined #tripleo16:44
jistror if so, does heat pay any attention to it16:44
gfidenteoh the puppet apply is because of Identifier getting changed16:44
Goneridprince, https://review.openstack.org/#/c/248246/ can you take a look on this os-net-config, we need this patch to get instack-undercloud working with vlan tagged local_interface.16:45
slaglejistr: heat does not pay attention to it16:45
jistrright, so it probably wouldn't matter that it failed. ok at least that :)16:46
dprinceGoneri: yep, thanks for pointing it out16:46
slaglejistr: well, unless it leaves the cluster completely broken16:46
slagleand nothing reported to the user16:46
jistrhmm yea16:47
hewbroccaUgh! Random puppet apply doesn't seem good at all16:47
slagleshardy: do you have any ideas about how we can further workaround this issue with 55-heat-config if /var/run/ has been wiped?16:47
slagleshardy: any way to get the old contents back, or generate them somehow?16:48
gfidenteslagle, I don't get though if *Identifier triggers apply, why is it using older manifest?16:48
slaglegfidente: the old manifests and configs are already downloaded to /var/lib/heat-config. the script sees that, sees that there's no *.deployed equivalent in /var/run/heat-config, and reapplies them16:49
gfidenteah because of /run16:49
gfidentetks16:49
gfidente :016:49
*** trown is now known as trown|lunch16:49
slagleHmm. I wonder if also wiped /var/lib/heat-config16:49
slagle*we also16:49
slagleso nothing old is downloaded16:49
*** mgould has joined #tripleo16:50
*** aufi has quit IRC16:54
*** dmacpher has joined #tripleo16:55
hewbroccait's worth a try16:58
hewbroccayou could log into all the controllers before starting the process and nuke that dir, just to see what happens16:58
jistri'm trying to grasp how the metadata fetching and applying works17:00
slaglebnemec: os-cloud-config 0.3.0 in the sausage factory17:00
jistrin /var/lib/heat-config there are just the puppet manifests17:00
bnemecslagle: Nice, thanks :-)17:01
jistrbut not the whole json things including inputs etc.17:01
slaglejistr: that part is under /var/lib/os-collect-config17:02
slaglejistr: and oac is going to generate /usr/libexec/os-apply-config/templates/var/run/heat-config/heat-config before configure.d/55-heat-config runs17:04
slagleso actually, we'd have to probably selectively delete stuff out of /var/lib/os-collect-config which sounds pretty bad17:06
jistrslagle: ah yea those are the jsons i've been looking for. So i guess the puppet manifests are generated from this json metadata, no? The manifests are in the jsons as strings as well. What i'm getting at is that to me it seems like wiping /var/lib/heat-config/heat-config-puppet might not help17:07
jistrslagle: yup17:07
slaglei dont think this is a good idea17:07
slaglei'm not going to guess how to fix this, this is a heat / heat-config interaction17:07
jistryea would be good to get input from heat folks on this issue17:08
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Allow for usage of pre-allocated IPs for the controller nodes  https://review.openstack.org/22249717:08
slaglei can ask sbaker when he's online17:08
*** dmacpher has quit IRC17:10
*** dmacpher has joined #tripleo17:10
gfidenteand this is only fixed if people replace 55-heat-config17:11
*** olap has quit IRC17:12
*** ir2ivps10 has joined #tripleo17:13
jistryeah plus we'd need to migrate the content from /var/run to /var/lib17:13
shardyslagle: Hey, sorry been in a mtg, +1 on speaking to stevebaker, IIRC he's been looking at this, but obviously we need a way to update the heat-config stuff17:13
jistrotherwise we have just the new 55-heat-config but still a blank new dir17:14
slagleright so updating 55-heat-config can just be  manual, i'm not all that worried about that17:14
shardyslagle: I assume you've seen https://review.openstack.org/#/c/242924/ ?17:15
slagleshardy: yes. but what we actually need is a way to get /var/run back if it's already been wiped17:15
*** devvesa has quit IRC17:16
shardyslagle: Ok, ouch.  Other than letting the deployments all re-run I'm not sure17:16
slaglesomething that will generated the "deployed" dir based on the contents of /var/lib/os-collect-config and /var/lib/heat-config17:16
slaglejust assume it's all applied17:16
shardyif we assume all are completed, we could probably write a script which reads the deployment metadata and creates the files17:16
slagleshardy: so letting the old puppet rerun is where stuff breaks17:16
shardyslagle: Ok, well the data used as an input to heat-config is still there (the heat metadata asociated with the server), so it must be possible to re-created some dummy deployments data17:17
shardyhttps://github.com/openstack/tripleo-image-elements/blob/master/elements/os-refresh-config/os-refresh-config/post-configure.d/99-refresh-completed#L6617:19
shardye.g a loop like that which touches the file and stops heat-config running17:19
* shardy checks what heat-config expects17:19
shardyslagle: I think it's just checking for <deployment_id>.json17:20
shardyso a loop touching the files is probably enough17:20
*** shivrao has quit IRC17:20
*** rcernin has joined #tripleo17:21
*** sthillma has joined #tripleo17:21
shardy(see the "already deployed" logic in 55-heat-config17:21
*** yamahata has joined #tripleo17:22
slaglek, i updated the bug with this info17:22
slaglei'll talk to sbaker about it when he's on17:22
dprinceslagle: is there an upstream bug for this?17:23
*** sthillma_ has joined #tripleo17:23
*** sthillma has quit IRC17:25
*** sthillma_ is now known as sthillma17:25
*** jerrygb_ has quit IRC17:26
slagledprince: yes17:27
*** lazy_prince has quit IRC17:28
dprinceslagle: got a link?17:28
*** shardy has quit IRC17:30
*** derekh has quit IRC17:31
*** sthillma has quit IRC17:32
*** jerrygb has joined #tripleo17:33
*** jerrygb has quit IRC17:36
*** jerrygb has joined #tripleo17:40
*** jerrygb has quit IRC17:45
slagledprince: https://bugs.launchpad.net/heat-templates/+bug/151322017:47
openstackLaunchpad bug 1513220 in Heat Templates "55-heat-config state is stored in /var/run, which is lost on reboot" [Medium,Fix committed] - Assigned to Steve Baker (steve-stevebaker)17:47
*** dtantsur is now known as dtantsur|afk17:47
*** stendulker has quit IRC17:49
*** mgould has quit IRC17:54
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Sample environment with old ServiceNetMap value  https://review.openstack.org/24885918:08
*** trown|lunch is now known as trown18:11
*** yamahata has quit IRC18:11
*** dmacpher is now known as dmacpher-afk18:13
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Add fixup for pcs order constraints after update to new templates  https://review.openstack.org/24886318:22
openstackgerritMerged openstack/tripleo-heat-templates: Implement Advanced Firewalling support  https://review.openstack.org/19119518:22
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add support for DeployArtifacts  https://review.openstack.org/24531418:23
gfidenteslagle, merge https://review.openstack.org/#/c/248859/1 ?18:24
*** jerrygb has joined #tripleo18:27
openstackgerritMerged openstack/tripleo-heat-templates: Sample environment with old ServiceNetMap value  https://review.openstack.org/24885918:28
*** ukalifon has quit IRC18:28
slaglei would have waited for CI, just b/c18:29
gfidenteoh well, it wasn't going to test those bits anyway18:31
jistrmarios: pulling this to my newest update run too https://review.openstack.org/#/c/248863/18:34
jistrmarios: btw with the previous constraint i saw significant improvement in pings going out from a tenant VM, but still had issues with traffic going in, it seemed18:35
jistrdidn't have the latter properly automated, now i have automated ping tests both ways18:36
*** mandre has quit IRC18:37
mariosjistr: great thanks, we talked about that on the call this afternoon... seemed like the right place to fix it... you can check the constraints on your current env if it is still around, like http://paste.openstack.org/show/479745/18:37
jistrit actually timed out on keystone toke before completing (as i was running the errand in the afternoon), but it went through the yum_update phase smoother than before18:38
jistrbefore i saw 10 minute general connectivity loss from the VM, with the constraints it was just a couple of seconds18:39
*** dprince has quit IRC18:39
jistrbut i'm still not sure if the floating IP is totally fine. it didn't seem so18:39
mariosjistr: so to explain that paste a bit, i was polling the pcs constraints on control0 while it was being updated. before yum_update.sh is run, it is like 'BEFORE'. then 'AFTER' yum_update.sh is applied... so the constraints are good18:40
mariosjistr: then the unwanted neutron-server..ovs-cleanup re-appears (is re-added by the puppet-pacemaker run it seems?)18:40
jistryeah most probably18:41
*** mandre has joined #tripleo18:41
mariosjistr: really appreciate the extra testing. slagle confirmed he also saw that extraneous constraint in his env18:41
*** wuhg has quit IRC18:41
*** jerrygb has quit IRC18:42
*** jerrygb has joined #tripleo18:46
*** lazy_prince has joined #tripleo18:46
*** paramite has quit IRC18:49
*** bvandenh has quit IRC18:49
*** jerrygb has quit IRC18:51
*** bvandenh has joined #tripleo18:51
*** sthillma has joined #tripleo18:52
*** electrofelix has quit IRC18:57
*** lucasagomes is now known as lucas-dinner18:57
*** tiswanso has quit IRC19:00
*** tiswanso has joined #tripleo19:00
*** regebro has quit IRC19:02
*** lazy_prince has quit IRC19:02
*** jerrygb has joined #tripleo19:03
*** mandre has quit IRC19:04
*** mandre has joined #tripleo19:09
*** bvandenh has quit IRC19:13
*** trozet has joined #tripleo19:26
*** jcoufal has quit IRC19:27
trozetbnemec: do you have a few minutes to help me with something I'm hitting with tripleO deployment19:27
bnemectrozet: What's the problem?19:30
trozetbnemec: it looks like a timing issue between when hiera data files are created on the node, and when puppet executes19:30
trozetbnemec: puppet fails and hiera says hte variable isnt there, but If i check - it is there, and re-runninng puppet works19:30
*** gfidente is now known as gfidente|afk19:32
bnemectrozet: That is very strange.  What variable is triggering this?19:33
trozet[2015-11-23 17:59:11,330] (heat-config) [INFO] {"deploy_stdout": "", "deploy_stderr": "\u001b[1;31mError: Could not find data item opendaylight_port in any Hiera data file and no default supplied at /var/lib/heat-config/heat-config-puppet/ba7426b1-89cd-4360-b43a-e77d20b54596.pp:24 on node opendaylight-server\u001b[0m\n\u001b[1;31mError: Could not find data item opendaylight_port in any Hiera data file and no default supplied at /var/lib/19:34
trozetheat-config/heat-config-puppet/ba7426b1-89cd-4360-b43a-e77d20b54596.pp:24 on node opendaylight-server\u001b[0m\n", "deploy_status_code": 1}19:34
trozet[root@opendaylight-server ~]# cat /etc/puppet/hieradata/common.yaml | grep opendaylight_port19:35
trozetopendaylight_port: 808119:35
trozetbnemec:^19:35
bnemectrozet: Is there a change in gerrit for this that I can look at?19:40
trozetbnemec: no its not in gerrit.  The only thing I can think of at this point is something to do with the hooks/steps19:40
bnemectrozet: That was my first thought as well.19:40
trozetbnemec: this works on the controller, if its in step 219:40
trozetbnemec: but now im doing an external node, with no steps19:41
trozetbnemec: let me paste you the yaml19:41
trozetbnemec: http://pastebin.com/SbqNicBd19:41
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add support for DeployArtifacts  https://review.openstack.org/24531419:42
*** shivrao has joined #tripleo19:48
bnemectrozet: TBH, I'm not sure I'm the best person to ask about this, but it's possible you need a depends_on to make sure the hieradata gets applied before the puppet run happens: https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud-without-mergepy.yaml#L140719:51
*** dmacpher-afk has quit IRC19:52
trozetbnemec: yeah im trying a depends_on now19:56
*** dmacpher-afk has joined #tripleo20:05
trozetbnemec: i think that fixed it!20:14
bnemectrozet: Barely educated guesses FTW! :-)20:15
trozetbnemec: got a trickier question for you..20:15
trozetbnemec: this external opendaylight node spits out an output parameter lets call it odl_ip at the end of its deploy20:16
trozetbnemec: how can I reference that variable inside of the overcloud controller puppet?20:16
trozetbnemec: maybe I need to do an overcloud deployment step that depends on the OpenDaylight node finishing?20:17
bnemectrozet: Yeah, probably.  I think you're also going to want to allocate the port for the ODL server outside the ODL template too.  I believe that's how it works for the other server types.20:18
trozetbnemec: the port is passed in as environment file20:18
trozetbnemec: but like what i need to do is set openvswithc on the controller node to point to the odl_ip output variable20:19
*** yamahata has joined #tripleo20:20
bnemectrozet: Yeah, I suppose this would work kind of like the Ceph nodes do.  I believe they're completely deployed before everything else even starts.20:22
bnemectrozet: It looks like they have a similar thing too: https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/ceph-storage.yaml#L21820:22
*** jistr has quit IRC20:23
bnemecSo however we get that output back into the compute and control nodes should work for ODL too.20:23
trozetbnemec: good idea, thanks for the pointer will check it out20:23
openstackgerritMerged openstack-infra/tripleo-ci: Export TRIPLEO_SH_ARGS so containers gate will run properly  https://review.openstack.org/24820920:49
*** eggmaste` is now known as eggmaster20:52
*** jprovazn has quit IRC20:59
*** jang has quit IRC21:10
*** edmondk has quit IRC21:10
*** andreaf has quit IRC21:11
*** jang has joined #tripleo21:11
*** epheo has quit IRC21:11
*** edmondk has joined #tripleo21:17
*** epheo has joined #tripleo21:18
*** andreaf has joined #tripleo21:19
*** jerrygb has quit IRC21:22
*** shivrao has quit IRC21:25
*** jerrygb has joined #tripleo21:26
*** mcornea has quit IRC21:30
*** jerrygb has quit IRC21:31
*** david-lyle has quit IRC21:31
*** david-lyle has joined #tripleo21:34
*** jayg is now known as jayg|g0n321:36
*** mkovacik has joined #tripleo21:37
*** trown is now known as trown|outttypeww21:39
*** shivrao has joined #tripleo21:39
*** weshay_xchat has quit IRC21:41
*** weshay_xchat has joined #tripleo21:45
*** weshay_xchat has quit IRC21:46
*** morazi has quit IRC21:54
*** david-lyle has quit IRC21:55
*** untriaged-bot has joined #tripleo22:00
untriaged-botUntriaged bugs so far:22:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/150590022:00
openstackLaunchpad bug 1505900 in diskimage-builder "Failed to create 'wily' release with DIB_RELEASE" [Undecided,New]22:00
*** untriaged-bot has quit IRC22:00
*** david-lyle has joined #tripleo22:03
*** david-lyle has quit IRC22:04
*** julim_ has quit IRC22:09
*** akrivoka has quit IRC22:10
*** jerrygb has joined #tripleo22:11
*** thrash is now known as thrash|g0ne22:13
*** isq has quit IRC22:19
*** rcernin has quit IRC22:20
*** david-lyle has joined #tripleo22:21
*** isq has joined #tripleo22:21
*** david-lyle has quit IRC22:25
*** rpothier has quit IRC22:29
*** lucas-dinner has quit IRC22:36
*** athomas has quit IRC22:41
*** lucasagomes has joined #tripleo22:41
*** lucasagomes is now known as lucas-afk22:42
*** weshay_xchat has joined #tripleo22:56
*** david-lyle has joined #tripleo23:03
*** david-lyle has quit IRC23:05
*** pradk has quit IRC23:14
*** Marga_ has joined #tripleo23:14
*** mkovacik has quit IRC23:17
openstackgerritDan Prince proposed openstack/tripleo-common: Add scripts/upload-swift-artifacts  https://review.openstack.org/24531023:18
*** david-lyle has joined #tripleo23:23
openstackgerritDan Prince proposed openstack/tripleo-specs: New Spec: Deploy Puppet modules via Swift  https://review.openstack.org/24530923:23
*** david-lyle has quit IRC23:25
*** david-lyle has joined #tripleo23:35
*** david-lyle has quit IRC23:41
*** david-ly_ has joined #tripleo23:41

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!