Friday, 2016-04-15

*** ayoung has joined #tripleo00:03
*** pradk has quit IRC00:06
*** ramishra has joined #tripleo00:08
*** saneax is now known as saneax_AFK00:20
*** Ryjedo has quit IRC00:22
*** sambetts|afk has quit IRC00:22
*** sambetts has joined #tripleo00:31
*** lblanchard has quit IRC00:49
openstackgerritLars Kellogg-Stedman proposed openstack/tripleo-quickstart: add scripts for performing YAML validation  https://review.openstack.org/30473700:51
openstackgerritBrad P. Crochet proposed openstack/python-tripleoclient: Use values from endpoint map for service endpoints  https://review.openstack.org/30619500:55
*** lblanchard has joined #tripleo00:55
*** tiswanso has joined #tripleo01:07
*** tzumainn has quit IRC01:10
*** yamahata has quit IRC01:11
*** Slower has quit IRC01:26
*** cwolferh has joined #tripleo01:32
*** Slower has joined #tripleo01:37
*** julim has quit IRC01:38
*** Marga__ has joined #tripleo01:48
*** Marga_ has quit IRC01:51
*** Marga__ has quit IRC01:52
openstackgerritOpenStack Proposal Bot proposed openstack/diskimage-builder: Updated from global requirements  https://review.openstack.org/30341601:52
openstackgerritOpenStack Proposal Bot proposed openstack/python-tripleoclient: Updated from global requirements  https://review.openstack.org/26852801:58
*** akshai has joined #tripleo02:04
*** shivrao has quit IRC02:06
*** ramishra has quit IRC02:08
openstackgerritIan Wienand proposed openstack/diskimage-builder: Fix up EPEL element  https://review.openstack.org/30621302:10
*** ramishra has joined #tripleo02:17
*** chlong has joined #tripleo02:20
*** lblanchard has quit IRC02:25
*** thrash|g0ne has quit IRC02:26
*** akshai has quit IRC02:26
*** akshai_ has joined #tripleo02:26
*** rhallisey has quit IRC02:34
*** ramishra_ has joined #tripleo02:35
*** ramishra has quit IRC02:37
*** ramishra_ has quit IRC02:37
*** ramishra has joined #tripleo02:38
*** akshai_ has quit IRC02:38
openstackgerritIan Wienand proposed openstack/diskimage-builder: Fix up EPEL element  https://review.openstack.org/30621302:40
openstackgerritIan Wienand proposed openstack/diskimage-builder: Add EPEL as requirement of centos-minimal  https://review.openstack.org/30622002:40
*** shivrao has joined #tripleo02:47
*** yuanying has quit IRC02:48
*** shivrao has quit IRC02:49
*** coolsvap has joined #tripleo02:53
*** cwolferh has quit IRC03:02
*** shivrao has joined #tripleo03:17
*** thrash has joined #tripleo03:22
*** thrash has joined #tripleo03:22
*** tiswanso_ has joined #tripleo03:24
*** pleia2_ has joined #tripleo03:27
*** tiswanso_ has quit IRC03:30
*** sambetts_ has joined #tripleo03:31
*** shivrao has quit IRC03:32
*** bhunter_ has joined #tripleo03:32
*** coolsvap has quit IRC03:32
*** tiswanso has quit IRC03:32
*** sambetts has quit IRC03:32
*** bvandenh has quit IRC03:32
*** bhunter has quit IRC03:32
*** akrivoka has quit IRC03:32
*** dhellmann has quit IRC03:32
*** rbrady__ has quit IRC03:32
*** pleia2 has quit IRC03:32
*** bhunter_ is now known as bhunter03:32
*** coolsvap has joined #tripleo03:38
*** akrivoka has joined #tripleo03:39
*** ramishra has quit IRC03:40
*** ramishra has joined #tripleo03:41
*** panda has quit IRC03:41
*** panda has joined #tripleo03:42
*** bvandenh has joined #tripleo03:45
*** pleia2_ is now known as pleia203:46
*** rbrady__ has joined #tripleo03:46
*** yuanying has joined #tripleo03:47
*** dhellmann has joined #tripleo04:05
*** MaxPC has quit IRC04:05
*** jaosorior has joined #tripleo04:07
jaosoriorbnemec, dprince, still awake?04:10
openstackgerritMerged openstack/python-tripleoclient: Add gnocchi password as a deployment param  https://review.openstack.org/30424004:13
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Remove setting of heat engine workers  https://review.openstack.org/30623504:13
*** Marga_ has joined #tripleo04:16
*** Marga_ has quit IRC04:17
*** Marga_ has joined #tripleo04:18
*** coolsvap has quit IRC04:18
jaosoriormarios: Just so you know, the CI is broken currently due to the num_engine_workers parameter from heat being added to the puppet manifest (from Heat). We were setting that explicitly in the CI. So this commit removes that https://review.openstack.org/#/c/306235/04:18
*** coolsvap has joined #tripleo04:19
openstackgerritMerged openstack/python-tripleoclient: Use values from endpoint map for service endpoints  https://review.openstack.org/30619504:21
*** saneax_AFK is now known as saneax04:30
*** yamahata has joined #tripleo04:48
*** chlong has quit IRC04:48
*** chlong has joined #tripleo05:01
*** rcernin has joined #tripleo05:10
*** jprovazn has joined #tripleo05:17
*** myoung has joined #tripleo05:25
*** mdnadeem has joined #tripleo05:26
*** larsks has quit IRC05:27
*** rbrady__ has quit IRC05:28
*** jdob has quit IRC05:28
*** myoung|remote has quit IRC05:28
*** tremble has quit IRC05:28
*** rbrady__ has joined #tripleo05:28
*** hjensas has quit IRC05:28
*** Marga_ has quit IRC05:33
*** larsks has joined #tripleo05:36
*** Marga_ has joined #tripleo05:38
*** jdob has joined #tripleo05:42
openstackgerritIan Wienand proposed openstack/diskimage-builder: yum-minimal: strip locale archive  https://review.openstack.org/30439905:44
*** davidlenwell has quit IRC05:44
*** davidlenwell has joined #tripleo05:46
*** ChanServ sets mode: +v davidlenwell05:46
*** coolsvap has quit IRC05:54
*** ebalduf has quit IRC06:00
*** mikelk has joined #tripleo06:00
*** chlong has quit IRC06:02
*** shivrao has joined #tripleo06:02
*** aufi has joined #tripleo06:19
*** hjensas has joined #tripleo06:26
*** hjensas has joined #tripleo06:26
*** tremble has joined #tripleo06:29
*** tesseract has joined #tripleo06:29
*** tesseract is now known as Guest6322906:29
*** shivrao_ has joined #tripleo06:31
*** shivrao has quit IRC06:32
*** shivrao_ is now known as shivrao06:32
*** cwolferh has joined #tripleo06:36
*** tremble has quit IRC06:41
*** shivrao has quit IRC06:52
*** myoung|remote has joined #tripleo06:55
*** ccamacho has joined #tripleo06:55
*** Marga__ has joined #tripleo06:55
*** myoung has quit IRC06:55
*** tremble has joined #tripleo06:56
*** tremble has joined #tripleo06:56
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Remove setting of heat engine workers  https://review.openstack.org/30623506:58
*** davidlenwell_ has joined #tripleo07:01
*** ohamada has joined #tripleo07:03
*** zoli_gone-proxy is now known as zoliXXL07:03
*** mikelk has quit IRC07:04
*** davidlenwell has quit IRC07:04
*** Marga_ has quit IRC07:04
*** rbrady__ has quit IRC07:04
*** jprovazn has quit IRC07:04
zoliXXLgood morning07:06
*** larsks has quit IRC07:08
*** jprovazn has joined #tripleo07:10
*** tremble has quit IRC07:12
*** larsks has joined #tripleo07:14
*** mikelk has joined #tripleo07:14
*** paramite has joined #tripleo07:15
*** mkovacik has joined #tripleo07:15
*** florianf has joined #tripleo07:15
*** rbrady__ has joined #tripleo07:16
*** ifarkas has joined #tripleo07:17
*** tremble has joined #tripleo07:17
*** tremble has joined #tripleo07:17
*** athomas has joined #tripleo07:22
*** mgould has joined #tripleo07:25
*** athomas has quit IRC07:27
*** pcaruana has joined #tripleo07:31
*** athomas has joined #tripleo07:31
*** jaosorior has quit IRC07:48
*** jaosorior has joined #tripleo07:48
*** jaosorior has quit IRC07:51
*** jaosorior has joined #tripleo07:51
*** yamahata has quit IRC07:54
ccamachoGood morning!07:56
jaosoriorhey dude07:56
ccamachojaosorior, Today, not only a good moorning, also good friday!07:57
jaosoriorhaha indeed!07:57
*** shardy has joined #tripleo07:58
jaosoriorshardy: Hey dude07:59
*** jtomasek_ has joined #tripleo07:59
jaosoriorshardy: The CI is currently broken cause the num_engine_workers was added to puppet-heat. Here's a commit fixing that in tripleo-ci https://review.openstack.org/#/c/306235/07:59
jaosoriorit had passed our CI already, but I ammended the commit message, so it's running again08:00
*** jcoufal has joined #tripleo08:00
shardyjaosorior: So to clarify, does HeatWorkers now set num_engine_workers via puppet-heat?08:00
jaosoriorshardy, not yet08:01
jaosoriorthat commit is only to fix the CI08:01
jaosoriorI was gonna ask you08:01
shardyjaosorior: then we need to wire in via the new puppet-heat interface?08:01
jaosoriordo you think we should have a new parameter for the workers08:01
jaosorioror should we just re-use the HeatWorkers param?08:01
*** jpena|off is now known as jpena08:01
shardyjaosorior: I think setting it via hiera is fine08:01
jaosorioralright08:01
shardybut ideally we want to maintain the current behavior which is one worker08:02
shardyor our overcloud memory requirements go up quite a bit08:02
jaosoriorshardy: Yeah, I'll submit a patch for t-h-t, but wanted to consult you first08:02
shardyIf we're comfortable that is OK, we can land this patch, but I added that because we were hitting OOM during pingtest08:02
shardyjaosorior: I don't think we need a t-h-t patch, can we just fix the worker-config to use the new interface?08:03
jaosoriorshardy: Oh, well, don't we have already a HeatWorkers parameter that we can pass to t-h-t?08:03
jaosoriorwhy not make that work with the engine workers too?08:04
shardyjaosorior: yes but previously it only set the API workers, hence my questions ;)08:04
jaosorioroh, I see08:04
shardywe either wire that in to set the new https://github.com/openstack/puppet-heat/commit/fc324a840f6b51dcdd2524677fdd1d8d69524d1a num_engine_workers for API and engine08:04
shardyor fix the CI patch to still set num_engine_workers08:04
jaosoriorI think we should wiere that in08:05
jaosoriorit should be possible for deployers to set that in a standard way08:05
jaosoriorand it would be kinda weird that we have parameters for a bunch of other workers, but not the heat engine workers08:05
jaosoriorshardy: On the other hand, I think it's not as simple as just setting that parameter in the workers.yaml thingy. Since that parameter won't be available for other versions08:06
jaosoriorsuch as stable/mitaka and stable/liberty08:06
jaosoriorso it will break08:06
shardywe'll have to have two worker-configs then08:07
jaosorioryep08:07
jaosoriorshardy: What I suggest is to merge that patch, to fix the CI for now, and then we can work out a proper fix that will actually set that parameter08:07
jaosoriordoes that make sense?08:07
*** openstackgerrit has quit IRC08:08
shardyYeah, that sounds OK - I'll approve it if I can get the gerrit web UI to work...08:09
*** chem has joined #tripleo08:09
jaosoriorshardy: So, do you think I should add a HeatEngineWorkers parameter to t-h-t?08:09
jaosoriorfor Newton and beyond?08:10
shardyjaosorior: No, I think we should just make the existing HeatWorkers parameter influence num_engine_workers for now08:10
jaosorioralright08:10
shardywe can split the parameters if needed in future, but folks could still override the parameter via hiera if they really needed mismatched API->worker count08:10
*** stendulker has joined #tripleo08:10
shardy"server unavailable" gah08:11
jaosoriordamn... now gerrit is being flaky08:11
jaosorioryeah, I'm having the same issue08:11
*** mbound has joined #tripleo08:11
*** dbecker has joined #tripleo08:12
jaosoriorworked now08:13
shardyjaosorior: approved, we can work out reinstating the one-worker behavior in a followup patch08:16
*** openstackgerrit has joined #tripleo08:18
*** openstackgerrit has quit IRC08:18
jaosoriorshardy: What about this? https://review.openstack.org/#/c/306288/08:18
*** openstackgerrit has joined #tripleo08:18
shardyjaosorior: yup, that should do it, thanks!08:25
jaosoriorshardy: Do I have the BRANCH variable available in tripleo-ci/scripts/deploy.sh ?08:26
jaosorioroh, wait08:27
jaosoriorwrong variable08:27
jaosoriorwait up08:27
jaosoriorI'm checking how to know which branch are we at in that script08:27
jaosoriorI guess what I actually need is the STABLE_RELEASE variable08:28
*** jistr has joined #tripleo08:30
shardyhttps://github.com/openstack-infra/tripleo-ci/blob/master/scripts/tripleo.sh#L19408:33
shardyjaosorior: yup08:34
*** paramite is now known as paramite|afk08:34
*** paramite|afk is now known as paramite08:37
*** gfidente has joined #tripleo08:38
*** gfidente has quit IRC08:38
*** gfidente has joined #tripleo08:38
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Explicitly set num_engine_workers for mitaka and below  https://review.openstack.org/30629608:43
jaosoriorshardy ^^08:44
jaosorioroh wait08:44
jaosoriorthere08:44
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Explicitly set num_engine_workers for mitaka and below  https://review.openstack.org/30629608:44
jaosoriorzuul doesn't seemt to be picking up the changes :/08:48
bandinijistr: good job on finding e pengine bug btw ;)08:54
jistrbandini: hehe :) thanks for all the help on that!08:55
bandinijistr: glad if I can be of any help (it totally never happens) ;)08:58
*** dtantsur|afk is now known as dtantsur08:58
*** paramite is now known as paramite|afk09:05
-openstackstatus- NOTICE: Gerrit is going to be restarted because is not processing new changes09:06
ccamachoreview.openstack.org is kind of dead.. it's because is Friday and need to rest a little bit..09:07
*** mcornea has joined #tripleo09:08
*** sambetts_ is now known as sambetts09:11
jistrconstraint fixes with green CI ready to merge https://review.openstack.org/#/c/304592/09:22
jaosoriorjistr: wait up09:22
jaosoriorstuff isn't merging nor running at the moment :/09:22
jaosoriorproblems in the openstack infra09:22
jistrhmm :/09:22
jaosoriorthe last status sent was: NOTICE: No jobs are being processed by gerrit and zuul . We are working to solve the problem, please be aware that no changes have been sent to the queue in the last hour, so you will need to recheck jobs for that period.09:23
-openstackstatus- NOTICE: No jobs are being processed by gerrit and zuul . We are working to solve the problem, please be aware that no changes have been sent to the queue in the last hour, so you will need to recheck jobs for that period.09:23
*** ChanServ changes topic to "No jobs are being processed by gerrit and zuul . We are working to solve the problem, please be aware that no changes have been sent to the queue in the last hour, so you will need to recheck jobs for that period."09:23
jaosoriorah09:23
jaosoriorthere you go09:23
jistrhehe09:23
jaosoriorhaha09:23
jistrthanks09:23
*** florianf has quit IRC09:34
openstackgerritMerged openstack-infra/tripleo-ci: Remove setting of heat engine workers  https://review.openstack.org/30623509:39
jaosoriorjistr: Works now09:40
jistrcool, thanks. /me C-c C-v09:40
jistrconstraint fixes with green CI ready to merge https://review.openstack.org/#/c/304592/09:40
*** florianf has joined #tripleo09:41
jaosoriorjistr: Just to get things straight, add_missing_openstack_core_constraints still needs to be wired somewhere, right?09:42
jistrjaosorior: yes. it's just not clear where yet09:42
jistrit needs to be only executed on deployments that also migrated to WSGI09:43
jaosoriorI see09:43
jistrbut migration to WSGI is not implemented yet, and it's not clear how to do it09:43
jaosorioralright, given the current circumstances, it's fine like that then09:44
jistr#link https://etherpad.openstack.org/p/tripleo-migrations09:44
mariosbandini: hey man, can we add http://acksyn.org/files/tripleo/wsgi-openstack-core.pdf to tripleo-docs somewhere09:49
bandinimarios: yes sir. I think it makes more sense to generate a new one after jistr constraints fixes get in09:50
bandinithat way it is more correct09:51
*** ChanServ changes topic to "TripleO | CI cloud is back, currently processing the backlog | CI status: http://tripleo.org/cistatus.html | Docs: http://tripleo.org/"09:51
-openstackstatus- NOTICE: Zuul and gerrit are working normally now. Please recheck any jobs that may have been affected by this failure.09:51
mariosbandini: ack09:51
*** zoliXXL is now known as zoli|lunch09:56
*** tosky has joined #tripleo09:56
jistrmeh i rechecked assuming that the jobs aren't stable, but now i noticed that this will probably not pass the upgrades CI https://review.openstack.org/#/c/30434209:57
jistrour CI caught a backwards compatibility breakage \o/09:57
openstackgerritMerged openstack/tripleo-heat-templates: Keep setting backend_host to 'hostgroup' for rbd backends  https://review.openstack.org/30580809:58
jaosoriorjistr: Which?09:59
jistrjaosorior: hostname change09:59
jaosoriordamn! the fact that the CI caught it is actually pretty nice to hear :P09:59
*** dtantsur is now known as dtantsur|lunch10:00
openstackgerritmathieu bultel proposed openstack/tripleo-quickstart: Set default tht parameters for net-iso and remove hardcoded values  https://review.openstack.org/30511910:01
jistri'm still more inclined to break backwards comp upstream in this case though, because we'll have to break backwards compatibility *somewhere* and i think there are way more deployments with the -compute- names that will be expecting upgrades to work10:01
*** oshvartz has joined #tripleo10:02
mburnedmarios: jistr can one of you look at https://review.openstack.org/#/c/302830/ ?  needs +2/+A but passed CI10:03
mburnedmarios: maybe https://review.openstack.org/#/c/302696/ too10:04
mburnedmarios: and https://review.openstack.org/#/c/302720/10:04
mburnedjistr: seems your patches had a good night in CI ;-)10:05
mburnedhttps://review.openstack.org/#/c/304592/ <-- this one too10:05
jistryea! many patches did, actually. That's pretty good news.10:05
jistr+A'd EmilienM's patch10:06
* jistr -> lunch10:06
mburnedjistr: thanks!10:06
mariosjistr: beat me10:06
openstackgerritMerged openstack/tripleo-heat-templates: Fix Neutron enable_*_agent* Hiera parameters  https://review.openstack.org/30283010:10
openstackgerritJuan Antonio Osorio Robles proposed openstack/python-tripleoclient: Check Keystone init before running it  https://review.openstack.org/30633310:10
openstackgerritMike Burns proposed openstack/tripleo-heat-templates: Fix Neutron enable_*_agent* Hiera parameters  https://review.openstack.org/30633410:10
*** jprovazn has quit IRC10:10
openstackgerritMike Burns proposed openstack/tripleo-heat-templates: Fix Neutron enable_*_agent* Hiera parameters  https://review.openstack.org/30633510:10
openstackgerritJuan Antonio Osorio Robles proposed openstack/python-tripleoclient: Use values from endpoint map for service endpoints  https://review.openstack.org/30633610:12
openstackgerritMerged openstack/tripleo-heat-templates: Make sure openstack services are dependent on openstack-core  https://review.openstack.org/30459210:12
openstackgerritMerged openstack/python-tripleoclient: Unset UpdateIdentifier on deploy/scale, pass in StackAction  https://review.openstack.org/30272010:18
openstackgerritMerged openstack/tripleo-common: StackAction parameter to distinguish top-level create vs. update  https://review.openstack.org/30269610:19
mburnedjaosorior: just noticed -- 306336 changed changeIds from 29947510:20
mburnednot sure if you'd prefer to drop change it or not...10:21
mburneds/drop//10:21
jaosoriormburned: What do you mean10:21
jaosorior?10:21
mburnedjaosorior: 299475 is the original patch on master, the liberty backport is 306336, but the ChangeId changed between them10:22
mburnedprobably because it was different on the work that thrash did10:22
jaosoriordammit10:22
jaosoriorlets see10:22
mburnednot sure if we care or not10:22
mburnedbut easier to track if they match10:23
jaosoriorok, so in this one the change ID is fine https://review.openstack.org/#/c/306333/10:23
jaosoriorso the problem is this one, right? https://review.openstack.org/#/c/306336/10:23
jaosorioryep10:23
jaosoriorlets see10:23
mburnedyes10:24
jaosoriormburned: I think it's alright that the changeID changes10:25
mburnedjaosorior: no issue from me, but i wasn't sure if other tripleo cores would care for tracking purposes...10:26
jaosoriorjistr, marios, shardy? ^^10:26
shardyjaosorior: the changeID should always match the commit to master10:26
jaosorioralright, I'll change it then10:27
shardyhttps://review.openstack.org/#/c/306195/ was a mistake that should've been flagged during the backport review AFAICS10:27
shardynot a big deal, but it's easier to track things with consistent IDs10:28
mburnedshardy: 306195 matches 29947510:29
openstackgerritJuan Antonio Osorio Robles proposed openstack/python-tripleoclient: Use values from endpoint map for service endpoints  https://review.openstack.org/30634610:29
mburnedit's the liberty backport that's a mismatch (306336)10:29
jaosorioralright, updated the change ID to match the original10:29
mburnedwhich is now fixed...10:29
shardyack, I got confused -Etoomanypatches10:30
jaosoriorlol, happens10:30
*** gfidente is now known as gfidente|ghost10:31
openstackgerritMike Burns proposed openstack/tripleo-heat-templates: Make sure openstack services are dependent on openstack-core  https://review.openstack.org/30635010:33
openstackgerritMerged openstack-infra/tripleo-ci: Metrics tracking for TripleO deployment tasks  https://review.openstack.org/29139310:34
*** leanderthal|afk is now known as leanderthal10:34
mburnedjistr: 306350 -- liberty backport had merge conflicts, so didn't backport it there10:34
mburnedjaosorior: any thoughts on https://review.openstack.org/#/c/305478/10:36
jaosoriormburned: I was unaware of that issue10:37
jaosoriorthanks10:38
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Explicitly set num_engine_workers for mitaka and below  https://review.openstack.org/30629610:49
*** jtomasek_ has quit IRC10:56
jaosorioralright people, I'm off, have a good weekend everyone! :D10:59
*** jaosorior has quit IRC10:59
*** ccamacho is now known as ccamacho|lunch11:03
*** stendulker has quit IRC11:04
*** akshai has joined #tripleo11:04
*** gfidente has joined #tripleo11:05
*** akshai_ has joined #tripleo11:05
*** akshai has quit IRC11:08
*** dtantsur|lunch is now known as dtantsur11:09
*** gkadam has quit IRC11:10
*** florianf has quit IRC11:11
*** electrofelix has joined #tripleo11:11
*** jtomasek_ has joined #tripleo11:14
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Node assignment 1 part  https://review.openstack.org/30561211:14
jistrshardy: i fixed the link you asked about on review. We should decide on the approach on https://review.openstack.org/#/c/304342 vs. https://review.openstack.org/#/c/30570511:15
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Updated Roles Loading on Deployment Plan page  https://review.openstack.org/30595511:16
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Node assignment 1 part  https://review.openstack.org/30561211:16
jistrbasically, one of them means we don't break backwards compatibility upstream11:16
*** rhallisey has joined #tripleo11:16
jistrthe other one means we don't break backwards compatibility downstream, and we get a (imho) better default11:17
*** jtomasek_ has quit IRC11:18
*** ifarkas has quit IRC11:19
*** jtomasek_ has joined #tripleo11:20
*** lblanchard has joined #tripleo11:20
jistrmy view on the matter is: we'll have to break backwards compatibility *somewhere*. Regardless of upstream/downstream argument, i'd expect that more deployments exist on the version with -compute- hostnames, and it feels like a better default anyway, so i'd prefer keep backwards compatibility with that.11:21
*** paramite|afk is now known as paramite11:22
shardyjistr: I think the big problem is the backports11:25
shardyjistr: e.g we could possibly justify breaking between major versions (e.g mitaka and newton), if we state clearly that upgrades are not supported11:26
shardyhowever if we backport the change, anyone e.g in the RDO community, will break when they do any kind of update11:26
shardyI think that's probably not something we can accept11:26
shardyIt could be argued that the cleanest fix here is a single-line patch in the downstream spec file ;)11:27
gfidenteshardy, so think the spec is a viable solution for liberty11:28
*** ramishra has quit IRC11:28
gfidenteand I think we can change the default into -compute- in mitaka11:28
gfidenteand then figure how to make rdo/liberty upgrade to the new mitaka value11:28
gfidente?11:28
shardygfidente: I don't think we have to necessarily handle the upgrade liberty->mitaka11:29
jistralternatively we might not backport this at all upstream11:29
mariosshardy: downstream only was another thing we discussed (i.e. in the package if that is what you meant)11:29
*** florianf has joined #tripleo11:30
shardyI think we could reasonably state that upgrades are only supported from mitaka onwards for the upstream branches, because we've never tested or documented anything around upstream upgrades (yet)11:30
jistrand upstream upgrade mitaka->newton would mean adding the env file that's included with the patch that does the default change11:30
*** ramishra has joined #tripleo11:30
gfidentejistr, meh I'd use -compute- from the start in mitaka :P11:30
jistrand that would mean that on Newton things sync up, and we have the (imo nicer) -compute- default11:30
jistrgfidente: but can we still do it? we already cut the stable branches11:31
jistrso ppl might already be using those11:31
gfidenteyes but if we land today the new default in mitaka, only a small group of deployments will need to use the upgrade/env11:31
gfidenteif we don't it's going to hit more people11:32
shardyjistr: that's true, we need to confirm the status of the RDO release with trown|outtypewww11:32
mariosshardy: I +1d the change to the default in overcloud.yaml and was prepared to land it, but only if there wasn't another way. imo setting it in the env file for the upgrades when your env already uses 'compute' is preferable to changing the upstream default, albeit a bad one11:32
*** jtomasek_ has quit IRC11:33
*** dprince has joined #tripleo11:33
shardymarios: Yeah, I also was prepared to land it to master, but then the backports all the way to liberty were mentioned and the impact of that would be too much I think11:33
*** jprovazn has joined #tripleo11:34
*** zoli|lunch is now known as zoliXXL11:34
*** Marga__ has quit IRC11:34
jistrmarios: would you prefer staying with -novacompute- even if we don't do any upstream backports of the default change?11:35
jistrthe migration soulution there would be the same as when keeping -novacompute-, which means adding an env file to `overcloud deploy`, but it would be done on different deployments (instead of "use this if you deployed -compute-" we'd be saying "use this if you deployed -novacompute-")11:39
mariosjistr: so you mean, you'd like to change the upstream default on master, but not for liberty or mitaka?11:40
mariosjistr: but that will not address the issue of people coming from 'compute' to what is currently in liberty (novacompute)11:40
jistrmarios: yes. The change would "hit" upstream environments on Mitaka -> Newton upgrade, and the solution for it would be the env file.11:40
*** paramite is now known as paramite|afk11:41
openstackgerritFlorian Fuchs proposed openstack/tripleo-ui: Fixes icon font paths  https://review.openstack.org/30637511:43
jistrmarios: yeah that's true, but that's a downstream-only problem i think, isn't it? that could be addressable with a downstream-only fix (in liberty in mitaka), and once downstream and upstream sync up on -compute- (in newton), we can stop carrying that downstream-only fix11:44
jistrs/in liberty in mitaka/in liberty and mitaka/11:44
mariosjistr: ok, so the proposal is to carry the extra env file as a downstream only change and to make the change to the default regardless of this upgrades issue (and not port the default change to liberty/mitaka)11:45
mariosjistr: because 'novacompute' is a bad default11:46
gfidentemeh I think if we don't use -compute- in mitaka it'll turn against us later11:46
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Node assignment 1 part  https://review.openstack.org/30561211:46
*** dmsimard has quit IRC11:46
*** rhallisey has quit IRC11:47
hewbroccashardy: could you take a quick look at the last comment on https://bugzilla.redhat.com/show_bug.cgi?id=132547511:51
openstackbugzilla.redhat.com bug 1325475 in rhel-osp-director "rhel-osp-director: upgrade 7.3->8.0, that follows update 7.2->7.3, times out due to os-collect-config auth failure" [High,New] - Assigned to athomas11:51
hewbroccalast but one, I guess11:51
jistrmarios: in downstream it might not be an extra env file, it could be a hard-coded change as it was hard-coded until now (we want the change there always, regardless of deploy/upgrade)11:51
shardyWhatever we do, I think we're going to want to support upgrades from mitaka->newton upstream11:51
*** dmsimard has joined #tripleo11:51
hewbroccashardy: yes, because we want to CI them!11:51
mariosjistr: yeah ok, we can override the default in overcloud.yaml downstream11:51
*** rhallisey has joined #tripleo11:51
* marios proposing the review11:51
* hewbrocca dreams big11:51
jistrgfidente, shardy: we would support it, but you have to pass an extra env file. If we don't want people upgrading upstream to have to pass that extra env file, we should investigate the possibility of a mitaka backport of that change still. E.g. reach out to trown|outtypewww as shardy suggested above.11:51
shardyhewbrocca: yup, that's what we're working towards, however I think we may well consider liberty->mitaka upgrades out of scope (upstream) given that we branched without tested or documented upgrades11:51
shardythat kinda gives us a line in the sand wrt the Hostname change under discussion I think11:51
*** openstack has quit IRC11:51
*** openstack has joined #tripleo11:52
jistrgfidente, shardy, marios: I think it's valid to question whether it's worth the trouble, but it's perhaps something like the lower-case "c" in "controllerExtraConfig". Kind of an annoyance that we'll keep carrying. So if there's a possibility to change that while we still reasonably can, i'd like to.11:53
gfidenteshardy, jistr though we agreed on merging it in master right?11:53
gfidentethe sooner the better! :)11:54
jistryea :)11:54
*** athomas has quit IRC11:58
shardyjistr: that's a separate issue, we cannot change that because we've documented (upstream and downstream) controllerExtraConfig11:58
*** athomas has joined #tripleo11:58
shardyjistr: We do need a plan for that, which will probably be a "deprecated" parameter group in each template11:58
shardythen we'd have both controllerExtraConfig and ControllerExtraConfig for a while, with the former marked deprecated11:59
shardyso we can warn the user it's going to be removed11:59
shardyThat is a different problem to changing a template default value IMO11:59
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: composable neutron dhcp service  https://review.openstack.org/30338612:00
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: composable neutron metadata service  https://review.openstack.org/30361812:00
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: composable neutron l3 service  https://review.openstack.org/30356212:00
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: composable glance services  https://review.openstack.org/23737012:00
jistrshardy: yea. What i meant is that the hostnames will be a similar annoyance. What about starting to carry both controllerExtraConfig and ControllerExtraConfig right now? Perhaps i could submit a patch for that right away.12:01
shardyjistr: it already works, because puppet/controller.yaml uses ControllerExtraConfig12:02
gfidentewhat a trick :P12:02
shardywe just need to add the parameter groups and wire up the client to output warnings12:02
*** akshai_ has quit IRC12:02
*** morazi has joined #tripleo12:02
*** weshay has joined #tripleo12:05
jistrshardy: hmm how can it work though? Whatever we set to ControllerExtraConfig via parameter_defaults will be overwritten by explicitly passing the values from parent template, which are taken from controllerExtraConfig, isn't it so?12:06
openstackgerritBrad P. Crochet proposed openstack/instack-undercloud: Add a reload of keepalived  https://review.openstack.org/30547812:06
thrashslagle: ^^^^ fixed the commit msg and opened an lp12:06
shardyjistr: Ha, yeah you're right, we'll have to move controllerExtraConfig12:07
jistrto make both work we'd probably have to define both in controller.yaml and use map_merge i think, and change the wiring in overcloud.yaml from "controllerExtraConfig->ControllerExtraConfig" to "controllerExtraConfig->controllerExtraConfig"12:08
*** paramite|afk is now known as paramite12:08
* jistr could submit that and WIP it until we figure out the parameter groups12:09
jistrwdyt?12:09
shardyjistr: Yeah, sure, we'd either use map merge or just add an extra item to the hierarchy I guess12:10
*** jayg|g0n3 is now known as jayg12:11
*** pradk has joined #tripleo12:11
dprinceEmilienM: morning, hitting this today https://bugs.launchpad.net/tripleo/+bug/157082612:11
openstackLaunchpad bug 1570826 in tripleo "keystone-manage db_sync fails" [Critical,In progress]12:11
dprinceEmilienM: the last two RDO keystone commits are related to that... should we revert?12:12
*** ccamacho|lunch is now known as ccamacho12:15
*** saneax is now known as saneax_AFK12:19
dprinceEmilienM: https://review.gerrithub.io/273061 Revert touch keystone.log changes12:20
jistrshardy: cool. i'm testing map_merge first. Extra hierarchy item would mean deprecating the old one would leave a leftover hiera file in existing deployments (unreferenced from hierarchy.yaml after deprecation, but still...)12:20
jistrs/after deprecation/after removal/12:21
*** rhallisey has quit IRC12:22
slaglethrash: thanks12:23
*** trown|outtypewww is now known as trown12:24
*** mcornea has quit IRC12:25
*** rhallisey has joined #tripleo12:25
*** mcornea has joined #tripleo12:26
*** MaxPC has joined #tripleo12:27
trowndprince: I just merged the packaging fix for that rather than revert12:29
*** florianf has quit IRC12:29
dprincetrown: link?12:30
trownshardy: jistr, not entirely sure what the question for me wrt RDO Mitaka is? We released Tuesday12:30
dprincetrown: what exactly where we trying to fix with this?12:30
trownhttps://review.gerrithub.io/#/c/272999/12:30
*** morazi has quit IRC12:30
*** cwolferh has quit IRC12:30
shardytrown: thanks, I found the announcement12:30
trowndprince: for that I will have to defer to EmilienM :)12:30
*** gfidente has quit IRC12:31
*** gfidente|ghost has quit IRC12:31
*** hjensas has quit IRC12:31
shardytrown: the discussion is around the HostnameFormat change, and if we had time to land it to Mitaka before folks consuming TripleO via RDO would be impacted12:31
shardysounds like we dont12:31
trowndprince: just noticed it was broken when looking at why periodic job failed12:31
dprincetrown: I would actually like to revert all of this. See the note in my revert about the consequences of packages owning the log files12:31
dprincetrown: typically when I remove a package the log files persist12:32
dprincetrown: all of this breaks that I think12:32
trownshardy: ya though IMO upgrades are not supported in RDO, hopefully we can say that for RDO Newton12:32
trowndprince: I think the %ghost macro keeps it out of rpm db12:32
shardytrown: the problem it it's not just upgrades, if we were to backport this, any kind of update would break12:32
shardywhich I think is not acceptable, so we'll have to find an upgrade-time workaround12:33
dprincetrown: I tried it and that isn't what I saw :/12:33
trownshardy: hmm in that case I am -1 to backport12:33
dprincetrown: can't say I'm really passionate about whether it is or isn't included. But this feels like a hack12:33
dprincetrown: let keystone fix it https://bugs.launchpad.net/keystone/+bug/157046312:34
openstackLaunchpad bug 1570463 in OpenStack Identity (keystone) newton "RFE: keystone-manage CLI to allow using syslog & specific log files" [Medium,Triaged] - Assigned to Ron De Rose (ronald-de-rose)12:34
openstackgerritGiulio Fidente proposed openstack/puppet-tripleo: Add ceph profiles  https://review.openstack.org/30467512:34
dprincetrown: and any other changes can go into puppet-keystone I think12:34
*** florianf has joined #tripleo12:34
trowndprince: ya, could we ask in #rdo what was trying to be solved there? I have no clue, and am just trying to get trunk working :)12:34
dprincetrown: FWIW, I fixed my instack by *removing* the new log file. No need to chown it or anything yet.12:35
*** Goneri has joined #tripleo12:35
EmilienMdprince, trown: in a call atm, bbl12:36
pradkcould i request +a on these, they are just backports -> https://review.openstack.org/#/c/304090/ and https://review.openstack.org/#/c/304287/12:39
*** rhallisey has quit IRC12:39
openstackgerritJiri Stransky proposed openstack/python-tripleoclient: Unset UpdateIdentifier on deploy/scale, pass in StackAction  https://review.openstack.org/30639112:41
openstackgerritJiri Stransky proposed openstack/tripleo-common: StackAction parameter to distinguish top-level create vs. update  https://review.openstack.org/30639212:41
trownpradk: done12:42
*** jpena is now known as jpena|lunch12:42
*** gfidente|ghost has joined #tripleo12:43
*** gfidente has joined #tripleo12:43
*** gfidente has joined #tripleo12:43
*** cwolferh has joined #tripleo12:44
openstackgerritMerged openstack/tripleo-puppet-elements: Gnocchi Integration  https://review.openstack.org/30409012:44
pradkthx trown12:45
*** morazi has joined #tripleo12:45
*** rhallisey has joined #tripleo12:46
*** pradk has quit IRC12:49
*** pradk has joined #tripleo12:50
openstackgerritMerged openstack/puppet-tripleo: Map gnocchi vip to haproxy_listen_bind_param  https://review.openstack.org/30428712:50
jistrmburned: https://review.openstack.org/#/c/306350/ -- ack re conflict on liberty, that one should only go to newton/mitaka, it depends on having openstack-core which went in with/for WSGI keystone12:50
mburnedjistr: ahh, ok12:51
mburnedsounds good12:51
*** rhallisey has quit IRC12:53
*** rhallisey has joined #tripleo12:54
*** rlandy has quit IRC12:57
*** julim has joined #tripleo12:57
*** rlandy has joined #tripleo12:57
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart: Raise deploy timeout for HA job to 75 minutes  https://review.openstack.org/30640412:58
*** rhallisey has quit IRC13:01
openstackgerritBrad P. Crochet proposed openstack/instack-undercloud: Add a reload of keepalived  https://review.openstack.org/30547813:01
thrashslagle: realized the file was 644 instead of 755 and would not have executed.13:02
*** derekh has joined #tripleo13:03
*** akshai has joined #tripleo13:04
*** social has joined #tripleo13:06
*** rhallisey has joined #tripleo13:07
*** zoliXXL is now known as zoli_gone-proxy13:13
*** pkovar has quit IRC13:15
*** julim has quit IRC13:18
*** mcornea has quit IRC13:18
*** mcornea has joined #tripleo13:20
*** pkovar has joined #tripleo13:21
*** julim has joined #tripleo13:22
*** gfidente|ghost has quit IRC13:23
*** zoli_gone-proxy is now known as zoliXXL13:23
*** jaosorior has joined #tripleo13:25
weshayderekh, thanks for working through the CI on-boarding stuff.. it's really helpful!!!13:26
*** tiswanso has joined #tripleo13:26
panda+113:27
*** tzumainn has joined #tripleo13:29
*** Ryjedo has joined #tripleo13:29
openstackgerritMerged openstack-infra/tripleo-ci: Removing previously created resources in pingtest and --skip-pingtest-cleanup option  https://review.openstack.org/30456013:31
derekhweshay: panda no prob13:34
*** paramite is now known as paramite|afk13:35
*** gfidente|ghost has joined #tripleo13:35
*** dustins has joined #tripleo13:36
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: Update deprecated commands in tripleo.sh (Old heat * calls)  https://review.openstack.org/30108713:43
*** rodrigods has quit IRC13:45
*** rodrigods has joined #tripleo13:45
*** dtrainor has quit IRC13:46
*** mcornea has quit IRC13:52
*** rhallisey has quit IRC13:56
*** dtrainor has joined #tripleo13:58
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: Update deprecated commands in tripleo.sh (Old heat * calls)  https://review.openstack.org/30108713:58
*** mcornea has joined #tripleo13:59
*** jpena|lunch is now known as jpena14:00
*** paramite|afk is now known as paramite14:02
*** tiswanso has quit IRC14:02
*** julim has quit IRC14:02
*** tiswanso has joined #tripleo14:02
*** mgould has quit IRC14:04
*** mcornea has quit IRC14:05
openstackgerritJason E. Rist proposed openstack/tripleo-ui: Modal fixes: header, footer, width, fluidity  https://review.openstack.org/30439014:07
*** egafford has joined #tripleo14:07
openstackgerritOpenStack Proposal Bot proposed openstack/python-tripleoclient: Updated from global requirements  https://review.openstack.org/26852814:09
*** rhallisey has joined #tripleo14:10
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements  https://review.openstack.org/30062914:10
trownderekh: looks like the keystone packaging fix is incomplete... rdo folks want to give it one more go rather than revert, I will recheck the fake periodic job when that lands14:13
derekhtrown: ok, thanks14:14
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Use ceph profiles  https://review.openstack.org/30469214:15
*** hjensas has joined #tripleo14:19
*** hjensas has joined #tripleo14:19
*** julim has joined #tripleo14:19
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates: WIP: integration of the new puppet pacemaker.  https://review.openstack.org/30240914:24
*** dbecker has quit IRC14:24
*** dbecker has joined #tripleo14:25
*** rhallisey has quit IRC14:27
mburnedslagle: thrash:  https://review.openstack.org/#/c/305478/ <-- there is no code change between patchset 2 and patchset 4 and it passed all runs on patchset 2.  can we land it?14:29
*** rhallisey has joined #tripleo14:30
*** bnemec changes topic to "TripleO | CI status: http://tripleo.org/cistatus.html | Docs: http://tripleo.org/"14:31
*** jprovazn has quit IRC14:32
*** mkovacik has quit IRC14:33
*** mkovacik has joined #tripleo14:33
bnemecmburned: There kind of was a code change.  In PS 2 the file wasn't chmod +x so it wouldn't have been run in CI.14:34
*** athomas has quit IRC14:34
mburnedbnemec: ahh, i missed that14:35
bnemecWe should dib-lint the undercloud elements.14:37
*** electrofelix has quit IRC14:43
pino|workbnemec: dib-lint won't detect scripts without +x14:44
bnemecpino|work: It had better.  That was one of the main reasons for writing it.14:45
bnemecpino|work: https://github.com/openstack/diskimage-builder/blob/master/bin/dib-lint#L7514:46
pino|workah right, i stand corrected then14:47
pino|worknot that dib-lint will make the whole dib idea any better though14:48
*** mkovacik has quit IRC14:49
*** mkovacik has joined #tripleo14:50
thrashpino|work: btw, the yaml image building has merged in master.14:50
thrashpino|work: if you want to resurrect the virt-dib stuff, that would be the place to do it.14:50
pino|workto be left unreviewed for months, then told that the code changed once more? no thanks14:51
thrashbnemec: re: https://review.openstack.org/#/c/306333/14:51
thrashI'm not sure that can pass as it is...14:51
*** electrofelix has joined #tripleo14:51
thrashbnemec: I know you didn't propose it, but you wrote the initial patch.14:51
thrashbnemec: it tries to get a keystone_client before the keystone.initialize has run. The only way the code would work, is if keystone had already been initialized by puppet.14:52
thrashand that's what it's trying to detect in the first place. Check if keystone is initialized...14:53
bnemecthrash: It merged to master and has been running fine for a month and a half, without puppet initialization.14:53
thrashbnemec: am I assessing that correctly?14:53
thrashbnemec: that's really odd then...14:54
thrashbnemec: unless there is a change in os-cloud-config that returns differently from get_keystone_client...14:54
*** krickwix has joined #tripleo14:55
bnemecthrash: It's entirely possible something is different in liberty that breaks it though.14:55
thrashbnemec: I wasn't sure if the puppet init had landed in master yet.14:55
* thrash was too lazy to look too14:55
bnemecWe may just need to catch the exception from trying to get the client and assume that means keystone was not init'd.14:55
*** mbound has quit IRC14:55
*** krickwix has quit IRC14:56
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates: WIP: integration of the new puppet pacemaker.  https://review.openstack.org/30240914:56
thrashdefinnitely not in os-cloud-config.. that hasn't changed since 201414:56
*** rhallisey has quit IRC14:58
openstackgerritMerged openstack/tripleo-quickstart: add scripts for performing YAML validation  https://review.openstack.org/30473714:59
pradkquestion: for some reason stable/mitaka ha ci job is not picking up puppet-tripleo mitaka branch during the run15:00
pradkany idea why that would be the case?15:00
*** krickwix has joined #tripleo15:01
*** rhallisey has joined #tripleo15:02
pradkperhaps we need this? https://review.openstack.org/#/c/305879/15:04
pradkslagle, thoughts?15:04
trownpradk: I think puppet modules on stable branch come from packages... unless it changed recently15:05
pradktrown, oh so we need to rebuild puppet-tripleo for mitaka?15:05
pradkiirc we cut the mitaka branch a bit late like last week15:06
*** mbound has joined #tripleo15:06
pradktrown, lemme check what version of the package its pulling i15:06
pradkin15:06
*** pcaruana has quit IRC15:06
pradkopenstack-puppet-modules-8.0.3-0.20160414155424.b1da1b0.el7.centos.noarch15:07
*** tremble has quit IRC15:09
trownpradk: it is a bit of a pain to trace what is in that package (it is changing though), first step is to find that b1da1b0 hash:15:10
trownhttps://github.com/redhat-openstack/openstack-puppet-modules/commit/b1da1b06206d8d86f301ecea8f2736b1c0a9f18a15:10
trownthen I just look in the Puppetfile there: https://github.com/redhat-openstack/openstack-puppet-modules/blob/b1da1b06206d8d86f301ecea8f2736b1c0a9f18a/Puppetfile15:11
trownwhich gives 61a55c7b91dcc3f9eec13c8ee0057a7123d4b150 in puppet tripleo15:11
*** CaptTofu has quit IRC15:11
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates: WIP: integration of the new puppet pacemaker.  https://review.openstack.org/30240915:11
*** igorbelikov has quit IRC15:12
*** rhefner has quit IRC15:12
*** dmacpher has quit IRC15:12
*** Ng has quit IRC15:12
*** tdasilva has quit IRC15:12
*** quack_quack has quit IRC15:12
trownwhich I dont see there...15:12
pradktrown, yea i'm wondering if its using mitaka branch or not15:13
pradktrown, mitaka branch has a different head from what i see15:13
pradkwe did cut stable/mitaka branch a bit late for puppet-tripleo15:14
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Upload the overcloud images to cache  https://review.openstack.org/30649915:14
trownpradk: looks like your "Map gnochi.." commit is just passed what is in that package15:15
trownpradk: we can ask on #rdo-puppet for a sync (it is unfortunately a manual process)15:15
*** dmacpher has joined #tripleo15:15
pradktrown, ah ok, so that would kick of a new build with the latest hash15:16
*** rhallisey has quit IRC15:16
trownpradk: ya, and btw this is all changing very soon. puppet modules will just have individual packages tracked automatically in delorean15:17
*** tiswanso_ has joined #tripleo15:17
pradktrown, cool that sounds better15:17
*** julim_ has joined #tripleo15:17
trownthe current way is pretty painful15:17
pradkyea15:18
*** electrofelix has quit IRC15:18
*** leanderthal is now known as leanderthal|afk15:18
*** lblanchard1 has joined #tripleo15:18
*** sambetts_ has joined #tripleo15:19
*** CaptTofu has joined #tripleo15:19
*** julim has quit IRC15:20
*** hjensas has quit IRC15:20
openstackgerritDimitri Savineau proposed openstack/puppet-tripleo: Enable HAProxy forwardfor option for Horizon.  https://review.openstack.org/29649715:21
*** r-mibu_ has joined #tripleo15:21
*** pleia2_ has joined #tripleo15:21
openstackgerritMerged openstack/tripleo-quickstart: Raise deploy timeout for HA job to 75 minutes  https://review.openstack.org/30640415:23
*** rhefner has joined #tripleo15:23
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Conditionally request a test env from geard  https://review.openstack.org/30650615:23
*** davidlenwell has joined #tripleo15:24
*** ChanServ sets mode: +v davidlenwell15:24
*** tiswanso has quit IRC15:25
*** dustins has quit IRC15:25
*** pkovar has quit IRC15:25
*** derekh has quit IRC15:25
*** morazi has quit IRC15:25
*** gfidente has quit IRC15:25
*** dprince has quit IRC15:25
*** lblanchard has quit IRC15:25
*** paramite has quit IRC15:25
*** mikelk has quit IRC15:25
*** ohamada has quit IRC15:25
*** davidlenwell_ has quit IRC15:25
*** dhellmann has quit IRC15:25
*** bvandenh has quit IRC15:25
*** sambetts has quit IRC15:25
*** pleia2 has quit IRC15:25
*** r-mibu has quit IRC15:25
*** shadower has quit IRC15:25
*** trozet has quit IRC15:25
*** kbyrne has quit IRC15:25
*** telnoratti has quit IRC15:25
*** rwsu_ has quit IRC15:25
*** rasca_ has quit IRC15:25
*** jidar has quit IRC15:25
*** EmilienM has quit IRC15:25
*** number80 has quit IRC15:25
*** matbu has quit IRC15:25
*** pleia2_ is now known as pleia215:26
*** mbu has joined #tripleo15:26
*** dhellmann has joined #tripleo15:26
*** mbu is now known as matbu15:27
*** dprince has joined #tripleo15:28
*** greghaynes has quit IRC15:28
*** EmilienM has joined #tripleo15:28
openstackgerritDimitri Savineau proposed openstack/tripleo-heat-templates: Enable client address in Horizon's logs.  https://review.openstack.org/29657215:28
*** mkovacik has quit IRC15:29
*** rwsu_ has joined #tripleo15:29
*** pblaho has quit IRC15:29
*** tosky_ has joined #tripleo15:29
*** paramite has joined #tripleo15:30
*** ohamada has joined #tripleo15:30
*** jistr has quit IRC15:30
*** rcernin has quit IRC15:30
*** trozet has joined #tripleo15:30
*** jidar has joined #tripleo15:30
*** morazi has joined #tripleo15:30
*** derekh has joined #tripleo15:30
*** bvandenh has joined #tripleo15:30
*** tosky has quit IRC15:30
*** number80 has joined #tripleo15:31
openstackgerritBen Nemec proposed openstack/diskimage-builder: Don't stop dib-lint on first flake8 failure  https://review.openstack.org/30651015:31
*** Guest63229 has quit IRC15:31
*** rasca_ has joined #tripleo15:31
*** gfidente has joined #tripleo15:32
*** gfidente has joined #tripleo15:32
*** kbyrne has joined #tripleo15:32
*** telnoratti has joined #tripleo15:32
*** MaxPC has quit IRC15:32
*** dustins has joined #tripleo15:32
*** MaxPC has joined #tripleo15:32
*** pkovar has joined #tripleo15:32
*** gfidente has quit IRC15:33
*** rhallisey has joined #tripleo15:34
*** dtantsur is now known as dtantsur|afk15:35
*** igorbelikov has joined #tripleo15:38
*** pblaho has joined #tripleo15:38
openstackgerritBen Nemec proposed openstack/diskimage-builder: Allow skipping the md docs check  https://review.openstack.org/30651415:39
*** panda has quit IRC15:41
*** krickwix has quit IRC15:41
*** panda has joined #tripleo15:42
*** jistr has joined #tripleo15:42
*** Ng has joined #tripleo15:43
*** ChanServ sets mode: +v Ng15:43
*** jaosorior has quit IRC15:43
*** tdasilva has joined #tripleo15:46
openstackgerritLukas Bezdicka proposed openstack/puppet-tripleo: Add missing services ports to service_ports map  https://review.openstack.org/30592915:46
openstackgerritLukas Bezdicka proposed openstack/puppet-tripleo: Remove individual service certificates  https://review.openstack.org/30594215:46
*** greghaynes has joined #tripleo15:47
*** quack_quack has joined #tripleo15:47
ccamachoGuys! Have all a nice weekend, if have some time for a late afternoon reading.. http://classicprogrammerpaintings.tumblr.com/15:52
*** gfidente|ghost is now known as gfidente15:53
gfidenteccamacho that is a nice link :)15:54
pino|work(old but gold)15:54
*** hewbrocca is now known as hewbrocca-afk15:55
openstackgerritBen Nemec proposed openstack/instack-undercloud: Add dib-lint to pep8 tox job  https://review.openstack.org/30652115:55
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates: WIP fix ControllerExtraConfig param name  https://review.openstack.org/30652215:55
*** marcusvrn_ has joined #tripleo15:56
*** akshai has quit IRC15:57
jistrshardy: btw i didn't forget about the ControllerExtraConfig ^^, i just couldn't get it to work on first 2 tries and had to switch to other things. The patch seems to do things right except map_merge didn't seem to trigger for me, and the whole thing has been literally passed into hiera. I tried expanding it directly in hiera mapped_data and also running it through input_values first (which is the variant i submitted above). I might have done15:58
jistrsomething wrong, hopefully i'll get to poke at that a bit more next week.15:58
*** akshai has joined #tripleo15:58
*** jistr is now known as jistr|afk16:00
*** akshai has quit IRC16:00
*** akshai has joined #tripleo16:00
shardyjistr|afk: I just commented, you need to bump the HOT version to get map_merge16:01
zoliXXLhave a good weekend16:04
*** yamahata has joined #tripleo16:05
*** zoliXXL is now known as zoli_gone-proxy16:05
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Add a function to decide if using cache is appropriate  https://review.openstack.org/30652416:07
*** sambetts_ is now known as sambetts16:07
*** jcoufal has quit IRC16:08
*** marcusvrn_ has quit IRC16:13
*** marcusvrn_ has joined #tripleo16:14
*** gfidente has quit IRC16:14
*** aufi has quit IRC16:14
*** rwsu_ is now known as rwsu16:16
*** mbound has quit IRC16:17
*** Ng has quit IRC16:22
*** Ng has joined #tripleo16:24
*** ChanServ sets mode: +v Ng16:24
*** shadower has joined #tripleo16:34
*** ohamada has quit IRC16:34
*** tosky_ is now known as tosky16:35
*** dsariel has quit IRC16:36
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Redirect instack image build output to file  https://review.openstack.org/30653316:37
*** hjensas has joined #tripleo16:38
*** hjensas has joined #tripleo16:38
*** akshai has quit IRC16:39
openstackgerritBen Nemec proposed openstack/instack-undercloud: Nothing to see here  https://review.openstack.org/30653516:41
*** aufi has joined #tripleo16:41
*** paramite has quit IRC16:43
*** aufi has quit IRC16:50
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Add final success/failure message to ping test  https://review.openstack.org/30486416:50
*** trown is now known as trown|lunch16:51
*** akshai has joined #tripleo16:51
*** akrivoka has quit IRC16:55
*** sambetts is now known as sambetts|afk16:56
*** akrivoka has joined #tripleo16:57
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: TEST: Delete the overcloud when finished  https://review.openstack.org/29732816:58
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Test overcloud deletion with net-iso in periodic job  https://review.openstack.org/29676516:58
*** derekh has quit IRC16:58
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Add undercloud idempotency test  https://review.openstack.org/27921816:59
*** jistr|afk is now known as jistr17:00
jistrshardy: ah great, will bump up the version. Thanks!17:03
*** jpena is now known as jpena|off17:05
*** ccamacho has quit IRC17:12
*** yuanying_ has joined #tripleo17:18
*** tiswanso has joined #tripleo17:18
*** rhefner has quit IRC17:18
*** jidar has quit IRC17:20
*** telnoratti has quit IRC17:20
*** Ryjedo has quit IRC17:21
*** rhefner has joined #tripleo17:21
*** chem` has joined #tripleo17:21
*** kbyrne has quit IRC17:21
*** chem` has left #tripleo17:21
*** quack_quack_ has joined #tripleo17:22
*** CaptTofu has quit IRC17:22
*** matbu_ has joined #tripleo17:22
*** pleia2 has quit IRC17:22
*** pblaho_ has joined #tripleo17:22
*** jidar has joined #tripleo17:23
*** pkovar has quit IRC17:23
*** telnoratti has joined #tripleo17:24
*** ramishra_ has joined #tripleo17:24
*** pleia2 has joined #tripleo17:24
*** rhefner has quit IRC17:25
*** akrivoka has quit IRC17:26
*** Ng has quit IRC17:26
*** marcusvrn_ has quit IRC17:26
jistrshardy: it worked, thanks a bunch and have a good weekend. (i pushed a new patchset but gerritbot slept it through https://review.openstack.org/#/c/306522)17:26
*** shadower has quit IRC17:27
*** yamahata has quit IRC17:27
*** quack_quack has quit IRC17:27
*** pblaho has quit IRC17:27
*** igorbelikov has quit IRC17:27
*** dustins has quit IRC17:27
*** morazi has quit IRC17:27
*** rwsu has quit IRC17:27
*** EmilienM has quit IRC17:27
*** dhellmann has quit IRC17:27
*** matbu has quit IRC17:27
*** sambetts|afk has quit IRC17:27
*** lblanchard1 has quit IRC17:27
*** tiswanso_ has quit IRC17:27
*** dmacpher has quit IRC17:27
*** egafford has quit IRC17:27
*** dtrainor has quit IRC17:27
*** cwolferh has quit IRC17:27
*** Goneri has quit IRC17:27
*** ramishra has quit IRC17:27
*** openstackgerrit has quit IRC17:27
*** chem has quit IRC17:27
*** yuanying has quit IRC17:27
*** thrash has quit IRC17:27
shardyjistr: Nice, thanks you have a good weekend too!17:28
*** Ryjedo has joined #tripleo17:28
*** EmilienM has joined #tripleo17:29
*** quack_quack_ has quit IRC17:29
*** jdob has quit IRC17:30
*** ccamacho has joined #tripleo17:31
*** tiswanso has quit IRC17:32
*** jdob has joined #tripleo17:32
*** panda has quit IRC17:32
*** sambetts has joined #tripleo17:32
*** tiswanso has joined #tripleo17:32
*** pkovar has joined #tripleo17:33
*** david-lyle has quit IRC17:34
*** david-lyle has joined #tripleo17:34
*** dmacpher has joined #tripleo17:39
*** kbyrne has joined #tripleo17:40
*** lblanchard has joined #tripleo17:40
*** pkovar has quit IRC17:40
*** jdob has quit IRC17:40
*** jdob has joined #tripleo17:41
*** dustins has joined #tripleo17:41
*** akrivoka has joined #tripleo17:41
*** rhefner has joined #tripleo17:42
*** dhellmann has joined #tripleo17:44
*** Goneri has joined #tripleo17:45
*** yamahata has joined #tripleo17:46
*** morazi has joined #tripleo17:46
*** quack_quack_ has joined #tripleo17:46
*** number80 has quit IRC17:47
*** openstackgerrit has joined #tripleo17:48
*** rwsu has joined #tripleo17:48
*** number80 has joined #tripleo17:49
*** igorbelikov has joined #tripleo17:49
*** dhellmann has quit IRC17:50
*** trown|lunch is now known as trown17:50
*** dtrainor has joined #tripleo17:50
*** egafford has joined #tripleo17:51
*** jistr has quit IRC17:51
*** shardy has quit IRC17:51
*** psanchez has quit IRC17:53
*** tosky has quit IRC17:53
*** psanchez has joined #tripleo17:54
*** igorbelikov has quit IRC17:54
*** cwolferh has joined #tripleo17:54
*** dhellmann has joined #tripleo17:55
*** dhellmann has quit IRC17:57
*** shivrao has joined #tripleo17:57
*** CaptTofu has joined #tripleo17:58
*** igorbelikov has joined #tripleo17:58
*** Ng has joined #tripleo17:59
*** ChanServ sets mode: +v Ng17:59
*** spredzy has quit IRC17:59
*** panda has joined #tripleo17:59
*** marcusvrn_ has joined #tripleo17:59
*** spredzy has joined #tripleo17:59
*** Marga_ has joined #tripleo18:03
*** Goneri has quit IRC18:09
*** rasca_ has quit IRC18:10
*** rasca_ has joined #tripleo18:11
*** florianf has quit IRC18:16
*** thrash has joined #tripleo18:23
*** thrash has joined #tripleo18:23
*** yamahata has quit IRC18:25
*** tiswanso has quit IRC18:43
*** Goneri has joined #tripleo18:50
*** Goneri has quit IRC18:56
*** dprince has quit IRC18:57
*** yamahata has joined #tripleo19:02
*** myoung|remote is now known as myoung19:05
*** jdob has quit IRC19:18
*** Marga__ has joined #tripleo19:19
*** panda has quit IRC19:19
*** lblanchard1 has joined #tripleo19:20
*** paramite has joined #tripleo19:21
*** pblaho has joined #tripleo19:21
*** rhefner_ has joined #tripleo19:22
*** matbu has joined #tripleo19:22
*** Ng has quit IRC19:22
*** rhefner has quit IRC19:22
*** jdob has joined #tripleo19:22
*** lblanchard has quit IRC19:22
*** telnoratti has quit IRC19:22
*** pblaho_ has quit IRC19:22
*** Marga_ has quit IRC19:22
*** egafford has quit IRC19:22
*** dmacpher has quit IRC19:22
*** matbu_ has quit IRC19:22
*** rhefner_ is now known as rhefner19:23
*** Ng has joined #tripleo19:23
*** ChanServ sets mode: +v Ng19:23
*** telnoratti has joined #tripleo19:24
*** egafford has joined #tripleo19:25
*** panda has joined #tripleo19:32
*** dmacpher has joined #tripleo19:34
*** paramite has quit IRC19:37
*** paramite has joined #tripleo19:38
*** paramite has quit IRC19:46
openstackgerritMerged openstack/puppet-tripleo: Set defaultbranch for git-review to stable/mitaka  https://review.openstack.org/30587919:48
*** Goneri has joined #tripleo19:55
*** andreaf has quit IRC20:00
*** lblanchard1 has quit IRC20:01
*** andreaf has joined #tripleo20:01
*** lblanchard has joined #tripleo20:01
*** jidar has quit IRC20:04
*** jdob has quit IRC20:07
*** quack_quack_ has quit IRC20:11
*** quack_quack_ has joined #tripleo20:13
*** jdob has joined #tripleo20:18
*** dmacpher has quit IRC20:22
*** andreaf has quit IRC20:23
*** egafford has quit IRC20:23
*** yamahata has quit IRC20:23
*** hjensas has quit IRC20:23
*** trown is now known as trown|outtypewww20:24
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: IPv6 dual-stack support  https://review.openstack.org/28634420:28
*** jayg is now known as jayg|g0n320:28
EmilienMdsneddon: rebasing ^ fyi20:28
*** egafford has joined #tripleo20:28
*** andreaf has joined #tripleo20:28
*** mkovacik has joined #tripleo20:28
*** Goneri has quit IRC20:29
*** jidar has joined #tripleo20:31
*** jdob has quit IRC20:34
*** dmacpher has joined #tripleo20:35
dsneddonEmilienM, Thanks, I'll take a look20:36
*** yamahata has joined #tripleo20:36
*** mkovacik_ has joined #tripleo20:36
EmilienMdsneddon: on fact, the refactor is now allowing to enable dual stack for all vips, which is awesome20:37
dsneddonEmilienM, That is super-awesome.20:37
EmilienMyeah20:37
*** mkovacik has quit IRC20:37
*** lblanchard has quit IRC20:41
*** psanchez has quit IRC20:58
*** psanchez has joined #tripleo21:00
bnemecHmm, I don't think toci has had an HA pass all day, essentially.21:00
bnemecAlmost all of the failures seem to be right around 120 or 130 minutes too.21:01
bnemec2016-04-15 19:37:24 140020484421760 [ERROR] mysqld: Server GSSAPI error (major 851968, minor 2529639093) : gss_acquire_cred failed -Unspecified GSS failure.  Minor code may provide more information. Keytab FILE:/etc/krb5.keytab is nonexistent or empty.21:02
bnemec2016-04-15 19:37:24 140020484421760 [ERROR] Plugin 'gssapi' init function returned error.21:02
bnemecThis looks suspicious.21:03
openstackgerritIan Wienand proposed openstack/diskimage-builder: Add EPEL as requirement of centos-minimal  https://review.openstack.org/30622021:03
*** dustins has quit IRC21:07
bnemecOkay, I think that's killing all the ha:21:15
bnemechttp://logstash.openstack.org/#dashboard/file/logstash.json?query=build_name%3A%20*tripleo-ci*%20AND%20build_status%3A%20FAILURE%20AND%20message%3A%20%5C%22%3E%2Fdev%2Fnull%20returned%201%5C%22%20AND%20message%3A%20%5C%22clustercheck%5C%2221:15
*** MaxPC has quit IRC21:16
*** spredzy has quit IRC21:25
*** pradk has quit IRC21:29
*** julim_ has quit IRC21:30
*** egafford has quit IRC21:30
*** spredzy has joined #tripleo21:30
*** hjensas has joined #tripleo21:41
bnemecI think http://cbs.centos.org/koji/buildinfo?buildID=10512 broke us.21:42
*** lblanchard has joined #tripleo21:42
*** bnemec changes topic to "TripleO | HA jobs failing on https://bugs.launchpad.net/tripleo/+bug/1571090 | CI status: http://tripleo.org/cistatus.html | Docs: http://tripleo.org/"21:42
bnemecSince the alert bot seems to have taken a long weekend. ;-)21:43
*** rlandy has quit IRC21:51
*** rhallisey has quit IRC21:52
trown|outtypewwwbnemec: thanks for tracking that down... noticed the ha fake periodic job failed that way too, and wasnt sure if it was just a trunk regression with ha21:52
trown|outtypewwwdiscussing with number80 on #rdo21:53
bnemectrown|outtypewww: Cool21:53
number80I wouldn't expect that a -patch release would break something21:53
number80but untagging the last version and will backport the mtune patch21:53
trown|outtypewwwnumber80: ya seems like that should have been at least a minor version bump on galera, but I havent dug into exactly what broke21:55
trown|outtypewwwnumber80: also thanks !21:55
number80trown|outtypewww: np, I don't want to spend much time on a deprecated galera21:56
number80bnemec: is this liberty job?21:57
number80because in mitaka we have mariadb 10.1.x which includes mariadb-galera21:57
bnemecnumber80: It's all of our ha jobs.21:57
number80all of them?21:58
number80damn, it shouldn't affect mitaka21:58
trown|outtypewwwnumber80: ya even trunk job failed in a similar way21:58
number80mitaka should use mariadb 10.121:58
bnemecnumber80: I think we broke when mariadb 10.1 released, so we may have a hack somewhere keeping us on the old version.21:58
number80ok21:58
number80we need to review this with mbayer and dcibriani on monday21:59
bnemecSo many critical tripleo bugs. :-(21:59
number80yeah22:00
trown|outtypewwwhmmm, I am pretty sure we fixed that, pulling the undercloud logs from the periodic job22:00
bnemecI could swear we had a bug open about that, but now I can't find it.22:00
bnemecHence the griping about so many crits.22:01
trown|outtypewwwbnemec: is rpm -qa output for the undercloud collected somewhere?22:02
bnemechttps://bugs.launchpad.net/tripleo/+bug/154766022:02
openstackLaunchpad bug 1547660 in tripleo "Could not find command '/usr/bin/clustercheck'" [High,Triaged]22:02
bnemectrown|outtypewww: host_info.txt should have it22:02
bnemecIn /var/log/ from undercloud.tar.gz22:02
*** egafford has joined #tripleo22:03
bnemectrown|outtypewww: The bug I just linked is the original breakage on 10.1.22:03
bnemecSome muppet dropped it to high priority so I couldn't find it. :-P22:03
*** rasca_ has quit IRC22:05
trown|outtypewwwah found it http://chunk.io/f/be6e3a947dff49838b3148155caa8a2c22:05
trown|outtypewwwI am 90% positive we fixed the issues with 10.1 for mitaka release22:06
*** rasca_ has joined #tripleo22:09
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/157109022:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1571090 in tripleo "clustercheck always failing on ha job" [Critical,Triaged]22:10
trown|outtypewwwI think we might have merged something in tripleo that rebroke that ^22:10
trown|outtypewwwbecause we have had mariadb 10.1 for a couple weeks now22:11
trown|outtypewwwanyways gotta do the family thing, I will try to check back later22:11
*** mdnadeem_ has joined #tripleo22:21
*** egafford has quit IRC22:21
*** mdnadeem has quit IRC22:24
*** lblanchard has quit IRC22:25
*** akshai has quit IRC22:25
*** akshai has joined #tripleo22:27
*** yamahata has quit IRC22:35
*** rhallisey has joined #tripleo23:01
*** akshai has quit IRC23:05
*** akrivoka has quit IRC23:06
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/157109023:10
openstackLaunchpad bug 1571090 in tripleo "clustercheck always failing on ha job" [Critical,Triaged]23:10
*** ooolpbot has quit IRC23:10
openstackgerritRyan Hallisey proposed openstack/tripleo-heat-templates: Composable Keystone Containers  https://review.openstack.org/30428223:13
*** rhallisey has quit IRC23:13
*** lblanchard has joined #tripleo23:26
*** lblanchard has quit IRC23:29
*** lblanchard has joined #tripleo23:31
*** lblanchard has quit IRC23:35
*** lblanchard has joined #tripleo23:38
*** shivrao has quit IRC23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!