Friday, 2015-11-06

openstackgerritMichael Johnson proposed openstack/diskimage-builder: Fix diskimage-builder image size  https://review.openstack.org/24227300:02
johnsombnemec Ok, got distracted.  There is the patch that removes the journal adjustment00:03
*** Marga__ has quit IRC00:12
*** Marga_ has joined #tripleo00:13
*** Marga_ has quit IRC00:17
*** Marga_ has joined #tripleo00:17
*** CheKoLyN has quit IRC00:19
*** shadower has quit IRC00:23
*** shadower has joined #tripleo00:23
*** cody-somerville has quit IRC00:29
*** jobewan has quit IRC00:40
*** mbound has quit IRC00:40
*** cwolferh has joined #tripleo00:57
*** lblanchard has joined #tripleo00:58
*** noslzzp has joined #tripleo01:11
*** lazy_prince has joined #tripleo01:21
*** shivrao has quit IRC01:27
*** rgowrishankar has quit IRC01:53
*** tiswanso has joined #tripleo01:57
*** tiswanso has quit IRC01:57
*** tiswanso has joined #tripleo01:58
*** adrianopetrich has joined #tripleo02:12
*** lazy_prince has quit IRC02:22
*** cwolferh has quit IRC02:23
*** Goneri has joined #tripleo02:27
*** Goneri has quit IRC02:42
*** Marga_ has quit IRC02:50
*** Marga_ has joined #tripleo02:51
*** shivrao has joined #tripleo02:51
*** Marga_ has quit IRC02:55
*** cwolferh has joined #tripleo03:14
*** shivrao has quit IRC03:20
*** anande has joined #tripleo03:43
*** lazy_prince has joined #tripleo03:48
*** aukhan has joined #tripleo03:54
*** links has joined #tripleo03:59
*** untriaged-bot has joined #tripleo04:00
untriaged-botUntriaged bugs so far:04:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/151090104:00
openstackLaunchpad bug 1510901 in tripleo "seed's nova-compute service start fail" [Undecided,In progress] - Assigned to Cameron.C (cameron-c)04:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/151171504:00
openstackLaunchpad bug 1511715 in diskimage-builder "Images using draycut should have the option to pass drivers to include in build" [Undecided,New] - Assigned to Julia Kreger (juliaashleykreger)04:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/151350804:00
openstackLaunchpad bug 1513508 in diskimage-builder "Ironic IPA does not work when Swift is using https" [Undecided,New]04:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/150590004:00
openstackLaunchpad bug 1505900 in diskimage-builder "Failed to create 'wily' release with DIB_RELEASE" [Undecided,New]04:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/150426304:00
openstackLaunchpad bug 1504263 in tripleo "os-net-config mapping by MAC fails if trying to map in alternate order" [Undecided,Triaged]04:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/150914804:00
openstackLaunchpad bug 1509148 in tripleo "keystone initialize fails if undercloud can't reach overcloud public vip" [Undecided,New]04:00
*** untriaged-bot has quit IRC04:00
*** tiswanso has quit IRC04:14
*** lblanchard has quit IRC04:23
*** rlandy has quit IRC04:28
*** wuhg has joined #tripleo04:43
*** masco__ has joined #tripleo04:47
*** stendulker has joined #tripleo04:51
*** rasca_ has joined #tripleo04:55
*** rasca has quit IRC04:57
*** Marga_ has joined #tripleo05:14
*** Marga_ has quit IRC05:14
*** Marga_ has joined #tripleo05:15
openstackgerritRyan Brady proposed openstack/tripleo-common: Initial workflow implementation of tripleo-common  https://review.openstack.org/22729705:18
*** jerrygb_ has quit IRC05:18
*** panda has quit IRC05:41
*** panda has joined #tripleo05:41
*** adrianopetrich is now known as apetrich05:47
*** shivrao has joined #tripleo05:50
*** jaosorior has joined #tripleo05:52
*** aufi has joined #tripleo06:28
*** openstackgerrit has quit IRC06:31
*** openstackgerrit has joined #tripleo06:31
*** shivrao has quit IRC06:33
*** yog_ has joined #tripleo06:35
*** jprovazn has joined #tripleo06:36
*** olap has joined #tripleo06:38
*** david-lyle has joined #tripleo06:40
*** david-lyle has quit IRC06:45
*** mcornea has joined #tripleo06:50
*** Marga_ has quit IRC07:01
*** lsmola has joined #tripleo07:02
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add sample environment file to document usage of pre-defined IPs  https://review.openstack.org/24160607:11
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Do not rename the nested port resource name for the VIPs  https://review.openstack.org/24217607:11
jaosoriorshardy: Are you around?07:29
*** paramite has joined #tripleo07:33
*** rasca_ has quit IRC07:36
*** rasca has joined #tripleo07:39
*** yog_ has quit IRC07:41
*** tzumainn has quit IRC07:42
*** shardy has joined #tripleo07:49
jaosoriorshardy: ping07:51
*** cody-somerville has joined #tripleo07:55
*** yog_ has joined #tripleo07:55
shardyjaosorior: morning07:56
jaosoriorshardy: Hey man07:56
jaosoriorsome questions07:56
shardyjaosorior: Ok, but be warned, I've not had any coffee yet! ;)07:56
jaosoriorshardy: Is there a way for the input you give to a SoftwareConfig to be hidden?07:56
jaosorioralso, because it ends up being persisted in /var/run/heat-config/heat-config07:59
jaosorior*also, it ends up being persisted...07:59
jaosoriorand that seems to have quite permissive settings08:00
jaosoriorfile permission being something like 75508:00
shardyjaosorior: doesn't look like it, you can hide parameters so they're not visible via the heat CLI commands (and are encrypted in the DB), but not the inputs as they aren't persisted in the DB IIRC:08:00
shardyhttp://docs.openstack.org/developer/heat/template_guide/hello_world.html#hiding-parameters-values08:00
shardyhttps://github.com/openstack/heat/blob/master/heat/engine/resources/openstack/heat/software_config.py#L6808:00
shardyOk, that's a bug08:00
shardywe should fix the permissions in the heat-config element08:00
jaosorioryeah08:01
jaosoriorwas thinking of submitting a patch08:01
jaosoriorbut, only question I have now, is that, this file is a bit confusing:08:01
*** devvesa has joined #tripleo08:03
*** paramite is now known as paramite|afk08:06
*** tremble has quit IRC08:19
*** regebro has joined #tripleo08:22
*** akrivoka has joined #tripleo08:26
*** jprovazn has quit IRC08:36
*** zigo has quit IRC08:37
*** zigo has joined #tripleo08:42
*** openstackstatus has quit IRC08:42
*** paramite|afk is now known as paramite08:46
*** ifarkas has joined #tripleo08:51
*** sthillma has quit IRC08:57
*** masco__ has quit IRC08:58
*** mbound has joined #tripleo08:59
*** masco__ has joined #tripleo09:00
*** mbound has quit IRC09:02
*** mbound has joined #tripleo09:02
jaosoriorshardy, gfidente: If you guys have time to review the TLS patch https://review.openstack.org/#/c/231930/35 ; the basic functionality doesn't depend on the keystone endpoint parts from the previous patches, and it works with upgrades09:05
*** sthillma has joined #tripleo09:05
*** links has quit IRC09:11
*** derekh has joined #tripleo09:11
*** jistr has joined #tripleo09:19
*** sthillma has quit IRC09:20
*** jprovazn has joined #tripleo09:31
derekhHmmm, at some stage over the last 3 days or so, our CI jobs have gotten about 15 minutes longer has anybody any ideas what merged that may have caused this ?09:32
*** gfidente has joined #tripleo09:32
*** gfidente has quit IRC09:32
*** gfidente has joined #tripleo09:32
*** panda has quit IRC09:41
*** panda has joined #tripleo09:42
*** tzumainn has joined #tripleo09:46
*** mkovacik has joined #tripleo09:51
*** paramite is now known as paramite|afk09:58
*** chem has quit IRC09:59
*** chem has joined #tripleo09:59
*** killer_prince has joined #tripleo09:59
*** untriaged-bot has joined #tripleo10:00
untriaged-botUntriaged bugs so far:10:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/151090110:00
openstackLaunchpad bug 1510901 in tripleo "seed's nova-compute service start fail" [Undecided,In progress] - Assigned to Cameron.C (cameron-c)10:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/151171510:00
openstackLaunchpad bug 1511715 in diskimage-builder "Images using draycut should have the option to pass drivers to include in build" [Undecided,New] - Assigned to Julia Kreger (juliaashleykreger)10:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/151350810:00
openstackLaunchpad bug 1513508 in diskimage-builder "Ironic IPA does not work when Swift is using https" [Undecided,New]10:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/150590010:00
openstackLaunchpad bug 1505900 in diskimage-builder "Failed to create 'wily' release with DIB_RELEASE" [Undecided,New]10:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/150426310:00
openstackLaunchpad bug 1504263 in tripleo "os-net-config mapping by MAC fails if trying to map in alternate order" [Undecided,Triaged]10:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/150914810:00
openstackLaunchpad bug 1509148 in tripleo "keystone initialize fails if undercloud can't reach overcloud public vip" [Undecided,New]10:00
*** untriaged-bot has quit IRC10:00
*** nijaba has quit IRC10:01
*** lazy_prince has quit IRC10:03
*** athomas has joined #tripleo10:09
*** Slower has quit IRC10:11
*** noslzzp has quit IRC10:12
*** killer_prince has quit IRC10:13
*** Slower has joined #tripleo10:13
*** paramite|afk is now known as paramite10:15
*** julim_ has joined #tripleo10:19
*** julim has quit IRC10:22
*** jaosorior has quit IRC10:25
*** BadCub has quit IRC10:27
*** BadCub has joined #tripleo10:27
*** aukhan has quit IRC10:30
*** aukhan has joined #tripleo10:30
*** lazy_prince has joined #tripleo10:39
*** tosky has joined #tripleo10:41
*** shardy has quit IRC10:46
openstackgerritJiri Tomasek proposed openstack/tripleo-heat-templates: Add capabilities map  https://review.openstack.org/24243910:55
*** electrofelix has joined #tripleo10:57
*** aukhan has quit IRC11:05
*** akrivoka has quit IRC11:09
*** jaosorior has joined #tripleo11:11
*** akrivoka has joined #tripleo11:16
openstackgerritJiri Tomasek proposed openstack/tripleo-heat-templates: Add capabilities map  https://review.openstack.org/24243911:17
*** jprovazn has quit IRC11:18
*** rasca has quit IRC11:22
*** rasca has joined #tripleo11:23
*** stendulker has quit IRC11:31
*** masco__ has quit IRC11:33
*** gfidente is now known as gfidente|lunch11:40
*** Marga_ has joined #tripleo11:49
*** anande has quit IRC11:49
*** jerrygb has joined #tripleo11:54
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Move ceph::pool arguments within class call  https://review.openstack.org/24245611:55
*** dprince has joined #tripleo12:06
dprincederekh: hi, so have you tried trunk recently. I saw this: https://review.openstack.org/#/c/229789/12:09
derekhdprince: trunk is broken, I eventually got to the bottom of it yesterday https://review.openstack.org/#/c/242158/12:11
dprincederekh: I saw some neutron/server.log issues. specifically with regards to the neutron commit 26f008296bc11e927a58fe7bfe9b3ac6d1bb5365 (which I think means we have to update the [nova] section of our neutron.conf12:11
dprincederekh: Ah, I see. So there is a functional issue as well12:12
derekhdprince: those errors happen but tripleo (I think) doesn't use that call back mechanism12:12
derekhdprince: so I spent a while trying to figure them out but in the end it wasn't what was causing the issue12:13
dprincederekh: right, well the thing that confused me (in the undercloud) was they were partially configured12:13
dprincederekh: yeah, me too :)12:13
derekhdprince: its something we should probably sort out12:13
derekhbut ultimatly what causes our blockage is the wrong neutron client exception being thrown here https://review.openstack.org/#/c/242158/12:14
dprincederekh: yeah, we need to fix this in the instack12:14
derekh*fixed in that patch12:14
dprincederekh: ack, I will try that12:15
dprincederekh: for the overcloud Emilien actually has this in play https://review.openstack.org/#/c/225962/12:15
derekhcool12:16
*** rhallisey has joined #tripleo12:16
*** yog_ has quit IRC12:22
*** wuhg has quit IRC12:31
*** zigo has quit IRC12:36
*** zigo has joined #tripleo12:37
*** jprovazn has joined #tripleo12:40
*** trown|outttypeww is now known as trown12:50
*** paramite is now known as paramite|afk12:50
*** paramite|afk is now known as paramite12:56
*** regebro has quit IRC12:59
*** thrash|g0ne is now known as thrash13:01
*** akuznetsov has joined #tripleo13:01
d0ugalIs this a know issue? I got it when running openstack undercloud install. http://paste.openstack.org/show/478177/13:03
dprinced0ugal: looks like your puppet-ironic modules needs an update13:05
dprinced0ugal: Could not find class ::ironic::inspector13:05
d0ugaldprince: aha, I had no idea what that meant :) I just done a fresh install on CentOS13:06
d0ugaldprince: Any idea how I'd update that or check which version I have?13:06
trownd0ugal: dprince I think this is because "current-tripleo" is really old13:06
d0ugaloh13:06
*** lblanchard has joined #tripleo13:06
dprinceagree, that is likely the issue13:06
trownand we removed OPM from the "freshest of the fresh" repo includepkgs13:06
openstackgerritRhys Oxenham proposed openstack/tripleo-heat-templates: [WIP] Adding in support for automated Calamari Integration  https://review.openstack.org/24226713:10
d0ugaltrown: Makes sense, do you know of a workaround?13:11
dprincederekh: hey, so after applying your nova neutron API fix did you see it working?13:14
dprincederekh: I'm hitting a different failure now... http://paste.openstack.org/show/478178/13:14
trownd0ugal: `export DIB_INSTALLTYPE_puppet_modules=source` would workaround it... I think that is why CI is passing13:15
dprinced0ugal: exactly, this is how CI does it http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/toci_instack.sh#n14213:16
rhalliseyderekh, morning, the spec file patch merged13:20
rhalliseyderekh, what was you plan for periodic builds?13:20
dprincederekh: i found it, user error13:20
*** jayg|g0n3 is now known as jayg13:21
d0ugaltrown, dprince - thanks! that seems to be working.13:31
d0ugalShould we add that to tripleo.sh?13:31
dprincederekh: might be worth filing a bug for that nova neutron/api.py issue?13:35
*** panda has quit IRC13:40
*** panda has joined #tripleo13:41
trownd0ugal: I am not really sure what the best solution there is, but we should probably do what is in CI13:42
trownin tripleo.sh that is13:42
*** pradk has joined #tripleo13:50
*** rgowrishankar has joined #tripleo13:57
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: neutron: enable nova-event-callback by default  https://review.openstack.org/22596214:00
*** absubram has joined #tripleo14:01
*** Goneri has joined #tripleo14:03
*** tiswanso has joined #tripleo14:03
*** absubram_ has joined #tripleo14:06
*** absubram has quit IRC14:06
*** absubram_ is now known as absubram14:06
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: neutron: enable nova-event-callback by default  https://review.openstack.org/22596214:08
openstackgerritEmilien Macchi proposed openstack/instack-undercloud: Update puppet-neutron Hiera config  https://review.openstack.org/24249314:09
*** olap has quit IRC14:15
*** cwolferh has quit IRC14:16
*** olap has joined #tripleo14:17
*** rlandy has joined #tripleo14:17
dprinceEmilienM: hey, thanks for ^^. One question on these... since we are still keystone v2 in some places do you know if it causes functional issues if we rely on the puppet-nova defaults for project_domain_id, and user_domain_id (which are keystone v3 specific right?)14:19
*** akuznetsov has quit IRC14:19
EmilienMdprince: afik, neutron will use keystone v2 with nova, without problem14:20
EmilienMour CI is actually using that14:20
EmilienMdprince: https://review.openstack.org/#/c/242126/14:20
EmilienMsee our CI, green14:20
EmilienMand it's using keystone v214:21
dprinceEmilienM: okay, is that actually spawning an instance via nova too?14:21
* dprince can't remember14:21
EmilienMdprince: our CI is runnin Tempest scenarios, we test everything. Volumes, Instances, Networks, etc14:21
EmilienMdprince: https://github.com/openstack/puppet-openstack-integration#description14:21
dprinceEmilienM: cool. I think this should be fine then14:22
EmilienMdprince: the scenarios are really useful to run14:22
EmilienMthey test all the stack14:22
EmilienMand you can quickly detect a bug in the config14:22
EmilienMdprince: maybe tripleo could run that too?14:24
EmilienMdprince: what kind of test your CI is running?14:24
*** rasca has quit IRC14:24
derekhtrown: d0ugal ya, we should add the DIB_INSTALLTYPE_puppet_modules thing to tripleo.sh and remove it from toci14:26
derekhdprince: will create a bug14:26
*** athomas has quit IRC14:27
derekhrhallisey: cool, did the containers jobs get created yet ?14:28
derekhrhallisey: needs to be rebased https://review.openstack.org/#/c/238475/14:28
rhalliseyderekh, I don't know.  Where we I see it14:29
rhalliseywill it show up to gate new patches?14:29
rhalliseywithout merging?14:29
derekhrhallisey: this patch will actually create the new job but it needs to be rebased https://review.openstack.org/#/c/238475/14:29
dprinceEmilienM: we'd like to run it but our CI already takes so long14:29
derekhrhallisey: so the job will show up once thats merged14:30
dprinceEmilienM: currently nothing, we used to... but since we switched CI to instack no overcloud tests are done yet14:30
dprinceEmilienM: on the TODO list14:30
derekh**ALL** at some stage over the last 3 days or so, our CI jobs have gotten about 15 minutes longer has anybody any ideas what merged that may have caused this ?14:30
* derekh hasn't looked into it yet14:30
trownhmm...that is going in the wrong direction14:32
rhalliseyderekh, k all set14:32
dprinceEmilienM: +2 on the puppet-neutron commits, thanks14:33
derekhrhallisey: cool, looking14:34
openstackgerritJiri Stransky proposed openstack/tripleo-puppet-elements: Fix a puppet module name typo  https://review.openstack.org/24250814:34
EmilienMdprince: thanks14:35
derekhrhallisey: commented, needs to be updated slightly I think14:36
rhalliseyderekh, cool I missed that addition.  Thanks fixed14:39
*** athomas has joined #tripleo14:39
*** jprovazn has quit IRC14:44
*** morazi has joined #tripleo14:45
trownderekh: looking at one of the jobs that took a really long time (http://logs.openstack.org/39/242439/2/check-tripleo/gate-tripleo-ci-f21-nonha/1d107c8/console.html#_2015-11-06_12_21_46_144): it took 57 miniutes in just deploying the overcloud!14:51
openstackgerritMerged openstack/python-tripleoclient: Don't parse redhat-release for distro info  https://review.openstack.org/23488514:52
derekhtrown: ouch, and I don't think that access any external resources so its not a slow mirror or anything like that14:53
trownderekh: interestingly we spend almost an hour getting the undercloud ready with images built... that is pretty ripe for optimization14:53
morazirgowrishankar, have you had a chance to catch up with gchamoul re: the puppet work at all?14:54
dprincederekh: something puppet related?14:54
derekhtrown: yup, as of wednesday we now have a nightly jobs, which I intend to use to store certain images that don't need to be built each run14:54
*** rpothier has joined #tripleo14:55
derekhtrown: but the job currently fails , we need this I think https://review.openstack.org/#/c/242449/14:55
derekhdprince: possible, I havn't even looked beyond noticing things are taking longer14:55
rgowrishankarmorazi: chatting with him right now14:58
trownya something on the controller... CREATE_IN_PROGRESS->CREATE_COMPLETE of the Controller resource is 37min for a non-ha job... ControllerNodesPostDeployment is also 17min14:59
gchamoulmorazi: I confirm14:59
morazicheers15:01
*** Marga_ has quit IRC15:10
*** Marga_ has joined #tripleo15:10
*** Marga_ has quit IRC15:15
derekhdprince: updated to add a bug number https://review.openstack.org/#/c/242158/15:19
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci: DO NOT MERGE -- CI performance debugging  https://review.openstack.org/24254215:29
jistrderekh, trown: ^ that will inflate the console.html by about 200 KB but could give more info about what exactly is failing15:30
jistri mean slowing it down15:31
dprincederekh: thanks15:31
derekhjistr: great15:31
*** mcornea has quit IRC15:34
*** mcornea has joined #tripleo15:35
openstackgerritJaume Devesa proposed openstack/tripleo-puppet-elements: Adding networking MidoNet element  https://review.openstack.org/23255115:43
openstackgerritJaume Devesa proposed openstack/tripleo-puppet-elements: Adding networking MidoNet element  https://review.openstack.org/23255115:45
openstackgerritJason Guiditta proposed openstack/tripleo-heat-templates: puppet: run keystone in wsgi  https://review.openstack.org/21317515:50
*** untriaged-bot has joined #tripleo16:01
untriaged-botUntriaged bugs so far:16:01
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/151387916:01
openstackLaunchpad bug 1513879 in OpenStack Compute (nova) "NeutronClientException: 404 Not Found" [Undecided,In progress] - Assigned to Derek Higgins (derekh)16:01
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/151090116:01
openstackLaunchpad bug 1510901 in tripleo "seed's nova-compute service start fail" [Undecided,In progress] - Assigned to Cameron.C (cameron-c)16:01
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/151171516:01
openstackLaunchpad bug 1511715 in diskimage-builder "Images using draycut should have the option to pass drivers to include in build" [Undecided,New] - Assigned to Julia Kreger (juliaashleykreger)16:01
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/151350816:01
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/150590016:01
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/150426316:01
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/150914816:01
openstackLaunchpad bug 1513508 in diskimage-builder "Ironic IPA does not work when Swift is using https" [Undecided,New]16:01
*** untriaged-bot has quit IRC16:01
openstackLaunchpad bug 1505900 in diskimage-builder "Failed to create 'wily' release with DIB_RELEASE" [Undecided,New]16:01
openstackLaunchpad bug 1504263 in tripleo "os-net-config mapping by MAC fails if trying to map in alternate order" [Undecided,Triaged]16:01
openstackLaunchpad bug 1509148 in tripleo "keystone initialize fails if undercloud can't reach overcloud public vip" [Undecided,New]16:01
*** gfidente|lunch is now known as gfidente16:07
*** aufi has quit IRC16:12
openstackgerritTzu-Mainn Chen proposed openstack/tuskar: [WIP] Tuskar API v3  https://review.openstack.org/23571616:13
*** ifarkas has quit IRC16:14
gchamoulyes I am looking16:14
gchamouloops16:14
gchamoulwrong chan16:14
openstackgerritTzu-Mainn Chen proposed openstack/tuskar: [WIP] Tuskar API v3  https://review.openstack.org/23571616:21
*** derekh has quit IRC16:26
morazidtantsur|afk, lucas-afk trown do any of your happen to have handy what the nova/ironic race condition trace back looks like?  I am talking with someone that might be hitting this, but wanted to make sure16:31
jayganyone know if is jenkins turned off for tht right now?16:32
*** jaosorior has quit IRC16:35
*** HenryG has quit IRC16:37
*** HenryG has joined #tripleo16:39
trownmorazi: https://bugs.launchpad.net/nova/+bug/1341420 is the launchpad for it16:40
openstackLaunchpad bug 1341420 in OpenStack Compute (nova) "gap between scheduler selection and claim causes spurious failures when the instance is the last one to fit" [High,In progress]16:40
trownmorazi: but that does not really have a good traceback... The key identifier is 'NodeAssociated: Node 4c8a48d4-de85-4133-bc25-b0be2b7cd83a is associated with instance 45797815-cd88-4a77-bd93-f323a7f74544.' in ironic-api.log16:42
*** leanderthal has quit IRC16:42
*** paramite is now known as paramite|afk16:44
*** mkovacik has quit IRC16:48
*** Marga_ has joined #tripleo16:49
*** absubram has quit IRC16:55
*** paramite|afk is now known as paramite17:00
*** mcornea has quit IRC17:01
*** cwolferh_ has joined #tripleo17:01
*** alop has joined #tripleo17:06
jistrjayg: seems like it's running for your patch17:08
jistrjayg: immediate status can be seen here, under "check-tripleo" http://status.openstack.org/zuul/17:08
jistrjayg: and CI history can be seen here http://tripleo.org/cistatus.html17:08
jaygjistr: ah, nice, thx - I didn't see anything in the area where jenkins usually is, wasn't sure how that worked17:20
jistrjayg: yeah it can take a while for the jobs to run and appear in gerrit. And lately we have some slowdown in the CI, we have a patch submitted which could help uncover why.17:22
jaygjistr: fyi, if you are not aware, this patch is really needed, as keystone is dropping eventlet very soon, http is needed to be the default asap17:22
jaygok, cool, good to know17:22
gfidentedsneddon, are there known issues with the existing ipv6 patches or is it just going through review process?17:23
gfidentejayg, jistr do we have anything official from fabbione on how to switch to keystone/httpd btw?17:23
dsneddongfidente, It's just going through the review process. Very little testing (tenant network only) so far.17:24
jistrjayg, gfidente: i'm a bit worried about two things wrt that patch17:24
jistr1) upgrade17:24
jistr2) httpd startup time17:24
jayggfidente: nope, they weren't even aware afaict, pestered rasca about it the other day17:24
jistrre 217:24
jaygthey were supposed to discuss in a meeting, but no word back yet17:24
fabbionegfidente: not yet. is that required for OSPd 8 ?17:24
fabbionegfidente: also, you need to start looping bandini and rasca for this17:25
jaygjistr: sure, I can see that, but this is non-optional17:25
jaygeventlet was deprecated in kilo, and will be totally dropped for mitaka as I understand it17:25
jaygI _believe_ liberty still has it, but deprecated, is that right EmilienM ?17:26
EmilienMyes17:26
fabbioneif we can wait mikata to change architecture i'd be more happy17:26
EmilienMmitaka => dropped17:26
fabbionebecause switching to httpd is going to be a major surgery in the deployment17:26
jistrre 2 we've seen httpd fail to start up because horizon is doing some tough initial preprocessing when it's being started up, and systemd thinks that httpd is unresponsive and just kills it17:26
EmilienMI honestly think we should have used httpd since the beginning. This is really better to use apache to run openstack apis17:27
jaygjistr: I don't disagree, but this has been ignored for too long, I want to get people aware and thinking17:27
jistryea i've heard it's non-optional and i see the urgency. upgrades are also non-optional though, so we'll need to figure something out17:27
EmilienMour Puppet CI tested the upgrade from eventlet to wsgi and it works17:27
EmilienMI can show you the jenkins jobs that did it if you want17:27
gfidentefabbione, there is also this problem where we can't split horizon/keystone if they because retarting one causes the other to go down17:28
fabbionegfidente: i am aware of the problems with httpd17:28
jayggfidente: and this is just the beginning, all services are on their way to wsgi I understand17:28
fabbionegfidente: that's why it's going to be very tricky to change deployment sequence17:28
jaygceilometer will be next and will be the first to cause a problem with constraints as they are today17:29
fabbionegfidente: probably we will need to install all services, then fireup httpd, then start configuring them17:29
gfidenteso won't a simpler httpd frontend, runned in multiple copies, work better?17:29
fabbionegfidente: multiple httpd instances listening on different ports? doable17:29
fabbioneit's going to be still tricky to configure which modules to load and stuff17:30
gfidentefabbione, yeah maybe not actual apache httpd instances but something more lightweight17:30
jistrEmilienM, jayg: re upgrades i'd expect pacemaker deployments to be the ones which will need looking at and verifying. There's going to be a leftover service resource probably, and leftover constraints, just to name things i'd expect off the top of my head.17:30
fabbionewe will need to talk about it in details17:30
jaygjistr: understood17:30
gfidentejistr, ack upgrades probably need serious workflow17:31
fabbioneIMHO17:31
fabbionewhen changing the config this much17:31
fabbioneit's easier to recreate it from scratch17:31
*** trown is now known as trown|lunch17:31
fabbionestop all, destroy cluster, recreate cluster17:31
fabbioneit's less commands, it's faster and safer17:31
gfidentefabbione, I actually pushed for that idea at the summit17:31
fabbionebut17:31
fabbionethere would be service interruption17:32
EmilienMhopefuly one day we drop pacemaker :)17:32
gfidentefabbione, like we do delete/recreate of the node instead of upgrade in-place17:32
fabbioneEmilienM: hopefully one day we will drop openstack :)17:32
EmilienMlol17:32
*** lazy_prince has quit IRC17:32
fabbionegfidente: well not really, i was talking specifically of the pacemaker cluster, not the whole node17:32
EmilienM#1 will happen I think, not sure about #217:32
fabbioneEmilienM: #1 i doubt17:33
EmilienMfabbione: with containers?17:33
fabbioneyeps, even with containers17:33
gfidenteEmilienM, and then you're suggesting that upgrading openstack is easier? :)17:33
jaygok, opinions aside, we just need to figure out how to make this work  :)17:33
fabbioneEmilienM: that's why openshift is about to use pacemaker to run kubernets in HA :)17:33
fabbioneand a bunch of other stuff17:34
EmilienMthis is a Friday troll, I'm happy to feed it17:34
fabbioneso far, all those alternative HA solutions, have totally failed to be HA17:34
fabbione:)17:34
EmilienMI thought fabbione knew about trolls :(17:34
fabbioneand I feed them.. till they explode17:34
fabbioneMUAHHAHA17:34
gfidenteheat stack-list17:34
jayghehehe17:34
fabbionehave a nice weekend guys17:35
fabbionegfidente: did we even met in Tokyo?17:35
gfidenteare you serious?17:35
fabbionei was there, but i can t even remember talking to you17:35
fabbioneyes.. i am totally jetlagged17:35
fabbionebut I trust you.. i am sure we did talk17:35
fabbionei am out17:36
jayghave a nice weekend fabbione17:36
gfidentedream of flying httpd instances17:37
gfidenterainbow colored17:37
jistrworking ones would be enough to start with17:38
gfidentejistr, that's harder!17:38
jistryeah :) i think the horizon startup issue might bite us at some point17:38
jistrso horizon only had the power to break itself, now it will have the power to take down keystone with it17:39
jistr* so far17:39
gfidentejistr, are you saying that you might like the multiple instances thing?17:39
jistrmultiple instances of httpd?17:39
gfidentehttpd-alike17:40
jistrsorry i didn't catch this being discussed17:40
*** mbound has quit IRC17:40
gfidenteok I'll read that as a no17:40
jistrlol ok, though if i knew what we're discussing then maybe i'd like it :)17:41
gfidentewas really only a random thought17:42
gfidentebut yes about using many isolated httpd-alike instances per service17:42
gfidenteone per server17:42
gfidente*per service17:42
jistroh i see it above, sorry, there was so much chat i probably skipped a part, rereading17:43
jaygI see failures, what does this mean? :17:43
jaygCould not locate Gemfile or .bundle/ directory17:43
jayg2015-11-06 16:33:10.891 | Build step 'Execute shell' marked build as failure17:43
gfidenteI think it's the puppet lint stuff?17:43
jaygthat did fail too, same error17:44
jistrgfidente: yeah i think that's a good idea. I'd be concerned to have all the APIs under a single PID.17:44
jistri think we'll have to sort of follow what will be the accepted upstream way though, or at least not diverge *too* much17:45
gfidenteyeah17:45
jaygif they could be split, that seems good to me too, I had kind of been wondering if that was part of what apache resource agent was meant to handle17:45
jayghowever, I think of one service died, that doesn't necessarily kill apache altogether, right?17:46
jistriirc horizon startup taking too long did kill apache altogether for me, iirc (it's a while since i've hit that though)17:47
jistrhowever, it might have been just apache misconfiguration17:48
jaygI recall issue more with pacemaker killing it for taking too long that failure of the service itself, but it has been a while for me too17:48
jaygthat/than17:48
jistryeah maybe it was pacemaker, i don't recall it clearly17:50
jistranyways17:50
jistri'd expect there's a way to configure apache not to be so fragile17:50
jistri.e. one worker can take care of the horizon css preprocessing17:51
jistrand other workers can happily do different things at the same time17:51
jistr(hopefully :) )17:51
jaygsure - I am a bit wondering how/if this impacts service ordering deps still, or if that is not an issue at all17:51
*** pradk has quit IRC17:52
*** jprovazn has joined #tripleo17:52
jistryeah, i don't know the answer to that but it's a good question17:53
* jistr off17:54
jistrhave a nice weekend all17:54
*** jistr has quit IRC17:54
*** jprovazn has quit IRC17:56
*** electrofelix has quit IRC18:01
*** paramite has quit IRC18:05
*** jobewan has joined #tripleo18:05
*** lazy_prince has joined #tripleo18:05
*** tosky has quit IRC18:14
openstackgerritMerged openstack/tripleo-puppet-elements: Fix a puppet module name typo  https://review.openstack.org/24250818:17
*** alop has quit IRC18:18
*** lsmola has quit IRC18:21
*** devvesa has quit IRC18:27
*** absubram has joined #tripleo18:32
*** trown|lunch is now known as trown18:35
gfidenteslagle, the allowed_hosts thing, if we don't have * there people can't connect to the undercloud UI though, no?18:37
*** sthillma has joined #tripleo18:45
slaglegfidente: you don't need * there to connect to the undercloud ui if that's what you're asking18:46
slagledid you check out that django link?18:47
slagleALLOWED_HOSTS doesnt mean "what hosts can i accept connections from"18:48
gfidenteyeah it's which hostname it will serve18:48
slagleright18:48
slagleso we need the underclodu hostname and any IP's we care about there18:48
*** sthillma_ has joined #tripleo18:48
slaglewe don't need '*'18:48
gfidenteyeah but if people is mapping undercloud to some $dns_name, it won't work18:49
gfidenteso I wonder, is really that much of a security concern to make horizon serve * hostname?18:49
slaglenot sure about the severity of the concern18:50
slagleregardless, we shouldnt default to less secure18:50
*** sthillma has quit IRC18:50
*** sthillma_ is now known as sthillma18:50
gfidentewell, honestly, I am not sure how much of a security concern is to make horizon respond to whichever name rather than its own local hostname/ip only18:51
gfidenteI thought this was just going to cause troubles in real world scenarios18:52
gfidentebut will amend the vote18:52
*** absubram has quit IRC18:53
slaglegfidente: yea, i'm not honestly sure about how much of a security concern this is18:54
gfidenteso merge?18:54
slaglei'd just rather rely on the side of caution, and follow the recommendations from both django and horizon18:54
slagleneither of which say to use '*'18:54
gfidenteokay maybe a note in the docs to customize the .template will do?18:54
*** pradk has joined #tripleo18:54
slaglewe don't document that18:54
slaglei think that's a much larger discussion if we want to document that the .template file is meant to be customizable18:55
slagleit's debateable18:56
slaglewe've been bubbling stuff up to the user via undercloud.conf18:56
slaglebut clearly we can't do that for *every* setting18:56
slagleso we probably actually need a hiera override for the undercloud18:56
slagleto allow the user to configure a path to their custom hiera file, which will take precedence over the one from puppet-stack-config in the hiera hierarchy18:57
gfidentehonestly, I don't see how much of a security improvement is to filter the served hostnames18:58
gfidentebut like you said, django suggests to do so...18:58
slagleyea, i'd argue the point with horizon and django18:59
gfidenteahahah18:59
slaglewho document adding hostnames and ip address there18:59
gfidenteit's the alias thing httpd has for the name based virtual hosts18:59
gfidentebut httpd has it to match the virtual host itself, it's not just filtering the incoming request18:59
gfidenteanyway19:00
gfidenteyou hate me now I know19:02
gfidenteso I'll leave!19:02
gfidentehave good we!19:02
slaglegfidente: hah, not true19:03
slaglei love you man19:03
slagleyou are one of the kindest reviewers i know19:03
gfidenteahaha19:04
gfidenteyes I should get the half votes19:04
gfidente0.5 1.519:04
gfidenteto make good use of those too19:04
gfidentebye!19:05
*** gfidente has quit IRC19:05
*** mbound has joined #tripleo19:10
*** Marga_ has quit IRC19:33
*** akrivoka has quit IRC19:34
*** openstackstatus has joined #tripleo19:36
*** ChanServ sets mode: +v openstackstatus19:36
-openstackstatus- NOTICE: Gerrit will be offline at 20:00-20:15 UTC today (starting 20 minutes from now) for scheduled project rename maintenance19:41
*** sthillma has quit IRC19:48
*** pradk has quit IRC19:54
*** Marga_ has joined #tripleo19:56
-openstackstatus- NOTICE: Gerrit is offline until 20:15 UTC today for scheduled project rename maintenance20:04
*** ChanServ changes topic to "Gerrit is offline until 20:15 UTC today for scheduled project rename maintenance"20:04
*** jroll is now known as tjroll20:07
*** ChanServ changes topic to "TripleO | CI status: http://tripleo.org/cistatus.html | Docs http://docs.openstack.org/developer/tripleo-docs/"20:37
*** lucas-afk has quit IRC20:43
*** lucasagomes has joined #tripleo20:49
*** lazy_prince has quit IRC20:59
*** openstackgerrit has quit IRC21:01
*** openstackgerrit has joined #tripleo21:02
*** lblanchard has quit IRC21:03
*** rlandy has quit IRC21:09
*** lblanchard has joined #tripleo21:11
*** rlandy has joined #tripleo21:13
*** jrist has quit IRC21:13
*** jdob has quit IRC21:13
*** absubram has joined #tripleo21:13
*** jayg is now known as jayg|g0n321:15
*** jrist has joined #tripleo21:16
*** sthillma has joined #tripleo21:17
*** lblanchard has quit IRC21:28
openstackgerritRajini Ram proposed openstack/tripleo-heat-templates: Enable Equallogic Backends in Cinder  https://review.openstack.org/24264021:33
*** Goneri has quit IRC21:33
*** panda has quit IRC21:41
*** panda has joined #tripleo21:41
*** rlandy has quit IRC21:46
*** jerrygb has quit IRC21:46
*** jerrygb has joined #tripleo21:47
*** rlandy has joined #tripleo21:51
*** jerrygb has quit IRC21:51
*** dprince has quit IRC21:57
*** untriaged-bot has joined #tripleo22:00
untriaged-botUntriaged bugs so far:22:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/151387922:00
openstackLaunchpad bug 1513879 in OpenStack Compute (nova) "NeutronClientException: 404 Not Found" [Undecided,In progress] - Assigned to Derek Higgins (derekh)22:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/151090122:00
openstackLaunchpad bug 1510901 in tripleo "seed's nova-compute service start fail" [Undecided,In progress] - Assigned to Cameron.C (cameron-c)22:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/151171522:00
openstackLaunchpad bug 1511715 in diskimage-builder "Images using draycut should have the option to pass drivers to include in build" [Undecided,New] - Assigned to Julia Kreger (juliaashleykreger)22:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/151350822:00
openstackLaunchpad bug 1513508 in diskimage-builder "Ironic IPA does not work when Swift is using https" [Undecided,New]22:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/150590022:00
openstackLaunchpad bug 1505900 in diskimage-builder "Failed to create 'wily' release with DIB_RELEASE" [Undecided,New]22:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/150426322:00
openstackLaunchpad bug 1504263 in tripleo "os-net-config mapping by MAC fails if trying to map in alternate order" [Undecided,Triaged]22:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/150914822:00
openstackLaunchpad bug 1509148 in tripleo "keystone initialize fails if undercloud can't reach overcloud public vip" [Undecided,New]22:00
*** untriaged-bot has quit IRC22:00
*** rgowrishankar has quit IRC22:03
*** jerrygb has joined #tripleo22:09
*** jerrygb_ has joined #tripleo22:10
*** rlandy has quit IRC22:11
*** jerrygb has quit IRC22:14
*** tiswanso has quit IRC22:23
*** thrash is now known as thrash|wknd22:26
openstackgerritBen Nemec proposed openstack/instack-undercloud: Make ceilometer hardware meters work out of the box  https://review.openstack.org/24265222:27
openstackgerritMichael Johnson proposed openstack/diskimage-builder: Fix diskimage-builder image size  https://review.openstack.org/24227322:38
openstackgerritJeff Peeler proposed openstack/python-tripleoclient: Add ability to push images to local registry  https://review.openstack.org/24267822:38
johnsombnemec ^^ Let me know what you think about that approach22:38
*** w_ has joined #tripleo22:40
*** olaph has quit IRC22:43
*** shivrao has joined #tripleo22:44
*** trown is now known as trown|outttypeww23:15
*** jtomasek has quit IRC23:51
*** jerrygb_ has quit IRC23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!