Monday, 2016-10-17

*** bfournie has left #tripleo00:01
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/163371300:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1633713 in tripleo "puppet-ntp is breaking ci" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)00:10
*** limao has joined #tripleo00:22
*** limao_ has joined #tripleo00:26
*** limao has quit IRC00:29
*** dhill_ has quit IRC00:37
*** bfournie has joined #tripleo00:47
*** mbozhenko has joined #tripleo00:52
*** mbozhenko has quit IRC00:56
openstackgerritgecong proposed openstack/os-apply-config: Add __ne__ built-in function  https://review.openstack.org/38710701:06
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/163371301:10
openstackLaunchpad bug 1633713 in tripleo "puppet-ntp is breaking ci" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)01:10
*** ooolpbot has quit IRC01:10
*** noslzzp has joined #tripleo01:17
*** tzumainn has joined #tripleo01:24
*** tiswanso has joined #tripleo01:30
*** fzdarsky__ has joined #tripleo01:32
*** fzdarsky_ has quit IRC01:36
*** dmacpher has joined #tripleo01:36
*** jcoufal has quit IRC01:38
*** rhallisey has quit IRC01:38
*** noslzzp has quit IRC01:50
*** noslzzp has joined #tripleo01:51
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/163371302:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1633713 in tripleo "puppet-ntp is breaking ci" [Critical,In progress]02:10
*** tiswanso has quit IRC02:35
*** mbozhenko has joined #tripleo02:52
*** tiswanso has joined #tripleo02:55
*** mbozhenko has quit IRC02:57
*** tiswanso has quit IRC03:10
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/163371303:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1633713 in tripleo "puppet-ntp is breaking ci" [Critical,In progress]03:10
*** tiswanso has joined #tripleo03:10
*** limao_ has quit IRC03:13
*** chlong has joined #tripleo03:30
*** tiswanso has quit IRC03:32
*** pmannidi has quit IRC03:52
*** limao has joined #tripleo03:54
*** noslzzp has quit IRC03:58
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/163371304:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1633713 in tripleo "puppet-ntp is breaking ci" [Critical,In progress]04:10
*** apetrich has quit IRC04:26
*** apetrich has joined #tripleo04:33
*** tzumainn has quit IRC04:35
*** ctayal has joined #tripleo04:36
*** numans has joined #tripleo04:42
*** larstobi has quit IRC04:48
*** larstobi has joined #tripleo04:49
*** pmannidi has joined #tripleo04:50
*** mbozhenko has joined #tripleo04:53
*** mbozhenko has quit IRC04:57
*** ctayal has quit IRC05:03
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/163371305:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1633713 in tripleo "puppet-ntp is breaking ci" [Critical,In progress]05:10
*** ctayal has joined #tripleo05:16
*** chandankumar has joined #tripleo05:22
*** apetrich has quit IRC05:27
*** apetrich has joined #tripleo05:28
*** mbozhenko has joined #tripleo05:43
*** sudipto has joined #tripleo05:44
*** sudipto_ has joined #tripleo05:44
*** mbozhenko has quit IRC05:47
*** jaosorior has joined #tripleo05:48
*** mbozhenko has joined #tripleo05:48
*** mcornea has joined #tripleo05:51
*** pgadiya has joined #tripleo05:58
*** florianf has joined #tripleo05:59
*** rcernin has joined #tripleo06:06
*** ramishra has joined #tripleo06:09
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/163371306:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1633713 in tripleo "puppet-ntp is breaking ci" [Critical,In progress]06:10
*** ealcaniz has joined #tripleo06:17
*** coolsvap has joined #tripleo06:20
*** jbadiapa_ has joined #tripleo06:20
*** ctayal has quit IRC06:23
*** shadower has joined #tripleo06:26
jaosoriorbandini: nothing from nova is at the moment running with pacemaker, right?06:28
*** rasca has joined #tripleo06:29
*** jprovazn has joined #tripleo06:29
bandinijaosorior: correct06:29
jaosoriorbandini: for ocata would it already be safe to remove the unused manifests?06:30
jaosoriorin puppet-tripleo06:30
*** jtomasek_ has joined #tripleo06:31
bandinijaosorior: yes https://review.openstack.org/379957 I am just waiting for newton-rc3 to be releases so we don't diverge too much06:31
jaosoriornice!06:32
bandinijaosorior: will propose it mid-end of this week06:32
*** ctayal has joined #tripleo06:35
mcorneaHi everyone. Has anyone seen this error before: Exception updating plan: Error parsing template http://192.168.0.1:8080/v1/AUTH_99953bb093fa41a39c796e4de3666aaa/overcloud/overcloud.yaml Template format version not found. ?06:41
bandinimcornea: yes, old tripleo-common package06:42
bandinimcornea: the error is misleading, if you look at the heat logs the error before that one is the real one06:42
openstackgerritafazekas proposed openstack/tripleo-heat-templates: glance_multiple_locations when NovaEnableRbdBackend=true  https://review.openstack.org/38718606:43
*** tremble has joined #tripleo06:46
*** jtomasek_ has quit IRC06:47
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Remove faulty migration logic to stop nova-api  https://review.openstack.org/38718906:50
*** dtrainor has quit IRC06:52
*** oshvartz has joined #tripleo06:53
*** saneax-_-|AFK is now known as saneax06:53
*** dsariel has quit IRC06:55
openstackgerritgyani pillala proposed openstack/puppet-tripleo: New Class for VSA in the puppet to support HPE VSA Storevirtual Cinder Backend  https://review.openstack.org/38719106:55
*** StevenK has quit IRC06:55
*** hjensas has joined #tripleo06:58
*** hjensas has joined #tripleo06:58
*** pmannidi has quit IRC07:01
*** tesseract has joined #tripleo07:03
*** b00tcat has joined #tripleo07:04
*** tesseract is now known as Guest2107707:04
*** lmiccini has joined #tripleo07:04
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/163371307:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1633713 in tripleo "puppet-ntp is breaking ci" [Critical,In progress]07:10
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add parameters to run cinder over httpd  https://review.openstack.org/38720207:14
*** amoralej|off is now known as amoralej07:16
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Deploy cinder over Apache httpd  https://review.openstack.org/38720307:17
*** ebarrera has joined #tripleo07:22
*** oshvartz has quit IRC07:26
*** jlinkes has joined #tripleo07:27
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Add disabled links styling  https://review.openstack.org/38720807:27
*** masco has joined #tripleo07:30
*** gchamoul|afk is now known as gchamoul07:30
*** akuznetsov has joined #tripleo07:30
bandiniCI now fails like this for me: ssh: connect to host 10.209.96.166 port 22: No route to host. Anyone else seeing this?07:31
*** jpena|off is now known as jpena07:31
openstackgerritTomas Sedovic proposed openstack/tripleo-validations: Add the NoopFirewallDriver validation  https://review.openstack.org/38721007:32
*** tremble has quit IRC07:33
*** openstackgerrit has quit IRC07:34
*** openstackgerrit has joined #tripleo07:34
*** bana_k has joined #tripleo07:34
*** tremble has joined #tripleo07:35
*** jpich has joined #tripleo07:35
*** aufi has joined #tripleo07:36
*** flepied1 has quit IRC07:36
*** zoli_gone-proxy is now known as zoliXXL07:41
*** dtantsur|afk is now known as dtantsur07:42
*** dmacpher has quit IRC07:43
zoliXXLgood morning07:44
openstackgerritTomas Sedovic proposed openstack/tripleo-validations: Add the NoopFirewallDriver validation  https://review.openstack.org/38721007:45
*** shardy has joined #tripleo07:46
*** ctayal has quit IRC07:49
jaosoriorhttp://review.rdoproject.org/ seems to be down :/07:50
b00tcatwhen deploying a stack, is it possible to get the initial Puppet run output on a file?07:51
*** StevenK has joined #tripleo07:52
*** ohamada has joined #tripleo07:55
shardyMorning all07:59
shardyb00tcat: do you mean the manifest run by puppet or the stderr/stdout?08:00
*** pmannidi has joined #tripleo08:00
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Optionally include mod auth mellon for apache  https://review.openstack.org/35994208:00
*** dbecker has joined #tripleo08:01
*** limao has quit IRC08:02
b00tcatshardy: I would like stderr of the first run, and if possible with --trace and --debug enabled on the Puppet side08:03
b00tcatas I have an error that only takes place on the 1st run08:03
*** limao has joined #tripleo08:03
mcorneashardy: Good morning. Quick question regarding the composable roles: can I do customization via ExtraConfig for the custom roles?08:04
shardymcornea: yup, that should work although I've not tested it myself yet08:04
mcorneashardy: thanks, I'll add it to my list to test08:05
shardythe parameter is templated via j2 in role.role.j2.yaml e.g $RoleNameExtraConfig08:05
jaosoriorshardy: but wasn't there a more general ExtraConfig that I could just use for all roles?08:06
openstackgerritMerged openstack/tripleo-validations: Validate rogue DHCP servers  https://review.openstack.org/35397308:06
shardyjaosorior: yes, that should also work08:06
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/163371308:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1633713 in tripleo "puppet-ntp is breaking ci" [Critical,In progress]08:10
d0ugalhrm, so CI is unhappy today?08:11
openstackgerritDmitry Tantsur proposed openstack/python-tripleoclient: Remove "baremetal show capabilities" command  https://review.openstack.org/38723308:12
*** Guest69614 is now known as assassin08:12
jaosoriord0ugal: yep, both because we have issues with puppet-ntp and because review.rdoproject.org is down08:12
*** assassin has quit IRC08:12
*** assassin has joined #tripleo08:12
d0ugaljaosorior: k, thanks.08:13
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Fix cert/key input  https://review.openstack.org/38723508:13
d0ugalreview.rdoproject.org has been down quite a bit lately.08:13
jaosoriord0ugal: at the moment it's down cause they're migrating it to a new datacenter08:13
*** akuznetsov has quit IRC08:17
shardyb00tcat: http://paste.openstack.org/show/585907/ has some notes on how I'd do it08:19
shardyb00tcat: note the heat hook only supports --debug atm, so you may need to modify the hook (in the overcloud-full image) to support trace08:19
b00tcatshardy: in the paste it says that this should be done "via virt-copy-in", what does this mean?08:21
shardyb00tcat: its a tool provided via libguestfs-tools08:21
shardyit allows you to modify a qcow2 image e.g to copy in a file which you've modified08:22
b00tcatah, cool! thanks shardy08:22
*** waleedm has joined #tripleo08:23
shardyif the --trace flag proves useful you're welcome to propose it as an addition to the heat hook08:23
*** athomas has joined #tripleo08:25
waleedmHi, regarding the https://access.redhat.com/solutions/2446961 , yum upgrade python-tripleoclient-5.2.0-1.el7ost.noarch , returns no package available , any suggestion ?08:26
*** electrofelix has joined #tripleo08:26
*** rcarrill1 is now known as rcarrillocruz08:29
b00tcatshardy: sure :)08:32
openstackgerritTomas Sedovic proposed openstack/tripleo-validations: Validate haproxy configuration values  https://review.openstack.org/35395308:32
openstackgerritTomas Sedovic proposed openstack/tripleo-validations: Validation to verify connectivity to overcloud  https://review.openstack.org/35393408:33
openstackgerritTomas Sedovic proposed openstack/tripleo-validations: Validation to detect if undercloud disks use 512e  https://review.openstack.org/32217908:33
openstackgerritTomas Sedovic proposed openstack/tripleo-validations: Validate the IP range for the control plane  https://review.openstack.org/35395008:33
*** cylopez has joined #tripleo08:34
*** bana_k has quit IRC08:37
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add parameters to run cinder over httpd  https://review.openstack.org/38720208:39
*** anton- has quit IRC08:46
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Enable proxy headers parsing for Neutron  https://review.openstack.org/38726608:50
*** chem has joined #tripleo08:51
*** ccamacho has joined #tripleo08:51
*** chem has quit IRC08:54
*** chem has joined #tripleo08:54
*** anton- has joined #tripleo08:55
*** paramite has joined #tripleo08:57
mandrehello, since this week end apache fails to start on my control node because of invalid process count for WSGI daemon process08:57
mandrethe faulty config file is /etc/httpd/conf.d/10-nova_api_wsgi.conf and effectively nova::wsgi::apache::workers is set to 0 in /etc/puppet/hieradata/service_configs.yaml08:59
*** derekh has joined #tripleo08:59
*** milan has joined #tripleo08:59
mandreso my question is, what generates /etc/puppet/hieradata/service_configs.yaml?08:59
jistrit should come from the keystone service template here https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/keystone.yaml#L83-L8609:01
jistrhttps://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/keystone.yaml#L17909:01
jistrsorry apparently i didn't wake up yet :D09:02
openstackgerritChristian Schwede proposed openstack/tripleo-heat-templates: Fix usage of SwiftRawDisks  https://review.openstack.org/38727809:02
jistrnova, not keystone...09:02
mandrejistr: yeah, the issue is with nova-api09:03
jistrso it's here https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/nova-api.yaml09:03
mandrejistr: thanks!09:03
*** limao_ has joined #tripleo09:03
jpichmandre: Sounds somewhat related to https://bugs.launchpad.net/tripleo/+bug/1631133 though that looks to be fixed recently09:04
openstackLaunchpad bug 1631133 in OpenStack Compute (nova) "nova's osapi_compute_workers is not valid (must be greater than 1)" [High,In progress] - Assigned to Dan Prince (dan-prince)09:04
*** limao has quit IRC09:04
*** owalsh has joined #tripleo09:05
mandrejpich: it seems that the fix broke it for me :-/09:06
jpichmandre: Ouch :(09:06
*** pcaruana has joined #tripleo09:08
*** pmannidi has quit IRC09:08
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/163371309:10
openstackLaunchpad bug 1633713 in tripleo "puppet-ntp is breaking ci" [Critical,In progress]09:10
*** ooolpbot has quit IRC09:10
*** flepied has joined #tripleo09:12
*** anshul has joined #tripleo09:13
jaosoriormandre, jpich well, nova-api used to run over eventlet. And it was only recently that it moved to run over apache09:14
jaosoriorso it might be that that fix was meant for eventlet, but the apache migration came at the same time :/09:14
openstackgerritDougal Matthews proposed openstack/tripleo-common: Is this thing on?  https://review.openstack.org/38668309:15
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Provide roles network configuration  https://review.openstack.org/38728509:15
jpichjaosorior: Thank you for the additional information, I didn't know about the migration09:16
openstackgerritSteven Hardy proposed openstack/puppet-tripleo: Move heat domain/user creation into keystone profile  https://review.openstack.org/38728809:17
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Pass heat domain admin password to keystone  https://review.openstack.org/38728909:17
*** anshul has quit IRC09:17
*** hewbrocca-afk is now known as hewbrocca09:21
*** xuao has joined #tripleo09:22
*** gfidente has joined #tripleo09:23
*** gfidente has quit IRC09:23
*** gfidente has joined #tripleo09:23
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Set nova service_name via t-h-t  https://review.openstack.org/38651909:23
mandrejaosorior: thx, I'm trying to understand what's wrong in my environment, I might come back to you later :)09:23
jaosoriormandre: sure09:23
*** chlong has quit IRC09:26
*** limao_ has quit IRC09:26
*** limao has joined #tripleo09:27
socialdo we have template to populate overcloud with demo data or even set up tempest on some node?09:27
socialcomposable role for tempest \o/09:27
shardysocial: there's a template we use for the overcloud pingtest in tripleo-ci, but otherwise no09:28
shardythe composable services model is really only about the deployed overcloud (not the overcloud configuration or stuff running on it)09:29
*** limao has quit IRC09:29
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: glance_multiple_locations when NovaEnableRbdBackend=true  https://review.openstack.org/38729909:31
*** jaosorior has quit IRC09:41
*** jaosorior has joined #tripleo09:42
hewbroccaIsn't that something like what oooq and infrared do?09:44
jaosoriorccamacho: sup dude09:46
ccamachohey jaosorior morning! :)09:46
socialshardy: which template, I'd love to have a look09:47
jaosoriorccamacho: hey dude, so, did you have a chance to check the rest of the SSL stuff last week?09:47
*** tosky has joined #tripleo09:47
shardysocial: https://github.com/openstack-infra/tripleo-ci/tree/master/templates09:48
socialah I was looking in wrong repo :)09:48
shardybut really you can launch any heat stack you like on the deployed overcloud09:48
shardythere's a bunch more examples in the openstack/heat-templates repo09:48
ccamachojaosorior, partially, Im stuck in a no host available error since last Friday, but Ill let you know asap :)09:48
mandrejaosorior, jpich, jistr: this seems to fix it for me, https://review.openstack.org/#/c/387309/09:50
openstackgerritgengchc2 proposed openstack/python-tripleoclient: Remove white space between print () in plan_management.py  https://review.openstack.org/38731109:50
jaosoriormandre: nice!09:52
jpichmandre: Cool!09:53
*** mbozhenko has quit IRC09:54
openstackgerritMerged openstack/tripleo-validations: Validation to verify connectivity to overcloud  https://review.openstack.org/35393409:56
gfidentehey guys can we merge https://review.openstack.org/#/c/383721/ ?09:58
jaosoriorgfidente: we can't09:59
jaosoriorgfidente: CI is broken :/09:59
openstackgerritMerged openstack/tripleo-validations: Validate the IP range for the control plane  https://review.openstack.org/35395010:00
gfidenteright :) I was looking for the +2 :P10:00
*** derekh changes topic to "CI Jobs failing due too planed outage of review.rdoproject.org | TripleO : http://tripleo.org/ | https://wiki.openstack.org/wiki/TripleO | Meetings On Tuesdays at 14:00 UTC in #openstack-meeting-alt"10:02
*** tremble has quit IRC10:03
*** sudipto has quit IRC10:04
*** sudipto_ has quit IRC10:04
openstackgerritMerged openstack/tripleo-validations: Validation to detect if undercloud disks use 512e  https://review.openstack.org/32217910:05
jaosoriorccamacho: no host available... that's interesting, what do the nova and ironic logs say?10:05
*** tremble has joined #tripleo10:05
gfidentemarios, one question regarding this one https://review.openstack.org/#/c/384717/10:07
*** flepied has quit IRC10:07
ccamachojaosorior, got the error :) /var/log/nova-compute.log shows things like AMQP server controller:5672 closed the connection. Check login credentials: Socket closed10:08
ccamacholet me check if by restarting some services starts to work  again10:08
gfidentemarios,  I can do a follow-up np10:09
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/163371310:10
openstackLaunchpad bug 1633713 in tripleo "puppet-ntp is breaking ci" [Critical,In progress]10:10
*** ooolpbot has quit IRC10:10
jaosoriorccamacho: what about restarting rabbitmq (which is the connection that closed) and then restarting the openstack services?10:10
ccamachoyeahp10:10
*** panda_ is now known as panda10:10
openstackgerritMerged openstack/tripleo-docs: Update upgrade instructions for M->N upgrades  https://review.openstack.org/38471710:11
*** tremble has quit IRC10:13
mariosgfidente: o/ what is the question? (don't se it on the review?)10:15
gfidentemarios, nah wanted to add a single line about ceph, but thought it'd be better to merge it first10:16
*** tremble has joined #tripleo10:16
mariosgfidente: oh right... yeah it was in the commit as todo... sure i mean, we do have currenlty m..n instructions but that review added the migration (i.e. this is iterative) ping me/add me when you do10:16
gfidenteack10:16
mariosmigrations10:16
openstackgerritMiles Gould proposed openstack/python-tripleoclient: [WIP] Add DRAC RAID configuration to baremetal ready state command  https://review.openstack.org/29922110:20
*** flepied has joined #tripleo10:22
*** fzdarsky__ has quit IRC10:25
EmilienMhello10:28
*** fzdarsky has joined #tripleo10:28
*** zoliXXL is now known as zoli|lunch10:28
*** mgould has joined #tripleo10:33
mgouldmorning everybody!10:33
mgouldis https://review.openstack.org/#/c/367346 still able to be merged?10:33
*** xuao has quit IRC10:34
mgould^^^ removes RAID functionality from "configure ready state" in Mitaka10:34
*** sudipto has joined #tripleo10:34
*** sudipto_ has joined #tripleo10:34
*** noslzzp has joined #tripleo10:36
*** gfidente has quit IRC10:36
*** yolanda has quit IRC10:36
EmilienMhi, we are still dealing with https://bugs.launchpad.net/tripleo/+bug/1633713 FUI10:37
openstackLaunchpad bug 1633713 in tripleo "puppet-ntp is breaking ci" [Critical,In progress]10:37
EmilienMFYI10:37
EmilienMthe CI is still not stable10:37
jaosoriorEmilienM: a bit ago, there was also an issue with review.rdoproject.org being down due to migration to another datacenter. Not sure if that's done now.10:38
EmilienMyes, migration is done10:38
jaosoriornice10:38
*** sudswas__ has joined #tripleo10:38
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: CI test - never merge  https://review.openstack.org/38734410:38
jaosoriorEmilienM: so, we have a pin now for puppet-ntp, right?10:38
*** noslzzp has quit IRC10:38
jaosoriorEmilienM: is there plans to revert that change from puppet-ntp? or do we need to move ASAP to using puppet 4?10:39
pandaEmilienM: still can't access review.rdoproject.org10:39
waleedmHi, regarding the https://access.redhat.com/solutions/2446961 , yum upgrade python-tripleoclient-5.2.0-1.el7ost.noarch , returns no package available , any suggestion ?10:39
*** sudipto_ has quit IRC10:39
*** sudipto has quit IRC10:39
*** sudipto_ has joined #tripleo10:39
EmilienMjaosorior: we pinned until we switch to puppet410:39
*** noslzzp has joined #tripleo10:39
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Provide roles network configuration  https://review.openstack.org/38728510:39
EmilienMpanda: indeed10:41
*** yolanda has joined #tripleo10:44
jaosoriormcornea: hey dude, did you give a try to the role specific ExtraConfig?10:44
EmilienMhttp://logs.openstack.org/09/387309/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/e982d55/console.html#_2016-10-17_09_59_45_55426710:44
mcorneajaosorior: nope, not yet10:44
EmilienMindeed, RDO breakage is also for us10:44
matbuEmilienM: :/10:47
*** rhallisey has joined #tripleo10:47
EmilienMshardy: all CI is blocked until 15 UTC10:49
EmilienMthat's terrible10:50
*** gfidente has joined #tripleo10:50
*** gfidente has quit IRC10:50
*** gfidente has joined #tripleo10:50
shardyEmilienM: Yeah I agree the timing isn't good, but it sounds like there may be a workaround by pointing rdoinfo at the github mirrors10:50
EmilienMno need to do recheck folks10:51
shardyHopefully we can figure out how to get better visibility of planned outages like this in future :(10:51
shardymcornea: Hi, can you pls check https://bugs.launchpad.net/tripleo/+bug/163307710:51
openstackLaunchpad bug 1633077 in tripleo "Deployment fails when non-pacemaker Manila services are deployed on a different role than controller" [High,Triaged]10:51
*** rhallisey has quit IRC10:51
shardymcornea: I started looking at the fix, and AFAICS it's already fixed so wanted to confirm you had that patch when testing10:52
mcorneashardy: checking10:52
*** rhallisey has joined #tripleo10:53
mcorneashardy: I can't say for sure becaue I don't have the environment anymore but I can try to reproduce it and will let you know10:54
shardymcornea: ack, if you've got an environment where you can easily check that would be great, thanks10:55
*** pkovar has joined #tripleo11:01
*** florianf has quit IRC11:01
openstackgerritFlorian Fuchs proposed openstack/tripleo-ui: Add deployment cancellation/deletion  https://review.openstack.org/38735511:03
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Provide roles network configuration  https://review.openstack.org/38728511:05
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates: Composable Zaqar services  https://review.openstack.org/33168211:06
openstackgerritBrad P. Crochet proposed openstack/puppet-tripleo: Add zaqar profiles  https://review.openstack.org/33168111:07
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates: Composable Mistral services  https://review.openstack.org/32343611:08
*** zoli|lunch is now known as zoli11:08
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Provide roles network configuration  https://review.openstack.org/38728511:09
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/163371311:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1633713 in tripleo "puppet-ntp is breaking ci" [Critical,In progress]11:10
*** derekjhyang has quit IRC11:10
*** sudipto_ has quit IRC11:11
*** sudswas__ has quit IRC11:11
*** zoli is now known as zoliXXL11:11
*** gfidente has quit IRC11:12
*** florianf has joined #tripleo11:12
openstackgerritJiri Stransky proposed openstack/python-tripleoclient: Allow overriding CLI parameter defaults with env files  https://review.openstack.org/38666911:19
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Provide roles network configuration  https://review.openstack.org/38728511:21
openstackgerritBabu Shanmugam proposed openstack/puppet-tripleo: Fix bug in ovn plugin  https://review.openstack.org/38736611:28
*** matbu is now known as matbu|brb11:31
*** mbozhenko has joined #tripleo11:33
EmilienMit sounds like workarounds in RDO, we can use recheck and see how it goes11:34
*** chem has quit IRC11:34
jaosoriorexcellent!11:34
*** tremble has quit IRC11:35
EmilienMmhh I still see an error during delorean build11:36
jaosorior:(11:36
*** tremble has joined #tripleo11:37
*** chem has joined #tripleo11:38
*** mbozhenko has quit IRC11:38
*** mbozhenko has joined #tripleo11:38
*** dprince has joined #tripleo11:43
openstackgerritBabu Shanmugam proposed openstack/puppet-tripleo: Fix bug in ovn plugin  https://review.openstack.org/38736611:43
*** zoliXXL is now known as zoli|brb11:44
*** rbrady has joined #tripleo11:47
*** rbrady has joined #tripleo11:47
*** gfidente has joined #tripleo11:47
*** dmacpher has joined #tripleo11:48
*** dsavineau has joined #tripleo11:50
*** phpcodemonkey has joined #tripleo11:52
*** jayg|g0n3 is now known as jayg11:56
*** chem has quit IRC11:57
*** chem has joined #tripleo11:57
openstackgerritabdul nizamuddin proposed openstack/os-cloud-config: Changed the home-page link  https://review.openstack.org/38738811:58
*** panda is now known as panda|afk11:58
*** bfournie has quit IRC12:03
*** waleedm has quit IRC12:05
*** dsariel has joined #tripleo12:06
*** jcoufal has joined #tripleo12:08
*** hewbrocca is now known as hewbrocca-afk12:09
EmilienMok things are fine now in CI12:09
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/163371312:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1633713 in tripleo "puppet-ntp is breaking ci" [Critical,In progress]12:10
*** pgadiya has quit IRC12:10
EmilienMremoving the alert ^12:10
d0ugalEmilienM: Thanks!12:10
jpich\o/12:11
*** amoralej is now known as amoralej|lunch12:11
*** tzumainn has joined #tripleo12:12
EmilienMcredits to jpena and apevec for their help12:14
d0ugal++12:15
*** maticue has joined #tripleo12:16
*** fultonj has quit IRC12:17
*** fultonj has joined #tripleo12:17
*** coolsvap has quit IRC12:18
*** sai has quit IRC12:19
*** rook_ has quit IRC12:20
*** Guest23990 is now known as zigo12:21
*** dsavineau has left #tripleo12:22
*** rbowen has joined #tripleo12:25
openstackgerritBabu Shanmugam proposed openstack/puppet-tripleo: Fix bug in ovn plugin  https://review.openstack.org/38736612:25
*** rook has joined #tripleo12:26
*** rook is now known as Guest4069312:26
*** sai has joined #tripleo12:27
*** rbrady has quit IRC12:29
*** morazi has joined #tripleo12:29
*** dtantsur is now known as dtantsur|mtg12:30
openstackgerritBrad P. Crochet proposed openstack-infra/tripleo-ci: Use yaml files for building images for CI  https://review.openstack.org/33631212:32
*** zoli|brb is now known as zoli12:32
*** zoli is now known as zoliXXL12:32
openstackgerritBrad P. Crochet proposed openstack/python-tripleoclient: TEST - DO NOT MERGE  https://review.openstack.org/38740512:33
*** gfidente has quit IRC12:39
jtomasekshardy: what is proper way to cancel deployment in progress? deleting the stack? or cancel_update?12:42
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart: Add ability to deploy an overcloud with ssl  https://review.openstack.org/38283012:42
*** trown is now known as trown|brb12:43
*** matbu|brb is now known as matbu12:43
*** bfournie has joined #tripleo12:43
*** jprovazn has quit IRC12:46
*** zaneb has quit IRC12:47
*** zaneb has joined #tripleo12:48
*** jpena is now known as jpena|lunch12:50
shardyjtomasek: I think stack cancel update only works for update, so on the initial create the only option is to delete it12:50
*** abehl has joined #tripleo12:50
jtomasekshardy: ok, sounds fine12:50
shardyjtomasek: it would be good to have a heat interface which just stops the deploy non destructively in future tho12:50
zanebshardy, jtomasek: it also does a rollback, which is never what you want for TripleO12:51
jtomasekack12:51
shardyzaneb: Even if the stack has rollback disabled (the default) ?12:51
zanebshardy: yes12:52
shardyzaneb: Ok, thanks for clarifying12:52
shardysounds like we could use a stop-right-now interface which just cancels $action and stops12:52
zanebshardy: agree. we're gonna try to implement that in convergence12:53
*** limao has joined #tripleo12:54
openstackgerritCyril Lopez proposed openstack/tripleo-heat-templates: Fix api_extensions_path in neutron-opencontrail environment  https://review.openstack.org/38741612:57
*** limao_ has joined #tripleo12:57
*** tiswanso has joined #tripleo12:59
*** tiswanso has quit IRC12:59
*** tiswanso has joined #tripleo13:00
*** limao has quit IRC13:00
*** Goneri has joined #tripleo13:02
*** mah has left #tripleo13:03
*** rbrady has joined #tripleo13:04
*** ramishra has quit IRC13:08
*** hjensas has quit IRC13:11
*** lblanchard has joined #tripleo13:13
*** trown|brb is now known as trown13:14
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Remove setting of OS_IMAGE_API_VERSION for newton and above  https://review.openstack.org/38742113:15
*** pcaruana has quit IRC13:18
*** tobias_fiberdata has quit IRC13:19
*** gfidente has joined #tripleo13:20
*** flepied has quit IRC13:20
*** flepied has joined #tripleo13:26
*** jprovazn has joined #tripleo13:27
openstackgerritMerged openstack/tripleo-ui: Add disabled links styling  https://review.openstack.org/38720813:27
openstackgerritMerged openstack/tripleo-ui: Fix cert/key input  https://review.openstack.org/38723513:28
*** myoung|gone is now known as myoung13:28
openstackgerritJuan Antonio Osorio Robles proposed openstack/python-tripleoclient: Enable creating images with Glance v2  https://review.openstack.org/38743013:28
*** panda|afk is now known as panda13:28
*** jeckersb_gone is now known as jeckersb13:29
jpichmandre: Hello! When you have a few minutes, I'd appreciate your thoughts/tips on https://bugs.launchpad.net/tripleo/+bug/1634131 and the possible approach I'm describing. I think that's how things should be done when working with Puppet but I could be misunderstanding things :)13:30
openstackLaunchpad bug 1634131 in tripleo "UI config is overwritten on undercloud upgrade" [High,Triaged]13:30
shardyjpich: I think that is expected, any config files managed by puppet should not be manually modified13:31
mandrejpich: looking...13:32
shardyjpich: you'll need to wire in any customizations to that file via hieradata overrides, and undecloud.conf can point to a local overrides file13:32
shardyand/or add undercloud.conf options that capture what you need to configure13:33
jpichshardy: That's what I thought indeed. Thank you for the tips on how these settings can be overridden. Are there other options/examples of settings that require an additional customisation file?13:34
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Stop pinning Glance API  https://review.openstack.org/38743213:34
shardyjpich: yup, I'll add some notes to the bug13:34
jpichshardy: I'm still hoping we can get by by reusing the undercloud_hostname parameter, but this is useful to know in case we can't!13:34
jpichshardy: Thank you13:35
mandrejpich: what shardy said :)13:35
jaosoriorjpich: what would you use the undercloud_hostname parameter for?13:35
jpichmandre: :D Thanks!13:35
jpichjaosorior: Using it as the base URL for configuring the service URLs in the UI (the undercloud services)13:36
jpichjaosorior: https://github.com/openstack/tripleo-ui/blob/master/dist/tripleo_ui_config.js.sample13:37
openstackgerritMerged openstack/tripleo-quickstart: Explicitly cast variables in quickstart-extras playbook  https://review.openstack.org/38687313:37
jaosoriorjpich: that might not be accurate, depending on how the undercloud is being deployed, you might want to take undercloud_public_vip and undercloud_admin_vip into account, those might even be set as FQDNs13:37
b00tcatcan I get a +1 on the workflow here? https://review.openstack.org/#/c/383058/ I need to rebase 2 other patches on top of this one when it's merged ^^"13:37
jpichjaosorior: Alright, I'm not familiar with the 2 parameters you mentioned but will investigate them as well. I'm hoping to avoid having to add yet a new setting, but perhaps it can't be helped. Thank you for the pointers!13:41
*** trown is now known as trown|brb13:41
jaosoriorjpich: those are what the endpoints end at if SSL is enabled13:41
jpichjaosorior: But not when SSL isn't enabled?13:42
jaosoriorjpich: that's the issue :(. unless we start deploying haproxy in the undercloud always (which I have a patch for that I need to get back to)13:42
openstackgerritMarkos Chandras proposed openstack/diskimage-builder: lib: Drop shebang from library scripts  https://review.openstack.org/38744013:43
openstackgerritMarkos Chandras proposed openstack/diskimage-builder: elements: Drop executable bits from environment files  https://review.openstack.org/38744113:43
shardySounds like it would be helpful to have a really simple CI smoke test, so we can e.g prove that at least the UI login page loads for SSL/non-SSL cases?13:43
openstackgerritJuan Antonio Osorio Robles proposed openstack/python-tripleoclient: Enable creating images with Glance v2  https://review.openstack.org/38743013:44
jpichjaosorior: That should be interesting!! We might be going for an SSL-only undercloud when the UI is installed, you might have seen dtrainor's work at https://blueprints.launchpad.net/tripleo/+spec/enable-communication-ui-undercloud13:44
jaosoriorjpich: I did, and I think that's great stuff!13:45
*** ealcaniz has quit IRC13:45
jpichshardy: Hoping to get something like that done with https://blueprints.launchpad.net/tripleo/+spec/triplo-ui-basic-ci-check , though if you have additional/different ideas on how this might work please feel free to update the whiteboard :)13:46
jpichjaosorior: Yeah :D13:46
shardyjpich: ack, sounds good :)13:46
*** akuznetsov has joined #tripleo13:46
jpichshardy: Cheers!13:47
*** akuznetsov has quit IRC13:47
*** pblaho has joined #tripleo13:47
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Always deploy HAProxy  https://review.openstack.org/36036813:48
openstackgerritafazekas proposed openstack/python-tripleoclient: Enable serial console tests  https://review.openstack.org/38744513:49
*** akuznetsov has joined #tripleo13:50
*** zaneb has quit IRC13:54
*** mbozhenko has quit IRC13:55
*** zaneb has joined #tripleo13:56
jtomasekshadower: it is still valid that copy_ssh_key workflow needs to be run post deployment, right?13:57
jpichjtomasek: Hi! I meant to ask you about https://bugs.launchpad.net/tripleo/+bug/1632007 , do you know any more about it?13:58
openstackLaunchpad bug 1632007 in tripleo "Failed deployment due to Hiera resolution of keystone::wsgi::apache::workers" [High,Triaged] - Assigned to Jiri Tomasek (jtomasek)13:58
shadowerjtomasek: it should happen automatically now13:58
jtomasekjpich: didn't get to it yet, I'll check the output from heat validate to see how does the value of that parameter look13:59
shadowerjtomasek: https://github.com/openstack/tripleo-common/blob/master/workbooks/deployment.yaml#L12214:00
jtomasekshadower: so the workflow is run automatically at some point or it is not needed any more?14:00
openstackgerritMerged openstack/tripleo-ui: Add central logging  https://review.openstack.org/37606014:00
shadowerjtomasek: the workflow is still needed, but it's now run as part of the "deploy_plan" workflow ^14:01
jtomasekshadower: oh nice14:01
jtomasekshadower: thanks14:01
shadowernp :-)14:01
*** dtantsur|mtg is now known as dtantsur14:01
jtomasekbtw. anyone seen this? Error: Could not find dependency Class[Swift::Proxy::Versioned_writes] for Swift::Service[swift-proxy-server] at /etc/puppet/modules/swift/manifests/proxy.pp:27914:01
EmilienMjtomasek: it reminds be something we did recently, a sec14:02
jtomasekEmilienM: deployment fails on it (GUI) - setup is latest tripleo-common from source + latest THT from source14:02
*** jpena|lunch is now known as jpena14:03
*** amoralej|lunch is now known as amoralej14:03
*** hogepodge has quit IRC14:04
EmilienMjtomasek: https://review.openstack.org/#/c/384616/14:05
openstackgerritMerged openstack/puppet-tripleo: packages: run upgrade at 'setup' stage  https://review.openstack.org/38663714:05
openstackgerritLukas Bezdicka proposed openstack/puppet-tripleo: packages: run upgrade at 'setup' stage  https://review.openstack.org/38745614:06
openstackgerritDougal Matthews proposed openstack/instack-undercloud: Only create the Mistral config env if it doesn't exist  https://review.openstack.org/38655814:06
jtomasekEmilienM: thanks, so the failure is probably due to my undercloud setup being old and there fore incompatible with this tht change, right?14:07
EmilienMjtomasek: maybe puppet-tripleo and puppet-swift?14:08
jtomasekEmilienM: ok, thanks, I'll try to update the setup14:08
jtomasekEmilienM: probably this one https://review.openstack.org/#/q/I07a206473ff7939749e3eba1dfe3ea8c4526eb5c,n,z14:09
EmilienMjtomasek: probably14:09
*** saneax is now known as saneax-_-|AFK14:10
*** trown|brb is now known as trown14:11
*** Goneri has quit IRC14:14
*** Goneri has joined #tripleo14:15
*** lucasagomes is now known as lucas-hungry14:18
openstackgerrityolanda.robla proposed openstack/tripleo-quickstart: Create directories with root  https://review.openstack.org/38489214:19
*** ealcaniz has joined #tripleo14:19
*** ohamada_ has joined #tripleo14:20
*** ohamada has quit IRC14:20
openstackgerritBrad P. Crochet proposed openstack/python-tripleoclient: Switch overcloud build images to use ImageBuildManager  https://review.openstack.org/38553014:20
jpichjtomasek: Great, thank you! I can recreate the issue on my current environment, if you'd like me to do some more data gathering to add to the bug?14:23
*** coolsvap has joined #tripleo14:25
trozetshardy: thanks for the comments14:27
trozetshardy: i agree it is some legacy logic there that is left over and should make it better14:27
*** dhill_ has joined #tripleo14:27
shardytrozet: can we just fix the enabled on controller stuff in puppet-tripleo do you think?14:28
EmilienMbeagles: do you have a patch for https://bugs.launchpad.net/tripleo/+bug/1633580 ?14:28
openstackLaunchpad bug 1633580 in tripleo "port for rabbitmq is not included in list of rabbit_hosts" [High,Confirmed] - Assigned to Brent Eagles (beagles)14:28
trozetshardy: I'm looking at it now to figure out what needs to change14:28
shardytrozet: ack, sounds good, let me know if I can help14:28
trozetshardy: I guess I would need to make comparisons of IP addresses to figure out where ODL should run then?14:29
beaglesEmilienM: geez.. yeah. gerrit/launchpad fail once again14:30
EmilienMdprince: do you have a patch for https://bugs.launchpad.net/tripleo/+bug/1633595 ?14:30
openstackLaunchpad bug 1633595 in tripleo "Nova no longer sets authtoken memcache_servers" [High,In progress] - Assigned to Dan Prince (dan-prince)14:30
EmilienMbeagles: no worries14:30
dprinceEmilienM: working on one approach this morning14:31
dprinceEmilienM: I will have it today14:31
EmilienMdprince: ok14:31
shardytrozet: Is the problem that we've got one manifest that configures things on both nodes running the service and those that don't?14:31
shardyhttps://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/neutron/opendaylight.pp14:31
dprinceshardy: on that note: how would you feel about me adding new versions of memcached_node_ips_v6 in all-nodes-config.yaml?14:32
dprinceshardy: ones with ports on the end of them?14:32
shardyit seems like the odl_on_controller flag indicates it should really be two profiles14:32
*** aufi has quit IRC14:32
shardydprince: there's a bug about that, I think we need to remove it and calculate the list in puppet-tripleo14:32
dprinceshardy: I don't like adding to all-nodes-config... but I need a quick (easy to backport) place to put these I think14:32
shardylike we already did for ceph14:32
dprinceshardy: yeah, that causes the puppet to be less ideal I'm afraid14:33
EmilienMdprince: yes14:33
EmilienMdprince: I did it in puppet tripleo already14:33
EmilienMdprince: let me find the patch14:33
shardyhttps://bugs.launchpad.net/tripleo/+bug/163282214:33
openstackLaunchpad bug 1632822 in tripleo "Must have a role named Controller running memcached when using custom roles due to hardcoded ControllerIpListMap" [High,Triaged]14:33
EmilienMdprince: https://github.com/openstack/puppet-tripleo/commit/494b9dfe952a47ac4dcc21acdec6c0adacf59a8b14:34
shardydprince: open to other ideas, but it shouldn't have a hard-coded reference to the ControllerIpListMap14:34
EmilienMshardy: ^14:34
EmilienMI would not fix it in THT neither14:34
dprinceshardy: what I'm suggesting could actually fix that14:34
shardyit should instead use the memcached_node_ips list we calculate for all roles14:34
EmilienMright14:34
dprinceshardy: I'm saying why not just keep memcached_ips in all-nodes-config14:34
shardydprince: we could do, but it's an ugly special case if we do that, having got pretty much every other service out of all-nodes-config14:35
EmilienMdprince: and compute the memcache paramameter in puppet-tripleo?14:35
dprinceshardy: we still have the IPv6 version there today, So why not move the IPv4 varient back... and add 2 more new version that have ports on them (via heats repeat function)14:35
dprinceEmilienM: I'm working on the compute one, yes14:35
dprinceEmilienM: I want it gone. I don't like it14:35
trozetshardy: I think that piece is OK.  I think there may be an issue with IP addresses.  The ovs/opendaylight.pp needs to know the physical IPs of everywhere ODL is running.14:35
dprinceshardy: well, it is either a special case in Heat or puppet-tripleo I'm afraid14:36
EmilienMdprince: I didn't mean "compute role", but "calculate the parameter"14:36
EmilienMdprince: have you seen https://github.com/openstack/puppet-tripleo/commit/494b9dfe952a47ac4dcc21acdec6c0adacf59a8b ?14:36
shardydprince: I don't think calculating the list is puppet-tripleo is a special case, it's just taking a generic list of IPs and putting it in the format needed by the service?14:36
trozetshardy:  I guess we could use opendaylight_api_node_ips14:36
shardythe puppet-tripleo layer seems like a reasonable place to do that but as I said open to other ideas14:37
dprinceEmilienM: I don't like those fixes because it forces us to use class instead of include14:37
shardywe tried pretty hard to unwire everything from all-nodes, so I'm kinda reluctant to go backwards, but whatever works I guess14:37
dprinceEmilienM: same here, http://git.openstack.org/cgit/openstack/puppet-tripleo/tree/manifests/profile/base/nova.pp#n5914:37
shardytrozet: we could, but should it actually be two manifests?14:38
shardye.g one that runs on the node running odl, and one which runs on those not running the service?14:38
trozetshardy: yeah thats what we have now I think14:38
EmilienMmwhahaha: wdyt about https://review.openstack.org/#/c/386761/1/manifests/profile/base/aodh.pp ?14:38
trozetshardy: are you saying it should be just 1?14:38
shardyhttps://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/neutron/opendaylight.pp14:39
dprinceshardy: I'll try to avoid all-nodes-config if I can. But the puppet-tripleo fixes are going to be larger I think14:39
EmilienMdprince: we agreed weeks ago to fix this problem in puppet-tripleo14:39
shardydprince: ack, well tbh I left that as a FIXME as I knew it was tricky, thanks for looking into it14:39
EmilienMand now we're going backward14:39
trozetshardy: yeah so we would just remove the odl_on_controller there and check if ODLHA is enabled if we add HA14:39
trozetshardy: so if you include odl_api it means you want to run ODL on that node14:40
trozetshardy: if you include odl_ovs it means just configure OVS on that node to point to ODL14:40
dprinceEmilienM: if that is the way we are going stand ready. All of the nova::keystone::authtoken parameters need to get ported into the profile modules properly I'm afraid14:40
dprinceEmilienM: in short, we move away from using puppet-nova hiera... and more towards puppet-tripleo hiera which I think is kind of sad14:40
trozetshardy: let me try removing all of this crap on my local setup14:40
shardytrozet: The way it's supposed to work is you add e.g OS::TripleO::OpenDaylight to the FooServices list for a role, and we then deploy the service on the role14:41
dprinceEmilienM: I'm actually wondering if these fixes below in puppet-nova/puppet-swift instead of in puppet-tripleo14:41
*** abehl has quit IRC14:41
trozetshardy: and see if I can get it to work.  Do you care if I add HA when I make the changes?14:41
shardytrozet: so there should never be any foo_enabled booleans, because the manifest simply isn't run on the roles which don't include it14:41
EmilienMdprince: I remember some cases were fixed in puppet-* modules14:41
trozetshardy: means allowing OVS to configure to 3 ODL controllers, and checking if ODL HA is enabled in that link you just sent14:41
shardytrozet: well it looks like we only conigure odl on the first controller atm?14:42
trozetshardy: right14:42
shardythe $primary_controller logic will still work for any role14:42
trozetshardy:  yeah ODL HA is not that stable, so thats why I didn't include it14:42
trozetshardy:but i guess it could be 2 patches, refactor the stuff per your comments and pick that to stable/newton.  Then push another patch to add ODL HA to master only?14:43
shardytrozet: ack, I think the special-case for one node is OK for now, and we can do it via the bootstrap_nodeid14:43
shardytrozet: yeah, that sounds like a good compromise14:43
shardythanks!14:43
EmilienMdprince: I agree that it's sad to leave includes.14:44
trozetshardy: ok cool.  For ODL HA onto master...kind of a new feature.  Can I push that without a LP#?14:44
shardytrozet: please raise a LP bug or blueprint and target it to ocata14:44
shardyso we can track the work and help get it reviewed14:44
trozetshardy: ok thanks14:44
EmilienMdprince: i'm open to a better approach if you have one14:44
trozetshardy, EmilienM: is tripleoci fixed now?14:45
EmilienMtrozet: yes14:45
trozetcool14:45
dprinceEmilienM: a better approach is to use the new heat conditionals and set these directly via hiera14:45
EmilienMdprince: is it supported in Newton?14:46
EmilienMit sounds risky to me to fix it that way at this stage of the release14:46
shardyconditionals are supported in newton, we're already using them14:47
EmilienMok14:47
trozetshardy: just to confirm, the composable role will be able to set opendaylight_api_node_ips and opendaylight_api_vip, right?14:48
dprinceEmilienM: yep, no rish in using them now. I need to find the right place to put them in Heat though. I have an idea I'd like to pursue though14:48
dprincerisk14:48
shardytrozet: yup, that's all wired in automatically now14:48
trozetshardy: ok great14:48
EmilienMbeagles: commented https://review.openstack.org/#/c/386761/14:48
EmilienMdprince: cool thanks14:49
*** dprince has quit IRC14:49
*** dmsimard is now known as dmsimard|afk14:49
openstackgerritMerged openstack/tripleo-puppet-elements: Update git commit sources for Midonet element  https://review.openstack.org/38305814:52
openstackgerritMerged openstack/tripleo-common: Port Scale Down Functionality into Workflow  https://review.openstack.org/38270714:57
*** lucas-hungry is now known as lucasagomes14:58
openstackgerritMerged openstack/instack-undercloud: Tune number of workers for undercloud  https://review.openstack.org/38669615:02
*** pcaruana has joined #tripleo15:03
*** ealcaniz has quit IRC15:04
*** penick has quit IRC15:05
*** akuznetsov has quit IRC15:09
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Fix running deployment routing check  https://review.openstack.org/38751915:09
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Add disabled links styling  https://review.openstack.org/38752015:09
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Fix cert/key input  https://review.openstack.org/38752115:09
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Add central logging  https://review.openstack.org/38752215:09
EmilienMmwhahaha: do you want to backpor tthe worker thing?15:10
mwhahahayes15:10
openstackgerritAlex Schultz proposed openstack/instack-undercloud: Tune number of workers for undercloud  https://review.openstack.org/38752315:10
EmilienMmwhahaha: +215:10
openstackgerritMerged openstack/tripleo-ui: Provide roles network configuration  https://review.openstack.org/38728515:11
mwhahahaEmilienM: review.rdoproject.org having issues? http://logs.openstack.org/60/386760/1/check/gate-tripleo-ci-centos-7-nonha-multinode/9a97e1a/console.html#_2016-10-17_14_21_26_85145915:12
*** ebarrera has quit IRC15:12
*** limao_ has quit IRC15:12
EmilienMmwhahaha: it's down for maintainance without announcement15:12
mwhahahaglorious15:13
EmilienMmwhahaha: but CI jobs should not fail now15:13
EmilienMmwhahaha: because they redirected to github now15:13
*** jlinkes has quit IRC15:15
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Provide roles network configuration  https://review.openstack.org/38752715:17
trozetshardy: the one pitfall I see is with the VIP.  So if we deploy a composable role on an external node, we will be able to give it a VIP or set opendaylight_api_vip to be it's address as output.  That is OK?15:20
*** chandankumar has quit IRC15:21
shardytrozet: opendaylight_api_vip will be set to the vip for the network defined for the service in the ServiceNetMap15:22
shardydoes that work OK for you?15:22
trozetshardy: I don't think that will work15:22
trozetshardy: because the ODL node will be a  separate node from the controller cluster15:23
trozetshardy: and the VIP will be on the controllers right?15:23
shardytrozet: yes, that's fine, I think we just need to wire that node in via haproxy15:23
jtomasekjpich: when you create a new plan (by uploading tht), browse to ControllerRole config and to Keystone service, what is the value of KeystoneWorkers parameter?15:23
shardysame as for all other api services15:23
trozetshardy: yeah i guess it could still go through haproxy on controller and load balance to the external ODL node15:23
shardyhttps://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy.pp#L113915:24
trozetshardy: ok that will work15:24
jpichjtomasek: Lemme check now15:24
shardytrozet: so yeah, I think that should just work15:24
trozetshardy: cool.  I made the necessary changes.  Now going to test it on my setup15:25
shardytrozet: great, sounds good, thanks! :)15:25
openstackgerritBrent Eagles proposed openstack/puppet-tripleo: Add port to rabbitmq node ip list  https://review.openstack.org/38676115:25
*** rcernin has quit IRC15:26
openstackgerritBrad P. Crochet proposed openstack/tripleo-common: Refresh DeployIdentifier as well on update  https://review.openstack.org/38753115:28
EmilienMthrash: where is -x option ? ^15:29
thrashEmilienM: huh? -x?15:29
EmilienMthrash: git cherry-pick -x15:29
thrashI did it via gerrit...15:29
thrash:(15:29
EmilienMoh you used Gerrit UI and the patch is not merged yet in master https://review.openstack.org/#/c/386617/15:29
thrashOh... Is that why it won't do it?15:30
thrashThat's silly.15:30
thrashBut I guess not that silly15:30
shardyyou can click cherry-pick again after the patch merges and it adds the -x option15:30
thrashshardy: cool.15:30
EmilienMright15:30
paramiteHey guys, is gate-tripleo-ci-centos-7-nonha-multinode-updates-nv supposed to succeed or I can stop with recheck athttps://review.openstack.org/#/c/384904/ ?15:31
openstackgerritTim Rozet proposed openstack/puppet-tripleo: Removes logic dependent on 'odl_on_controller'  https://review.openstack.org/38753215:31
thrashparamite: it's non-voting15:31
jpichjtomasek: It's set to "%{::processorcount}" (double-quotes included) after creating with the latest newton tht which... means it should work then??15:32
paramitethrash, I know, I just want to avoid situation of not getting review done without all jobs green15:32
EmilienMit's non voting, but supposed to pass most of the times.15:32
jtomasekjpich: ok, I see where the problem is now. in GUI we try to JSON.parse parameter values, so json or array values are not passed as strings but as objects15:33
paramiteEmilienM, so I should proceed woth rechecking I suppose15:33
thrashparamite: it would warrant at least a look to see if it is your patch that is causing that non-voting job to fail15:33
EmilienMparamite: let me check15:33
EmilienMparamite: have you read logs?15:33
paramiteEmilienM, thrash: Monitoring is turned off be default, so I'm 100% sure it's not my patch :)15:33
jpichjtomasek: Ah? Will it be easy to fix?15:34
EmilienMparamite: so it's good15:34
jtomasekjpich: hopefully15:34
paramiteEmilienM, great, thanks15:34
jpichjtomasek: Fwiw while at the hackfest I definitely saw people writing in JSON dictionaries in order to modify some of the puppet configuration so, that's gonna come up too :)15:35
jpichjtomasek: Yay! :)15:35
openstackgerritTim Rozet proposed openstack/tripleo-heat-templates: Removes EnableODL heat parameter and fixes missing local_ip param  https://review.openstack.org/38679115:36
EmilienMthrash: can you look https://review.openstack.org/#/c/383696/ please?15:37
openstackgerritAlejandro Andreu proposed openstack/tripleo-puppet-elements: Separate Datastax repository from the Midonet one  https://review.openstack.org/38305715:38
openstackgerritAlejandro Andreu proposed openstack/tripleo-puppet-elements: Installs more packages with the Midonet element  https://review.openstack.org/38305615:38
thrashEmilienM: ack15:40
thrashEmilienM: thankfully I had already reviewed that. :)15:43
EmilienMthrash: thanks15:44
*** tremble has quit IRC15:46
*** jistr is now known as jistr|biab15:46
*** aufi has joined #tripleo15:49
*** cylopez has quit IRC15:50
*** athomas has quit IRC15:51
*** david-lyle_ has joined #tripleo15:52
*** david-lyle has quit IRC15:53
*** hogepodge has joined #tripleo15:53
*** ctayal has joined #tripleo15:53
*** athomas has joined #tripleo15:56
*** mandre has quit IRC15:59
*** weshay is now known as weshay_brb16:00
openstackgerritGuil Barros proposed openstack/tripleo-heat-templates: Fix api_extensions_path in neutron-opencontrail environment  https://review.openstack.org/38754416:02
*** rbrady is now known as rbrady-afk16:06
*** ctayal has quit IRC16:06
*** rcernin has joined #tripleo16:10
*** ealcaniz has joined #tripleo16:11
*** ealcaniz has quit IRC16:11
*** dtrainor has joined #tripleo16:12
*** ohnoitsme has quit IRC16:12
*** abehl has joined #tripleo16:13
*** zaneb has quit IRC16:13
*** dprince has joined #tripleo16:14
*** mandre has joined #tripleo16:15
*** newmember has quit IRC16:17
*** jpich has quit IRC16:18
*** arxcruz has joined #tripleo16:19
*** zoliXXL is now known as zoli|gone16:20
*** zoli|gone is now known as zoli_gone-proxy16:21
*** dtrainor has quit IRC16:21
*** dtrainor has joined #tripleo16:22
*** jistr|biab is now known as jistr16:22
*** david-lyle_ is now known as david-lyle16:24
*** abehl has quit IRC16:25
*** numans has quit IRC16:26
*** rbowen has quit IRC16:27
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: JSON Parse only object and array parameter values  https://review.openstack.org/38755716:27
*** rbowen has joined #tripleo16:27
*** jtomasek has quit IRC16:28
*** cylopez has joined #tripleo16:28
*** dprince has quit IRC16:28
*** dmsimard|afk is now known as dmsimard16:28
*** dprince has joined #tripleo16:29
*** zaneb has joined #tripleo16:29
openstackgerritMerged openstack/tripleo-common: Fetch the snmpd_readonly_user_password from the Mistral environment  https://review.openstack.org/38369616:32
*** bana_k has joined #tripleo16:33
*** paramite has quit IRC16:34
*** ctayal has joined #tripleo16:34
*** abregman has joined #tripleo16:34
*** lmiccini has quit IRC16:39
openstackgerritDan Trainor proposed openstack/puppet-tripleo: Enable communication between UI and the Undercloud by making HAProxy proxy for the UI  https://review.openstack.org/38681716:40
*** trown is now known as trown|lunch16:43
*** phpcodemonkey has quit IRC16:43
*** abregman is now known as abregman|afk16:43
*** derekh has quit IRC16:44
*** penick has joined #tripleo16:46
*** weshay_brb is now known as weshay16:47
*** Goneri has quit IRC16:49
*** aufi has quit IRC16:50
*** myoung is now known as myoung|lunch16:50
*** pkovar has quit IRC16:52
*** jeckersb is now known as jeckersb_gone16:53
*** masco has quit IRC16:54
*** b00tcat has quit IRC16:54
*** jaosorior has quit IRC16:57
*** penick has quit IRC16:57
*** amoralej is now known as amoralej|off16:57
*** rbrady-afk is now known as rbrady16:58
*** flepied has quit IRC16:59
openstackgerritMerged openstack/puppet-tripleo: packages: run upgrade at 'setup' stage  https://review.openstack.org/38745616:59
openstackgerritMerged openstack/tripleo-common: Refresh DeployIdentifier as well on update  https://review.openstack.org/38661716:59
openstackgerritBrent Eagles proposed openstack/puppet-tripleo: Add port to rabbitmq node ip list  https://review.openstack.org/38676117:01
*** mgould is now known as mgould|afk17:01
*** beekneemech has quit IRC17:02
*** bana_k has quit IRC17:02
*** penick has joined #tripleo17:03
*** electrofelix has quit IRC17:03
*** jtomasek has joined #tripleo17:04
*** jaosorior has joined #tripleo17:06
*** jtomasek has quit IRC17:06
*** jtomasek has joined #tripleo17:06
*** pmannidi has joined #tripleo17:07
*** bnemec has joined #tripleo17:07
*** newmember has joined #tripleo17:08
*** ohamada_ has quit IRC17:09
*** pmannidi has quit IRC17:11
*** tiswanso has quit IRC17:12
*** tiswanso has joined #tripleo17:13
d0ugalEmilienM, thrash - I think we probably need this: https://review.openstack.org/#/c/386558/17:14
d0ugalEmilienM, thrash - otherwise a second undercloud install will break AFAICT17:14
*** tosky has quit IRC17:15
openstackgerritMerged openstack/tripleo-ui: Fix running deployment routing check  https://review.openstack.org/38751917:16
openstackgerritMerged openstack/tripleo-ui: Add disabled links styling  https://review.openstack.org/38752017:16
openstackgerritMerged openstack/tripleo-ui: Fix cert/key input  https://review.openstack.org/38752117:16
openstackgerritMerged openstack/tripleo-ui: Add central logging  https://review.openstack.org/38752217:16
openstackgerritMerged openstack/tripleo-ui: Provide roles network configuration  https://review.openstack.org/38752717:17
openstackgerritDougal Matthews proposed openstack/tripleo-common: Fetch the snmpd_readonly_user_password from the Mistral environment  https://review.openstack.org/38532317:17
rhalliseyd0ugal, I also hit that17:20
rhallisey+117:21
*** jeckersb_gone is now known as jeckersb17:21
*** rwsu has joined #tripleo17:22
*** jpena is now known as jpena|off17:23
*** rwsu has left #tripleo17:24
*** newmember has quit IRC17:24
*** paramite has joined #tripleo17:26
*** rwsu_ has joined #tripleo17:29
*** rwsu_ is now known as rwsu17:29
openstackgerritMerged openstack/tripleo-ui: JSON Parse only object and array parameter values  https://review.openstack.org/38755717:31
*** tiswanso has quit IRC17:31
*** trown|lunch is now known as trown17:31
*** tiswanso has joined #tripleo17:31
thrashbnemec: https://review.openstack.org/#/c/387405/17:33
thrashbnemec: tested the image thing. :)17:33
shardyAH00526: Syntax error on line 26 of /etc/httpd/conf.d/10-nova_api_wsgi.conf17:34
shardyseen that, and again on a freshly installed undercloud with new images17:34
shardythere was a nova change related to process count IIRC, are we waiting on current-tripleo promotion or something?17:35
* shardy doesn't see a pin in CI17:35
dtrainorthere was a change17:36
dtrainorhttps://bugs.launchpad.net/bugs/163200717:37
openstackLaunchpad bug 1632007 in tripleo "Failed deployment due to Hiera resolution of keystone::wsgi::apache::workers" [High,Fix released] - Assigned to Jiri Tomasek (jtomasek)17:37
dtrainorshardy, what does the line look like?  i don't have an environment at this very moment17:38
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: JSON Parse only object and array parameter values  https://review.openstack.org/38758617:39
jtomasekflorianf: ^ please17:40
*** flepied has joined #tripleo17:40
shardydtrainor: thanks, this is via the CLI, and I have https://review.openstack.org/#/c/385078/ applied17:40
shardydtrainor: the problem is the config still has processes=017:40
shardysetting it to 1 allows httpd to start17:40
d0ugalshardy: Do you have a moment to review https://review.openstack.org/#/c/386558/ ?17:41
*** jaosorior has quit IRC17:41
d0ugalor slagle (since you looked at the first patch) ^17:42
shardyI suspect we're not seeing it in CI because of https://github.com/openstack/tripleo-heat-templates/blob/master/environments/low-memory-usage.yaml#L917:42
*** jaosorior has joined #tripleo17:42
shardymaybe there's an issue with the patch from dprince17:42
*** dprince has quit IRC17:42
shardyd0ugal: ack will do17:42
bnemecshardy: Yeah, my local deployments were failing all day Friday too, and I saw someone mention that there was something wrong with our Apache WSGI config as a result of the 0 worker count change.17:43
*** dprince has joined #tripleo17:43
florianfjtomasek: done17:43
shardyWSGIDaemonProcess nova-api group=nova processes=0 threads=2 user=nova17:43
shardyshould be17:43
shardyWSGIDaemonProcess nova-api group=nova processes=1 threads=2 user=nova17:44
shardyin /etc/httpd/conf.d/10-nova_api_wsgi.conf17:44
d0ugalshardy: Thanks.17:44
shardyseems like the tht patch doesn't work or there's some other problem17:44
*** ayoung has joined #tripleo17:45
shardyhiera nova::wsgi::apache::workers returns 017:45
slagled0ugal: is APIException as specific as we can get there?17:45
slagled0ugal: or could we catch a NotFound or something17:46
*** Goneri has joined #tripleo17:46
*** jaosorior has quit IRC17:51
*** paramite has quit IRC17:51
openstackgerritMerged openstack/tripleo-ui: JSON Parse only object and array parameter values  https://review.openstack.org/38758617:56
*** penick has quit IRC17:59
openstackgerritMerged openstack/puppet-tripleo: Move heat domain/user creation into keystone profile  https://review.openstack.org/38728818:01
openstackgerritMerged openstack/tripleo-heat-templates: glance_multiple_locations when NovaEnableRbdBackend=true  https://review.openstack.org/38718618:02
*** dtantsur is now known as dtantsur|afk18:02
*** penick has joined #tripleo18:03
openstackgerritJoe Talerico proposed openstack/puppet-tripleo: WIP : OVN to use controller IP as OVNDB host  https://review.openstack.org/38759418:04
jtomasekhonza: this does not work any more https://github.com/openstack/tripleo-common/blob/master/tripleo_common/actions/parameters.py#L13118:11
jtomasekhonza: the parameters never get updated18:11
honzajtomasek: oh?18:11
*** kjw3 has joined #tripleo18:11
jtomasekhonza: could it be that self.parameters gets overwriten by parameters from __init__ in UpdateParametersAction?18:12
jtomasekhonza: (line 103)18:13
*** cylopez has quit IRC18:13
honzajtomasek: yeah, line 123 sets it to None18:14
*** ctayal has quit IRC18:14
honzajtomasek: i have no recollection of writing this code :)18:15
jtomasekhonza: do you have time to file a bug, fix it and send a patch, this is critical bug which breaks GUI18:15
*** rhallisey has quit IRC18:16
honzajtomasek: yes, i can probably do it today but it will have to be later (in like 4h)18:16
jtomasekhonza: np, would be good if we could review it tomorrow morning and hopefully merge before rc318:17
honzajtomasek: i'll do my best to have the patch ready for when you wake up18:17
jtomasekhonza: thanks!18:18
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add apache workers to nova-api conditional  https://review.openstack.org/38759818:18
shardybnemec: ^^ FYI that fixes the issue I was seeing18:18
*** shardy is now known as shardy_afk18:19
*** ctayal has joined #tripleo18:21
trozetshardy: I tested the patches and they work.  Please see if this is what you had in mind: https://review.openstack.org/#/c/387532/1 https://review.openstack.org/#/c/386791/18:22
*** jcoufal has quit IRC18:23
*** cschwede|mtg is now known as cschwede18:23
*** yamahata has joined #tripleo18:28
*** Guest21077 has quit IRC18:29
*** dprince has quit IRC18:32
*** dprince has joined #tripleo18:32
openstackgerritJames Slagle proposed openstack/tripleo-common: Refresh DeployIdentifier as well on update  https://review.openstack.org/38753118:36
*** owalsh has quit IRC18:48
openstackgerritDan Prince proposed openstack/puppet-tripleo: Set memcached_servers for nova API  https://review.openstack.org/38762418:49
*** rhallisey has joined #tripleo18:49
EmilienMd0ugal: ack18:50
gregworkfultonj: hey, what configs did you say were relevant to troubleshooting why ceph client configs are not being done on compute/control nodes ?18:50
dprinceEmilienM: t-h-t fix didn't work out :/. So ^^^ should handle the memcached servers issue18:50
dprinceEmilienM: that one is a regression... but I'm going to set these for other services too for ocata18:51
gregworkfultonj: im running openstack-tripleo-heat-templates-2.0.0-34.el7ost ..18:51
openstackgerritJohn Fulton proposed openstack/tripleo-specs: Integrate TripleO with Tendrl for External Storage Deployment/Management  https://review.openstack.org/38763118:51
EmilienMdprince: ok i'll look shortly18:51
cmysterseems like I hit sometihng here: http://paste.openstack.org/show/586011/18:56
cmysterdid anyone see something like that before ? ^18:56
openstackgerritOpenStack Proposal Bot proposed openstack/python-tripleoclient: Updated from global requirements  https://review.openstack.org/37512518:56
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements  https://review.openstack.org/38114818:57
EmilienMdprince: do we need to sanitize the ipv6?18:57
EmilienMdprince: like I did in https://github.com/openstack/puppet-tripleo/commit/494b9dfe952a47ac4dcc21acdec6c0adacf59a8b18:58
dprinceEmilienM: we aren't for ::nova::cache18:58
*** rajinir has joined #tripleo18:58
dprinceEmilienM: if we do I think that is a separate issue18:58
EmilienMlike suffix(any2array(normalize_ip_for_uri($memcache_servers)), ":${memcache_port}")18:58
dprinceEmilienM: and we probably need to do it in nova.pp and nova/api.pp alike18:58
*** cwolferh has joined #tripleo18:59
EmilienMdprince: it would be great to have an unit test18:59
EmilienMlike I did with swift proxy18:59
*** morazi has quit IRC18:59
EmilienMat least we can know we're doing what we expect19:00
*** pblaho has quit IRC19:00
dprinceEmilienM: yeah. It would also be great if puppet-nova just did what we needed here :/19:00
fultonjgregwork: tripleo should configure the ceph client for you and the ceph.conf of your clients should reflect what is recommended by Ceph in http://docs.ceph.com/docs/master/rbd/rbd-openstack/19:00
EmilienMdprince: well, do it in puppet-nova then19:00
dprinceEmilienM: maybe I will. I'm trying to make this one easy to back port19:01
gregworkfultonj: so thats not happening at all19:01
gregworktripleO provisions the overcloud, fully configures the ceph nodes / monitoring on control and initializes the disk .. like it is a ready to go storage deployment19:01
gregworkbut then fails to configure the compute/controler nodes to use it (cinder/glance)19:01
gregworkceph tree / ceph -s showing lots of goodness .. but cinder.conf/glance-api.conf are barren of any rbd/ceph config19:02
EmilienMdprince: I commented, with my feedback.19:02
fultonjgregwork: it could be that you didn't specify the required options in THT to get this done OR tripleO is failing to configure it. To determine which please share logs from ceph clinet server (e.g. compute) and your THT.19:03
gregworkwhere should i put them19:04
*** penick has quit IRC19:04
EmilienMslagle: can you also look https://review.openstack.org/#/c/387614/ ?19:05
EmilienMdprince: the problem with puppet-nova  now is that we give a single param that contains both ip and port. If we split it in puppet-nova we would leverage the sanitize in puppet-nova if you see what I mean19:07
EmilienMdprince: but for now, we do it in puppet-tripleo19:07
dprinceEmilienM: exactly, I would prefer all of this in puppet-* I think19:08
EmilienMdprince: you know what19:10
EmilienMdprince: let me do it in puppet-nova for ocata19:11
EmilienMdprince: I'm preparing a patch this afternoon19:11
EmilienMdprince: please in the meantime fix tripleo master/newton (and i'll take care of updating it later)19:11
*** tiswanso has quit IRC19:11
fultonjgregwork: http://docs.openstack.org/infra/system-config/paste.html19:12
*** tiswanso has joined #tripleo19:12
EmilienMdprince: does it work for you?19:12
dprinceEmilienM: yep19:13
gregworkfultonj: ok ill start preparing this as a paste19:13
EmilienMdprince: ack. I'll let you know when I submit a change in puppet-nova. ASAP19:14
*** yamahata has quit IRC19:14
*** penick has joined #tripleo19:23
fultonjgregwork: you might just start with your THT19:24
gregworkok i have that .. was trying to figure out how to get the messages file to you19:25
gregworksince its kinda big19:25
fultonjgregwork: yeah, you wouldn't want to drop the whole thing in just the relevant part19:25
*** cylopez has joined #tripleo19:25
*** Guest40693 is now known as rook19:25
gregworkpaste.openstack.org/show/586015/19:26
*** mcornea has quit IRC19:26
gregworklet me know if you need more, but that was the most relevant templates i guess19:27
openstackgerritDan Prince proposed openstack/puppet-tripleo: Set memcached_servers for nova API  https://review.openstack.org/38762419:31
weshayd0ugal, question re: https://github.com/openstack/python-tripleoclient/blame/master/tripleoclient/workflows/plan_management.py#L12419:31
weshaywe are seeing an error "Unable to create plan. A container with the name overcloud already exists." on some fresh deployments, is that possible or maybe just a red herring?19:32
*** abregman|afk is now known as abregman19:32
*** ctayal has quit IRC19:33
d0ugalweshay: it could be possible. I'd be interested in seeing the mistral logs, specifically the executor log.19:33
d0ugalweshay: you might be seeing: https://bugs.launchpad.net/tripleo/+bug/163419519:33
openstackLaunchpad bug 1634195 in tripleo "Creating the default plan can fail when communicating with swift. It should be retried" [Medium,Confirmed]19:33
weshaycool /me checks19:34
weshaymyoung|lunch, ^19:34
*** ccamacho has quit IRC19:34
*** jcoufal has joined #tripleo19:34
*** myoung|lunch is now known as myoung19:34
*** rasca has quit IRC19:35
gregworkfultonj: were there any other files you needed me to prepare ?19:36
fultonjgregwork: not that i see for now, i need to take care of seomthing else for a deadline at the moment19:37
gregworkalright19:37
weshayd0ugal, ya.. looks like it.. https://thirdparty-logs.rdoproject.org/jenkins-tripleo-quickstart-periodic-newton-delorean-ha-12/undercloud/var/log/mistral/engine.log.gz#_2016-10-17_17_24_15_43219:38
*** akuznetsov has joined #tripleo19:38
d0ugalweshay: This is the bit: https://thirdparty-logs.rdoproject.org/jenkins-tripleo-quickstart-periodic-newton-delorean-ha-12/undercloud/var/log/mistral/executor.log.gz#_2016-10-17_17_24_15_34119:39
d0ugalweshay: so it is the same19:39
weshaymburned, ^19:39
weshayd0ugal, thank you!19:39
weshayd0ugal, seems to only happen in HA deployments for us btw19:40
d0ugalweshay: interesting.19:40
d0ugalweshay: I think the problem is that the plan creation fails mid-way, and thus you have a corrupt plan.19:40
d0ugalso we either need to find a way to cleanup better or ensure it finishes19:40
myoungaye...i also have 2 nodes at this fail state taken offline...one with a centos based image, the other with RHEL, same delorean hash19:40
d0ugalweshay: I can look into this tomorrow19:40
d0ugalor maybe rbrady can now19:40
*** akuznetsov has quit IRC19:42
*** lucasagomes is now known as lucas-afk19:43
openstackgerritJoe Talerico proposed openstack/puppet-tripleo: WIP : OVN to use controller IP as OVNDB host  https://review.openstack.org/38759419:43
openstackgerritDougal Matthews proposed openstack/instack-undercloud: Only create the Mistral config env if it doesn't exist  https://review.openstack.org/38655819:44
trozetEmilienM: I see the same CI failure from the weekend with this patch https://review.openstack.org/#/c/386737/ (stable/newton).  Do I just need to rebase?19:48
*** milan is now known as milan-afk19:48
EmilienMtrozet: yes19:49
EmilienMor recheck19:49
trozetEmilienM: i had just rechecked like an hour ago, so will try rebase19:50
openstackgerritTim Rozet proposed openstack/tripleo-heat-templates: Fixes missing provider mappings for OpenDaylight  https://review.openstack.org/38673719:50
*** ccamacho has joined #tripleo19:51
EmilienMtrozet: let me know19:51
*** yamahata has joined #tripleo19:52
*** jayg is now known as jayg|g0n319:57
trozetEmilienM: could you review it for me?19:58
EmilienMtrozet: sure19:59
*** bana_k has joined #tripleo20:00
*** yamahata has quit IRC20:00
trozetEmilienM: i have like 4 or 5 that need review...if you have time20:01
trozetEmilienM: some are 1 or 2 line changes20:01
EmilienMtrozet: paste links here I'll look as soon as I can20:01
*** kjw3 has quit IRC20:03
*** trown is now known as trown|afk20:03
*** rbowen has left #tripleo20:05
*** dsneddon is now known as dsneddon_20:07
leifmadsenhey all -- trying to update the TripleO docs for the basic_deployment_cli.rst file, and wondering if anyone here has underclouds deployed that they can validate syntax for me with the openstack client for Mitaka and Liberty?20:07
leifmadsenI think these neutron subnet-create commands are fairly out of date now20:07
leifmadsenbut I think they changed again in Newton, and I only have a Newton undercloud right now20:08
leifmadsenalso I think these commands are just crazy out of date, and not entirely sure how much I should deal with attempting to document for the older versions20:14
*** Slower_ is now known as Slower20:16
*** dsneddon has joined #tripleo20:21
*** pcaruana has quit IRC20:25
openstackgerritJustin Kilpatrick proposed openstack/tripleo-quickstart: Add documentation for add-on roles  https://review.openstack.org/34673320:26
*** trown|afk is now known as trown20:28
*** ctayal has joined #tripleo20:29
*** yamahata has joined #tripleo20:30
*** ebarrera has joined #tripleo20:31
*** bfournie has quit IRC20:33
openstackgerritEmilien Macchi proposed openstack/tripleo-specs: Propose TripleO Squads policy  https://review.openstack.org/38520120:37
*** kjw3 has joined #tripleo20:41
openstackgerritLeif Madsen proposed openstack/tripleo-docs: Update basic deployment commands for Newton  https://review.openstack.org/38767120:41
openstackgerritJoe Talerico proposed openstack/puppet-tripleo: WIP : OVN to use controller IP as OVNDB host  https://review.openstack.org/38759420:43
*** jprovazn has quit IRC20:47
stevebakershardy_afk: I've found a problem with that env file resolution fix https://bugs.launchpad.net/tripleo/+bug/163426020:47
openstackLaunchpad bug 1634260 in tripleo "Missing get_file files don't cause deploy failures" [Undecided,New]20:47
dhill_https://bugs.launchpad.net/tripleo/+bug/163420220:48
openstackLaunchpad bug 1634202 in tripleo "Failure to introspect new nodes using RDO Newton on RHEL" [Undecided,New]20:48
weshayEmilienM++20:48
weshayreally nice proposal20:48
EmilienMweshay: cool20:49
*** tobias_fiberdata has joined #tripleo20:51
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Modify the constraint to allow single quote for DPDK core list param  https://review.openstack.org/38767620:54
*** yamahata has quit IRC20:55
*** yamahata has joined #tripleo20:55
*** trown is now known as trown|outtypewww20:55
openstackgerritEmilien Macchi proposed openstack/tripleo-common: Port Scale Down Functionality into Workflow  https://review.openstack.org/38767820:55
EmilienMrbrady: ^20:55
openstackgerritFlorian Fuchs proposed openstack/tripleo-ui: Add deployment cancellation/deletion  https://review.openstack.org/38735520:56
dhill_https://bugs.launchpad.net/tripleo/+bug/163420220:57
openstackLaunchpad bug 1634202 in tripleo "Failure to import new nodes using RDO Newton on RHEL" [Undecided,New]20:57
dhill_and Ocata and RHOSP1020:57
dhill_this looks like mistral is not retrying when it's locked?20:57
openstackgerritFlorian Fuchs proposed openstack/tripleo-ui: Add deployment cancellation/deletion  https://review.openstack.org/38735521:00
*** kjw3 has quit IRC21:03
*** florianf has quit IRC21:06
*** lblanchard has quit IRC21:06
*** jcoufal has quit IRC21:09
openstackgerritJohn Fulton proposed openstack/tripleo-specs: Integrate TripleO with Tendrl for External Storage Deployment/Management  https://review.openstack.org/38763121:13
*** dprince has quit IRC21:17
*** r-mibu has quit IRC21:19
*** r-mibu has joined #tripleo21:19
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Include ceilometer in swift proxy pipeline  https://review.openstack.org/37195021:19
*** athomas has quit IRC21:23
*** ebarrera has quit IRC21:25
*** newmember has joined #tripleo21:25
*** x220_ has joined #tripleo21:26
*** rhefner has quit IRC21:27
*** rhefner has joined #tripleo21:29
*** newmember has quit IRC21:29
EmilienMI see an high rate of failures in stable/newton for multinode job21:31
EmilienMwith the same error every time21:33
EmilienMError: Could not start Service[httpd]: Execution of '/usr/bin/systemctl start httpd' returned 1: Job for httpd.service failed21:33
dhill_EmilienM, I see a "I can't import new nodes" consistently since Newton :)21:34
openstackgerritSteve Baker proposed openstack/tripleo-heat-templates: Docker compute, use role based config.  https://review.openstack.org/38769121:37
*** tobias_fiberdata has quit IRC21:41
EmilienMdhill_: have you filed a bug?21:41
dhill_EmilienM, yes21:41
EmilienMdhill_: link?21:41
dhill_EmilienM, https://bugs.launchpad.net/tripleo/+bug/163420221:42
openstackLaunchpad bug 1634202 in tripleo "Failure to import new nodes using RDO Newton on RHEL" [Undecided,New]21:42
dhill_EmilienM, it was working before this is a new issue21:42
*** abregman is now known as abregman|afl21:42
*** abregman|afl is now known as abregman|afk21:42
EmilienMdhill_: I triaged it21:43
EmilienMI'll see if I can get some eyes on it21:43
*** tobias_fiberdata has joined #tripleo21:43
dhill_EmilienM, I also have this issue with RHOSP 10 since last build21:43
EmilienMdhill_: it's out of context of tripleo, where we talk about upstream repo shere21:44
*** ebarrera has joined #tripleo21:44
*** nyechiel has joined #tripleo21:44
*** shardy_afk has quit IRC21:44
dhill_ok21:45
weshaydhill_, can you paste the delorean hash from /etc/yum.repos.d/delorean.repo in that bug21:46
afazekasThis simple change https://review.openstack.org/#/c/386330/ looking for some attention21:48
*** ebarrera has quit IRC21:48
*** rwsu has quit IRC21:56
*** x220_ has quit IRC21:57
honzajtomasek: still around?21:59
*** rcernin has quit IRC22:06
honzajrist: have you seen the bug that jtomasek was talking about?  role counts not updating?  i can't reproduce22:08
*** weshay is now known as weshay_bbiab22:09
*** nyechiel has quit IRC22:10
*** social has quit IRC22:17
*** ctayal has quit IRC22:17
openstackgerritJohn Fulton proposed openstack/tripleo-specs: Integrate TripleO with Tendrl for External Storage Deployment/Management  https://review.openstack.org/38763122:21
openstackgerritPaul Belanger proposed openstack/diskimage-builder: Initial support for ansible-playbook  https://review.openstack.org/38560822:23
*** pmannidi has joined #tripleo22:27
*** tobias_fiberdata has quit IRC22:30
*** ctayal has joined #tripleo22:37
fultonjwhen proposing a spec do you normally edit the toctree outside of just the .rst file that contains your proposal?22:38
fultonjhttp://logs.openstack.org/31/387631/3/check/gate-tripleo-specs-docs-ubuntu-xenial/67dc8cf/console.html#_2016-10-17_22_23_26_59665122:38
fultonjgfidente: ^22:39
*** cylopez has quit IRC22:39
*** cylopez has joined #tripleo22:42
*** panda is now known as panda|Zz22:43
openstackgerritCyril Lopez proposed openstack/tripleo-heat-templates: Fix api_extensions_path in neutron-opencontrail environment  https://review.openstack.org/38770222:46
*** cylopez has quit IRC22:48
*** dsneddo__ has joined #tripleo23:02
*** dsneddon has quit IRC23:04
openstackgerritAlex Schultz proposed openstack/instack-undercloud: [donotmerge] ci test  https://review.openstack.org/38770723:09
*** penick has quit IRC23:21
*** ctayal has quit IRC23:26
openstackgerritJoe Talerico proposed openstack/puppet-tripleo: WIP : OVN to use controller IP as OVNDB host  https://review.openstack.org/38759423:29
*** ctayal has joined #tripleo23:36
*** rajinir has quit IRC23:36
openstackgerritJoe Talerico proposed openstack/puppet-tripleo: WIP : OVN to use controller IP as OVNDB host  https://review.openstack.org/38759423:38
*** chlong has joined #tripleo23:40
openstackgerritJoe Talerico proposed openstack/puppet-tripleo: WIP : OVN to use controller IP as OVNDB host  https://review.openstack.org/38759423:44
*** bfournie has joined #tripleo23:52
*** Goneri has quit IRC23:53
*** tiswanso has quit IRC23:53

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!