Monday, 2016-10-10

*** limao has joined #tripleo00:25
*** tiswanso has joined #tripleo00:43
*** tiswanso has quit IRC00:48
*** dmacpher has quit IRC00:57
*** xuao has joined #tripleo01:03
*** david-lyle_ has joined #tripleo01:04
*** david-lyle has quit IRC01:08
*** david-lyle_ is now known as david-lyle01:10
*** eggmaster has quit IRC01:14
*** mandre has quit IRC01:26
*** mandre has joined #tripleo01:26
*** jistr has quit IRC01:29
*** Tristitia has quit IRC01:29
*** jtomasek has quit IRC01:29
*** jtomasek has joined #tripleo01:34
*** jistr has joined #tripleo01:35
*** Tristitia has joined #tripleo01:36
*** yamahata has quit IRC02:07
*** dmacpher has joined #tripleo02:08
*** bana_k has joined #tripleo02:17
*** bana_k has quit IRC02:46
*** ebalduf has joined #tripleo02:50
*** coolsvap has joined #tripleo02:56
*** bana_k has joined #tripleo02:57
*** rhallisey has quit IRC03:06
*** david-lyle has quit IRC03:09
*** bana_k has quit IRC03:32
*** bfournie has quit IRC03:54
*** pmannidi_ is now known as pmannidi04:04
*** dmsimard is now known as dmsimard|pto04:23
*** pgadiya has joined #tripleo04:43
*** tiswanso has joined #tripleo04:45
*** abregman has joined #tripleo04:49
*** tiswanso has quit IRC04:51
*** nyechiel has joined #tripleo04:56
*** dsariel has joined #tripleo04:57
*** jaosorior has joined #tripleo05:07
*** jaosorior has quit IRC05:10
*** bana_k has joined #tripleo05:11
*** jaosorior has joined #tripleo05:11
*** mcornea has joined #tripleo05:19
jaosoriormcornea: hey dude, do you have a deployment with SSL around?05:25
mcorneajaosorior: hey, checking05:25
mcorneajaosorior: yep, I do05:26
jaosoriormcornea: if you got some extra cycles, can you verify if you can still reproduce this? https://bugzilla.redhat.com/show_bug.cgi?id=137001805:26
openstackbugzilla.redhat.com bug 1370018 in openstack-tripleo-heat-templates "When querying OpenStack APIs, the links that are returned by APIs are with an http:// and not https://" [Medium,New] - Assigned to jstransk05:26
mcorneajaosorior: http://paste.openstack.org/show/585127/05:29
jaosoriormcornea: was that overcloud or undercloud?05:29
mcorneajaosorior: it's the overcloud05:29
*** limao_ has joined #tripleo05:30
jaosoriormcornea: upstream or downstream?05:30
mcorneajaosorior: it's upstream tht05:30
jaosoriormcornea: thanks05:30
jaosoriormcornea: what about nova and cinder?05:30
jaosoriordo they have the same issue?05:31
mcorneajaosorior: the images are using the downstream build05:31
*** lazy_prince has quit IRC05:32
*** limao has quit IRC05:32
mcorneajaosorior: http://paste.openstack.org/show/585128/05:33
mcorneajaosorior: it looks it's doing the calls to https05:34
jaosoriormcornea: so that's not too bad05:35
jaosoriormcornea: do you know if nova has the same issue?05:35
mcorneajaosorior: in fact curl http://172.16.18.25:13696/v2.0/ returns curl: (52) Empty reply from server05:35
mcorneajaosorior: checking05:36
jaosoriormcornea: (sorry dude, I'm still deploying my environment :( )05:36
*** tzumainn has joined #tripleo05:37
mcorneajaosorior: http://paste.openstack.org/show/585129/05:40
jaosoriormcornea: alright. I think I know what the issue is. I think it will also be fine for cinder05:42
mcorneajaosorior: yeah: http://paste.openstack.org/show/585130/05:44
mcorneajaosorior: so why does neutron return http?05:44
jaosoriormcornea: so, nova and cinder use the http_proxy_to_wsgi middleware coming from oslo.middleware. It's enabled in TripleO with the enable_headers_parsing option. That one is the one that sets the https.05:45
jaosoriormcornea: neutron doesn't have that middleware, so I have to submit a patch.05:46
jaosoriormcornea: glance is using that middleware too05:47
mcorneajaosorior: oh, I see. So how come the client still does the connections over https?05:47
jaosoriormcornea: cause the client gets the base URL from the keystone endpoint05:47
jaosoriorwell, keystone catalog actually, which exposes the endpoints05:47
jaosoriorand the keystone catalog points to https05:47
mcorneajaosorior: gotcha05:48
jaosoriormcornea: just to be sure, can you verify that glance has the same behavior?05:48
mcorneajaosorior: ya http://paste.openstack.org/show/585132/05:49
*** hjensas_ has quit IRC05:49
jaosoriorfuck yeah05:50
jaosoriormcornea: mind if I mention that you verified this?05:50
mcorneajaosorior: sure, np05:50
jaosoriormcornea: thanks dude!05:51
mcorneajaosorior: aodh shows the same issue05:56
jaosoriormcornea: ok, adding it to the list05:58
mcorneajaosorior: ceilometer, heat-cfn and gnocchi as well06:00
jaosoriormcornea: the plot thickens06:01
jaosoriormcornea: so there is a bug https://bugs.launchpad.net/gnocchi/+bug/1590608 I didn't know about :D06:05
openstackLaunchpad bug 1590608 in OpenStack DBaaS (Trove) "Services should use http_proxy_to_wsgi middleware" [Undecided,In progress] - Assigned to Masaki Matsushita (mmasaki)06:05
*** rasca has joined #tripleo06:15
*** bana_k has quit IRC06:26
*** dmacpher has quit IRC06:31
*** jprovazn has joined #tripleo06:33
*** limao_ has quit IRC06:39
*** limao has joined #tripleo06:40
*** limao has quit IRC06:40
*** limao has joined #tripleo06:41
*** tremble has joined #tripleo06:41
*** rcernin has joined #tripleo06:48
*** pcaruana has joined #tripleo07:03
*** ebarrera has joined #tripleo07:04
*** tesseract has joined #tripleo07:06
*** tesseract is now known as Guest4972307:06
*** test-R has joined #tripleo07:10
*** dsneddon has joined #tripleo07:10
test-RHi, Is there a way to check the profile parameter on the overcloud node ? like hiera profile or something ?07:11
openstackgerritCarlos Camacho proposed openstack/tripleo-common: Default the J2 excludes files to safe values.  https://review.openstack.org/38432107:13
jaosoriortest-R: which profile parameter?07:13
test-Rjaosorior: for example, control, compute,,, etc07:14
openstackgerritCarlos Camacho proposed openstack/tripleo-common: Default the J2 excludes files to safe values.  https://review.openstack.org/38432107:14
*** Guest35658 is now known as leanderthal07:16
*** leanderthal is now known as leanderthal|afk07:16
*** panda|off is now known as panda07:16
jaosoriortest-R: not sure. The best people to answer that are not online yet :/07:18
*** hjensas_ has joined #tripleo07:18
*** hjensas_ has quit IRC07:18
*** hjensas_ has joined #tripleo07:18
pandajaosorior: is there any way to make this error more verbose ? http://logs.openstack.org/15/382515/8/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/eb50e31/console.html#_2016-10-07_19_41_53_920458 I repeated the steps to create certificate two times, and I don't know why verification fails. Mabe I'm missing a parameter in environments07:18
*** snecklifter has joined #tripleo07:18
jaosoriorpanda: I tried to access the logs you sent and I get "File not found"07:19
jaosoriorpanda: but usually no... OpenSSL gives terrible error messages like that :/07:19
jaosoriorpanda: we can inspect the cert you have though07:19
jaosoriorcan you pass the patch again?07:19
pandajaosorior: sure https://review.openstack.org/38251507:22
pandajaosorior: and here, logs were compressed in the meantime http://logs.openstack.org/15/382515/8/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/eb50e31/console.html.gz#_2016-10-07_19_41_56_77259007:23
jaosoriorpanda: I see07:24
jaosorioralright so07:24
jaosoriorpanda: using this: openssl x509 -in test-environments/overcloud-cacert-ipv4netiso.pem -noout -text07:24
*** bvandenh has joined #tripleo07:25
jaosoriorpanda: that will give you the output of what the cert was in the end07:25
jaosoriorthe CN is 10.0.0.1807:25
*** bana_k has joined #tripleo07:25
jaosoriorso that seems fine07:25
openstackgerritCarlos Camacho proposed openstack/tripleo-common: Default the J2 excludes files to safe values.  https://review.openstack.org/38432107:25
jaosoriorpanda: so the issue could be that the undercloud doesn't trust the certificate07:25
jaosoriorlet me check your patch again07:25
jaosoriorpanda: is there anywhere where we're doing the update-ca-trust extract in the undercloud?07:26
jaosoriorpanda: so, the deal is that you need to install/trust the CA cert in the undercloud07:26
jaosoriorelse it won't trust it and it will refuse to establish a connection07:26
jaosoriorpanda: that is the case07:27
jaosoriorlet me update the CR07:27
pandajaosorior: the job without net-iso didn't need one07:27
*** dbecker has joined #tripleo07:27
pandajaosorior: i thought it was done by one of the existing environments07:27
*** aufi has joined #tripleo07:27
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: [WIP] Add IPv6 coverage using existing jobs  https://review.openstack.org/38251507:30
jaosoriorpanda: https://review.openstack.org/#/c/382515/9/toci_instack_ovb.sh07:30
*** abregman_ has joined #tripleo07:30
*** abregman has quit IRC07:31
pandajaosorior: ah, there ... ca file07:31
pandajaosorior: thanks!07:32
*** cylopez has joined #tripleo07:33
snecklifterWho are the best people to chase on tripleo-docs reviews? https://review.openstack.org/#/c/380954/07:34
snecklifterjaosorior: thx07:36
*** tzumainn has quit IRC07:36
*** hewbrocca-afk is now known as hewbrocca07:36
*** b00tcat has joined #tripleo07:37
*** anshul has joined #tripleo07:37
openstackgerritMerged openstack/tripleo-docs: Fixes network name for tempest  https://review.openstack.org/38095407:37
sneckliftercylopez: thx07:38
*** jpich has joined #tripleo07:38
*** ccamacho has joined #tripleo07:38
*** ccamacho is now known as ccamacho|mtg07:39
openstackgerritCarlos Camacho proposed openstack/tripleo-common: Default the J2 excludes files to safe values.  https://review.openstack.org/38432107:40
cylopezsnecklifter: you're welcome, I like when people working around tempest .07:40
*** abregman_ has quit IRC07:41
*** abregman has joined #tripleo07:41
*** abregman has quit IRC07:42
*** abregman has joined #tripleo07:42
*** jpena|off is now known as jpena07:43
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: Implement overcloud upgrade job - Mitaka -> Newton  https://review.openstack.org/32375007:45
*** athomas has joined #tripleo07:53
*** athomas has quit IRC07:53
*** gfidente has joined #tripleo07:54
*** gfidente has quit IRC07:54
*** gfidente has joined #tripleo07:54
*** athomas has joined #tripleo07:54
*** zoli_gone-proxy is now known as zoliXXL07:54
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB  https://review.openstack.org/38109407:57
test-RHi, Is there a way to check the profile parameter on the overcloud node ? like hiera profile or something ? and it will return controller, compute, etc07:57
zoliXXLgood morning07:58
*** bana_k has quit IRC07:59
*** milan has joined #tripleo08:16
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart: Add ability to deploy an overcloud with ssl  https://review.openstack.org/38283008:17
b00tcattest-R: there's this hiera variable `nova::compute::enabled` that you might be interested in08:17
openstackgerritCarlos Camacho proposed openstack/tripleo-common: Default the J2 excludes files to safe values.  https://review.openstack.org/38432108:17
*** ccamacho|mtg is now known as ccamacho08:21
*** abregman_ has joined #tripleo08:26
*** ohamada has joined #tripleo08:29
*** abregman has quit IRC08:29
*** dtantsur|afk is now known as dtantsur08:32
*** mbozhenko has joined #tripleo08:36
*** leanderthal|afk has quit IRC08:39
b00tcatis the Jenkins job "gate-tripleo-ci-centos-7-ovb-ha" in this patch https://review.openstack.org/#/c/383058/ something that can be solved with a `recheck`?08:39
test-Rb00tcat, aha i see, but as for control and blockstorage, do we have anything ?08:43
*** chem` has joined #tripleo08:44
*** nyechiel has quit IRC08:46
*** dsneddon_1 has quit IRC08:46
*** jschluet has joined #tripleo08:48
*** timothyb89_ has joined #tripleo08:48
*** dsneddon_1 has joined #tripleo08:49
*** social_ has joined #tripleo08:49
*** Slower_ has joined #tripleo08:49
b00tcatthat I have no idea - I'm just deploying compute+controller as of now08:49
b00tcatbut I guess you'll find something grepping on /etc/puppet/hieradata test-R08:50
*** soc_off_ has joined #tripleo08:50
*** pleia2_ has joined #tripleo08:50
*** dsneddon has quit IRC08:50
jaosoriortest-R, if I may ask, what do you need that flag for?08:51
*** nyechiel has joined #tripleo08:51
*** amoralej_ has joined #tripleo08:53
*** andreaf_ has joined #tripleo08:53
*** athomas has quit IRC08:54
*** pcaruana has quit IRC08:54
*** dsariel has quit IRC08:54
*** xuao has quit IRC08:54
*** r-mibu has quit IRC08:54
*** social has quit IRC08:54
*** andreaf has quit IRC08:54
*** soc_off has quit IRC08:54
*** pleia2 has quit IRC08:54
*** jschlueter has quit IRC08:54
*** Slower has quit IRC08:54
*** dmanchad has quit IRC08:54
*** amoralej has quit IRC08:54
*** timothyb89 has quit IRC08:54
*** andreaf_ is now known as andreaf08:54
*** dmanchad has joined #tripleo08:57
*** nyechiel has quit IRC08:58
*** r-mibu has joined #tripleo09:00
*** pcaruana has joined #tripleo09:00
*** athomas has joined #tripleo09:01
*** radeks has joined #tripleo09:01
d0ugalo/09:01
*** dsariel has joined #tripleo09:01
openstackgerritCarlos Camacho proposed openstack/tripleo-common: Default the J2 excludes files to safe values.  https://review.openstack.org/38432109:03
openstackgerritMerged openstack/tripleo-heat-templates: Make step an integer on the pacemaker controller  https://review.openstack.org/38388409:06
*** abregman_ is now known as abregman09:07
openstackgerritDougal Matthews proposed openstack/instack-undercloud: Make the snmpd_readonly_user_password available to Mistral  https://review.openstack.org/38369409:09
pandawhere are we installing qemu-img-ev ? http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha-liberty/a87926b/logs/undercloud/var/log/undercloud_install.txt.gz#_2016-10-10_06_16_18_00009:12
*** zoliXXL is now known as zoli|lunch09:14
*** flaper87 has joined #tripleo09:19
*** lazy_prince has joined #tripleo09:21
*** Guest10079 is now known as zigo09:23
*** tosky has joined #tripleo09:27
*** snecklifter has quit IRC09:28
openstackgerritMerged openstack/tripleo-heat-templates: Add new environment for debug  https://review.openstack.org/38375309:30
*** lazy_prince has quit IRC09:30
*** panda is now known as panda|afk09:34
*** derekh has joined #tripleo09:36
*** shardy has joined #tripleo09:37
*** paramite has joined #tripleo09:37
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: Use Password Generation in the Mistral workflows  https://review.openstack.org/37554409:37
*** jaosorior has quit IRC09:38
*** shardy has quit IRC09:38
*** jaosorior has joined #tripleo09:38
*** shardy has joined #tripleo09:39
*** mbozhenko has quit IRC09:41
*** dsneddon has joined #tripleo09:50
openstackgerritMerged openstack/puppet-tripleo: Use Heat role *_enabled hiera to check Manila backends  https://review.openstack.org/38363209:50
openstackgerritAdriano Petrich proposed openstack/tripleo-heat-templates: GATE TEST, please ignore  https://review.openstack.org/36544909:53
*** amoralej_ is now known as amoralej10:00
*** nyechiel has joined #tripleo10:03
*** jistr is now known as jistr|mtg10:03
openstackgerritDougal Matthews proposed openstack/instack-undercloud: Make the snmpd_readonly_user_password available to Mistral  https://review.openstack.org/38369410:04
*** limao has quit IRC10:08
openstackgerrityolanda.robla proposed openstack/tripleo-quickstart: Create working dir in undercloud  https://review.openstack.org/38439710:09
*** nyechiel has quit IRC10:12
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: Save the result of direct action calls in Mistral  https://review.openstack.org/38173910:13
*** mbozhenko has joined #tripleo10:14
d0ugalIs the instack-undercloud log stored somewhere from CI runs?10:14
derekhd0ugal: this one? logs/undercloud/var/log/undercloud_install.txt.gz10:16
d0ugalderekh: yes! Thanks. Sorry, I was looking for the name "instack"10:16
derekhd0ugal: that would be too easy10:17
*** bfournie has joined #tripleo10:18
*** akrivoka has joined #tripleo10:18
*** akrivoka has quit IRC10:20
*** hewbrocca is now known as hewbrocca-afk10:20
*** akrivoka has joined #tripleo10:22
*** hewbrocca-afk is now known as hewbrocca10:24
openstackgerritMerged openstack/tripleo-common: Make UpdateManager use a passed-in stack setup  https://review.openstack.org/38370810:25
*** Guest2483 is now known as rook10:31
rookshardy: heya10:33
openstackgerritTomas Sedovic proposed openstack/tripleo-validations: Add a validation-specific Ansible output callback  https://review.openstack.org/37547710:33
*** chem has left #tripleo10:33
*** chem` has quit IRC10:33
test-Rb00tcat, aha thanks, I'll check10:36
test-Rjaosorior, because I need to run some deployment tasks in the heat templates and some steps are profile dependent10:40
*** chem has joined #tripleo10:42
b00tcatmaybe this is too broad of a question but: is it possible to bring a virtual NIC up when deploying the overcloud with a hypervisor?10:43
b00tcatas this wouldn't make sense when deploying baremetal10:43
openstackgerritMartin Mágr proposed openstack/puppet-tripleo: Deploy monitoring/logging agents sooner  https://review.openstack.org/38160410:43
b00tcatI mean an additional NIC (apart from the one that is created by default)10:44
openstackgerritMartin Mágr proposed openstack/puppet-tripleo: Deploy monitoring/logging agents sooner  https://review.openstack.org/38160410:44
*** zoli|lunch is now known as zoli10:50
*** zoli is now known as zoliXXL10:50
*** pkovar has joined #tripleo10:53
EmilienMgood morning10:55
hewbroccaGood morning sir!10:57
*** panda|afk is now known as panda10:59
EmilienMshardy: today is Thanksgiving in Canada, I'll be offline during the day but back later in the evening.11:01
hewbroccaEmilienM: what are *you* thankful for today?11:02
EmilienMhewbrocca: the beauty of nature in Quebec, we're going to visit one of the most beautiful parks11:03
hewbroccaExcellent!11:05
hewbroccaI am thankful I am not currently in the USA11:05
hewbroccabecause I'm not sure my heart could take the stress11:05
EmilienMyeah, it sucks :(11:05
hewbroccaAt least over here I only see the news on the web11:06
hewbroccaAt home it would be on newspapers and TV...11:06
* dtantsur treats absence of a TV as one of big pluses of emigration11:08
hewbroccaYeah11:09
hewbroccait's a huge win, honestly11:09
*** radeks has quit IRC11:10
*** lazy_prince has joined #tripleo11:11
*** rhallisey has joined #tripleo11:14
*** dsneddon has quit IRC11:14
*** adarazs is now known as adarazs_lunch11:25
openstackgerritJiri Stransky proposed openstack/python-tripleoclient: Fix get_file in out-of-tree templates  https://review.openstack.org/38381311:27
paramiteshardy, Hey Steve, I'm trying to do this http://tinyurl.com/gnyf3wy but obviously I'm missing something, because I'm hitting: Guys by any chance, did you hit this error: 2016-10-10 10:26:32Z [overcloud]: CREATE_FAILED  Resource CREATE failed: The Referenced Attribute (ObjectStorageServiceChain role_data) is incorrect.11:32
paramiteshardy, can you please give me a hint what I need to add/change?11:32
*** rodrigods has quit IRC11:34
*** rodrigods has joined #tripleo11:34
hewbroccaparamite: shardy may be high latency today, he's at the EMEA field hackfest11:34
hewbroccajistr|mtg: ^^^ you have any ideas here?11:34
*** jistr|mtg is now known as jistr11:34
paramitehewbrocca, ah ok, thanks for info11:35
openstackgerritChristian Schwede proposed openstack/instack-undercloud: Fix default Swift ring partition power  https://review.openstack.org/38443611:36
paramitejistr, sadly all resources are CREATE_COMPLETE so I cannot debug on resource level ... neither I didn't find any error for my last deployment11:36
paramitein heat logs11:37
*** ccamacho is now known as ccamacho|lunch11:37
*** radeks has joined #tripleo11:37
*** nyechiel has joined #tripleo11:38
jaosoriorHey guys, would really appreciate reviews for these two https://review.openstack.org/#/c/366548/  https://review.openstack.org/#/c/356430/11:39
jaosoriorjistr: can you check these out if you have a chance? ^^11:42
openstackgerritChristian Schwede proposed openstack/tripleo-heat-templates: Fix default Swift ring partition power  https://review.openstack.org/38443911:43
*** lucas-afk is now known as lucasagomes11:45
*** matbu is now known as matbu|lch11:47
*** zaneb has joined #tripleo11:48
bandinimarios, matbu, chem: https://bugs.launchpad.net/tripleo/+bug/1630580 am testing an N->M upgrade and hitting this one. Ever seen it?11:48
openstackLaunchpad bug 1630580 in tripleo "upgrade-non-controller.sh getting stuck cleaning up openstack-nova-compute package " [High,Confirmed]11:48
test-RIs there a way to update the kernel parameters of the overcloud nodes from the undercloud configurations files ?11:48
jistrparamite: hmm i can't see anything wrong with that patch... does the environment including sensu-client.yaml work *without* this patch? I wonder if we're looking into a wrong place.11:48
*** dprince has joined #tripleo11:49
jistrparamite: i'm not sure if it's in CI, so it could be that it was already broken before your patch. I think you could try deploying without that patch also, to tell where the error is.11:50
chembandini: no specifically there, but for the undercloud upgrade we have to systemctl stop openstack-nova to make it work11:50
chembandini: the "error" was the same some dependency issue during upgrade of the nova compute11:51
jistrjaosorior: ok11:51
bandinichem: yeah I was wondering what options we have to fix it on the compute nodes. I guess stopping nova-compute is one option11:51
chembandini: it was downstream, and nobody seems to complain upstream so we just add it to the procedure.11:52
bandinichem: I see11:53
bandinichem: so I expected that starting openstack-nova-conductor by hand would fix it, but it does not seem to be the case (i.e. I get the same timeout waiting for nova-conductor)11:54
gfidenteparamite map_merge merges two maps11:55
mariosbandini: yes, i am actually about to file a bz... i was the only one hitting it so we said to just file the bz and see :)11:55
gfidenteI think your second argument is a list11:55
mariosbandini: oh no hold on this is for compute node11:55
mariosbandini: i am filing siomething very  similar but for the undercloud11:55
bandinimarios: yes compute nodes11:55
mariosbandini: so no not seen this one11:55
chemmarios if that matters I had the timeout during the init upgrade with upstream.  I have added the "systemctl stop openstack-*" pre-command to this job.11:57
chemmarios: yes, but bandini's error is the same11:58
* jistr reloc11:58
*** adarazs_lunch is now known as adarazs11:58
marioschem: sounds like... let me get the package versions etc into the bz and we can see. but really should *not* happen on init, since we aren't updating anything there11:58
bkreitchhi, is TripleO supposed to be supported on Ubuntu - or only on RPM based systems?11:58
marios(or shouldn't be)11:58
jaosoriorbkreitch: it's not supported on Ubuntu at the moment.11:59
chemmarios: oups, sorry, it's during the ./undercloud-upgrade.sh11:59
marioschem: ah ok then is the one we spoke about last week11:59
marioschem: so we may yet have to revisit that12:00
marioschem: but this one from bandini is sthing else (though may ultimately be similar root cause) as it is for upgrading compute nodes12:00
chemmarios: yeap, but same error message and look like same problem with nova-compute having an non recoverable dependency on nova-conductor12:01
marioschem: ah we have one https://bugzilla.redhat.com/show_bug.cgi?id=137204012:01
openstackbugzilla.redhat.com bug 1372040 in rhel-osp-director "OSP-Director-10: upgrading undercloud from: osp9 to osp10, the yum update command hangs for about 20min over: 'Yum Cleanup: 1:openstack-nova' ." [Medium,New] - Assigned to athomas12:01
bkreitchjaosorior: thx, is it planned or not in the near future?12:02
chemmarios: in the readme in the downstream only bz12:02
jaosoriorbkreitch: not planned. Unless people are interested on working on it.12:02
marioschem: ack thanks lets talk about it on scrum today added a note to agenda12:03
*** amoralej is now known as amoralej|lunch12:06
*** dmacpher has joined #tripleo12:11
*** shardy is now known as shardy_mtg12:12
*** shardy_mtg is now known as shardy12:12
*** matbu|lch is now known as matbu12:14
*** hjensas_ has quit IRC12:15
hewbroccabkreitch: yes, patches are certainly very welcome12:15
*** ccamacho|lunch is now known as ccamacho12:15
paramitegfidente, oh, that's a good point, thanks!12:15
paramitejistr, ack, gonna try to deploy without the patch12:16
*** radeks has quit IRC12:16
gfidenteparamite heh been there before, yaml indentation gets messy :P12:16
paramite:)12:16
*** morazi has quit IRC12:16
bkreitchhewbrocca: yes - planned? but currently it seems to be mostly RPM focused.. is there something like RDO for Ubuntu?12:20
*** rbrady has joined #tripleo12:22
pandaderekh: there's an explanation somewhere on what happened yesterday to CI logs ?12:25
hewbroccabkreitch: there isn't really an RDO for Ubuntu -- RDO is focused on RPM-based12:25
hewbroccaTripleO *used* to support Ubuntu, but we haven't kept it up12:26
hewbroccaI think we would love to support it again but it's not really on the radar12:26
bkreitchhewbrocca: i see, thx12:31
*** jpena is now known as jpena|lunch12:33
*** chem has quit IRC12:36
*** chem has joined #tripleo12:36
*** shardy is now known as shardy_mtg12:37
*** fultonj has joined #tripleo12:43
*** trown|outtypewww is now known as trown12:44
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Set the notification driver for glance  https://review.openstack.org/38448112:47
*** shardy_mtg is now known as shardy12:49
*** pabelanger has quit IRC12:53
*** pabelanger has joined #tripleo12:53
*** tzumainn has joined #tripleo12:56
*** rlandy has joined #tripleo12:57
derekhpanda: I wasn't aware of any problem with ci logs12:57
pandaderekh: Isee that something happened to the logs history, some build from the past week have now yesterday's date, some files in logs were compressed, and HA jobs are missing overcloud nodes jobs. I thought something was being modified to free disk space12:59
*** jbadiapa has quit IRC13:01
derekhpanda: All of the logs for our jobs are stored by infra, we havn't (and can't) touch them, but iirc infra do compress them13:02
derekhpanda: we were talking last week about freeing space on the undercloud, but that has nothing to do with the job jogs13:02
*** cdearborn has joined #tripleo13:02
derekh*logs13:02
*** dsneddon has joined #tripleo13:03
*** shardy is now known as shardy_mtg13:03
*** jprovazn has quit IRC13:03
*** radeks has joined #tripleo13:06
pandaderekh: mh, ok I'll check with infra about compression, but I doubt they have something to do with the missing overcloud logs.13:06
ccamachohey dprince morning! quick question related to https://bugs.launchpad.net/tripleo/+bug/1631133  Can we just default the value in THT to '' and then in puppet-nova default all the workers value to $::os_workers  ?? In which case we will by default using a safe value instead of processor count?13:06
openstackLaunchpad bug 1631133 in OpenStack Compute (nova) "nova's osapi_compute_workers is not valid (must be greater than 1)" [High,In progress] - Assigned to Dan Prince (dan-prince)13:06
derekhpanda: can you point me at an example?13:06
pandaderekh: http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha-tempest/2aca7fc/logs/13:08
*** dsneddon has quit IRC13:08
*** hjensas_ has joined #tripleo13:08
*** hjensas_ has quit IRC13:08
*** hjensas_ has joined #tripleo13:08
*** shardy_mtg is now known as shardy13:09
*** panda is now known as panda|afk13:10
*** jbadiapa has joined #tripleo13:10
*** pgadiya has quit IRC13:12
derekhpanda|afk: http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha-tempest/2aca7fc/logs/postci.txt.gz#_2016-10-09_08_53_58_00013:12
derekhpanda|afk: ERROR: The Stack (overcloud) could not be found13:12
derekhpanda|afk: looks like there was no overcloud, so nothing to get logs from I assume13:12
dprinceccamacho: we could do that but '' is not an integer so we'd lose the Number validation in t-h-t13:13
*** morazi has joined #tripleo13:14
derekhpanda|afk: looks like we're deleting the overcloud in the ha job here http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/toci_gate_test.sh#n9513:14
dprinceccamacho: Several ways we could work around it. I think the simplest and most desirable fix is to fix NOva though. Because they made a breaking change.13:14
dprinceccamacho: almost got unit tests working on that. Hit a snag... will try to update today13:15
*** amoralej|lunch is now known as amoralej13:15
*** coolsvap has quit IRC13:16
*** limao has joined #tripleo13:19
*** morazi has quit IRC13:21
*** pgadiya has joined #tripleo13:24
jistrjaosorior: looking at the internal TLS patches, so IIUC it is encrypted on two parts of the way separately: client <-tls-> haproxy, and a separate haproxy <-tls-> server, and the individual tls parts can use different keys/certs, right?13:24
*** jprovazn has joined #tripleo13:24
jaosoriorjistr: yep13:25
ccamachodprince cool13:25
jistrjaosorior: ack, thanks13:26
*** fultonj has quit IRC13:26
*** fultonj has joined #tripleo13:26
jistrjaosorior: are we clear to merge those patches, given that they're targeted at ocata though?13:27
jistr(just +2'd for now, not +A)13:27
jaosoriorjistr: running them again just in case.13:29
jaosoriorjistr: they've been through too many rebases haha. So just to make sure13:29
jistrjaosorior: ack but what i meant was more like "should we wait merging those patches until Newton is officially released?"13:30
jaosoriorjistr: wasn't RC3 already released last week?13:31
jaosoriorjistr: if those patches merge in master they won't be used for newton anyway. master is only for Ocata now AFAIK13:32
jaosoriorshardy: ^^13:32
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart: Add ability to deploy an overcloud with ssl  https://review.openstack.org/38283013:34
*** morazi has joined #tripleo13:34
*** radeks has quit IRC13:34
*** limao has quit IRC13:36
*** limao has joined #tripleo13:36
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: Add the workflow name to the starting workflow message  https://review.openstack.org/37533113:37
openstackgerritDougal Matthews proposed openstack/instack-undercloud: Make the snmpd_readonly_user_password available to Mistral  https://review.openstack.org/38369413:41
akrivokaI'm getting an error "Unable to set 'is_public' to 'True'" when trying to upload  overcloud images to glance, anyone seen this?13:42
jpichakrivoka: Sorry, I was looking for the bug, it's https://bugs.launchpad.net/tripleo/+bug/163105213:43
openstackLaunchpad bug 1631052 in tripleo "openstack overcloud image upload command is broken" [Critical,Fix released] - Assigned to John Trowbridge (trown)13:43
jaosoriorakrivoka: you need to update your packages13:43
jaosoriorakrivoka: that was fixed already13:43
jpichakrivoka: There's both a fix and a workaround, depending on what works better for you13:43
jristthorough!13:43
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart: Add centosci configs for cloudsig-stable pipeline  https://review.openstack.org/38451213:44
akrivokathanks jpich and jaosorior13:44
openstackgerritDougal Matthews proposed openstack/instack-undercloud: Make the snmpd_readonly_user_password available to Mistral  https://review.openstack.org/38369413:44
openstackgerritDougal Matthews proposed openstack/tripleo-common: Fetch the snmpd_readonly_user_password directly from the hiera file  https://review.openstack.org/38369613:44
*** milan has quit IRC13:45
shardyjaosorior, jistr: Yep we've not declared the stable/newton release final yet, but the branches exist so it's OK to land ocata patches to master now13:46
*** milan has joined #tripleo13:46
*** panda|afk is now known as panda13:47
shardyrook: Hey FYI I posted the blog post you were asking about, see http://hardysteven.blogspot.co.uk/2016/10/tripleo-composablecustom-roles.html13:47
*** pgadiya has quit IRC13:48
pandaderekh: the delete test change was merged 31st of august ...13:50
shardynote that it assumes some pretty recent patches which may still be getting into non-upstream builds13:50
derekhpanda: so have we not had the overcloud logs for periodic jobs since then?13:50
*** jpena|lunch is now known as jpena13:52
ccamachoshardy, mind to check this new change related to composable roles? https://review.openstack.org/#/c/384321/  Its just a few validations13:53
pandaderekh: sometimes we have them, sometimes we don't .. maybe when delete or something before that fails we have them.13:53
ccamachoThat I had pending13:54
jistrshardy, jaosorior: ack, thanks :)13:54
derekhpanda: we should have them from all failed and nonha jobs13:54
*** cdearborn has quit IRC13:55
pandaderekh: ok, so it's normal that we don't have them if everything works ?13:56
shardyccamacho: don't we want the list to be empty when everything gets converted to role.role.j2.yaml?13:56
shardyseems like we'll have to revert this change when that happens?13:56
derekhpanda: its not ideal but from the looks of it thats the way its coded13:56
openstackgerritDougal Matthews proposed openstack/instack-undercloud: Make the snmpd_readonly_user_password available to Mistral  https://review.openstack.org/38369413:57
ccamachoshardy yeahp. And in that case when the file its empty or only with "name:" or even if it does not exist, the list of excluded templates will be [],  In which case all templates should be rendered.13:58
ccamacho{"name": []} means there is no role to be excluded, render all roles using role.role.j2.yaml13:59
*** limao has quit IRC13:59
shardyccamacho: ah, yeah OK I see, makes sense, thanks14:00
*** limao has joined #tripleo14:00
ccamachothanks!14:00
*** noslzzp has joined #tripleo14:00
*** morazi has quit IRC14:00
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates: Update OpenContrail loadbalancer plugin value  https://review.openstack.org/38349814:01
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates: Update OpenContrail loadbalancer plugin value  https://review.openstack.org/38349714:02
openstackgerritLuca Lorenzetto proposed openstack/diskimage-builder: Avoid disabling rhel-7-server-rh-common-rpms  https://review.openstack.org/38453314:03
*** morazi has joined #tripleo14:03
*** maticue has joined #tripleo14:10
*** noslzzp has quit IRC14:10
*** noslzzp has joined #tripleo14:11
*** ayoung has joined #tripleo14:13
jaosoriorayoung: hey dude, can you help me out debugging some httpd issue?14:13
*** bnemec has joined #tripleo14:15
ayoungjaosorior, can you help me ouit debugging some Policy Issue?14:15
ayoungHeh14:15
ayoungjaosorior, whatcha got?14:15
jaosoriorayoung: httpd refuses to start, and I've failed to find a relevant error message.14:18
ayoungjaosorior, did you run apachtcl test?14:19
ayoungor something like that without the typos?14:19
*** mbozhenko has quit IRC14:19
ayoungapachectl configtest14:20
jaosoriorayoung: apachectl configtest   gives Syntax OK14:20
openstackgerritChristian Schwede proposed openstack/puppet-tripleo: Add part_power and min_part_hours for Swift  https://review.openstack.org/38455114:20
*** maticue has quit IRC14:20
openstackgerritChristian Schwede proposed openstack/tripleo-heat-templates: Fix default Swift ring partition power  https://review.openstack.org/38443914:21
*** aufi has quit IRC14:22
jaosoriorshardy, d0ugal: updating the overcloud seems to be broken again :/14:25
*** mcornea has quit IRC14:26
ayoungjaosorior, SELinux?14:26
jaosoriorayoung: that worked14:28
*** rdopiera has left #tripleo14:30
jaosoriorayoung: yep, it was indeed a SELinux issue14:30
*** tobias-fiberdata has quit IRC14:31
*** null_ref has joined #tripleo14:31
d0ugaljaosorior: dang - do you have an error?14:32
d0ugaljaosorior: I've not touched that code in a while, but I have seen some changes.14:32
jaosoriord0ugal: ERROR: The server could not comply with the request since it is either malformed or otherwise incorrect.14:32
ayoungjaosorior, was it the Credentials Repo?14:32
d0ugaljaosorior: odd - is there a traceback in the mistral logs?14:33
jaosoriord0ugal: it seems to be a heat error14:33
jaosoriorayoung: which Credentials Repo?14:33
d0ugaljaosorior: true, so I guess there wont be much else logged.14:33
jaosoriord0ugal, shardy this is the error log in heat-api.log http://paste.openstack.org/show/585196/14:34
d0ugaljaosorior: that means almost nothing to me :(14:34
ayoungjaosorior, /etc/keystone/credentials14:34
d0ugaljaosorior: I'd download the plan from swift and see if I could find anything "odd" about it.14:34
ayoungjaosorior, what does the audit log tell you?  I assume you switched SELinux to permissive mode and reran it.  Run audit2allow or something to see what it was complaining about.  We need SELinux enabled to run, so it caught something14:35
jaosoriorayoung: haven't gone deeper to debug the SELinux error. But as far as I can tell it's not related to keystone14:35
jaosoriorayoung: so, in step 3 for the bootstrap node, actually keystone starts just fine.14:36
openstackgerritMerged openstack/diskimage-builder: Move the opensuse mkinitrd script to the zypper element  https://review.openstack.org/38157414:36
jaosoriorayoung: things seem to go wrong on step 4, when we try to start httpd with ceilometer, gnocchi and aodh14:36
*** mburned has joined #tripleo14:36
d0ugalHas CI just gone red?14:37
jaosoriord0ugal: seems it has14:37
*** openstack has joined #tripleo18:23
*** ipsecguy_ has joined #tripleo18:24
*** ipsecguy has quit IRC18:28
*** openstack has joined #tripleo19:04
trownand the -ev package obsoletes the non-ev one19:05
*** cwolferh has joined #tripleo19:05
bnemectrown: Oh, weird.  I assumed it was the other way around because the -ev package is coming from rdo.19:05
pandayep, I think that's what jpena was trying to explain to me19:05
trownin the bug it is clear we are trying to install qemu-img without the -ev repo enabled... but we already have the -ev package installed19:06
bnemecYeah, looking again I see that it does say -ev is already installed.  The thing tha tconfused me was "Removing qemu-img.x86_64 10:1.5.3-105.el7_2.7"19:07
*** openstackstatus has joined #tripleo19:07
bnemecWhich made it sound like it was trying to remove the old version.19:07
*** ChanServ sets mode: +v openstackstatus19:07
bnemecBut I guess it means yum is removing that package from the install list.19:07
*** bfournie has joined #tripleo19:08
bnemecI wonder if there's any way to just remove everything from rdo-qemu-ev so we make sure nothing is coming from that repo.19:08
*** pkovar has quit IRC19:09
bnemecI should restate that: I'm sure there _is_ a way to do it, I'm wondering how hard it is. :-)19:09
*** matbu|bbl is now known as matbu19:11
*** abregman has joined #tripleo19:12
bnemecpanda: trown: What if we just moved http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/toci_instack_ovb.sh#n27 after http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/toci_instack_ovb.sh#n45 ?19:15
bnemecWe don't start messing with the images until later in the script anyway, so it shouldn't matter where exactly it happens before that.19:15
*** dprince has joined #tripleo19:15
trownbnemec: is the repo setup on 45 getting rid of a repo?19:16
bnemectrown: It's probably this: http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/toci_instack_ovb.sh#n3019:16
trownoh it is on 30 that we kill rdo-release which probably takes the ev repo with it19:16
trownya19:16
bnemecHeh, yep19:16
trownthat would work then19:16
bnemecOkay, let's try that then.  It should save us some time versus messing with an install/uninstall cycle in yum.19:18
pandaok, install after removeing rdo-release19:18
bnemecpanda: ^19:18
bnemecpanda: No, after --repo-setup.19:18
bnemecThat way we make sure to get the one we want.19:19
pandabnemec: so we already install what undercloud would anyway ?19:19
pandaok19:19
bnemecRight, let's not mess around with installing the package twice.19:19
trownpanda: maybe just add it to http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/toci_instack_ovb.sh#n4819:19
pandatrown: that's what I did :)19:21
*** dsariel has joined #tripleo19:21
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates: Actually start the systemd services in step3 of the major-upgrade step  https://review.openstack.org/38466719:23
bandinimarios, matbu, chem: ^19:23
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci: Nove qemu-img installation after repo setup  https://review.openstack.org/38462819:24
openstackgerritMerged openstack/tripleo-heat-templates: Fixing resources path in OpenDaylight  https://review.openstack.org/38254119:31
*** shardy has joined #tripleo19:33
*** shardy has quit IRC19:33
*** mbozhenko has quit IRC19:35
openstackgerritMerged openstack/tripleo-heat-templates: Remove unneeded *_enable_backend hiera from Manila backends  https://review.openstack.org/38363319:35
*** bana_k has quit IRC19:45
*** abregman is now known as abregman|afk19:51
*** mcornea has quit IRC19:58
*** mbozhenko has joined #tripleo20:01
*** bana_k has joined #tripleo20:04
openstackgerritChristian Schwede proposed openstack/puppet-tripleo: Add versioned_writes to Swift proxy config  https://review.openstack.org/38470420:16
openstackgerritChristian Schwede proposed openstack/tripleo-heat-templates: Enable object versioning in Swift proxy  https://review.openstack.org/38461620:16
*** dprince has quit IRC20:16
*** lucasagomes is now known as lucas-afk20:19
*** rhallisey has quit IRC20:29
*** rhallisey has joined #tripleo20:29
*** dsneddon_ has joined #tripleo20:31
*** rhallisey has quit IRC20:35
*** dsneddon_ has quit IRC20:36
*** akrivoka has quit IRC20:39
*** mbozhenko has quit IRC20:43
*** paramite has quit IRC20:46
*** mbozhenko has joined #tripleo20:46
openstackgerritSteve Baker proposed openstack/os-collect-config: Treat ec2 collector data as immutable  https://review.openstack.org/38471220:58
*** trown is now known as trown|outtypewww21:00
*** kjw3 has joined #tripleo21:02
*** jprovazn has quit IRC21:03
*** redhatkj has joined #tripleo21:11
*** redhatkj has quit IRC21:11
openstackgerritMichele Baldessari proposed openstack/tripleo-docs: WIP Update upgrade instructions for M->N upgrades  https://review.openstack.org/38471721:14
*** rbrady is now known as rbrady-afk21:19
*** anshul has quit IRC21:32
*** mbozhenko has quit IRC21:38
*** abregman|afk is now known as abregman21:44
*** kjw3 has quit IRC21:46
*** fultonj has quit IRC21:48
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Move qemu-img installation after repo setup  https://review.openstack.org/38462822:03
*** absubram has quit IRC22:07
*** cdearborn has quit IRC22:11
*** absubram has joined #tripleo22:19
*** abregman has quit IRC22:19
*** absubram has quit IRC22:22
*** dsneddon_ has joined #tripleo22:24
*** dsneddon_ has quit IRC22:29
openstackgerritPradeep Kilambi proposed openstack/tripleo-docs: WIP Update upgrade instructions for M->N upgrades  https://review.openstack.org/38471722:46
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Rate limit testenv creation  https://review.openstack.org/38473122:49
*** tiswanso has joined #tripleo22:59
*** tiswanso has quit IRC23:02
*** rlandy is now known as rlandy|afk23:05
*** gfidente has quit IRC23:08
*** morazi has quit IRC23:14
*** panda is now known as panda|Zz23:17
*** dsneddon_ has joined #tripleo23:25
*** flepied has quit IRC23:28
*** dsneddon_ has quit IRC23:30
*** HenryG has quit IRC23:32
*** HenryG has joined #tripleo23:32
*** yamahata has quit IRC23:34
*** flepied has joined #tripleo23:44
*** yamahata has joined #tripleo23:46
*** ipsecguy_ has quit IRC23:56
*** ipsecguy has joined #tripleo23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!