Friday, 2017-07-21

openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add heat api container to run cron purge_deleted  https://review.openstack.org/48586500:05
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add keystone cron container to run token_flush  https://review.openstack.org/48586300:06
*** cdearborn_ has joined #tripleo00:08
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170548100:10
openstackLaunchpad bug 1705481 in tripleo "scenario001 broken due to sensu puppet module update" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)00:10
*** ooolpbot has quit IRC00:10
*** kambiz has quit IRC00:10
*** kambiz has joined #tripleo00:13
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add cinder cron container to run db purge  https://review.openstack.org/48587300:14
*** cdearborn__ has joined #tripleo00:16
*** itlinux has quit IRC00:17
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add heat api container to run cron purge_deleted  https://review.openstack.org/48586500:17
*** cdearborn has quit IRC00:18
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add keystone cron container to run token_flush  https://review.openstack.org/48586300:19
*** tzumainn has quit IRC00:21
*** rlandy has quit IRC00:22
*** cdearborn_ has quit IRC00:29
*** psahoo has joined #tripleo00:32
*** ecerquei_ has quit IRC00:33
*** cdearborn__ has quit IRC00:35
openstackgerritdaixianmeng proposed openstack/diskimage-builder master: update element growroot Add support for XFS format  https://review.openstack.org/48589500:39
*** bfournie has joined #tripleo00:47
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Bump fedora-minimal DIB_RELEASE 26  https://review.openstack.org/48257000:50
openstackgerritIan Wienand proposed openstack/diskimage-builder master: [WIP] Move setfiles to outside chroot with runcon  https://review.openstack.org/48589900:50
*** fragatin_ has joined #tripleo00:51
*** fragatina has quit IRC00:54
*** fragati__ has joined #tripleo00:54
*** fragatin_ has quit IRC00:55
*** fragatina has joined #tripleo00:56
*** fragatina has quit IRC00:57
*** fragatin_ has joined #tripleo00:57
*** jkilpatr has quit IRC00:58
*** fragatin_ has quit IRC00:59
*** fragatina has joined #tripleo00:59
*** fragati__ has quit IRC00:59
*** itlinux has joined #tripleo01:01
*** fragatina has quit IRC01:03
openstackgerritIan Wienand proposed openstack/diskimage-builder master: [WIP] Move setfiles to outside chroot with runcon  https://review.openstack.org/48589901:05
larsksIn a containerized deployment...what controls from where the overcloud pulls images? My overcloud is pulling images from docker.io, rather than the registry on the undercloud, and I want to change that.01:08
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170548101:10
openstackLaunchpad bug 1705481 in tripleo "scenario001 broken due to sensu puppet module update" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)01:10
*** ooolpbot has quit IRC01:10
*** psahoo has quit IRC01:10
*** fragatina has joined #tripleo01:12
*** fragatina has quit IRC01:14
*** ansmith has quit IRC01:28
*** psahoo has joined #tripleo01:29
*** psahoo_ has joined #tripleo01:35
*** psahoo has quit IRC01:37
*** psahoo_ has quit IRC01:39
*** psahoo has joined #tripleo01:40
*** psahoo has quit IRC01:40
*** psahoo has joined #tripleo01:42
*** fzdarsky_ has joined #tripleo01:43
*** fzdarsky|afk has quit IRC01:46
openstackgerritIan Wienand proposed openstack/diskimage-builder master: [WIP] Move setfiles to outside chroot with runcon  https://review.openstack.org/48589901:46
*** itlinux has quit IRC01:49
openstackgerritIan Wienand proposed openstack/diskimage-builder master: [WIP] Move setfiles to outside chroot with runcon  https://review.openstack.org/48589901:54
*** yamahata has quit IRC01:56
*** gbarros has joined #tripleo01:57
*** tvignaud has quit IRC01:58
*** itlinux has joined #tripleo02:04
openstackgerritIan Wienand proposed openstack/diskimage-builder master: [WIP] Move setfiles to outside chroot with runcon  https://review.openstack.org/48589902:08
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170548102:10
openstackLaunchpad bug 1705481 in tripleo "scenario001 broken due to sensu puppet module update" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)02:10
*** ooolpbot has quit IRC02:10
*** yamahata has joined #tripleo02:42
*** cschwede has joined #tripleo02:55
*** cschwede_ has quit IRC02:57
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170548103:10
openstackLaunchpad bug 1705481 in tripleo "scenario001 broken due to sensu puppet module update" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)03:10
*** ooolpbot has quit IRC03:10
*** cnf has quit IRC03:10
*** rbrady has joined #tripleo03:12
*** rbrady has joined #tripleo03:12
*** fragatina has joined #tripleo03:12
*** chem has quit IRC03:15
*** fragatina has quit IRC03:16
*** gbarros has quit IRC03:26
*** gbarros has joined #tripleo03:27
*** jaganathan has joined #tripleo03:28
*** jaganathan has quit IRC03:35
*** gkadam has joined #tripleo03:48
*** dbecker has quit IRC03:54
*** fragatina has joined #tripleo03:56
*** fragatina has quit IRC03:56
*** fragatina has joined #tripleo03:57
*** flepied has quit IRC04:00
*** yamahata has quit IRC04:06
*** yamahata has joined #tripleo04:07
*** dbecker has joined #tripleo04:07
*** gbarros has quit IRC04:07
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170548104:10
openstackLaunchpad bug 1705481 in tripleo "scenario001 broken due to sensu puppet module update" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)04:10
*** ooolpbot has quit IRC04:10
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Bump fedora-minimal DIB_RELEASE 26  https://review.openstack.org/48257004:13
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Move setfiles to outside chroot with runcon  https://review.openstack.org/48589904:13
*** dmacpher has joined #tripleo04:15
numansHello reviewers. The patch https://review.openstack.org/#/c/475423/ to increase OVN coverage for tripleo got merged in project-config.04:27
numansThis patch also runs tripleo job for networking-ovn project and the CI for networking-ovn is broken.04:27
numansIt would be nice if the reviewers can review this patch - https://review.openstack.org/#/c/484868/04:28
numansin order to unblock networking-ovn gate04:28
*** dsariel_ has joined #tripleo04:33
*** rbrady has quit IRC04:36
*** psachin has joined #tripleo04:50
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170548105:10
openstackLaunchpad bug 1705481 in tripleo "scenario001 broken due to sensu puppet module update" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)05:10
*** ooolpbot has quit IRC05:10
*** marios has joined #tripleo05:14
*** fragatina has quit IRC05:15
*** marios_ has joined #tripleo05:19
*** rcernin has quit IRC05:22
*** skramaja has joined #tripleo05:26
*** radeks has joined #tripleo05:34
*** iranzo has joined #tripleo05:35
*** iranzo has joined #tripleo05:35
*** rcernin has joined #tripleo05:36
*** flepied has joined #tripleo05:38
*** cshastri has joined #tripleo05:41
*** marios_ has quit IRC05:43
*** coolsvap has joined #tripleo05:43
*** marios has quit IRC05:43
*** marios has joined #tripleo05:43
*** lmiccini has joined #tripleo05:47
*** anshul has joined #tripleo05:47
*** aufi has joined #tripleo05:49
*** masco has joined #tripleo05:51
*** radeks has quit IRC05:51
*** ccamacho has quit IRC06:02
*** jfrancoa has joined #tripleo06:02
*** ccamacho has joined #tripleo06:02
*** jbadiapa has joined #tripleo06:03
*** dsariel has joined #tripleo06:04
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo master: Fix lint issues to upgrade to puppet-lint 2.3  https://review.openstack.org/48578206:09
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170548106:10
openstackLaunchpad bug 1705481 in tripleo "scenario001 broken due to sensu puppet module update" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)06:10
*** ooolpbot has quit IRC06:10
*** pgadiya has joined #tripleo06:11
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo master: Check lint upgrade to 2.3  https://review.openstack.org/48570606:12
*** flepied has quit IRC06:15
*** psachin has quit IRC06:16
*** ccamacho is now known as ccamacho|brb06:21
*** jprovazn has joined #tripleo06:28
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Let's make yum transaction less expensive for tempest  https://review.openstack.org/48557406:35
*** links has joined #tripleo06:37
*** ffiore has joined #tripleo06:39
*** jaganathan has joined #tripleo06:45
*** jlinkes has joined #tripleo06:46
*** ccamacho|brb is now known as ccamacho06:48
*** flepied has joined #tripleo06:48
*** _milan_ has joined #tripleo06:49
*** athomas has joined #tripleo06:49
*** yamahata has quit IRC06:50
openstackgerritKarthik S proposed openstack/tripleo-heat-templates master: Provide DPDK nic configs and add multiqueue config  https://review.openstack.org/47453306:54
*** fzdarsky_ is now known as fzdarsky06:55
*** gfidente has joined #tripleo06:57
*** gfidente has quit IRC06:57
*** gfidente has joined #tripleo06:57
*** bogdando has joined #tripleo06:57
*** rcernin has quit IRC06:58
*** rcernin has joined #tripleo06:58
*** dtantsur|afk is now known as dtantsur07:00
*** radeks has joined #tripleo07:02
*** florianf has joined #tripleo07:02
*** fzdarsky has quit IRC07:04
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Convert scenario001-multinode-containers job to ceph-ansible  https://review.openstack.org/47928807:06
*** ebarrera has joined #tripleo07:06
*** _milan_ is now known as milan07:07
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170548107:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1705481 in tripleo "scenario001 broken due to sensu puppet module update" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)07:10
*** fzdarsky has joined #tripleo07:10
*** yprokule has joined #tripleo07:11
*** amoralej|off is now known as amoralej07:11
*** psachin has joined #tripleo07:13
*** tesseract has joined #tripleo07:16
*** ffiore has quit IRC07:18
*** fzdarsky has quit IRC07:19
*** fzdarsky has joined #tripleo07:24
*** bogdando has quit IRC07:25
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo master: Fix lint issues to upgrade to puppet-lint 2.3  https://review.openstack.org/48578207:25
*** itlinux has quit IRC07:26
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo master: Check lint upgrade to 2.3  https://review.openstack.org/48570607:28
*** ffiore has joined #tripleo07:29
*** dpawar has joined #tripleo07:31
*** hewbrocca_afk is now known as hewbrocca07:34
*** bogdando has joined #tripleo07:37
*** ccamacho is now known as ccamacho|brb07:43
openstackgerritMerged openstack/tripleo-heat-templates master: Add nova::compute::rbd setting into nova-libvirt profile  https://review.openstack.org/48520607:51
openstackgerritMerged openstack/tripleo-puppet-elements master: scsi-target-utils is not used in RHEL7+  https://review.openstack.org/47500107:51
*** psahoo has quit IRC07:57
sri_Hello everybody : I have one doubt when we deploying overcloud  "--control-scale 3   --control-flavor control " is control is role of Controller right ? , I am trying to deploy my overcloud with custom roles exp role names (CephStorageMON ) how to I pass the cephstoragemon-scale 3 --cephstoragemon-flavor ceph-mon , I've created that flavor and tag to node.07:58
*** dmacpher has quit IRC08:01
*** lucas-afk is now known as lucasagomes08:03
*** psahoo has joined #tripleo08:03
*** dsariel_ has quit IRC08:06
*** dsariel has quit IRC08:06
dpawarHi, gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container failing repeatedly. failure does not looks to be related to https://review.openstack.org/#/c/475765/17. Anything broken here ? http://logs.openstack.org/65/475765/17/check/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container/5a89111/console.html08:06
gfidentesri_ set the number of nodes in role_data08:07
openstackgerritMerged openstack/tripleo-heat-templates master: Exposing the ability to enable/disable the repository  https://review.openstack.org/45252108:07
saneaxsri_, take a look at http://hardysteven.blogspot.in/2016/10/tripleo-composablecustom-roles.html08:08
gfidentesri_ or pass as parameter $rolenameCount: $n08:09
openstackgerritChristian Schwede proposed openstack/tripleo-heat-templates master: Add Swift dispersion profile  https://review.openstack.org/47625508:09
gfidentefor example CephStorageMONCount: 308:09
*** snecklifter has joined #tripleo08:09
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170548108:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1705481 in tripleo "scenario001 broken due to sensu puppet module update" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)08:10
sri_gfidente: hi I tried that  I run into this error ResourceInError: resources.CephStorageMON: Went to status ERROR due to "Message: No valid host was found. There are not enough hosts available., Code: 500" http://paste.openstack.org/show/616058/08:10
sri_gfidente: this is updated roles.yaml   file http://paste.openstack.org/show/616130/08:13
gfidentesri_ yeah that is because of the flavor matching I think08:14
sri_gfidente: yes first link there is typo but here i fixed that typo but still facing same issue http://paste.openstack.org/show/616130/08:15
sri_gfidente: OvercloudCephStorageMONFlavor: ceph-mon , OvercloudCephStorageOSDFlavor: ceph-osd08:16
*** cnf has joined #tripleo08:16
gfidentesri_ so check in the nova logs why it says there aren't nodes08:17
gfidentebtw you don't need both08:18
gfidentepuppet-ceph.yaml and storage-environment.yaml08:18
gfidentebut this is unrelated08:18
*** cylopez has joined #tripleo08:18
sri_gfidente: understood08:18
*** egonzalez has joined #tripleo08:21
gfidentesri_ it's probably in the scheduler logs08:22
sri_gfidente:  root@undercloud stack]# grep -i error /var/log/nova/nova-scheduler.log    -- is empty08:23
openstackgerritMerged openstack/tripleo-heat-templates master: Switch MonitoringRabbitUseSSL to boolean  https://review.openstack.org/48562108:24
openstackgerritMerged openstack/tripleo-repos master: It's _RDO Trunk_ repos  https://review.openstack.org/46641608:24
gfidentesri_ well I can't point you to a specific line to grep fore08:25
gfidentebut you should see the returned error from the compute nodes where it attempted to schedule the node08:25
gfidenteso check the compute node too08:26
gfidente*compute logs08:26
sri_gfidente: ok08:26
dpawarmwahahaha: gfidente: any idea about this faulilure ? http://logs.openstack.org/65/475765/17/check/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container/5a89111/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2017-07-21_07_26_0108:27
dpawarmwahahaha: ^08:27
dpawarmwhahaha: ^08:28
sri_gfidente: I've one quick question role name of controller is "Controller" in cli we pass the "control-flavor" where do this link together ?08:30
gfidentedpawar Jul 21 07:25:49 localhost os-collect-config: "2017-07-21 07:24:57,532 ERROR: 14843 -- Failed running docker-puppet.py for sensu",08:31
gfidentein http://logs.openstack.org/65/475765/17/check/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container/5a89111/logs/subnode-2/var/log/messages.txt.gz#_Jul_21_07_25_4908:31
gfidentesri_ the default roles were hardcoded into the client cli08:33
gfidentehttps://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/utils.py#L55608:33
gfidentedeprecated in favor of $roleCount: $n parameter08:33
openstackgerritJan Provaznik proposed openstack/tripleo-heat-templates master: WIP add ganesha and ganesha VIP  https://review.openstack.org/47124508:36
openstackgerritJan Provaznik proposed openstack/tripleo-heat-templates master: Let mds create manila key and fs  https://review.openstack.org/48249608:36
sri_gfidente: Ok so can override those in environment file ? I seen some were that example file but I am not able to find it again , Instead of using cli to pass the parameters we can use environment file !!08:36
gfidentesri_ yes totally08:37
*** tvignaud has joined #tripleo08:38
dpawargfidente: is it look related to any of the following ? https://review.openstack.org/#/c/475765/17  https://review.rdoproject.org/r/#/c/7740/  https://review.openstack.org/#/c/481085/08:39
*** ckyriakidou has joined #tripleo08:39
*** AbhishekKane has joined #tripleo08:41
*** marios has quit IRC08:41
*** derekh has joined #tripleo08:42
*** marios has joined #tripleo08:42
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Open up firewall for the control-ports in the bundles  https://review.openstack.org/48604808:43
gfidentedpawar probably https://bugs.launchpad.net/tripleo/+bug/170548108:46
openstackLaunchpad bug 1705481 in tripleo "scenario001 broken due to sensu puppet module update" [Critical,Fix released] - Assigned to Alex Schultz (alex-schultz)08:46
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: Fix up the control-port for rabbitmq bundles  https://review.openstack.org/48575108:47
dpawargfidente: i saw that, but the error signature is different http://logs.openstack.org/70/482170/9/check/gate-tripleo-ci-centos-7-scenario001-multinode-oooq/214d3dc/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2017-07-20_10_52_5008:48
*** ccamacho|brb is now known as ccamacho08:51
sri_gfidente: I've created a environment file  for " parameter_defaults:   ControllerCount: 3   ComputeCount: 1   CephStorageOSDCount: 3   CephStorageMONCount: 3" , here we take role name and added Count , for flavor's is it like ControllerFlavor ?08:51
*** chem has joined #tripleo08:51
*** shardy has joined #tripleo08:54
gfidentesri_ it's Overcloud$nameFlavor08:54
gfidentesri_ https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/role.role.j2.yaml#L1008:55
sri_gfidente: got it08:56
AbhishekKanemwhahaha gfidente: https://bugs.launchpad.net/tripleo/+bug/1705481 seemed to be merged. If I recheck my patch now https://review.openstack.org/#/c/475765/17 , will it pick up the fix or is some rebase required on my patch?08:56
openstackLaunchpad bug 1705481 in tripleo "scenario001 broken due to sensu puppet module update" [Critical,Fix released] - Assigned to Alex Schultz (alex-schultz)08:56
AbhishekKanemwhahaha: Ok. I see that one review request is marked in progress.08:59
*** ramishra has quit IRC09:00
*** ramishra has joined #tripleo09:02
AbhishekKanehttp://logs.openstack.org/65/475765/17/check/gate-tripleo-ci-centos-7-scenario001-multinode-oooq/ab705ac/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2017-07-21_06_54_28 shows that "openstack stack failures list overcloud --long" was run. Which file has these logs?09:08
*** paramite has joined #tripleo09:10
*** akrivoka has joined #tripleo09:11
skramajaAbhishekKane: it is in the same file, few lines above - http://logs.openstack.org/65/475765/17/check/gate-tripleo-ci-centos-7-scenario001-multinode-oooq/ab705ac/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2017-07-21_06_54_2209:12
AbhishekKaneskramaja: oh! thanks!09:13
openstackgerritDerek Higgins proposed openstack/tripleo-heat-templates master: Add ironic config to scenario 004  https://review.openstack.org/48526109:14
*** paramite has quit IRC09:22
*** salmankhan has joined #tripleo09:25
*** paramite has joined #tripleo09:28
paramite Hey guys, I have a problem with recent THT master. It seem that even though I've set DockerNamespace: 192.168.24.1:8787/tripleoupstream and DockerNamespaceIsRegistry: true , the images are pulled from docker.io. Did anything changed recently?09:29
gfidenteparamite yes it did09:31
shardyparamite: try running  openstack overcloud container image prepare --namespace=192.168.1.16:8787/tripleoupstream --env-file=$HOME/containers-parameters.yaml09:31
shardywith whatever IP you need for your local registry obviously ;)09:31
shardythat will generate an environment file containing all the image references, which aren't calculated via DockerNamespace anymore09:32
shardyparamite: make sure you have latest tripleoclient and tripleo-common09:32
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-ui master: Imported Translations from Zanata  https://review.openstack.org/48607509:34
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: WIP Make HA container bundle work on remote nodes  https://review.openstack.org/48607609:35
*** paramite has quit IRC09:37
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo master: Fix lint issues to upgrade to puppet-lint 2.3  https://review.openstack.org/48578209:42
*** marios has quit IRC09:43
*** marios has joined #tripleo09:43
*** masco has quit IRC09:43
*** katkapilatova has joined #tripleo09:48
*** katkapilatova has left #tripleo09:48
openstackgerritzenghui.shi proposed openstack/tripleo-specs master: Tripleo PTP (Precision Time Protocol) support  https://review.openstack.org/48322709:49
*** paramite has joined #tripleo09:51
paramiteshardy, thans09:51
paramitethanks!09:51
sri_shardy: Hi I am trying to deploy overcloud with custom roles , I am getting no valid host error ""Message: No valid host was found. There are not enough hosts available., Code: 500" , this is my environment  http://paste.openstack.org/show/616146/, I am doing something wrong here ?09:53
*** Vijayendra has quit IRC09:55
shardysri_: I'd check the node profiles/tagging - you're using specific flavors for control/compute/ceph-osd/ceph-mon, are you sure you have enough notes availble of each type, and that they're correctly tagged (check the capabilities in ironic node-show matches the capability in nova flavor show)09:56
shardythe error tells us nova can't find enough nodes that match the flavors you've requested09:56
*** stendulker has joined #tripleo09:56
*** jprovazn has quit IRC09:56
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart-extras master: WIP: enable containers periodic job  https://review.openstack.org/47574509:57
shardyhmm the profiles list output looks OK though...09:57
shardysri_: you may need to check the nova-scheduler logs to work out which criteria aren't being met, e.g could it be disk or ram isn't correctly set for some nodes in ironic?09:59
chandankumarmwhahaha: finally the job passed, https://review.openstack.org/48547710:00
*** stendulker_ has joined #tripleo10:00
*** Vijayendra has joined #tripleo10:01
sri_shardy: yes , I've tested without custom roles like 3 ceph nodes 3 controllers 1 compute it worked , ok  let me check that10:01
*** stevebaker has quit IRC10:03
*** stendulker has quit IRC10:04
*** slagle has quit IRC10:04
*** stendulker_ has quit IRC10:05
sri_shardy: you're right I think I miss configured node , Let me validate node's with profile and flavors    ----> nova-scheduler.log http://paste.openstack.org/show/616149/10:07
gfidentesri_ so it was in there :D10:17
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Open up firewall for the control-ports in the bundles  https://review.openstack.org/48604810:17
sri_dfidente: yes lol,10:18
*** psahoo has quit IRC10:24
*** ramishra has quit IRC10:24
*** ramishra has joined #tripleo10:26
*** jkilpatr has joined #tripleo10:26
*** paramite has quit IRC10:26
*** jprovazn has joined #tripleo10:27
*** jkilpatr has quit IRC10:33
shardymarios, dciabrin: Hey I'm about to add update_tasks, do we know how many steps are like to be required at this point?10:34
shardyOr should I just assume the same as upgrade_tasks as a starting point?10:34
mariosshardy: :/ been pulled into a case am afraid so not really able to respond too much here. well, lets make it same 6 but right don't expecte we'll need them all (maybe for bring down cluster before package update is the most immediate/obvious things we have to orchestrate)10:35
shardymarios: ack, yeah I was thinking we'd probably need less (do we even need all 6 for upgrade now?) but I'll make them same to start with and we can iterate on it10:36
*** fzdarsky is now known as fzdarsky|afk10:37
*** skramaja has quit IRC10:38
*** artom_ has quit IRC10:45
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Move step_config/docker_config calculation into services.yaml  https://review.openstack.org/48525010:57
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Move docker_puppet_tasks calculation into services.yaml  https://review.openstack.org/48568510:57
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Move services.yaml output calculation into Value resources  https://review.openstack.org/47925410:57
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Add RoleConfig output  https://review.openstack.org/48573110:57
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Move deploy-steps-playbook to deploy-steps-tasks  https://review.openstack.org/48568610:57
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Consolidate puppet/docker deployments with one deploy steps workflow  https://review.openstack.org/48329310:57
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Default docker_puppet_debug to false  https://review.openstack.org/48610310:57
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Add support for update_tasks  https://review.openstack.org/48610410:57
*** rook has quit IRC10:57
*** dtantsur is now known as dtantsur|bbl10:57
*** sai_ has quit IRC10:57
shardymatbu: Hey interested in your opinion on https://review.openstack.org/486104 - I'm wondering if we should convert upgrade tasks to when conditionals instead of tags, so we can do the same approach for generating an upgrade_tasks_playbook10:58
*** sai has joined #tripleo10:58
*** rook has joined #tripleo10:58
shardyIf we do that we could remove the playbook generation special-case from tripleoclient10:58
*** rook is now known as Guest1156210:59
*** flepied has quit IRC11:02
*** cylopez has quit IRC11:03
*** flepied has joined #tripleo11:03
*** jkilpatr has joined #tripleo11:09
*** shardy is now known as shardy_lunch11:10
*** pkovar has joined #tripleo11:16
*** ccamacho is now known as ccamacho|lunch11:17
*** pgadiya has quit IRC11:24
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Remove Mitaka release reference from validate-tempest  https://review.openstack.org/46886211:25
*** coolsvap has quit IRC11:27
*** ffiore has quit IRC11:29
atothbeagles, can I assume you know a thing or two about the ci scenarios?11:30
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Let's make yum transaction less expensive for tempest  https://review.openstack.org/48557411:37
*** colonwq has quit IRC11:38
therveCan I do a depend-on in tht on a puppet module?11:38
therveIt doesn't seem to be taken into account11:38
*** shardy_lunch is now known as shardy11:38
shardytherve: it should work for openstack puppet modules11:39
shardytherve: got a link to the patch?11:39
therveshardy, https://review.openstack.org/#/c/485124/111:39
*** colonwq has joined #tripleo11:39
shardytherve: the depends-on already merged so did you just get unlucky and have CI run after it merged but before rdo current was updated?11:41
therveshardy, I don't think so :). It merged yesterday, the build is from 2 days ago11:42
shardytherve: k, let me look more closely then :)11:42
shardyhttps://trunk.rdoproject.org/centos7/current/ seems to have the version you need now at least11:42
therveshardy, Well it was more for info :) Now it should be good indeeed11:42
*** paramite has joined #tripleo11:43
shardytherve: ah this is an upgrades job11:43
beaglesatoth: maybe literally "two things"... I can try to help if you want regardless11:43
beaglesatoth, what's on the go11:43
shardywe don't enable the overlay repo until the upgrade is started IIRC11:43
therveshardy, Hum no I was not looking at that one11:43
therveshardy, Was looking at the config on the regular jobs11:43
shardyAh I just looked at the only one that failed :)11:43
therveshardy, Like http://logs.openstack.org/24/485124/1/check/gate-tripleo-ci-centos-7-scenario002-multinode-oooq/5684e11/logs/subnode-2/rpm-qa.txt.gz11:44
thervepuppet-zaqar-11.2.0-0.20170719095646.4369b01.el7.centos.noarch11:44
shardyhttp://logs.openstack.org/24/485124/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/020df72/console.html#_2017-07-19_09_59_00_80226311:46
shardySo we see it get built there11:46
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart master: enable container periodic job  https://review.openstack.org/47574311:47
therveshardy, Doesn't it say "packages not built correctly" ?11:47
*** lucasagomes is now known as lucas-hungry11:47
shardyyeah I think that's a weird dlrn thing, it built one package and complains it didn't build $others I think11:47
*** abishop has joined #tripleo11:48
*** sbrzozow has joined #tripleo11:49
shardyhttp://logs.openstack.org/24/485124/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/020df72/logs/overcloud-controller-0/var/log/yum.log.txt.gz11:50
shardyhttp://logs.openstack.org/24/485124/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/020df72/logs/undercloud/home/jenkins/install_built_repo.log.txt.gz11:50
shardythose seem to show puppet-zaqar and t-h-t get updated from gating_repo?11:51
atothbeagles, scenerio003 blows up neutron when I add the lbaas stuff to it. I'm trying to test locally doing a overcloud deploy with scenario 3 yaml passed as a -e arg. the problem there is the install blows up even if I don't add the lbaas stuff to it11:51
beaglesatoth, is there a patch u/s that I can look at logs?11:52
beaglesatoth, I think the answer is yes, right.. I was just looking at one last night :)11:52
atothbeagles, so I'm looking to figure out how to run the scenario with out having the push the patchset each time as I'm going to piecemeal the lbaas stuff in to see which piece is breaking it11:52
shardyhttp://logs.openstack.org/24/485124/1/check/gate-tripleo-ci-centos-7-scenario002-multinode-oooq/5684e11/logs/undercloud/home/jenkins/install_built_repo.log.txt.gz11:52
therveshardy, Ah so it installed the right version?11:53
shardytherve: ^^ so it's installed that version, but you think it's not built the right hash?11:53
therveHum I don't know about that actually11:53
therveshardy, Sorry, maybe my change didn't work then11:54
shardytherve: ack, np - let me know if you dig further and think it is CI related11:54
therveThanks for looking11:55
*** colonwq has quit IRC11:55
beaglesatoth, ah... I wonder if neutron-lbaas package isn't getting installed in multinode11:55
therveIt worked in the puppet CI scenario002 which is weird11:55
beaglesatoth, multinode is a slightly different beast - 1s11:55
atothbeagles, oops looks like I switched channels there mistakenly :-)11:56
beaglesatoth, :)11:56
*** colonwq has joined #tripleo11:56
*** paramite has quit IRC11:56
atothbeagles, yeah, but I thought the ensure package was taking care of that, or are you saying it isn't available in the repo?11:57
beaglesatoth, that's a good point... mmm11:57
atothbeagles, when I looked at the neutron log I was wondered if the lbaasv2 alias wasn't defined, but as I don't know where those aliases are defined I could verify it11:59
*** morazi has joined #tripleo11:59
chandankumartrown|outtypewww: can we get -2 removed from this patch https://review.openstack.org/#/c/468862/ as mitaka eol is already tagged12:01
beaglesatoth, does the config (not CI, just regular deployment) work in your development environment?12:02
atothbeagles, yep12:03
beaglesatoth (I think it's done in setup.cfg btw)12:03
atothbeagles, I'm assuming it's the aliases are not changed for individual scenarios though12:04
*** cylopez has joined #tripleo12:04
beaglesatoth, no.. which leads me back to things not being installed properly..12:05
* beagles ruminates on other service plugins that are not part of the neutron package that might be exercised in CI12:05
beaglesI can't think of one12:05
openstackgerritChristian Schwede proposed openstack/tripleo-heat-templates master: Add Swift dispersion profile  https://review.openstack.org/47625512:05
beaglesatoth, if you want to "hack in" a check you could put the full class name instead of the alias in the scenario12:06
*** artom has joined #tripleo12:07
numansEmilienM, shardy, beagles Hi, with the patch https://review.openstack.org/#/c/475423/ merged in project-config, networking-ovn gate is broken. can you please have a look at this patch - https://review.openstack.org/#/c/484868/12:07
beaglesatoth, whether it works or not you know something new, if it works, then the install is "funny" and not behaving as expected - if it doesn't work, then you know it isn't getting installed at all12:07
atothbeagles, yeah, one of the avenues I was going to go, but if I can't test it locally it'll take for ever to run12:07
beaglesatoth, can you clarify what is happening locally?12:08
weshayeasy doc review if someone has a sec https://review.openstack.org/#/c/447576/12:08
*** paramite has joined #tripleo12:08
atothbeagles, let me throw together a pastebin for you12:09
beaglesatoth, cool12:09
therveshardy, I'm a dummy, it got built before a fix on the depend12:11
shardytherve: aha, mystery solved :)12:11
*** fragatina has joined #tripleo12:14
shardynumans: lgtm but as EmilienM said we need to recheck to trigger the scenario, I just did that12:14
numansshardy, thanks.12:14
panda|offis there some documentation for the containers prepare command ?12:15
*** panda|off is now known as panda12:15
numansshardy, i am not too familiar with CI, is this tripleo quickstart patch also required  ? - https://review.openstack.org/#/c/484097/12:15
*** slagle has joined #tripleo12:15
shardypanda: there is https://review.openstack.org/#/c/475958/12:15
shardyneeds a rebase by the looks of it12:15
pandashardy: ah thanks. I thought I could specify also the registry to use to pull images from12:19
atothbeagles, https://pastebin.com/0PQKqe0v12:19
beaglesatoth, mmmm.. what is this of, are you trying to run the scenario locally or is this just a deployment?12:20
shardypanda: yup you can like openstack overcloud container image prepare --namespace=192.168.1.16:8787/tripleoupstream --env-file=$HOME/containers-parameters.yaml12:20
shardywhere 192.168.1.16:878 is the registry host/port12:20
atothbeagles, good question :-)12:20
atothbeagles, I want to run the scenario but the only way I could think to do it was through an overcloud deploy12:21
pandashardy: so even something like openstack overcloud container image prepare --namespace=trunk.registry.rdoproject.org/tripleo would work ?12:21
atothbeagles, how SHOULD I run a scenario?12:21
beaglesatoth, yup, that's cool... I was just wondering if you figured out how to do a multinode scenario locally - in which case I'm going to be useless :)12:22
shardypanda: yup I think so12:22
beaglesatoth, though it probably isn't that big of a deal, I just haven't tried it ...12:22
atothbeagles, now I'm thinking it may be because I'm only using 1 compute and one controller but couldn't say for sure as I know nothing about these scenarios :-)12:23
pandashardy: \o/ thanks.12:23
beaglesatoth, mmmm... wait12:23
*** jaganathan has quit IRC12:23
*** dprince has joined #tripleo12:24
beaglesatoth, can you supply the command line for how you're deploying?12:25
beaglesatoth, if you are trying to pull in multinode specific yaml with a straight deploy that probably isn't going to work12:25
beaglesatoth, you might be better off just doing away with your alias in your scenario patch and see what happens -12:26
beaglesatoth, because if it works in your environment both ways, you learn nothing except "it is supposed to work"12:26
*** ansmith has joined #tripleo12:27
beaglesatoth, at the moment the lbaas packages have either been installed directly in the disk image or container12:28
openstackgerritDamien Ciabrini proposed openstack/tripleo-heat-templates master: Fall back to non-containerized cinder-backup and cinder-volume for HA  https://review.openstack.org/48612112:28
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Add support for update_tasks  https://review.openstack.org/48610412:28
atothbeagles, openstack overcloud deploy --templates -e /usr/share/openstack-tripleo-heat-templates/ci/environments/scenario003-multinode.yaml12:28
beaglesatoth,  so multinode might be throuwing a wringle12:28
beaglesatoth, yeah, I would not expect that to work12:28
atothbeagles, ok, why not?12:28
beaglesatoth, maybe it should, but I wouldn't expect it to12:29
atoth:-)12:29
beaglesatoth, hold on...12:29
*** gkadam has quit IRC12:29
atothbeagles, I know nothing about it so I could say whether it should work or not :-)12:30
beaglesatoth, OS::TripleO::Controller::Net::SoftwareConfig: ../common/net-config-multinode.yaml12:32
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart master: enable container periodic job  https://review.openstack.org/47574312:32
beaglesatoth, you *could* try just commenting out those lines locally and see what you get12:32
beaglesatoth, (there's one for Compute as well)12:33
openstackgerritMerged openstack/tripleo-heat-templates stable/newton: Revert "Use optimal (instead of default) tunables for Ceph on upgrade"  https://review.openstack.org/48574612:33
atothbeagles, ok I'll give that a shot, what is in that file?12:34
beaglesatoth, multinode involves "pre-setup", those files contain commands like adding ip addrs to existing devices12:34
atothbeagles, ah12:34
beaglesatoth,  if you try running them in a non-multinode setup those things (among others likely) will fail12:35
atothbeagles, deploy started, we'll see what happens :-)12:35
beaglesatoth, kind of curious because if it works, I'll toss some modified scenarios in my deployment mix12:36
*** rlandy has joined #tripleo12:36
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart-extras master: WIP: enable containers periodic job  https://review.openstack.org/47574512:36
*** atoth is now known as atoth_guinea_pig12:37
* beagles is slowly getting around to a "standardized + variables" setup including mixed baremetal virtual overcloud nodes 12:37
beagles(for SR-IOV)12:37
*** atoth_guinea_pig is now known as atoth12:37
beaglesjust wish I had an IPMI capable SR-IOV box.. fake_pxe is getting on my nerves12:37
atoth:-)12:38
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart-extras master: WIP: enable containers periodic job  https://review.openstack.org/47574512:38
*** pchavva has joined #tripleo12:39
*** trown|outtypewww is now known as trown12:40
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574712:40
trownchandankumar: I will do 1 better and put +2 :)12:40
*** lucas-hungry is now known as lucasagomes12:45
*** leitan has joined #tripleo12:48
openstackgerritSteven Hardy proposed openstack/python-tripleoclient master: Consume new RoleConfig data in config download  https://review.openstack.org/48573212:48
*** jrist has quit IRC12:49
chandankumarafazekas: panda: sshnaidm please have a look on this review https://review.openstack.org/#/c/485574/512:49
*** ffiore has joined #tripleo12:50
*** cylopez has quit IRC12:50
*** ccamacho|lunch is now known as ccamacho12:51
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574712:51
*** rhallisey has joined #tripleo12:51
*** florianf has quit IRC12:52
*** paramite has quit IRC12:54
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Add support for update_tasks  https://review.openstack.org/48610412:54
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Move setfiles to outside chroot with runcon  https://review.openstack.org/48589912:55
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Undercloud deploy with multiple source containers  https://review.openstack.org/48613512:56
bogdandofolks, w/o that patch ^^ undercloud deploy fails for me with "Property DockerNeutronConfigImage not assigned"12:56
bogdandoI wonder how does it pass CI...12:57
*** cylopez has joined #tripleo12:57
*** florianf has joined #tripleo12:59
shardyflorianf: Hi!13:00
shardyflorianf: Hey I was wondering, is there a reason we do role.lower() in tripleo-ansible-inventory?13:00
shardyI would prefer it if we maintained the case so it matches all the data output by heat13:00
shardyany objections to me pushing a patch for that?13:00
shardysame question re service names, but I think they're all lowercase in t-h-t anyway13:01
*** dparkes has joined #tripleo13:01
*** gbarros has joined #tripleo13:01
*** jrist has joined #tripleo13:03
*** ramishra has quit IRC13:03
openstackgerritSteven Hardy proposed openstack/tripleo-validations master: Don't modify case of role names in inventory  https://review.openstack.org/48614013:03
*** jcoufal has joined #tripleo13:04
*** cdearborn has joined #tripleo13:04
*** ramishra has joined #tripleo13:05
leitanHi guys, my nodes are not "asuming" the roles that i have specified for them , im using preprovisioned nodes, they run basic tasks but the openstack undercloud installation never starts13:06
leitanany pinpoint ?13:06
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574713:07
bogdandoleitan: os-cloud-config should be reconfigured to detach from host openstack cloud13:07
florianfshardy: I think the only reason is to maintain some sort of consistency.13:07
shardyflorianf: Ok, consistent with what? :)13:07
leitanos-cloud-configs gets the URL and i can see on the heat resource detail that the ControllerDeployedNode role is assigned13:07
shardyI was thinking it's be more consistent if it matched what's in roles_data.yaml, and the heat outputs13:08
bogdandoleitan: like here https://github.com/slagle/traas/blob/085da1462972c39c4edcece2e2b7a4691b3dd5ad/templates/toci-job.yaml#L11313:08
shardybut open to other ideas13:08
leitanso im wondering why it doesnt start installing, what do you mean to be "reconfigured" bogdando ?13:08
florianfshardy: With the way the inventory sections are usually named.13:08
shardyflorianf: if we think it's going to break anything, I can add duplicate groups with case maintained and .lower()13:08
florianfshardy: But I don't have a strong opinion on that. :-)13:08
bogdandoleitan: for my case, it was just hanging until timed out, w/o that reconfiguration step13:08
shardyflorianf: ack, I ran into it testing minor updates13:09
*** suuuper has joined #tripleo13:09
shardyflorianf: and it's kind of weird do to --limit controller13:09
shardywhen the role is called Controller13:09
shardybut I guess we could support both13:09
florianfshardy: I guess duplicates would be confusing. So I'm fine with getting rid of the .lower() conversion13:09
shardy--limit computeovsdpdkcustomrolefoo13:09
shardyflorianf: Ok thanks, I pushed a patch so perhaps you can check it when you get a moment :)13:10
flaper87gfidente: http://logs.openstack.org/59/471759/37/experimental/gate-tripleo-ci-centos-7-scenario006-multinode-oooq-nv/103f2fa/logs/undercloud/var/log/heat/heat-engine.log.txt.gz#_2017-07-20_14_46_54_07813:10
flaper87gfidente: debugging now13:10
florianfshardy: Sure, of course :-)13:10
atothbeagles, same story, deploy fails13:10
*** agopi has joined #tripleo13:11
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Let's make yum transaction less expensive for tempest  https://review.openstack.org/48557413:11
leitanbogdando: its weird cause when i inspect the stack, the only thing i see that its going to be installed of tripleO is OS::TripleO::DeployedServer::ControlPlanePort OS::TripleO::DeployedServer::Bootstrap13:11
beaglesatoth, with NetworkDeployment failures?13:11
beaglesatoth, or something else?13:11
atothbeagles, yep13:11
leitanbogdando: nothing about neutron, glance, nova, etc ...13:11
atothbeagles, I did not comment out OS::TripleO::Compute::Net::SoftwareConfig: ../common/net-config-multinode.yaml though13:12
beaglesatoth, oh haha13:12
bogdandoleitan: do you use undercloud install or undercloud deploy?13:13
beaglesatoth, that's probably the issue13:13
beaglesatoth, you basically don't want anything multinode specific13:13
bogdandothe latter works for me on openstack cloud based VMs, but I have yet tried the former leitan, can't say much about it13:13
leitanbogdando: undercloud deploy (following the docs of pre-provisioned nodes)13:13
beaglesatoth, in the meantime I recommend you try the fully-scoped class in the u/s patch instead of the alias - fight the battle on two fronts13:13
bogdandoleitan: manual, or with quickstart roles?13:14
atothbeagles, yeah, that was my thought too :-)13:14
leitanbogdando: we are using custom roles13:14
*** tzumainn has joined #tripleo13:14
flaper87gfidente: oh, mmh, apparently, on-success is missing in Heat's mistral external resource definition13:15
bogdandoleitan: aside from https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/deployed_server.html I can only share inventory variables that work for me...13:15
gfidenteflaper87 no this is unrelated to the execution13:15
gfidenteit's related to the task resource13:15
leitanbogdando: that will be very helpfull13:16
bogdandobasically, I'm struggling to deploy custom roles UC then overcloud on top, leitan13:16
sri_shardy: while deploying overcloud faild with this error "Error: ceilometer-upgrade --skip-metering-database returned 1 instead of one of [0]" , i've seen there is couple of bug reports on this but that was 2 to 3 months ego , I am using stable/ocata !!13:16
*** jmelvin has joined #tripleo13:16
leitanbogdando: we are struggling with custom roles for the overcloud13:16
flaper87gfidente: oh, mmh, it's on_success13:16
flaper87gfidente: not on-success13:16
bogdandodidn't yet succeed with overcloud on pre-provisioned, by quickstart. But UC works for me13:16
flaper87why is this inconsistent?13:16
gfidenteflaper87 yeah check os::mistral::task properties13:16
bogdandoleitan: so here is my inventory vars / playbooks  https://github.com/bogdando/oooq-warp13:16
flaper87gfidente: already did, it's on_success13:17
*** fzdarsky|afk is now known as fzdarsky13:17
jristhonza: are you familiar with this error? http://logs.openstack.org/75/486075/1/check/gate-tripleo-ui-nodejs6-npm-run-lint/7a17625/console.html13:17
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy kubernetes using TripleO on the overcloud  https://review.openstack.org/47175913:18
leitanbogdando: ill check that out thanks !13:18
shardysri_: pradk may be able to help identify the ocata backports needed, so you can ensure you have them13:18
jristhonza: or can I just fire off a recheck13:18
honzajrist: looking13:18
honzajrist: recheck won't help, the language check fails http://logs.openstack.org/75/486075/1/check/gate-tripleo-ui-nodejs6-npm-run-lint/7a17625/console.html#_2017-07-21_09_47_36_17059713:19
shardyjtomasek: Hey, does the UI currently have support for controlling minor updates?13:20
jristhonza: ahhhh, I was wondering about that13:20
bogdandoleitan: this is my current playbook https://github.com/bogdando/oooq-warp/blob/master/playbooks/oooq-traas-under.yaml and the inventory vars https://github.com/bogdando/oooq-warp/blob/master/custom.yaml_example. In order to create a static inventory from openstack, I use my custom patches https://review.openstack.org/#/c/463701/ and this playbook https://github.com/bogdando/oooq-warp/blob/master/playbooks/oooq-traas.yaml13:20
shardye.g the workflow implemented via openstack overcloud update13:20
bogdandocan't say how it is expected to go with the quickstart.sh / devmode leitan. I'm using that off-road way only so far13:21
honzajrist: needs to be added here https://github.com/openstack/tripleo-ui/blob/master/src/js/constants/i18n.js#L113:21
honzajrist: 'fr'13:21
sri_shardy: thanks13:21
jristhonza: for that patch? or permanently13:23
honzajrist: permanently --- each new language should be added13:23
jtomasekshardy: what does it mean specifically?13:23
jristhonza: should be automatic https://review.openstack.org/#/c/486075/ ?13:23
jristah13:24
jristhonza: separate patch?13:24
jristdepends-on ?13:24
honzajrist: probably13:24
shardyjtomasek: it does a rolling minor update of the nodes, using breakpoints to apply a script that controls pacemaker and runs yum update on each node13:24
honzajrist: hmmm, i guess we could update the zanata one13:24
honzajrist: that might be cleaner13:24
jristhonza: go on... :)13:24
jristI'm listening13:24
honzajrist: want me to do it?13:24
jristhow?13:24
jristor tell me and I wil :)13:25
shardyjtomasek: the reason I ask is the approach is changing to support containers soon, I just pushed a bunch of patches and wasn't sure if we need to consider UI updates13:25
jristthis wasn't covered in jpich's deep dive :)13:25
leitanbogdando: im actually trying to install a production cloud with triple0, finding it unnecesarily complicated (used to deploy full clouds with ansible) but it need it for homologation13:25
*** catintheroof has joined #tripleo13:25
openstackgerritDamien Ciabrini proposed openstack/puppet-tripleo master: Prevent haproxy to run iptables during docker-puppet configuration  https://review.openstack.org/48614113:25
jtomasekshardy: we can't do this from UI, so I think the patches does not affect UI13:25
honzajrist: pull down that patch, add the 'fr': 'French' entry to the constants/i18n.js file, amend the commit and git review13:25
jristhonza: ah13:25
jristhonza: noted!13:26
jristwill do13:26
jristhonza: I thought you meant do something in zanata13:26
honzajrist: thanks --- i think we could improve the lint error message, too13:26
shardyjtomasek: Ok that's good - FYI the new approach is using ansible, so I suspect we can drive it via a mistral workflow similar to validations in future13:26
honzajrist: ie add next steps13:26
jristhonza: separate patch :)13:26
shardyif the UI doesn't need that right now though, we might run ansible from tripleoclient as a first step13:26
*** catinthe_ has joined #tripleo13:26
honzajrist: yes, for sure13:26
honzajrist: low priority13:26
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart master: enable container periodic job  https://review.openstack.org/47574313:26
pabelangerEmilienM: is anybody working on making undercloud-containers more stable? http://status.openstack.org/elastic-recheck/data/others.html#gate-tripleo-ci-centos-7-undercloud-containers13:27
openstackgerritToure Dunnon proposed openstack/tripleo-common master: tripleo-common sudoers file is to permissive.  https://review.openstack.org/48614213:27
pabelangerEmilienM: I tried to debug a job failure but don't see much logging collected.  Seems to be missing some log files compared to quickstart jobs13:27
*** iranzo has quit IRC13:27
jtomasekshardy: cool13:27
pabelangereg: undercloud log folder13:27
*** iranzo has joined #tripleo13:28
*** iranzo has joined #tripleo13:28
openstackgerritToure Dunnon proposed openstack/tripleo-common master: tripleo-common sudoers file is to permissive.  https://review.openstack.org/48614213:28
*** eck`gone is now known as eck`13:28
bogdandoleitan: I've shared that I have for development environments by quickstart ansible roles, like devstack for openstack, you know... I suppose that does not fit production environments :) Other folks here should know more on that topic13:28
*** ecerquei has joined #tripleo13:30
openstackgerritJason E. Rist proposed openstack/tripleo-ui master: Imported Translations from Zanata  https://review.openstack.org/48607513:30
jristhonza: ^13:30
*** catintheroof has quit IRC13:30
jristakrivoka: ^13:30
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574713:30
honzajrist: that should do it13:31
*** florianf has quit IRC13:32
*** dtantsur|bbl is now known as dtantsur13:32
jristhonza: thanks for your help (and brainzzzz)13:32
honzajrist: np!13:32
jristalso I might have reordered it because I'm slightly OCD that way13:33
*** florianf has joined #tripleo13:33
leitanbogdando: we were looking forward to do it too, once we have a working deploy13:34
sri_pradk : hi can you help with this , while deploying overcloud faild with this error "Error: ceilometer-upgrade --skip-metering-database returned 1 instead of one of [0]" , i've seen there is couple of bug reports on this but that was 2 to 3 months ego , I am using stable/ocata !!13:36
bogdandoleitan: there are also much better experts here for pre-provisioned nodes and custom overcloud roles, like  shardy and slagle :)13:36
pradksri_, yea we fixed this recently13:36
pradksri_, https://review.openstack.org/#/c/482712/ is the ocata patch13:37
bogdandoI can try to help to address quickstart questions though13:37
bogdandothere is also a #oooq channel for advanced quickstart topics13:37
sri_pradk: thanks13:38
*** rbowen has quit IRC13:38
*** rbowen has joined #tripleo13:38
*** anshul has quit IRC13:38
honzajtomasek: would you mind hitting the +1 workflow on this? https://review.openstack.org/#/c/483979/ thanks13:40
leitanbogdando: thanks for the help !13:40
jtomasekhonza: done13:41
honzajtomasek: \o/13:41
*** jcoufal_ has joined #tripleo13:41
leitanshardy slagle do you guys know why after running BootsTrap and ControlPlanePort, my nodes stops there and doesnt start the component installations ? (im using pre provisioned nodes, defined the roles )13:41
leitanim seem that after running deployed-servers.yml, doesnt do anything else13:42
*** george_goh has quit IRC13:43
*** links has quit IRC13:43
*** jcoufal has quit IRC13:43
EmilienMhello13:43
openstackgerritMerged openstack/tripleo-heat-templates stable/ocata: Revert "Use optimal (instead of default) tunables for Ceph on upgrade"  https://review.openstack.org/48574513:43
*** suuuper has quit IRC13:43
*** suuuper has joined #tripleo13:44
leitanshardy slagle were passing the "-r deployed-server-roles-data-mycustom.yaml" at the end of the command, seems to be ignoring it13:44
openstackgerritMerged openstack/puppet-tripleo stable/newton: Use correct manage_firewall hieradata  https://review.openstack.org/48570913:44
EmilienMpabelanger: not afik13:44
EmilienMpabelanger: what is the problem? I'm happy to help now13:45
pabelangerEmilienM: http://status.openstack.org/elastic-recheck/data/others.html13:45
pabelangerEmilienM: these are the reasons why the gate pipeline for tripleo jobs are so high13:45
pabelangerEmilienM: just curious if anybody is working to fix them13:45
pabelangerpep8 seems like a easy fix13:46
openstackgerritToure Dunnon proposed openstack/tripleo-common master: tripleo-common sudoers file is to permissive.  https://review.openstack.org/48614713:46
pabelangerbut not sure how broken code would have landed in tripleo-heat-templates13:46
EmilienMpabelanger: I'm not sure if someone is working on this one (I just woke up)13:47
slagleleitan: you could start by checking the agents on the nodes to see if they're stuck doing something, or pulling new metadata from heat, etc13:47
pabelangerEmilienM: okay13:47
EmilienMhttp://logs.openstack.org/35/483535/4/gate/gate-tripleo-heat-templates-pep8-ubuntu-xenial/6dcbcb6/console.html#_2017-07-20_17_22_51_08940213:48
*** nmathew has joined #tripleo13:48
EmilienMsounds like contrail broke us13:48
EmilienMpabelanger: let me investigate13:48
leitanslagle: they are not, they finish running basic tasks from BoosTrap and our nooped Ports, and they stop doing anything13:48
EmilienMpabelanger: the problem seems resolved: https://review.openstack.org/#/c/48568513:48
EmilienMpabelanger: I don't see the problem anymore13:49
EmilienMat least for pep813:49
openstackgerritDamien Ciabrini proposed openstack/tripleo-heat-templates master: Fix creation of iptables rules for non-HA containerized HAproxy  https://review.openstack.org/47418313:49
pabelangerEmilienM: any idea on what fixed it or why it broke?13:50
leitanslagle: but wondering also, why our nova/neutron etc roles, doesnt come up on the list when we do a stack resource list using the phyisical resource id of the Role13:50
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart master: enable container periodic job  https://review.openstack.org/47574313:50
EmilienMpabelanger: you also mentioned gate-tripleo-ci-centos-7-undercloud-containers, let me see13:50
EmilienMpabelanger: if you look at gate-tripleo-ci-centos-7-undercloud-containers on http://cistatus.tripleo.org/ - it has more than 85% of success overall, and 92.7 yesterday13:51
EmilienMpabelanger: so not sure why you say it's unstable13:51
slagleleitan: do you mean you resource list the respective OS::Heat::ResourceGroup and it's empty?13:51
pabelangerEmilienM: that is on gate pipeline?13:52
EmilienMpabelanger: I found why pep8 is failing13:52
EmilienMpabelanger: yes, gate pipeline13:52
EmilienMpabelanger: for pep8, this is the reason: https://review.openstack.org/#/c/483535/13:52
leitanslagle: openstack stack resource show overcloud ControllerDeployedServer -c physical_^Csource_id -f value13:53
leitanthen13:53
leitanopenstack stack resource show 5b7dc02d-97f1-4e65-be14-e5a400fd85fd ControllerDeployedServer -c physical_resource_id -f value13:53
EmilienMpabelanger: we'll look at this one more closely13:53
leitanand finally openstack stack resource list 32677512-63f3-4373-b290-2a6d9516a75213:53
mwhahahaEmilienM: that hasn't merged yet?13:53
sri_pradk: if I want to monkey patch this bug  https://review.openstack.org/#/c/482712/ where do I need modify my heat-templates ?13:53
leitanslagle: and inside , theres only this:13:53
pabelangerEmilienM: IMO, you need to bump that pass rate much higher. Because, any failure in gate pipeline will cause subsequent jobs to be re-run (a gate reset). This is the reason your change queue is up to 16hr+ ATM13:53
EmilienMmwhahaha: sounds like now13:54
atothbeagles, Success! commenting out those 2 lines worked locally :-)13:54
mwhahahastrigazi: http://hardysteven.blogspot.com/2016/08/tripleo-deploy-artifacts-and-puppet.html example 2 to monkey patch puppet-tripleo13:54
pabelangerEmilienM: the removal of citycloud-sto2 has helpped also13:54
EmilienMpabelanger: sounds like easy to say13:54
leitanslagle: http://paste.openstack.org/show/616169/13:54
atothbeagles, time to see if my update breaks stuff locally too :-)13:54
mwhahahastrigazi: sorry wrong person13:54
mwhahahasri_: -^13:54
pabelangerEmilienM: Yup, devstack starts blowing up if more then 1% failures13:54
slagleleitan: 32677512-63f3-4373-b290-2a6d9516a752 is a nested stack for a given individual server13:55
strigazi@mwhahaha np13:55
slagleleitan: you aren't going to see other nodes/roles/whatever there13:55
slagleleitan: you'd need to list the top level stacks of type OS::Heat::ResourceGroup to see the other nested stacks13:55
chandankumarEmilienM: can we get this merged https://review.openstack.org/#/c/485477/ ? so that you can rebase your package, we will fulfull qa wishes xD13:55
leitanslagle: so the roles that should be applied to the nodes are going, like nova neutron etc, should be on the top level stacks ?13:56
sri_mwhahaha: thanks13:56
slagleleitan: resource list accepts a --filter, i'd suggest using that to filter on type. it's easier to see OS::Heat::ResourceGroup that way13:56
pabelangerEmilienM: cool, will keep and eye on 48353513:56
beaglesatoth, awesomee13:56
*** ffiore has quit IRC13:56
slagleleitan: what i'm saying is that the other nodes resources are in different stacks13:57
pabelangerEmilienM: how long as undercloud-containers been in the gate? Recent addition?13:57
slagleleitan: you have to go resource list those stacks to see those resources13:57
leitanslagle: ok but thats not what im doing when checking the resource show at the "ControllerDeployedServer" ?13:58
EmilienMpabelanger: let me find out in git13:58
slagleleitan: nope. ControllerDeployedServer would only contain the stacks for nodes corresponding to the role ControllerDeployedServer13:59
slagleleitan: here is another way you can see the resoruces: https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/deployed_server.html#manual-configuration-of-heat-agents13:59
leitanslagle: right, but inside that stacks should be the nova api / neutron roles ? or should be on the top stack ?14:00
*** ffiore has joined #tripleo14:00
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Make HA container bundle work on remote nodes  https://review.openstack.org/48607614:00
leitanslagle: ill create the stack again and follow that guid14:00
leitane14:00
slagleleitan: each role has it's own corresponding OS::Heat::ResourceGroup stack, that is at the first level under "overcloud"14:01
slagleleitan: the name of that stack matches the role name14:01
*** anshul has joined #tripleo14:01
slagleas I said, if you filter on OS::Heat::ResourceGroup you will see them14:01
EmilienMchandankumar: I thought you would rebase my patch ;-)14:02
EmilienMchandankumar: kidding. I'll do it14:02
leitanslagle: great ill try that as first, still wondering why it doesnt start installing the roles after running the basic Boostrap and ControlPlanePort , ill dig a little bit more14:02
*** Goneri has joined #tripleo14:02
chandankumarEmilienM: debian screwed me last night, i still didnot why it is not getting from pip14:02
EmilienMpabelanger: almost a month: https://review.openstack.org/#/c/478257/14:03
chandankumars/why/get why14:03
nmathewone quick regarding stack update14:03
*** anshul has quit IRC14:03
nmathewwhy --update-plan-only is not taking changed environment file?14:03
*** anshul has joined #tripleo14:03
*** tzumainn has quit IRC14:03
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: Change default network isolation type to multi-nic  https://review.openstack.org/47670414:04
*** dparkes has quit IRC14:05
*** _milan_ has joined #tripleo14:06
*** psachin has quit IRC14:06
matbushardy: if you don't have time for adding flag to disable update via heat, don't hesitate to ping i would be able to add it14:07
matbuthx for the awesome work btw :)14:07
*** milan has quit IRC14:07
*** cylopez has quit IRC14:07
shardymatbu: ack thanks!14:08
shardymatbu: one thing I may not have time to finish is https://review.openstack.org/#/c/483943/14:08
shardymatbu: I noticed the config download data is world-readable, that fixes it but the tests need updating14:08
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Use stdout_lines instead of stdout for subnode inventory  https://review.openstack.org/48339614:08
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Add node config variables to support deployed server  https://review.openstack.org/48568914:09
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Remove vars from multinode common config which can be overriden  https://review.openstack.org/48615414:09
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: WIP Add featureset for 3nodes multinode job  https://review.openstack.org/48615514:09
nmathewWhen I add a new parameter_defaults in new environment file, stack is failing saying unknown "parameter" any hints?14:09
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart master: enable container periodic job  https://review.openstack.org/47574314:09
chandankumartrown: https://review.openstack.org/485574 packages are not getting updated on undercloud through yum install.14:09
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Use stdout_lines instead of stdout for subnode inventory  https://review.openstack.org/48339614:09
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Add node config variables to support deployed server  https://review.openstack.org/48568914:09
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: WIP Add featureset for 3nodes multinode job  https://review.openstack.org/48615514:09
chandankumartrown: higher version of package is the available in the repo but yum is saying something installed version is the higher package14:10
chandankumari donot know what is wrong with the yum on undercloud14:10
chandankumarplease have a look14:10
trownchandankumar: I think that happens just after we promote an image in tripleo-ci14:10
trownchandankumar: because there is a repo on the image that is not yet propogated to mirrors14:11
chandankumartrown: how to get it fixed?14:11
trownchandankumar: should fix itself later today if that is the issue14:11
trownchandankumar: just takes time for the repo to propogate14:11
chandankumartrown: tempest jobs are failing as it failed to pick the latest tempestconf packages14:11
chandankumararxcruz: ^^14:12
chandankumartrown: ack!14:12
trownchandankumar: how long have they been failing... just this morning?14:12
*** jcoufal has joined #tripleo14:12
chandankumartrown: from tomorrow14:12
trownhmm... that might not be it then14:12
matbushardy: k , i will test it and update it if needed14:12
trownchandankumar: do you have a way to test your patch to see if it fixes the tempest jobs?14:13
chandankumarhttps://review.gerrithub.io/370454 got merged  tomorrow14:13
shardymatbu: ack thanks, I think the patching of open in the test needs to be modified14:13
*** tzumainn has joined #tripleo14:13
*** radeks has quit IRC14:13
*** jcoufal_ has quit IRC14:13
chandankumartrown: patch contains rpm is available in repo and but yum is not picking it14:13
shardynmathew: Hi, can you share your environment, and the exact error on paste.openstack.org?14:13
*** jprovazn has quit IRC14:14
nmathew@shardy yes14:14
openstackgerritJason E. Rist proposed openstack/tripleo-quickstart-extras master: Missing conversion for ironic-inspector port in tripleo-ui config  https://review.openstack.org/47767514:15
pradksri_, if you deploy from stable/ocata branch, it should already be in the tree14:15
arxcruzchandankumar: ack14:15
EmilienMdprince, shardy: pabelanger is asking me to disable undercloud-container in gate, which has too high % of failure (less than 20%) but it seems to block the gate since it reset the jobs when this one fails. I found out a trace in the CI job and was wondering if you know the error:14:15
EmilienMhttp://logs.openstack.org/96/483096/2/gate/gate-tripleo-ci-centos-7-undercloud-containers/43be4d1/logs/var/log/undercloud_install.txt.gz#_2017-07-21_13_16_43_00014:16
dprinceEmilienM: looking14:16
jristweshay: ^^^14:16
weshaytrown, panda can we push this through please? https://review.openstack.org/#/c/477675/14:17
jristweshay: oh it was the renaming of the word mistral14:17
jristwho changed that in another patch lol14:17
leitanslagle: im seeing this with the ResourceGroup resource_type http://paste.openstack.org/show/616171/14:17
dprinceEmilienM: could be related to the fake keystone14:18
EmilienMdprince: would it be race or persistent?14:18
dprinceEmilienM: I've not seen it locally so not sure14:18
dprinceEmilienM: we've recently switch to ansible so it could be a race related to that too14:19
*** Guest11562 is now known as rook14:19
dprinceEmilienM: the feature is marked experimental so I would say having code land is probably more important than keeping this gating. That said... in the check queue this job would give us the fastest feedback (it runs *much* faster than a full overcloud)14:20
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: Don't fail if VM extradisks are already attached  https://review.openstack.org/47498114:20
nmathewshardy, please find the logs http://paste.openstack.org/show/616173/14:21
EmilienMdprince: I know :(14:21
EmilienMdprince: that's why I'm asking otherwise I would have just disabled it14:21
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras master: WIP Make env variables for multinode into ansible vars  https://review.openstack.org/48393014:22
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras master: Make deployed server bootstrap environment part of multinode  https://review.openstack.org/48615814:22
leitanslagle: after restarting the agents, it begin installing the basics, and all the stacks got to CREATE_COMPLETE state14:22
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci master: WIP Testing changes required to move 3nodes job to quickstart  https://review.openstack.org/48307714:22
leitanslagle: as follows: http://paste.openstack.org/show/616174/14:23
slagleleitan: ok, then it has moved onto the next steps14:24
*** eck` is now known as eck`gone14:25
shardynmathew: I think the problem is using --update-plan-only, if you do a normal deploy it will update the heat stack with the new environment14:26
shardynmathew: the problem is the plan in swift is updated, but heat doesn't know about the new parameter value14:26
*** jrist has quit IRC14:26
leitanslagle: it did, the only difference from previous runs is that we exported all the nodes into the roles variables (we were doing just 1) the deploy actually expect that all the declared nodes should be there ?14:26
shardythe overcloud update stack command doesn't pass the new plan data to heat IIRC, although arguably it should14:26
nmathewshardy, let me try a deployment instead of  --update-plan-only14:27
slagleleitan: check the documentation at https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/deployed_server.html#automatic-configuration-of-heat-agents14:28
*** eck`gone is now known as eck`14:28
nmathewshardy, this command required then "openstack overcloud update stack -i overcloud" ?14:28
EmilienMchandankumar: is subunit2html binary deployed with the tempest package?14:29
jkilpatrwhat channel would I go to if I wanted to get a coherent explanation of how oslodb works?14:29
jkilpatrthe documentation doesn't properly expalin what level of abstraction they want to do what14:29
EmilienMchandankumar: I think it's part of python-subunit right?14:29
shardynmathew: overcloud deploy ... will apply the new environment, and re-run puppet, overcloud update triggers a workflow where we do a rolling yum update of the nodes14:29
shardyso it depends which one you need (reconfigure or package update)14:30
shardynmathew: the issue is overcloud update can't currently do reconfigure and update in one pass14:30
shardyeven though that's technically possible via heat, it just isn't implemented that way14:31
nmathewshardy, thanks I will give a try14:31
*** myoung|remote has quit IRC14:33
chandankumarEmilienM: subunit2html comes from ostestr14:36
EmilienMchandankumar: I'm trying https://review.openstack.org/48525514:36
*** myoung|remote has joined #tripleo14:36
chandankumarEmilienM: debian will again screw up, let see14:37
*** rbrady has joined #tripleo14:37
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Add all existing parameter mismatches to exclusion list  https://review.openstack.org/48353514:37
chandankumarEmilienM: by queen may be we are moving stestr no dependency on testr or ostestr14:38
EmilienMpabelanger: let me today to figure out if we disable undercloud-container job, I'm still looking at "why" it fails and see if it's random, consistent or absent14:38
EmilienMchandankumar: it's not debian, it's ubuntu, fyi14:38
EmilienM(slighly different on packages)14:38
*** jrist has joined #tripleo14:39
*** jrist has joined #tripleo14:39
EmilienMchandankumar: why will it screw up? Because I don't pip install anymore?14:39
*** anshul has quit IRC14:39
chandankumarEmilienM: in my earlier patch when i doing pip install testreposity without sudo it is not picking up, so i espically added a if condition14:40
pabelangerEmilienM: sure, I'll keep looking at other job failures too, making sure it isn't related to the infrastructure14:40
MVenesioslagle: we are having an error installing the overcloud: "Error: Evaluation Error: The title 'cinder_volume' has already been used in this resource expression"14:41
abishopshardy: hoping you still might have time for https://review.openstack.org/#/c/471462/14:43
*** cshastri has quit IRC14:44
fultonj+1 on 471462, that would get the automated HCI tuning into pike14:44
EmilienMchandankumar: ok I'll restore this change if I see it failing14:44
shardyabishop: ack will do14:44
chandankumarEmilienM: sure,14:44
fultonjthanks14:45
*** |ance|ott has joined #tripleo14:45
|ance|otthi guys, I am having issues installing the undercloud on Centos7. I got this error:14:45
|ance|ottError: Syntax error at 'Boolean'; expected ')' at /etc/puppet/modules/rabbitmq/manifests/init.pp:3 on node undercloud.localdomain14:45
|ance|ottany help is appreciated14:46
abishopshardy: many, many thx!14:46
*** rlandy is now known as rlandy|brb14:46
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart master: enable container periodic job  https://review.openstack.org/47574314:46
sri_pradk: I installed my undercloud 15 day ago14:47
nmathewshardy, it failed again with same reason. logs here http://paste.openstack.org/show/616178/14:48
*** jlinkes has quit IRC14:48
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Add support for nova live/cold-migration with containers  https://review.openstack.org/47195614:49
leitanslagle: it started the instalation, but failed, used an amazing blog post to debug the stack by shardy, and i finally got "Evaluation Error: The title 'cinder_volume' has already been used in this resource expression at /etc/puppet/modules/tripleo/manifests/firewall.pp"14:50
*** myoung|remote has quit IRC14:50
leitanslagle: this can be repeated for some reason somewhere and its trying to apply the firewall rules two times ?14:50
shardynmathew: Hmm, can you paste the template where CssPackageName is used?14:51
nmathewshardy, it is there in the link itself14:52
nmathewshardy, 3rd cat14:52
sri_pradk: I have quick question is this "ceilometer/collector.pp" inside overcloud image ? I am not able to find this file in heat-templates14:52
*** dparkes has joined #tripleo14:53
pradksri_, hmm that would be under /usr/share/openstack-tripleo-heat-templates/ on undercloud14:53
pradksri_, i would suggest reinstalling with latest stable/ocata .. but you can monkey patch too14:53
pradksri_, alternately just git checout to /tmp and point --templates to that dir14:54
*** anshul has joined #tripleo14:54
sri_pradk: ok i think git checkout is easy thing to14:54
sri_do14:54
shardynmathew: ah, yeah doh!  The issue is the parameters aren't defined in the template where the get_param's are used14:55
pradksri_, actaully wait, the fix is to the puppet code not templates14:55
bnemec|ance|ott: It sounds like there's something wrong with your rabbitmq puppet package.  Maybe try reinstalling it.  It seems unlikely that a syntax error snuck into the init manifest.14:55
shardythe heat error is a little misleading is it's undefined, not "not provided"14:55
pradksri_, you need to update the modules in swift14:55
pradksri_, one sec lemme get the link14:55
*** atoth has quit IRC14:56
nmathewshardy, thanks, let me see14:56
|ance|ott@bnemec this is the log14:56
|ance|otthttps://pastebin.com/r8FX1fEP14:56
pradksri_, you will need to follow this http://hardysteven.blogspot.com/2016/08/tripleo-deploy-artifacts-and-puppet.html14:56
*** cdearborn_ has joined #tripleo14:56
|ance|ottit happens when i run openstack undercloud install14:57
pradksri_, see example 2 in that blog .. thats what you are looking for14:57
nmathewshardy, oh sorry, I got it, just like any other templates we need to define it, i hope original ones like "update_identifier" are defined internally14:58
abishopshardy: thank you !!!14:58
sri_pradk: Ok thanks for you help , I am reading about this  on that same link I got it form mwhahaha14:59
*** gfidente is now known as gfidente|afk14:59
shardynmathew: yeah anywhere you use get_param, the corresponding parameter must be defined in the parameters block15:00
shardyabishop: np!15:00
*** chandankumar is now known as daccontant15:00
*** gfidente has joined #tripleo15:00
*** gfidente has quit IRC15:00
*** gfidente has joined #tripleo15:00
*** shardy is now known as shardy_mtg15:00
nmathewshardy_mtg, thanks15:00
pradksri_, cool15:02
slagleleitan: yea, sounds like it's a problem with puppet and/or hieradata at this point15:02
openstackgerritSven Anderson proposed openstack/tripleo-heat-templates master: Use normal socket file permissions instead of polkit  https://review.openstack.org/48497915:02
bnemec|ance|ott: That doesn't change my recommendation.  There's something broken in your puppet-rabbitmq package.  You have to resolve that.15:02
leitanslagle: im specifically naming the cinder_volume to install on the controller node, but im also using the pacemaker resource, those too can be conflicting ? any quick pin points to debug this ?15:03
*** nmathew has quit IRC15:04
*** _milan_ has quit IRC15:04
openstackgerritOliver Walsh proposed openstack/puppet-tripleo master: Revert workaround for libvirt polkit auth with containers  https://review.openstack.org/47981615:04
bnemecMan, is there any way to see the pass/fail rate of patches in our gate?15:05
bnemecBecause it seems _terrible_.15:05
slagleleitan: you can look at the puppet error, track that back to the manifest/module being used, then see what hieradata is configuring that module with "cinder_volume" multiple times, then track the hieradata back to something in tripleo-heat-templates15:05
bnemecLike 20% passes, and that might be generous.15:05
slagleleitan: you don't have cinder volume included twice in your service list or something do you?15:06
openstackgerritMerged openstack/tripleo-docs master: Add step about deploying HA controllers with containers  https://review.openstack.org/48351515:06
*** |ance|ott has quit IRC15:06
leitani have cinder_volume and blockstorageCinderVolume, i assume that are not the same15:06
*** dprince has quit IRC15:07
leitanslagle: ^^15:07
slagleleitan: whre do you have those?15:07
slaglecan you paste your sevices list15:07
leitanslagle: yes15:08
leitanslagle: http://paste.openstack.org/show/616180/15:08
slagleleitan: yea, that's the issue. you don't want BlockStorageCinderVolume and CinderVolume on the same role15:10
slagleleitan: afaict, they map to the same thing, so you should just use CinderVolume on ControllerDeployedServer15:10
*** itlinux has joined #tripleo15:11
leitanslagle: wow thanks, thats a copy paste from somewhere mistake :)15:11
leitanre running !15:11
slaglei guess we have them separated like that in case you wanted to map one to the pacemaker implementation, and the other one not15:12
slaglei don't really know15:12
*** cdearborn has quit IRC15:12
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart master: enable container periodic job  https://review.openstack.org/47574315:12
slaglebut you definnitely can't have them on the same role15:12
leitanslagle: i understand, we are including pacemaker also, maybe inside is using the block one15:13
*** anshul has quit IRC15:14
daccontantEmilienM: here comes the failure http://logs.openstack.org/55/485255/2/check/gate-puppet-openstack-integration-4-scenario004-tempest-ubuntu-xenial/6781141/console.html#_2017-07-21_15_12_07_65297715:14
*** rcernin has quit IRC15:14
EmilienMdaccontant: ok, I'll revert the change after my mtg15:15
*** dparkes has quit IRC15:15
daccontantEmilienM: sure :-)15:16
daccontantEmilienM: might be somethign wrong is happening with puppet-tempest, need to check15:16
*** gfidente has quit IRC15:16
*** aufi has quit IRC15:17
*** jrist has quit IRC15:18
*** gfidente has joined #tripleo15:19
*** gfidente has quit IRC15:19
*** gfidente has joined #tripleo15:19
*** rlandy|brb is now known as rlandy15:19
daccontantRegarding barbican tempest plugin support in tripleo we need it first in puppet-tempest na?15:20
openstackgerritMerged openstack/tripleo-heat-templates master: Remove DockerNamespace references  https://review.openstack.org/47939815:20
*** ffiore has quit IRC15:22
EmilienMdaccontant: probably15:23
*** ebarrera has quit IRC15:25
*** dsariel_ has joined #tripleo15:25
*** suuuper has quit IRC15:26
*** gfidente has quit IRC15:26
*** dsariel has joined #tripleo15:26
*** jcoufal_ has joined #tripleo15:26
*** dpawar has quit IRC15:28
*** jcoufal has quit IRC15:28
*** lmiccini has quit IRC15:29
*** anshul has joined #tripleo15:31
*** gfidente has joined #tripleo15:32
*** gfidente has quit IRC15:32
*** gfidente has joined #tripleo15:32
*** shardy_mtg is now known as shardy15:33
EmilienMdaccontant: ./run_tests.sh: line 339: run_tempest/bin/subunit2html: No such file or directory on centos15:35
EmilienMdaccontant: sounds like subunit2html wasn't installed in the venv15:36
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci master: WIP Testing changes required to move 3nodes job to quickstart  https://review.openstack.org/48307715:36
daccontantEmilienM: https://github.com/openstack/os-testr/blob/master/setup.cfg#L3015:36
EmilienMdaccontant: ah, I see :)15:37
daccontantEmilienM: mwhahaha barbican tempest plugin support for puppet-tempest https://review.openstack.org/#/c/486166/ feel free to enable scenario for barbican15:37
EmilienMdaccontant: we already have15:37
EmilienMdaccontant: we have coverage for barbican already15:38
daccontantEmilienM: but in puppet-tempest it was not available15:38
EmilienMdaccontant: a sec15:38
daccontantEmilienM: and we have not packaged tempest plugin for barbican,15:38
EmilienMdaccontant: we test encrypted volume test which resides in cinder probably, and use barbican15:39
EmilienMthat's why15:39
EmilienMdaccontant: http://logs.openstack.org/77/485477/10/check/gate-puppet-openstack-integration-4-scenario002-tempest-centos-7/0fabfb8/console.html#_2017-07-21_09_35_16_87151515:39
EmilienMI think we're happy with this test now, since we don't want to test all barbican API but just integration tests15:39
daccontantEmilienM: sure, but if anybody needed, i have added it15:39
EmilienMdaccontant: but we can patch puppet-tempest for sure15:40
EmilienMdaccontant: yup, i'll review it15:40
EmilienMdaccontant: in fact I'm confused what is wrong in https://review.openstack.org/#/c/485255/2/run_tests.sh15:41
EmilienMdaccontant: except the pip install thing15:41
openstackgerritTim Rozet proposed openstack/tripleo-heat-templates master: Cleans up exec workaround for ODL container clustering  https://review.openstack.org/48616915:45
*** iranzo has quit IRC15:47
*** ffiore has joined #tripleo15:48
*** bogdando has quit IRC15:48
openstackgerritSteven Hardy proposed openstack/tripleo-validations master: Don't modify case of role names in inventory  https://review.openstack.org/48614015:50
*** rbrady has quit IRC15:50
*** flepied has quit IRC15:51
openstackgerritTim Rozet proposed openstack/tripleo-heat-templates master: Cleans up exec workaround for ODL container clustering  https://review.openstack.org/48616915:54
*** gfidente has quit IRC15:55
leitanslagle: making some progress here, did you guys see the error of neutron-server not able to start due to missing /etc/neutron/plugin.ini file ?15:56
*** florianf has quit IRC15:56
*** jrist has joined #tripleo15:57
*** dsariel has quit IRC15:57
gbarrosare the container checks broken again?15:57
*** dsariel_ has quit IRC15:57
EmilienMgbarros: http://tripleo.org/cistatus.html16:00
EmilienMgbarros: I don't think so, unless something broke very recently16:00
*** dparkes has joined #tripleo16:00
gbarrosEmilienM https://review.openstack.org/#/c/475048/21 has been waiting for gate to complete for a bit over 12 hours now. http://status.openstack.org/zuul/ looks like stalled on containers?16:01
facemanbeagles, it's atoth here, this is my bouncer alias :-)16:02
beaglesfaceman, yo16:02
facemanbeagles, so my updates work locally (when the two lines we talked about are commented out)16:03
gbarrosa few ahead of it taking even longer16:03
*** itlinux has quit IRC16:03
beaglesfaceman, okay cool16:03
facemanbeagles, so I'm going to push the patch with the non-aliased lbaasv2 and hope it works in the live environment :-)16:03
beaglesfaceman, yup.. curious16:04
daccontantEmilienM: http://logs.openstack.org/55/485255/3/check/gate-puppet-openstack-integration-puppet-syntax-4-centos-7/9f5b208/console.html for centos passed16:07
daccontantEmilienM: i think we should not define testr and subunit2html under binary16:07
daccontantlet'use system binary provided by rpm16:07
daccontanti am waiting for ubuntu how it goes.16:07
EmilienMdaccontant: we don't care about syntax job in that case16:08
EmilienMdaccontant: they don't run all these bits (tempest etc) so please ignore it16:08
EmilienMdaccontant: you have ubuntu vm?16:09
daccontantsorry16:09
daccontantwrong job16:09
daccontantlet the job finish16:09
*** lucasagomes is now known as lucas-afk16:09
EmilienMdaccontant: let's take it on #puppet-openstack plz16:10
*** dsariel has joined #tripleo16:10
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Revert "Disable systemd-networkd & systemd-resolved"  https://review.openstack.org/48394616:10
*** dsariel_ has joined #tripleo16:11
openstackgerritAndrewToth proposed openstack/tripleo-heat-templates master: Enable Neutron LBaaS Integration  https://review.openstack.org/48521316:11
*** florianf has joined #tripleo16:11
facemanbeagles, do ci scenario updates require reno files too?16:11
*** dparkes has quit IRC16:15
pandashardy: for the prepare command, specifying host in the namespace doesn't work ...16:15
panda2017-07-21 16:07:00 | imagename: trunk.registry.rdoproject.org/tripleo/centos-binary-aodh-api:tripleo-ci-testing16:15
panda2017-07-21 16:07:04 | 404 Client Error: Not Found ("no such id: docker.io/trunk.registry.rdoproject.org/tripleo/centos-binary-aodh-api:tripleo-ci-testing")16:15
pandastill tries to contact dockerhub16:16
*** egonzalez has quit IRC16:16
*** gfidente|afk is now known as gfidente16:16
shardypanda: can you share the generated environment file?16:17
shardyI had similar problems but it was a combination of an old tripleo-common and wrong args to the prepare command16:17
*** rbrady has joined #tripleo16:18
*** rbrady has joined #tripleo16:18
pandashardy: http://logs.openstack.org/47/475747/71/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/4281668/logs/undercloud/home/jenkins/overcloud_containers.yaml.txt.gz and http://logs.openstack.org/47/475747/71/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/4281668/logs/undercloud/home/jenkins/docker_registry.yaml.txt.gz16:18
jristweshay: :(16:19
*** daccontant is now known as chandankumar16:20
openstackgerritAlan Bishop proposed openstack/tripleo-quickstart-extras master: Don't fail if Virtual BMCs have already been created  https://review.openstack.org/48617516:22
*** jmelvin has quit IRC16:24
*** cschwede has quit IRC16:25
*** yamahata has joined #tripleo16:27
*** anshul has quit IRC16:27
*** flepied has joined #tripleo16:27
pandashardy: you have a working example of pulling images from a different registry ?16:28
*** yprokule has quit IRC16:28
shardypanda: http://paste.openstack.org/show/616190/ is my local env, it seems to hit my local registry OK AFAICT16:29
*** itlinux has joined #tripleo16:29
shardypanda: however I did notice similar issues to you previously when I had an error in the file, docker just silently gives up and tries docker.io instead16:30
shardycan't see the issue with your logs tho, sorry16:30
pandashardy: ok, thanks fro trying. last thing, I thought prepare command was generating also DockerNamespace DockerNamespaceIsREgistry and DockerInsecureRegistryAddress, but it doesn't. Do I have to still provide those ?16:31
beaglesfaceman, good question... my feeling is no. I don't see it showing up the release notes much and a sampling of scenario update commits don't include release notes16:31
*** itlinux has quit IRC16:31
shardypanda: No those have been removed ref https://review.openstack.org/#/c/479398/16:32
shardyI think the quickstart patches to remove them may still be pending tho16:33
pandashardy: thanks. Next thing I'll try is to add the port to the registry host, maybe not specifying it confuses the command into thinking it's part of the namespace16:33
shardypanda: yeah maybe, I wonder if there's any clues in the logs, or if you can run docker-puppet manually with debug enabled?16:34
*** paramite has joined #tripleo16:34
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart master: enable container periodic job  https://review.openstack.org/47574316:36
pandashardy: no other clues, and the host is gone16:37
shardypanda: yeah I meant test locally to help debug :)16:37
*** dmsimard is now known as dmsimard|afk16:37
*** rbrady has quit IRC16:38
*** ffiore has quit IRC16:40
*** greghaynes has quit IRC16:40
MVenesioGuys, if an overcloud deploy fails using openstack overcloud deploy over deployed servers, do i need to do some kind of cleanup in the Servers or i've to just run the openstack overcloud deploy again ?16:40
shardyMVenesio: in most cases you should be able to just run it again16:40
leitanshardy: is a good practice to delete the config of /etc/os-collect-config.conf ?16:41
*** pblaho has quit IRC16:42
*** anshul has joined #tripleo16:42
MVenesioshardy: or maybe cleanup some config from the puppet agent ?16:42
*** marios has quit IRC16:42
shardyslagle: ^^ is any special cleanup needed in the deployed-server case?16:42
*** snecklifter has quit IRC16:42
*** ffiore has joined #tripleo16:43
*** hewbrocca is now known as hewbrocca_afk16:46
*** dprince has joined #tripleo16:48
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Add support for update_tasks  https://review.openstack.org/48610416:48
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Add RoleConfig output  https://review.openstack.org/48573116:48
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Add environment to disable deploy steps  https://review.openstack.org/48618016:48
shardyslagle: Hey FYI ^^ shows the approach I mentioned a few days ago to disable heat driven deploy steps and run them directly via ansible16:49
shardywe could refactor more things into the playbook but atm that will still run the host_prep_tasks via heat16:49
slagleshardy: cool, i'll have a look16:50
openstackgerritSteven Hardy proposed openstack/tripleo-validations master: Don't modify case of role names in inventory  https://review.openstack.org/48614016:51
leitanslagle: how about the cleanup on pre-rpovisioned nodes ? need to do something or just re run the overcloud deploy ?16:51
*** jprovazn has joined #tripleo16:52
*** dsariel_ has quit IRC16:54
*** derekh has quit IRC16:54
*** flepied has quit IRC16:54
*** bcafarel has quit IRC16:54
*** dsariel has quit IRC16:54
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras master: Make deployed server bootstrap environment part of multinode  https://review.openstack.org/48615816:55
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras master: WIP Make env variables for multinode into ansible vars  https://review.openstack.org/48393016:55
*** athomas has quit IRC16:55
*** trown is now known as trown|lunch16:55
*** ramishra has quit IRC16:57
openstackgerritTim Rozet proposed openstack/puppet-tripleo master: Deprecates using exec workaround for ODL clustering  https://review.openstack.org/48618217:03
slagleleitan: if it's a whole new stack, possibly17:06
*** dbecker has quit IRC17:07
slagleleitan: if you're just stack updating a previously failed stack, then no17:07
-openstackstatus- NOTICE: Restarting Gerrit for our weekly memory leak cleanup.17:07
leitanslagle: is a whole new stack, what considerations should we take ? we added new services to a role and its not deploying it17:07
*** bcafarel has joined #tripleo17:08
*** pkovar has quit IRC17:08
slagleleitan: the agent configuration needs to be reapplied for a whole new stack17:09
leitanslagle: yes, the swift metadata url should change too ?17:09
leitanwhen inspecting the stack ?17:09
leitanor stays the same ?17:10
paramitehey guys, can we please get some attention on https://review.openstack.org/#/q/topic:bp/container-healthchecks+status:open , so we can move on with health checks?17:10
leitanwe deleted all the os-collect-config.conf on all the nodes17:10
slagleleitan: it changes17:11
*** atoth has joined #tripleo17:11
*** dtantsur is now known as dtantsur|afk17:11
slagleleitan: you need to reconfigure it just as you did previously17:11
leitanyes , we re-run the get-occ-config.sh again on all nodes @slagle17:12
leitanslagle: ^^17:12
leitanare we missing something ?17:12
slaglenope17:12
*** gkadam has joined #tripleo17:12
gfidenteflaper87 you still around?17:13
gfidenteflaper87 help :D17:13
gfidenteI am trying to find why glance-api container failed in a CI job17:14
gfidentelogs.openstack.org/04/485004/1/check/gate-tripleo-ci-centos-7-undercloud-containers/d0c82fd/17:14
gfidenteI can see an issue at the end of the undercloud install http://logs.openstack.org/04/485004/1/check/gate-tripleo-ci-centos-7-undercloud-containers/d0c82fd/logs/var/log/undercloud_install.txt.gz17:15
*** iranzo has joined #tripleo17:15
*** greghaynes has joined #tripleo17:16
gfidentebut I can't find infos about what went wrong in the container17:16
gfidentehave any clue?17:16
leitanslagle: thanks17:21
trozetmwhahaha: as promised... https://review.openstack.org/#/c/486182/17:22
rlandybnemec: hello ... ovb jobs are failing IPMI validation - I assume related to https://github.com/cybertron/openstack-virtual-baremetal/commit/ae02e88b985a406face7eda22e4b8abb1cd2c61d.17:22
mwhahahatrozet: cool i'll take a look17:22
rlandyThis is the clouds.yaml file I have17:22
rlandyhttps://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/ovb-manage-stack/templates/clouds.yaml.j217:22
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Add health check for services connected to RabbitMQ  https://review.openstack.org/48357817:23
*** rbrady has joined #tripleo17:24
*** ffiore has quit IRC17:25
*** anshul has quit IRC17:25
jristhonza: I just tried testing https://review.openstack.org/#/c/473933/ and I don't think it's working17:28
jristhonza: is it in the little help menu and you click debug ?17:28
honzajrist: yes, i believe so17:28
jristdoesn't seem to work.17:29
jristam I missing something perhaps?17:29
jristwhen I click it nothing appears to happen17:29
honzajrist: anything in the console?  are your node_modules up to date?17:29
honzajrist: I can have a look in a sec17:30
jristI think so and maybe :)17:30
*** akrivoka has quit IRC17:30
jristhonza: thanks17:31
*** rbrady has quit IRC17:32
openstackgerritHonza Pokorny proposed openstack/tripleo-common master: Add GUI logging workflows  https://review.openstack.org/46919617:33
honzajrist: lol, you're right, completely broken, must have happened during a rebase :(17:35
jristhonza: yay!17:35
jristI'm not an idiot17:35
openstackgerritSandhya Dasu proposed openstack/tripleo-heat-templates master: Modifying Cisco templates to support composable roles  https://review.openstack.org/48486117:35
*** flepied has joined #tripleo17:36
honzajrist: but i am :)17:36
jristbah17:36
jristeveryone makes mistakes17:36
*** jkilpatr has quit IRC17:36
*** shardy has quit IRC17:39
*** jkilpatr has joined #tripleo17:40
*** fragatina has quit IRC17:41
gfidentebnemec do you which, if any, job is using tls/ssl?17:43
gfidenteis it possible gate-tripleo-ci-centos-7-containers-multinode and gate-tripleo-ci-centos-7-undercloud-containers are?17:43
openstackgerritTim Rozet proposed openstack/tripleo-heat-templates master: Adds environment file for ODL + SRIOV  https://review.openstack.org/48618717:44
*** trown|lunch is now known as trown17:52
gbarroshow do i figure out if a gate job is stuck? looks like there are 6 now past the 12hr mark and another 7 past the 6hr mark.17:53
vkmchey, I'm hitting this when trying to deploy containerized overcloud... rings any bell? http://paste.openstack.org/show/616195/17:56
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Provides Ceph config into OpenStack clients  https://review.openstack.org/48250017:58
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Download logs interface  https://review.openstack.org/47393318:00
honzajrist: updated ^^^18:00
bnemecgfidente: I'm honestly not sure anymore.  I think both of the non-containerized ovb jobs are though.18:02
bnemecrlandy: Oh, is that creating the heat stack manually?18:03
rlandybnemec: no - using shade18:03
bnemecWell, same difference.  Not using deploy.py.18:03
rlandyno18:03
bnemecI really don't recommend that.18:04
bnemecBut the reason it's probably failing is that you need to pass the new parameter, whose name I can't remember off the top of my head.18:04
rlandyOS_CLOUD?18:05
rlandyhost_cloud18:05
bnemecrlandy: cloud_data18:05
bnemecHmm, which I never added a description to.  I should do that.18:05
rlandybnemec: ok - why are you against shade?18:05
bnemecrlandy: I'm not against shade, I'm against use of OVB without deploy.py.  You're going to have to re-implement every feature I add.18:06
*** atoth has quit IRC18:07
bnemecrlandy: This is what you're probably missing now: https://github.com/cybertron/openstack-virtual-baremetal/blob/master/openstack_virtual_baremetal/deploy.py#L15618:08
bnemecWhich is calling this: https://github.com/cybertron/openstack-virtual-baremetal/blob/master/openstack_virtual_baremetal/auth.py#L6418:08
rlandybnemec: yes - I see that - but I'll try moving to deploy.py  - it's closer to upstream - which is really what we want to reproduce18:10
*** iranzo has quit IRC18:13
*** salmankhan has quit IRC18:14
jristhonza: reviewing18:16
gfidentebnemec stay with me18:16
gfidentehttps://review.openstack.org/#/c/482500/14/docker/services/glance-api.yaml18:16
bnemecgfidente: I dunno, it's lunch time here. :-)18:16
gfidenteam I reading it right that is spawning a second container18:16
gfidentewhen tls is true and not merging the config settings with the existing one?18:17
gfidenteline 13018:17
bnemecgfidente: I'm not sure I'm the one to ask about containers, but it does appear that way.  Only for internal tls though18:19
bnemecgfidente: So that would probably only be exercised in the experimental fakeha-tls-everywhere job.18:19
jristhonza: works now, but http://172.16.213.154:8989/v2/executions 40418:19
bnemecI guess it's called ovb-fakeha-caserver18:19
pabelangergbarros: not stuck but the gate keeps resetting because of job that fails before said patchsets18:20
bnemecAnd it appears that job is failing in general right now. :-(18:20
pabelangergbarros: so, right now it is about 15hr+ delayed as a result of that18:20
*** pchavva has quit IRC18:20
gbarrospabelanger do i need to do something or will it sort itself out?18:21
honzajrist: right18:21
honzajrist: you need this :( https://review.openstack.org/#/c/469196/18:22
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: WIP Add featureset for 3nodes multinode job  https://review.openstack.org/48615518:23
jristhonza: roger that thanks18:23
pabelangergbarros: zuul will evenetually clear out the back log. If you want to see why things are failing, you can use elastic-recheck: http://status.openstack.org/elastic-recheck/data/others.html18:23
jristhonza: I think it'd be good to note that in the UI commit message18:23
honzajrist: on it18:24
pabelangergbarros: by fixing those failures, the gate pipeline will merge things faster18:24
dtrainoris there a command to delete any lingering configuration and current state left over by a failed os-net-config ?18:24
dtrainoraside from just ifdown'ing the interfaces, deleted the config files etc18:24
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Download logs interface  https://review.openstack.org/47393318:24
dtrainoros-net-config --cleanup comes close I think, but says "Cleanup unconfigured interfaces".  Some interfaces are configured.18:24
gfidentebnemec ack thanks!18:26
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Drop step_config as top level docker requirement  https://review.openstack.org/44271618:27
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Support configurable Zaqar backends  https://review.openstack.org/47755918:27
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: docker: Add unit tests on service_name  https://review.openstack.org/44275518:27
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add docker templates to configure Ironic inspector  https://review.openstack.org/45782218:27
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Drop MongoDB from the undercloud  https://review.openstack.org/47756218:27
bnemecgfidente: I think Juan is back on Monday, you may want to talk to him then.  I assume he's the one who implemented all of that.18:27
dtrainorhmmmm i guess a successful stack delete also deletes and cleans up the interface configuration18:27
*** jrist has quit IRC18:29
dsneddondtrainor, os-net-config --cleanup will undefine interfaces which are defined in /etc/sysconfig but not defined in the os-net-config config.json|yaml18:32
dsneddondtrainor, It won't work for cleaning up interfaces which are defined in os-net-config's config file.18:33
dsneddondtrainor, But you can run os-net-config --cleanup with a very minimal config.yaml and then run os-net-config again on the regular config.18:33
vkmchey, I'm hitting this when trying to deploy containerized overcloud... rings any bell? http://paste.openstack.org/show/616195/18:37
vkmcdprince, ^18:37
dtrainorcool ,good to know, thank you18:37
dtrainori had a deployment fail with "/etc/sysconfig/network-scripts/ifup-eth[26635]: Error, some other host already uses address 172.16.2.7." and not quite sure how to recover with it.  i was going to write it off as a fluke, clean things up, and re-deploy unless this indicative of a bigger problem18:38
dprincevkmc: yes, you need to generate a new env file or add this to your env18:38
tdasilvatrown: EmilienM: hi, have you seen this problem that vkmc ^^^ is running into? any pointers? I'm also running into this while running oooq18:38
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Make EnablePackageInstall and Debug descriptions consistent  https://review.openstack.org/48353618:38
dprincevkmc: http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/environments/docker-centos-tripleoupstream.yaml18:39
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Make Deploy/UpdateIdentifier definition semi-consistent  https://review.openstack.org/48353718:39
tdasilvaoops looks like dprince has something for us18:39
tdasilvawill try that18:39
vkmcthanks dprince18:39
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Make various password descriptions consistent  https://review.openstack.org/48353818:39
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Make RoleParameters and key_name descriptions consistent  https://review.openstack.org/48353918:39
dtrainordsneddon, ring any bells by chance18:39
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Make many networking parameters consistent  https://review.openstack.org/48354018:39
dtrainor?18:39
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Make UpgradeLevelNovaCompute parameters consistent  https://review.openstack.org/48404118:39
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Mount /var/lib/neutron in neutron agents for metadata proxy  https://review.openstack.org/48525818:39
EmilienMbnemec: just rebases ^ and approving your stuff, thx!18:40
*** fragatina has joined #tripleo18:40
dprincevkmc: see also, http://lists.openstack.org/pipermail/openstack-dev/2017-July/119880.html18:40
EmilienMtdasilva: ^ that18:40
-openstackstatus- NOTICE: docs.o.o is currently broken, we're investigating18:40
dprincevkmc: as that post mentions you can also use images from your local registry by generating a file with the new 'overcloud container image18:41
dprinceprepare18:41
dprince' command18:41
tdasilvaEmilienM: thanks! following dprince suggestions...18:42
dprince'openstack overcloud container image prepare' command18:42
*** gkadam has quit IRC18:44
dsneddondtrainor, Oh, that does ring a bell.18:45
dsneddondtrainor, There used to be a bug where the following would occur: 1) system gets IP through DHCP, 2) os-net-config tries to assign that IP to the bridge, 3) IP conflict.18:46
dsneddondtrainor, We modified os-net-config at one point to make sure that the dhclient would be killed.18:46
dsneddondtrainor, Because for some reason an ifdown/ifup wouldn't result in a notification to the dhclient monitor.18:46
*** jkilpatr has quit IRC18:47
*** jkilpatr has joined #tripleo18:50
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart master: enable container periodic job  https://review.openstack.org/47574318:51
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart-extras master: Use prepare command for overcloud_containers.yaml  https://review.openstack.org/47597518:52
dtrainori see18:52
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574718:53
dtrainor'/etc/sysconfig/network-scripts/ifup-eth[22550]: Error, some other host already uses address 172.16.1.10.'18:53
dtrainorweird, getting it on another host too.18:53
dtrainorcool thanks dsavineau18:56
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574718:56
dtrainordsneddon, rather18:56
dsneddondtrainor, What version is this?18:56
dtrainoros-net-config-7.0.1-0.20170715002058.9ef9a7a.el7.centos.noarch18:56
dtrainordoes that help?18:56
dsneddondtrainor, Wat? That's new, so it shouldn't be exhibiting the problem I'm talking about.18:57
dtrainorright.  i'm playing around with split-stack, I think there's just a conflict between the two stacks.18:57
dsneddondtrainor, Are you sure that you didn't forget to instantiate a network, which can end up with the provisioning IP ending up in multiple places?18:57
dtrainorit's not the provisioning ip, but what you described i ran in to yesterday18:57
dtrainori wasn't matching properly to a correct nic-config so all the interfaces got the ctrlplane ip and, well, explosions ensued18:58
dtrainorbrb19:01
dsneddondtrainor, Well, let me know if you need help figuring it out, but definitely let me know if you think you've found a bug.19:01
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: allow tqe roles to work in sync with ARA  https://review.openstack.org/48223719:06
leitanslagle: finally, we have a working overcloud deployment ! the only thing that we have just rabbit mysql haproxy cindervolume and redis managed by pacemaker, is possible to add the rest of the apis services to the pacemaker cluster ?19:07
*** jcoufal_ has quit IRC19:07
larsksleitan: the model is generally that pacemaker only manages those things which are not active/active. For most of the openstack services, you can run as many instances as you want and then use haproxy to ensure availability.19:18
leitanlarsks: great then the haproxy that is deployed its actually managing all my apis behind it19:18
larsksIt should be, yes.19:19
leitanlarsks: thats the redhat model, i remember that OSP9 manage all the resources19:19
leitanmaybe it changed19:19
larsksThat's correct.19:19
*** yamahata has quit IRC19:20
leitanlarsks: thats good news ... corosync/pacemaker gave me a lot of headahces on deployments with more than 20 nodes19:20
*** gbarros has quit IRC19:22
leitanlarsks slagle , last question, i want to deploy ceph now, can i "update" the stack adding the cephosd and mon roles and nodes ?, how do i do that ? just adding the nodes and roles and running openstack overcloud deploy ? is gonna uddapte my existing stack ? thanks19:25
*** amoralej is now known as amoralej|off19:26
larsksleitan: I believe that should work.  Make sure you pass all the same environment files to 'overcloud deploy' that you passed the first time. Updating an existing stack isn't something I've tried very much, so look to someone else for an authoritative answer.19:26
leitanlarsks: great thanks19:27
*** dmsimard|afk is now known as dmsimard19:35
slagleleitan: yea, have a look at the docs19:36
gfidenteleitan about ceph, note that in the puppet-ceph.yaml env file which you should use to enable ceph there are some defaults to configure all cinder/glance/nova/gnocchi to use ceph19:38
*** florianf has quit IRC19:38
gfidentebut if you're updating an existing stack, you can't just change the backend of glance or nova19:38
gfidenteunless they were empty so you don't need to migrate data19:39
leitanthey are empty is a fresh install19:41
gfidentecool19:43
leitanthanks for the tip gfidente19:43
*** sbrzozow has quit IRC19:49
*** paramite has quit IRC19:50
fultonjcan non-cores vote in other core elections held on the dev mailing list?19:50
fultonjor s/"can"/"is it normal for"/g19:51
*** thrash is now known as thrash|bbl19:52
EmilienMfultonj: feedback is always welcome19:55
*** yamahata has joined #tripleo19:55
fultonjthanks EmilienM19:55
EmilienMfultonj: though alsmost 6 years I'm here I never saw someone saying NO in the projects I've been involved with19:55
leitangfidente: how can configure the disk distribution, placemente (where to put the jorunal, and where the data) ?19:58
*** catinthe_ has quit IRC19:58
*** jkilpatr has quit IRC20:03
fultonjleitan: are you asking for ceph-ansible or puppet-ceph?20:06
pandammmh20:06
panda2017-07-21 19:58:35 | imagename: ceph/daemon:tag-build-master-jewel-centos-720:06
fultonjleitan: i assume for ceph-ansible if you're looking at the new stuff20:06
panda2017-07-21 19:58:37 | 404 Client Error: Not Found ("no such id: trunk.registry.rdoproject.org/ceph/daemon:tag-build-master-jewel-centos-7")20:06
panda2017-07-21 19:58:37 | END return value: 120:06
pandawhat builds this ?20:06
leitanfultonj: im using ROSP11 so i guess its puppet-ceph20:07
fultonjleitan: yes, puppet-ceph20:07
fultonjpanda: i will get you the URL with the docker image20:07
*** paramite has joined #tripleo20:07
pandafultonj: not that simple20:07
fultonjok, ken dryer built it20:08
leitanfultonj: yes, how can i specify the disks on that setup20:08
fultonjleitan: http://giuliofidente.com/2016/08/ceph-tripleo-and-the-newton-release.html20:10
fultonjthere's an example on giulio's blog ^ under Set a default disks map for the OSD nodes20:11
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: WIP Add featureset for 3nodes multinode job  https://review.openstack.org/48615520:11
leitanfultonj: greaaat, ill take a look thanks !20:11
pandafultonj: I'm trying to use a different registry, with images built only with kolla, but the prepare command generates the same registry host for all the images. I don't know how to specify an exception to say "pull this from docker.io, the rest from the other registry"20:16
*** jprovazn has quit IRC20:18
*** fzdarsky has quit IRC20:19
fultonjhttp://lists.openstack.org/pipermail/openstack-dev/2017-July/119880.html20:19
fultonji thought ^ was supposed to provide a way to do this (though I have not tried it)20:20
*** ansmith has quit IRC20:25
*** eck` is now known as eck`gone20:27
pandafultonj: the format, yes. The prepare command, not quite.20:30
*** MVenesio has quit IRC20:30
chandankumarEmilienM: mwhahaha https://review.openstack.org/#/c/485255/ please have a look20:31
*** jrist has joined #tripleo20:32
*** jrist has joined #tripleo20:32
*** jfrancoa has quit IRC20:34
pandaalso, the ceph image doesn't have a Docker*Image parameter20:37
fultonjpanda: i don't know to get prepare to do that either. on my side i am using prepare to get containers.yaml and then in another env i just set DockerCephDaemonImage: brew-pulp-docker01.web.prod.ext.phx2.redhat.com:8888/rhceph:2.3-320:38
EmilienMchandankumar: ok20:39
pandafultonj: manual tweaking is not an option for me :(20:40
*** chandankumar is now known as dassistant20:41
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart-extras master: Use prepare command for overcloud_containers.yaml  https://review.openstack.org/47597520:43
*** gbarros has joined #tripleo20:43
gfidentepanda so20:44
gfidentethe DockerCephDaemon image is coming with https://review.openstack.org/#/c/465066/41/docker/services/ceph-ansible/ceph-base.yaml20:45
pandagfidente: fultonj I'm trying adding --exclude ceph to the prepare command20:45
gfidenteis anything is expecting to find ceph/daemon:tag-build-master-jewel-centos-7 in  trunk.registry.rdoproject.org20:45
gfidentethat is wrong20:45
pandagfidente: not even as a workaround for now ?20:45
gfidenteour image path purposely doesn't have a registry address because we want to default to docker.io20:45
gfidenteand I believe upstream code defaults to that20:46
gfidenteso what is putting there trunk.registry.rdoproject.org ?20:46
pandagfidente: when I specify --pull-source as argument to the prepare command, every image gets the same registry20:47
gfidenteah so it's assuming same source for all images20:47
pandagfidente: yes, maybe you should remove it from the general template20:47
gfidentepanda "general"20:48
*** fpan has quit IRC20:48
pandagfidente: sorry, I'm taking a look at the template only now20:48
gfidentepanda so I am looking at the code too20:49
gfidentein overcloud_containers.j220:49
gfidentewe purposely don't use {{namespace}} prefix20:49
pandagfidente: I don't know how the prepare command adds pull_source to the list20:49
pandaI assumed it was in the template20:50
gfidenteI am not sure if the intended behavior is to add the registry host if the image doesn't use {{namespace}}20:50
*** bnemec has quit IRC20:50
gfidentebut I agree let's remove it from the templates20:50
gfidentejust so it doesn't break existing stuff20:50
gfidenteand for now we keep the default in the ceph templates20:51
pandaso, the command loads and renders the list, then add some keys to the dictionary, like "pull_source" for all the entries. Then dumps it.20:52
*** jkilpatr has joined #tripleo20:52
gfidentepanda yeah I noticed20:52
gfidentethe {{namespace}} prefix is not for the registry host20:52
gfidentethe right fix for this is to add a {{registry}} prefix too it seems20:53
pandaI tend to agree20:53
gfidentebut short term we can remove it from the list20:53
gfidenteand keep the default in the templates20:53
pandathat's how I imagined it was done in the first place20:54
pandagfidente: I don't kno w how many are impacted by this, let's see if --exclude ceph does the trick. At the moment I'm not testing ceph at all in the periodic containers job20:54
panda(I think)20:54
gfidentepanda better to remove it so it's smoother for other people20:55
pandaunless scenario001 contains ceph20:55
pandaok20:55
gfidenteI'll keep a FIXME in the .j2 so we remember about it20:55
fultonjthanks panda gfidente20:56
gfidenteyeah thanks panda for pointing it out20:56
jristweshay: pokepoke20:59
jristweshay: is dev mode all git clones ?20:59
weshayjrist, hey.. saw ur change failed on gates20:59
*** abishop has quit IRC20:59
jristweshay: yeah thanks for the recheck20:59
weshayjrist, nothing runs in ooo w/o packages20:59
jrist:(21:00
weshayya21:00
jristso what does "devmode" mean21:00
weshayjrist, but devmode takes a change or set of changes.. and builds them into a rpm repo for you21:00
weshayand installs them on the undercloud and overcloud nodes21:00
weshayso that's what it means21:01
openstackgerritGiulio Fidente proposed openstack/tripleo-common master: Do not list Ceph specific image in overcloud_images.yaml.j2  https://review.openstack.org/48500421:01
*** trown is now known as trown|lunch21:01
*** trown|lunch is now known as trown|outtypewww21:01
gfidentepanda fultonj ^^ I think that should be it21:01
gfidentepanda so location for ceph remains set in the template for now https://review.openstack.org/#/c/465066/41/docker/services/ceph-ansible/ceph-base.yaml21:02
jristweshay: like I want to test https://review.openstack.org/#/c/473933/ with  https://review.openstack.org/#/c/469196/21:02
gfidentethat is probably a sane default for rdo because you don't want ceph images there?21:03
gfidenteDockerCephDaemonImage21:03
gfidentelooks good?21:03
weshayjrist, https://docs.openstack.org/tripleo-quickstart/latest/devmode.html21:03
weshayjrist, w/ zuul mode21:03
*** eck`gone is now known as eck`21:03
jristweshay: pass those two change sets in somehow?21:04
jristweshay: looking21:04
weshayjrist, if they are both from the same repo.. which they are21:04
jristbioe'21:04
pandagfidente: I'll add a comment to explain what happens to me, thanks.21:05
weshayrebase one on the other and just pick the top one21:05
fultonjgfidente: thanks21:05
jristweshay: nope21:05
jristone is tripleo-common, one is tripleo-ui21:05
weshaypanda, do you have the ssh keys for sova?21:05
weshayjrist, oh.. then ur fine.. just specify both using the syntax in the doc21:05
gfidentepanda sure yes, update it21:05
gfidentethanks!21:05
pandaweshay: no21:05
jristweshay: thanks!21:07
*** dsariel has joined #tripleo21:10
*** agopi has quit IRC21:10
*** dsariel_ has joined #tripleo21:11
*** bnemec has joined #tripleo21:11
*** paramite has quit IRC21:16
*** mburned has quit IRC21:20
*** faceman has quit IRC21:20
*** myoung has quit IRC21:20
*** lhinds has quit IRC21:20
*** pliu has quit IRC21:20
*** rnoriega has quit IRC21:20
*** mburned has joined #tripleo21:25
*** myoung has joined #tripleo21:29
*** mburned has quit IRC21:30
*** dprince has quit IRC21:34
*** mburned has joined #tripleo21:35
*** ansmith has joined #tripleo21:40
*** trozet has quit IRC22:02
*** leitan has quit IRC22:04
*** Goneri has quit IRC22:05
*** flepied has quit IRC22:07
*** MVenesio has joined #tripleo22:12
*** rlandy has quit IRC22:15
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: [GO AWAY] Provides Ceph config into OpenStack clients  https://review.openstack.org/48624422:17
*** tesseract has quit IRC22:25
*** myoung is now known as myoung|afk22:26
*** dcritch has quit IRC22:26
*** morazi has quit IRC22:27
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: WIP, print the failed_deployment log contents to the console for users and ara  https://review.openstack.org/48624822:30
*** myoung|afk has quit IRC22:52
*** ckyriakidou has quit IRC22:56
*** MVenesio has joined #tripleo22:57
*** MVenesio has quit IRC22:58
*** Goneri has joined #tripleo23:01
*** dsariel has quit IRC23:06
*** dsariel_ has quit IRC23:07
openstackgerritMerged openstack/tripleo-heat-templates master: Add a new role for ComputeOvsDpdk and clean-up parameters  https://review.openstack.org/47842723:30
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates master: Render isolated network templates using jinja2  https://review.openstack.org/47561223:33
*** panda is now known as panda|off23:34
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates master: Render VIPs dynamically based on network_data.yaml  https://review.openstack.org/48626023:36
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574723:39
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates master: Render VIPs dynamically based on network_data.yaml  https://review.openstack.org/48626023:41
*** cdearborn_ has quit IRC23:46
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates master: Render VIPs dynamically based on network_data.yaml  https://review.openstack.org/48626023:56
*** catintheroof has joined #tripleo23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!