Tuesday, 2015-05-26

*** sdake_ has quit IRC00:01
*** sdake_ has joined #tripleo00:02
*** sdake has quit IRC00:06
*** chlong has joined #tripleo00:15
*** mestery has joined #tripleo00:38
*** mestery has quit IRC00:41
*** mestery has joined #tripleo00:43
*** marzif has quit IRC01:00
*** julim has joined #tripleo01:21
*** julim has quit IRC01:21
*** radek__ has joined #tripleo01:44
*** rhallisey has quit IRC01:53
*** sdake has joined #tripleo02:48
*** sdake_ has quit IRC02:50
*** sdake_ has joined #tripleo02:50
*** sdake has quit IRC02:54
*** untriaged-bot has joined #tripleo03:00
untriaged-botNo untriaged bugs so far! \o/03:00
*** untriaged-bot has quit IRC03:00
*** yamahata has joined #tripleo03:03
*** tzumainn has joined #tripleo03:06
*** radek__ has quit IRC03:07
*** panda has quit IRC03:21
*** panda has joined #tripleo03:21
*** sdake_ has quit IRC03:23
*** dtantsur|afk is now known as dtantsur04:02
*** links has joined #tripleo04:27
*** MasterPiece`` has joined #tripleo04:30
*** MasterPiece has quit IRC04:33
*** MasterPiece`` has quit IRC04:41
*** MasterPiece`` has joined #tripleo04:41
*** MasterPiece`` has quit IRC04:41
*** jpeeler has joined #tripleo04:49
*** jpeeler has quit IRC04:51
*** jpeeler has joined #tripleo04:54
*** penick has joined #tripleo05:03
*** penick has quit IRC05:03
*** ukalifon1 has joined #tripleo05:36
*** tzumainn has quit IRC05:49
*** akrivoka has joined #tripleo06:24
*** chlong has quit IRC06:30
*** radek__ has joined #tripleo06:34
*** jprovazn has joined #tripleo06:35
spredzyMorning all06:40
*** akrivoka has quit IRC06:46
*** akrivoka has joined #tripleo06:48
*** ifarkas has joined #tripleo06:50
*** yuanying_ has joined #tripleo06:54
*** yuanying has quit IRC06:54
*** matbu has quit IRC06:58
*** dasm|afk has quit IRC06:59
*** matbu has joined #tripleo07:02
*** jtomasek has joined #tripleo07:03
*** cody-somerville has joined #tripleo07:10
*** cody-somerville has joined #tripleo07:10
*** akrivoka has quit IRC07:12
*** yuanying_ has quit IRC07:12
*** yuanying has joined #tripleo07:13
*** bvandenh has joined #tripleo07:15
*** cody-somerville has quit IRC07:17
*** gfidente has joined #tripleo07:30
*** gfidente has joined #tripleo07:30
*** dasm|afk has joined #tripleo07:31
*** dasm|afk is now known as dasm07:31
*** paramite has joined #tripleo07:33
*** Goneri has joined #tripleo07:34
dasmhello o/07:35
gfidentemorning07:37
gfidente:)07:37
dasmso, everyone back to normal after summit? :)07:37
*** jistr has joined #tripleo07:39
spredzyhello all07:41
gfidente:)07:42
matbumorning07:43
*** akrivoka has joined #tripleo07:44
*** mcornea has joined #tripleo07:49
hewbroccadasm: totally07:50
*** akrivoka has quit IRC07:58
*** shardy has joined #tripleo07:58
*** aufi has joined #tripleo07:59
*** pino|work has joined #tripleo08:03
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci: Revert "Pin puppet-memcached"  https://review.openstack.org/18552408:06
gfidentejistr, FWIW, I am diverging a little on some ceph troubles08:08
jistrmorning08:08
gfidentemorning08:08
jistrgfidente: ack08:08
*** yuanying has quit IRC08:09
*** yog__ has joined #tripleo08:14
*** lucasagomes has joined #tripleo08:15
*** derekh has joined #tripleo08:20
*** bkero has quit IRC08:21
*** bkero has joined #tripleo08:21
*** akrivoka has joined #tripleo08:50
*** lazy_prince has joined #tripleo08:55
*** rlandy has joined #tripleo08:57
hewbroccaYou guys happen to know if we support neutron vlan mode yet?08:58
*** untriaged-bot has joined #tripleo09:00
untriaged-botNo untriaged bugs so far! \o/09:00
*** untriaged-bot has quit IRC09:00
*** subscope has joined #tripleo09:03
jistrthere seems to be something related in code, however i've never tried switching it personally and i think it's not CI'd09:18
jistrhttps://github.com/openstack/tripleo-heat-templates/blob/2e2fe4b7bcafa8c1f1b9789a40719f5fd146bcf8/puppet/manifests/overcloud_controller_pacemaker.pp#L444-L44809:18
jistrhttps://github.com/openstack/tripleo-heat-templates/blob/631b1afee180317e4eca5980e82238265f1a7049/puppet/manifests/overcloud_compute.pp#L68-L7209:18
jistrworth asking dprince probably if he tried switching to vxlan, i think he wrote those bits ^^, so he may have tried it09:19
hewbroccavxlan has passed CI somewhere09:22
hewbroccabut vlan AFAIK has not09:22
*** adrianopetrich has quit IRC09:25
*** pdb has joined #tripleo09:39
*** panda is now known as panda|afk10:02
*** adrianopetrich has joined #tripleo10:04
*** adrianopetrich has quit IRC10:12
*** adrianopetrich has joined #tripleo10:14
openstackgerritMerged openstack/tripleo-incubator: Do not set deploy_ramdisk and deploy_kernel as flavor keys  https://review.openstack.org/18135710:18
*** marzif has joined #tripleo10:39
*** adrianopetrich has quit IRC10:53
*** yamahata has quit IRC10:59
*** shardy_ has joined #tripleo11:02
*** shardy has quit IRC11:02
*** matbu is now known as matbu_afk11:07
*** shardy_ has quit IRC11:07
*** shardy has joined #tripleo11:08
*** rhallisey has joined #tripleo11:27
*** thrash|g0ne is now known as thrash11:30
*** jistr is now known as jistr|class11:33
*** lucasagomes is now known as lucas-hungry11:40
*** matbu_afk is now known as matbu11:40
*** panda|afk is now known as panda11:50
*** tzumainn has joined #tripleo11:53
*** trown|outttypeww is now known as trown12:02
*** jayg|g0n3 is now known as jayg12:13
*** jdob has joined #tripleo12:15
*** dprince has joined #tripleo12:18
*** weshay has joined #tripleo12:21
*** yog__ has quit IRC12:29
ukalifon1rlandy: Hi. Giulio mentioned that you are doing some scaling tests. Have you been able to scale the cloud (add compute nodes, for example) ?12:35
rlandyukalifon1: yes ... CI is running and scaling overcloud nodes ... will send you links12:36
ukalifon1rlandy: Have you been able to scale multiple times? Or does the CI scale once and consider the test as passed ?12:37
rlandyukalifon1: the CI is setup to scale first compute and then ceph12:38
*** lazy_prince has quit IRC12:38
rlandydue to memory issues heat has been having, I have disabled the second scaling as it usually results in OOM errors12:38
*** lazy_prince has joined #tripleo12:39
rlandyukalifon: but once we have a fix for heat, then yes, the CI job will scale twice in a row12:39
openstackgerritMerged openstack/tripleo-heat-templates: Wire in optional network creation for overcloud  https://review.openstack.org/17784412:39
gfidentedprince, derekh using the puppet single image locally, I end up with an image which misses os-net-config despite it being in the list of elements DIB is trying to install12:40
gfidenteever seen this? am I missing something obvious?12:40
*** lucas-hungry is now known as lucasagomes12:41
dprincegfidente: path issue maybe? It gets it for me... Haven't tried today though12:44
gfidentedprince, ack will investigate12:45
*** killer_prince has joined #tripleo12:49
*** lazy_prince has quit IRC12:51
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Update neutron local_ip to use the tenant network  https://review.openstack.org/17871612:51
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add a network ports IP mapping resource  https://review.openstack.org/17871412:51
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: An environment file to enable network isolation  https://review.openstack.org/18505912:51
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add isolated network ports to block storage roles  https://review.openstack.org/18082412:51
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add isolated network ports to swift roles  https://review.openstack.org/18082312:51
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: os-net-config templates to configure vlans on bond  https://review.openstack.org/18458012:51
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Switch net-config templates to use OS::stack_id  https://review.openstack.org/18434312:51
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add isolated network ports to ceph roles  https://review.openstack.org/18082212:51
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add isolated network ports to controller roles  https://review.openstack.org/17784612:51
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add isolated network ports to compute roles  https://review.openstack.org/18082112:51
*** adrianopetrich has joined #tripleo12:51
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add a ports (ip address) abstraction layer  https://review.openstack.org/17784512:51
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add isolated net parameters to net-config stacks  https://review.openstack.org/18082012:51
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Make puppet all-nodes Ip networks configurable  https://review.openstack.org/18558112:51
openstackgerritDan Prince proposed openstack/tripleo-incubator: devtest_testenv.sh: support for multiple bridges  https://review.openstack.org/17788012:51
openstackgerritDan Prince proposed openstack/tripleo-incubator: Wire --vlan-trunk-ids into devtest_testenv.sh  https://review.openstack.org/18358812:51
openstackgerritDan Prince proposed openstack/tripleo-incubator: Rename brbm.xml template to net.xml  https://review.openstack.org/18353912:51
openstackgerritDan Prince proposed openstack/tripleo-incubator: setup-network: add support for vlan trunks  https://review.openstack.org/18354012:51
openstackgerritDan Prince proposed openstack/tripleo-incubator: cleanup-env: Allow configurable bridge names.  https://review.openstack.org/17787712:52
openstackgerritDan Prince proposed openstack/tripleo-incubator: Move vm.xml to domain.xml  https://review.openstack.org/18354112:52
*** lazy_prince has joined #tripleo12:53
openstackgerritJiri Tomasek proposed openstack/tuskar-ui: Synced run_tests.sh with horizon, requirements cleanup  https://review.openstack.org/18558312:55
*** killer_prince has quit IRC12:56
*** jistr|class is now known as jistr13:00
*** jehb has joined #tripleo13:01
*** tserong has quit IRC13:06
*** weshay is now known as weshay_brb13:08
*** weshay_brb is now known as weshay13:12
*** julim has joined #tripleo13:12
*** zaneb has joined #tripleo13:16
*** jprovazn has quit IRC13:24
*** morazi has joined #tripleo13:28
*** links has quit IRC13:29
*** lazy_prince has quit IRC13:33
openstackgerritJiri Tomasek proposed openstack/tuskar-ui: Synced run_tests.sh with horizon, requirements cleanup  https://review.openstack.org/18558313:40
*** GheRivero has left #tripleo13:40
openstackgerritJiri Stransky proposed openstack/tripleo-puppet-elements: Install fence agents on the controller image  https://review.openstack.org/18559713:48
jistrjayg: morning :) when you have some bandwidth available, could you please provide feedback if this seems to you like a reasonable thing to do https://github.com/redhat-openstack/puppet-pacemaker/pull/4913:52
*** akrivoka has quit IRC13:53
*** lblanchard has joined #tripleo13:56
*** sdake has joined #tripleo13:56
*** bnemec has joined #tripleo13:57
*** dasm is now known as dasm|afk13:58
*** radez_g0n3 is now known as radez14:01
*** jprovazn has joined #tripleo14:01
jaygjistr: sure thing, I shoul be able to review that today, that is the fencing change, right?14:02
jayglooks fine to me, I'll point crag at it to make sure he has no concerns, we can merge it later today14:03
jistrjayg: yeah just renaming the manifests. If things go well, we might be able to construct some generic solution for creating stonith resources in pacemaker by taking input from parameters in Heat and translating that directly into pacemaker::stonith::* manifest names, so having conventions in naming there would be helpful.14:04
jistrif things don't go so well we'll need to do some manual wrapper14:04
jaygyeah, I think we have long not wanted to have to do manual wrappers  :)14:05
jistralso for the time being we'll probably use the proven ipmilan/xvm manifests14:05
jistrbut in the long term it might be nice to switch to those manifests which were generated14:06
jaygyeah, I would start there for sure14:06
* jayg afk for a bit, but should be on call14:06
jistrack14:06
*** spzala has joined #tripleo14:08
jistri think the generated manifests might have an error in them and also we might want to do some manual amendments there before we start using them (support $name, get the xvm/ipmilan ones on par feature-wise with the current proven manifests etc.)14:09
jistrjayg: ^ so in the long term i'd consider moving away from the autogenerated fashion, and only use the autogeneration as a starting point. I don't suppose it would be a huge amount of work to keep them in sync with actual fence agents, and we'll have much more freedom if we don't have to autogenerate.14:10
*** spzala has quit IRC14:14
*** spzala has joined #tripleo14:14
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Make puppet all-nodes Ip networks configurable  https://review.openstack.org/18558114:25
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: An environment file to enable network isolation  https://review.openstack.org/18505914:25
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: os-net-config templates to configure vlans on bond  https://review.openstack.org/18458014:25
hewbroccaspredzy: you're at work this week, right?14:26
spredzyhewbrocca, I am yes :)14:27
hewbroccaxlnt14:27
hewbroccadprince: is gonna lean on you, look out!14:27
hewbrocca:D14:27
spredzyahah I am ready but yes I know about the network mgmt reviews ;)14:28
*** bvandenh has quit IRC14:28
*** akrivoka has joined #tripleo14:29
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Make puppet all-nodes Ip networks configurable  https://review.openstack.org/18558114:36
slagledprince: did you mean to remove the -a I added to: https://review.openstack.org/#/c/177877/14:37
slagledprince: either way i'm fine with it now14:37
dprinceslagle: no, but I think I blew away your change, will fix it shortly14:38
jprovaznanyone here who could review a tuskar patch? https://review.openstack.org/#/c/183148/ (needs one more +2)14:39
jdobjprovazn: i'm not kidding, I was literally just about to hunt someone down to look at that14:41
jdobwas just reviewing my outstanding stuffs14:41
jdobmarios, gfidente ^14:41
jprovazn:)14:41
gfidentehttp://logs.openstack.org/14/178714/13/check-tripleo/check-tripleo-ironic-overcloud-f20puppet-ha/de6bdb4/ mongod failed to start on all nodes, probably worth keepeing an eye14:41
openstackgerritYanis Guenane proposed openstack/tripleo-heat-templates: Update mongodb implementation to reflect master  https://review.openstack.org/18562814:41
gfidentethere is spredzy ! :)14:44
spredzyo/ ;)14:44
*** cody-somerville has joined #tripleo14:45
*** cody-somerville has joined #tripleo14:45
*** hewbrocca has quit IRC14:49
*** matbu is now known as matbu_afk14:56
*** untriaged-bot has joined #tripleo15:00
untriaged-botNo untriaged bugs so far! \o/15:00
*** untriaged-bot has quit IRC15:00
*** matbu_afk is now known as matbu15:02
*** Goneri has quit IRC15:08
*** panda has quit IRC15:21
*** panda has joined #tripleo15:21
openstackgerritYanis Guenane proposed openstack/tripleo-heat-templates: Update mongodb implementation to reflect master  https://review.openstack.org/18562815:25
jistrjayg: oh one more thing15:28
jistri forgot on the call15:29
jistrjayg: for the current HA setup you'll want this in the devtestrc file too15:29
jistrexport DIB_CLOUD_INIT_ETC_HOSTS=''15:29
jistrjayg: and i had to also export this today:15:30
jistrexport NODE_MEM=409615:30
jistrjayg: because the controller nodes were getting quite close to the RAM limit, so when i wanted to run manuall yum install there to play with fencing, it ran out of memory15:30
*** dsneddon has joined #tripleo15:32
*** aufi has quit IRC15:33
*** jdob has quit IRC15:34
*** jdob has joined #tripleo15:34
*** jistr has quit IRC15:40
*** derekh_ has joined #tripleo15:49
*** derekh has quit IRC15:53
*** noslzzp has joined #tripleo15:54
*** MasterPiece has joined #tripleo15:56
*** adrianopetrich has quit IRC15:58
*** MasterPiece has quit IRC15:58
*** MasterPiece has joined #tripleo15:58
*** MasterPiece has quit IRC15:59
*** dtantsur is now known as dtantsur|afk16:00
*** rwsu has joined #tripleo16:02
*** alop has joined #tripleo16:04
*** paramite has quit IRC16:04
*** gfidente is now known as gfidente|afk16:04
*** regebro has quit IRC16:20
*** mcornea has quit IRC16:20
*** MasterPiece has joined #tripleo16:24
*** pino|work has quit IRC16:32
*** trown is now known as trown|lunch16:41
*** bvandenh has joined #tripleo16:50
*** mcornea has joined #tripleo16:55
openstackgerritDan Prince proposed openstack/tripleo-incubator: devtest_testenv.sh: support for multiple bridges  https://review.openstack.org/17788016:59
openstackgerritDan Prince proposed openstack/tripleo-incubator: Wire --vlan-trunk-ids into devtest_testenv.sh  https://review.openstack.org/18358816:59
openstackgerritDan Prince proposed openstack/tripleo-incubator: Rename brbm.xml template to net.xml  https://review.openstack.org/18353916:59
openstackgerritDan Prince proposed openstack/tripleo-incubator: setup-network: add support for vlan trunks  https://review.openstack.org/18354016:59
openstackgerritDan Prince proposed openstack/tripleo-incubator: cleanup-env: Allow configurable bridge names.  https://review.openstack.org/17787716:59
openstackgerritDan Prince proposed openstack/tripleo-incubator: Move vm.xml to domain.xml  https://review.openstack.org/18354116:59
*** ifarkas has quit IRC17:02
*** penick has joined #tripleo17:09
*** yamahata has joined #tripleo17:10
*** derekh_ has quit IRC17:12
openstackgerritSteven Hardy proposed openstack/os-collect-config: Allow an initial "burst" of config polls on (re)start  https://review.openstack.org/18567417:16
*** lucasagomes is now known as lucas-dinner17:23
*** dsneddon has quit IRC17:36
*** matbu is now known as matbu_afk17:41
*** HenryG has quit IRC17:42
*** wfoster has quit IRC17:43
*** wfoster has joined #tripleo17:46
*** HenryG has joined #tripleo17:46
*** dsneddon has joined #tripleo17:47
*** trown|lunch is now known as trown17:52
*** HenryG has quit IRC18:01
*** HenryG has joined #tripleo18:01
*** cody-somerville has quit IRC18:03
openstackgerritRyan Hefner proposed openstack/tripleo-heat-templates: Enable NetApp Backends in Cinder  https://review.openstack.org/18483918:03
*** cody-somerville has joined #tripleo18:04
*** cody-somerville has joined #tripleo18:04
openstackgerritJiri Tomasek proposed openstack/tuskar-ui: Synced run_tests.sh with horizon, requirements cleanup  https://review.openstack.org/18558318:05
openstackgerritMerged openstack/tripleo-heat-templates: Add a ports (ip address) abstraction layer  https://review.openstack.org/17784518:08
openstackgerritMerged openstack/tripleo-heat-templates: Add isolated net parameters to net-config stacks  https://review.openstack.org/18082018:09
openstackgerritMerged openstack/tripleo-heat-templates: Add isolated network ports to controller roles  https://review.openstack.org/17784618:09
openstackgerritMerged openstack/tripleo-heat-templates: Add isolated network ports to compute roles  https://review.openstack.org/18082118:10
*** lblanchard has quit IRC18:10
openstackgerritMerged openstack/tripleo-heat-templates: Add isolated network ports to ceph roles  https://review.openstack.org/18082218:11
openstackgerritMerged openstack/tripleo-heat-templates: Add isolated network ports to swift roles  https://review.openstack.org/18082318:11
openstackgerritMerged openstack/tripleo-heat-templates: Add isolated network ports to block storage roles  https://review.openstack.org/18082418:12
openstackgerritMerged openstack/tripleo-heat-templates: Add a network ports IP mapping resource  https://review.openstack.org/17871418:13
openstackgerritMerged openstack/tripleo-heat-templates: Update neutron local_ip to use the tenant network  https://review.openstack.org/17871618:14
openstackgerritMerged openstack/tripleo-heat-templates: Switch net-config templates to use OS::stack_id  https://review.openstack.org/18434318:16
openstackgerritMerged openstack/tripleo-heat-templates: An environment file to enable network isolation  https://review.openstack.org/18505918:17
*** lblanchard has joined #tripleo18:20
*** jprovazn has quit IRC18:28
*** dprince has quit IRC18:32
*** daneyon has joined #tripleo18:33
*** ukalifon2 has joined #tripleo18:46
*** ukalifon1 has quit IRC18:46
openstackgerritimain proposed openstack/tripleo-heat-templates: Containerized TripleO Overcloud.  https://review.openstack.org/17884018:57
openstackgerritMerged openstack-infra/tripleo-ci: Update delorean URL  https://review.openstack.org/18464019:03
openstackgerritimain proposed openstack/tripleo-heat-templates: Containerized TripleO Overcloud.  https://review.openstack.org/17884019:03
*** rhallisey has quit IRC19:04
*** rhallisey has joined #tripleo19:06
*** ukalifon2 has quit IRC19:10
*** daneyon has quit IRC19:11
*** barra204 has joined #tripleo19:16
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates: Map Ceilometer services to isolated networks  https://review.openstack.org/18570819:21
*** panda has quit IRC19:21
*** panda has joined #tripleo19:22
openstackgerritMerged openstack/tripleo-incubator: Update puppet docs to set ROOT_DISK  https://review.openstack.org/17633719:43
openstackgerritMerged openstack/tripleo-incubator: cleanup-env: Allow configurable bridge names.  https://review.openstack.org/17787719:45
openstackgerritMerged openstack/tripleo-incubator: devtest_testenv.sh: support for multiple bridges  https://review.openstack.org/17788019:45
openstackgerritMerged openstack/tripleo-incubator: Remove sysctl element from puppet image  https://review.openstack.org/18474919:45
*** rlandy has quit IRC19:46
*** panda has quit IRC19:48
*** panda has joined #tripleo19:53
*** radez is now known as radez_g0n320:04
*** yamahata has quit IRC20:07
*** stevebaker has quit IRC20:17
*** stevebaker has joined #tripleo20:17
*** stevebaker has quit IRC20:17
*** stevebaker has joined #tripleo20:17
*** stevebaker has quit IRC20:18
*** stevebaker has joined #tripleo20:18
openstackgerritMerged openstack/tripleo-heat-templates: overcloud stepped deployment environment  https://review.openstack.org/16192720:21
*** stevebaker has quit IRC20:23
*** stevebaker has joined #tripleo20:23
*** stevebaker has quit IRC20:24
*** stevebaker has joined #tripleo20:24
*** radez_g0n3 is now known as radez20:26
*** gfidente|afk is now known as gfidente20:27
*** stevebaker has quit IRC20:27
*** julim has quit IRC20:27
*** stevebaker has joined #tripleo20:27
openstackgerritMerged openstack/tripleo-heat-templates: We don't need to create the clustercheck user anymore  https://review.openstack.org/18447620:30
openstackgerritGiulio Fidente proposed openstack-infra/tripleo-ci: Enable NeutronL3HA for the HA job  https://review.openstack.org/18546120:36
Sloweranyone else seeing controller issues?  Looks like maybe ceph is hanging.20:37
Slowerhttp://paste.fedoraproject.org/225780/67199514/raw/20:37
Slowerthis is a fresh checkout a few hrs ago, full rebuild20:37
bnemecSlower: It's ControllerAllNodesDeployment that appears to be stuck.  You'll probably want to take a look at the os-collect-config logs on the controller node to see why.20:38
Slowerok20:38
bnemec(I say that because it's the only resource that's still CREATE_IN_PROGRESS)20:38
openstackgerritMerged openstack/tripleo-heat-templates: Ensures mongodb configuration only happens if mongodb is needed  https://review.openstack.org/18449420:38
*** yamahata has joined #tripleo20:40
gfidente^^ that had an issue though :(20:41
gfidenteoh merge conflict, commenting there20:42
*** jayg is now known as jayg|g0n320:44
Slowerbnemec: right20:44
Slowerbnemec: embarrassingly enough I don't know how to ssh into the controller :)20:45
jdobSlower: find it IP using nova list and ssh in as heat-admin20:46
Slowerno special key?20:46
Slowerapparently not..20:46
jdobshould already be configured with it20:46
Slowerthanks jdob :)20:46
bnemecSlower: devtest sets them up with the key for the regular user you're running devtest as.20:46
jdobSlower: np :) I felt dumb the first time I had to do that too, I'm not sure it's actually documented anywhere20:46
*** alop has quit IRC20:49
*** stevebaker has quit IRC20:50
*** stevebaker has joined #tripleo20:50
*** stevebaker has quit IRC20:52
*** stevebaker has joined #tripleo20:52
*** morazi has quit IRC20:54
Slowerok, another dumb question, what log would I look at to find the issue?20:59
*** daneyon has joined #tripleo21:00
*** untriaged-bot has joined #tripleo21:00
untriaged-botNo untriaged bugs so far! \o/21:00
*** untriaged-bot has quit IRC21:00
*** HenryG has quit IRC21:04
*** daneyon has quit IRC21:05
*** HenryG has joined #tripleo21:07
*** lucas-dinner has quit IRC21:10
gfidenteSlower, log on your controller node as heat-admin user21:11
gfidentesudo -i21:11
gfidentejournalctl -u os-collect-config21:11
gfidenteand search for some error21:11
Slowerthanks gfidente!21:12
*** lblanchard has quit IRC21:13
*** trown is now known as trown|outttypeww21:15
Slowerhrrm21:17
Slowerhttp://paste.fedoraproject.org/225795/14326750/raw/21:17
Slowerthere's that error, which is repeating every 30s21:18
Sloweror this one which is earlier: http://paste.fedoraproject.org/225796/14326751/21:19
Slowerneither seem very straight forward to me21:19
gfidenteSlower, if you add -l to journalctl it should give you full line length21:21
gfidenteare you deploying with the instructions for devtest?21:21
*** weshay has quit IRC21:21
Slowergfidente: yes21:26
Slowerfresh build today from latest master21:27
gfidenteand this is on fedora?21:27
Sloweryes21:27
Slowerf21 I think actually tho21:27
Sloweryeah21:27
*** radek__ has quit IRC21:27
Sloweroh yeah I pasted from less output21:27
Slowerhttp://paste.fedoraproject.org/225803/14326757/21:29
*** mcornea has quit IRC21:30
*** akrivoka has quit IRC21:30
gfidenteso that INTERFACES var should not be empty21:31
gfidentecheck https://github.com/openstack/tripleo-image-elements/blob/master/elements/keepalived/os-refresh-config/configure.d/22-keepalived21:31
Slowerhrrm21:32
Slowerdid I not set something right in the undercloudrc or something?21:32
gfidentesupposedly coming from https://github.com/openstack/tripleo-heat-templates/blob/master/controller.yaml#L61421:33
gfidentethere isn't anything you can change there21:34
gfidentecan you run21:34
gfidenteos-apply-config --key virtual_interfaces.instances --type raw --key-default ''21:34
gfidenteas root on your controller?21:34
gfidenteis it returning anything?21:34
Sloweroh there's a pile of network patches that just went in21:35
Sloweros-apply-config --key virtual_interfaces.instances --type raw --key-default ''21:36
Slower[{"priority": 101, "vrrp_instance_name": "VI_CONTROL", "virtual_router_id": 51, "virtual_ips": [{"interface": "br-ex", "ip": "192.0.2.3"}], "keepalive_interface": "br-ex"}, {"priority": 101, "vrrp_instance_name": "VI_PUBLIC", "virtual_router_id": 52, "virtual_ips": [{"interface": "br-ex", "ip": "192.0.2.4"}], "keepalive_interface": "br-ex"}]21:36
gfidentecan you21:36
gfidentejournalctl -u os-collect-config -lf21:37
gfidenteto see if you can figure what is the script which is failing? os-collect-config will print an ERROR and try again all the scripts until it fails21:37
gfidenteOR succeeds and exits21:37
Slowerdib-run-parts?21:38
SlowerMay 26 21:38:25 ov-3qmlsxujbsb-0-rk5tiroe5p36-controller-od2bb7ayoldq os-collect-config[791]: libsemanage.semanage_read_policydb: Could not open kernel policy /etc/selinux/targeted/modules/active/policy.kern for reading. (No such file or directory).21:38
SlowerMay 26 21:38:25 ov-3qmlsxujbsb-0-rk5tiroe5p36-controller-od2bb7ayoldq os-collect-config[791]: OSError: No such file or directory21:39
SlowerMay 26 21:38:25 ov-3qmlsxujbsb-0-rk5tiroe5p36-controller-od2bb7ayoldq os-collect-config[791]: [2015-05-26 21:38:25,301] (os-refresh-config) [ERROR] during pre-configure phase. [Command '['dib-run-parts', '/usr/l21:39
Sloweribexec/os-refresh-config/pre-configure.d']' returned non-zero exit status 1]21:39
SlowerMay 26 21:38:25 ov-3qmlsxujbsb-0-rk5tiroe5p36-controller-od2bb7ayoldq os-collect-config[791]: [2015-05-26 21:38:25,302] (os-refresh-config) [ERROR] Aborting...21:39
Slowernot sure otherwise21:39
gfidentethis seems valid, but I can't tell why the error21:40
gfidenteselinux should be in permissive mode, is that the case21:40
gfidente?21:40
gfidente(on the controller)21:40
Sloweryes permissive21:41
Slowermany others are running ok21:43
Slowerit's running firewall rules21:43
gfidenteyeah as soon as one fails it will start again21:44
Slowerhttp://paste.fedoraproject.org/225811/43267667/raw/21:44
gfidentelooks something broken with the image21:45
gfidentedo you have the selinux-policy-targeted package installed?21:47
gfidente(in the controller node)21:47
Slowerselinux-policy-targeted-3.13.1-105.13.fc21.noarch21:48
Slowerya21:48
gfidentebut21:48
SlowerI nuked the contents of some of the scripts and got it working.. :)21:48
gfidentels /etc/selinux/targeted/modules/active/21:48
gfidentereturns nothing?21:48
Slowerthere's lots of files there21:49
gfidenteincluding policy.kern ?21:49
Slowerbut no policy.kern21:49
gfidentewhich should be shipped with the package21:49
gfidenteso again , looks like something broken with the image21:49
gfidenteyou should rebuild it probably21:50
gfidentethat meant21:50
gfidenteheat stack-delete overcloud (from the undercloud)21:50
Sloweryes you are right21:50
Slowerrpm -ql shows it in the pkg21:50
gfidenterm -fr tripleo/overcloud*21:50
gfidenteand devtest_overcloud.sh again21:51
gfidenteanyway, while you're at it, all this stuff you're trying is months old and currently unmaintained21:51
gfidentewe're working on an implementation which configures the overcloud using puppet21:51
gfidenteif you want to try that instead21:51
gfidentedelete the overcloud stack21:52
gfidenteand then follow21:52
gfidentehttps://github.com/openstack/tripleo-incubator/blob/master/doc/source/puppet.rst21:52
Slowergfidente: I was using: http://etherpad.corp.redhat.com/heat-puppet-devtest21:56
bnemecHoly cow, we're still using merge.py in the Ubuntu job?21:59
bnemecGross! :-P21:59
SlowerI'll rebuild and cross my fingers ;)22:00
*** cwolferh has quit IRC22:01
gfidenteSlower, I'd go with the puppet implementation as well nowdays22:01
gfidenteso make sure to read that and export what is needed22:01
gfidentebefore devtest_overcloud.sh22:01
Slowergfidente: yeah ok.  Thanks a lot for the help!22:01
SlowerI think I'm almost done for the day..22:01
*** gfidente changes topic to "Deploying OpenStack Using OpenStack | Summit proposed topics: https://etherpad.openstack.org/p/tripleo-liberty-proposed-sessions | https://wiki.openstack.org/wiki/TripleO"22:04
openstackgerritMerged openstack/tripleo-heat-templates: os-net-config templates to configure vlans on bond  https://review.openstack.org/18458022:04
openstackgerritBen Nemec proposed openstack/tripleo-heat-templates: Fix grammar nits in bond-with-vlans templates  https://review.openstack.org/18575722:07
*** rhallisey has quit IRC22:13
openstackgerritMerged openstack/tripleo-heat-templates: Define Glance Pacemaker resources on $pacemaker_master node only  https://review.openstack.org/18499622:13
*** shardy has quit IRC22:27
*** alop has joined #tripleo22:27
*** rhallisey has joined #tripleo22:33
*** radez is now known as radez_g0n322:34
*** lifeless has quit IRC22:35
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Add Nova as Pacemaker resource  https://review.openstack.org/18576622:40
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates: Map Cinder services to isolated networks  https://review.openstack.org/18576722:41
*** daneyon has joined #tripleo22:49
*** daneyon has quit IRC22:54
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates: Map Heat services to isolated networks  https://review.openstack.org/18577522:55
*** yuanying has joined #tripleo22:59
gfidente'night everyone22:59
*** gfidente has quit IRC22:59
*** chlong has joined #tripleo23:09
*** tserong has joined #tripleo23:10
*** chlong has quit IRC23:15
*** cwolferh has joined #tripleo23:33
*** chlong has joined #tripleo23:44
openstackgerritSteve Baker proposed openstack/tripleo-heat-templates: Config & deployments to update overcloud packages  https://review.openstack.org/17997423:47
*** lifeless has joined #tripleo23:54

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!