Friday, 2015-03-20

*** sdake_ has joined #tripleo00:19
*** sdake__ has joined #tripleo00:21
*** sdake has quit IRC00:22
*** sdake_ has quit IRC00:25
*** dprince has joined #tripleo00:26
*** alop has quit IRC00:29
*** Marga_ has quit IRC00:29
*** Marga_ has joined #tripleo00:29
*** Marga_ has quit IRC00:37
openstackgerritMartin André proposed stackforge/kolla: Move genenv.sh and start.sh to tools directory  https://review.openstack.org/16605900:51
openstackgerritMartin André proposed stackforge/kolla: Move genenv.sh and start.sh to tools directory  https://review.openstack.org/16605900:54
openstackgerritMerged stackforge/kolla: Check for root privilege in start.sh  https://review.openstack.org/16589200:58
openstackgerritMerged stackforge/kolla: Remove traces of kubernetes  https://review.openstack.org/16591801:01
openstackgerritMartin André proposed stackforge/kolla: Remove reference to k8s directory from README  https://review.openstack.org/16606501:16
openstackgerritDaneyon Hansen proposed stackforge/kolla: Implements: blueprint Implement a database container set  https://review.openstack.org/16606901:19
daneyonsdake ^01:20
*** prad has quit IRC01:21
openstackgerritDaneyon Hansen proposed stackforge/kolla: Update gitignore  https://review.openstack.org/16607001:24
openstackgerritMartin André proposed stackforge/kolla: Move genenv.sh and start.sh to tools directory  https://review.openstack.org/16605901:33
openstackgerritMerged openstack/tripleo-incubator: Remove non-ascii characters in tripleo-incubator/doc/source/troubleshooting.rst  https://review.openstack.org/16504501:37
openstackgerritMerged stackforge/kolla: Always restart glance services  https://review.openstack.org/16599701:39
tchaypo0-01:59
openstackgerritSteven Dake proposed stackforge/kolla: Add pid: host to libvirt  https://review.openstack.org/16607402:02
*** yamahata has quit IRC02:11
*** noslzzp has quit IRC02:18
*** pradeep1 has quit IRC02:22
*** sdake__ has quit IRC02:25
*** sdake has joined #tripleo02:25
*** stendulker has joined #tripleo02:29
*** stendulker_ has joined #tripleo02:41
*** stendulker has quit IRC02:41
*** weshay has quit IRC02:51
*** stendulker has joined #tripleo02:51
*** weshay has joined #tripleo02:52
*** stendulker_ has quit IRC02:53
*** greghaynes has quit IRC02:58
openstackgerritDaneyon Hansen proposed stackforge/kolla: Implements: blueprint Implement a database container set  https://review.openstack.org/16606903:00
*** greghaynes has joined #tripleo03:05
*** sdake_ has joined #tripleo03:05
*** subscope_ has joined #tripleo03:05
*** radez is now known as radez_g0n303:09
*** sdake has quit IRC03:10
*** pradeep has joined #tripleo03:10
*** sdake has joined #tripleo03:10
openstackgerritDaneyon Hansen proposed stackforge/kolla: Implements: blueprint Implement a database container set  https://review.openstack.org/16606903:10
*** sdake_ has quit IRC03:14
*** stendulker has quit IRC03:17
*** stendulker has joined #tripleo03:17
*** noslzzp has joined #tripleo03:23
*** spzala has quit IRC03:30
openstackgerritSteven Dake proposed stackforge/kolla: Improve Heat integration  https://review.openstack.org/16609103:41
*** Marga_ has joined #tripleo03:43
*** Marga_ has quit IRC03:46
*** yog_ has joined #tripleo03:55
*** Marga_ has joined #tripleo03:56
openstackgerritMartin André proposed stackforge/kolla: Fix `wait_for` function in kolla-common.sh  https://review.openstack.org/16569903:57
openstackgerritMartin André proposed stackforge/kolla: Cleanup leftover after wait_for was merged into kolla-common.sh  https://review.openstack.org/16570003:57
*** untriaged-bot has joined #tripleo04:00
untriaged-botUntriaged bugs so far:04:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/143044504:00
openstackLaunchpad bug 1430445 in tripleo "Horizon translations aren't compiled" [Undecided,In progress] - Assigned to Steve McLellan (sjmc7)04:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/143059904:00
openstackLaunchpad bug 1430599 in diskimage-builder "ramdisk-image-create with ironic-discoverd-ramdisk element fails" [Undecided,Fix committed] - Assigned to Yuiko Takada (takada-yuiko)04:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/142990204:00
openstackLaunchpad bug 1429902 in tripleo "os-refresh-config fails during post-configure phase" [Undecided,New]04:00
*** untriaged-bot has quit IRC04:00
*** Marga_ has quit IRC04:02
*** stendulker_ has joined #tripleo04:03
*** stendulker has quit IRC04:04
*** Marga_ has joined #tripleo04:11
*** Marga_ has quit IRC04:17
*** tzumainn has quit IRC04:20
*** pradeep has quit IRC04:24
*** Marga_ has joined #tripleo04:25
*** wuhg has joined #tripleo04:26
*** eghobo has joined #tripleo04:27
*** Marga_ has quit IRC04:31
*** Marga_ has joined #tripleo04:40
*** noslzzp has quit IRC04:44
*** Marga_ has quit IRC04:53
*** pradeep has joined #tripleo04:53
*** eghobo has quit IRC04:54
*** yamahata has joined #tripleo04:57
*** chlong has quit IRC05:02
openstackgerritSteven Dake proposed stackforge/kolla: Make the Horizon dashboard work properly  https://review.openstack.org/16610205:13
openstackgerritSteven Dake proposed stackforge/kolla: Use -L flag in curl  https://review.openstack.org/16610305:13
*** ishant has joined #tripleo05:14
*** Marga_ has joined #tripleo05:16
*** Marga_ has quit IRC05:16
*** Marga_ has joined #tripleo05:16
*** masco has joined #tripleo05:18
*** chlong has joined #tripleo05:19
*** Marga_ has quit IRC05:37
*** Marga_ has joined #tripleo05:38
*** eghobo has joined #tripleo05:38
openstackgerritDaneyon Hansen proposed stackforge/kolla: Refactors Keystone Start Script  https://review.openstack.org/16610605:52
openstackgerritDaneyon Hansen proposed stackforge/kolla: Refactors Keystone Start Script  https://review.openstack.org/16610605:54
*** eghobo_ has joined #tripleo05:55
openstackgerritDaneyon Hansen proposed stackforge/kolla: Implements: blueprint Implement a database container set  https://review.openstack.org/16606905:55
*** eghobo has quit IRC05:58
*** chlong has quit IRC06:01
*** sdake_ has joined #tripleo06:04
*** eghobo_ has quit IRC06:06
*** eghobo has joined #tripleo06:07
*** sdake has quit IRC06:08
*** chlong has joined #tripleo06:13
*** sdake has joined #tripleo06:18
*** sdake_ has quit IRC06:22
*** marios has joined #tripleo06:24
*** jprovazn has joined #tripleo06:27
openstackgerritSteven Dake proposed stackforge/kolla: Remove ADD wait_for from centos-rdo-base dockerfile  https://review.openstack.org/16610806:29
*** Marga_ has quit IRC06:34
*** eghobo has quit IRC06:36
*** dasm|afk is now known as dasm06:41
*** subscope_ has quit IRC06:42
openstackgerritSteven Dake proposed stackforge/kolla: Remove /var/log/mariadb from hostmount list  https://review.openstack.org/16611506:44
*** eghobo has joined #tripleo06:49
*** yuanying has quit IRC06:51
*** mrunge has joined #tripleo06:52
*** killer_prince is now known as lazy_prince06:53
*** yuanying has joined #tripleo06:55
*** yamahata has quit IRC06:58
*** yamahata has joined #tripleo06:58
*** mandre1 has joined #tripleo07:02
*** mandre has quit IRC07:04
*** mandre1 has quit IRC07:08
*** maufart has joined #tripleo07:15
*** eghobo has quit IRC07:20
openstackgerritDaneyon Hansen proposed stackforge/kolla: Fixes Keystone openrc and sets / for scripts  https://review.openstack.org/16612307:21
*** regebro has joined #tripleo07:33
*** shardy has joined #tripleo07:40
*** panda has quit IRC07:40
*** panda has joined #tripleo07:41
*** stendulker_ has quit IRC07:43
*** chlong has quit IRC07:45
*** jtomasek has quit IRC07:46
*** rdopiera has joined #tripleo07:54
*** mandre has joined #tripleo07:54
*** mandre has joined #tripleo07:56
*** jtomasek has joined #tripleo07:56
*** jistr has joined #tripleo07:58
*** mandre1 has joined #tripleo08:00
*** mandre has quit IRC08:00
*** jcoufal has joined #tripleo08:01
*** dtantsur|afk is now known as dtantsur08:02
*** eghobo has joined #tripleo08:06
*** eghobo_ has joined #tripleo08:08
*** eghobo has quit IRC08:11
*** mandre1 has quit IRC08:12
*** athomas has joined #tripleo08:20
*** openstackgerrit has quit IRC08:22
*** openstackgerrit has joined #tripleo08:22
*** lsmola has quit IRC08:28
*** ifarkas has joined #tripleo08:34
openstackgerritMerged openstack/tripleo-image-elements: Identify os-net-config conf file as autogenerated  https://review.openstack.org/16588108:40
*** dtantsur is now known as dtantsur|bbl08:41
*** lsmola has joined #tripleo08:44
*** eghobo_ has quit IRC08:50
*** eghobo has joined #tripleo08:56
openstackgerritMerged openstack/diskimage-builder: Flagging ubuntu-minimal as untested  https://review.openstack.org/16407009:00
*** lazy_prince is now known as killer_prince09:00
*** mandre has joined #tripleo09:05
*** yamahata has quit IRC09:09
*** lucasagomes has joined #tripleo09:13
*** ishant has quit IRC09:15
*** eghobo has quit IRC09:18
*** eghobo has joined #tripleo09:19
*** eghobo has quit IRC09:24
*** ishant has joined #tripleo09:26
*** mandre has quit IRC09:27
*** derekh has joined #tripleo09:28
*** mandre has joined #tripleo09:28
openstackgerritMerged openstack/diskimage-builder: Cleanup/restify components.rst  https://review.openstack.org/15539009:34
openstackgerritMerged openstack/diskimage-builder: openSUSE update  https://review.openstack.org/15966209:34
*** rdopiera_ has joined #tripleo09:35
*** rdopiera has quit IRC09:36
*** mcornea has joined #tripleo09:38
*** mandre has quit IRC09:47
*** gfidente has joined #tripleo09:58
*** gfidente has joined #tripleo09:58
*** untriaged-bot has joined #tripleo10:00
untriaged-botUntriaged bugs so far:10:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/143044510:00
openstackLaunchpad bug 1430445 in tripleo "Horizon translations aren't compiled" [Undecided,In progress] - Assigned to Steve McLellan (sjmc7)10:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/143059910:00
openstackLaunchpad bug 1430599 in diskimage-builder "ramdisk-image-create with ironic-discoverd-ramdisk element fails" [Undecided,Fix committed] - Assigned to Yuiko Takada (takada-yuiko)10:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/142990210:00
openstackLaunchpad bug 1429902 in tripleo "os-refresh-config fails during post-configure phase" [Undecided,New]10:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/143443110:00
openstackLaunchpad bug 1434431 in tripleo "Abnormal exit in building rhel images by diskimage-builder for system is not registered." [Undecided,New]10:00
*** untriaged-bot has quit IRC10:00
openstackgerritMerged openstack/tuskar-ui: Make role validation more useful  https://review.openstack.org/16472710:04
*** eghobo has joined #tripleo10:09
*** pblaho__ is now known as pblaho10:15
*** pradeep has quit IRC10:25
*** rdopiera_ has quit IRC10:28
*** rdopiera has joined #tripleo10:28
*** eghobo_ has joined #tripleo10:29
*** eghobo has quit IRC10:32
*** rlandy has joined #tripleo10:36
openstackgerritJiri Tomasek proposed openstack/tuskar-ui: Remove password check from is_required Parameter method  https://review.openstack.org/16616010:36
*** akrivoka has joined #tripleo10:44
*** yog_ has quit IRC10:47
*** eghobo_ has quit IRC10:50
*** eghobo has joined #tripleo10:51
*** killer_prince is now known as lazy_prince10:54
openstackgerritMerged openstack/tripleo-heat-templates: Add support for Neutron l3_ha option in puppet templates  https://review.openstack.org/16414410:54
*** thrash|0ut is now known as thrash10:59
*** yuanying has quit IRC11:02
*** eghobo has quit IRC11:03
gfidentethanks marios !11:04
*** jcoufal has quit IRC11:16
*** masco has quit IRC11:16
*** athomas has quit IRC11:21
*** rhallisey has joined #tripleo11:21
openstackgerritMarios Andreou proposed openstack/tuskar: Adds tuskar-delete-roles command  https://review.openstack.org/16552911:23
*** athomas has joined #tripleo11:26
*** rdopiera has quit IRC11:36
*** eghobo has joined #tripleo11:39
*** dtantsur|bbl is now known as dtantsur11:41
*** MasterPiece has joined #tripleo11:41
*** MasterPiece has quit IRC11:42
*** dprince has quit IRC11:43
*** MasterPiece has joined #tripleo11:45
gfidentegetting old but nice to have https://review.openstack.org/#/c/153317/111:50
gfidente+A welcomed :)11:50
*** Marga_ has joined #tripleo11:54
*** sdake has quit IRC11:57
*** eghobo has quit IRC11:58
openstackgerritMarios Andreou proposed openstack/tuskar: Adds tuskar-load-role to load a single role and associated extra-data  https://review.openstack.org/16515011:58
*** pelix has joined #tripleo11:59
openstackgerritMarios Andreou proposed openstack/tuskar: Adds tuskar-load-role to load a single role and associated extra-data  https://review.openstack.org/16515012:03
*** morazi has joined #tripleo12:04
*** lblanchard has joined #tripleo12:05
*** noslzzp has joined #tripleo12:07
*** dprince has joined #tripleo12:11
derekhdprince: I'm jotting things down here, mysqld seems to have a lot of file open so I bounced it https://etherpad.openstack.org/p/dub0J7vwmK12:12
derekhdprince: Do you know if nodepool is still connecting or have they disabled it while we debug ?12:14
dprincederekh: I think it is still trying12:14
dprincederekh: let me service down these two unpingable computes12:14
*** stendulker has joined #tripleo12:15
derekhdprince: ok, I'm going to reset-state the stuck instances, nodepool should be able to delete them12:16
*** radez_g0n3 is now known as radez12:16
dprincederekh: right, unless they were are the failed computes, which some are12:16
*** radez_g0n3 has joined #tripleo12:16
*** radez_g0n3 is now known as radez12:16
derekhdprince: ok, do you think I should hold off so ?12:17
dprincederekh: no, go for it12:17
dprincederekh: I haven't done anything yet12:17
derekhdprince: done12:19
dprincederekh: lets go ahead and delete the nodepool nodes ourselves12:20
*** dpaterson has joined #tripleo12:20
derekhdprince: looks lioke node pool has done it12:21
dprincederekh: well fancy that :)12:21
derekhdprince: gotta pop out for a bit for something, will be back in about 40 minutes12:21
regebroHow do I get the Keystone username into a configuration file created with os-apply-config as a part of a diskimage-builder element when run from instack?12:21
*** sdake has joined #tripleo12:30
*** regebro is now known as regebro|food12:31
*** jdob has joined #tripleo12:34
*** lucasagomes is now known as lucas-hungry12:42
*** dpaterson has quit IRC12:44
*** regebro|food is now known as regebro12:44
*** dpaterson has joined #tripleo12:45
*** sdake_ has joined #tripleo12:52
*** pelix has quit IRC12:53
dprincederekh: I think we've got hung neutron ports as well.12:55
dprincederekh: not seeing the new instances getting floatingip's12:55
*** sdake has quit IRC12:55
*** ChuckC_ has joined #tripleo13:00
*** ChuckC has quit IRC13:01
openstackgerritMerged openstack/diskimage-builder: Add no_timer_check to vm grub cmdline  https://review.openstack.org/15331713:05
*** ChuckC_ has quit IRC13:05
*** dpaterson has quit IRC13:10
*** rhallisey has quit IRC13:13
*** trown|outttypeww is now known as trown13:13
*** dpaterson has joined #tripleo13:15
*** stendulker has quit IRC13:15
gfidentedprince, so the '"}' unexepcted, believe it or not, I have seen it after applying the patch on 1 of 3 supposedly identical controllers13:18
*** ishant has quit IRC13:19
*** ChuckC_ has joined #tripleo13:19
dprincegfidente: by applying the patch do you mean commenting out the 'default_parameters' section of your Heat environment?13:19
*** ishant has joined #tripleo13:20
gfidenteyes13:21
gfidenteit always point to last line of the .pp file13:21
gfidenteFWIW13:21
gfidenteI am thinking about a race of some kind maybe?13:22
dprincegfidente: are you using Delorean current? How new is your Heat?13:22
dprincegfidente: could be13:22
gfidenteheatclient I updated it from pip manually, python-heatclient==0.3.013:24
gfidenteheat in the undercloud is from some 'old' master branch13:24
*** ishant has quit IRC13:25
*** rdopiera has joined #tripleo13:25
gfidenteheat is 055fa384f35732d294630f707d847cf86b08a59b , 26 Jan13:26
*** Marga_ has quit IRC13:26
gfidentedprince, to be clear, this was a resource group of three controllers, not three separate deployments13:27
*** rhallisey has joined #tripleo13:28
dprincegfidente: gotcha, so you were testing/devoping HA13:28
gfidenteyeah13:28
*** wuhg has quit IRC13:39
*** tzumainn has joined #tripleo13:40
*** rdopiera_ has joined #tripleo13:41
derekhdprince: back13:42
*** rdopiera has quit IRC13:42
dprincederekh: I cleaned up a bunch of floatingips and I deleted all the Nodepool instances13:42
dprincederekh: I want a clean slate for everything after restarting MySQL13:42
derekhdprince: ok13:43
dprincederekh: talking in infra to get us re-enabled ATM13:43
dprincederekh: they turned us off13:43
derekhdprince: ahh ok13:43
dprincederekh: here they come now13:44
dprinceBOOM!13:44
dprincederekh: if things are working we should see floatingips eventually attached to them13:44
dprincederekh: all the previous ACTIVE nodes had no floating IPs13:44
dprincederekh: hmmm... there is one ERROR already :(13:45
dprincederekh: but some ACTIVE too, so promising13:45
derekhdprince: I see a floating IP13:45
derekh| 6310ad20-2fda-491f-ab51-631269227f21 | tripleo-precise-tripleo-test-cloud-rh1-1397995.slave.openstack.org | ACTIVE | -          | Running     | default-net=10.2.9.109, 66.187.229.39; tripleo-bm-test=192.168.1.79   |13:45
*** lucas-hungry is now known as lucasagomes13:45
derekhits a start13:45
dprincederekh: there you go, that is what we needed to see again13:45
derekh;-)13:46
*** rhallisey has quit IRC13:48
*** rhallisey has joined #tripleo13:48
derekhdprince: we have a running job https://jenkins02.openstack.org/job/check-tripleo-ironic-overcloud-precise-nonha/883/13:51
dprincederekh: but its the Fedora ones we are backed up on!13:51
dprincederekh: maybe the Fedora slaves take a bit longer to fully come online13:52
derekhdprince: maybe, suppose we'll know in a few minutes how it all pans out ;-)13:53
openstackgerritRadomir Dopieralski proposed openstack/tuskar-ui: Show required service configuration parameters as required  https://review.openstack.org/16623514:00
dprincederekh: I see Fedora node getting cleaned up14:03
dprincederekh: going to ask about the nodepool logs in infra14:04
derekhdprince: ok, I'm wondering if too many instances were spawned together now, so the laod might be causing them to come up too slowley?14:06
dprincederekh: could be. I'm wondering if there was another (unrelated) infra change which broke Fedora slaves yesterday too?14:07
dprincederekh: are the logs for these public?14:07
derekhdprince: also possible, the logs for the template building is public but I don't think the rest are14:07
derekhdprince: not fully sure though14:07
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Set all RabbitMQ queues as mirrored when clustered  https://review.openstack.org/16556414:09
derekhdprince: Not sure their getting an IP from dhcp, seeing logs of these14:16
derekhMar 20 14:12:49 ci-overcloud-notcompute0-fxndafyc3pnh dnsmasq-dhcp[20506]: DHCPDISCOVER(tapb2e1642f-49) 10.2.8.9 fa:16:3e:0a:79:c7 no address available14:16
*** egafford has joined #tripleo14:16
derekh| 2fbce710-3899-4f0c-813b-19fce5480459 |                                     | fa:16:3e:0a:79:c7 | {"subnet_id": "b0ec3a8e-3f2b-471e-b163-012d48b5f416", "ip_address": "10.2.9.107"}     |14:17
dprincederekh: git.openstack.org: Temporary failure in name resolution14:17
dprincederekh: seeing that from the Ubuntu jobs actually14:17
bnemecregebro: Which keystone username are you looking to reference?  Most of them are hard-coded to the name of the service, so there's no metadata for os-apply-config.14:17
regebrobnemec: The keystone one, which then is "admin".14:18
egaffordslagle, bnemec, dprince, derekh: Hi all. Any eyes I could get on review https://review.openstack.org/#/c/165149/ would be greatly appreciated. This will allow us to circumvent the RHEL/CentOS7->RHEL/CentOS6 DIB bootloader issue when needed, and otherwise offer a useful hook to particularly knowledgeable end-users.14:18
derekhdprince: which job? only one job has started as far as I can see and its still running14:19
regebroAnd apparently the password key is {{admin-password}}14:19
dprinceegafford: dealing with an outage, once it is over I'll have a look14:19
regebrobnemec: Can I assume that keystone is running on 127.0.0.1?14:19
egafforddprince: Absolutely; no great rush. I appreciate it!14:19
dprincederekh: https://jenkins07.openstack.org/job/check-tripleo-ironic-undercloud-precise-nonha/1990/14:19
dprincederekh: that could have been me clearing out the instances14:20
bnemecregebro: No, I don't think that's what you want to do.  Let me see if I can find an example.14:20
*** prad has joined #tripleo14:21
dprincederekh: FWIW I was able to spin up my own instance and assign a floatingip14:22
derekhdprince: maybe a bunch of them die at the same time http://goodsquishy.com/downloads/tripleo-jobs.html14:22
dprincederekh: let me try spinning up an instance again, and see what is up (testing ssh and ping, etc)14:22
bnemecregebro: I think you want keystone.host: https://github.com/openstack/tripleo-heat-templates/blob/master/controller.yaml#L48114:22
regebrobnemec: That would make sense. I think there may be additional problems, as I don't have a keystone.host.14:23
derekhdprince: ok,  manually deleted instance will also need their floating ip's returned to the pool, with floatingip-delete, will do that14:24
regebrosudo os-apply-config --key keystone --type raw just gives "key keystone does not exist in [u'/var/lib/os-collect-config/heat_local.json']"14:24
slaglethat's b/c the instack installed undercloud is now puppet based14:25
slagleare you running that on the undercloud?14:25
regebroslagle: Yeah.14:29
regebroslagle: But instack is still running the DIB elements...14:29
dprincederekh: I cleared the floatingip pool as well14:29
dprincederekh: an hour ago...14:30
regebroMaybe I should not try to use DIB elements and do this some other way?14:30
derekhdprince: ya, I spotted it14:30
slagleregebro: it still uses some, yes. which one are you working with in particular here?14:30
slaglethe tempest element from tripleo-image-elements?14:30
regebroslagle: Well, yes, as a base for trying things out.14:30
regebroslagle: If it should be done with puppet instead, I'm fine with that.14:31
derekhdprince: we now have 4 running jobs14:31
slagleregebro: yea, i think you should have a go at using the tempest puppet module instead, puppet-tempest14:32
slagleregebro: if you look at the puppet-stack-config element in instack-undercloud, you can see how that might work14:33
slagleregebro: have a simple element that installs a puppet manifest into /etc/puppet/manifests14:33
slaglepuppet apply that manifest in an os-refresh-config script14:33
regebroslagle: Aha, so that element runs the puppet stuff?14:33
regebroOK, I'll look into that.14:33
dprincederekh: any Fedora?14:34
slagleregebro: it occurs to me though, that you probably want to run tempest against the overcloud right?14:34
dprincederekh: you gotta be specific man!14:34
derekhdprince: none14:34
egaffordThanks bnemec.14:34
regebroslagle: Sure, against the overcloud, yes, but therefore from the undercloud.14:34
*** prad has quit IRC14:35
slagleregebro: ok, you'll likely have to query heat to get the keystone host for the overcloud14:35
slagleafter the overcloud is deployed14:35
slaglehiera on the undercloud only knows about the config for the undercloud14:35
*** prad has joined #tripleo14:36
regebroslagle: Well, my brain is fried right now, but I think it's the undercloud keystone it should talk to.14:36
slagleok, i admit to not knowing much how to configure tempest14:37
derekhdprince: booting one now to see how long it takes, they have 2 minutes befor being deleted http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/templates/nodepool/nodepool.yaml.erb#n89814:38
bnemecregebro: We don't want tempest talking to the undercloud keystone.14:38
regebrobnemec: Ah, OK.14:39
dprincederekh: fungi suggested checking the console on one of them, apparently they had boot issues with only Fedora yesterday14:39
dprincederekh: the Fedora image used for slaves is just 'Fedora 20 64-bit' though right?14:40
derekhdprince: nope, thats the image used to create the template14:41
regebroI think for Friday afternoon I should try to do something really simple, like writing a new timezone implementation that can handle ambiguous DST changeovers or something-14:41
dprincederekh: right, so the template (prepare) scripts could be causing it14:41
derekhdprince: it will be tripleo-f20-1426342534.template.openstack.org or tripleo-f20-1426774535.template.openstack.org14:41
derekhdprince: dunno, I can't ssh to my instance yet14:44
derekhdprince: which was the standard f20 image14:44
*** rlandy has quit IRC14:46
dprincederekh: I'm not able to get onto mine new one either14:50
derekhdprince: k, trying to get a console14:50
dprincederekh: I see the instance has booted. The console.log (on the nova compute host) shows cloud-init running, etc.14:50
*** MasterPiece has quit IRC14:51
derekhdprince: ok14:51
dprincederekh: oh, we have these Max retries exceeded with url: /2009-04-04/meta-data/instance-id14:52
derekhdprince: cloud-init on my instance is spitting this out14:52
derekh[  177.114545] cloud-init[457]: 2015-03-20 14:38:07,926 - url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [112/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by <class 'socket.error'>: [Errno 101] Network is unreachable)]14:52
derekhdprince: snap14:52
dprincederekh: :)14:52
dprincederekh: neutron-metadata-agent says Remote metadata server experienced an internal server error.14:54
dprincederekh: bounced it, going to reboot my instance and see if it is happy14:55
derekhdprince: k14:55
*** dasm is now known as dasm|afk14:55
*** mrunge has quit IRC14:56
*** MasterPiece has joined #tripleo15:00
derekhdprince: doesn't seem to have helped15:01
dprincederekh: next things to check is ovs agent on the compute nodes I think15:02
dprincederekh: make sure things are getting ported up properly I guess15:02
derekhdprince: how about bounching neutron-dhcp-agent, aswell, it must be either the ports or dhcp15:04
dprincederekh: go for it. I think I did that earlier but doing again won't hurt15:04
*** lazy_prince is now known as killer_prince15:08
derekhdprince: didn't help15:10
*** yamahata has joined #tripleo15:13
dprincederekh: mysql is getting killed again15:14
dprincederekh: neutron-server is also running hot15:15
*** radez is now known as radez_g0n315:15
derekhdprince: nodepool is probably starting a lot of instances so maybe thats to be expected, or maybe not15:17
derekhdprince: don't see any ovs problems on my compute node15:17
*** yamahata has quit IRC15:17
*** maufart has quit IRC15:18
derekhdprince: you didn't restart neutron-openvswitch-agent on the controller but did restart the rest of the neutron services, any reason?15:18
dprinceno, we can do it there too15:18
* dprince forgot15:18
*** radez_g0n3 is now known as radez15:18
*** sdake has joined #tripleo15:19
derekhdprince: ok, will do15:19
derekhdprince: ahh you done it15:19
*** sdake_ has quit IRC15:20
*** sdake_ has joined #tripleo15:21
*** openstackgerrit has quit IRC15:21
*** openstackgerrit has joined #tripleo15:22
*** sdake__ has joined #tripleo15:23
*** sdake has quit IRC15:23
*** sdake_ has quit IRC15:26
dprincederekh: I think we might should disable nodepool again15:29
derekhdprince: agreed, we can poke at things a bit then15:30
dprincederekh: do we need to push a patch for that or just request it?15:32
* dprince hates pushing patches for these things15:32
derekhdprince: not sure but looks like there was no patch to disable it yesterday15:35
dprincederekh: yeah, I think Monty mispoke when he told me that. He was just looking at the logs at the time.15:35
dprincederekh: so it was never disabled.15:35
derekhdprince: ahh ok15:36
dprincederekh: we could just put a temporary firewall rule in to block our public API port15:36
derekhdprince: so, I don't know if we can just request it or not15:36
dprincederekh: and then you and I can troubleshoot it locally15:36
dprincederekh: that might cause nodepool to be upset though :)15:37
derekhdprince: ya, lets just ask infra and see15:38
dprincederekh: I doubt it would be too bad15:38
*** lsmola has quit IRC15:38
*** ChuckC_ is now known as ChuckC15:39
*** weshay has quit IRC15:41
dprincederekh: Yeah, so infra says a firewall rule is totally fine15:42
dprincederekh: that way we don't have to bother them with two patches15:42
dprincederekh: (potentially more!)15:42
derekhdprince: sounds good to me15:42
openstackgerritRadomir Dopieralski proposed openstack/tuskar-ui: Show required service configuration parameters as required  https://review.openstack.org/16623515:44
*** weshay has joined #tripleo15:44
openstackgerritMarios Andreou proposed openstack/tuskar: Add relative_path metadata to a stored file  https://review.openstack.org/16520915:44
openstackgerritMarios Andreou proposed openstack/tuskar: Adds tuskar-load-role to load a single role and associated extra-data  https://review.openstack.org/16515015:44
*** alop has joined #tripleo15:45
openstackgerritRadomir Dopieralski proposed openstack/tuskar-ui: Show required service configuration parameters as required  https://review.openstack.org/16623515:45
*** lsmola has joined #tripleo15:48
*** jprovazn has quit IRC15:51
*** Marga_ has joined #tripleo15:52
*** untriaged-bot has joined #tripleo16:00
untriaged-botUntriaged bugs so far:16:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/143044516:00
openstackLaunchpad bug 1430445 in tripleo "Horizon translations aren't compiled" [Undecided,In progress] - Assigned to Steve McLellan (sjmc7)16:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/143059916:00
openstackLaunchpad bug 1430599 in diskimage-builder "ramdisk-image-create with ironic-discoverd-ramdisk element fails" [Undecided,Fix committed] - Assigned to Yuiko Takada (takada-yuiko)16:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/142990216:00
openstackLaunchpad bug 1429902 in tripleo "os-refresh-config fails during post-configure phase" [Undecided,New]16:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/143443116:00
openstackLaunchpad bug 1434431 in tripleo "Abnormal exit in building rhel images by diskimage-builder for system is not registered." [Undecided,New]16:00
*** untriaged-bot has quit IRC16:00
*** lsmola has quit IRC16:05
*** sdake has joined #tripleo16:05
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: galera: Allow installer to setup galera cluster  https://review.openstack.org/16498316:07
openstackgerritMerged stackforge/kolla: Move genenv.sh and start.sh to tools directory  https://review.openstack.org/16605916:09
*** sdake__ has quit IRC16:09
*** epheo has quit IRC16:10
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates: puppet: add debug mode for OpenStack services  https://review.openstack.org/16629616:10
*** epheo has joined #tripleo16:11
openstackgerritPino Toscano proposed openstack/diskimage-builder: Do not export REG_HALT_UNREGISTER between hook scripts  https://review.openstack.org/16223916:12
*** kbyrne has quit IRC16:18
openstackgerritDaneyon Hansen proposed stackforge/kolla: Implements: blueprint Implement a database container set  https://review.openstack.org/16606916:20
dprincederekh: blocked16:22
dprincederekh: added the command to the etherpad16:23
dprincederekh: only blocking keystone, neutron, and nova16:23
dprincederekh: which is pretty much everything16:23
dprincederekh: interesting to see neutron-server is still getting killed though16:24
dprincederekh: I enabled debug on neutron to see what is going on16:25
derekhdprince: ok, lets see what its like after I remove the instances16:25
*** spzala has joined #tripleo16:31
*** Marga_ has quit IRC16:40
*** EmilienM is now known as EmilienM|afk16:41
openstackgerritRyan Hallisey proposed stackforge/kolla: Heat container is having trouble accessing heat meta data  https://review.openstack.org/16630916:42
*** yamahata has joined #tripleo16:43
derekhdprince: I think nodepool is still talking to us16:43
dprincederekh: oh, I blocked 13000,9696,877416:44
*** ifarkas has quit IRC16:44
dprincederekh: which port?16:44
dprincederekh: I've lost connectivity for the moment, not sure what happened16:44
derekhdprince: not sure, the instance count is going up I think16:44
derekhdprince: I lost my connection too16:45
dprincederekh: to the seedhost even16:45
dprincederekh: weird16:45
derekhdprince: too the overcloud-controller, I still got the seedhost16:45
*** dprince has quit IRC16:46
*** dprince has joined #tripleo16:46
derekhdprince: the iptables command in the etherpad is "-D" wouldn't that delete a rule16:49
derekhdprince: I still can't get into the controller, you?16:50
dprincederekh: no, plus I can't even get to the seedhost16:51
dprincederekh: now I can16:51
dprincederekh: I did a restart of the neutron-server and OVS, maybe that is what did it16:52
derekhdprince: maybe16:52
dprincederekh: its time to bring out the hammer, the DRAC16:53
*** alop has quit IRC16:53
derekhdprince: yup, trying to remember the firefox trickery now16:53
* derekh goes digging through old mails16:54
*** dtantsur is now known as dtantsur|afk16:55
dprincederekh: sorry man, I've hosed us now :(16:55
dprincederekh: check your email16:59
derekhdprince: thanks16:59
*** regebro has quit IRC17:03
*** rdopiera_ has quit IRC17:07
derekhdprince: Got firefox working but now having issues connecting to seed host17:09
derekhvia ssh17:10
dprincederekh: Yeah, it seems intermittent for me too17:10
openstackgerritSteven Dake proposed stackforge/kolla: Make the Horizon dashboard work properly  https://review.openstack.org/16610217:10
openstackgerritSteven Dake proposed stackforge/kolla: Use -L flag in curl  https://review.openstack.org/16610317:10
openstackgerritSteven Dake proposed stackforge/kolla: Add pid: host to libvirt  https://review.openstack.org/16607417:10
openstackgerritSteven Dake proposed stackforge/kolla: Improve Heat integration  https://review.openstack.org/16609117:10
dprincederekh: wondering if this is just a plain ol-network issue17:11
dprincederekh: actually, I'm on the seed still17:11
*** pdb has quit IRC17:12
*** pdb has joined #tripleo17:13
*** Marga_ has joined #tripleo17:13
derekhdprince: maybe, although it feels like each time I try to connect its getting worse, do I remember something like this befor where packets were bouncing around the varioous interfaces in loops....17:13
derekhdprince: I havn't had any problems with connecting to the bastion, so whatever is going on its after that17:14
openstackgerritMarios Andreou proposed openstack/tuskar: Adds tuskar-load-role to load a single role and associated extra-data  https://review.openstack.org/16515017:19
*** jistr has quit IRC17:19
*** pblaho has quit IRC17:20
*** alop has joined #tripleo17:21
openstackgerritSteven Dake proposed stackforge/kolla: Make the Horizon dashboard work properly  https://review.openstack.org/16610217:21
openstackgerritSteven Dake proposed stackforge/kolla: Use -L flag in curl  https://review.openstack.org/16610317:21
openstackgerritSteven Dake proposed stackforge/kolla: Improve Heat integration  https://review.openstack.org/16609117:21
*** openstackgerrit has quit IRC17:21
*** openstackgerrit has joined #tripleo17:22
*** mcornea has quit IRC17:22
*** egafford has left #tripleo17:32
*** pelix has joined #tripleo17:35
*** pelix has quit IRC17:38
*** pelix has joined #tripleo17:39
openstackgerritSteven Dake proposed stackforge/kolla: Don't kill keystone, but instead wait for it to finish at the end  https://review.openstack.org/16633017:48
*** shardy has quit IRC18:01
*** sdake_ has joined #tripleo18:03
*** lucasagomes is now known as lucas-beer18:04
*** sdake has quit IRC18:06
*** derekh has quit IRC18:11
*** MasterPiece has quit IRC18:11
openstackgerritJay Dobies proposed openstack/tuskar: Add relative_path metadata to a stored file  https://review.openstack.org/16520918:21
*** alop has quit IRC18:22
*** alop has joined #tripleo18:22
*** eghobo has joined #tripleo18:35
openstackgerritMerged openstack/tuskar: Change role to use only name part in attributes  https://review.openstack.org/16600918:38
*** CaptTofu_ has quit IRC18:39
openstackgerritMerged openstack/tuskar: Adds tuskar-delete-roles command  https://review.openstack.org/16552918:39
*** penick has joined #tripleo18:41
*** eghobo has quit IRC18:46
openstackgerritMerged openstack/python-tuskarclient: Add support for subdirs in templates listing  https://review.openstack.org/16429818:46
*** spzala has quit IRC18:46
*** cwolferh has quit IRC18:47
*** Marga_ has quit IRC18:50
*** Marga_ has joined #tripleo18:50
*** pradk has joined #tripleo18:55
*** pradk has quit IRC18:55
*** prad has quit IRC18:56
*** prad has joined #tripleo18:59
*** Marga_ has quit IRC18:59
*** masco has joined #tripleo19:00
*** eghobo has joined #tripleo19:03
*** masco has quit IRC19:07
*** EmilienM|afk is now known as EmilienM19:10
*** sdake has joined #tripleo19:11
openstackgerritMerged stackforge/kolla: Fixes Keystone openrc and sets / for scripts  https://review.openstack.org/16612319:14
*** sdake_ has quit IRC19:15
*** spzala has joined #tripleo19:20
*** pelix has quit IRC19:22
*** MasterPiece has joined #tripleo19:36
*** eghobo has quit IRC19:36
*** yamahata has quit IRC19:36
*** yamahata has joined #tripleo19:37
*** athomas has quit IRC19:42
*** gfidente has quit IRC19:44
*** eghobo has joined #tripleo19:52
*** MasterPiece has quit IRC19:58
*** Marga_ has joined #tripleo20:00
*** lucas-beer has quit IRC20:03
*** Marga_ has quit IRC20:05
*** ChuckC has quit IRC20:05
*** MasterPiece has joined #tripleo20:06
*** Marga_ has joined #tripleo20:08
*** CaptTofu_ has joined #tripleo20:12
*** jdob has quit IRC20:24
*** jdob has joined #tripleo20:24
*** akrivoka has quit IRC20:25
*** dprince has quit IRC20:26
*** Marga_ has quit IRC20:26
openstackgerritSteven Dake proposed stackforge/kolla: The genenv tool was generating the wrong password for the openrc file as a result of recent keystone rework.  This patch fixes that problem.  https://review.openstack.org/16637120:35
*** thrash is now known as thrash|wknd20:41
openstackgerritSteven Dake proposed stackforge/kolla: Add ADMIN_USER_PASSWORD to genenv tool  https://review.openstack.org/16637120:41
*** sdake_ has joined #tripleo20:45
*** sdake has quit IRC20:49
*** radez is now known as radez_g0n320:50
*** jdob has quit IRC20:50
openstackgerritJeff Peeler proposed openstack/tuskar: Adds tuskar-load-role to load a single role and associated extra-data  https://review.openstack.org/16515021:00
*** trown is now known as trown|outttypeww21:00
sdake_nice jpeeler coming up to speed on tripleo :)21:02
jpeelertuskar mostly, and that was just a rebase heh21:02
*** jtomasek has quit IRC21:05
openstackgerritSHIGEMATSU Mitsuhiro proposed openstack/tripleo-incubator: Fix typos in tripleo-incubatr/scripts/devtest_variables.sh i  https://review.openstack.org/16638421:08
*** lblanchard has quit IRC21:13
*** jtomasek has joined #tripleo21:18
*** eghobo has quit IRC21:27
openstackgerritMerged stackforge/kolla: Add ADMIN_USER_PASSWORD to genenv tool  https://review.openstack.org/16637121:30
*** Marga_ has joined #tripleo21:30
*** spzala has quit IRC21:36
openstackgerritSHIGEMATSU Mitsuhiro proposed openstack/tripleo-incubator: Fix typos in tripleo-incubatr/scripts/devtest_variables.sh  https://review.openstack.org/16638421:38
*** MasterPiece has quit IRC21:38
*** EmilienM is now known as EmilienM|PTO21:44
*** rhallisey has quit IRC21:53
*** weshay has quit IRC21:54
*** untriaged-bot has joined #tripleo22:00
untriaged-botUntriaged bugs so far:22:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/143044522:00
openstackLaunchpad bug 1430445 in tripleo "Horizon translations aren't compiled" [Undecided,In progress] - Assigned to Steve McLellan (sjmc7)22:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/143059922:00
openstackLaunchpad bug 1430599 in diskimage-builder "ramdisk-image-create with ironic-discoverd-ramdisk element fails" [Undecided,Fix committed] - Assigned to Yuiko Takada (takada-yuiko)22:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/142990222:00
openstackLaunchpad bug 1429902 in tripleo "os-refresh-config fails during post-configure phase" [Undecided,New]22:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/143443122:00
openstackLaunchpad bug 1434431 in tripleo "Abnormal exit in building rhel images by diskimage-builder for system is not registered." [Undecided,New]22:00
*** untriaged-bot has quit IRC22:00
openstackgerritDaneyon Hansen proposed stackforge/kolla: Refactors nwfilter  https://review.openstack.org/16639522:04
*** Marga_ has quit IRC22:10
*** Marga_ has joined #tripleo22:24
*** prad has quit IRC22:25
openstackgerritSHIGEMATSU Mitsuhiro proposed openstack/tripleo-specs: Fix typo in tripleo-specs/specs/juno/network_configuration.rst  https://review.openstack.org/16640822:39
*** sdake has joined #tripleo22:43
*** sdake_ has quit IRC22:47
*** jtomasek has quit IRC22:48
openstackgerritSteven Dake proposed stackforge/kolla: Have genenv offer some hepful hints about FLAT_INTERFACE  https://review.openstack.org/16641523:19
openstackgerritSHIGEMATSU Mitsuhiro proposed openstack/tripleo-image-elements: Fix typo in elements/mariadb-rpm/os-refresh-config/configure.d/52-mariadb-rpm-init  https://review.openstack.org/16641623:19
openstackgerritgreghaynes proposed openstack/diskimage-builder: Support VHD output format  https://review.openstack.org/15643323:28
*** Marga_ has quit IRC23:29
openstackgerritgreghaynes proposed openstack/diskimage-builder: Support VHD output format  https://review.openstack.org/15643323:37
openstackgerritDaneyon Hansen proposed stackforge/kolla: WIP: Refactor nova-network  https://review.openstack.org/16642023:41
*** Marga_ has joined #tripleo23:42

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!