Wednesday, 2014-05-14

lifelessuhm00:12
lifelesscolour me confused :)00:12
lifelessmetadata is at 169.254.169.254/latest...00:12
lifelesssomething very odd going on there00:13
clarkbshouldnt you be at an hp party?00:16
greghaynesclarkb: shouldnt you be downstairs?00:19
clarkbyes00:22
clarkb>_>00:22
Lotus907efihmmm00:22
Lotus907efiyeah, I know the metadata is supposed to be at that IP00:23
Lotus907efii.e. at 169.254.169.254/latest00:23
Lotus907efiI do not know why it is trying to connect to 192.0.2.2100:23
Lotus907efiI grepped through all of the stuff under /etc/cloud and /var/lib/cloud00:24
Lotus907efibut that IP does not seem to show up00:24
lifelessgreghaynes: dev/fd was missing00:24
Lotus907efiThe output from running "cloud-init init" is at http://paste.openstack.org/show/80281/00:25
greghayneshuh.... I wonder what changed?00:31
*** chuckC has quit IRC00:33
lifelessgreghaynes: somwthign deleted it00:37
lifelessnow, the problem is that the server thinks its own ip address is ...147 but its got ...145 onbr-ctlplane00:37
lifelessah no00:40
lifelessgreghaynes: Booting from filename "pxelinux.0"00:40
lifelesstftp://192.168.122.168/pxelinux.0............. Connection timed out (0x4c126035)00:40
*** julim has joined #tripleo00:42
GheRiverodid you redeploy the seed?00:43
lifelessyes00:43
lifelessGheRivero: ^00:44
lifelessGheRivero: what is the fix?00:45
GheRiverothe tftp should be working00:45
*** eguz has quit IRC00:45
lifelessGheRivero: did you change something ?00:45
*** eghobo has joined #tripleo00:46
GheRiveronothing. I just added the iptables prerouting rule for the metadata server, but looks like now is applied00:46
GheRiveroalthoug the tftp server is down00:47
lifelessGheRivero: huh00:47
lifelessGheRivero: the redirect rule was already there00:47
lifelessGheRivero: see theip address00:47
lifelessGheRivero: its wrong00:47
lifelessGheRivero: I believe someone saw this before00:47
lifelessgreghaynes: ^00:48
lifelessmanuallyfixing00:50
*** eguz has joined #tripleo00:53
greghaynesI havent encountered that before00:56
*** eghobo has quit IRC00:57
*** xuhaiwei has joined #tripleo01:01
GheRiverofailed. No valid host.. agh01:02
*** ramishra has quit IRC01:09
*** ramishra has joined #tripleo01:13
*** newell_ has quit IRC01:21
GheRiverolifeless: https://review.openstack.org/#/c/93078/01:27
*** nosnos has joined #tripleo01:43
*** shardy has quit IRC01:49
lifelessGheRivero: we lost https://review.openstack.org/#/c/93133/ as well01:49
SpamapSso what's the status?01:50
lifelessGheRivero: why not use the keystone location ?01:50
* SpamapS just waking from an evening nap :P01:50
lifelessSpamapS: ust kicking off a deploy now, hopefully it will go further01:51
lifelessthen we'll apply the manual fixes to the resulting undercloud and try an overcloud, then work back with ful automation at each step01:51
SpamapSso are we convinced the change to element-deps handling was the culprit?01:51
SpamapSor am I WAY out of date?01:51
*** yamahata has joined #tripleo01:53
lifelessway out of date02:00
lifelesswe're not even sure thats a thing now02:00
*** dkehnx1 has joined #tripleo02:10
*** ramishra has quit IRC02:11
*** dkehnx1 has quit IRC02:12
*** chuckC has joined #tripleo02:31
lifeless0k now we are back to our old friend trusty hang02:40
lifelesswe have the REDIRECT rule in place for metadata, so not that.02:40
GheRivero:(02:43
GheRiverodon't tear down the undercloud02:43
lifelessgreg wanted to redo the seed earlier02:44
*** julim has quit IRC02:45
GheRiverostupid vpn. It's logging me out02:45
*** chuckC has quit IRC02:48
lifelessGheRivero: you need to update the vpn cert02:51
lifelessGheRivero: I just asked NOC02:51
lifelessok undercloud init progressing02:52
lifelessimage built successfully02:52
lifelessyay02:52
lifeless-> hotel where I shall tickle an overcloud deploy02:52
greghaynesAh, our old friend trusty hnnng02:55
GheRiveroOk. My laptop and the hotel wifi don't want to play together :(02:58
*** chuckC has joined #tripleo02:58
*** untriaged-bot has joined #tripleo03:00
untriaged-botUntriaged bugs so far:03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131876703:00
uvirtbotLaunchpad bug 1318767 in tripleo "apache element SSL cert check fails" [Undecided,New]03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131744603:00
uvirtbotLaunchpad bug 1317446 in tripleo "Whitespace in SSLCertificate param causes jq error" [Undecided,In progress]03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131497803:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131902703:00
uvirtbotLaunchpad bug 1314978 in tripleo "Cloud vm not pingable after overcloud upgrade " [Undecided,New]03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131535503:00
uvirtbotLaunchpad bug 1319027 in diskimage-builder "dib install packages not document in the command help" [Undecided,New]03:00
uvirtbotLaunchpad bug 1315355 in tripleo "Upgrade of overcloud failed with "Connection to neutron failed: Maximum attempts reached"" [Undecided,New]03:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131871703:00
uvirtbotLaunchpad bug 1318717 in diskimage-builder "image with rhel element can't be built if DIB_RHSM_* variables aren't set" [Undecided,In progress]03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131777803:00
uvirtbotLaunchpad bug 1317778 in tripleo "Rabbit "guest from everywhere" should be reverted" [Undecided,New]03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131667503:00
uvirtbotLaunchpad bug 1316675 in tripleo "Saving a devtest VM results in error" [Undecided,In progress]03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131705603:00
uvirtbotLaunchpad bug 1317056 in tripleo "Guest VM FS corruption after compute host reboot" [Undecided,New]03:00
*** untriaged-bot has quit IRC03:00
GheRiveroamd back03:10
*** jang has joined #tripleo03:11
*** ramishra has joined #tripleo03:12
*** ramishra has quit IRC03:16
GheRiverogreghaynes: are you redeploying the seed?03:17
greghaynesno03:17
GheRiveroit's down03:18
GheRiverovirsh # list --all03:18
GheRivero Id    Name                           State03:18
GheRivero----------------------------------------------------03:18
GheRivero -     seed                           shut off03:18
GheRiveroat least the undercloud is up03:19
greghaynesGheRivero: You ran into the issue "ImportError: No module named nova.scheduler.ironic_host_manager" right?03:22
greghaynesfor nova-scheduler03:22
GheRiverothis afternoon03:22
greghaynesNo fix up for it yet?03:23
greghaynesJust checking before I start debugging03:23
GheRiverowe didn't hit it now. So maybe it was a messed up undercloud image03:24
greghaynesThis is on my dev box03:24
*** jang has quit IRC03:24
greghaynesfor the seed03:24
*** cody-somerville has joined #tripleo03:25
GheRiveroyou hit it?03:26
greghaynesyep03:26
GheRiveroironic is not instaled inside the nova venv.03:27
*** jang has joined #tripleo03:27
greghayneshttps://bugs.launchpad.net/tripleo/+bug/131924103:28
uvirtbotLaunchpad bug 1319241 in tripleo "nova-scheduler fails to start with  ImportError: No module named nova.scheduler.ironic_host_manager" [Undecided,New]03:29
*** jang has quit IRC03:29
*** jang has joined #tripleo03:30
GheRiveronoted03:31
*** nosnos has quit IRC03:33
lifelessGheRivero: no_proxy was teh thing :)03:33
lifelessGheRivero: oh yiou've reproeduced the bug ?03:34
GheRivero:/  stupid corporate policies03:34
GheRiverogreghaynes did03:34
lifelesserm03:34
lifelessgreghaynes: ^ ?03:34
*** nati_ueno has joined #tripleo03:35
lifelessgreghaynes: https://bugs.launchpad.net/diskimage-builder/+bug/1319152 was abut the same thing; may want to dup03:35
uvirtbotLaunchpad bug 1319152 in diskimage-builder "regression in dependency expansion" [Critical,Incomplete]03:35
greghaynesah03:35
lifelessGheRivero: ok, I'm going to apply the ironic fixes03:35
lifelessGheRivero: by hand03:35
GheRiverolifeless: did you tear down the seed node?03:36
greghayneslifeless: Oh, I have ironic installed in /opt/stack03:36
lifelessGheRivero: no03:36
lifelessGheRivero: error: unsupported configuration: Domain requires KVM, but it is not available. Check that virtualization is enabled in the host BIOS, and host configuration is setup to load the kvm modules.03:36
GheRiverogreghaynes: do you have it installed inside the nova venv?03:37
lifelessGheRivero: I think /dev got eaten03:37
lifelessGheRivero: I think /dev got eaten03:37
GheRivero:?03:37
lifelessabah03:37
greghayneslifeless: ironic==2013.2.dev244.g9654a4e says pip freeze03:37
lifelessbuild failed and rm'd /dev/*03:37
lifelessgreghaynes: ok thats better than we had here03:38
GheRiverowhat the...03:38
lifelessGheRivero: we'll want to reboot the jump host before we use the seed again03:40
GheRiverowe can wait for a overcloud test03:41
lifelessinstalled NobodyCam 's fix rev 303:42
lifelessoh nuts I just wedged it by doing o-c-c when the seed was down  no heat metadata and it fails badly03:43
lifelessfingers crossed, rebooting jump host03:43
*** morganfainberg_Z is now known as morganfainberg03:50
*** jang has quit IRC03:50
*** jang has joined #tripleo03:51
lifelessok its booted03:54
*** eguz has quit IRC04:00
lifelessmkdir: cannot create directory �/var/run/rabbitmq�: Permission denied04:03
lifeless/usr/lib/rabbitmq/bin/rabbitmq-server: 80: /usr/lib/rabbitmq/bin/rabbitmq-server: cannot create /var/run/rabbitmq/pid: Directory nonexistent04:03
lifelesson reboot of the seed04:03
lifelessand _mysql_exceptions.OperationalError: (2002, "Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)")04:04
lifelessnow back on undercloud04:10
lifelessrefreshing its config04:10
*** ramishra has joined #tripleo04:12
lifelessdeploying overcloud04:14
GheRiveroERROR04:15
lifelesssadface04:16
lifelessno walid host04:16
*** ramishra has quit IRC04:17
xuhaiweilifeless:in undercloud, trying to boot an instance, but failed04:17
xuhaiweilifeless: can i boot an instance like usual04:19
lifelessxuhaiwei: should be able to04:19
xuhaiweiwhere is the log?04:19
*** cody-somerville has quit IRC04:22
*** nosnos has joined #tripleo04:22
lifelessxuhaiwei: which log?04:22
xuhaiweilifeless: the instance booting failed, i want to see the log04:22
lifelessxuhaiwei: sure; which one?04:23
lifelessxuhaiwei: nova-conductor? -api? -scheduler? -baremetal ?04:23
lifelesskeystone, neutron etc...04:23
xuhaiweinova compute04:23
lifelessmost logs are in /var/log/upstart04:23
xuhaiweithank you04:24
GheRiverolifeless: what did you change in ironic?04:32
lifelessGheRivero: undercloud? pulled in NobodyCam's fix for parted04:36
*** nati_ueno has quit IRC04:36
lifelessGheRivero: set debug logging, and pulled in NobodyCam's fix tor rpc workers04:36
xuhaiweilifeless:I got a NoValidHost exception when booting an instance on undercloud, does this mean i should create a vm to be a host before booting an instance?04:37
lifelesshttps://review.openstack.org/#/c/93463/1/elements/ironic/os-apply-config/etc/ironic/ironic.conf04:37
lifelessxuhaiwei: no, it means that something went wrong04:37
xuhaiweiI can't see the error message from nova-compute.log.104:37
lifelessGheRivero: devananda: Ironic is responding super slowly04:37
lifeless11 seconds to do a node-show04:37
*** nati_ueno has joined #tripleo04:38
lifelessxuhaiwei: oh, I see - are you manually installing things? If so are you following devtest or just exploring?04:38
lifelessxuhaiwei: nova hypervisor-stats will tell you if you have machines registered with the scheduler04:38
xuhaiweilifeless: I am not following devtest now, I have got a devtest enviroment, now just try to use it, for example booting another compute node04:40
xuhaiweilifeless:i can see free_disk_gb and free_ram_mb are 0, is this the reason? and why there is no new nova-compute log in /var/log/upstart04:42
lifelessxuhaiwei: if there is nothing being written there is no log written04:43
xuhaiweilifeless: even if i start an instance?04:43
*** jang has quit IRC04:44
lifelessxuhaiwei: the request never hits the compute process if there is nowhere to deploy - it stops at the scheduler04:44
*** jang has joined #tripleo04:44
lifelessGheRivero: 2014-05-14 04:44:12.123 25940 WARNING nova.scheduler.filters.compute_filter [req-816dc5b9-4493-4592-af78-d5924f204:46
lifeless1e4bd7e1) ram:98304 disk:1638400 io_ops:0 instances:0 has not been heard from in a while04:46
lifeless16 seconds to run ironic driver-list04:47
lifelessI'm going to try unregistering all but 5 nodes04:47
lifelessI think this is a regression, since this *did* work a motnh ago04:48
*** dkehn_ has joined #tripleo04:58
xuhaiweilifeless: i think devtest is designed to allocate specific memory for the seed,under and overcloud, so there is no free memory for user to create new overcloud, is it true?04:59
*** jang has quit IRC04:59
lifelessxuhaiwei: no04:59
*** ramishra has joined #tripleo04:59
*** dkehn__ has quit IRC05:01
xuhaiweilifeless: so in my environment on undercloud there is no free disk and memory, if i want to create a new overcloud what should i do?05:04
*** ramishra has quit IRC05:04
lifelessxuhaiwei: you need to register baremetal nodes with the undercloud05:07
lifelessxuhaiwei: this is what devtest_undercloud does in setup-baremetal05:07
lifelessok, night all, I'm out05:15
xuhaiweilifeless: bye05:15
*** rlandy has joined #tripleo05:38
*** nati_ueno has quit IRC05:44
*** rakesh_hs has joined #tripleo05:46
*** ramishra has joined #tripleo06:00
*** ramishra has quit IRC06:05
*** rakesh_hs has quit IRC06:13
*** rakesh_hs has joined #tripleo06:13
*** d0ugal has joined #tripleo06:25
*** d0ugal has quit IRC06:25
*** d0ugal has joined #tripleo06:25
*** jtomasek has joined #tripleo06:32
*** nati_ueno has joined #tripleo06:35
*** kevinbenton has quit IRC06:37
*** gcha has joined #tripleo06:38
*** kevinbenton has joined #tripleo06:38
*** ifarkas has joined #tripleo06:40
*** nati_ueno has quit IRC06:40
*** ifarkas has quit IRC06:41
*** ifarkas has joined #tripleo06:41
openstackgerritA change was merged to openstack/tripleo-incubator: Add keepalived to overcloud, control vip to heat  https://review.openstack.org/8961306:44
*** hashar has joined #tripleo06:47
*** jtomasek has quit IRC06:47
*** hashar has quit IRC06:52
*** peoplemerge has joined #tripleo06:52
*** hashar has joined #tripleo06:53
*** geertj has joined #tripleo06:54
*** pblaho has joined #tripleo06:59
*** e0ne has joined #tripleo07:00
*** jprovazn has joined #tripleo07:01
*** ramishra has joined #tripleo07:01
*** e0ne has quit IRC07:02
*** ramishra has quit IRC07:05
*** yamahata has quit IRC07:21
gonerihi all, can a core take a look on https://review.openstack.org/#/c/91829/ to unblock https://review.openstack.org/#/c/88534/07:28
*** rcarrillocruz has joined #tripleo07:30
jprovazngoneri: hi, sure07:30
*** rcarrill` has quit IRC07:30
gonerijprovazn: thanks :)07:33
*** nati_ueno has joined #tripleo07:36
*** nati_ueno has quit IRC07:41
*** jtomasek has joined #tripleo07:51
*** darraghb has joined #tripleo07:53
*** hashar has quit IRC07:58
*** ramishra has joined #tripleo08:02
*** ramishra has quit IRC08:06
*** xuhaiwei has quit IRC08:09
lxsli+A for https://review.openstack.org/90983 https://review.openstack.org/93072 please?08:18
lxsliAlso https://review.openstack.org/#/c/91801/08:19
lxsliAll those have a +2 already08:20
lxsli90983+93072 have dependent patches, also with +208:20
*** ramishra has joined #tripleo08:20
*** hashar has joined #tripleo08:22
*** jp_at_hp has joined #tripleo08:22
openstackgerritA change was merged to openstack/diskimage-builder: 4 spaces indent  https://review.openstack.org/9182908:26
lxsligoneri: nice one!08:27
goneriI pretty surprise I didn't have to go in a “rebase dance” for this one :)08:28
goneriprobably because everybody is at the summit08:28
lxsliZuul queue is pretty nice too :)08:31
goneriyeah :)08:32
openstackgerritA change was merged to openstack/diskimage-builder: indent: search for !=4 spaces indentation  https://review.openstack.org/8853408:33
openstackgerritA change was merged to openstack/tripleo-image-elements: Add IPv4 flag for Ironic's TFTP setup  https://review.openstack.org/8720808:33
*** ramishra has quit IRC08:34
goneriwell I'm also interested by some +A on these patches, all of them are pretty trivial and already come with +2 https://review.openstack.org/#/c/91823/ https://review.openstack.org/#/c/91818/ https://review.openstack.org/#/c/85271/ https://review.openstack.org/#/c/85272/08:35
*** martyntaylor has joined #tripleo08:36
*** nati_ueno has joined #tripleo08:37
*** giulivo has joined #tripleo08:38
*** martyntaylor has left #tripleo08:38
*** nati_ueno has quit IRC08:42
rcarrillocruzmorning tripleo!08:48
giulivohi rcarrillocruz :)08:49
giulivomorning for me too on this side of the world08:49
rcarrillocruzheh, yeah, not that many people on this side of the world this week :P08:50
giulivonot for the people in atlanta though08:50
giulivoindeed08:50
*** untriaged-bot has joined #tripleo09:00
untriaged-botUntriaged bugs so far:09:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131876709:00
uvirtbotLaunchpad bug 1318767 in tripleo "apache element SSL cert check fails" [Undecided,New]09:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131744609:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131497809:00
uvirtbotLaunchpad bug 1317446 in tripleo "Whitespace in SSLCertificate param causes jq error" [Undecided,In progress]09:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131902709:00
uvirtbotLaunchpad bug 1314978 in tripleo "Cloud vm not pingable after overcloud upgrade " [Undecided,New]09:00
uvirtbotLaunchpad bug 1319027 in diskimage-builder "dib install packages not document in the command help" [Undecided,New]09:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131535509:00
uvirtbotLaunchpad bug 1315355 in tripleo "Upgrade of overcloud failed with "Connection to neutron failed: Maximum attempts reached"" [Undecided,New]09:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131871709:00
uvirtbotLaunchpad bug 1318717 in diskimage-builder "image with rhel element can't be built if DIB_RHSM_* variables aren't set" [Undecided,In progress]09:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131777809:00
uvirtbotLaunchpad bug 1317778 in tripleo "Rabbit "guest from everywhere" should be reverted" [Undecided,New]09:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131667509:00
uvirtbotLaunchpad bug 1316675 in tripleo "Saving a devtest VM results in error" [Undecided,In progress]09:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131705609:00
*** untriaged-bot has quit IRC09:00
uvirtbotLaunchpad bug 1317056 in tripleo "Guest VM FS corruption after compute host reboot" [Undecided,New]09:00
*** ramishra has joined #tripleo09:01
*** gcha has quit IRC09:01
gonerilxsli: sorry for -1 but I think it the good time to remove the MysqlInnodbBufferPoolSize hack too https://review.openstack.org/#/c/93072/09:04
*** rlandy has quit IRC09:04
*** bkero has quit IRC09:06
*** hashar has quit IRC09:07
*** NobodyCam has quit IRC09:07
*** bkero has joined #tripleo09:07
*** NobodyCam has joined #tripleo09:08
*** gcha has joined #tripleo09:10
lxsligoneri: did you see the dependent patch?09:14
lxslihttps://review.openstack.org/#/c/93073/09:14
gonerilxsli: oh09:15
gonerilxsli: the // operator is a “or”09:17
gonerithe code snippet works https://review.openstack.org/#/c/93072/1/scripts/devtest_undercloud.sh works09:17
goneriit seems to me more natural than https://review.openstack.org/#/c/93073/1/scripts/devtest_undercloud.sh09:17
lxsliI see what you mean, I'm using a bit of a trick whereas // is more obvious09:21
lxslilet me think a little - either way, I'll change 93073 not 9307209:21
lxsligoneri: did I do something wrong? http://paste.openstack.org/show/80326/09:32
*** nati_ueno has joined #tripleo09:38
*** hashar has joined #tripleo09:38
goneriecho '{}'| jq '.parameters += {"a": (.parameters.a // 123)}'09:41
goneriecho '{ "parameters": { "a": "lapin"} }'| jq '.parameters += {"a": (.parameters.a // 123)}'09:41
*** nati_ueno has quit IRC09:42
*** ramishra has quit IRC09:42
goneriI'm not sure I understand your comment09:43
goneriwith this filter, we keep parameters.a if it is defined. Or we define it at 123. right?09:44
lxsligoneri: both tests show "a" being overwritten whether or not it is set initially09:45
lxsliwe want the default to only be applied if "a" is unset09:46
gonerilxsli: http://paste.openstack.org/show/80331/09:47
goneriparameters.a is not overwritten in the second case09:47
lxsliAre you using jq v1.2?09:48
gonerilxsli: that's the script I used to reproduce your code http://paste.openstack.org/show/80332/09:48
lxslithis is getting weird09:48
goneri1.3 here09:49
lxsliaha! Let me upgrade09:49
*** ekarlso has joined #tripleo09:52
ekarlsoHi guys09:52
ekarlsoi'm seeing a problem with rmq clusters not coming up properly on some runs09:52
ekarlsothe first node typically comes up but 2-3rd doesn't due to random failures by the looks ranging from the rmq service restart hanging or the mnesia tables not being found on the node09:53
*** ramishra has joined #tripleo09:55
openstackgerritDmitry Shulyak proposed a change to openstack/tripleo-image-elements: Allow services ports configuration  https://review.openstack.org/9255010:00
lxsligoneri: I'm not sure how to guarantee jq 1.3 is installed, so using a solution that works on 1.2 seems safer. I'll comment to that effect10:02
gonerilxsli: or, use the 1.3 solution and keep the 1.2 hack with a message10:06
gonerihttp://packages.ubuntu.com/search?keywords=jq10:07
goneritrusty comes with 1.310:07
lxsliWhat base image distros is TripleO targeted at? I think there are others than Ubuntu10:08
*** rameshg87 has joined #tripleo10:09
goneriI don't know, I cannot find the information. I would say, the last Ubuntu LTS and Fedora 20.10:11
lxsliI think RHEL + SUSE too10:12
gonerihum right10:13
* goneri connect on RHN to see the current jq version10:13
gonerijq 1.3 is in EPEL10:14
*** jtomasek has quit IRC10:15
lxslilooks like it might be on OpenSUSE too10:15
lxsliSo I guess the question is whether Saucy is still a target10:16
goneriI drop the -1. I will propose a patch when jq 1.3 will be the default everywhere :)10:22
goneriBTW, I like these changes, it's much more clean. Thank you.10:23
lxsliOK thanks goneri :)10:25
lxslihad a chat with a colleague and ofc this is part of a devtest script so it's the user's local workstation that matters not the base image10:25
lxsliWhich is totally uncontrolled atm, afaik we have no way to say a local package must have version >= X10:26
*** ramishra has quit IRC10:29
*** akrivoka has joined #tripleo10:37
*** nati_ueno has joined #tripleo10:38
gonerilxsli: this may be a solution :) https://github.com/mwilliamson/jq.py10:40
goneribut it's not pure perl10:40
lxsliWarning: the API is not stable.10:40
goneris/perl/python/10:40
lxsliThank the lords above it's not pure Perl :)10:40
goneri=)10:41
lxsliI started trying to explain blessed references to someone last year and they nearly cried10:41
*** ramishra has joined #tripleo10:43
*** nati_ueno has quit IRC10:43
lifelessohhhh, eth0 vs eth2 again. that might explain it.10:44
lxslilifeless!10:45
lxslihttps://review.openstack.org/93072 https://review.openstack.org/9307310:45
lifelessmorning :)10:45
lxslihttps://review.openstack.org/90983 https://review.openstack.org/9304110:45
lxslihttps://review.openstack.org/91801 pretty please?10:45
lxsliI think you've seen it all before + they have +2s so should be quick10:46
*** mestery has joined #tripleo10:55
*** mestery has quit IRC10:59
lifelesslxsli: will look a little later today11:01
* SpamapS awakens, fully refreshed11:03
lxslithanks lifeless11:03
lxsliooh, if you could argue directly about https://review.openstack.org/92356 that would also be great :)11:04
lxslimorning11:04
lifelessSpamapS: I think I know twhat the trusty deadlock might be11:07
lifeless111:08
lifelesswe booted with eth0 not eth2 in the metadata11:08
*** jtomasek has joined #tripleo11:11
*** ramishra has quit IRC11:11
*** chuckC has quit IRC11:14
lifelessoh yeah thats a lot happier.11:16
lifelessbug etc coming in a bit11:16
openstackgerritGiulio Fidente proposed a change to openstack/tripleo-incubator: Clarify the requirements for the TRIPLEO_ROOT variable  https://review.openstack.org/9261111:26
*** geertj has quit IRC11:30
SpamapSlifeless: interesting11:32
*** chuckC has joined #tripleo11:32
*** gcha has quit IRC11:36
openstackgerritDmitry Shulyak proposed a change to openstack/tripleo-image-elements: Allow services ports configuration  https://review.openstack.org/9255011:38
*** gcha has joined #tripleo11:38
*** weshay has quit IRC11:39
*** nati_ueno has joined #tripleo11:39
*** nati_ueno has quit IRC11:44
*** geertj has joined #tripleo11:49
*** akrivoka has quit IRC11:52
*** rlandy has joined #tripleo11:54
*** mestery has joined #tripleo11:56
*** weshay has joined #tripleo11:57
openstackgerritNicholas Randon proposed a change to openstack/tripleo-incubator: Export seed ip instead of gateway ip.  https://review.openstack.org/9355312:00
*** akrivoka has joined #tripleo12:00
*** nati_ueno has joined #tripleo12:03
*** mestery has quit IRC12:04
*** pblaho has quit IRC12:06
*** gcha has quit IRC12:07
*** nati_ueno has quit IRC12:08
*** nati_ueno has joined #tripleo12:09
*** gcha has joined #tripleo12:09
*** gcha has quit IRC12:09
*** gcha has joined #tripleo12:10
*** mestery has joined #tripleo12:11
lifeless-> conf12:12
*** nati_ueno has quit IRC12:13
GheRiveromorning all12:16
dshulyakmorning12:18
openstackgerritDmitry Shulyak proposed a change to openstack/tripleo-heat-templates: WIP: Haproxy configuration  https://review.openstack.org/9355412:22
*** rameshg87 has left #tripleo12:25
*** yamahata has joined #tripleo12:26
*** e0ne has joined #tripleo12:29
*** mestery has quit IRC12:33
*** e0ne has quit IRC12:33
*** akrivoka has quit IRC12:38
jp_at_hpany tripleo cores able to approve this please? https://review.openstack.org/#/c/93042/ devtest is currently broken over it...12:40
*** yamahata has quit IRC12:41
*** akrivoka has joined #tripleo12:46
*** akrivoka has quit IRC12:46
GheRiverosorry jp_at_hp, I can't give more votes :(12:47
*** gcha has quit IRC12:47
*** akrivoka has joined #tripleo12:47
lxsliGheRivero: if you're in a giving mood I pasted a ton of +2'd changes above. All pretty simple :)12:48
GheRiverolxsli: I have like... 10 minutes before the summit sessions start, but will try to look at some12:48
lxslithat'd be great, thanks!12:49
*** gcha has joined #tripleo12:50
*** noslzzp has joined #tripleo12:51
*** chuckC has quit IRC12:52
openstackgerritNicholas Randon proposed a change to openstack/tripleo-incubator: Separate Heat BM and VM configs for Nova-BM.  https://review.openstack.org/9003312:53
*** nati_ueno has joined #tripleo12:54
*** gcha has quit IRC12:54
*** chuckC has joined #tripleo12:55
*** gcha has joined #tripleo12:55
*** rakesh_hs has quit IRC12:55
*** lazy_prince has joined #tripleo12:58
*** ramishra has joined #tripleo12:59
*** eghobo has joined #tripleo13:00
*** morazi has joined #tripleo13:02
*** gcha has quit IRC13:03
*** gcha has joined #tripleo13:03
*** dshulyak has quit IRC13:10
*** dshulyak has joined #tripleo13:14
*** morganfainberg is now known as morganfainberg_Z13:16
openstackgerritNicholas Randon proposed a change to openstack/tripleo-incubator: Export seed ip instead of gateway ip.  https://review.openstack.org/9355313:17
*** julim has joined #tripleo13:17
*** morazi has quit IRC13:19
*** morazi has joined #tripleo13:20
*** funzo has joined #tripleo13:20
lifelesshttps://etherpad.openstack.org/p/tripleo-end-to-end-automatic-bm <- folk interested in bringup of tripleo on a rack with no hands-on-fiddling13:26
lifelessgreghaynes: https://review.openstack.org/#/c/93132/ failed on overcloud13:31
lifelessCan I get a review on https://review.openstack.org/#/c/93475/ ?13:31
lifelessoh, failedovercloud13:31
*** julim has quit IRC13:34
StevenKlifeless: I'm going to Abandon https://review.openstack.org/#/c/93489/13:34
lifelessack13:35
*** ramishra has quit IRC13:35
openstackgerritGhe Rivero proposed a change to openstack/tripleo-image-elements: Fix ironic api port in nova element  https://review.openstack.org/9307813:38
*** eghobo has quit IRC13:40
*** morazi has quit IRC13:43
*** nati_ueno has quit IRC13:44
*** nati_ueno has joined #tripleo13:45
*** e0ne has joined #tripleo13:46
*** ramishra has joined #tripleo13:49
*** nati_uen_ has joined #tripleo13:49
gonerijp_at_hp: thanks for your feedback. Yes, it's obvious it's not a good idea with the Galera<>MySQL example.13:49
*** nati_ueno has quit IRC13:50
jp_at_hpgoneri: no probs.  I thought the original to only allow 1 type of operating-system was good, but I guess you can't please all of the people all of the time :D13:50
*** noslzzp has quit IRC13:51
*** nati_uen_ has quit IRC13:53
gonerijp_at_hp: ahah :) I was about to adjust to change back to the “operating-system” check, but the backlog is huge. I will prepare another patch in the future.13:56
tchaypoGOOD MORNING FREEDOM LOVERS13:58
StevenKtchaypo: Who do you think you are, jdub?13:58
*** nati_ueno has joined #tripleo13:58
GheRiverotchaypo: Freedom lovers? You are attached to your 'portable' system13:59
tchaypoStevenK: I'm so glad someone understood13:59
StevenKtchaypo: Anyway, it doesn't feel like morning, I've been at GWCC since 7:2014:00
tchaypoGheRivero: you'll have to speak up, i can't hear you over top of my screen ;)14:01
tchaypoStevenK: yes, i saw  you walking that way while I was enjoying breakfast at the doubletree14:01
tchaypoGheRivero: okay, the noise cancelling headphones may have something to do with not being able to hear you as well... maybe..14:01
* StevenK had breakfast with the Foundation board14:02
lifelessGheRivero: I got things working14:02
lifelessGheRivero: https://etherpad.openstack.org/p/tripleo-end-to-end-automatic-bm14:02
GheRiverolifeless: cool!14:02
*** nosnos has quit IRC14:03
GheRiveroagh! I do really need a machine for the VPN. Too bad it doesn't work from the hpcloud14:04
lifelessGheRivero: yeah :(14:04
GheRiveroI think I will try recover my 'server' from my former university datacenter now that they are freeing a bunch of machines by replacing Exchange Mail with GMail14:06
StevenKGheRivero: And host it where?14:09
lifelessis there a bug for the truty boot hang ?14:09
GheRiveroAt the university datacenter. I still have 'privileges' there :) And a 10Gb bandwidth14:10
StevenKGheRivero: Oh, recover, but not move it14:10
GheRiverolifeless: https://bugs.launchpad.net/tripleo/+bug/131647514:12
uvirtbotLaunchpad bug 1316475 in tripleo "trusty hang on first boot post deploy" [Critical,Triaged]14:12
*** blamar has joined #tripleo14:14
lifelessit looks like overcloud-precise is broken in all jobs?14:16
GheRiverodo you what happened to http://goodsquishy.com/downloads/tripleo-jobs.html?14:17
GheRiverowas really cool to check out those things14:17
lifelessderekh will14:17
*** d0ugal has quit IRC14:20
*** lazy_prince has quit IRC14:22
lifelesshmm14:23
lifeless+ os-svc-restart -n neutron-openvswitch-agent14:23
lifelessstop: Unknown instance:14:23
lifelessstart: Job failed to start14:23
jp_at_hpso - is anyonw able to approve either of the commits that will fix the current devtest.sh breakage?14:23
StevenKjp_at_hp: Oh?14:24
*** lazy_prince has joined #tripleo14:25
*** d0ugal has joined #tripleo14:25
*** d0ugal has quit IRC14:25
*** d0ugal has joined #tripleo14:25
*** deklan has joined #tripleo14:26
jp_at_hphttps://review.openstack.org/93042 or https://review.openstack.org/9003314:26
*** deklan has quit IRC14:30
*** deklan has joined #tripleo14:30
GheRiverolifeless: are you rebuilding the overcloud?14:31
lifelessGheRivero: yes, hoping its as simple as a stale image14:32
*** ramishra has quit IRC14:33
*** deklan has quit IRC14:36
*** e0ne has quit IRC14:36
*** jprovazn has quit IRC14:36
*** chuckC has quit IRC14:36
GheRiverobtw. did you said yesterday that an image build failed and rm /dev ? Sounds weird!14:37
tchaypoGheRivero: I've had that happen to me once14:40
*** eghobo has joined #tripleo14:43
*** e0ne has joined #tripleo14:45
*** blamar has quit IRC14:45
*** noslzzp has joined #tripleo14:46
*** blamar has joined #tripleo14:53
*** chuckC has joined #tripleo14:57
lifelessGheRivero: yes, occasional dib fffail14:58
*** untriaged-bot has joined #tripleo15:00
untriaged-botUntriaged bugs so far:15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131876715:00
uvirtbotLaunchpad bug 1318767 in tripleo "apache element SSL cert check fails" [Undecided,New]15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131744615:00
uvirtbotLaunchpad bug 1317446 in tripleo "Whitespace in SSLCertificate param causes jq error" [Undecided,In progress]15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131497815:00
uvirtbotLaunchpad bug 1314978 in tripleo "Cloud vm not pingable after overcloud upgrade " [Undecided,New]15:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131902715:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131535515:00
uvirtbotLaunchpad bug 1319027 in diskimage-builder "dib install packages not document in the command help" [Undecided,New]15:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131871715:00
uvirtbotLaunchpad bug 1315355 in tripleo "Upgrade of overcloud failed with "Connection to neutron failed: Maximum attempts reached"" [Undecided,New]15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131777815:00
uvirtbotLaunchpad bug 1318717 in diskimage-builder "image with rhel element can't be built if DIB_RHSM_* variables aren't set" [Undecided,In progress]15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131667515:00
uvirtbotLaunchpad bug 1317778 in tripleo "Rabbit "guest from everywhere" should be reverted" [Undecided,New]15:00
uvirtbotLaunchpad bug 1316675 in tripleo "Saving a devtest VM results in error" [Undecided,In progress]15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131705615:00
*** untriaged-bot has quit IRC15:00
uvirtbotLaunchpad bug 1317056 in tripleo "Guest VM FS corruption after compute host reboot" [Undecided,New]15:00
*** julim has joined #tripleo15:02
*** killer_p- has joined #tripleo15:04
*** ramishra has joined #tripleo15:04
*** killer_p- is now known as killer_prince15:04
*** sballe has joined #tripleo15:06
*** rbrady has joined #tripleo15:10
*** killer_p- has joined #tripleo15:12
*** killer_prince has quit IRC15:14
*** killer_p- is now known as killer_prince15:14
*** ifarkas has quit IRC15:14
*** julim has quit IRC15:17
*** shakayumi has joined #tripleo15:18
*** cody-somerville has joined #tripleo15:20
*** IvanBerezovskiy1 has left #tripleo15:23
*** deklan has joined #tripleo15:23
openstackgerritDmitry Shulyak proposed a change to openstack/tripleo-image-elements: Add haproxy stats to listen on 9000 port  https://review.openstack.org/9358015:23
*** jeremydei_ has joined #tripleo15:25
*** jeremydei has quit IRC15:25
*** blamar has quit IRC15:28
*** shakayumi has quit IRC15:28
*** shakayumi has joined #tripleo15:31
giulivoguys, to avoid the devtest script being stopped in the middle of devtest_setup for the user to relogin with the new group, how about we move the libvirt membership addition out of install-dependencies and in a own script launched _after_ setup-clienttools ?15:32
*** shakayumi has quit IRC15:33
StevenKgiulivo: I thought we needed to re-exec _setup after the group membership anyway?15:33
giulivohi StevenK indeed at the moment that it how it goes but we can avoid asking to re-run _setup if the libvirt membership addition happens at the end of the script15:34
*** blamar has joined #tripleo15:35
StevenKgiulivo: I thought portions of _setup required the membership ?15:35
StevenKgiulivo: Perhaps move the check and group addition to a script that is run before _setup if I'm correct.15:36
*** chuckC has quit IRC15:36
giulivoStevenK, also valid for me yes15:36
giulivoas long as we avoid stopping the script in between the steps I think that would be better15:36
* giulivo thinks it is only cleanup-env which depends on the libvirtd membership though15:37
*** eghobo has quit IRC15:37
StevenK_testenv is after _setup, I *think*, in which case a seperate script is fine15:37
StevenKAnd it removes some *horrible* code from _setup, so +115:38
giulivoStevenK, ok, thanks for the quick chat, I'll try that and add you to the review15:40
*** nati_ueno has quit IRC15:40
*** julim has joined #tripleo15:41
*** nati_ueno has joined #tripleo15:41
giulivoStevenK, I'm also unsure if/when we should use "sudo virsh" when we want the user to be in the libvirtd group15:43
*** noslzzp has quit IRC15:43
giulivoStevenK, is there a reason why some commands use "sudo virsh" and others do stuff with user's credentials?15:44
*** shakayumi has joined #tripleo15:44
StevenKgiulivo: Some commands may require creating or deleting files in root-owned directories, AFAIR15:45
*** chuckC has joined #tripleo15:45
giulivoas far as I understand, we need the user to be in the libvirtd group so that baremetal can do poweron/poweroff using user's credentials, is that correct?15:45
StevenKRight15:46
*** nati_ueno has quit IRC15:46
giulivobut if a user belongs to the libvirtd group, hopefully libvirt is not going to require user to have privileges to write in its config directory15:46
StevenKgiulivo: Feel free to remove the sudo from the calls, and see which ones break15:47
StevenKLess sudo is also a win15:47
giulivohehe yeah I'll try to mess up a bit and see, thanks!15:47
*** deklan has quit IRC15:47
*** rbrady has quit IRC15:48
*** lazy_prince has quit IRC15:51
*** beecee has joined #tripleo15:53
*** nati_ueno has joined #tripleo15:54
*** blamar has quit IRC15:54
*** rbrady has joined #tripleo15:59
*** hashar has quit IRC16:01
openstackgerritMichael Tupitsyn proposed a change to openstack/tripleo-incubator: Handy utility to deep merge JSON strings  https://review.openstack.org/9288116:02
*** julim has quit IRC16:03
*** mestery has joined #tripleo16:06
*** marun has joined #tripleo16:08
openstackgerritColeman Corrigan proposed a change to openstack/diskimage-builder: Added a DIB_TIDY_IMAGE toggle for image tidy up  https://review.openstack.org/9359416:10
openstackgerritA change was merged to openstack/tripleo-incubator: tripleo not configuring baremetal correctly in undercloud  https://review.openstack.org/9304216:12
*** deklan has joined #tripleo16:15
openstackgerritJon-Paul Sullivan (jp_at_hp) proposed a change to openstack/tripleo-incubator: Revert to correctly determining nodes needed  https://review.openstack.org/9359716:17
*** mestery has quit IRC16:21
*** deklan has quit IRC16:21
openstackgerritJon-Paul Sullivan (jp_at_hp) proposed a change to openstack/tripleo-incubator: Revert to correctly determining nodes needed  https://review.openstack.org/9359716:22
*** ramishra has quit IRC16:23
*** shakayumi has quit IRC16:24
*** newell_ has joined #tripleo16:25
*** nati_ueno has quit IRC16:27
gonerican a core take a look on the following (trivial) patches https://review.openstack.org/#/c/91823/ and https://review.openstack.org/#/c/91818/16:27
*** nati_ueno has joined #tripleo16:27
lifelessok so I don't know what teh trusty lockup is16:28
*** noslzzp has joined #tripleo16:28
lifelessGheRivero: / greghaynes: I think we're back to hacking on that now16:29
lifelessI have a 40 node cluster thats got 40 active nodes, but multiple stuck on the lockup16:29
*** chuckC has quit IRC16:29
lifelesse.g.  * Stopping DHCP any connected, but unconfigured network interfaces      [ OK ]16:29
GheRiverook. taking a look16:29
lifeless * Starting configure network device                                     [ OK ]16:29
GheRiverowhich one is the one you have the console open?16:30
lifelesson the node with ip 10.22.157.153 (screen window 2 atm )16:30
lifelessgotta run, meeting :( - ping a node that you can't ssh to from nova-list :)16:30
GheRiveroI will reboot it to inspect the logs16:31
*** nati_ueno has quit IRC16:31
*** rbrady has quit IRC16:31
*** marun has quit IRC16:33
*** noslzzp has quit IRC16:35
*** sballe has quit IRC16:36
openstackgerritColeman Corrigan proposed a change to openstack/diskimage-builder: Added a DIB_TIDY_IMAGE toggle for image tidy up  https://review.openstack.org/9359416:36
*** noslzzp has joined #tripleo16:38
*** akuznetsov has quit IRC16:39
GheRiverothe check-tripleo-overcloud-precise is failing due to a rabbitmq issue16:48
GheRiverostart: Job is already running: rabbitmq-server16:49
*** eghobo has joined #tripleo16:52
*** nati_ueno has joined #tripleo16:55
*** akuznetsov has joined #tripleo16:58
geertjHi all, I was looking into adding support for ravellosystems.com to devtest.sh.17:00
geertjI was looking at the code, and not sure where to start.17:01
geertjAny pointers?17:01
*** nati_ueno has quit IRC17:03
*** nati_ueno has joined #tripleo17:04
*** eghobo has quit IRC17:07
*** eghobo has joined #tripleo17:07
*** blamar has joined #tripleo17:08
*** nati_ueno has quit IRC17:08
*** e0ne has quit IRC17:16
*** e0ne has joined #tripleo17:18
openstackgerritChristian Berendt proposed a change to openstack/python-tuskarclient: replaced e.message with unicode(e)  https://review.openstack.org/9360617:18
*** darraghb has quit IRC17:28
*** nati_ueno has joined #tripleo17:31
victor_lowtherIn the Docker stuff I am working on I handle that by telling libvirtd that anyone can access it via the unix socket and that everyone has to use qemu:///system.17:32
*** eguz has joined #tripleo17:33
victor_lowtherer, w.r.t virsh stuff.17:33
*** chuckC has joined #tripleo17:35
*** eguz has quit IRC17:36
*** akuznetsov has quit IRC17:37
*** eghobo has quit IRC17:37
*** nati_ueno has quit IRC17:43
*** e0ne has quit IRC17:43
*** nati_ueno has joined #tripleo17:44
*** nati_ueno has quit IRC17:45
*** nati_ueno has joined #tripleo17:46
*** jrist has joined #tripleo17:46
*** chuckC has quit IRC17:49
*** mestery has joined #tripleo17:51
*** ramishra has joined #tripleo17:52
*** noslzzp has quit IRC17:53
*** chuckC has joined #tripleo17:54
*** rwsu has quit IRC17:55
*** julim has joined #tripleo17:56
*** marun has joined #tripleo17:57
*** geertj has quit IRC18:00
lifelesshi18:03
lifelessI might try saucy again18:03
lifelesswould I annoy anyone if I did that?18:04
*** akrivoka has quit IRC18:04
lifelessthe deploy layer is trusty, and I want to just flush out if there are heat issue etc still lukring18:04
GheRivero:/ I was trying to debug some nodes and getting a list of failing ones, just in case is something hw18:04
greghaynesGheRivero: I was thinking we might also do the set -x in dhcp-all-interfaces and output console in the upstart job for the whole overcloud18:05
greghaynesjust to get more info18:05
*** deklan has joined #tripleo18:05
GheRiverolifeless: opinion on that? ^^18:06
lifelessGheRivero: it could be18:06
lifelessGheRivero: can I help ?18:06
lifelessGheRivero: are you going top-> down ?18:07
GheRiveroI'm going in order18:07
lifelesswhich order - nova? ironic?18:07
lifelessip ?18:07
GheRiverodon't know if all the ips are actually leased18:08
lifelessnova list will tell you18:08
GheRiveroip order 149-> and increasing.18:09
lifelessjogo_: you're not in the upgrade ssession18:09
GheRivero:) not the best way. but don;t have to keep track where I am in the list18:09
StevenKlifeless: Lies18:10
StevenK;-)18:10
*** deklan has quit IRC18:12
*** shakayumi has joined #tripleo18:14
lifelessGheRivero: nova list | grep ctlplane | sed -e 's/^.*10.22.157.\(.*\) .*$/heat-admin@10.22.157.\1/' | xargs -n1 ssh :)18:19
GheRiveroI already got the list.. Now I'm translating the nova ips to ipmi ip18:19
lifelesskk18:21
*** ramishra has quit IRC18:21
*** ramishra has joined #tripleo18:21
*** ramishra_ has joined #tripleo18:24
*** ramishra has quit IRC18:24
*** shakayumi has quit IRC18:26
*** deklan has joined #tripleo18:26
*** e0ne has joined #tripleo18:28
*** marun has quit IRC18:31
*** chuckC has quit IRC18:31
lifelessok powering off the clood18:31
StevenKlifeless: Out of context, that's a pretty funny comment18:32
*** mestery has quit IRC18:32
* greghaynes envisions death star power down noise18:32
GheRiverothe rabbitmq server in the controller node can be restarted without problem (that's the issue in the check-tripleo-overcloud-precise)18:33
SpamapSlifecycle callbacks sessionn starting in 5 min18:34
GheRiveroI mean, in the check-tripleo-overcloud-precise if fails to restart18:34
SpamapSimportant for TripleO's heat HA story18:34
*** chuckC has joined #tripleo18:36
lifelesshmm heat18:37
lifelesswhy for you not deleting my stack ?18:37
greghaynesHA HA HA18:37
lifelessSpamapS: oh hai18:37
StevenKSpamapS: I was going to yell at the keystone guys about v3 client18:38
lifelessSpamapS: do you want me there ?18:38
StevenKfatal: unable to access 'https://git.openstack.org/openstack/heat.git/': GnuTLS recv error (-9): A TLS packet with unexpected length was received.18:38
lifelessSpamapS: also heat in the undercloud on this rack is not deleting the instances18:38
lifelesspsits in lalala land18:38
*** deklan has quit IRC18:40
*** deklan has joined #tripleo18:40
*** saurabhs has joined #tripleo18:40
*** deklan_ has joined #tripleo18:41
*** deklan has quit IRC18:42
*** mestery has joined #tripleo18:42
*** lazy_prince has joined #tripleo18:45
*** cody-somerville has quit IRC18:45
*** jrist has quit IRC18:46
*** shakayumi has joined #tripleo18:48
*** shakayumi has quit IRC18:49
*** blamar has quit IRC18:57
*** ramishra_ has quit IRC18:57
*** lazy_prince has quit IRC18:59
*** julim has quit IRC19:00
*** eghobo has joined #tripleo19:00
*** lazy_prince has joined #tripleo19:01
*** eghobo has quit IRC19:01
*** eghobo has joined #tripleo19:01
*** saurabhs has quit IRC19:03
StevenKWTB local mirror on my laptop19:07
lifelessfinally, it is dead19:08
GheRivero:/ RIP19:11
*** jang has joined #tripleo19:11
lifelesshonestly, it was a zombie stack19:17
lifelessresouuuurces19:17
*** jrist has joined #tripleo19:17
*** jang has quit IRC19:18
*** julim has joined #tripleo19:19
*** deklan_ has quit IRC19:19
*** deklan has joined #tripleo19:20
*** julim has quit IRC19:20
*** mestery has quit IRC19:21
*** eghobo has quit IRC19:21
*** geertj has joined #tripleo19:21
*** deklan has quit IRC19:24
*** ramishra has joined #tripleo19:26
*** ramishra has quit IRC19:26
*** jrist has quit IRC19:27
*** jrist has joined #tripleo19:29
*** rbrady has joined #tripleo19:30
openstackgerritGhe Rivero proposed a change to openstack-infra/tripleo-ci: Add /mnt/state/var/log to the host state files  https://review.openstack.org/9362719:31
lifeless10 seconds to do heat stack-list19:32
lifelesswe're threashing or something19:32
*** deklan has joined #tripleo19:32
*** marun has joined #tripleo19:41
*** noslzzp has joined #tripleo19:41
SpamapSlifeless: stack-list parses the whole stack19:45
lifelessSpamapS: for every stack?19:45
lifelessSpamapS: so I have heat wedged here. I would like you to analyse ploease19:45
*** deklan has quit IRC19:46
*** deklan has joined #tripleo19:46
*** marun has quit IRC19:46
lifelessSpamapS: e.g. + os-apply-config --key db-password19:46
lifeless[2014/05/14 07:40:45 PM] [ERROR] key db-password does not exist in ['/var/lib/os-collect-config/heat_local.json', '/var/lib/os-collect-config/ec2.json', '/var/lib/os-collect-config/cfn.json']19:46
lifeless+ db_pass=19:46
lifelessSpamapS: on ze controller19:47
*** blamar has joined #tripleo19:48
*** lazy_prince has quit IRC19:51
*** deklan has quit IRC19:51
SpamapSlifeless: heat stack-metadata-show stackname controllername19:51
SpamapSerr19:52
SpamapSresource-metadata-show19:52
*** lazy_prince has joined #tripleo19:52
lifelessresource-metadata ?19:54
lifelessSpamapS: ^?19:54
SpamapSlifeless: sure19:55
SpamapSlifeless: you at pod?19:56
lifelessSpamapS: 306, coming out in a sec19:57
lifelessit takes about 10-15 seconds to show each resource, be done soon19:57
SpamapSlifeless: I don't care much about resource api versioning so I would be interested in side by side hacking at the pod19:58
openstackgerritVictor Lowther proposed a change to openstack/tripleo-incubator: Let devtest.sh run in a Docker container.  https://review.openstack.org/9186719:58
SpamapS(resource api versioning being the next heat session)19:58
StevenKI would also be interested in the pod, but that's because I'm chewing through battery20:00
SpamapSStevenK: try soaking it in milk.. will require less chewing20:01
StevenKSob20:01
StevenKI've been trying to create images so I can break keystone on a local seed and see how my os-cloud-config change works20:02
SpamapSStevenK: oh! want a new tag?20:03
StevenKSpamapS: Nope, I want to fix this bug first20:04
lifelessSpamapS: http://paste.openstack.org/show/80390/20:04
lifelessSpamapS: I can come to the pod now20:04
SpamapSlifeless: weird! the deployment isn't IN PROGRESS20:04
SpamapSlifeless: heading to pod now20:04
*** hashar has joined #tripleo20:10
*** nati_ueno has quit IRC20:11
*** nati_ueno has joined #tripleo20:12
*** chuckC has quit IRC20:12
*** noslzzp has quit IRC20:12
*** lazy_prince has quit IRC20:13
*** rbrady has quit IRC20:26
*** nati_ueno has quit IRC20:26
openstackgerritGregory Haynes proposed a change to openstack/tripleo-image-elements: Make ironic virtual pm key permissions 600  https://review.openstack.org/9362920:27
*** rbrady has joined #tripleo20:28
*** cody-somerville has joined #tripleo20:29
lifeless /win goto #heat20:29
lifelesswin goto #heat20:29
*** nati_uen_ has joined #tripleo20:30
*** rlandy has quit IRC20:32
*** mestery has joined #tripleo20:33
*** nealph has joined #tripleo20:40
*** chuckC has joined #tripleo20:44
*** e0ne has quit IRC20:58
*** untriaged-bot has joined #tripleo21:00
untriaged-botUntriaged bugs so far:21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131876721:00
uvirtbotLaunchpad bug 1318767 in tripleo "apache element SSL cert check fails" [Undecided,New]21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131744621:00
uvirtbotLaunchpad bug 1317446 in tripleo "Whitespace in SSLCertificate param causes jq error" [Undecided,In progress]21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131497821:00
uvirtbotLaunchpad bug 1314978 in tripleo "Cloud vm not pingable after overcloud upgrade " [Undecided,New]21:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131902721:00
uvirtbotLaunchpad bug 1319027 in diskimage-builder "dib install packages not document in the command help" [Undecided,New]21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131535521:00
uvirtbotLaunchpad bug 1315355 in tripleo "Upgrade of overcloud failed with "Connection to neutron failed: Maximum attempts reached"" [Undecided,New]21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131947321:00
uvirtbotLaunchpad bug 1319473 in tripleo "devtest_testenv.sh doesn't honour overcoud_computescale or overcloud_controlscale" [Undecided,In progress]21:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131871721:00
uvirtbotLaunchpad bug 1318717 in diskimage-builder "image with rhel element can't be built if DIB_RHSM_* variables aren't set" [Undecided,In progress]21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131777821:00
uvirtbotLaunchpad bug 1317778 in tripleo "Rabbit "guest from everywhere" should be reverted" [Undecided,New]21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131667521:00
uvirtbotLaunchpad bug 1316675 in tripleo "Saving a devtest VM results in error" [Undecided,In progress]21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131705621:00
uvirtbotLaunchpad bug 1317056 in tripleo "Guest VM FS corruption after compute host reboot" [Undecided,New]21:00
*** untriaged-bot has quit IRC21:00
*** mestery has quit IRC21:01
*** mestery has joined #tripleo21:02
*** jeremydei_ is now known as jeremydei21:08
*** nati_uen_ has quit IRC21:11
notqrunning devtest_seed getting failed to start domain seed, error sata is not supported with this qemu binary21:12
notqgoogling now, but thought i'd ask for thoughts if it's a common problem21:12
*** eghobo has joined #tripleo21:12
*** chuckC has quit IRC21:12
*** eghobo has quit IRC21:13
*** eghobo has joined #tripleo21:13
StevenKnotq: Where did the qemu binary come from?21:13
victor_lowtherif it is rhel or centos 6, that is true.21:14
notqjust installed ubuntu newest version. so default21:14
victor_lowthernotq: ok, that is weird.21:14
victor_lowthersata has been supported in qemu for a few years norw.21:15
victor_lowtherubuntu 14.04?21:15
notqyep21:15
victor_lowtherwell, it is supported in qemu 2.0.021:15
*** mestery has quit IRC21:16
victor_lowtherwhat version are you using?21:16
*** chuckC has joined #tripleo21:16
notqnot sure, default install. should i rpm -qa | grep qemu ?21:16
victor_lowtherum21:16
victor_lowthernot really. :)21:16
*** ramishra has joined #tripleo21:16
StevenKNot on Ubuntu :-)21:16
notqoh, heh21:16
notqsorry i'm mostly a redhat guy21:16
victor_lowtherqemu-system-x86_64 --version21:16
notq2.021:17
victor_lowthersuper weird.21:17
*** nati_ueno has joined #tripleo21:18
*** morazi has joined #tripleo21:20
openstackgerritDerek Higgins proposed a change to openstack-infra/tripleo-ci: Run free  https://review.openstack.org/9363421:22
notqhrm21:22
victor_lowthernotq: what does virsh dumpxml seed |grep machine show?21:23
notqarch=i686 machine ='pc-1.0' hvm21:24
*** eguz has joined #tripleo21:28
*** eguz has quit IRC21:28
victor_lowtherthat looks reasonable-ish21:29
*** eghobo has quit IRC21:29
notqit has been a new ubuntu install, and following this. that's it http://docs.openstack.org/developer/tripleo-incubator/devtest.html21:29
*** blamar has quit IRC21:31
victor_lowtherIf you feel adventurous,  you can modify the vm.xml template to zap the machine= part of the <type> tag.21:31
victor_lowthersince that is overspecified anyways.21:32
*** jml has quit IRC21:36
*** jml has joined #tripleo21:39
lifelessgreghaynes: https://etherpad.openstack.org/p/tripleo-end-to-end-automatic-bm21:40
openstackgerritGhe Rivero proposed a change to openstack/tripleo-image-elements: WIP - Lill rabbit before restarting int  https://review.openstack.org/9363721:40
notqvm.xml template somewhere in tripleo-incubator?21:40
notqediting no21:41
notqnow21:41
victor_lowtherok21:41
notqrerunning devtest_seed21:41
*** hashar has quit IRC21:42
*** cody-somerville has quit IRC21:44
*** geertj has quit IRC21:46
*** ramishra has quit IRC21:48
*** nealph has quit IRC21:52
openstackgerritGregory Haynes proposed a change to openstack/diskimage-builder: Add -x and console output for dhcp-all-interfaces  https://review.openstack.org/9364021:53
notqsame error, sata is not supported with this qemu binary21:53
greghayneslifeless: https://review.openstack.org/#/c/93640/21:54
*** chuckC has quit IRC21:56
*** nati_ueno has quit IRC21:56
*** jrist has quit IRC21:58
*** morazi has quit IRC22:02
*** giulivo has quit IRC22:05
*** rbrady has quit IRC22:06
*** geerdest has quit IRC22:07
openstackgerritVictor Lowther proposed a change to openstack/tripleo-incubator: Let devtest.sh run in a Docker container.  https://review.openstack.org/9186722:10
*** nati_ueno has joined #tripleo22:11
*** nati_ueno has quit IRC22:14
*** nati_ueno has joined #tripleo22:15
victor_lowtherStevenK: https://gist.github.com/VictorLowther/a8e502ec56a4acddbe9022:15
*** nati_ueno has quit IRC22:19
*** sballe has joined #tripleo22:32
*** sballe has quit IRC22:36
*** eghobo has joined #tripleo22:37
*** eghobo has quit IRC22:38
*** eghobo has joined #tripleo22:38
*** chuckC has joined #tripleo23:00
*** chuckC has quit IRC23:31
*** newell_ has quit IRC23:35
*** Hefeweizen has quit IRC23:47
*** ramishra has joined #tripleo23:51
*** ramishra has quit IRC23:53
*** ramishra has joined #tripleo23:54

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!