Monday, 2014-05-19

*** lifeless has joined #tripleo00:07
*** xuhaiwei has joined #tripleo00:18
*** rbrady has quit IRC00:22
*** shakayumi has quit IRC00:31
*** eghobo has quit IRC00:37
lifelessSpamapS: ohhai00:43
StevenKHmmm01:24
StevenKI wonder if devtest is actually registering 14 nodes with undercloud on my laptop01:25
lifelessyou have some reason to think it is not?01:33
StevenKIt was a random thought -- not sure if they all get spun up01:34
*** nosnos has joined #tripleo01:41
*** nati_ueno has joined #tripleo01:46
*** deklan has joined #tripleo01:57
lifelessyou're not deploying a 14 node cluster02:00
*** deklan has quit IRC02:04
*** nati_ueno has quit IRC02:09
*** nati_ueno has joined #tripleo02:13
*** nati_ueno has quit IRC02:16
*** lifeless has quit IRC02:16
*** rbrady has joined #tripleo02:16
*** matsuhashi has joined #tripleo02:17
*** nati_ueno has joined #tripleo02:21
*** lifeless has joined #tripleo02:24
*** nati_ueno has quit IRC02:30
*** jml has quit IRC02:38
*** jml has joined #tripleo02:39
*** rbrady has quit IRC02:43
openstackgerritSteve Baker proposed a change to openstack/tripleo-image-elements: Refresh heat-cfntools element  https://review.openstack.org/9203602:46
*** rbrady has joined #tripleo02:48
*** killer_prince has quit IRC02:50
*** ramishra has joined #tripleo02:57
*** untriaged-bot has joined #tripleo03:00
untriaged-botUntriaged bugs so far:03:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131998703:00
uvirtbotLaunchpad bug 1319987 in diskimage-builder "WHITELIST error" [Undecided,In progress]03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131744603:00
uvirtbotLaunchpad bug 1317446 in tripleo "Whitespace in SSLCertificate param causes jq error" [Undecided,In progress]03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131497803:00
uvirtbotLaunchpad bug 1314978 in tripleo "Cloud vm not pingable after overcloud upgrade " [Undecided,New]03:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131902703:00
uvirtbotLaunchpad bug 1319027 in diskimage-builder "dib install packages not document in the command help" [Undecided,New]03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131535503:00
uvirtbotLaunchpad bug 1315355 in tripleo "Upgrade of overcloud failed with "Connection to neutron failed: Maximum attempts reached"" [Undecided,New]03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131876703:00
uvirtbotLaunchpad bug 1318767 in tripleo "apache element SSL cert check fails" [Undecided,New]03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131947303:00
uvirtbotLaunchpad bug 1319473 in tripleo "devtest_testenv.sh doesn't honour overcloud_computescale or overcloud_controlscale" [Undecided,In progress]03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131705603:00
uvirtbotLaunchpad bug 1317056 in tripleo "Guest VM FS corruption after compute host reboot" [Critical,New]03:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131871703:00
uvirtbotLaunchpad bug 1318717 in diskimage-builder "image with rhel element can't be built if DIB_RHSM_* variables aren't set" [Undecided,In progress]03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131777803:00
uvirtbotLaunchpad bug 1317778 in tripleo "Rabbit "guest from everywhere" should be reverted" [Undecided,New]03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131667503:00
uvirtbotLaunchpad bug 1316675 in tripleo "Saving a devtest VM results in error" [Undecided,In progress]03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/132009003:00
uvirtbotLaunchpad bug 1320090 in tripleo "pxe_ephemeral_format': u'ext4 left on nodes after deploys deleted" [Undecided,New]03:00
*** untriaged-bot has quit IRC03:00
*** nati_ueno has joined #tripleo03:06
*** eghobo has joined #tripleo03:19
*** nati_ueno has quit IRC03:21
*** eghobo has quit IRC03:39
*** nosnos has quit IRC03:51
*** rbrady has quit IRC04:02
*** gfa has left #tripleo04:14
StevenKlifeless: Re: bug 1316475, I wonder if it's a bug in ifup04:18
uvirtbotLaunchpad bug 1316475 in tripleo "trusty hang on first boot post deploy" [Critical,Triaged] https://launchpad.net/bugs/131647504:18
StevenKlifeless: Maybe build a trusty image, and forcibly downgrade ifupdown to 0.7.44ubuntu3 from saucy?04:19
greghaynesor maybe replace ifup with strace ifup in our image04:19
*** eghobo has joined #tripleo04:20
StevenKI'm a little concerned with where stderr goes with that approach04:20
lifelessStevenK: so it does say '[OK]' there04:20
lifelessso it might not be that job04:20
lifelessits just that we don't see any other job...04:20
StevenKHm, so it might even be upstart itself04:20
StevenKUpstart looks to be two releases different, so it's a possibility04:21
*** tzumainn has quit IRC04:21
StevenKI'd suggest switching to systemd, but then I'd have to review my lunch04:22
*** nati_ueno has joined #tripleo04:32
*** nosnos has joined #tripleo04:32
*** nati_ueno has quit IRC04:37
*** ramishra has quit IRC04:38
*** rbrady has joined #tripleo04:40
*** akuznetsov has joined #tripleo04:55
*** rakesh_hs has joined #tripleo05:13
*** ramishra has joined #tripleo05:15
*** ramishra has quit IRC05:29
*** ramishra has joined #tripleo05:30
*** dshulyak_ has joined #tripleo05:31
*** nati_ueno has joined #tripleo05:34
*** ramishra has quit IRC05:34
*** jtomasek has joined #tripleo06:08
*** rdopieralski has joined #tripleo06:12
*** nati_ueno has quit IRC06:17
*** adam_gone is now known as adam_g06:19
*** matsuhashi has quit IRC06:25
*** matsuhashi has joined #tripleo06:28
*** dshulyak_ has quit IRC06:29
*** nati_ueno has joined #tripleo06:35
*** rbrady has quit IRC06:36
*** eghobo has quit IRC06:40
*** eghobo has joined #tripleo06:40
*** ifarkas has joined #tripleo06:42
*** andreaf has joined #tripleo06:46
openstackgerritA change was merged to openstack/tuskar-ui: Get AdminPassword safely, in the case it is missing  https://review.openstack.org/9230706:47
openstackgerritA change was merged to openstack/tuskar-ui: Use python -m coverage.__main__ to invoke coverage  https://review.openstack.org/9347406:49
openstackgerritA change was merged to openstack/tuskar-ui: Default GlanceLogFile template parameter value  https://review.openstack.org/9156206:49
*** eguz has joined #tripleo06:57
*** eghobo has quit IRC06:57
*** eguz has quit IRC06:59
*** nati_ueno has quit IRC07:00
*** d0ugal has joined #tripleo07:06
*** mrunge has joined #tripleo07:12
*** rbrady has joined #tripleo07:13
*** jprovazn has joined #tripleo07:19
xuhaiweilifeless: if I want to add a new compute node in overcloud, I just need to source the undercloudrc, and rename the stack name for the new heat stack, and set OVERCLOUD_COMPUTESCALE=1 and then run devtest_overcloud.sh?07:20
*** andreaf has quit IRC07:26
*** andreaf has joined #tripleo07:27
*** pblaho has joined #tripleo07:27
*** nati_ueno has joined #tripleo07:29
*** jtomasek has quit IRC07:33
dshulyakvinsh: hi, are you around?07:33
*** nati_ueno has quit IRC07:33
*** shardy has joined #tripleo07:34
*** ramishra has joined #tripleo07:39
*** jtomasek has joined #tripleo07:44
*** e0ne has joined #tripleo07:45
*** ramishra has quit IRC07:57
*** giulivo has joined #tripleo07:59
*** jistr has joined #tripleo08:01
*** rdopieralski has quit IRC08:01
*** rdopieralski has joined #tripleo08:02
*** rdopieralski has quit IRC08:03
*** cody-somerville has joined #tripleo08:06
*** rdopieralski has joined #tripleo08:06
*** lazy_prince has joined #tripleo08:14
*** lazy_prince is now known as killer_prince08:14
*** darraghb has joined #tripleo08:15
*** darraghb has quit IRC08:16
*** darraghb has joined #tripleo08:18
*** athomas has joined #tripleo08:19
*** darraghb has left #tripleo08:23
*** pelix has joined #tripleo08:23
*** hashar has joined #tripleo08:25
*** _dguerri is now known as dguerri08:26
Ngmorning08:31
*** lucasagomes has joined #tripleo08:32
pblahomorning...08:32
*** martyntaylor has joined #tripleo08:33
*** derekh_ has joined #tripleo08:37
xuhaiweiIs anyone succeed in adding a new compute node to the overcloud?08:49
*** ramishra has joined #tripleo08:50
*** dguerri is now known as _dguerri08:52
openstackgerritNicholas Randon proposed a change to openstack/tripleo-heat-templates: Move to software-config for the undercloud.  https://review.openstack.org/9331908:59
*** untriaged-bot has joined #tripleo09:00
untriaged-botUntriaged bugs so far:09:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131998709:00
uvirtbotLaunchpad bug 1319987 in diskimage-builder "WHITELIST error" [Undecided,In progress]09:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131744609:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131497809:00
uvirtbotLaunchpad bug 1317446 in tripleo "Whitespace in SSLCertificate param causes jq error" [Undecided,In progress]09:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131902709:00
uvirtbotLaunchpad bug 1314978 in tripleo "Cloud vm not pingable after overcloud upgrade " [Undecided,New]09:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131535509:00
uvirtbotLaunchpad bug 1319027 in diskimage-builder "dib install packages not document in the command help" [Undecided,New]09:00
uvirtbotLaunchpad bug 1315355 in tripleo "Upgrade of overcloud failed with "Connection to neutron failed: Maximum attempts reached"" [Undecided,New]09:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131876709:00
uvirtbotLaunchpad bug 1318767 in tripleo "apache element SSL cert check fails" [Undecided,New]09:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131947309:00
uvirtbotLaunchpad bug 1319473 in tripleo "devtest_testenv.sh doesn't honour overcloud_computescale or overcloud_controlscale" [Undecided,In progress]09:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131705609:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131871709:00
uvirtbotLaunchpad bug 1317056 in tripleo "Guest VM FS corruption after compute host reboot" [Critical,New]09:00
uvirtbotLaunchpad bug 1318717 in diskimage-builder "image with rhel element can't be built if DIB_RHSM_* variables aren't set" [Undecided,In progress]09:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131777809:00
uvirtbotLaunchpad bug 1317778 in tripleo "Rabbit "guest from everywhere" should be reverted" [Undecided,New]09:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131667509:00
uvirtbotLaunchpad bug 1316675 in tripleo "Saving a devtest VM results in error" [Undecided,In progress]09:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/132009009:00
uvirtbotLaunchpad bug 1320090 in tripleo "pxe_ephemeral_format': u'ext4 left on nodes after deploys deleted" [Undecided,New]09:00
*** untriaged-bot has quit IRC09:00
openstackgerritNicholas Randon proposed a change to openstack/tripleo-heat-templates: Move to software-config for the undercloud.  https://review.openstack.org/9331909:00
*** _dguerri is now known as dguerri09:01
xuhaiwei+Ng: I want to add a compute node to the overcloud, but i failed it, can you help?09:03
*** rlandy has joined #tripleo09:05
*** jp_at_hp has joined #tripleo09:11
Ngxuhaiwei: so you registered a new node with the undercloud and it failed to deploy?09:11
xuhaiwei+Ng:I didn't register a new node, I noticed there are already 14 nodes registered, so i just source undercloudrc, and reset the OVERCLOUD_COMPUTESCALE and changed the STACK_NAME in devtest_overcloud.sh and then run devteset_overcloud.sh09:16
Ngxuhaiwei: that wouldn't add a node to the overcloud, that would try and deploy a whole new overcloud with a different name, but likely with the same networking09:17
Ngseems unlikely to work :)09:17
xuhaiweithe script failed in stack-create, and in the nova-api.log i found Authorization failed for token09:18
xuhaiwei+Ng: does this mean the token is expired? the admin_token written in the overcloud-env.json09:19
Ngxuhaiwei: sounds like it, yes, but if you want to add a node to the overcloud, re-running devtest_overcloud.sh isn't going to do that09:20
dshulyakbtw it is possible to start deployment with more than 1 controller - https://review.openstack.org/#/c/88085/ , one minor issue is with keystone output url http://paste.openstack.org/show/80883/09:20
Ngif you want to build a second overcloud, you could do that, but you'd need to modify the networking config too, not just STACKNAME09:20
xuhaiwei+Ng: is it complicated to config the network?09:21
*** tzumainn has joined #tripleo09:22
Ngxuhaiwei: do you want a second overcloud? or are you trying to add a compute node to your first overcloud?09:23
xuhaiwei+Ng: just a compute node to the first overcloud09:23
Ngxuhaiwei: ok, then you don't want to re-run devtest_overcloud.sh09:23
openstackgerritDerek Higgins proposed a change to openstack-infra/tripleo-ci: Add revert hook point  https://review.openstack.org/9415609:24
Ngxuhaiwei: you need to register the node with the undercloud, edit the overcloud heat config to require one more compute note, and tell heat to update the stack with that new config.09:24
xuhaiwei+Ng: the heat stack-update makes sense to me, but how to register the node with undercloud?09:27
*** IvanBerezovskiy has joined #tripleo09:27
openstackgerritDmitry Shulyak proposed a change to openstack/tripleo-heat-templates: Change keystone url in outputs to use vip address  https://review.openstack.org/9415709:29
Ngxuhaiwei: if you're using nova-baremetal, "nova baremetal-node-create" with various relevant arguments09:29
xuhaiwei+Ng: i got it, thank you very much09:30
Ngxuhaiwei: np :)09:30
*** gcha has joined #tripleo09:36
*** lsmola has joined #tripleo09:44
jp_at_hplifeless: Ng any other cores...  I disagree with the -2 on this review.  https://review.openstack.org/#/c/93597/  I think the commit messsage is a very clear and well constructed reasoning for making the change.  Can I get some feedback on that please?  If other cores feel I am wrong I will abandon, if I can be given a reasonable alternative to my proposed patch.  Thanks...09:45
*** matsuhashi has quit IRC09:50
*** e0ne has quit IRC09:55
*** rcarrillocruz has joined #tripleo09:56
Ngjp_at_hp: I'm curious about how this has "fundementally broken the developer use-case"09:56
Ng*fundamentally09:56
*** rcarrill` has quit IRC09:57
*** ramishra has quit IRC10:03
*** e0ne has joined #tripleo10:05
*** akrivoka has joined #tripleo10:07
*** martyntaylor has left #tripleo10:07
jp_at_hpNg: as a developer I want to build with different scales, which may be beyond 15 nodes.  Perhaps a little overstated.  Take out the fundamentally and it reads better.10:14
jp_at_hpand s/the/a/10:14
jp_at_hpSo it has brokan a developer use-case...10:14
Ngjp_at_hp: the various variables are still overridable though, right??10:19
jp_at_hpNg: after all of the -2's about adding new environment variables...10:19
jp_at_hpAnd that means checking that you have set NODE_CNT to min(overcloud computescale + overcloud control scale +2), or your run will fail.10:20
Ngso, that might not be a bad direction to take your patch - ensure that NODE_CNT is 15 or the summation of required machines, whichever is higher10:21
openstackgerritNicholas Randon proposed a change to openstack/tripleo-heat-templates: Add passthrough configuration glue.  https://review.openstack.org/9181010:27
xuhaiwei+Ng: another question: if i add a compute node by updating the original stack, will it destroy the original compute nodes?10:28
Ngxuhaiwei: no10:29
xuhaiwei+Ng: ok10:29
*** e0ne has quit IRC10:31
*** gcha has quit IRC10:34
*** mrunge has quit IRC10:49
*** xuhaiwei has quit IRC11:03
*** rcarrillocruz has quit IRC11:04
*** mrunge has joined #tripleo11:04
openstackgerritDmitry Shulyak proposed a change to openstack/tripleo-heat-templates: Use vip address where controller0 was used for endpoints  https://review.openstack.org/9415711:04
*** e0ne has joined #tripleo11:06
*** rcarrillocruz has joined #tripleo11:08
*** e0ne has quit IRC11:10
*** dguerri is now known as _dguerri11:12
*** e0ne has joined #tripleo11:18
*** nosnos has quit IRC11:21
*** e0ne has quit IRC11:22
openstackgerritA change was merged to openstack/tripleo-incubator: Fixes for manual installation  https://review.openstack.org/8795511:28
*** gcha has joined #tripleo11:42
*** e0ne has joined #tripleo11:53
*** bcrochet has quit IRC11:57
*** lucasagomes is now known as lucas-hungry11:58
*** bcrochet has joined #tripleo12:00
jp_at_hpNg: yes, I can do that.  But it is frustrating that different principles are being applied to different patches.  The patch that did this meant a new environment variable was needed to make things work, and yet other patches adding environment variables are dismissed out of hand... :(12:02
openstackgerritColeman Corrigan proposed a change to openstack/diskimage-builder: Added a DIB_RESOLV_CONF for resolv.conf injection  https://review.openstack.org/9417712:04
Ngjp_at_hp: I wonder if that means there is some kind of mismatch in expectations about new env vars. AFAIK we don't have any strict policy about introducing them or not introducing them, so it would be good to get everyone on the same page12:04
jp_at_hpNg: Any change that involves any new env vars seems to be getting a -2 at the mo.12:05
jp_at_hpexcept in some cases ... :(12:05
Ngjp_at_hp: got any links to those -2s handy? I'd like to look into this and see if we can avoid wasted effort, whether there is some policy being applied, or if there are just better ways to be doing those things12:07
*** bcrochet has quit IRC12:07
jp_at_hphttps://review.openstack.org/85009 is one of them.  https://review.openstack.org/#/c/88252/ is a -1 but on grounds of adding an env var...12:09
*** bcrochet has joined #tripleo12:10
lxsliNg: lifeless is pursuing that policy rigorously12:10
jp_at_hpNg: https://review.openstack.org/#/c/93597/ is another where the needs of CI seem to be applied ahead of developer workflow, which imho is incorrect and backwards.  It's quite frustrating.12:10
jp_at_hpIf there is a policy, it needs to be (1) declared, (2) provide usable alternatives to those things being verboten.12:11
lxsli(3) applied to everyone equally by all cores12:12
jp_at_hpnot to mention, it can alienate developers :(12:12
jp_at_hplxsli: +112:12
Ngok, so 93597 wasn't -2'd because of an envvar12:12
Ngfwiw I don't think there is such a policy, and I don't want you guys to get frustrated/alienated, when we can all work together to find better ways of doing things, ideally ways that *reduce* envvars, since we already have way too many12:13
Ngwe're all upstream devs on this, we're all in this togather :D12:15
lxsliyeah there's this ENV_JSON stuff, which is good, but it's really not finished yet12:15
*** jdob has joined #tripleo12:20
lxslibtw anyone know if the gate's working now?12:21
*** mrunge has quit IRC12:25
giulivotchaypo, I updated https://review.openstack.org/#/c/92611/ as per our conversatio12:28
*** weshay has joined #tripleo12:29
openstackgerritA change was merged to openstack/tuskar-ui: Improve error reporting  https://review.openstack.org/9038112:30
openstackgerritA change was merged to openstack/tuskar-ui: Added selenium test environment to tox.ini  https://review.openstack.org/9212912:30
openstackgerritA change was merged to openstack/tuskar-ui: Use the master tarball for openstack depends  https://review.openstack.org/9161412:31
jp_at_hpNg: that's cool, but we need to make sure we all work together, and alternatives are presented when something is -2'ed.12:34
*** jpeeler has joined #tripleo12:34
*** jpeeler has joined #tripleo12:35
Ngjp_at_hp: agreed, it may be worth a mailing list thread about that, and/or about any specific -2s that don't come with decent suggestions12:36
Ng(I prefer mailing list to gerrit, it's more discoverable/linkable for future reference)12:37
jp_at_hpWell core reviewers should know what is expected of them ...12:37
*** gcha has quit IRC12:37
jp_at_hpBut OK, last week was the summit, so maybe just outside of normal operating procedures...12:37
*** gcha has joined #tripleo12:39
Ngjp_at_hp: I do agree, however, knowing that something is not appropriate and a fully fleshed out decision on what is appropriate, are two separate things, so it may well be that discussion on the list is the best outcome of a -212:40
lxsliThe issue has been bumping along for a couple of weeks at least; but I agree a mailing list thread would have helped raise it12:41
Ngwe're always going to have tension between the desire to get stuff implemented now and the desire to get stuff implemented well. How we walk that line as a group, will be a big factor in our long-term success, imho :)12:42
lxslijp_at_hp: will you raise a thread about it?12:48
*** noslzzp has joined #tripleo12:52
jp_at_hplxsli: well - a specific issue or the general case?12:52
lxsliabout env vars, the approach intended to replace it and the process point of blocking new env vars when there's no clear replacement solution in place12:57
jp_at_hplxsli: yes - that is definitely a longer topic that needs edification.12:59
*** dlfryar has joined #tripleo13:00
*** lucas-hungry is now known as lucasagomes13:00
*** rcarrill` has joined #tripleo13:03
*** rcarrillocruz has quit IRC13:05
openstackgerritDmitry Shulyak proposed a change to openstack/tripleo-heat-templates: Use vip address where controller0 was used for endpoints  https://review.openstack.org/9415713:06
*** dprince has joined #tripleo13:06
*** rcarrill` has quit IRC13:09
openstackgerritNicholas Randon proposed a change to openstack/tripleo-incubator: Separate Heat BM and VM configs for Nova-BM.  https://review.openstack.org/9003313:10
*** howleyt has quit IRC13:10
openstackgerritNicholas Randon proposed a change to openstack/tripleo-incubator: Choose whether to deploy/update using heat.  https://review.openstack.org/9234413:11
openstackgerritNicholas Randon proposed a change to openstack/tripleo-incubator: Make a separation between --heat-env  https://review.openstack.org/9309113:11
openstackgerritNicholas Randon proposed a change to openstack/tripleo-incubator: Export seed ip instead of gateway ip.  https://review.openstack.org/9355313:12
*** rcarrillocruz has joined #tripleo13:15
*** dlfryar has quit IRC13:18
*** jang has quit IRC13:22
*** jml has quit IRC13:25
*** jang has joined #tripleo13:26
*** jml has joined #tripleo13:28
*** jang has quit IRC13:28
*** deklan has joined #tripleo13:33
*** deklan_ has joined #tripleo13:33
openstackgerritJiri Stransky proposed a change to openstack/os-cloud-config: PKI key/cert generation for use with Keystone  https://review.openstack.org/8332413:34
*** killer_prince has quit IRC13:34
*** ccrouch has joined #tripleo13:37
*** deklan has quit IRC13:38
*** rakesh_hs has quit IRC13:39
vinshdshulyak, ping! Am on now13:40
*** morazi has joined #tripleo13:40
dshulyakvinsh: is sysctl element finally worked for you?13:42
vinshIt worked as expected once properly included13:42
*** funzo has quit IRC13:43
*** funzo has joined #tripleo13:44
*** funzo has quit IRC13:44
*** funzo has joined #tripleo13:44
*** matty_dubs|gone is now known as matty_dubs13:48
*** deklan_ has quit IRC13:49
*** jrist has joined #tripleo13:59
*** lazy_prince has joined #tripleo14:02
*** lazy_prince is now known as killer_prince14:02
*** gcha has quit IRC14:02
*** rwsu has joined #tripleo14:06
*** funzo has quit IRC14:08
*** funzo has joined #tripleo14:09
*** funzo has quit IRC14:10
*** funzo has joined #tripleo14:11
*** funzo has quit IRC14:11
*** funzo has joined #tripleo14:11
*** morganfainberg_Z is now known as morganfainberg14:19
*** olaph has joined #tripleo14:21
*** ramishra has joined #tripleo14:27
*** lazy_prince3 has joined #tripleo14:30
*** lazy_prince3 is now known as lazy_prince14:31
openstackgerritNicholas Randon proposed a change to openstack/tripleo-heat-templates: Add passthrough configuration glue.  https://review.openstack.org/9181014:31
*** jang has joined #tripleo14:32
*** jtomasek has quit IRC14:33
*** jang has quit IRC14:34
dshulyakjprovazn: hi, btw what is current state of rabbit cluster and galera?14:35
*** jtomasek has joined #tripleo14:35
dshulyakit seems that it is possible to start ha testing this week14:35
dshulyakbut vrrp for neutron is not ready yet :(14:36
jprovazndshulyak, galera cluster setup is currently not sufficient for >1 node, I run multi node setup with this pending patch: https://review.openstack.org/#/c/86871/14:37
jprovaznrabbitmq - this should be fine14:37
jprovazndshulyak, whole keystone's certificate logic is not in yet14:38
jprovazndshulyak, neutron needs more love too14:38
jprovaznif we end up with A/P for neutron, then ^ depends on solving pcs vs crm config tool too14:38
openstackgerritFlint Calvin proposed a change to openstack/tripleo-incubator: Adding the setting of CeilometerMeteringSecret in scripts/devtest_overcloud.sh so that the value of metering_secret gets set appropriately in /etc/ceilometer/ceilometer.conf on the management controller.  https://review.openstack.org/9420114:43
openstackgerritDmitry Shulyak proposed a change to openstack/tripleo-heat-templates: Haproxy configuration  https://review.openstack.org/9355414:46
lxsliCore for https://review.openstack.org/#/c/91801/ please?14:50
*** untriaged-bot has joined #tripleo15:00
untriaged-botUntriaged bugs so far:15:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131998715:00
uvirtbotLaunchpad bug 1319987 in diskimage-builder "WHITELIST error" [Undecided,In progress]15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131744615:00
uvirtbotLaunchpad bug 1317446 in tripleo "Whitespace in SSLCertificate param causes jq error" [Undecided,In progress]15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131497815:00
uvirtbotLaunchpad bug 1314978 in tripleo "Cloud vm not pingable after overcloud upgrade " [Undecided,New]15:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131902715:00
uvirtbotLaunchpad bug 1319027 in diskimage-builder "dib install packages not document in the command help" [Undecided,New]15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131535515:00
uvirtbotLaunchpad bug 1315355 in tripleo "Upgrade of overcloud failed with "Connection to neutron failed: Maximum attempts reached"" [Undecided,New]15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131876715:00
uvirtbotLaunchpad bug 1318767 in tripleo "apache element SSL cert check fails" [Undecided,New]15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131947315:00
uvirtbotLaunchpad bug 1319473 in tripleo "devtest_testenv.sh doesn't honour overcloud_computescale or overcloud_controlscale" [Undecided,In progress]15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131705615:00
uvirtbotLaunchpad bug 1317056 in tripleo "Guest VM FS corruption after compute host reboot" [Critical,New]15:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131871715:00
uvirtbotLaunchpad bug 1318717 in diskimage-builder "image with rhel element can't be built if DIB_RHSM_* variables aren't set" [Undecided,In progress]15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131777815:00
uvirtbotLaunchpad bug 1317778 in tripleo "Rabbit "guest from everywhere" should be reverted" [Undecided,New]15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131667515:00
uvirtbotLaunchpad bug 1316675 in tripleo "Saving a devtest VM results in error" [Undecided,In progress]15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/132009015:00
uvirtbotLaunchpad bug 1320090 in tripleo "pxe_ephemeral_format': u'ext4 left on nodes after deploys deleted" [Undecided,New]15:00
*** untriaged-bot has quit IRC15:00
openstackgerritA change was merged to openstack/tuskar: debug level logs should not be translated  https://review.openstack.org/9349215:05
*** blamar has joined #tripleo15:07
*** deklan has joined #tripleo15:16
openstackgerritMichael Kerrin proposed a change to openstack/tripleo-incubator: The default in heat-templates is to preserve ephemeral disks  https://review.openstack.org/8535315:16
*** ramishra has quit IRC15:17
giulivoping GheRivero15:22
*** ramishra has joined #tripleo15:23
openstackgerritTzu-Mainn Chen proposed a change to openstack/tuskar-ui: Ensure ipmi username and password are set  https://review.openstack.org/9304815:25
*** ptippett has joined #tripleo15:29
*** mkerrin has joined #tripleo15:30
*** deklan has quit IRC15:31
*** ramishra has quit IRC15:36
*** morganfainberg is now known as morganfainberg_Z15:38
*** dlfryar has joined #tripleo15:43
*** IvanBerezovskiy has left #tripleo15:45
*** matty_dubs is now known as matty_dubs|lunch15:46
*** chuckC has quit IRC15:48
openstackgerritA change was merged to openstack/diskimage-builder: Fedora: Add support for configuring Yum mirrors  https://review.openstack.org/9219015:52
SpamapSo/15:52
greghaynes\o15:53
SpamapSgreghaynes: before I dive into trusty debugging.. have you done anything with it?15:54
SpamapSoh woot, 93931 merged15:55
SpamapSrecheck the world15:55
Nghey SpamapS, greghaynes15:55
greghaynesSpamapS: I have not15:56
greghaynesNg: hihi15:56
*** eghobo has joined #tripleo15:57
derekh_SpamapS: recheck nothing15:59
derekh_SpamapS: R1 isn't being used by nodepool at the moment, don't know why but backlog is getting bigger16:00
derekh_SpamapS: its as if its been unconfigured, i.e. nothing it hitting the API16:00
derekh_SpamapS: I asked about it on infa a couple of times but no answer yet16:01
derekh_btw, url to current jobs is here http://46.231.113.2/downloads/tripleo-jobs.html16:02
derekh_dns should be updated soon16:02
*** chuckC has joined #tripleo16:02
SpamapSderekh_: doh16:05
SpamapSderekh_: I kind of want that page for all of my openstack projects now btw ;)16:06
*** ramishra has joined #tripleo16:06
derekh_SpamapS: I got no problem running it somewhere over more projects if we can find a place for the code to live16:07
*** ptippett is now known as ptippett[A]16:07
* ptippett[A] is now away - Reason : Auto-Away after 30 minutes16:07
*** chuckC has quit IRC16:08
openstackgerritA change was merged to openstack/tripleo-image-elements: base element for trove control plane elements  https://review.openstack.org/8260516:09
SpamapSderekh_: so we've had 9 zombie ACTIVE vms on R1 since Friday morning.16:10
*** deklan has joined #tripleo16:10
SpamapSderekh_: clarkb said something about needing to forcibly remove things in nodepool16:10
*** e0ne has quit IRC16:10
SpamapSderekh_: I'm going to focus on getting trusty deployable though. This tail chasing on mellanox is going nowhere.16:10
openstackgerritA change was merged to openstack/tripleo-image-elements: element for installing Trove-API service  https://review.openstack.org/8260616:12
derekh_SpamapS: ok, I'm not sure what I can do, I think we need some eyes on nodepool16:14
derekh_clarkb: ^ is there anything I can do to get the  tripleo-test-cloud provider running ?16:14
*** pblaho has quit IRC16:15
SpamapSslagle: hey, I was going to -1 https://review.openstack.org/#/c/82606/8 and suggest that trove should take advantage of passthrough for all of those config options.16:15
SpamapSderekh_: can you verify that instances booted in R1 become reachable?16:16
*** jistr has quit IRC16:16
SpamapSderekh_: I'm about to start booting trusty looking for answers on that undercloud.16:16
*** ramishra has quit IRC16:16
derekh_SpamapS: I was able to get a ssh response over the weekend, will try again now16:17
*** rdopieralski has quit IRC16:18
openstackgerritNicholas Randon proposed a change to openstack/tripleo-incubator: Export seed ip instead of gateway ip for keygen.  https://review.openstack.org/9421916:18
*** hashar has quit IRC16:21
*** jp_at_hp has quit IRC16:22
SpamapSderekh_: ok, as long as that is up I'm comfortable asking for nodepool to start using it again so we can get the queue flushed. If I can get trusty working today, I'd like to redeploy the overcloud w/ trusty.16:22
*** jp_at_hp has joined #tripleo16:24
*** newell_ has joined #tripleo16:26
*** rcarrill` has joined #tripleo16:28
NgSpamapS: are you doing the trusty stuff in the screen session? I'm curious to see and also am happy to throw peanuts from the gallery ;)16:28
SpamapSNg: what screen session?16:28
SpamapSNg: I'm still barred from the VPN16:28
SpamapSNg: not that I've tried to rectify that.16:28
SpamapSNg: no I'm doing it on the freecloud rack.16:28
Ngah, I meant the screen session on the other rack16:29
NgSpamapS: is there anything I can do to assist unbarring you from the VPN?16:29
*** rcarrillocruz has quit IRC16:30
*** chuckC has joined #tripleo16:31
SpamapSNg: get mordred to send that JIRA ticket.16:36
SpamapSmordred: send a JIRA ticket. and make me a sandwich.16:36
*** cody-somerville has quit IRC16:37
NgSpamapS: fwiw we don't need mordred for that16:38
Ngbut he can still make you a sandwich?16:38
*** dshulyak_ has joined #tripleo16:39
*** csd has joined #tripleo16:39
olaphSpamapS: just added your account to the 'VPN -All Users' group.  Try again in a few...16:40
*** cody-somerville has joined #tripleo16:40
*** cody-somerville has joined #tripleo16:40
*** morganfainberg_Z is now known as morganfainberg16:44
SpamapSolaph: \o/16:46
derekh_SpamapS: I tried 3 new instances first two failed, got ssh to 3rd16:47
*** cody-somerville has quit IRC16:48
*** matty_dubs|lunch is now known as matty_dubs16:51
*** martyntaylor has joined #tripleo16:51
*** derekh_ has quit IRC16:52
*** martyntaylor has left #tripleo16:59
*** dshulyak_ has quit IRC16:59
*** dshulyak_ has joined #tripleo17:00
*** killer_prince has quit IRC17:00
*** bnemec has joined #tripleo17:07
*** lucasagomes is now known as lucas-hungry17:14
slaglebnemec: any idea what's going on with the oslotest failure here: https://review.openstack.org/#/c/91561/ ?17:15
*** hashar has joined #tripleo17:17
*** ramishra has joined #tripleo17:17
*** chuckC has quit IRC17:18
*** ramishra has quit IRC17:18
bnemecslagle: It's probably because there's no stable branch for oslotest.  I proposed https://review.openstack.org/#/c/92910/ to disable it for now because I believe we're going to be automating the oslotest cross-testing anyway, so we should be able to address it then.17:19
*** rcarrill` is now known as rcarrillocruz17:19
slaglebnemec: ah, ok. thx17:19
*** julim has joined #tripleo17:21
*** dprince has quit IRC17:24
*** hashar has quit IRC17:25
*** morazi has quit IRC17:29
*** jerryz has joined #tripleo17:34
*** morazi has joined #tripleo17:34
*** athomas has quit IRC17:35
*** marun has joined #tripleo17:36
*** killer_prince has joined #tripleo17:40
*** lazy_prince has quit IRC17:40
*** nati_ueno has joined #tripleo17:49
*** saurabhs has joined #tripleo17:50
jp_at_hpIf any one can - https://review.openstack.org/#/c/88252 is desparately in need of review :(17:54
*** rcarrillocruz has quit IRC17:55
SpamapSjp_at_hp: w/ the summit, and CI being at 10% capacity, reviews are going to be behind for a few more days.17:56
SpamapSbecause zomg my brain is dead from 5 days of talking about OpenStack nonstop. :-P17:56
jp_at_hpSpamapS: If only it wasn't languishing *before* last week :(  I feel no core love :'(17:56
* jp_at_hp slaps himself to get it together17:57
jp_at_hpSpamapS: sure - I can hold on another week.  It's only time.  It's all temporal.17:57
* mordred hands jp_at_hp a wet cat with a label "core love" on it17:57
* jp_at_hp worries about why the cat is wet. But at least it isn't in a box.17:58
*** rcarrillocruz has joined #tripleo18:00
*** vinsh has quit IRC18:00
*** chuckC has joined #tripleo18:02
ShrewsSpamapS: openstack openstack openstack openstack... beer beer beer beer .... openstack openstack openstack18:07
Shrewsand i could go on18:07
ShrewsSpamapS: also, you are the devil18:08
gothicmindfoodSpamapS: don't forget the karaoke in between the last two beers18:09
*** julim has quit IRC18:11
*** julim has joined #tripleo18:13
SpamapSShrews: pleased to meet you18:15
SpamapSShrews: hope you guessed my name.18:15
Shrewswoo woo18:15
SpamapSgothicmindfood: have to remember it to forget it18:15
*** nati_ueno has quit IRC18:17
*** andreaf has quit IRC18:18
*** marun has quit IRC18:20
*** chuckC has quit IRC18:27
*** e0ne has joined #tripleo18:28
*** morazi has quit IRC18:29
*** eghobo has quit IRC18:29
*** nati_ueno has joined #tripleo18:32
*** pelix has quit IRC18:34
*** jp_at_hp has quit IRC18:35
*** cody-somerville has joined #tripleo18:37
*** cody-somerville has joined #tripleo18:37
*** lazy_prince has joined #tripleo18:42
*** chuckC has joined #tripleo18:43
*** rcarrill` has joined #tripleo18:48
openstackgerritOm Kumar proposed a change to openstack/diskimage-builder: Refactor code to select boot kernel  https://review.openstack.org/7987318:49
*** hashar has joined #tripleo18:50
*** rcarrillocruz has quit IRC18:51
*** andreaf has joined #tripleo18:55
openstackgerritOm Kumar proposed a change to openstack/tripleo-image-elements: Adds local storage Boot support in case PXE boot fails.  https://review.openstack.org/7928918:57
*** jang has joined #tripleo18:57
*** nati_uen_ has joined #tripleo18:59
*** eghobo has joined #tripleo18:59
*** nati_ueno has quit IRC19:02
*** ccrouch has quit IRC19:08
*** rcarrillocruz has joined #tripleo19:09
NgNobodyCam: I think you can abandon https://review.openstack.org/#/c/87296/ - trunk went a different route, but no longer blocks indefinitely19:10
*** rcarrill` has quit IRC19:10
*** cody-somerville has quit IRC19:19
*** vinsh has joined #tripleo19:23
SpamapSonce we get this trusty thing sorted..19:24
SpamapSI think it is time to tear down cd-undercloud and get some sweet ironic deploy sugar in there19:25
*** nati_uen_ has quit IRC19:26
*** nati_ueno has joined #tripleo19:26
*** dlfryar_ has joined #tripleo19:28
*** dlfryar has quit IRC19:29
*** dlfryar_ is now known as dlfryar19:29
*** marun has joined #tripleo19:31
adam_gwhat does /etc/network/interfaces looke like on first boot, prior to dhcp-all-interfaces running?19:36
*** eguz has joined #tripleo19:37
adam_gdah, nvm19:38
greghaynesadam_g: welcome back19:39
Nghey adam_g :)19:39
adam_ggreghaynes, thanks. you too :)19:39
*** cody-somerville has joined #tripleo19:40
*** cody-somerville has joined #tripleo19:40
*** nati_ueno has quit IRC19:41
*** ccrouch1 has joined #tripleo19:41
adam_gNg, \o19:41
*** eghobo has quit IRC19:41
greghaynesNg: SpamapS What are youalls takes on https://review.openstack.org/#/c/93039/519:43
greghaynesThere was a similar patch I saw youall comment on19:43
greghaynesoh wait, that just sets server-id... not as bad as I thought19:45
Nggreghaynes: yeah I'm not so opposed to this, especially as it makes the good point that we're almost certainly not triggering the old way anyway19:45
*** lazy_prince has quit IRC19:46
*** julim has quit IRC19:49
*** epim has joined #tripleo19:49
*** epim is now known as Penick19:50
*** julim has joined #tripleo19:53
*** jprovazn has quit IRC19:53
*** greghaynes has quit IRC19:53
*** gothicmindfood has quit IRC19:53
*** gothicmindfood has joined #tripleo19:54
*** ewindisch has quit IRC19:54
*** bkero has quit IRC19:54
Ngoh come on, middle of a review run and I can't route to *.openstack.org anymore19:54
Ngdear the universe, grrrrr, love Ng19:54
*** echohead1 has quit IRC19:54
*** jrist has quit IRC19:55
*** sdake has quit IRC19:55
*** tteggel has quit IRC19:55
*** cody-somerville has quit IRC19:55
*** tteggel has joined #tripleo19:55
*** jeremydei has quit IRC19:56
*** echohead_ has joined #tripleo19:56
*** dshulyak_ has quit IRC19:57
*** nati_ueno has joined #tripleo19:58
*** bkero has joined #tripleo19:59
*** jeremydei has joined #tripleo20:01
*** rlandy has quit IRC20:02
*** ewindisch has joined #tripleo20:03
*** jrist has joined #tripleo20:06
*** sdake has joined #tripleo20:07
*** cody-somerville has joined #tripleo20:08
*** cody-somerville has joined #tripleo20:08
*** greghaynes has joined #tripleo20:08
*** e0ne has quit IRC20:14
*** rbrady has quit IRC20:22
openstackgerritSaurabh Surana proposed a change to openstack/tripleo-image-elements: Provide a way to set user permission for rabbitmq users  https://review.openstack.org/9265920:25
*** akrivoka has quit IRC20:26
*** julim has quit IRC20:32
*** cody-somerville has quit IRC20:32
*** lazy_prince has joined #tripleo20:34
*** Hefeweizen has joined #tripleo20:35
*** rcarrill` has joined #tripleo20:39
openstackgerritOm Kumar proposed a change to openstack/diskimage-builder: Refactor code to select boot kernel  https://review.openstack.org/7987320:40
*** rcarrillocruz has quit IRC20:41
*** e0ne has joined #tripleo20:41
*** e0ne_ has joined #tripleo20:45
*** e0ne has quit IRC20:46
*** e0ne_ has quit IRC20:55
openstackgerritFlint Calvin proposed a change to openstack/tripleo-incubator: Adding the setting of CeilometerMeteringSecret in scripts/devtest_overcloud.sh so that the value of metering_secret gets set appropriately in /etc/ceilometer/ceilometer.conf on the management controller.  https://review.openstack.org/9420120:55
*** jang has quit IRC20:55
*** jdob has quit IRC20:59
*** yamahata has joined #tripleo20:59
*** untriaged-bot has joined #tripleo21:00
untriaged-botUntriaged bugs so far:21:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131998721:00
uvirtbotLaunchpad bug 1319987 in diskimage-builder "WHITELIST error" [Undecided,In progress]21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131744621:00
uvirtbotLaunchpad bug 1317446 in tripleo "Whitespace in SSLCertificate param causes jq error" [Undecided,In progress]21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131497821:00
uvirtbotLaunchpad bug 1314978 in tripleo "Cloud vm not pingable after overcloud upgrade " [Undecided,New]21:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131902721:00
uvirtbotLaunchpad bug 1319027 in diskimage-builder "dib install packages not document in the command help" [Undecided,New]21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131535521:00
uvirtbotLaunchpad bug 1315355 in tripleo "Upgrade of overcloud failed with "Connection to neutron failed: Maximum attempts reached"" [Undecided,New]21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131876721:00
uvirtbotLaunchpad bug 1318767 in tripleo "apache element SSL cert check fails" [Undecided,New]21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131947321:00
uvirtbotLaunchpad bug 1319473 in tripleo "devtest_testenv.sh doesn't honour overcloud_computescale or overcloud_controlscale" [Undecided,In progress]21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131705621:00
uvirtbotLaunchpad bug 1317056 in tripleo "Guest VM FS corruption after compute host reboot" [Critical,New]21:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131871721:00
uvirtbotLaunchpad bug 1318717 in diskimage-builder "image with rhel element can't be built if DIB_RHSM_* variables aren't set" [Undecided,In progress]21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131777821:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131667521:00
uvirtbotLaunchpad bug 1317778 in tripleo "Rabbit "guest from everywhere" should be reverted" [Undecided,New]21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/132009021:00
uvirtbotLaunchpad bug 1316675 in tripleo "Saving a devtest VM results in error" [Undecided,In progress]21:00
*** untriaged-bot has quit IRC21:00
uvirtbotLaunchpad bug 1320090 in tripleo "pxe_ephemeral_format': u'ext4 left on nodes after deploys deleted" [Undecided,New]21:00
*** rcarrillocruz has joined #tripleo21:05
*** rcarrill` has quit IRC21:07
*** sballe has joined #tripleo21:08
* SpamapS restarts tripleo-cd21:18
SpamapSwe'll see if those trusty baremetal machines start21:18
*** cd-undercloud has joined #tripleo21:19
cd-undercloud************** overcloud complete status=1 ************21:19
*** cd-undercloud has quit IRC21:19
adam_gSpamapS, has the d-a-i bug been affecting the gate as well?21:19
*** geerdest has joined #tripleo21:22
openstackgerritA change was merged to openstack/diskimage-builder: Add map-services for debian distros.  https://review.openstack.org/9178521:23
SpamapSadam_g: no21:24
SpamapSadam_g: tripleo-cd is an attempt to run an actual cloud from "always trunk everything" ;)21:25
openstackgerritA change was merged to openstack/tripleo-image-elements: Make nova-novncproxy usable in a public cloud.  https://review.openstack.org/8858921:25
SpamapSadam_g: it currently dies often because nova-bm fails to boot one of the boxes.21:25
SpamapSadam_g: so we've had it turned off21:25
*** matty_dubs is now known as matty_dubs|gone21:27
*** cd-undercloud has joined #tripleo21:28
cd-undercloud************** overcloud complete status=1 ************21:28
*** cd-undercloud has quit IRC21:28
SpamapSwell that was quick ;)21:30
*** Penick has quit IRC21:31
openstackgerritA change was merged to openstack/os-collect-config: Only top-level some deployment configs  https://review.openstack.org/9173321:36
*** lazy_prince has quit IRC21:48
NobodyCamNg: ack21:49
*** TravT has joined #tripleo21:52
*** jtomasek has quit IRC21:54
*** andreaf has quit IRC21:55
*** andreaf has joined #tripleo21:55
*** hashar has quit IRC21:57
*** chuckC has quit IRC21:59
*** Kiall has quit IRC21:59
openstackgerritFlint Calvin proposed a change to openstack/tripleo-incubator: Value of metering_secret needs to get set in /etc/ceilometer/ceilometer.conf.  https://review.openstack.org/9420122:08
*** TravT has quit IRC22:10
*** TravT has joined #tripleo22:11
*** peoplemerge has joined #tripleo22:14
*** peoplemerge has quit IRC22:15
*** peoplemerge has joined #tripleo22:18
*** peoplemerge has quit IRC22:18
*** ccrouch1 has quit IRC22:20
*** peoplemerge has joined #tripleo22:20
SpamapSlifeless: so, after about 15 boots of trusty on cd-undercloud, I can't reproduce the trusty lockup.22:21
lifelessSpamapS: hah22:22
lifelessSpamapS: what image are you booting ?22:22
SpamapSlifeless: trusty22:23
SpamapStrusty + lots22:23
SpamapStripleo-cd is using trusty22:23
SpamapSand is almost done on its first creation/boot22:23
lifelessSpamapS: I reproduced yesterday with a trusty undercloud image on the 405 rack22:23
SpamapSlifeless: Adam G has been trying too.. no dice.. trusty boots for him on the 405 rack22:24
SpamapSadam_g: right? ^^22:25
SpamapSlifeless: perhaps your reproduction yesterday didn't pull latest cloud image?22:25
SpamapSlifeless: note that new trusty images landed this morning.22:25
SpamapS0511 UTC22:26
lifelessSpamapS: building a new image now22:27
adam_glifeless, were you using the undercloud image currently in glance?22:28
*** ccrouch has joined #tripleo22:29
lifelessadam_g: I was using the undercloud image that is in the undercloud glance22:31
lifelessadam_g: you can see my vm22:32
lifeless'vm' haha - that I reproduced on22:32
lifelessin nova list22:32
lifelessI rebooted and started poking around log files22:32
adam_glifeless, hangtest?22:32
lifelessexactly22:32
lifelessit hung :)22:32
*** cd-undercloud has joined #tripleo22:33
cd-undercloud************** overcloud complete status=1 ************22:33
*** cd-undercloud has quit IRC22:33
lifelessloading the new image under a new name22:37
adam_ghmm. finally got one to trigger22:38
adam_give been cycling thru the unused nodes booting the undercloud image.22:38
SpamapS+ wait_for 30 10 neutron agent-list -f csv -c alive -c agent_type -c host '|' grep '":-).*Open vSwitch agent.*overcloud-novacompute"'22:38
SpamapSTiming out after 300 seconds:22:38
*** ptippett[A] has quit IRC22:39
SpamapShm22:39
SpamapSovs agents didn't start on computes22:39
SpamapScorrection22:40
SpamapSthey started22:40
SpamapSbut they're not registering themselves22:40
SpamapSor.. something like that22:41
* SpamapS scratches head22:41
stevebakerSpamapS: shiiiiiiiiii http://paste.openstack.org/show/80963/22:43
*** vinsh has quit IRC22:43
SpamapSstevebaker: json: can't hash with it, can't not hash it22:44
lifelessSpamapS: registration happens by db writes22:44
SpamapSlifeless: not RPC?22:44
lifelessSpamapS: possibly indirected by that, not 100% sure in the neutron case22:44
stevebakerSpamapS: looks like you'll need to parse before hashing22:44
SpamapSstevebaker: right, probably easier then to just do an equality check22:45
stevebakerSpamapS: yeah22:46
SpamapSstevebaker: thanks for looking into it. I was afraid it might be that. :-/22:47
stevebakerI was half expecting whitespace issues, but yeah22:47
*** yamahata has quit IRC22:47
tchaypogood morning!22:48
tchaypoStevenK: have you looked at the latest patch of https://review.openstack.org/#/c/92611/ ? based on comments from me it's gone back towards telling the user they need to set their own $TRIPLEO_ROOT22:50
tchaypobut I think it still has enough compatibility with your existing setup to keep you (and other existing devs) happy22:51
SpamapSstevebaker: probably has something to do with filtered out keys changing the dict order22:51
SpamapSthat, or sun spots22:51
stevebakerthe metadata is being set/updated via different paths, but so what. its weird22:52
SpamapSstevebaker: I recall some articles on a JSON equivalent that is always the same string representation if the data is the same..22:54
openstackgerritA change was merged to openstack/tripleo-image-elements: Make cinder-tgt/lio depend on cinder-volume  https://review.openstack.org/8488422:54
StevenKtchaypo: Reviewed, but I have some niggles.22:58
stevebakerSpamapS: could be weird interaction with the Json sqlalchemy type. I'll try taking copies of dicts when modifying22:59
*** chuckC has joined #tripleo23:00
*** deklan has quit IRC23:14
stevebakerSpamapS: I think I'm right, I have a fix23:16
lifelessstevebaker: so is that false-change thing landed now?23:16
stevebakerlifeless: the mitigation has. I'm about to propose a change which appears to fix the root issue23:17
stevebakerlifeless: but I wonder if occ should compare with dict equality rather than hashing anyway23:18
lifelessoh, WUT23:18
lifelesswe hash the serialised forms?23:18
SpamapSright23:18
SpamapSthats the bug23:18
lifelessAHHHHHHHHHHHHHHHHH23:18
SpamapStreating them as opaque strings rather than nicely manicured structural data that we can interpret23:18
SpamapSmeanwhile I've discovered keystoneclient has no on-disk file cache method23:19
SpamapSmemcached only23:20
SpamapS doh23:20
stevebakerhow about an on-disk store which uses the memcached api?23:20
SpamapSno I think the right thing to do is to move it to using dogpile23:21
SpamapSjust like keystone internally23:21
SpamapSand then let people configure the dogpile "region" to use for tokens23:21
SpamapSanyway.. time to fetch kids23:22
*** jogo_ is now known as jogo23:23
stevebakerlifeless, SpamapS: https://review.openstack.org/#/c/94283/ should make raw hashing work again23:23
*** lucas-hungry has quit IRC23:24
*** ptippett[A] has joined #tripleo23:26
*** matsuhashi has joined #tripleo23:27
lifelesscool23:30
lifelessadam_g: trying the latest image now to see23:31
adam_glifeless, if its the -latest one, ive already got it booted and hung23:31
adam_glifeless, the node /w ilo address .93 seems to hit the issue consistently with a fresh /etc/network/interfaces23:33
lifelessit is23:34
lifelesscool\23:34
*** weshay has quit IRC23:36
morganfainbergSpamapS, dogpile ++ let me know if you need help23:42
*** dlfryar has quit IRC23:45
*** chuckC has quit IRC23:49
*** chuckC has joined #tripleo23:50
*** chuckC has quit IRC23:54
* ptippett[A] is now away - Reason : Auto-Away after 30 minutes23:56
*** cd-undercloud has joined #tripleo23:57
cd-undercloud************** overcloud complete status=1 ************23:57
*** cd-undercloud has quit IRC23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!