Tuesday, 2014-05-13

*** yfaykya has quit IRC00:00
*** yfaykya has joined #tripleo00:01
*** yfaykya has quit IRC00:05
*** yfaykya has joined #tripleo00:07
*** yfaykya has quit IRC00:11
*** yfaykya has joined #tripleo00:13
*** yfaykya has quit IRC00:18
*** yfaykya has joined #tripleo00:19
*** yfaykya has quit IRC00:24
*** ramishra has joined #tripleo00:24
*** yfaykya has joined #tripleo00:25
*** yfaykya has quit IRC00:30
*** yfaykya has joined #tripleo00:31
*** lifeless has joined #tripleo00:31
*** yfaykya has quit IRC00:36
*** yfaykya has joined #tripleo00:37
*** yfaykya has quit IRC00:42
*** yfaykya has joined #tripleo00:43
*** killer_prince has quit IRC00:46
*** killer_prince has joined #tripleo00:47
*** yfaykya has quit IRC00:48
*** yfaykya has joined #tripleo00:50
*** killer_prince has quit IRC00:53
*** jpeeler has quit IRC00:54
*** yfaykya has quit IRC00:54
*** yfaykya has joined #tripleo00:56
*** giulivo has quit IRC00:58
*** yfaykya has quit IRC01:00
*** yfaykya has joined #tripleo01:02
*** yfaykya has quit IRC01:06
*** yfaykya has joined #tripleo01:08
*** yfaykya has quit IRC01:13
*** yfaykya has joined #tripleo01:14
*** julim has joined #tripleo01:15
*** sseago has quit IRC01:18
*** yfaykya has quit IRC01:19
*** yfaykya has joined #tripleo01:20
*** yfaykya has quit IRC01:25
*** yfaykya has joined #tripleo01:26
*** ramishra has quit IRC01:28
*** yfaykya has quit IRC01:31
*** yfaykya has joined #tripleo01:33
*** yfaykya has quit IRC01:37
*** yfaykya has joined #tripleo01:39
*** yfaykya has quit IRC01:44
*** yfaykya has joined #tripleo01:45
*** jang1 has joined #tripleo01:49
*** yfaykya has quit IRC01:50
*** nosnos has joined #tripleo01:50
*** yfaykya has joined #tripleo01:51
*** yfaykya has quit IRC01:56
*** yfaykya has joined #tripleo01:57
*** yfaykya has quit IRC02:01
*** yfaykya has joined #tripleo02:03
*** yfaykya has quit IRC02:07
*** yfaykya has joined #tripleo02:09
*** noslzzp has quit IRC02:13
*** yfaykya has quit IRC02:14
*** yfaykya has joined #tripleo02:15
*** yfaykya has quit IRC02:20
*** yfaykya has joined #tripleo02:22
*** yfaykya has quit IRC02:26
*** yfaykya has joined #tripleo02:28
*** yfaykya has quit IRC02:33
*** yfaykya has joined #tripleo02:34
*** jang1 has quit IRC02:34
*** jang1 has joined #tripleo02:37
*** andreaf has joined #tripleo02:37
*** ramishra has joined #tripleo02:39
*** yfaykya has quit IRC02:39
*** yfaykya has joined #tripleo02:40
*** ramishra has quit IRC02:43
*** yfaykya has quit IRC02:44
*** yfaykya has joined #tripleo02:46
*** yfaykya has quit IRC02:50
*** yfaykya has joined #tripleo02:52
*** yfaykya has quit IRC02:56
*** yfaykya has joined #tripleo02:58
*** andreaf_ has joined #tripleo02:59
*** untriaged-bot has joined #tripleo03:00
untriaged-botUntriaged bugs so far:03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131876703:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131744603:00
uvirtbotLaunchpad bug 1318767 in tripleo "apache element SSL cert check fails" [Undecided,New]03:00
uvirtbotLaunchpad bug 1317446 in tripleo "Whitespace in SSLCertificate param causes jq error" [Undecided,In progress]03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131497803:00
uvirtbotLaunchpad bug 1314978 in tripleo "Cloud vm not pingable after overcloud upgrade " [Undecided,New]03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131535503:00
uvirtbotLaunchpad bug 1315355 in tripleo "Upgrade of overcloud failed with "Connection to neutron failed: Maximum attempts reached"" [Undecided,New]03:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131871703:00
uvirtbotLaunchpad bug 1318717 in diskimage-builder "image with rhel element can't be built if DIB_RHSM_* variables aren't set" [Undecided,New]03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131777803:00
uvirtbotLaunchpad bug 1317778 in tripleo "Rabbit "guest from everywhere" should be reverted" [Undecided,New]03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131667503:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131705603:00
uvirtbotLaunchpad bug 1316675 in tripleo "Saving a devtest VM results in error" [Undecided,In progress]03:00
*** untriaged-bot has quit IRC03:00
uvirtbotLaunchpad bug 1317056 in tripleo "Guest VM FS corruption after compute host reboot" [Undecided,New]03:00
*** yfaykya has quit IRC03:03
*** andreaf has quit IRC03:03
*** yfaykya has joined #tripleo03:04
*** yfaykya has quit IRC03:09
*** Antonio1 has joined #tripleo03:10
Antonio1n03:10
Antonio1n03:10
Antonio1n03:10
*** yfaykya has joined #tripleo03:10
Antonio1j jnlnlknlkn03:11
Antonio1io¡: n03:11
Antonio1(22:37:23) ¡Antonio¡: n03:11
Antonio1(22:37:24) ¡Antonio¡: n03:11
Antonio1(22:37:44) yfaykya [~shabba@skynet.skynet.ie] ha entrado en la sala.03:11
Antonio1(22:38:00) ¡Antonio¡: j jnlnlknlkn03:11
*** Antonio1 has left #tripleo03:11
*** yfaykya has quit IRC03:15
*** yfaykya has joined #tripleo03:17
*** yfaykya has quit IRC03:21
*** yfaykya has joined #tripleo03:23
*** jang1 has quit IRC03:25
*** yfaykya has quit IRC03:27
*** yamahata has joined #tripleo03:27
*** yfaykya has joined #tripleo03:29
*** andreaf_ has quit IRC03:32
*** yfaykya has quit IRC03:33
*** yfaykya has joined #tripleo03:35
*** sseago has joined #tripleo03:39
*** yfaykya has quit IRC03:40
*** julim has quit IRC03:41
*** yfaykya has joined #tripleo03:41
*** nosnos has quit IRC03:42
*** yfaykya has quit IRC03:46
openstackgerritDirk Mueller proposed a change to openstack/tuskar: Default to keystone auth strategy  https://review.openstack.org/9337003:47
*** yfaykya has joined #tripleo03:47
*** akuznetsov has quit IRC03:47
*** yfaykya has quit IRC03:52
*** yfaykya has joined #tripleo03:53
*** yfaykya has quit IRC03:58
*** yfaykya has joined #tripleo03:59
GheRivero_Ng: greghaynes: lifeless: @all the undercloud is now booting (without Ng's patch. will test later)04:12
*** GheRivero_ is now known as GheRivero04:12
GheRiverothe issue was a missing iptables rule in the seed to reach the metadata server, so the cloud-init in the undercloud didn't like it04:13
Nghuh04:14
GheRiverowow! someone is awake :)04:14
NgI shouldn't be awake :)04:14
GheRiveroNg: you can go now to bed. Your patch passed it flawlessly04:24
* GheRivero crashes for today04:27
NgGheRivero: awesome, thanks very much for the testing!04:27
*** nosnos has joined #tripleo04:48
*** yamahata has quit IRC05:20
*** dshulyak_ has joined #tripleo05:20
*** cody-somerville has joined #tripleo05:24
*** d0ugal has quit IRC05:25
*** rakesh_hs has joined #tripleo05:44
*** d0ugal has joined #tripleo06:00
*** dshulyak_ has quit IRC06:16
*** geertj has joined #tripleo06:41
*** ifarkas has joined #tripleo06:42
*** cody-somerville has quit IRC06:52
*** gcha has joined #tripleo06:56
*** pblaho has joined #tripleo06:58
*** AaronGr has quit IRC07:08
*** jtomasek has joined #tripleo07:09
*** AaronGr has joined #tripleo07:14
openstackgerritDmitry Shulyak proposed a change to openstack/tripleo-image-elements: Allow services ports configuration  https://review.openstack.org/9255007:43
*** e0ne has joined #tripleo07:56
*** jprovazn has joined #tripleo08:00
*** gcha has quit IRC08:03
openstackgerritIvan Berezovskiy proposed a change to openstack/diskimage-builder: Export unbound variable DIB_RHSM_USER  https://review.openstack.org/9338708:03
*** darraghb has joined #tripleo08:08
*** giulivo has joined #tripleo08:13
*** akuznetsov has joined #tripleo08:22
*** gcha has joined #tripleo08:27
*** rlandy has joined #tripleo08:37
*** martyntaylor has joined #tripleo08:41
*** randonn has quit IRC08:42
*** randonn has joined #tripleo08:42
*** randonn has quit IRC08:47
*** randonn has joined #tripleo08:48
openstackgerritNicholas Randon proposed a change to openstack/tripleo-heat-templates: Move to software-config for the undercloud.  https://review.openstack.org/9331908:48
*** akuznetsov has quit IRC08:51
*** akuznetsov has joined #tripleo08:51
*** e0ne has quit IRC08:54
*** dkehn__ has joined #tripleo08:54
*** e0ne has joined #tripleo08:55
*** dkehn_ has quit IRC08:57
*** e0ne has quit IRC08:59
*** e0ne has joined #tripleo08:59
*** untriaged-bot has joined #tripleo09:01
untriaged-botUntriaged bugs so far:09:01
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131876709:01
uvirtbotLaunchpad bug 1318767 in tripleo "apache element SSL cert check fails" [Undecided,New]09:01
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131744609:01
uvirtbotLaunchpad bug 1317446 in tripleo "Whitespace in SSLCertificate param causes jq error" [Undecided,In progress]09:01
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131497809:01
uvirtbotLaunchpad bug 1314978 in tripleo "Cloud vm not pingable after overcloud upgrade " [Undecided,New]09:01
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131535509:01
uvirtbotLaunchpad bug 1315355 in tripleo "Upgrade of overcloud failed with "Connection to neutron failed: Maximum attempts reached"" [Undecided,New]09:01
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131871709:01
uvirtbotLaunchpad bug 1318717 in diskimage-builder "image with rhel element can't be built if DIB_RHSM_* variables aren't set" [Undecided,In progress]09:01
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131777809:01
uvirtbotLaunchpad bug 1317778 in tripleo "Rabbit "guest from everywhere" should be reverted" [Undecided,New]09:01
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131667509:01
uvirtbotLaunchpad bug 1316675 in tripleo "Saving a devtest VM results in error" [Undecided,In progress]09:01
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131705609:01
uvirtbotLaunchpad bug 1317056 in tripleo "Guest VM FS corruption after compute host reboot" [Undecided,New]09:01
*** untriaged-bot has quit IRC09:01
*** e0ne has quit IRC09:03
*** e0ne has joined #tripleo09:04
*** jang1 has joined #tripleo09:24
*** randonn has quit IRC09:30
*** jp_at_hp has joined #tripleo09:44
*** gcha_ has joined #tripleo09:57
*** gcha has quit IRC10:00
*** gcha_ has quit IRC10:00
openstackgerritAlexis Lee proposed a change to openstack/tripleo-image-elements: Add elasticsearch element  https://review.openstack.org/9340710:06
openstackgerritAlexis Lee proposed a change to openstack/tripleo-image-elements: Add logstash element  https://review.openstack.org/9340810:06
*** akrivoka_ has joined #tripleo10:16
*** e0ne has quit IRC10:25
*** e0ne has joined #tripleo10:26
*** geertj has quit IRC10:29
dshulyakanybody tried to deploy from recent master locally?10:51
dshulyaknova cant ssh to pm_addr from udnercloud10:52
*** akrivoka_ has quit IRC10:58
*** yamahata has joined #tripleo11:00
openstackgerritLoganathan Parthipan proposed a change to openstack/tripleo-incubator: scripts to persist a running devtest to disk  https://review.openstack.org/9257511:07
openstackgerritDirk Mueller proposed a change to openstack/tuskar: Default to keystone auth strategy  https://review.openstack.org/9337011:15
*** jang1 has quit IRC11:20
*** andreaf has joined #tripleo11:26
*** andreaf has quit IRC11:26
greghaynesGheRivero: !11:51
greghaynesGheRivero: w00t!11:51
*** yamahata has quit IRC11:56
GheRiveromorning all11:57
lxsliGheRivero: morning, take a look at this please? https://review.openstack.org/#/c/93407/11:58
*** geertj has joined #tripleo12:01
*** jpeeler has joined #tripleo12:19
*** jpeeler has joined #tripleo12:19
lifelesso/12:29
openstackgerritDmitry Shulyak proposed a change to openstack/tripleo-incubator: Add Power params for undercloud ssh access  https://review.openstack.org/9342712:33
openstackgerritDmitry Shulyak proposed a change to openstack/tripleo-incubator: Add Power params for undercloud ssh access  https://review.openstack.org/9342712:34
*** gcha has joined #tripleo12:35
openstackgerritVictor Sergeyev proposed a change to openstack/tripleo-incubator: Fixes for manual installation  https://review.openstack.org/8795512:45
openstackgerritDmitry Shulyak proposed a change to openstack/tripleo-incubator: Add Power params for undercloud ssh access  https://review.openstack.org/9342712:46
openstackgerritAna Krivokapic proposed a change to openstack/tuskar-ui: Add performance charts to node details page  https://review.openstack.org/8641312:51
*** e0ne has quit IRC12:51
*** pblaho has quit IRC12:52
*** e0ne has joined #tripleo12:52
*** rbrady has joined #tripleo12:59
*** sseago has quit IRC13:00
*** nosnos has quit IRC13:05
openstackgerritA change was merged to openstack/tripleo-incubator: Minor spelling & grammatical improvements  https://review.openstack.org/9329813:08
*** lazy_prince has joined #tripleo13:16
*** e0ne has quit IRC13:27
*** e0ne has joined #tripleo13:28
*** sseago has joined #tripleo13:40
*** ifarkas has quit IRC13:43
*** julim has joined #tripleo13:50
*** lazy_prince has quit IRC13:54
*** julim has quit IRC13:57
*** ramishra has joined #tripleo13:59
openstackgerritIvan Berezovskiy proposed a change to openstack/diskimage-builder: Rename old image file instead of rewrite it  https://review.openstack.org/9343914:04
*** ramishra has quit IRC14:05
*** eghobo has joined #tripleo14:05
*** eghobo has quit IRC14:14
*** rbrady has quit IRC14:15
*** jprovazn has quit IRC14:20
openstackgerritNicholas Randon proposed a change to openstack/tripleo-heat-templates: Add passthrough configuration glue.  https://review.openstack.org/9181014:21
openstackgerritNicholas Randon proposed a change to openstack/tripleo-heat-templates: Move to software-config for the undercloud.  https://review.openstack.org/9331914:27
openstackgerritNicholas Randon proposed a change to openstack/tripleo-heat-templates: Add passthrough configuration glue.  https://review.openstack.org/9181014:28
*** hashar has joined #tripleo14:32
*** rakesh_hs has quit IRC14:38
openstackgerritErik Colnick proposed a change to openstack/tripleo-image-elements: Enable neutron.conf passthrough configuration  https://review.openstack.org/9345114:38
*** dshulyak has quit IRC14:51
openstackgerritNicholas Randon proposed a change to openstack/tripleo-incubator: Separate Heat BM and VM configs for Nova-BM.  https://review.openstack.org/9003314:52
*** dshulyak has joined #tripleo14:53
*** EntropyWorks has joined #tripleo14:54
*** jcooley has joined #tripleo14:55
openstackgerritChris Krelle proposed a change to openstack/tripleo-image-elements: Adjust rpc thread pool for Ironic  https://review.openstack.org/9346314:59
*** untriaged-bot has joined #tripleo15:00
untriaged-botUntriaged bugs so far:15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131876715:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131744615:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131497815:00
uvirtbotLaunchpad bug 1318767 in tripleo "apache element SSL cert check fails" [Undecided,New]15:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131902715:00
uvirtbotLaunchpad bug 1317446 in tripleo "Whitespace in SSLCertificate param causes jq error" [Undecided,In progress]15:00
uvirtbotLaunchpad bug 1314978 in tripleo "Cloud vm not pingable after overcloud upgrade " [Undecided,New]15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131535515:00
uvirtbotLaunchpad bug 1319027 in diskimage-builder "dib install packages not document in the command help" [Undecided,New]15:00
uvirtbotLaunchpad bug 1315355 in tripleo "Upgrade of overcloud failed with "Connection to neutron failed: Maximum attempts reached"" [Undecided,New]15:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131871715:00
uvirtbotLaunchpad bug 1318717 in diskimage-builder "image with rhel element can't be built if DIB_RHSM_* variables aren't set" [Undecided,In progress]15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131777815:00
uvirtbotLaunchpad bug 1317778 in tripleo "Rabbit "guest from everywhere" should be reverted" [Undecided,New]15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131667515:00
uvirtbotLaunchpad bug 1316675 in tripleo "Saving a devtest VM results in error" [Undecided,In progress]15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131705615:00
uvirtbotLaunchpad bug 1317056 in tripleo "Guest VM FS corruption after compute host reboot" [Undecided,New]15:00
*** untriaged-bot has quit IRC15:00
*** rbrady has joined #tripleo15:03
openstackgerritDmitry Shulyak proposed a change to openstack/tripleo-image-elements: Allow services ports configuration  https://review.openstack.org/9255015:04
*** morganfainberg_Z is now known as morganfainberg15:12
StevenKmorganfainberg: Hm, you looked rather awake during the meeting :-P15:12
morganfainbergStevenK, Lots of caffiene will do that!15:13
StevenKHaha15:13
openstackgerritErik Colnick proposed a change to openstack/tripleo-image-elements: Enable neutron.conf passthrough configuration  https://review.openstack.org/9345115:13
*** rbrady has quit IRC15:15
*** EntropyWorks has quit IRC15:20
*** jcooley has quit IRC15:20
SpamapS"Juju will integrate with Heat" ... _interesting_15:20
*** EntropyWorks has joined #tripleo15:21
*** jcooley has joined #tripleo15:21
*** jcooley has quit IRC15:22
*** EntropyWorks has quit IRC15:22
greghaynesSpamapS: Hai, so youre here too ;)15:22
*** morganfainberg is now known as morganfainberg_Z15:23
*** morganfainberg_Z is now known as morganfainberg15:25
*** EntropyWorks has joined #tripleo15:25
*** EntropyWorks has quit IRC15:26
*** EntropyWorks has joined #tripleo15:27
*** jcooley has joined #tripleo15:27
*** julim has joined #tripleo15:28
*** lazy_prince has joined #tripleo15:28
*** e0ne has quit IRC15:29
*** e0ne has joined #tripleo15:29
GheRivero2014-05-13 15:28:07.624 6108 CRITICAL nova [-] ImportError: No module named ironic.nova.scheduler.ironic_host_manager15:31
greghayneswah15:32
GheRiveroironic is not a dep in nova, so is not installed in its venv.... (I though the ironic element took care of that)15:33
StevenKI see the design summit rooms are set to artic winter15:36
*** martyntaylor has left #tripleo15:36
morganfainbergStevenK, yeah.15:43
*** julim has quit IRC15:45
lifelessthis is what you're debugging on 405? + os-svc-restart -n nova-scheduler15:46
lifelessstop: Unknown instance:15:46
lifelessstart: Job failed to start15:46
lifeless[2014-05-13 15:45:19,967] (os-refresh-config) [ERROR] during post-configure phase. [Command '['dib-run-parts', '/opt/stack/os-config-refresh/post-configure.d']' returned non-zero exit status 1]15:46
lifelessGheRivero: the seed worked15:46
lifelessGheRivero: we can check the image cmomand line params for this question15:47
GheRiverothe error is on undercloud15:47
lifelessGheRivero: ubuntu -a amd64 -o /home/cetest/undercloud ntp baremetal boot-stack os-collect-config dhcp-all-interfaces neutron-dhcp-agent stackuser pypi -u --offline use-ephemeral mellanox use-ephemeral rabbitmq-server15:47
lifelessGheRivero: ^ thats what it was built with.15:47
lifelessGheRivero: I think someone rebuilt the images I'd prepped.15:47
lifelessGheRivero: I'll clear things out and respin; give me a sec15:48
GheRiverolifeless: cool15:48
openstackgerritMichael Tupitsyn proposed a change to openstack/tripleo-image-elements: Passthrough-enable keystone.conf.  https://review.openstack.org/9162515:48
greghayneshrm, so removing the metadata API iptables rule on my seed and deploying undercloud (with trusty) the undercloud times out in cloud-init....15:48
greghaynesnot sure what was different for us15:49
lifelessGheRivero: devtest.sh --build-only --existing-environment --trash-my-machine ftw15:49
lifelessgreghaynes: right, which would cause 'failed to come up' symptoms15:49
greghaynesYes... maybe we just werent being patient enough but previously we were seeing network interfaces attempt to come up and then it would just hang.... no timeout15:50
lifelessso the net hang thing is real15:51
lifelessI speculate it wasn't the cause of the utter fail here :)15:51
lifelessgreghaynes: any idea why the rule hadn't come up?15:51
greghaynesagreed.15:51
GheRiverolifeless: I though that the devtest.sh will trash all the network configuration on the machine15:51
lifelessGheRivero: see --existing-environment15:52
lifelessGheRivero: + --build-only15:52
greghayneslifeless: No idea. Do you know who actually is responsible for adding it? greping tripleo for DNAT resulted in nothing but a line in docs saying to add that rule15:52
GheRiverolifeless: ouch!15:53
*** noslzzp has joined #tripleo15:53
GheRiverogreghaynes: I would say nova-network15:54
greghaynesIn other news, it only required 2 ssh tunnels to vnc to my undercloud thanks to the port blocking on the wifi15:56
GheRiveroin neutron it should be the agent the one adding the rule15:59
*** nati_ueno has joined #tripleo15:59
*** d0ugal has quit IRC15:59
*** noslzzp has quit IRC15:59
lifelessgreghaynes: ./elements/nova-ironic/os-refresh-config/configure.d/81-nat-metadata:iptables16:02
*** nati_ueno has quit IRC16:03
*** nati_ueno has joined #tripleo16:03
greghaynesoh, -j REDIRECT16:04
*** gcha has quit IRC16:04
greghaynesfancy16:04
*** morganfainberg is now known as morganfainberg_Z16:07
*** morganfainberg_Z is now known as morganfainberg16:08
*** dshulyak_ has joined #tripleo16:09
*** gothicmindfood has joined #tripleo16:09
*** e0ne has quit IRC16:15
*** e0ne has joined #tripleo16:16
openstackgerritAna Krivokapic proposed a change to openstack/tuskar-ui: Use python -m coverage.__main__ to invoke coverage  https://review.openstack.org/9347416:16
*** jp_at_hp has quit IRC16:18
*** jp_at_hp has joined #tripleo16:19
lifelesscp: cannot open '/tmp/image.YHcV6J0N/mnt/tmp/kernel' for reading: Permission denied16:20
lifelessbuilding images!16:21
tchaypogreghaynes: this is when serial console would be megahandy16:21
tchaypolifeless: did you turn it off and on again?16:21
lifelesstchaypo: hmm ?16:22
lifelessits failign in /tmp/image.YHcV6J0N/hooks/cleanup.d/99-extract-ramdisk-files16:22
lifelessNuts, I thought I had a fix already16:23
GheRiveroweird16:23
*** morazi has joined #tripleo16:23
lifelessI did, I'd stashed it'16:25
StevenKlifeless: Is it something that we should polish and land?16:26
openstackgerritlifeless proposed a change to openstack/diskimage-builder: Ensure we can read the kernel out.  https://review.openstack.org/9347516:26
tchaypodid you stash it and pop it again?16:26
lifelesstchaypo: No, I locked it16:26
StevenK-rw------- 1 root root 5.6M May  2 20:30 vmlinuz-3.13.0-24-generic16:27
StevenKHuh16:27
tchaypoAh, pop and lock? I didn't raelise you did breakdancing16:27
tchaypoStevenK: Trusty!16:27
* StevenK ssh's across an ocean16:28
lifelesstchaypo: then I broke it down16:28
GheRiverolifeless: shouldn't we sudoing the cp instead of changing the perms?16:28
lifelessGheRivero: no because if we do we can't then use it locally :)16:28
tchaypoStevenK: or was that saucy? either way it's an ubuntuism16:29
lifelessGheRivero: my first attempt to fix it indeed did that.16:29
GheRiveroand changing them in locally16:29
StevenKEr, but then you need sudo for the chmod anyway?16:29
lifelessStevenK: sude is in the chroot16:29
Nghuh, I thought we'd previously hit the stupid kernel permissions thing and fixed it16:29
Nglike, months ago16:29
GheRiveroNg: I also have the same dejavu16:29
StevenKtchaypo: I don't have anything but Ubuntu, and everything everywhere is 600 for the kernel16:29
tchaypoyeah, I think that's how I know about it16:30
StevenKLike I went and checked a Precise machune16:30
StevenK*machine16:30
tchayposo it seems odd to me that StevenK only just seems to be noticing this for the first time16:30
lifelessI don't fundamentally care, but this is one sudo, and a sudo cp + sudo chown later seems overkill16:30
lifelessoh, this is outside the chroot, but same diff - one call vs several16:30
lifelessNg: indeed, and yet.16:30
*** nati_ueno has quit IRC16:31
Ngreality defeats collective deja vu :(16:31
Ngpesky reality16:31
StevenKHaha16:31
StevenKlifeless: So I don't really care if it's sudo chmod versus sudo cp, TBH. Let me +1 the patch16:31
lifelessok, undercloud deploy kicking off16:34
StevenKlifeless: https://review.openstack.org/93304 btw16:34
greghaynesGheRivero: so was the -j REDIRECT rule in iptables already and you swapped it for the -j DNAT one?16:34
*** rlandy has quit IRC16:34
greghaynesor was there just no nat rule?16:34
GheRiverogreghaynes: there was not rule at all. no redirect, no dnat16:35
openstackgerritJames Polley proposed a change to openstack/tripleo-incubator: Add a link to tripleo-newdev-notes  https://review.openstack.org/9294416:35
greghayneshuh. os-c-c says it ran that :/16:35
*** hashar has quit IRC16:36
greghaynesI do see it doing a bunch of stuff on BOOTSTACK_MASQ_NEW that fail due to not making that chain first.. but AFAICT just a red herring16:37
GheRiverolet's see was the iptables state after deploying a new seed16:38
greghayneser, sorry, the BOOTSTACK_MASQ chain16:38
greghaynesyea, I just didnt want to blast away the seed if youall are underclouding16:38
greghaynesbut if you want to plzdo16:38
*** shakayumi has joined #tripleo16:39
GheRiveroI think lifeless is rebuilding all the images again16:39
greghaynesyea, so probably good to wait16:39
*** shakayumi has joined #tripleo16:40
*** shakayumi has quit IRC16:40
greghaynesalso, noms16:41
StevenKTrapped in Ironic16:42
StevenKWell. Trapped by jogo_ in ironic16:42
lifelessI rebuilt them all, tor the undercloud down and its spinning up now16:44
*** nati_ueno has joined #tripleo16:44
openstackgerritJames Polley proposed a change to openstack/tripleo-incubator: Add details of which OS releases are tested in CI  https://review.openstack.org/9274916:44
StevenKtchaypo: Again?16:44
tchaypoStevenK: Yerp.16:46
tchaypothose two changes are related - we do have some mention of which releases we suggest people use, but some people don't see it; this adds a bit more specificity and adds a link so it's more discoverable16:47
tchaypobecause docs that aren't discoverable don't exist16:47
tchaypoalso, it's lunchtime.16:47
*** morazi has quit IRC16:47
*** morganfainberg is now known as morganfainberg_Z16:48
*** lazy_prince has quit IRC16:49
tchayposee you down there?16:50
openstackgerritJon-Paul Sullivan (jp_at_hp) proposed a change to openstack/tripleo-incubator: Enable selective dib configuration per image  https://review.openstack.org/8500916:50
lifelessMonitor is in graphics mode or an unsupported text mode. aarrgghh16:53
*** eghobo has joined #tripleo16:54
*** eghobo has quit IRC16:55
*** eghobo has joined #tripleo16:55
lifelessexport no_proxy=16:58
lifelessok, new image does + os-svc-restart -n nova-scheduler17:01
lifelessstop: Unknown instance:17:01
lifelessstart: Job failed to start17:01
lifelesstoo17:01
lifelessubuntu -a amd64 -o /home/cetest/undercloud ntp baremetal boot-stack os-collect-config dhcp-all-interfaces neutron-dhcp-agent stackuser pypi -u --offline use-ephemeral mellanox use-ephemeral rabbitmq-server again17:02
lifelessI think an ironic regression in devtest_und17:03
*** e0ne has quit IRC17:03
*** eghobo has quit IRC17:05
*** eghobo has joined #tripleo17:05
*** nati_ueno has quit IRC17:13
*** nati_ueno has joined #tripleo17:13
*** marun has joined #tripleo17:16
*** nati_ueno has quit IRC17:18
*** newell_ has joined #tripleo17:23
*** nati_ueno has joined #tripleo17:24
StevenKGheRivero: So I can see that Ubuntu has mode 600 kernels, but I don't know what RHEL/SuSE all do17:29
*** eghobo has quit IRC17:38
GheRiverolifeless: the graphics text mode in ilo is cause I tweaked the pxe extra params and added --verbose and --debug to it17:44
GheRiveroStevenK: don't know either. But yes, maybe too much overhead for a simple copy17:48
lifelessGheRivero: ah17:49
lifelessGheRivero: so looking for the bad image params bug now17:49
openstackgerritVictor Lowther proposed a change to openstack/diskimage-builder: Make diskimage-builder work in Docker.  https://review.openstack.org/9056017:51
*** geertj has quit IRC17:52
*** ramishra has joined #tripleo17:53
*** marun has quit IRC17:55
*** nati_ueno has quit IRC17:55
openstackgerritNicholas Randon proposed a change to openstack/tripleo-heat-templates: Move to software-config for the undercloud.  https://review.openstack.org/9331917:56
*** julim has joined #tripleo17:56
openstackgerritNicholas Randon proposed a change to openstack/tripleo-heat-templates: Add passthrough configuration glue.  https://review.openstack.org/9181017:57
*** cody-somerville has joined #tripleo17:58
*** ramishra has quit IRC17:59
*** morganfainberg_Z is now known as morganfainberg18:13
*** rcarrill` has quit IRC18:18
*** nati_ueno has joined #tripleo18:18
*** chuckC has joined #tripleo18:23
*** rcarrillocruz has joined #tripleo18:23
*** darraghb has quit IRC18:24
*** geertj has joined #tripleo18:24
*** noslzzp has joined #tripleo18:24
openstackgerritErik Colnick proposed a change to openstack/tripleo-image-elements: Enable additional neutron passthrough configuration  https://review.openstack.org/9348218:34
lifelessany progress?18:36
*** morganfainberg is now known as morganfainberg_Z18:37
greghaynesNo idea why that rule wasnt in iptables - would redeploying the seed totally ruin your work?18:37
*** julim has quit IRC18:37
lifelessgreghaynes: no, go ahead18:37
lifelessgreghaynes: use USE_CACHE=1 to avoid rebuilding images :)18:37
openstackgerritErik Colnick proposed a change to openstack/tripleo-image-elements: Enable additional neutron passthrough configuration  https://review.openstack.org/9348218:38
lifelessgreghaynes: (and use window 0 in screen for that ;))18:39
lifelessgreghaynes: would you lke me to ?18:39
greghaynesyep, ill watch18:39
*** noslzzp has quit IRC18:41
greghaynesoh. well thats easy enoug18:41
*** chuckC has quit IRC18:41
greghaynesenough, rather18:41
lifeless:)18:41
*** lazy_prince has joined #tripleo18:42
*** geertj has quit IRC18:43
*** nati_ueno has quit IRC18:44
*** lazy_prince has quit IRC18:47
greghayneslifeless: so... its there18:47
*** lazy_prince has joined #tripleo18:47
greghaynesIt *is* a redirect rule, which is different than the one that was added18:47
*** cian__ has joined #tripleo18:49
greghaynesso probably deploy undercloud now, and ill debug if theres some bug with that rule versus the DNAT which GheRivero added18:49
*** cian_ has quit IRC18:49
*** julim has joined #tripleo18:51
lifelessok18:51
lifelessbut18:51
lifelesswe need to fix the image build18:51
lifelessits not adding the ironic element18:52
GheRiveroI hate moving around rooms. The vpn goes down :(18:52
greghaynesTo the undercloud? That code is pretty simple...18:54
*** rcarrill` has joined #tripleo18:54
lifelessgreghaynes: http://paste.openstack.org/show/80259/18:54
lifelesssee how the ironic element disappears18:55
lifelessGheRivero: I have my vpn running from a VM somewhere safe. And on wired network :)18:55
greghaynesooo thats a good idea18:55
SpamapSwhuzzah18:55
GheRiveroMy hpcloud bill will be huge the day I have to pay for it18:56
*** rcarrillocruz has quit IRC18:56
greghaynesoh. how did that get past review18:57
greghaynestheres a missing \18:57
greghaynesoh, nvm. gah my font color is blending in my bg18:57
lifelessso nova-ironic is there18:58
*** chuckC has joined #tripleo18:58
*** jtomasek has quit IRC18:59
lifelessgreghaynes: http://paste.openstack.org/show/80260/ more details19:00
lifelesstransitive dependencies are broken in dib19:00
lifelesslook for 'ironic'19:00
lifelessI bet it is19:01
lifelessc357ca66340ca7ec81f6cac584b006e543847ed719:01
SpamapSlifeless: are you @ the pod?19:03
lifelessno I'm in the ironic session19:03
lifelessc3 is faulty19:03
lifelessfiling bug19:03
StevenKlifeless: Do you want me to revert it?19:04
greghaynesa test!19:04
greghayneswould be wonderful19:04
StevenKWould be wonderful if I revert and review?19:04
*** dshulyak_ has quit IRC19:05
StevenKlifeless: I have a revert, do you have a bug I can link to the commit ?19:06
*** jtomasek has joined #tripleo19:07
lifelesswe may need to fix it, since it was added to fix a bug. But - https://bugs.launchpad.net/diskimage-builder/+bug/131915219:09
uvirtbotLaunchpad bug 1319152 in diskimage-builder "regression in dependency expansion" [Critical,Triaged]19:09
*** akrivoka has quit IRC19:11
openstackgerritJon-Paul Sullivan (jp_at_hp) proposed a change to openstack/tripleo-incubator: Add HEAT_UNDERCLOUD_EXTRA_OPTS back  https://review.openstack.org/9348819:12
openstackgerritJon-Paul Sullivan (jp_at_hp) proposed a change to openstack/tripleo-incubator: Add HEAT_UNDERCLOUD_EXTRA_OPTS back  https://review.openstack.org/9348819:15
*** geertj has joined #tripleo19:15
jp_at_hplifeless: please don't just revert that change - it really is needed to not break a lot of things.19:18
StevenKjp_at_hp: So I was suggesting a revert, lifeless was saying wait19:19
jp_at_hpok - well StevenK please don't just revert that cange ;-)19:20
StevenKjp_at_hp: Yes, I'm not going to19:20
*** jang has quit IRC19:20
lifelessStevenK: please push up a revert so we can see what it breaks19:22
openstackgerritSteve Kowalik proposed a change to openstack/diskimage-builder: Revert "Iterate over provided elements first"  https://review.openstack.org/9348919:22
openstackgerritJon-Paul Sullivan (jp_at_hp) proposed a change to openstack/tripleo-incubator: Add HEAT_UNDERCLOUD_EXTRA_OPTS back  https://review.openstack.org/9348819:23
jp_at_hplifeless: what it breaks may not be upstream CI.  It misses a lot.19:24
*** jtomasek has quit IRC19:24
lifelessjp_at_hp: this has broken ironic, fixing that is super critical, if the thing it breaks is not tested upstream, Ironic is going to take precedence19:26
*** dpamio has joined #tripleo19:27
*** dpamio has left #tripleo19:27
greghaynesaha! I has failing test19:31
*** jp_at_hp has quit IRC19:34
*** chuckC has quit IRC19:35
*** lucasagomes has joined #tripleo19:37
*** julim has quit IRC19:39
openstackgerritChristian Berendt proposed a change to openstack/tuskar: debug level logs should not be translated  https://review.openstack.org/9349219:41
*** jtomasek has joined #tripleo19:47
*** julim has joined #tripleo19:48
Lotus907efiif I create three baremetal nodes using nova baremetal-node-create blah blah blah and then I want to boot one of those nodes using nova boot blah blah how do I know which one it is going to boot?19:51
Lotus907efiI don't see any way with the nova boot command to specify a particular node19:51
*** e0ne has joined #tripleo19:55
*** geertj has quit IRC19:55
StevenK[6~19:57
lifelessLotus907efi: you can force the hypervisor as a nova admin, that lets you do the same thing with ironic19:59
lifelessLotus907efi: but generally - you shouldn't care which one its going to boot19:59
openstackgerritA change was merged to openstack/tripleo-incubator: Install releases of os-cloud-config  https://review.openstack.org/9330419:59
Lotus907efihmm, if i have a rack of systems and they have different HW capabilities or should be assigned to specific function then I do care which one I am booting20:00
lifelessdifferent flavors let you select the hardware that matches20:00
openstackgerritJames Polley proposed a change to openstack/tripleo-incubator: Add details of which OS releases are tested in CI  https://review.openstack.org/9274920:00
openstackgerritSteve Kowalik proposed a change to openstack/tripleo-incubator: Switch to init-keystone from os-cloud-config  https://review.openstack.org/9349920:01
openstackgerritGregory Haynes proposed a change to openstack/diskimage-builder: WIP: making failing test for ironic deps bug  https://review.openstack.org/9350020:01
*** e0ne has quit IRC20:02
Lotus907efibut as far as I can tell the only flavor available by default is the baremetal one20:02
lifelessLotus907efi: sure, but by default all your hardware is identical20:05
lifelessLotus907efi: StevenK is on an arc to get more flavours made automatically20:05
Lotus907efiah20:05
lifelessI can't reproduce this problem locally, which is sodd20:05
StevenKlifeless: I am? Oh, right20:06
greghayneslifeless: Im unconvinced that revert is the bug20:06
StevenKThat whole register-nodes thing that I've been doing for months20:06
greghaynesSpamapS: http://paste.openstack.org/show/80260/20:07
lifelessgreghaynes: so we need a test case20:11
lifelessI sat down to write one20:11
lifelessit worked20:11
lifelessI tried it on the server20:11
lifelessit failed20:11
lifelessI'm like WAT20:11
greghayneslifeless: yerp, see the WIP I just pasted20:11
greghaynesoh?20:11
lifelessyeah20:11
notqwhen running devtest_undercloud.sh, how do i go into the session once an error occurs20:15
greghayneslifeless: can share test?20:15
lifelessnow I can't reproduce at all20:16
lifelesstrying a build again20:16
lifelessgreghaynes: ELEMENTS_PATH=$(pwd)/elements:../diskimage-builder/elements/ element-info -d base  ubuntu ntp baremetal boot-stack os-collect-config dhcp-all-interfaces neutron-dhcp-agent stackuser pypi use-ephemeral mellanox use-ephemeral rabbitmq-server nova-ironic ceilometer-collector ceilometer-api ceilometer-agent-central ceilometer-agent-notification horizon20:16
greghayneslifeless: Have you tried ./diskimage-builder/bin/element-info --expand-dependencies nova-ironic20:18
greghaynesoh20:19
greghaynesduh20:19
greghaynesIt appears we tried the same tactic20:19
greghayneslifeless: that gives me an ironic...20:21
*** lucasagomes has quit IRC20:21
*** nati_ueno has joined #tripleo20:25
*** julim has quit IRC20:26
*** lazy_prince has quit IRC20:31
*** eghobo has joined #tripleo20:32
*** chuckC has joined #tripleo20:32
*** e0ne has joined #tripleo20:38
*** chuckC has quit IRC20:40
greghayneslifeless: So you are correct that ther is no /opt/stack/ironic, but the element dep is added... so sounds like an installation issue of some kind20:46
*** e0ne has quit IRC20:46
StevenKHuh. My init-keystone from os-cloud-config branch is failing the world because of connection refused to port 3535720:49
*** nati_ueno has quit IRC20:52
*** lazy_prince has joined #tripleo20:53
*** blamar has joined #tripleo20:55
*** nati_uen_ has joined #tripleo20:57
*** untriaged-bot has joined #tripleo21:00
untriaged-botUntriaged bugs so far:21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131876721:00
uvirtbotLaunchpad bug 1318767 in tripleo "apache element SSL cert check fails" [Undecided,New]21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131744621:00
uvirtbotLaunchpad bug 1317446 in tripleo "Whitespace in SSLCertificate param causes jq error" [Undecided,In progress]21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131497821:00
uvirtbotLaunchpad bug 1314978 in tripleo "Cloud vm not pingable after overcloud upgrade " [Undecided,New]21:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131902721:00
uvirtbotLaunchpad bug 1319027 in diskimage-builder "dib install packages not document in the command help" [Undecided,New]21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131535521:00
uvirtbotLaunchpad bug 1315355 in tripleo "Upgrade of overcloud failed with "Connection to neutron failed: Maximum attempts reached"" [Undecided,New]21:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/131871721:00
uvirtbotLaunchpad bug 1318717 in diskimage-builder "image with rhel element can't be built if DIB_RHSM_* variables aren't set" [Undecided,In progress]21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131777821:00
uvirtbotLaunchpad bug 1317778 in tripleo "Rabbit "guest from everywhere" should be reverted" [Undecided,New]21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131667521:00
uvirtbotLaunchpad bug 1316675 in tripleo "Saving a devtest VM results in error" [Undecided,In progress]21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/131705621:00
uvirtbotLaunchpad bug 1317056 in tripleo "Guest VM FS corruption after compute host reboot" [Undecided,New]21:00
*** untriaged-bot has quit IRC21:00
*** eguz has joined #tripleo21:02
*** eguz has quit IRC21:02
*** morganfainberg_Z is now known as morganfainberg21:03
*** wendar has quit IRC21:05
*** morazi has joined #tripleo21:05
*** eghobo has quit IRC21:06
*** wendar has joined #tripleo21:06
*** StevenK has quit IRC21:07
*** StevenK has joined #tripleo21:08
*** marun has joined #tripleo21:09
*** marun has quit IRC21:09
*** blamar has quit IRC21:15
*** chuckC has joined #tripleo21:18
*** chuckC has quit IRC21:19
* greghaynes is just more confused now21:20
greghaynesin a new image build, source-repositories is definitely cloning into /opt/stack/ironic21:20
greghaynesgoing to just let this one finish and verify it has the same bug...21:20
lifelessgreghaynes: we can run trunk heat again now21:21
lifelessgreghaynes: I presume you figured out that was what I was poking at?21:21
greghayneslifeless: Yep, already did that21:21
*** chuckC has joined #tripleo21:22
greghaynesthat being: I unset DIB_REPOREF_heat21:22
lifelessI've updated devtestrc for that21:22
*** morazi has quit IRC21:22
*** e0ne has joined #tripleo21:24
*** jtomasek has quit IRC21:26
*** eghobo has joined #tripleo21:26
*** eghobo has quit IRC21:27
lifelessgreghaynes: you're going to mount and poke locally, not wait for a deploy ?21:27
*** eghobo has joined #tripleo21:27
*** e0ne has quit IRC21:27
*** eguz has joined #tripleo21:28
*** eguz has quit IRC21:30
*** lazy_prince has quit IRC21:30
*** morganfainberg is now known as morganfainberg_Z21:31
*** eghobo has quit IRC21:32
greghayneslifeless: yes21:37
greghayneslifeless: if I ctrl+c in time21:38
greghaynes/usr/sbin/dkms: line 1902: /dev/fd/62: No such file or directory21:39
greghayneswaah21:39
greghayneslifeless: You (or anyone else) seen this when installing openvswitch-dkms?21:41
lifelesslolno21:41
greghaynes:_(21:42
greghaynessomeone qq'd in my term21:44
lifelessme apparently21:46
lifelesssorry21:46
greghaynesAFAICT its happening during the package install...21:47
lifelessis it reproducable ?21:50
greghaynesyep21:50
greghayneson that host at least21:50
lifelessit was working earlier21:52
lifelessI wonder if there has been a new kernel released21:52
lifelesshmm https://review.openstack.org/#/c/93475/ failed21:54
*** noslzzp has joined #tripleo21:55
*** nati_uen_ has quit IRC21:57
*** noslzzp has quit IRC21:57
*** nati_ueno has joined #tripleo22:03
*** chuckC has quit IRC22:07
lifelessgreghaynes: mount table is odd :)22:07
*** noslzzp has joined #tripleo22:12
greghayneswhat about the dinner table?22:16
*** noslzzp has quit IRC22:17
*** cody-somerville has quit IRC22:18
lifelessgreghaynes: cleaned up stale mounts, seeing if that helps.22:19
*** nati_ueno has quit IRC22:28
*** chuckC has joined #tripleo22:30
*** giulivo has quit IRC22:52
*** ramishra has joined #tripleo22:59
*** eghobo has joined #tripleo23:08
*** eghobo has quit IRC23:09
*** eghobo has joined #tripleo23:09
Lotus907efihow do I re-run cloud-init from the command line?23:13
*** eguz has joined #tripleo23:15
Lotus907efiis it as simple as just re-running cloud-init from the command line or should I remove some config files first?23:15
Lotus907efilike the stuff in /var/lib/cloud/ ?23:18
*** eghobo has quit IRC23:18
lifelessgreghaynes: oh yay - http://paste.openstack.org/show/80277/23:37
lifelessgreghaynes: thats on the seed vm host23:37
lifelessgreghaynes: dkms faaiill23:38
lifelesswhich is saucy23:38
Lotus907efiok, I am trying to run "cloud-init init" on a baremetal system I have booted23:46
Lotus907efiand when I do I am getting a connection refused message for the URL http://192.0.2.21//latest/meta-data/instance-id23:48
Lotus907efibut I can ping that IP but cannot ssh or wget from it23:48
Lotus907efiwhat is 192.0.2.21 ?23:48
Lotus907efiit is not a IP address I see on my cloud23:49
Lotus907efiI have two baremetal systems, one at 192.0.2.25 and the other at 192.0.2.2723:49
Lotus907efiand as usual my seed is at 192.0.2.1 and the undercloud is at 192.0.2.323:50
Lotus907efibut as far as I can tell I do not have anything at 192.0.2.21 so I am very puzzled why I can ping that23:50

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!