Sunday, 2013-12-15

*** cd-undercloud has joined #tripleo00:26
cd-undercloud************** overcloud complete status=1 ************00:26
*** cd-undercloud has quit IRC00:26
*** vkozhukalov has quit IRC00:43
*** shadower has joined #tripleo01:00
*** shardy has joined #tripleo01:03
*** cd-undercloud has joined #tripleo01:25
cd-undercloud************** overcloud complete status=1 ************01:25
*** cd-undercloud has quit IRC01:25
*** shardy has quit IRC01:37
*** shadower has quit IRC01:38
*** shardy has joined #tripleo01:39
*** shadower has joined #tripleo01:39
*** CaptTofu has joined #tripleo01:53
*** AaronGr_Zzz has joined #tripleo02:03
*** AaronGr_Zzz is now known as AaronGr02:03
*** AaronGr is now known as AaronGr_Zzz02:05
*** jcooley_ has joined #tripleo02:09
*** CaptTofu has quit IRC02:24
*** CaptTofu has joined #tripleo02:24
*** cd-undercloud has joined #tripleo02:26
cd-undercloud************** overcloud complete status=1 ************02:26
*** cd-undercloud has quit IRC02:26
*** rongze has joined #tripleo02:27
*** shadower has quit IRC02:32
*** rongze has quit IRC02:32
*** shardy has quit IRC02:35
*** shardy has joined #tripleo02:35
*** shadower has joined #tripleo02:35
*** Haomeng|2 has quit IRC02:47
*** shadower has quit IRC02:52
*** shardy has quit IRC02:53
*** boris-42 has joined #tripleo03:18
*** cd-undercloud has joined #tripleo03:25
cd-undercloud************** overcloud complete status=1 ************03:25
*** cd-undercloud has quit IRC03:25
*** rcarrillocruz has joined #tripleo03:28
*** shadower has joined #tripleo03:29
*** shardy has joined #tripleo03:31
*** rcarrillocruz has quit IRC03:32
*** jergerber has joined #tripleo03:54
*** rongze has joined #tripleo03:59
*** rongze has quit IRC04:10
*** jergerber has quit IRC04:10
*** jergerber has joined #tripleo04:14
*** rongze has joined #tripleo04:20
*** cd-undercloud has joined #tripleo04:22
cd-undercloud************** overcloud complete status=1 ************04:22
*** cd-undercloud has quit IRC04:22
*** rongze_ has joined #tripleo04:23
*** rongze has quit IRC04:24
*** rongze_ has quit IRC05:02
*** CaptTofu has quit IRC05:03
*** CaptTofu has joined #tripleo05:03
*** rongze has joined #tripleo05:10
*** cd-undercloud has joined #tripleo05:25
cd-undercloud************** overcloud complete status=1 ************05:25
*** cd-undercloud has quit IRC05:25
*** CaptTofu has quit IRC05:37
*** CaptTofu has joined #tripleo05:38
*** spzala has joined #tripleo06:12
*** rongze has quit IRC06:14
*** spzala has quit IRC06:18
*** jcooley_ has quit IRC06:19
*** cd-undercloud has joined #tripleo06:25
cd-undercloud************** overcloud complete status=1 ************06:25
*** cd-undercloud has quit IRC06:25
*** rongze has joined #tripleo06:45
*** rongze has quit IRC06:49
*** rongze has joined #tripleo07:11
*** tzumainn has quit IRC07:12
*** vkozhukalov has joined #tripleo07:16
*** cd-undercloud has joined #tripleo07:23
cd-undercloud************** overcloud complete status=1 ************07:23
*** cd-undercloud has quit IRC07:23
*** jergerber has quit IRC07:23
*** rongze_ has joined #tripleo07:39
*** rongze has quit IRC07:43
*** jcooley_ has joined #tripleo08:01
*** jcooley_ has quit IRC08:05
*** cd-undercloud has joined #tripleo08:24
cd-undercloud************** overcloud complete status=1 ************08:24
*** cd-undercloud has quit IRC08:24
*** julim has joined #tripleo08:30
*** boris-42 has quit IRC08:32
*** julim has quit IRC08:37
*** jcooley_ has joined #tripleo08:56
*** jcooley_ has quit IRC09:00
*** michchap has quit IRC09:22
*** michchap has joined #tripleo09:23
*** cd-undercloud has joined #tripleo09:28
cd-undercloud************** overcloud complete status=1 ************09:28
*** cd-undercloud has quit IRC09:28
SpamapShmmm timing out waiting for nova compute node09:30
*** rcarrillocruz has joined #tripleo09:30
SpamapShm no more fragility because of a transient nova api failure09:31
*** rcarrillocruz1 has joined #tripleo09:46
*** rcarrillocruz has quit IRC09:48
*** boris-42 has joined #tripleo09:53
*** vkozhukalov has quit IRC10:24
*** cd-undercloud has joined #tripleo10:27
cd-undercloud************** overcloud complete status=1 ************10:27
*** cd-undercloud has quit IRC10:27
*** tzumainn has joined #tripleo10:37
*** jcooley_ has joined #tripleo10:44
*** jcooley_ has quit IRC10:49
*** vkozhukalov has joined #tripleo11:03
*** rongze_ has quit IRC11:17
*** cd-undercloud has joined #tripleo11:27
cd-undercloud************** overcloud complete status=1 ************11:27
*** cd-undercloud has quit IRC11:27
*** rongze has joined #tripleo11:39
*** rushiagr has joined #tripleo11:55
*** rushiagr has quit IRC12:08
*** rushiagr has joined #tripleo12:09
*** cd-undercloud has joined #tripleo12:27
cd-undercloud************** overcloud complete status=1 ************12:27
*** cd-undercloud has quit IRC12:27
*** rcarrillocruz1 has quit IRC12:29
*** rongze has quit IRC12:32
*** jcooley_ has joined #tripleo12:32
*** rushiagr has quit IRC12:37
*** jcooley_ has quit IRC12:37
*** rongze has joined #tripleo12:45
*** rongze_ has joined #tripleo13:00
*** rongze has quit IRC13:03
*** ccrouch has joined #tripleo13:07
*** cd-undercloud has joined #tripleo13:26
cd-undercloud************** overcloud complete status=1 ************13:26
*** cd-undercloud has quit IRC13:26
*** julim has joined #tripleo13:34
*** vkozhukalov has quit IRC13:37
*** julim has quit IRC13:39
*** CaptTofu has quit IRC14:12
*** CaptTofu has joined #tripleo14:12
*** jcooley_ has joined #tripleo14:21
*** cd-undercloud has joined #tripleo14:25
cd-undercloud************** overcloud complete status=1 ************14:25
*** cd-undercloud has quit IRC14:25
*** jcooley_ has quit IRC14:26
*** CaptTofu has quit IRC14:45
*** CaptTofu has joined #tripleo14:46
*** cd-undercloud has joined #tripleo15:25
cd-undercloud************** overcloud complete status=1 ************15:25
*** cd-undercloud has quit IRC15:25
*** vkozhukalov has joined #tripleo15:28
*** rongze_ has quit IRC16:08
*** jcooley_ has joined #tripleo16:09
*** rongze has joined #tripleo16:15
*** jcooley_ has quit IRC16:15
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/tripleo-image-elements: Try to list heat overcloud stack events after run  https://review.openstack.org/6223816:18
*** cd-undercloud has joined #tripleo16:23
cd-undercloud************** overcloud complete status=1 ************16:23
*** cd-undercloud has quit IRC16:23
*** jcooley_ has joined #tripleo16:29
*** tzumainn has quit IRC16:37
*** sdake-OOO2 is now known as sdake_16:48
*** rushiagr has joined #tripleo17:08
*** jcooley_ has quit IRC17:15
*** cd-undercloud has joined #tripleo17:22
cd-undercloud************** overcloud complete status=1 ************17:22
*** cd-undercloud has quit IRC17:22
*** rushiagr has quit IRC17:35
*** AaronGr_Zzz is now known as AaronGr17:46
*** CaptTofu has quit IRC17:55
*** CaptTofu has joined #tripleo17:56
*** rcarrillocruz has joined #tripleo18:08
*** cody-somerville has quit IRC18:11
*** cd-undercloud has joined #tripleo18:23
cd-undercloud************** overcloud complete status=1 ************18:23
*** cd-undercloud has quit IRC18:23
*** julim has joined #tripleo18:35
*** julim has quit IRC18:40
*** rushiagr has joined #tripleo18:53
*** rcarrillocruz1 has joined #tripleo18:59
*** rcarrillocruz has quit IRC18:59
*** AaronGr is now known as AaronGr_Zzz19:04
*** rushiagr has quit IRC19:08
*** cd-undercloud has joined #tripleo19:20
cd-undercloud************** overcloud complete status=1 ************19:20
*** cd-undercloud has quit IRC19:20
*** CaptTofu has quit IRC19:21
*** jergerber has joined #tripleo19:38
*** rcarrillocruz1 has quit IRC19:46
* SpamapS restarts neutron-server and tripleo-cd .. consistently failing on neutron problems19:55
*** pblaho has joined #tripleo20:12
*** pblaho has left #tripleo20:13
*** spzala has joined #tripleo20:15
*** 21WABX369 has joined #tripleo20:31
*** 21WABX369 has quit IRC20:43
*** rongze has quit IRC20:55
*** cd-undercloud has joined #tripleo20:56
cd-undercloud************** overcloud complete status=1 ************20:56
*** cd-undercloud has quit IRC20:56
openstackgerritDan Prince proposed a change to openstack/tripleo-image-elements: Glance: make logging configurable...  https://review.openstack.org/6224621:12
*** michchap_ has joined #tripleo21:14
*** michchap has quit IRC21:15
*** rongze has joined #tripleo21:26
*** rongze has quit IRC21:34
openstackgerritDan Prince proposed a change to openstack/tripleo-image-elements: Glance: use upstream schema-image.json  https://review.openstack.org/6224721:34
*** boris-42 has quit IRC21:46
*** cd-undercloud has joined #tripleo21:57
cd-undercloud************** overcloud complete status=1 ************21:57
*** cd-undercloud has quit IRC21:57
SpamapS2013-12-15 17:24:45,015.015 3205 TRACE nova.openstack.common.threadgroup IncompatibleObjectVersion: Version 1.2 of InstanceList is not supported22:05
SpamapSinteresting22:05
SpamapSnova is legitimately broken it seems22:05
lifelessnuts22:06
lifelessundercloud?22:06
SpamapSno22:07
SpamapSovercloud22:07
SpamapSmight be a regression22:07
SpamapSor we may be using deprecated things unknowingly22:07
lifelessboog filing time22:07
SpamapSstopping tripleo-cd22:08
*** rongze has joined #tripleo22:28
SpamapSlifeless: hmmm.. I am confused..22:29
SpamapSlifeless: when I log in to the overcloud... /opt/stack/nova is not the version the tripleo-cd job pulled from git.22:30
SpamapSHEAD is now at caa2775 Merge "Get test_openAuth_can_refuse_None_uri to cleanup after itself"22:31
SpamapSbut HEAD on the image is 3b32669390ec980d3e0aa62397f73d4787cb27cc22:31
SpamapSfrom December 422:31
SpamapSand that is the problem22:32
SpamapSnotcompute is too far out of date22:32
lifelesscheck the undercloud glance22:32
lifelessone reason they might be different is that we deployed an old image22:33
SpamapSg| created_at            | 2013-12-15T22:04:45                  |22:33
*** rongze has quit IRC22:33
lifelessand just the one image?22:34
SpamapSlifeless: compute is fine22:34
SpamapScontrol has the old repo22:34
SpamapSovercloud-control build is failing22:35
SpamapSand not being detected22:35
SpamapSlovely22:35
SpamapSanybody want to guess what PoS python debacle is causing the fail?22:35
SpamapSdistutils.errors.DistutilsError: Could not find suitable distribution for Requirement.parse('d2to1')22:35
lifelessok, so two bugs.22:36
SpamapSright22:36
lifelesslets fix the failure to detect first :)22:36
SpamapSlooks like overcloud-control has been failing since Dec 422:36
SpamapSlifeless: yes please :)22:36
SpamapSno pipe fail22:37
lifelessnuts22:37
SpamapSso when we added | tee .. we lost detection22:38
lifelesshmm, chalk another one up for lack of tests22:39
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/tripleo-incubator: Set pipefail on all devtest scripts  https://review.openstack.org/6225022:41
SpamapSlifeless: truth be told.. we have _some_ tests. :)22:44
SpamapSlifeless: just that the failures are so numerous and the notification so coarse.. we have become immune to status=122:44
SpamapSlooks like it is failing on glance22:45
*** jcooley_ has joined #tripleo22:45
StevenKSpamapS: Much the same as the gate is bogged down with what people consider spurious failures and just 'recheck no bug' ?22:45
SpamapSStevenK: yeah, same class of problem.22:45
SpamapSbut ours is worse because we don't even have to recheck no bug.. tripleo-cd just runs again22:46
StevenKWell, it is a CD system :-)22:46
SpamapSthe only opportunity to investigate is right after status=1 .. before the next deploy.. gazing at the seer stones22:46
openstackgerritA change was merged to openstack/tripleo-incubator: Set pipefail on all devtest scripts  https://review.openstack.org/6225022:50
lifelesswin 5122:50
SpamapSonly 51?22:52
SpamapS:)22:52
lifelessWhat makes you say only?22:53
SpamapSThere was a point where I had about 50 channels in my autojoin list22:54
SpamapSI've trimmed to 27 now.22:54
*** ogelbukh has quit IRC22:55
lifelessI'm at 70ish22:55
*** ogelbukh has joined #tripleo22:57
lifelessSpamapS: so whats the || : construct for?23:01
SpamapSlifeless: we're still in set -e so if we failed before creating the stack we'd fail hard23:02
*** vkozhukalov has quit IRC23:02
openstackgerritDan Prince proposed a change to openstack/tripleo-image-elements: Use upstream policy.json for keystone.  https://review.openstack.org/6225623:03
openstackgerritDan Prince proposed a change to openstack/tripleo-image-elements: Use upstream policy.json for cinder.  https://review.openstack.org/6225723:03
openstackgerritDan Prince proposed a change to openstack/tripleo-image-elements: Use upstream policy.json for heat.  https://review.openstack.org/6225823:03
*** jergerber has quit IRC23:03
SpamapSI hope this isn't somehow caused by the local pypi-mirror23:04
lifelessno, I mean23:04
lifelesswhat does || : do23:04
lifeless|| true?23:05
SpamapSlifeless: right23:05
lifelessack23:05
SpamapSPerhaps too old school23:05
lifelessno, just a little oblique23:05
SpamapS       : [arguments]23:05
SpamapS              No effect; the command does nothing beyond  expanding  arguments23:05
SpamapS              and  performing any specified redirections.  A zero exit code is23:05
SpamapS              returned.23:05
lifelessso23:05
lifelessfailing hard isn't appropriate?23:06
SpamapSlifeless: it is particularly fun in $() .. $( do-something-dangerous || :)23:06
SpamapSlifeless: no, because I also want the report from below23:06
lifelessok23:06
lifelessmaybe worth a comment to that effect23:06
SpamapSaye agreed23:06
SpamapSraised questions == bugs in documentation IMO :)23:06
SpamapSgah my squid is all out of date.. taking forever to build a pretty basic image. :-P23:08
*** rongze has joined #tripleo23:30
*** rongze has quit IRC23:35
*** akrivoka has joined #tripleo23:38
*** megaprint has joined #tripleo23:53
*** megaprint has quit IRC23:53
lifelessSpamapS: sadface23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!