15:04:12 <johnthetubaguy> #startmeeting XenAPI
15:04:13 <openstack> Meeting started Wed Aug 20 15:04:12 2014 UTC and is due to finish in 60 minutes.  The chair is johnthetubaguy. Information about MeetBot at http://wiki.debian.org/MeetBot.
15:04:15 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
15:04:17 <BobBall> o/
15:04:18 <openstack> The meeting name has been set to 'xenapi'
15:04:25 <johnthetubaguy> hi BobBall
15:04:45 <BobBall> hi johnthetubaguy
15:05:24 <johnthetubaguy> #topic CI
15:05:31 <johnthetubaguy> any news on the CI front?
15:05:41 <BobBall> infra broke me :(
15:05:46 <BobBall> or QA
15:05:50 <BobBall> they disabled saucy
15:05:55 <johnthetubaguy> ah, right
15:05:58 <BobBall> which meant I had to fudge it for now
15:06:04 <johnthetubaguy> in what way?
15:06:06 <BobBall> I've got trusty I think ready to go but not flicked the switch yet
15:06:09 <BobBall> FORCE=yes ;)
15:06:09 <johnthetubaguy> change packages?
15:06:22 <BobBall> no
15:06:48 <johnthetubaguy> fair enough
15:06:54 <johnthetubaguy> any more on that?
15:07:01 <BobBall> I'll have to update to trusty soon though
15:07:08 <BobBall> #link http://f0ab4dc4366795c303a0-8fd069087bab3f263c7f9ddd524fce42.r22.cf1.rackcdn.com/ci_status/recent_finished.txt
15:07:13 <BobBall> shows we're doing OK ATM
15:07:20 <BobBall> 70 failures though, 260 passed
15:07:29 <BobBall> #link http://f0ab4dc4366795c303a0-8fd069087bab3f263c7f9ddd524fce42.r22.cf1.rackcdn.com/ci_status/all_failures.txt
15:07:44 <BobBall> shows that the recent failures are primarily made up of 'no tempest failure detected'
15:08:01 <BobBall> which now seems to be down to devstack failing to run due to various bugs
15:08:12 <johnthetubaguy> hmm
15:08:23 <johnthetubaguy> thats sucky
15:08:26 <BobBall> for example http://dd6b71949550285df7dc-dda4e480e005aaa13ec303551d2d8155.r49.cf1.rackcdn.com/76/96476/2/17587/results.html
15:08:33 <BobBall> 2014-07-17 15:10:26.992 | (98)Address already in use: AH00072: make_sock: could not bind to address [::]:80
15:08:48 <BobBall> But there are more fun ones such as http://dd6b71949550285df7dc-dda4e480e005aaa13ec303551d2d8155.r49.cf1.rackcdn.com/07/114207/13/22500/devstacklog.txt.gz
15:08:57 <BobBall> 2014-08-20 14:10:11.445 | 2014-08-20 14:10:11.443 4036 ERROR oslo.db.sqlalchemy.exc_filters [-] DBAPIError exception wrapped from (InterfaceError) No result set to fetch from. None None
15:09:27 <johnthetubaguy> hmm, funky
15:09:38 <johnthetubaguy> I guess this stuff must be hitting the gate?
15:10:04 <BobBall> some
15:10:09 <BobBall> but I've got a bigger problem ATM
15:10:16 <BobBall> #link https://bugs.launchpad.net/glance/+bug/1342080
15:10:17 <uvirtbot> Launchpad bug 1342080 in glance "glance api is tracebacking with "error: [Errno 32] Broken pipe"" [Undecided,New]
15:10:23 <BobBall> seems to have broken all of the internal citrix CI :)
15:10:25 <BobBall> no idea why
15:10:33 <johnthetubaguy> odd
15:10:38 <BobBall> I did ask in #openstack-glance but no ideas there
15:10:42 <BobBall> you got any ideas from the bug report?
15:11:19 <johnthetubaguy> v2 vs v1 switch?
15:11:26 <johnthetubaguy> looks like a bad request
15:11:46 <BobBall> v2 vs v1?
15:13:08 <johnthetubaguy> glance v1 vs v2
15:13:18 <johnthetubaguy> did we land that in nova, can't remember
15:13:21 <BobBall> was there a recent switch to v2?
15:13:31 <johnthetubaguy> maybe we hand a v2 url down to the plugin that only does v1, not sure
15:13:53 <johnthetubaguy> can't remember, it was coming soon, maybe, maybe a devstack change?
15:14:29 <BobBall> well http://logstash.openstack.org/#eyJzZWFyY2giOiJcImVycm9yOiBbRXJybm8gMzJdIEJyb2tlbiBwaXBlXCIgQU5EIFwiQmFkIHJlcXVlc3Qgc3ludGF4ICgnMCcpXCIiLCJmaWVsZHMiOltdLCJvZmZzZXQiOjAsInRpbWVmcmFtZSI6IjE3MjgwMCIsImdyYXBobW9kZSI6ImNvdW50IiwidGltZSI6eyJ1c2VyX2ludGVydmFsIjowfSwic3RhbXAiOjE0MDg1NDc2Mzg2ODh9 shows 28,000 hits in the gate in the last 48 hours...
15:14:34 <BobBall> which is shocking
15:14:41 <johnthetubaguy> ah, OK
15:14:48 <johnthetubaguy> so something bad there
15:15:03 <BobBall> but e-r isn't showing it
15:15:06 <BobBall> which is weird
15:15:25 <johnthetubaguy> you have to write a query for that right? I guess thats not done yet
15:15:40 <BobBall> ah, true
15:15:47 <BobBall> I got that query from the bug report
15:15:52 <BobBall> but it doesn't seem to have been added to e-r
15:16:18 <johnthetubaguy> yeah, its waiting for effort on that I guess
15:16:35 <BobBall> I don't get it thoguh
15:16:37 <johnthetubaguy> anyways, all sounds like general issues, which in some ways is good, others is bad
15:16:38 <BobBall> it seems very fatal
15:16:51 <BobBall> and 28k hits over 48 hours is a _serious_ issue
15:17:09 <johnthetubaguy> agreed
15:18:18 <BobBall> seems that logstash returns a result even if it didn't fail things
15:18:21 <BobBall> and it's not failing for most people
15:18:24 <BobBall> *shrug* no ideas
15:20:05 <BobBall> definitely v1 btw
15:20:09 <BobBall> not v2
15:20:25 <johnthetubaguy> cool
15:20:46 <johnthetubaguy> jsonscheme have just changed something, I think people were taking in #openstack-nova
15:20:59 <johnthetubaguy> so it could be related, like tighter validation
15:21:01 <johnthetubaguy> anyways...
15:21:04 <johnthetubaguy> anything else?
15:21:13 <BobBall> nah
15:21:25 <johnthetubaguy> #topic Open Discussion
15:21:31 <johnthetubaguy> so nothing from me here at the moment
15:21:35 <johnthetubaguy> any other things?
15:22:30 <BobBall> nah
15:22:34 <BobBall> not this week
15:23:25 <johnthetubaguy> cool
15:23:30 <johnthetubaguy> thanks, catch you next time
15:23:33 <johnthetubaguy> #endmeeting