| *** thorst_ has joined #openstack-powervm | 00:19 | |
| *** thorst_ has quit IRC | 00:22 | |
| *** thorst_ has joined #openstack-powervm | 00:23 | |
| *** thorst_ has quit IRC | 00:32 | |
| *** tlian has quit IRC | 00:35 | |
| *** devlaps has quit IRC | 00:37 | |
| *** devlaps has joined #openstack-powervm | 00:38 | |
| *** seroyer has joined #openstack-powervm | 01:03 | |
| *** seroyer has quit IRC | 01:23 | |
| *** svenkat has joined #openstack-powervm | 01:25 | |
| *** smatzek has joined #openstack-powervm | 01:43 | |
| *** svenkat has quit IRC | 02:07 | |
| *** smatzek has quit IRC | 02:07 | |
| *** diegs has quit IRC | 02:11 | |
| *** thorst_ has joined #openstack-powervm | 02:14 | |
| *** thorst_ has quit IRC | 02:23 | |
| *** thorst_ has joined #openstack-powervm | 02:31 | |
| *** thorst_ has quit IRC | 02:50 | |
| *** thorst_ has joined #openstack-powervm | 02:50 | |
| *** thorst_ has quit IRC | 02:59 | |
| *** edmondsw has joined #openstack-powervm | 03:52 | |
| *** edmondsw has quit IRC | 03:57 | |
| *** thorst_ has joined #openstack-powervm | 03:57 | |
| *** devlaps has quit IRC | 03:58 | |
| *** thorst_ has quit IRC | 04:04 | |
| *** thorst_ has joined #openstack-powervm | 05:01 | |
| *** thorst_ has quit IRC | 05:09 | |
| *** AndyWojo has quit IRC | 05:14 | |
| *** AndyWojo has joined #openstack-powervm | 05:19 | |
| *** edmondsw has joined #openstack-powervm | 05:53 | |
| *** edmondsw has quit IRC | 05:57 | |
| *** thorst_ has joined #openstack-powervm | 06:07 | |
| *** thorst_ has quit IRC | 06:14 | |
| *** thorst_ has joined #openstack-powervm | 07:13 | |
| *** thorst_ has quit IRC | 07:19 | |
| *** thorst_ has joined #openstack-powervm | 08:16 | |
| *** thorst_ has quit IRC | 08:23 | |
| *** k0da has joined #openstack-powervm | 08:37 | |
| *** k0da has quit IRC | 08:49 | |
| *** k0da has joined #openstack-powervm | 08:52 | |
| *** lucioal has joined #openstack-powervm | 09:37 | |
| *** lucioal has quit IRC | 09:38 | |
| *** lucioal has joined #openstack-powervm | 09:38 | |
| *** thorst_ has joined #openstack-powervm | 10:06 | |
| *** thorst_ has quit IRC | 10:15 | |
| lucioal | I install Nova PowerVM on Openstack newton. But when i create an instance the nova link return error 500 com.ibm.pmc.rest.provider.exceptions.SelfFetchingNotSupportedException | 10:24 |
|---|---|---|
| *** thorst_ has joined #openstack-powervm | 11:13 | |
| *** thorst_ has quit IRC | 11:20 | |
| *** openstackgerrit has quit IRC | 11:32 | |
| *** smatzek has joined #openstack-powervm | 11:54 | |
| *** edmondsw has joined #openstack-powervm | 12:12 | |
| *** thorst_ has joined #openstack-powervm | 12:18 | |
| *** thorst_ has quit IRC | 12:25 | |
| *** edmondsw_ has joined #openstack-powervm | 12:26 | |
| *** seroyer has joined #openstack-powervm | 12:34 | |
| *** thorst_ has joined #openstack-powervm | 12:47 | |
| *** edmondsw_ has quit IRC | 12:50 | |
| *** kylek3h__ has quit IRC | 12:56 | |
| *** seroyer has quit IRC | 12:58 | |
| *** seroyer has joined #openstack-powervm | 13:01 | |
| *** lucioal has quit IRC | 13:09 | |
| *** tblakes has joined #openstack-powervm | 13:10 | |
| *** seroyer has quit IRC | 13:15 | |
| *** svenkat has joined #openstack-powervm | 13:15 | |
| *** kylek3h_away has joined #openstack-powervm | 13:26 | |
| *** seroyer has joined #openstack-powervm | 13:48 | |
| *** tlian has joined #openstack-powervm | 13:51 | |
| *** esberglu has joined #openstack-powervm | 14:05 | |
| *** apearson has joined #openstack-powervm | 14:06 | |
| *** mdrabe has joined #openstack-powervm | 14:07 | |
| *** dwayne_ has quit IRC | 14:07 | |
| esberglu | thorst_: http://docs.openstack.org/infra/system-config/third_party.html#permissions-on-your-third-party-system | 14:09 |
| esberglu | From that it looks like the CI will automatically be non-voting for nova, so I think we can just add it to the existing check pipeline | 14:10 |
| esberglu | Do we want our CI to provide gating votes for the *-powervm projects? | 14:11 |
| *** edmondsw has quit IRC | 14:27 | |
| *** smatzek has quit IRC | 14:36 | |
| *** edmondsw has joined #openstack-powervm | 14:41 | |
| *** smatzek has joined #openstack-powervm | 14:57 | |
| thorst_ | esberglu: Yes - gating votes on the -powervm | 14:58 |
| thorst_ | nothing gets in unless your CI works | 14:58 |
| thorst_ | no pressure | 14:58 |
| thorst_ | :-) | 14:58 |
| esberglu | thorst_: lol. Okay I will kick off the actions to get that to happen. | 15:02 |
| esberglu | And I'm turning on CI for nova right now | 15:02 |
| thorst_ | exciting! | 15:04 |
| *** seroyer has quit IRC | 15:15 | |
| *** mdrabe has quit IRC | 15:18 | |
| *** kriskend_ has joined #openstack-powervm | 15:19 | |
| *** mdrabe has joined #openstack-powervm | 15:30 | |
| *** jwcroppe has joined #openstack-powervm | 15:33 | |
| *** seroyer has joined #openstack-powervm | 15:37 | |
| *** tjakobs has joined #openstack-powervm | 15:40 | |
| *** dwayne_ has joined #openstack-powervm | 15:44 | |
| *** thorst_ is now known as thorst_afk | 16:35 | |
| *** devlaps has joined #openstack-powervm | 16:43 | |
| *** apearson has quit IRC | 17:06 | |
| *** apearson has joined #openstack-powervm | 17:10 | |
| *** k0da has quit IRC | 17:52 | |
| *** apearson has quit IRC | 17:56 | |
| thorst_afk | esberglu: seeing some failures...do I need to worry? | 18:19 |
| *** thorst_afk is now known as thorst_ | 18:19 | |
| *** apearson has joined #openstack-powervm | 18:34 | |
| esberglu | Nope. Most of them are still just from patches that aren't rebased with the HVType and VMMode. | 18:51 |
| esberglu | efrieds PowerVM Skeleton patch failed because the driver failed with a Not Implemented error which makes sense | 18:52 |
| esberglu | And one actual failure rebuilding a server from error state | 18:55 |
| esberglu | thorst_: ^^ | 18:55 |
| *** jwcroppe has quit IRC | 19:53 | |
| *** jwcroppe has joined #openstack-powervm | 19:54 | |
| *** jwcroppe has quit IRC | 19:58 | |
| thorst_ | hmm | 20:00 |
| adreznec | thorst_: we're having issues with git.o.o access from our POK CI systems too | 20:08 |
| adreznec | That we're not seeing from Roch systems | 20:08 |
| *** openstackgerrit has joined #openstack-powervm | 20:10 | |
| openstackgerrit | Taylor Jakobson proposed openstack/nova-powervm: Retry up to 3 times on disk create https://review.openstack.org/406355 | 20:10 |
| adreznec | I'll post numbers in a minute | 20:10 |
| openstackgerrit | Merged openstack/nova-powervm: Add delay queue for events https://review.openstack.org/391164 | 20:15 |
| thorst_ | adreznec: we are? | 20:16 |
| thorst_ | git.o.o? | 20:16 |
| adreznec | At least on our CI systems | 20:16 |
| thorst_ | git clone issues? | 20:17 |
| adreznec | Yep | 20:17 |
| thorst_ | so those have always existed I thought (and was why even OpenStack's gate has multiple tries for the git clone) | 20:17 |
| thorst_ | is it just dead, or is it intermittent? | 20:17 |
| adreznec | thorst_: http://paste.openstack.org/show/591720/ | 20:18 |
| adreznec | That 978.00 KiB/s is misleading though | 20:19 |
| adreznec | I watched it fluctuate between like 1-2 MiB/s and 15 KiB/s | 20:19 |
| adreznec | and it seems somewhat intermittent | 20:19 |
| thorst_ | right. | 20:19 |
| adreznec | But I've been doing parallel clones from systems in roch and pok | 20:19 |
| adreznec | and I'm only seeing it from pok | 20:19 |
| esberglu | Yeah the time is more telling. 14m vs 2m | 20:19 |
| thorst_ | yep yep...I thought we had always seen this? | 20:20 |
| thorst_ | (and was part of why we cloned down nightly) | 20:20 |
| thorst_ | (and added that retry mechanism) | 20:20 |
| adreznec | Not this bad | 20:20 |
| adreznec | I think it's causing the zuul queue to hang | 20:20 |
| esberglu | Yeah it's killing the CI | 20:20 |
| thorst_ | I'm confused. What are you guys doing | 20:20 |
| thorst_ | rebuilding the CI? | 20:21 |
| adreznec | No | 20:21 |
| adreznec | When zuul goes to pull a new patch from upstream on a changeset, it does a git fetch from git.o.o | 20:21 |
| adreznec | No real way around that | 20:21 |
| adreznec | Since the WIP patchsets obviously aren't on github | 20:21 |
| esberglu | And right now we have some patches coming through that depend on like 10 other patches | 20:22 |
| esberglu | So zuul pull all of those down | 20:22 |
| esberglu | And it's going so slow that they are essentially stuck in the queue | 20:22 |
| thorst_ | and some of these patches are 200 meg? | 20:23 |
| esberglu | We think they are dying and restarting | 20:25 |
| thorst_ | adreznec: what's the git.o.o IP when you ping from roch? | 20:25 |
| thorst_ | is it 104.130.246.128? | 20:26 |
| adreznec | 104.130.246.128 | 20:26 |
| adreznec | Same yeah | 20:26 |
| adreznec | Checked that already | 20:26 |
| thorst_ | give me a 'bad neo' | 20:27 |
| thorst_ | neo41? | 20:27 |
| esberglu | We are seeing this on the production management node right now. Otherwise any of the CI neos. neo38 | 20:33 |
| thorst_ | OK - its horribly slow to RTP as well....but about 1.1 MB/s | 20:33 |
| esberglu | Other CI systems have been having issues with git.o.o as well | 20:34 |
| esberglu | They have switched to github where they can. Some have set up local mirrors | 20:34 |
| thorst_ | I have a theory | 20:36 |
| adreznec | UH oh | 20:36 |
| thorst_ | adreznec: PM me the IP of your roch system | 20:36 |
| *** gianpero has joined #openstack-powervm | 20:39 | |
| thorst_ | I think its the DNS | 20:43 |
| openstackgerrit | Taylor Jakobson proposed openstack/nova-powervm: Retry up to 3 times on disk create https://review.openstack.org/406355 | 20:43 |
| adreznec | thorst_: Please theory thx | 20:43 |
| adreznec | Hmm | 20:43 |
| thorst_ | .128.50 is responding slowly | 20:43 |
| adreznec | Possible? thinking the corporate DNS is having issues? | 20:43 |
| thorst_ | I switch to .130.50 and faster | 20:43 |
| thorst_ | let me PM a couple DNS to try out | 20:43 |
| *** edmondsw has quit IRC | 20:43 | |
| thorst_ | esberglu: try switching things to .130.50 DNS and see if that helps | 20:50 |
| thorst_ | when I'm on that, things appear faster (not super fast mind you...but faster) | 20:50 |
| thorst_ | 10 Mb/s | 20:50 |
| *** apearson has quit IRC | 21:05 | |
| *** apearson has joined #openstack-powervm | 21:10 | |
| *** smatzek has quit IRC | 21:28 | |
| *** k0da has joined #openstack-powervm | 21:35 | |
| *** thorst_ has quit IRC | 21:43 | |
| *** thorst_ has joined #openstack-powervm | 21:44 | |
| *** thorst_ has quit IRC | 21:44 | |
| openstackgerrit | Eric Berglund proposed openstack/nova-powervm: DNM: ci check https://review.openstack.org/328315 | 21:58 |
| *** apearson has quit IRC | 22:06 | |
| *** svenkat has quit IRC | 22:07 | |
| *** apearson has joined #openstack-powervm | 22:07 | |
| *** seroyer has quit IRC | 22:09 | |
| *** edmondsw has joined #openstack-powervm | 22:16 | |
| *** edmondsw has quit IRC | 22:21 | |
| *** kylek3h_away has quit IRC | 22:32 | |
| *** kriskend_ has quit IRC | 22:32 | |
| *** tblakes has quit IRC | 22:35 | |
| *** esberglu has quit IRC | 22:37 | |
| *** esberglu has joined #openstack-powervm | 22:38 | |
| *** esberglu has quit IRC | 22:42 | |
| *** dwayne_ has quit IRC | 22:57 | |
| *** mdrabe has quit IRC | 23:06 | |
| *** seroyer has joined #openstack-powervm | 23:11 | |
| *** seroyer has quit IRC | 23:17 | |
| *** k0da has quit IRC | 23:23 | |
| *** apearson has quit IRC | 23:26 | |
| *** tjakobs has quit IRC | 23:32 | |
| *** esberglu has joined #openstack-powervm | 23:45 | |
| *** esberglu has quit IRC | 23:49 | |
| *** BorD__ has joined #openstack-powervm | 23:52 | |
| *** dwayne_ has joined #openstack-powervm | 23:55 | |
| *** gianpero has quit IRC | 23:57 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!