| *** tjakobs has joined #openstack-powervm | 00:10 | |
| *** thorst has joined #openstack-powervm | 00:25 | |
| *** thorst has quit IRC | 00:26 | |
| *** thorst has joined #openstack-powervm | 00:27 | |
| *** seroyer has joined #openstack-powervm | 00:31 | |
| *** thorst has quit IRC | 00:35 | |
| *** tjakobs has quit IRC | 00:42 | |
| *** thorst has joined #openstack-powervm | 01:29 | |
| *** thorst has quit IRC | 01:29 | |
| *** thorst has joined #openstack-powervm | 01:34 | |
| *** thorst has quit IRC | 01:39 | |
| *** seroyer has quit IRC | 02:11 | |
| *** thorst has joined #openstack-powervm | 02:36 | |
| *** thorst has quit IRC | 02:44 | |
| *** tjakobs has joined #openstack-powervm | 03:18 | |
| *** thorst has joined #openstack-powervm | 03:42 | |
| *** tjakobs has quit IRC | 03:47 | |
| *** thorst has quit IRC | 03:48 | |
| *** thorst has joined #openstack-powervm | 05:09 | |
| *** thorst has quit IRC | 05:15 | |
| *** tlian has quit IRC | 06:02 | |
| *** thorst has joined #openstack-powervm | 06:13 | |
| *** thorst has quit IRC | 06:20 | |
| *** openstackgerrit_ has joined #openstack-powervm | 06:23 | |
| *** openstackgerrit_ has quit IRC | 06:25 | |
| *** openstackgerrit_ has joined #openstack-powervm | 06:26 | |
| *** openstackgerrit_ has quit IRC | 06:27 | |
| *** openstackgerrit_ has joined #openstack-powervm | 06:34 | |
| *** openstackgerrit_ has quit IRC | 06:35 | |
| *** openstackgerrit_ has joined #openstack-powervm | 06:59 | |
| *** openstackgerrit_ has quit IRC | 07:00 | |
| *** thorst has joined #openstack-powervm | 07:16 | |
| *** thorst has quit IRC | 07:23 | |
| *** k0da has joined #openstack-powervm | 09:03 | |
| *** thorst has joined #openstack-powervm | 09:07 | |
| *** k0da has quit IRC | 09:14 | |
| *** thorst has quit IRC | 09:15 | |
| *** k0da has joined #openstack-powervm | 09:33 | |
| *** thorst has joined #openstack-powervm | 09:46 | |
| *** thorst has quit IRC | 09:53 | |
| *** Cartoon has joined #openstack-powervm | 10:04 | |
| *** thorst has joined #openstack-powervm | 10:51 | |
| *** thorst has quit IRC | 10:58 | |
| *** thorst has joined #openstack-powervm | 11:56 | |
| *** thorst has quit IRC | 12:02 | |
| *** seroyer has joined #openstack-powervm | 12:27 | |
| *** thorst has joined #openstack-powervm | 12:50 | |
| *** kylek3h_away has quit IRC | 13:01 | |
| *** jwcroppe has quit IRC | 13:06 | |
| *** tblakes has joined #openstack-powervm | 13:09 | |
| *** apearson has quit IRC | 13:29 | |
| *** jwcroppe has joined #openstack-powervm | 13:29 | |
| *** kylek3h_away has joined #openstack-powervm | 13:40 | |
| *** kylek3h_away has quit IRC | 13:41 | |
| *** svenkat has joined #openstack-powervm | 13:43 | |
| *** seroyer has quit IRC | 13:47 | |
| *** kylek3h has joined #openstack-powervm | 13:57 | |
| *** tlian has joined #openstack-powervm | 14:00 | |
| *** seroyer has joined #openstack-powervm | 14:11 | |
| *** BorD__ has quit IRC | 14:17 | |
| *** BorD__ has joined #openstack-powervm | 14:17 | |
| *** Cartoon has quit IRC | 14:24 | |
| *** esberglu has joined #openstack-powervm | 14:33 | |
| *** esberglu_ has joined #openstack-powervm | 14:35 | |
| *** dwayne_ has joined #openstack-powervm | 14:36 | |
| *** esberglu has quit IRC | 14:37 | |
| thorst | esberglu_: how's the CI holding up? | 14:54 |
|---|---|---|
| esberglu_ | Fine in terms of tempest runs. A couple failures that I need to take a look at. | 14:55 |
| esberglu_ | But the queue thing is still killing us | 14:55 |
| esberglu_ | It caught up over the weekend, last night there were 0 in the queue | 14:55 |
| esberglu_ | Now there are 32 in the queue | 14:55 |
| thorst | are we running 20 at once like we are set up to? | 14:56 |
| esberglu_ | Yeah | 14:59 |
| thorst | we're getting behind even when running 20 at once? | 15:00 |
| esberglu_ | I mean there are never more than a handful going at once | 15:00 |
| thorst | yeah, that's it | 15:00 |
| thorst | so why aren't we processing things over to jenkins more quickly | 15:00 |
| thorst | I'm not sure what a cloned repo buys us to fix that... | 15:01 |
| thorst | (but that could be my ignorance) | 15:01 |
| esberglu_ | #startmeeting powervm_driver_meeting | 15:02 |
| openstack | Meeting started Mon Dec 12 15:02:41 2016 UTC and is due to finish in 60 minutes. The chair is esberglu_. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:02 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:02 |
| openstack | The meeting name has been set to 'powervm_driver_meeting' | 15:02 |
| esberglu_ | thorst_: We can talk about it here to keep the records | 15:03 |
| thorst | lol, I didn't even realize we had a meeting now | 15:03 |
| thorst | is adreznec in? | 15:03 |
| esberglu_ | Oh shoot I'm on the wrong day | 15:03 |
| esberglu_ | We don't have a meeting | 15:04 |
| esberglu_ | #endmeeting | 15:04 |
| openstack | Meeting ended Mon Dec 12 15:04:04 2016 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:04 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/powervm_driver_meeting/2016/powervm_driver_meeting.2016-12-12-15.02.html | 15:04 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/powervm_driver_meeting/2016/powervm_driver_meeting.2016-12-12-15.02.txt | 15:04 |
| thorst | fast meeting! | 15:04 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/powervm_driver_meeting/2016/powervm_driver_meeting.2016-12-12-15.02.log.html | 15:04 |
| esberglu_ | Mondays... | 15:04 |
| *** kriskend_ has joined #openstack-powervm | 15:04 | |
| esberglu_ | thorst_: So it is these git fetch and git-upload-pack commands that are taking forever | 15:06 |
| esberglu_ | 09:56 0:00 git fetch -v origin refs/changes/65/392565/7 | 15:06 |
| esberglu_ | For example that has been going for 10 minutes | 15:06 |
| -openstackstatus- NOTICE: The Gerrit service on review.openstack.org is restarting now to address acute performance issues, and will be back online momentarily. | 15:06 | |
| esberglu_ | But since it is grabbing fresh changesets, I think you are right that a mirror won't help | 15:07 |
| *** gianpero has quit IRC | 15:08 | |
| thorst | esberglu_: so it's not the server they just restarted...right? | 15:08 |
| thorst | I mean, short of making a git repeater... | 15:08 |
| thorst | which basically just sits in a loop and clones down the changes. | 15:09 |
| esberglu_ | Yeah I think it comes down to figuring out why the network is not playing well with git.o.o | 15:10 |
| thorst | but did you verify that the PowerKVM team is seeing this same issue/ | 15:19 |
| thorst | I know their git pulls are slow...but is this specific thing slow on their env as well? | 15:19 |
| thorst | esberglu_: ^^ | 15:19 |
| esberglu_ | thorst_: Checking with them now | 15:22 |
| *** apearson has joined #openstack-powervm | 15:23 | |
| esberglu_ | thorst_: They think it is an issue with our zuul merger | 15:28 |
| esberglu_ | They had to expand from 1 zuul merger to 6 | 15:28 |
| esberglu_ | To compensate for sub optimal network performance | 15:28 |
| thorst | esberglu_: neat! | 15:29 |
| thorst | successfully collaborating | 15:30 |
| thorst | add that to your year end results :-) | 15:30 |
| thorst | so, you know how to do that or needs investigation or needs a bigger server or I'm just going to keep rambling | 15:30 |
| *** tjakobs has joined #openstack-powervm | 15:32 | |
| esberglu_ | thorst_: Well they have a separate server for every merger | 15:33 |
| thorst | not additional processes on the same server? | 15:42 |
| thorst | we could go throw those on jupiter. | 15:42 |
| *** burgerk has joined #openstack-powervm | 15:42 | |
| thorst | we could make like 20 of them up on jupiter... | 15:45 |
| thorst | esberglu_: ^^ | 15:45 |
| esberglu_ | Yeah they are using 6 separate servers, but we might be able to have several mergers on one | 15:48 |
| *** burgerk has quit IRC | 15:50 | |
| esberglu_ | They are using puppet to configure all this stuff | 15:50 |
| esberglu_ | Which I'm not super familiar with, so I'm just trying to figure out how they are doing it right now | 15:51 |
| *** burgerk has joined #openstack-powervm | 15:57 | |
| adreznec | thorst: Did I miss a meeting? Sorry, had an appointment from 9-10, didn't see anything on my calendar | 16:04 |
| thorst | adreznec: so basically lots of issues with git.o.o | 16:04 |
| thorst | and the PowerKVM team solved it by having lots of mergers | 16:04 |
| thorst | esberglu_: I'm not familiar with puppet either, but we could just ansible it? | 16:05 |
| adreznec | Ah, ok | 16:05 |
| thorst | we're familiar with that...unless the work is super hard. | 16:05 |
| adreznec | Puppet? | 16:05 |
| thorst | adreznec: having a repo clone won't help because this is for stuff as it streams in for zuul... | 16:05 |
| esberglu_ | Yeah we could probably just ansible it | 16:05 |
| adreznec | Well shit | 16:05 |
| adreznec | What are you guys trying to do? | 16:05 |
| thorst | I also like using jupiter because its a supported OpenStack cloud, instead of me providing a VM :-) | 16:06 |
| esberglu_ | I talked to the mikhail again about our zuul queue issues | 16:06 |
| esberglu_ | Basically the 1 zuul merger can't handle the workload | 16:06 |
| esberglu_ | especially with the network issues | 16:06 |
| esberglu_ | So they are using 6 zuul mergers | 16:06 |
| adreznec | they being? | 16:07 |
| adreznec | kvm guys? | 16:07 |
| esberglu_ | The PowerKVM CI team | 16:07 |
| adreznec | Ah k | 16:07 |
| esberglu_ | But they are doing all the conf for that using puppet, which I don't know anything about | 16:07 |
| adreznec | Can we update the puppet-openstackci stuff to spin up multiple instances of it? | 16:08 |
| esberglu_ | Yeah probably | 16:09 |
| adreznec | e.g. modify the single_node_ci.pp file to create multiple copies of that zuul_merger service | 16:09 |
| adreznec | Not sure if zuul automatically handles round-robining things then | 16:10 |
| esberglu_ | thorst_: Looks like that new system is done being set up. I was thinking we can use that (neo50) and neo4 for OSA CI dev. and continue using neo14 for staging CI | 16:27 |
| thorst | OK | 16:27 |
| thorst | neo50 wasn't the SDN team's? | 16:28 |
| *** apearson has quit IRC | 16:29 | |
| *** apearson has joined #openstack-powervm | 16:32 | |
| esberglu_ | I thought you had said a while back that we would be adding it to CI once it was set up. Could be wrong though | 16:34 |
| *** k0da has quit IRC | 16:36 | |
| *** apearson has quit IRC | 16:56 | |
| thorst | hmmm...I still have a TODO to get through all that server notes | 17:03 |
| *** thorst has quit IRC | 17:03 | |
| *** thorst has joined #openstack-powervm | 17:06 | |
| *** thorst has quit IRC | 17:10 | |
| *** apearson has joined #openstack-powervm | 17:13 | |
| *** apearson has quit IRC | 17:27 | |
| *** apearson has joined #openstack-powervm | 17:32 | |
| *** openstack has joined #openstack-powervm | 17:59 | |
| *** kriskend_ has quit IRC | 18:03 | |
| *** thorst has joined #openstack-powervm | 18:13 | |
| *** kriskend_ has joined #openstack-powervm | 18:52 | |
| *** k0da has joined #openstack-powervm | 19:03 | |
| *** thorst_ has joined #openstack-powervm | 19:45 | |
| *** thorst has quit IRC | 19:48 | |
| *** edmondsw has joined #openstack-powervm | 19:50 | |
| *** edmondsw has quit IRC | 19:52 | |
| *** thorst has joined #openstack-powervm | 19:53 | |
| *** thorst_ has quit IRC | 19:56 | |
| *** thorst_ has joined #openstack-powervm | 19:59 | |
| *** thorst has quit IRC | 20:03 | |
| *** kriskend_ has quit IRC | 20:08 | |
| *** kriskend_ has joined #openstack-powervm | 20:13 | |
| *** thorst has joined #openstack-powervm | 20:15 | |
| *** thorst__ has joined #openstack-powervm | 20:16 | |
| *** thorst_ has quit IRC | 20:18 | |
| *** thorst has quit IRC | 20:19 | |
| *** thorst__ has quit IRC | 20:22 | |
| *** thorst has joined #openstack-powervm | 20:25 | |
| *** thorst has quit IRC | 20:38 | |
| *** tblakes_ has joined #openstack-powervm | 20:39 | |
| *** tblakes has quit IRC | 20:43 | |
| *** tblakes_ is now known as tblakes | 20:43 | |
| *** jwcroppe has quit IRC | 21:01 | |
| *** thorst has joined #openstack-powervm | 21:36 | |
| *** thorst_ has joined #openstack-powervm | 21:40 | |
| *** thorst has quit IRC | 21:41 | |
| *** thorst_ is now known as thorst | 21:43 | |
| *** svenkat has quit IRC | 21:44 | |
| *** seroyer has quit IRC | 21:46 | |
| *** seroyer has joined #openstack-powervm | 21:55 | |
| *** k0da has quit IRC | 22:21 | |
| *** kylek3h has quit IRC | 22:22 | |
| *** thorst has quit IRC | 22:32 | |
| *** thorst has joined #openstack-powervm | 22:33 | |
| *** tblakes has quit IRC | 22:35 | |
| *** thorst has quit IRC | 22:41 | |
| *** kriskend_ has quit IRC | 22:48 | |
| *** burgerk_ has joined #openstack-powervm | 22:51 | |
| *** burgerk has quit IRC | 22:54 | |
| *** esberglu_ has quit IRC | 22:55 | |
| *** esberglu has joined #openstack-powervm | 22:55 | |
| *** burgerk_ has quit IRC | 22:56 | |
| *** esberglu_ has joined #openstack-powervm | 22:56 | |
| *** esberglu has quit IRC | 23:00 | |
| *** esberglu_ has quit IRC | 23:01 | |
| *** dwayne_ has quit IRC | 23:05 | |
| *** kylek3h has joined #openstack-powervm | 23:07 | |
| *** apearson has quit IRC | 23:08 | |
| *** jwcroppe has joined #openstack-powervm | 23:10 | |
| *** seroyer has quit IRC | 23:13 | |
| *** tjakobs has quit IRC | 23:20 | |
| *** esberglu has joined #openstack-powervm | 23:24 | |
| *** esberglu has quit IRC | 23:28 | |
| *** thorst has joined #openstack-powervm | 23:39 | |
| *** thorst has quit IRC | 23:46 | |
| *** thorst has joined #openstack-powervm | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!