| jeblair | Krinkle: one of the things i'm _really_ excited about is the possibility that when we run our own infra-cloud, we can point this system at our production logs and automatically see how often we see the same bugs in production | 00:00 |
|---|---|---|
| *** yamamoto has quit IRC | 00:00 | |
| *** teran has joined #openstack-infra | 00:00 | |
| *** teran has quit IRC | 00:05 | |
| jeblair | clarkb, mordred: the 5s delay seems to be working as intended | 00:10 |
| clarkb | woot | 00:11 |
| jeblair | at least, things are still functioning. we'll have to keep an eye out for whether it fixes the 'depends on a change that failed to merge' errors in check | 00:11 |
| *** dimsum__ has quit IRC | 00:16 | |
| *** sarob has joined #openstack-infra | 00:20 | |
| *** dimsum__ has joined #openstack-infra | 00:22 | |
| *** dims_ has joined #openstack-infra | 00:23 | |
| *** rlucio has quit IRC | 00:24 | |
| *** mjordan has joined #openstack-infra | 00:24 | |
| *** sarob has quit IRC | 00:25 | |
| *** SumitNaiksatam has quit IRC | 00:26 | |
| *** dimsum__ has quit IRC | 00:27 | |
| *** hdd has joined #openstack-infra | 00:34 | |
| *** leakypipes has quit IRC | 00:34 | |
| *** annegentle has joined #openstack-infra | 00:45 | |
| *** baoli has joined #openstack-infra | 00:47 | |
| *** sarob has joined #openstack-infra | 00:47 | |
| *** annegentle has quit IRC | 00:49 | |
| *** marun has quit IRC | 00:56 | |
| *** Swami has joined #openstack-infra | 00:59 | |
| *** Swami has quit IRC | 00:59 | |
| *** mjordan has quit IRC | 01:00 | |
| *** tqtran has quit IRC | 01:00 | |
| *** teran has joined #openstack-infra | 01:01 | |
| *** emagana has quit IRC | 01:03 | |
| *** dboik_ has joined #openstack-infra | 01:04 | |
| *** sarob has quit IRC | 01:04 | |
| *** teran has quit IRC | 01:06 | |
| *** dboik has quit IRC | 01:07 | |
| *** otter768 has joined #openstack-infra | 01:08 | |
| *** otter768 has quit IRC | 01:13 | |
| mordred | jeblair: woot | 01:18 |
| mordred | timrc: your graphs are looking better ... you may have better luck replacing b1 and b2 and whatnot with just one that has a * | 01:18 |
| *** hdd has quit IRC | 01:18 | |
| *** thingee has quit IRC | 01:18 | |
| mordred | unless you explicitly want to see our fake cloud segregations | 01:18 |
| clarkb | they may be useful as they are on different networks and routers | 01:19 |
| clarkb | and azs | 01:19 |
| timrc | mordred, I'm not sure I want to stick with cubism. That's what's rendering those now. | 01:19 |
| timrc | I'm also trying to decide if side-by-side is useful or one large plot with multiple datapoints on it. | 01:19 |
| timrc | mordred, I only used those two for now because they align much better in terms of tasks than a hpcloud and rax. | 01:19 |
| mordred | clarkb: in general I agree- although I believe our current problems are all database related | 01:20 |
| mordred | :) | 01:20 |
| clarkb | ya not sure if useful but there are differences | 01:20 |
| mordred | ++ | 01:20 |
| timrc | These graphs are kind of small... ideally you can sort of see trends, but that's about it. | 01:20 |
| mordred | I think it's useful to see separate but also combined | 01:20 |
| mordred | yah | 01:20 |
| *** hdd has joined #openstack-infra | 01:20 | |
| timrc | The coloring can supposedly identify anomalies... | 01:21 |
| *** sputnik13 has quit IRC | 01:21 | |
| timrc | The other thing I've thought about is pairing say CreateServer and DeleteServer, one being positive, and the other being negative, graphing together. | 01:21 |
| timrc | But I am not sure that's insightful without looking at all the other associated tasks. | 01:22 |
| *** hockeynut_ has joined #openstack-infra | 01:22 | |
| *** dims_ has quit IRC | 01:24 | |
| *** davideagnello has quit IRC | 01:25 | |
| *** hockeynut has quit IRC | 01:25 | |
| *** hockeynut_ is now known as hockeynut | 01:25 | |
| *** hockeynut has quit IRC | 01:27 | |
| *** hockeynut has joined #openstack-infra | 01:27 | |
| *** hockeynut has quit IRC | 01:30 | |
| *** hockeynut has joined #openstack-infra | 01:32 | |
| *** unicell has quit IRC | 01:33 | |
| *** changbl_ has joined #openstack-infra | 01:34 | |
| *** hockeynut has quit IRC | 01:35 | |
| *** hockeynut has joined #openstack-infra | 01:38 | |
| *** ujuc has joined #openstack-infra | 01:39 | |
| *** harlowja is now known as harlowja_away | 01:39 | |
| *** unicell has joined #openstack-infra | 01:40 | |
| *** woodster_ has quit IRC | 01:40 | |
| *** hockeynut has quit IRC | 01:41 | |
| cody-somerville | timrc: Staking CreateServer and DeleteServer probably isn't useful. Stacking all the tasks needed to bring a node online or to dispose of it though would be. | 01:42 |
| *** changbl_ has quit IRC | 01:42 | |
| *** harlowja_away is now known as harlowja | 01:44 | |
| fungi | well, and stacking all of those together does give us the amount of time that slice of our quota is occupied by overhead states and thus unavailable for running jobs | 01:44 |
| *** annegentle has joined #openstack-infra | 01:45 | |
| fungi | though i guess this is just analyzing the amount of time it took to return from the api call, not the amount of time spent waiting for that call to go into effect? | 01:47 |
| cody-somerville | aye. | 01:47 |
| *** unicell has quit IRC | 01:47 | |
| *** sputnik13 has joined #openstack-infra | 01:47 | |
| fungi | so, yeah, i guess we could still benefit from an aggregate "this is how much time was spent waiting on responses from api calls" | 01:48 |
| mordred | indeed - like - since EVERYTHING takes longer ... you can tell that the aggregate cost of teh 5 extra api calls dealing with floating ips takes adds up | 01:49 |
| mordred | if floating ip calls took sub-second like they should | 01:49 |
| mordred | then having 5 more of them would be meh | 01:49 |
| *** annegentle has quit IRC | 01:51 | |
| *** hockeynut has joined #openstack-infra | 01:52 | |
| *** hockeynut has quit IRC | 01:54 | |
| *** teran has joined #openstack-infra | 02:02 | |
| timrc | This kind of "stacking" can also identify patterns, but how useful this particular pattern is... http://15.125.65.125/ | 02:05 |
| *** dboik_ has quit IRC | 02:06 | |
| *** teran has quit IRC | 02:06 | |
| *** ajmiller has joined #openstack-infra | 02:07 | |
| *** annegentle has joined #openstack-infra | 02:12 | |
| *** annegentle has quit IRC | 02:12 | |
| *** hockeynut has joined #openstack-infra | 02:13 | |
| *** baoli has quit IRC | 02:14 | |
| *** emagana has joined #openstack-infra | 02:16 | |
| *** baoli has joined #openstack-infra | 02:20 | |
| *** dimsum__ has joined #openstack-infra | 02:23 | |
| *** dims_ has joined #openstack-infra | 02:24 | |
| *** achanda has quit IRC | 02:27 | |
| *** sarob has joined #openstack-infra | 02:27 | |
| *** dimsum__ has quit IRC | 02:27 | |
| *** sarob has quit IRC | 02:29 | |
| *** achanda has joined #openstack-infra | 02:33 | |
| *** achanda has quit IRC | 02:37 | |
| *** dims_ has quit IRC | 02:39 | |
| *** david-lyle_ has quit IRC | 02:43 | |
| *** sputnik13 has quit IRC | 02:44 | |
| *** harlowja is now known as harlowja_away | 02:48 | |
| *** patrickeast has quit IRC | 02:49 | |
| *** achanda has joined #openstack-infra | 02:54 | |
| *** sputnik13 has joined #openstack-infra | 02:55 | |
| *** teran has joined #openstack-infra | 03:03 | |
| *** teran has quit IRC | 03:07 | |
| *** otter768 has joined #openstack-infra | 03:09 | |
| *** woodster_ has joined #openstack-infra | 03:13 | |
| *** otter768 has quit IRC | 03:14 | |
| *** achanda has quit IRC | 03:17 | |
| *** emagana has quit IRC | 03:33 | |
| *** hdd has quit IRC | 03:35 | |
| *** tkelsey has joined #openstack-infra | 03:40 | |
| *** tkelsey has quit IRC | 03:44 | |
| *** yamamoto has joined #openstack-infra | 03:56 | |
| *** mjordan has joined #openstack-infra | 04:00 | |
| *** baoli has quit IRC | 04:01 | |
| *** teran has joined #openstack-infra | 04:04 | |
| *** teran has quit IRC | 04:08 | |
| *** btully has quit IRC | 04:13 | |
| *** dimsum__ has joined #openstack-infra | 04:15 | |
| *** achanda has joined #openstack-infra | 04:18 | |
| *** dimsum__ has quit IRC | 04:20 | |
| *** armax has quit IRC | 04:21 | |
| *** unicell has joined #openstack-infra | 04:22 | |
| *** mjordan has quit IRC | 04:23 | |
| *** achanda has quit IRC | 04:23 | |
| *** ajmiller_ has joined #openstack-infra | 04:26 | |
| *** ajmiller has quit IRC | 04:30 | |
| *** Krinkle is now known as Krinkle|detached | 04:35 | |
| *** Viswanath has joined #openstack-infra | 04:43 | |
| timrc | Playing around with grafana. Pretty nice graph / dashboard builder. | 04:45 |
| timrc | http://15.125.65.125/dashboard/db/nodepool-performance | 04:45 |
| *** Viswanath has quit IRC | 04:45 | |
| *** Krinkle|detached is now known as Krinkle | 04:47 | |
| Krinkle | timrc: Is that from the Kibana folks? | 04:54 |
| timrc | Krinkle, grafana? I actually do not know... | 04:55 |
| timrc | Krinkle, cody-somerville pointed me at it and I decided to play around with it. | 04:55 |
| Krinkle | it looks virtually identical (in a good way) | 04:55 |
| Krinkle | Ah, it is | 04:55 |
| *** sirushti has joined #openstack-infra | 04:55 | |
| Krinkle | People wanted Kibana (often used for Logstash/elasticsearch) to support Graphite and instead a clone was created. | 04:55 |
| Krinkle | Grafana | 04:55 |
| Krinkle | awesome | 04:55 |
| *** unicell has quit IRC | 04:57 | |
| Krinkle | Kibana 3+ that is | 04:57 |
| Krinkle | It seems openstack is using an older version at logstash.openstack.org | 04:57 |
| Krinkle | KIbana 3 demo: http://demo.packetbeat.com/# | 04:58 |
| timrc | Krinkle, It's pretty nice. Super easy to at metrics and what not. | 05:00 |
| timrc | They did a good job. | 05:00 |
| timrc | add* | 05:00 |
| mordred | timrc: oh - that's pretty | 05:02 |
| *** sdake has joined #openstack-infra | 05:03 | |
| Krinkle | Yeah, I love it. It provides the data that feels like it's right there, accessible in any way you want. Removes the barrier of complex graphite queries and static images. | 05:03 |
| *** Viswanath has joined #openstack-infra | 05:04 | |
| *** sdake_ has joined #openstack-infra | 05:04 | |
| timrc | mordred, Not a good sign when you need to use a log scale to show rax v. hpcloud CreateServerTask timings :) | 05:04 |
| mordred | timrc: :) | 05:04 |
| *** teran has joined #openstack-infra | 05:04 | |
| timrc | I'm going to make sure we get these metrics downstream inside of HP... but I'm scared to see what those graphs actually look like. | 05:05 |
| *** btully has joined #openstack-infra | 05:05 | |
| *** Krinkle is now known as Krinkle|detached | 05:05 | |
| *** dboik has joined #openstack-infra | 05:07 | |
| *** sdake has quit IRC | 05:07 | |
| *** Viswanath has quit IRC | 05:08 | |
| *** wenlock has quit IRC | 05:09 | |
| *** btully has quit IRC | 05:10 | |
| *** teran has quit IRC | 05:10 | |
| *** otter768 has joined #openstack-infra | 05:10 | |
| *** dboik has quit IRC | 05:12 | |
| mordred | timrc: just so you know, I've been sharing info up the various chains - so let me know when you're ok with me sharing that link with people | 05:13 |
| *** nibalizer has joined #openstack-infra | 05:14 | |
| *** otter768 has quit IRC | 05:14 | |
| timrc | mordred, Okay. I'm going to give it a proper hostname, but I don't think it's going anywhere. | 05:16 |
| timrc | mordred, I don't know what it takes to get a new project into openstack-infra, but if this is something people want, I'd be happy to do the work to make it happen. | 05:17 |
| timrc | It's stupid simple to get grafana up and running. | 05:18 |
| *** woodster_ has quit IRC | 05:20 | |
| *** aswadr has joined #openstack-infra | 05:20 | |
| *** hdd has joined #openstack-infra | 05:22 | |
| *** aswadr has quit IRC | 05:24 | |
| *** ildikov_ has quit IRC | 05:27 | |
| timrc | mordred, I'll keep this running... DNS propagation may be broken still, but this works for me: http://grafana.busywait.com/dashboard/db/nodepool-performance | 05:31 |
| *** sarob has joined #openstack-infra | 05:34 | |
| *** stevemar has joined #openstack-infra | 05:35 | |
| nibalizer | mmm shiny graph | 05:36 |
| nibalizer | om nom nom | 05:36 |
| mordred | timrc: it seems to be offering me the options to do lots of things ... | 05:36 |
| * nibalizer zooms in | 05:36 | |
| nibalizer | much datas | 05:36 |
| mordred | timrc: do those persist for other people? | 05:36 |
| *** sarob has quit IRC | 05:36 | |
| timrc | mordred, No, you can view, but not save. | 05:36 |
| nibalizer | no you can | 05:37 |
| nibalizer | if you do the share dashboard | 05:37 |
| nibalizer | it makes a link | 05:37 |
| nibalizer | http://grafana.busywait.com/dashboard/db/nodepool-performance?from=1428090202481&to=1428105958645 | 05:37 |
| nibalizer | you can also 'save' them in ES if tim has that turned on | 05:37 |
| mordred | yah - but i'm not going to be editing something accidentially | 05:37 |
| timrc | I believe I turned on only anonymous viewing of the nodepool-performance dash... so while you can manipulate things in your browser, those should not persist. | 05:38 |
| timrc | Or at least, that was my understanding :) | 05:38 |
| cody-somerville | meow. | 05:39 |
| timrc | Check out http://grafana.org/blog/2015/03/30/Grafana-2-Beta1.html -- User & Organization permissions | 05:40 |
| cody-somerville | Jebus. How do I give these guys my money? Their stuff is hot. | 05:41 |
| nibalizer | cody-somerville: srsly | 05:42 |
| nibalizer | when he showed it off at monitorama last year everyone was like 'SHUT UP QUIT JOB TAKE MONEY' | 05:42 |
| timrc | mordred, I can give you an account with an Editor role if you'd like. | 05:44 |
| *** stevemar has quit IRC | 05:44 | |
| * cody-somerville trolls through Grafana git log looking for people to hire. | 05:44 | |
| timrc | cody-somerville, They might want to rewrite everything in Go :) | 05:45 |
| cody-somerville | Maybe we should. You know, pull a juju. | 05:45 |
| mordred | because that was successful | 05:48 |
| * mordred looks at the masses of happy juju users sabdfl keeps inventing, I mean talking about ... | 05:49 | |
| *** medieval1 has quit IRC | 05:54 | |
| *** unicell has joined #openstack-infra | 05:56 | |
| openstackgerrit | Andrey Pavlov proposed openstack-infra/project-config: Fix ec2-api gating job https://review.openstack.org/170646 | 05:58 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/170651 | 06:01 |
| *** teran has joined #openstack-infra | 06:05 | |
| *** rhe00 has quit IRC | 06:08 | |
| *** rhe00 has joined #openstack-infra | 06:10 | |
| *** teran has quit IRC | 06:10 | |
| *** achanda has joined #openstack-infra | 06:22 | |
| timrc | cody-somerville, It's a little buggy, but I've added the spread graph you liked: http://grafana.busywait.com/dashboard/db/nodepool-performance | 06:22 |
| timrc | Ah I changed the time period, that seemed to get it to render correctly. | 06:23 |
| *** achanda has quit IRC | 06:27 | |
| *** ivar-lazzaro has joined #openstack-infra | 06:28 | |
| *** btully has joined #openstack-infra | 06:29 | |
| *** SumitNaiksatam has joined #openstack-infra | 06:34 | |
| *** hdd has quit IRC | 06:35 | |
| *** SumitNaiksatam has left #openstack-infra | 06:35 | |
| *** Longgeek has joined #openstack-infra | 06:52 | |
| *** medieval1 has joined #openstack-infra | 06:55 | |
| *** medieval1 has quit IRC | 07:00 | |
| *** teran has joined #openstack-infra | 07:06 | |
| *** kiseok7_ has quit IRC | 07:06 | |
| *** mugsie has quit IRC | 07:08 | |
| *** SumitNaiksatam has joined #openstack-infra | 07:09 | |
| *** teran has quit IRC | 07:11 | |
| *** otter768 has joined #openstack-infra | 07:11 | |
| *** otter768 has quit IRC | 07:15 | |
| *** achanda has joined #openstack-infra | 07:16 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Cleanup jenkins/jobs/projects.yaml https://review.openstack.org/168148 | 07:16 |
| *** gulic has quit IRC | 07:19 | |
| openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/170651 | 07:31 |
| *** ujuc has quit IRC | 07:32 | |
| *** e0ne has joined #openstack-infra | 07:39 | |
| *** e0ne has quit IRC | 07:42 | |
| *** e0ne has joined #openstack-infra | 07:46 | |
| *** e0ne has quit IRC | 07:46 | |
| *** sarob has joined #openstack-infra | 07:48 | |
| *** sarob has quit IRC | 07:53 | |
| *** medieval1 has joined #openstack-infra | 07:56 | |
| *** medieval1 has quit IRC | 08:01 | |
| *** teran has joined #openstack-infra | 08:07 | |
| *** sdake_ has quit IRC | 08:08 | |
| *** sdake has joined #openstack-infra | 08:08 | |
| *** teran has quit IRC | 08:11 | |
| *** achanda has quit IRC | 08:21 | |
| *** wicope has joined #openstack-infra | 08:24 | |
| *** wicope has joined #openstack-infra | 08:25 | |
| *** achanda has joined #openstack-infra | 08:26 | |
| *** achanda has quit IRC | 08:27 | |
| *** ivar-lazzaro has quit IRC | 08:38 | |
| *** sputnik13 has quit IRC | 08:40 | |
| *** ivar-lazzaro has joined #openstack-infra | 08:45 | |
| *** Bsony has joined #openstack-infra | 08:46 | |
| *** medieval1 has joined #openstack-infra | 08:58 | |
| *** ivar-lazzaro has quit IRC | 08:58 | |
| *** ivar-lazzaro has joined #openstack-infra | 08:58 | |
| *** dhritishikhar_ has joined #openstack-infra | 09:00 | |
| *** medieval1 has quit IRC | 09:02 | |
| *** ivar-lazzaro has quit IRC | 09:03 | |
| *** teran has joined #openstack-infra | 09:07 | |
| *** otter768 has joined #openstack-infra | 09:12 | |
| *** teran has quit IRC | 09:12 | |
| *** otter768 has quit IRC | 09:16 | |
| *** teran has joined #openstack-infra | 09:18 | |
| *** rkukura has quit IRC | 09:41 | |
| *** btully has quit IRC | 09:43 | |
| *** rkukura has joined #openstack-infra | 09:46 | |
| *** teran has quit IRC | 09:51 | |
| *** medieval1 has joined #openstack-infra | 09:58 | |
| *** medieval1 has quit IRC | 10:03 | |
| *** amotoki has joined #openstack-infra | 10:07 | |
| *** gaelL has quit IRC | 10:11 | |
| *** gaelL has joined #openstack-infra | 10:13 | |
| *** andreykurilin_ has joined #openstack-infra | 10:16 | |
| *** Longgeek has quit IRC | 10:24 | |
| *** wicope has quit IRC | 10:30 | |
| *** Longgeek has joined #openstack-infra | 10:30 | |
| *** Longgeek has quit IRC | 10:35 | |
| *** niska has quit IRC | 10:37 | |
| *** ivar-lazzaro has joined #openstack-infra | 10:38 | |
| *** claudiub has joined #openstack-infra | 10:39 | |
| *** niska has joined #openstack-infra | 10:41 | |
| *** sarob has joined #openstack-infra | 10:49 | |
| *** ivar-lazzaro has quit IRC | 10:52 | |
| *** sarob has quit IRC | 10:53 | |
| openstackgerrit | Max Rydahl Andersen proposed openstack-infra/jenkins-job-builder: Initial work for supporting downstream-ext https://review.openstack.org/158117 | 10:56 |
| *** medieval1 has joined #openstack-infra | 10:59 | |
| *** dhritishikhar_ has quit IRC | 10:59 | |
| openstackgerrit | Max Rydahl Andersen proposed openstack-infra/jenkins-job-builder: Add support for 'raw' to inject direct xml to job configs. https://review.openstack.org/160158 | 11:03 |
| *** medieval1 has quit IRC | 11:04 | |
| *** otter768 has joined #openstack-infra | 11:13 | |
| *** andreykurilin_ has quit IRC | 11:13 | |
| *** otter768 has quit IRC | 11:17 | |
| *** btully has joined #openstack-infra | 11:20 | |
| *** dhritishikhar_ has joined #openstack-infra | 11:20 | |
| *** mjordan has joined #openstack-infra | 11:22 | |
| *** btully has quit IRC | 11:24 | |
| *** medieval1 has joined #openstack-infra | 11:31 | |
| *** hashar has joined #openstack-infra | 11:34 | |
| *** kutija has joined #openstack-infra | 11:39 | |
| *** mjordan has quit IRC | 11:40 | |
| *** medieval1 has joined #openstack-infra | 11:48 | |
| *** yamamoto has quit IRC | 11:48 | |
| *** medieval1 has quit IRC | 11:49 | |
| *** hashar has quit IRC | 12:04 | |
| *** hdd has joined #openstack-infra | 12:19 | |
| openstackgerrit | Max Rydahl Andersen proposed openstack-infra/jenkins-job-builder: Add support for 'raw' to inject direct xml to job configs. https://review.openstack.org/160158 | 12:37 |
| *** yamamoto has joined #openstack-infra | 12:45 | |
| *** yamamoto has quit IRC | 12:45 | |
| *** amotoki has quit IRC | 12:49 | |
| *** yamamoto has joined #openstack-infra | 12:51 | |
| *** yamamoto has quit IRC | 12:52 | |
| *** dimsum__ has joined #openstack-infra | 12:58 | |
| *** dims_ has joined #openstack-infra | 13:04 | |
| *** dimsum__ has quit IRC | 13:06 | |
| *** otter768 has joined #openstack-infra | 13:13 | |
| *** amotoki has joined #openstack-infra | 13:15 | |
| *** sarob has joined #openstack-infra | 13:16 | |
| *** claudiub has quit IRC | 13:16 | |
| *** otter768 has quit IRC | 13:18 | |
| *** weshay has quit IRC | 13:19 | |
| *** sarob has quit IRC | 13:20 | |
| *** masoz has quit IRC | 13:24 | |
| *** baoli has joined #openstack-infra | 13:24 | |
| *** baoli has quit IRC | 13:30 | |
| *** baoli has joined #openstack-infra | 13:32 | |
| *** amotoki has quit IRC | 13:33 | |
| *** YorikSar has quit IRC | 13:34 | |
| *** baoli has quit IRC | 13:37 | |
| *** baoli has joined #openstack-infra | 13:39 | |
| *** wicope has joined #openstack-infra | 13:47 | |
| *** Kiall has quit IRC | 13:54 | |
| *** tnovacik has joined #openstack-infra | 13:54 | |
| *** Kiall has joined #openstack-infra | 13:56 | |
| *** rbradfor has joined #openstack-infra | 14:07 | |
| *** dims_ has quit IRC | 14:12 | |
| *** baoli has quit IRC | 14:18 | |
| *** hdd has quit IRC | 14:22 | |
| mordred | timrc: ping when you're up | 14:22 |
| *** YorikSar has joined #openstack-infra | 14:24 | |
| *** ajmiller_ is now known as ajmiller | 14:39 | |
| *** yamamoto has joined #openstack-infra | 14:41 | |
| *** ZZelle has quit IRC | 14:43 | |
| *** ZZelle has joined #openstack-infra | 14:44 | |
| timrc | mordred, Just pulled myself out of a nyquil coma. What's up? | 14:45 |
| *** yamamoto has quit IRC | 14:46 | |
| *** baoli has joined #openstack-infra | 14:47 | |
| *** btully has joined #openstack-infra | 14:56 | |
| *** woodster_ has joined #openstack-infra | 14:57 | |
| *** enikanorov has joined #openstack-infra | 15:00 | |
| *** dhritishikhar_ has quit IRC | 15:00 | |
| *** btully has quit IRC | 15:00 | |
| *** baoli has quit IRC | 15:01 | |
| *** annegentle has joined #openstack-infra | 15:11 | |
| *** annegentle is now known as Guest7380 | 15:11 | |
| *** baoli has joined #openstack-infra | 15:11 | |
| *** Guest7380 is now known as agentle_wkend | 15:12 | |
| *** dimsum__ has joined #openstack-infra | 15:13 | |
| *** zz_dimtruck is now known as dimtruck | 15:14 | |
| *** otter768 has joined #openstack-infra | 15:14 | |
| *** dimsum__ has quit IRC | 15:18 | |
| *** otter768 has quit IRC | 15:19 | |
| clarkb | we use older kibana on logstash.o.o because kibana3 is silly. It wants to do things like write to es indexes and I never managed to figure out how to make it less silly | 15:20 |
| *** baoli has quit IRC | 15:22 | |
| mordred | timrc: if you get bored at some point, I'd love a short note on what you did to set it up ... also, are the graphs on it configured through the web? or can you configure them in config files on disk? | 15:24 |
| *** mriedem has joined #openstack-infra | 15:24 | |
| timrc | mordred, They are configured through the web. For this deployment I installed their debian package on an hpcloud instance, started the grafana service, and logged in with the default admin creds. | 15:25 |
| timrc | mordred, I do not know if you can build the graphs with files on disk. | 15:25 |
| mordred | gotcha. cool. thanks! | 15:26 |
| *** emagana has joined #openstack-infra | 15:26 | |
| mordred | that's pretty easy as a setup... it would be lamer for infra to run one if the set of graphs to display have to be configured through the web | 15:26 |
| clarkb | oh wow thats log10 not linear | 15:27 |
| timrc | clarkb, Yeah. | 15:27 |
| timrc | Pretty sad statement being made there :) | 15:27 |
| timrc | mordred, I'll look to see if graphs can be configured from files on a disk. At the moment, this install is using an sqlite3 db, as well (the default) but can be configured to use myql, postgresql, etc. | 15:28 |
| *** armax has joined #openstack-infra | 15:30 | |
| clarkb | mordred that first graph makes a case for floating IPs being :( | 15:31 |
| *** alexpilotti has joined #openstack-infra | 15:31 | |
| clarkb | I've made the argument before but good to see it in an easy to consume info dump | 15:33 |
| mordred | timrc: cool. I mean, I like the explorability a lot - but if the graphs have to be managed through the web it's kind of a non-starter for us | 15:33 |
| mordred | clarkb: yah. for sure | 15:33 |
| mordred | clarkb: I think they're a great construct for specific apps that need that thing | 15:33 |
| mordred | clarkb: but as a general "this is how you get network access" it's very stupid | 15:33 |
| mordred | clarkb: it's like allocating a load balancer to get an external ip - except a load balancer that is pretty bad | 15:33 |
| timrc | mordred, Got it. Yeah. | 15:34 |
| agentle_wkend | ok need another idea bounced off. I need to figure out how many contributors there are to an individual directory in a repo. I've poked around github, activity.openstack, and stackalytics but can't find directory-level stats. Any ideas? | 15:35 |
| agentle_wkend | it's so I can see which guides in openstack-manuals have more contributors | 15:36 |
| agentle_wkend | or at least see patterns | 15:36 |
| clarkb | you can `git log $dir` and pass in a couple other flags to get just the authors out | 15:38 |
| jeblair | agentle_wkend: could probably do that with 'git log', which you can restrict to a certain directory, eg 'git log foo/' | 15:38 |
| *** baoli has joined #openstack-infra | 15:38 | |
| jeblair | agentle_wkend: git log --pretty=format:"%an <%ae>" directory/ | 15:40 |
| agentle_wkend | jeblair: there we go, I was playing with git shortlog and if it can do directories I'm good to goo | 15:40 |
| timrc | mordred, So it appears that all of the graphing and dashboard data is just json. | 15:40 |
| agentle_wkend | jeblair: is a Jenkins entry the bot, and I should only count people entries? | 15:41 |
| agentle_wkend | jeblair: https://gist.github.com/anonymous/993e68c476454bd3f1e6 should the Jenkins and OpenStack Proposal Bot entries add up to the number of all the other entries? | 15:42 |
| agentle_wkend | clarkb: jeblair: that ^^ was from git shortlog -s -n doc/admin-guide-cloud/ | 15:43 |
| agentle_wkend | in the openstack-manuals repo | 15:43 |
| *** dimtruck is now known as zz_dimtruck | 15:43 | |
| jeblair | agentle_wkend: jenkins adding up to the others is not surprising due to merge commits -- jenkins is the author of record for those, and many (most? all?) changes we merge end up with merge commits | 15:44 |
| timrc | mordred, And there is a way to import json from the dash.... so now all I need to figure out is if I can write json some where that grafana will automatically import from. | 15:44 |
| mordred | it's possible that a change can not have a corresponding merge commit though | 15:44 |
| agentle_wkend | jeblair: ok, just trying to make sure I'm counting people not bots | 15:44 |
| *** akshai has joined #openstack-infra | 15:44 | |
| *** tkelsey has joined #openstack-infra | 15:44 | |
| timrc | mordred, That is something I'll need to figure out this evening. I have a lot of house chores that piled up that I've been promising my wife I'd do for weeks :) | 15:45 |
| *** akshai has quit IRC | 15:45 | |
| jeblair | agentle_wkend: yeah, if you just ignore jenkins and the proposal bot, you should be good (though of course the proposal bot is responsible for real translations authored by people, but the trail goes cold there with our current tooling) | 15:45 |
| agentle_wkend | jeblair: good, I'm going to measure translation through the other tooling, so it's fair for this measure | 15:46 |
| agentle_wkend | jeblair: unless you think counting percent translated isn't a good measure of "activity" on a guide | 15:46 |
| *** tkelsey has quit IRC | 15:48 | |
| *** emagana has quit IRC | 15:49 | |
| *** emagana has joined #openstack-infra | 15:50 | |
| jeblair | agentle_wkend: i think that's important. probably also how quickly translations are updated? but i think the translators focus more on the cycle anyway, so i'm not sure how that metric will work out. | 15:50 |
| agentle_wkend | jeblair: good point. I'm focusing on a year's worth, but should figure out how to take release cycles into account | 15:51 |
| *** emagana has quit IRC | 15:54 | |
| timrc | mordred, Okay so it's JSON stored in a database column. So it seems simple enough to create json dashboard files that can be stored in project-config and then write a script to that will load them into the database. | 15:55 |
| mordred | timrc: I agree- that does sound fairly simple | 15:57 |
| *** agentle_wkend has quit IRC | 15:58 | |
| timrc | mordred, I'm work on a POC of that this weekend. | 15:58 |
| timrc | Erm.. I'm going to | 15:58 |
| mordred | timrc: don't ignore the wife chores too much - otherwise you will be a bad person | 15:58 |
| timrc | It appears the nyquil is still having some effect. Maybe I should have used the dosage cap and not just "guesstimated" as I chugged. | 15:59 |
| mordred | :) | 15:59 |
| jeblair | timrc: before you go crazy, let's figure out what we want to use this for | 15:59 |
| jeblair | timrc: i mean, if you want to explore a bit more, that's cool. but i don't want you to waste effort if we end up not using it... | 16:02 |
| *** zz_dimtruck is now known as dimtruck | 16:03 | |
| jeblair | timrc: so when you get to the point where you would be unhappy if we didn't proceed with it, let's be sure to chat and make sure we have needs and use cases that it will cover | 16:03 |
| timrc | jeblair, Sure. | 16:03 |
| *** armax has quit IRC | 16:05 | |
| timrc | Our immediate need downstream at least is a way to monitor nodepool performance. To accompany this I also want to measure job completion times to get an idea of throughput. I think it'll be used less for monitoring and more for things like capacity planning or calling out inefficiencies or anomalies so they can be further investigated and / or resolved. | 16:05 |
| *** YorikSar has quit IRC | 16:05 | |
| timrc | That first monitor should be an analyze. | 16:05 |
| *** sdake has quit IRC | 16:06 | |
| *** davideagnello has joined #openstack-infra | 16:06 | |
| *** sarob_ has joined #openstack-infra | 16:07 | |
| *** emagana has joined #openstack-infra | 16:09 | |
| ekarlso | a | 16:11 |
| *** dimtruck is now known as zz_dimtruck | 16:17 | |
| *** YorikSar has joined #openstack-infra | 16:20 | |
| zaro | fungi: sorry to bother you. I've managed to mess up the review-dev db last night (around 0400 utc time). next time you are free would you mind getting me a backup of the review-dev db? one from thurs or early fri would be best. | 16:29 |
| fungi | zaro: they're on review-dev in the /var/backups/mysql_backups directory. there's about a month's worth of daily dumps in there | 16:37 |
| *** boris-42 has quit IRC | 16:38 | |
| *** YorikSar has quit IRC | 16:41 | |
| *** davideagnello has quit IRC | 16:46 | |
| *** emagana has quit IRC | 16:55 | |
| *** emagana has joined #openstack-infra | 16:56 | |
| *** agentle_wkend has joined #openstack-infra | 16:58 | |
| *** emagana has quit IRC | 17:01 | |
| *** agentle_wkend has quit IRC | 17:03 | |
| *** davideagnello has joined #openstack-infra | 17:09 | |
| *** davideagnello has quit IRC | 17:13 | |
| *** dimsum__ has joined #openstack-infra | 17:13 | |
| *** otter768 has joined #openstack-infra | 17:15 | |
| *** _nadya_ has joined #openstack-infra | 17:15 | |
| *** bswartz has quit IRC | 17:16 | |
| *** bswartz has joined #openstack-infra | 17:17 | |
| *** ricolin has joined #openstack-infra | 17:17 | |
| *** ricolin has quit IRC | 17:18 | |
| *** otter768 has quit IRC | 17:20 | |
| *** dtroyer has quit IRC | 17:29 | |
| *** btully has joined #openstack-infra | 17:35 | |
| *** dimsum__ has quit IRC | 17:51 | |
| *** _nadya_ has quit IRC | 17:57 | |
| *** agentle_wkend has joined #openstack-infra | 17:59 | |
| *** vinkman has quit IRC | 18:00 | |
| *** agentle_wkend has quit IRC | 18:04 | |
| *** woodster_ has quit IRC | 18:20 | |
| *** agentle_wkend has joined #openstack-infra | 18:21 | |
| *** tnovacik has quit IRC | 18:25 | |
| *** otter768 has joined #openstack-infra | 18:26 | |
| *** e0ne has joined #openstack-infra | 18:29 | |
| agentle_wkend | oh! And I would really love it if the infra team could help out Rackspace with our docs information architecture. I tweeted it out yesterday, http://j.mp/1yKl0Ko is the survey link. clarkb jeblair mordred I know we've talked about improving Rackspace docs, please offer input :) | 18:31 |
| *** e0ne has quit IRC | 18:31 | |
| zaro | Thanks fungi! Promise to remember that the db is backed up to same machine so i won't have to bother about this again :) Anyways I was able to fix review-dev and test my migration script on it as well. | 18:33 |
| fungi | tweets. how quaint! | 18:33 |
| fungi | zaro: awesome. it's probably not clearly documented, but that's how our database backup puppet modules work (they're basically just wrapping cron jobs running dump commands to the local machine so our filesystem backups will pick them up) | 18:35 |
| fungi | wow... a 34-item sort. that smacks of committee | 18:38 |
| *** yfried has joined #openstack-infra | 18:40 | |
| *** yfried has quit IRC | 18:43 | |
| *** yfried has joined #openstack-infra | 18:43 | |
| *** dhritishikhar_ has joined #openstack-infra | 18:48 | |
| *** dimsum__ has joined #openstack-infra | 18:51 | |
| *** dimsum__ has quit IRC | 18:57 | |
| *** e0ne has joined #openstack-infra | 18:58 | |
| *** vinkman has joined #openstack-infra | 19:00 | |
| *** e0ne has quit IRC | 19:00 | |
| *** davideagnello has joined #openstack-infra | 19:01 | |
| *** e0ne has joined #openstack-infra | 19:04 | |
| *** woodster_ has joined #openstack-infra | 19:05 | |
| *** davideagnello has quit IRC | 19:06 | |
| agentle_wkend | fungi: it's a 34-item sort? I haven't seen the whole thing! | 19:07 |
| *** stevemar has joined #openstack-infra | 19:07 | |
| *** e0ne has quit IRC | 19:08 | |
| *** baoli has quit IRC | 19:09 | |
| *** e0ne has joined #openstack-infra | 19:13 | |
| *** e0ne has quit IRC | 19:18 | |
| *** boris-42 has joined #openstack-infra | 19:18 | |
| *** dboik has joined #openstack-infra | 19:20 | |
| *** dhritishikhar_ has quit IRC | 19:20 | |
| *** stevemar has quit IRC | 19:21 | |
| *** e0ne has joined #openstack-infra | 19:21 | |
| *** e0ne has quit IRC | 19:24 | |
| *** otter768 has quit IRC | 19:30 | |
| *** agentle_wkend has quit IRC | 19:39 | |
| *** agentle_wkend has joined #openstack-infra | 19:40 | |
| *** agentle_wkend has quit IRC | 19:45 | |
| fungi | agentle_wkend: yeah, but i powered through anyway | 19:45 |
| *** tkelsey has joined #openstack-infra | 19:46 | |
| *** tkelsey has quit IRC | 19:50 | |
| *** achanda has joined #openstack-infra | 19:59 | |
| *** zz_dimtruck is now known as dimtruck | 20:00 | |
| *** dimtruck is now known as zz_dimtruck | 20:02 | |
| *** zz_dimtruck is now known as dimtruck | 20:02 | |
| *** achanda has quit IRC | 20:07 | |
| *** yamamoto has joined #openstack-infra | 20:07 | |
| *** baoli has joined #openstack-infra | 20:09 | |
| *** yamamoto has quit IRC | 20:12 | |
| *** baoli has quit IRC | 20:14 | |
| *** SumitNaiksatam has quit IRC | 20:22 | |
| *** dimsum__ has joined #openstack-infra | 20:24 | |
| *** SumitNaiksatam has joined #openstack-infra | 20:26 | |
| *** dboik has quit IRC | 20:27 | |
| *** sarob_ has quit IRC | 20:31 | |
| *** agentle_wkend has joined #openstack-infra | 20:41 | |
| *** agentle_wkend has quit IRC | 20:45 | |
| *** Bsony has quit IRC | 20:55 | |
| *** hdd has joined #openstack-infra | 21:09 | |
| *** sarob has joined #openstack-infra | 21:10 | |
| *** hdd has quit IRC | 21:13 | |
| *** sarob has quit IRC | 21:15 | |
| *** wicope has quit IRC | 21:26 | |
| *** sarob has joined #openstack-infra | 21:27 | |
| *** otter768 has joined #openstack-infra | 21:31 | |
| *** sarob has quit IRC | 21:32 | |
| *** dimtruck is now known as zz_dimtruck | 21:33 | |
| *** otter768 has quit IRC | 21:36 | |
| *** harlowja_at_home has joined #openstack-infra | 21:37 | |
| *** harlowja_at_home has quit IRC | 21:38 | |
| *** agentle_wkend has joined #openstack-infra | 21:38 | |
| *** baoli has joined #openstack-infra | 21:40 | |
| *** baoli has quit IRC | 21:45 | |
| *** tnovacik has joined #openstack-infra | 21:45 | |
| *** agentle_wkend has quit IRC | 21:51 | |
| *** andreykurilin_ has joined #openstack-infra | 21:58 | |
| *** achanda has joined #openstack-infra | 22:03 | |
| *** dmellado has quit IRC | 22:04 | |
| *** dmellado has joined #openstack-infra | 22:05 | |
| *** achanda has quit IRC | 22:20 | |
| *** achanda has joined #openstack-infra | 22:23 | |
| *** sputnik13 has joined #openstack-infra | 22:25 | |
| *** achanda has quit IRC | 22:27 | |
| *** btully has quit IRC | 22:28 | |
| *** btully has joined #openstack-infra | 22:29 | |
| *** sputnik13 has quit IRC | 22:30 | |
| *** baoli has joined #openstack-infra | 22:41 | |
| *** unicell1 has joined #openstack-infra | 22:41 | |
| *** unicell has quit IRC | 22:41 | |
| *** baoli has quit IRC | 22:46 | |
| *** unicell has joined #openstack-infra | 22:47 | |
| *** unicell1 has quit IRC | 22:49 | |
| *** agentle_wkend has joined #openstack-infra | 22:52 | |
| *** btully has quit IRC | 22:55 | |
| *** agentle_wkend has quit IRC | 22:57 | |
| *** tnovacik has quit IRC | 23:00 | |
| *** btully has joined #openstack-infra | 23:04 | |
| *** zz_dimtruck is now known as dimtruck | 23:08 | |
| *** woodster_ has quit IRC | 23:10 | |
| *** bradjones has quit IRC | 23:10 | |
| *** masoz has joined #openstack-infra | 23:12 | |
| *** bradjones has joined #openstack-infra | 23:12 | |
| *** bradjones has quit IRC | 23:12 | |
| *** bradjones has joined #openstack-infra | 23:12 | |
| *** wenlock has joined #openstack-infra | 23:23 | |
| *** btully has quit IRC | 23:23 | |
| *** btully has joined #openstack-infra | 23:24 | |
| *** vinkman has quit IRC | 23:26 | |
| *** dboik has joined #openstack-infra | 23:27 | |
| *** baoli has joined #openstack-infra | 23:29 | |
| *** baoli has quit IRC | 23:29 | |
| *** dboik has quit IRC | 23:32 | |
| *** baoli has joined #openstack-infra | 23:32 | |
| *** otter768 has joined #openstack-infra | 23:32 | |
| *** dtroyer has joined #openstack-infra | 23:34 | |
| *** baoli has quit IRC | 23:37 | |
| *** otter768 has quit IRC | 23:37 | |
| *** btully has quit IRC | 23:46 | |
| *** sputnik13 has joined #openstack-infra | 23:47 | |
| *** tkelsey has joined #openstack-infra | 23:47 | |
| *** tkelsey has quit IRC | 23:52 | |
| *** btully has joined #openstack-infra | 23:53 | |
| *** agentle_wkend has joined #openstack-infra | 23:53 | |
| *** andreykurilin_ has quit IRC | 23:54 | |
| *** dimtruck is now known as zz_dimtruck | 23:57 | |
| *** agentle_wkend has quit IRC | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!