Saturday, 2015-07-11

*** davideagnello has quit IRC00:01
*** dims has quit IRC00:03
*** Longgeek has quit IRC00:04
clarkbmtreinish sqlite00:06
*** bitblt has joined #openstack-infra00:07
*** zz_dimtruck is now known as dimtruck00:08
mtreinishclarkb: did I spell it wrong?00:09
clarkbosorry didnt finish my thoughr00:10
mtreinishheh, no worries :)00:10
clarkbI was going to suggest that as a pythob version safe db too00:10
clarkbsince it should be the same everywhere00:10
*** jasondot_ has quit IRC00:11
mtreinishyep, and I think using subunit2sql makes a lot of sense for this too, although it's a bit more work than just switching dbm to sqlite00:12
mtreinishbut sqlite is complete overkill for how testr is using the dbm file right now00:12
mtreinishbecause all it stores is key value pairs, test_id: runtime00:12
mtreinishand only the most recent runtime for a test is in the dbm it doesn't track across multiples00:13
mordredmongodb00:14
mordredwith docker00:14
mordreddone00:14
mtreinishhaha00:14
*** ddieterly has joined #openstack-infra00:15
*** dboik has joined #openstack-infra00:20
Clintjeblair: is it intended that gertty doesn't support - as negation in search queries?00:22
*** tsekiyam_ has joined #openstack-infra00:22
*** weshay has quit IRC00:23
*** mtanino has quit IRC00:23
*** e0ne has joined #openstack-infra00:24
*** dimtruck is now known as zz_dimtruck00:24
*** e0ne has quit IRC00:25
*** tsekiyama has quit IRC00:26
*** tsekiyam_ has quit IRC00:26
mordredClint: negation is the work of the devil00:28
*** sripriya has joined #openstack-infra00:29
*** jasondotstar has joined #openstack-infra00:31
Clintmordred: that's okay, kris kristofferson taught me well00:31
*** linkedinyou has joined #openstack-infra00:32
*** bitblt has quit IRC00:38
*** ajmiller has quit IRC00:40
*** sdake_ has joined #openstack-infra00:45
*** dboik has quit IRC00:46
*** sdake has quit IRC00:49
* timrc thinks we should put the information zuul reports to the log into a webscale, shardable Internet-famous database or something. The information is too useful to leave to log files.00:56
nibalizerya!00:57
mtreinishtimrc: isn't that the idea behind the zuul mysql reporter?00:59
timrcmtreinish, I know not of this reporter... so maybe>00:59
timrc?00:59
mtreinishtimrc: it was something jhesketh was working on IIRC I don't think it ever landed in the zuul repo though01:00
openstackgerritJoshua Harlow proposed openstack-infra/gerritlib: Add ability for this thread to die/cleanup  https://review.openstack.org/17139301:00
openstackgerritJoshua Harlow proposed openstack-infra/gerritlib: Add new tests to ensure data is captured  https://review.openstack.org/17144901:01
timrcmtreinish, Sounds interesting and useful.01:01
openstackgerritJoshua Harlow proposed openstack-infra/gerritlib: Add basic state transition tests  https://review.openstack.org/17175801:01
openstackgerritJoshua Harlow proposed openstack-infra/gerritlib: Add test for reconnect attempts  https://review.openstack.org/17176301:01
mtreinishtimrc: https://review.openstack.org/#/c/65885/01:02
mtreinishit's pretty simple there, but it could easily be expanded to include all the pieces you are tracking01:03
timrcmtreinish, Yeah I'm looking at the change now.  It doesn't look like it's storing information in a way that would make it much better than parsing logs.01:03
*** _amrith_ is now known as amrith01:03
timrcmtreinish, I'm working on a script that parses the zuul.log and charts the events and the time between those events for a given change/build.  So what would be an improvement over that is if the data was already structured.01:06
*** btully has quit IRC01:06
timrcstructured and query-able*01:07
*** puranamr has quit IRC01:07
*** otter768 has joined #openstack-infra01:08
*** unicell has quit IRC01:10
*** otter768 has quit IRC01:13
*** baoli has joined #openstack-infra01:13
*** Longgeek has joined #openstack-infra01:15
*** baoli has quit IRC01:18
*** jasondotstar has quit IRC01:20
openstackgerritJoshua Harlow proposed openstack-infra/gerritlib: Add ability for this thread to die/cleanup  https://review.openstack.org/17139301:20
*** ivar-lazzaro has quit IRC01:21
*** Longgeek has quit IRC01:23
*** baoli has joined #openstack-infra01:26
*** baoli has quit IRC01:26
*** baoli has joined #openstack-infra01:27
*** baoli has quit IRC01:27
*** baoli has joined #openstack-infra01:28
*** zz_dimtruck is now known as dimtruck01:28
*** sdake has joined #openstack-infra01:31
*** baoli has quit IRC01:32
*** btully has joined #openstack-infra01:33
*** davideagnello has joined #openstack-infra01:34
*** kzaitsev_mb has quit IRC01:35
*** sdake_ has quit IRC01:35
*** jasondotstar has joined #openstack-infra01:36
openstackgerritMadhusudhan Kandadai proposed openstack-infra/project-config: New jobs for neutron-lbaasv2 scenario tests  https://review.openstack.org/19975401:39
*** amotoki has quit IRC01:39
*** unicell has joined #openstack-infra01:42
*** shashank_hegde_ has joined #openstack-infra01:43
*** salv-orlando has joined #openstack-infra01:43
*** salv-orlando has quit IRC01:48
*** achanda has quit IRC01:52
*** baoli has joined #openstack-infra01:53
*** baoli has quit IRC01:53
*** baoli has joined #openstack-infra01:54
*** shashank_hegde_ has quit IRC01:56
*** sripriya has quit IRC01:56
*** jerryz has quit IRC01:59
*** sridhar_ram has quit IRC02:00
*** lhcheng has quit IRC02:03
*** laughterwym has joined #openstack-infra02:05
*** harlowja_at_home has joined #openstack-infra02:07
openstackgerritJoshua Harlow proposed openstack-infra/gerritlib: Add test for reconnect attempts  https://review.openstack.org/17176302:12
openstackgerritJoshua Harlow proposed openstack-infra/gerritlib: Add basic state transition tests  https://review.openstack.org/17175802:12
openstackgerritJoshua Harlow proposed openstack-infra/gerritlib: Add new tests to ensure data is captured  https://review.openstack.org/17144902:12
*** miqui has quit IRC02:15
*** dims has joined #openstack-infra02:16
*** yamahata has quit IRC02:19
*** coolsvap|away has quit IRC02:21
*** crc32 has quit IRC02:21
*** yamamoto has joined #openstack-infra02:22
*** coolsvap|away has joined #openstack-infra02:23
*** davideagnello has quit IRC02:25
*** krotscheck has quit IRC02:28
*** yamamoto has quit IRC02:28
*** ianw has quit IRC02:29
*** krotscheck has joined #openstack-infra02:29
*** ianw has joined #openstack-infra02:29
*** shashank_hegde_ has joined #openstack-infra02:31
*** amotoki has joined #openstack-infra02:40
*** sdake_ has joined #openstack-infra02:42
*** amotoki has quit IRC02:45
*** sdake has quit IRC02:46
*** shashank_hegde_ has quit IRC02:47
*** shashank_hegde_ has joined #openstack-infra02:49
*** achanda has joined #openstack-infra02:53
*** salv-orlando has joined #openstack-infra02:55
*** laughterwym has quit IRC02:55
*** shashank_hegde_ has quit IRC02:55
*** jasondotstar has quit IRC02:56
*** achanda has quit IRC02:57
*** salv-orlando has quit IRC02:57
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/project-config: Add dsvm job for oslo.cache  https://review.openstack.org/20073103:02
pleia2Clint: thanks re: freenode ticket \o/03:02
*** otter768 has joined #openstack-infra03:08
*** boris-42 has quit IRC03:12
*** otter768 has quit IRC03:13
*** jgriffith has joined #openstack-infra03:15
*** harlowja_at_home has quit IRC03:18
*** Longgeek has joined #openstack-infra03:20
*** yamamoto has joined #openstack-infra03:20
openstackgerritDavanum Srinivas (dims) proposed openstack/requirements: Make mock 1.1 the minimum version.  https://review.openstack.org/20034403:22
*** markvoelker has quit IRC03:23
*** dims has quit IRC03:23
*** Kennan2 has quit IRC03:24
*** Kennan has joined #openstack-infra03:24
*** markvoelker has joined #openstack-infra03:25
openstackgerritMerged openstack-infra/release-tools: Be safer with git refs.  https://review.openstack.org/19973603:25
*** julim has quit IRC03:26
*** heyongli has quit IRC03:27
*** heyongli has joined #openstack-infra03:28
*** yamamoto has quit IRC03:29
*** markvoelker has quit IRC03:31
*** btully has quit IRC03:37
*** baoli has quit IRC03:39
*** shashank_hegde_ has joined #openstack-infra03:40
*** amotoki has joined #openstack-infra03:41
*** ddieterly has quit IRC03:44
*** amotoki has quit IRC03:45
*** Longgeek has quit IRC03:46
*** mpopow has quit IRC03:49
*** markvoelker has joined #openstack-infra03:50
*** heyongli has quit IRC03:53
*** heyongli has joined #openstack-infra03:54
*** markvoelker has quit IRC03:56
*** jasondotstar has joined #openstack-infra03:57
*** dimtruck is now known as zz_dimtruck04:01
*** markvoelker has joined #openstack-infra04:06
*** armax has quit IRC04:07
*** sigmavirus24 is now known as sigmavirus24_awa04:11
*** woodster_ has quit IRC04:11
*** Guest55 has joined #openstack-infra04:13
*** shashank_hegde_ has quit IRC04:14
*** Guest55 has quit IRC04:17
*** markvoelker has quit IRC04:17
*** shashank_hegde_ has joined #openstack-infra04:17
*** jasondotstar has quit IRC04:22
*** bdemers has quit IRC04:26
*** yamamoto has joined #openstack-infra04:30
*** geoffarnold has joined #openstack-infra04:34
*** heyongli has quit IRC04:35
*** yamamoto has quit IRC04:35
*** geoffarnold has quit IRC04:35
*** heyongli has joined #openstack-infra04:36
*** geoffarnold has joined #openstack-infra04:36
*** amotoki has joined #openstack-infra04:41
*** Longgeek has joined #openstack-infra04:43
*** zz_dimtruck is now known as dimtruck04:43
*** ddieterly has joined #openstack-infra04:45
*** amotoki has quit IRC04:47
*** markvoelker has joined #openstack-infra04:48
*** Murad has quit IRC04:49
*** ddieterly has quit IRC04:49
*** mpopow has joined #openstack-infra04:50
*** markvoelker_ has joined #openstack-infra04:53
*** yamamoto has joined #openstack-infra04:54
*** salv-orlando has joined #openstack-infra04:55
*** markvoelker has quit IRC04:55
*** mpopow has quit IRC04:55
*** achanda has joined #openstack-infra04:56
*** markvoelker_ has quit IRC04:59
*** salv-orlando has quit IRC05:00
*** yamamoto has quit IRC05:00
*** achanda has quit IRC05:00
*** Longgeek has quit IRC05:01
*** linkedinyou has quit IRC05:03
*** markvoelker has joined #openstack-infra05:04
*** dimtruck is now known as zz_dimtruck05:08
*** markvoelker_ has joined #openstack-infra05:08
*** otter768 has joined #openstack-infra05:09
*** davideagnello has joined #openstack-infra05:10
*** baoli has joined #openstack-infra05:10
*** markvoelker has quit IRC05:11
*** markvoelker has joined #openstack-infra05:14
*** markvoelker_ has quit IRC05:14
*** otter768 has quit IRC05:14
*** heyongli has quit IRC05:14
*** baoli has quit IRC05:15
*** heyongli has joined #openstack-infra05:16
*** markvoelker_ has joined #openstack-infra05:24
*** unicell has quit IRC05:25
openstackgerritMerged openstack-infra/project-config: Activate KEEP_LOCALRC for Murano  https://review.openstack.org/20046405:25
*** _nadya_ has joined #openstack-infra05:25
*** markvoelker has quit IRC05:27
openstackgerritMerged openstack-infra/project-config: Added non voting Murano coverage job  https://review.openstack.org/20044505:30
openstackgerritMerged openstack-infra/project-config: Add an experimental ceilometer grenade job  https://review.openstack.org/20008605:30
openstackgerritMerged openstack-infra/project-config: Add experimental Cinder job for LIO  https://review.openstack.org/19807905:31
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Rename stackforge/os-ansible-deployment{,specs}  https://review.openstack.org/20073005:33
*** btully has joined #openstack-infra05:34
*** davideagnello has quit IRC05:35
*** davideagnello has joined #openstack-infra05:38
*** markvoelker has joined #openstack-infra05:39
*** sdake_ has quit IRC05:40
*** amotoki has joined #openstack-infra05:42
*** markvoelker_ has quit IRC05:43
*** markvoelker has quit IRC05:43
*** markvoelker has joined #openstack-infra05:43
*** ddieterly has joined #openstack-infra05:46
*** amotoki has quit IRC05:47
*** ddieterly has quit IRC05:50
*** _nadya_ has quit IRC05:51
*** _nadya_ has joined #openstack-infra05:51
*** Sukhdev has joined #openstack-infra05:53
*** _nadya_ has quit IRC05:55
*** sambetts has quit IRC05:57
*** davideagnello has quit IRC06:00
*** geoffarnold has quit IRC06:11
*** baoli has joined #openstack-infra06:11
*** geoffarnold has joined #openstack-infra06:11
*** baoli has quit IRC06:15
*** fawadkhaliq has joined #openstack-infra06:19
*** Longgeek has joined #openstack-infra06:28
*** achanda has joined #openstack-infra06:33
*** salv-orlando has joined #openstack-infra06:39
*** Longgeek has quit IRC06:43
*** amotoki has joined #openstack-infra06:43
*** Longgeek has joined #openstack-infra06:45
*** ddieterly has joined #openstack-infra06:47
*** amotoki has quit IRC06:47
*** ddieterly has quit IRC06:48
*** ddieterly has joined #openstack-infra06:48
*** salv-orlando has quit IRC06:51
*** shashank_hegde_ has joined #openstack-infra06:52
*** ddieterly has quit IRC06:53
*** yamamoto has joined #openstack-infra06:55
*** yamamoto has quit IRC07:01
*** otter768 has joined #openstack-infra07:10
*** fawadkhaliq has quit IRC07:11
*** fawadkhaliq has joined #openstack-infra07:12
*** shashank_hegde_ has quit IRC07:14
*** otter768 has quit IRC07:15
*** michchap_ has joined #openstack-infra07:16
*** achanda has quit IRC07:16
*** michchap has quit IRC07:16
*** sanjayu has joined #openstack-infra07:17
*** fawadkhaliq has quit IRC07:22
*** fawadkhaliq has joined #openstack-infra07:22
*** fawadkhaliq has quit IRC07:23
*** fawadkhaliq has joined #openstack-infra07:25
*** fawadkhaliq has quit IRC07:26
*** fawadk has joined #openstack-infra07:26
*** binbincong has joined #openstack-infra07:40
*** fawadk has quit IRC07:42
*** amotoki has joined #openstack-infra07:44
*** amotoki has quit IRC07:49
*** che-arne has joined #openstack-infra07:49
*** ddieterly has joined #openstack-infra07:49
*** Sukhdev has quit IRC07:53
*** salv-orlando has joined #openstack-infra07:53
*** ddieterly has quit IRC07:54
*** markvoelker has quit IRC07:57
*** salv-orlando has quit IRC08:00
*** fawadkhaliq has joined #openstack-infra08:06
*** kzaitsev_mb has joined #openstack-infra08:13
*** zxiiro has quit IRC08:20
*** btully has quit IRC08:34
openstackgerritMerged openstack-infra/project-config: Requirements updates clone from git.o.o  https://review.openstack.org/20072608:37
*** yamamoto has joined #openstack-infra08:40
*** yamamoto has quit IRC08:41
*** salv-orlando has joined #openstack-infra08:43
*** amotoki has joined #openstack-infra08:44
*** amotoki has quit IRC08:49
*** ddieterly has joined #openstack-infra08:50
*** jasondotstar has joined #openstack-infra08:52
*** ddieterly has quit IRC08:55
*** swat30 has quit IRC08:55
*** swat30 has joined #openstack-infra08:57
*** markvoelker has joined #openstack-infra08:58
*** markvoelker has quit IRC09:03
*** otter768 has joined #openstack-infra09:11
*** kzaitsev_mb has quit IRC09:14
*** kzaitsev_mb has joined #openstack-infra09:16
*** otter768 has quit IRC09:16
*** salv-orlando has quit IRC09:16
*** kutija_ has joined #openstack-infra09:18
*** nikeshm_ has quit IRC09:20
*** kutija has quit IRC09:21
*** Kennan has quit IRC09:25
*** Kennan has joined #openstack-infra09:29
*** wznoinsk has joined #openstack-infra09:32
*** amotoki has joined #openstack-infra09:36
*** yamamoto has joined #openstack-infra09:42
*** yamamoto has quit IRC09:47
*** niedbals- has quit IRC09:48
*** niedbalski_ has joined #openstack-infra09:48
*** ddieterly has joined #openstack-infra09:51
*** gpocentek has quit IRC09:54
*** ddieterly has quit IRC09:55
*** Somay has joined #openstack-infra09:56
Somayzaro: If you’re around, could you please review some of my patches? Most need just another +2 https://review.openstack.org/#/q/owner:somay.jain%2540gmail.com+status:open,n,z09:58
*** SumitNaiksatam has quit IRC10:01
*** Kennan2 has joined #openstack-infra10:03
*** Kennan has quit IRC10:03
*** SumitNaiksatam has joined #openstack-infra10:05
*** Longgeek has quit IRC10:07
*** Longgeek has joined #openstack-infra10:07
*** kzaitsev_mb has quit IRC10:12
*** jcoufal has joined #openstack-infra10:12
*** kzaitsev_mb has joined #openstack-infra10:17
*** salv-orlando has joined #openstack-infra10:19
*** fawadkhaliq has quit IRC10:22
*** salv-orlando has quit IRC10:23
*** fawadkhaliq has joined #openstack-infra10:26
*** kzaitsev_mb has quit IRC10:28
*** markvan has quit IRC10:31
*** fawadkhaliq has quit IRC10:32
*** Somay has quit IRC10:36
openstackgerrityolanda.robla proposed openstack-infra/system-config: Don't hardcode pip.conf values  https://review.openstack.org/16625210:36
*** binbincong has quit IRC10:41
*** baoli has joined #openstack-infra10:42
*** hrubi has quit IRC10:44
*** hrubi has joined #openstack-infra10:46
*** baoli has quit IRC10:47
openstackgerrityolanda.robla proposed openstack-infra/puppet-gerrit: Allow to send javaOptions in gerrit.config  https://review.openstack.org/19005710:47
*** ddieterly has joined #openstack-infra10:52
*** ddieterly has quit IRC10:56
*** markvoelker has joined #openstack-infra10:59
*** zz_dimtruck is now known as dimtruck11:01
*** markvoelker has quit IRC11:03
*** otter768 has joined #openstack-infra11:12
*** jasondotstar has quit IRC11:14
*** otter768 has quit IRC11:17
*** salv-orlando has joined #openstack-infra11:23
*** kutija has joined #openstack-infra11:33
*** efried has quit IRC11:35
*** kutija_ has quit IRC11:36
*** efried has joined #openstack-infra11:41
dgonzalezclarkb: sdague: If you are around, it would be cool if you could have a look at https://review.openstack.org/#/c/200309/11:45
*** ddieterly has joined #openstack-infra11:52
*** dimtruck is now known as zz_dimtruck11:53
*** salv-orlando has quit IRC11:54
*** ddieterly has quit IRC11:57
*** markvoelker has joined #openstack-infra12:00
*** ddieterly has joined #openstack-infra12:02
*** zz_dimtruck is now known as zz_zz_dimtruck12:03
mordredtimrc: clarkb was looking at something a while back about log emitters that will json the log data. at the time it was in the context of openstack and of making logstash parsing more better12:03
*** markvoelker has quit IRC12:04
mordredtimrc: https://github.com/exoscale/python-logstash-formatter this looks interesting12:05
fungitimrc: also curious, if you're still looking for timimg/performance data to track, why you don't just add more statsd calls instead of trying to infer it from log entries (not sure exactly what in zuul you're attempting to get timing on though)12:13
openstackgerritMonty Taylor proposed openstack-infra/shade: Allow use of admin tokens in keystone  https://review.openstack.org/19920912:13
mordredmmm. also more statsd calls12:14
openstackgerritMonty Taylor proposed openstack-infra/shade: Allow use of admin tokens in keystone  https://review.openstack.org/19920912:33
*** annegentle has joined #openstack-infra12:33
*** julim has joined #openstack-infra12:46
*** marzif_ has quit IRC12:50
*** annegentle has quit IRC12:54
*** salv-orlando has joined #openstack-infra12:55
*** ZZelle has quit IRC13:02
*** ZZelle has joined #openstack-infra13:02
*** heyongli has quit IRC13:06
*** salv-orlando has quit IRC13:07
openstackgerritMerged openstack-infra/shade: Fix identity domain methods  https://review.openstack.org/20068413:08
*** heyongli has joined #openstack-infra13:08
*** kutija_ has joined #openstack-infra13:09
*** kutija has quit IRC13:12
*** otter768 has joined #openstack-infra13:13
*** jasondotstar has joined #openstack-infra13:14
*** heyongli has quit IRC13:18
*** otter768 has quit IRC13:18
*** heyongli has joined #openstack-infra13:18
*** geoffarnold has quit IRC13:28
*** geoffarnold has joined #openstack-infra13:28
*** nelsnelson has quit IRC13:30
*** baoli has joined #openstack-infra13:32
*** sanjayu__u has quit IRC13:34
*** baoli has quit IRC13:37
*** efried has left #openstack-infra13:42
*** sigmavirus24_awa is now known as sigmavirus2413:46
*** madong has quit IRC13:58
*** madong has joined #openstack-infra13:59
jeblairClint: i don't think it's intentional, though i don't see any support for it in the tokenizer, so it seems less like a bug and more of a not-implemented feature13:59
*** markvoelker has joined #openstack-infra14:00
*** markvoelker has quit IRC14:05
*** salv-orlando has joined #openstack-infra14:07
mordredyou're a tokenizer14:08
*** jasondotstar has quit IRC14:10
*** Somay has joined #openstack-infra14:11
*** btully has joined #openstack-infra14:16
*** salv-orlando has quit IRC14:19
*** Somay has quit IRC14:20
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Add a common data directory for job workers  https://review.openstack.org/20069814:29
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Be more specific about scripts dir requirement  https://review.openstack.org/20082614:29
fungitime to go assemble a wheelbarrow so that i can mix some cement in it so that i can set a post so that i can mount a mailbox so that i can receive piled of unwanted junk mail14:31
fungis/piled/piles/14:32
fungi"if you wish to make an apple pie from scratch, you must first invent the universe" [sagan]14:32
*** zz_zz_dimtruck is now known as dimtruck14:33
*** mpopow has joined #openstack-infra14:36
*** rossella_s has quit IRC14:37
*** rossella_s has joined #openstack-infra14:37
*** mpopow has quit IRC14:41
*** sigmavirus24 is now known as sigmavirus24_awa14:42
*** marzif_ has joined #openstack-infra15:01
*** kun_huang has joined #openstack-infra15:03
kun_huanganyone here in this weekend?15:06
kun_huangI have a global requirement issue15:06
timrcfungi, Did you see the charts I'm producing? http://i.imgur.com/0craBhV.png15:06
timrcfungi, This chart plots events and time between events to show the progression of a build.15:06
kun_huanghttp://logs.openstack.org/40/200440/8/check/gate-rally-requirements/0e85754/console.html  updated requirements doesn't match global requirement because of unicode issue15:07
timrcfungi, Not sure how I15:08
timrcerm15:08
timrcNot sure how I'd model this in statsd.15:08
*** julim has quit IRC15:10
timrcmordred, Looking at that project, now.  Thanks.15:11
timrcmordred, What I15:11
timrcGah.  Stupid return key.15:11
*** armax has joined #openstack-infra15:12
*** chlong-weekend has joined #openstack-infra15:13
*** otter768 has joined #openstack-infra15:14
timrcmordred, What I'd really like to have is a web service that would allow me to generate these charts on-the-fly for any given project/change/build.  Also it would be good if the index were a paginated list of builds that could be filtered on a given project or change.  I think that could give the admin/op a fast way of getting insights into the system's functioning.15:15
*** zxiiro has joined #openstack-infra15:15
*** wenlock has joined #openstack-infra15:17
*** marzif_ has quit IRC15:17
*** shashank_hegde_ has joined #openstack-infra15:17
*** otter768 has quit IRC15:18
fungikun_huang: it looks like it's complaining that your test-requirement.txt has "2.6" in the markers for mock and it's expecting '2.6' instead (" vs ')15:21
fungikun_huang: we landed a patch to global requirements with "2.6" in it followed immediately by one that switched that to '2.6' and i think you manged to update in between those two15:25
*** puranamr has joined #openstack-infra15:25
*** shashank_hegde_ has quit IRC15:30
kun_huangfungi: thanks!15:31
kun_huangtrying now15:31
*** dims has joined #openstack-infra15:31
*** Guest55 has joined #openstack-infra15:37
*** dims has quit IRC15:41
kun_huangfungi: it passed:)15:45
kun_huangthank you very much :-)15:45
fungikun_huang: you're welcome!15:45
*** wenlock has quit IRC15:48
*** katyafervent is now known as katyafervent_awa15:50
jeblairtimrc: fyi there are already some timing stats in zuul: http://git.openstack.org/cgit/openstack-infra/zuul/tree/zuul/scheduler.py#n54515:55
*** Guest55 has quit IRC15:58
*** markvoelker has joined #openstack-infra16:01
*** flepied has left #openstack-infra16:01
*** markvoelker has quit IRC16:06
*** salv-orlando has joined #openstack-infra16:07
*** geoffarnold has quit IRC16:10
*** jbrc has joined #openstack-infra16:10
*** salv-orlando has quit IRC16:12
ekarlsois it normal for a AIO install to have 3.7k mysql connections open ?16:21
*** sdake has joined #openstack-infra16:21
timrcjeblair, I don't think you can use those to depict how a build progresses for a given changeset, though.16:22
jeblairtimrc: nope, it works better in aggregate, and answers questions like "how long does this job take?  how long do changes spend in this pipeline?".  run times for specific changes are reported to that change in gerrit.16:25
jeblairtimrc: what additional questions do you want to answer?16:26
*** wenlock has joined #openstack-infra16:27
*** sdake has quit IRC16:28
timrcjeblair, Yep and we chart those stats and I do find them useful.  I also like the insights that something like http://i.imgur.com/0craBhV.png gives -- either because I'm looking at a specific incident or trying to understand where all the time is going for a particular change.16:28
timrcThat chart shows some interesting things like the fact that hp-config-gerrit took twice as long to start building then it actually took to build or that gate-hp-config-projects-yaml ran twice in the context of the same build.16:31
*** ddieterly has quit IRC16:31
timrcFrom the perspective of a customer/user saying "Why is it taking my build so long to complete?" I think that gives them a pretty good visual story.16:32
timrcObviously not a complete picture, but a nice summary.16:33
jeblairtimrc: i agree that it shows that, but what actionable information does it give you?16:33
*** dims has joined #openstack-infra16:34
timrcjeblair, Well if it's taking twice as long to run the build as it takes the build to run then I can key in on a couple things: is it because there is a capacity problem or is jenkins saturated? Maybe a combination of both?16:34
jeblairtimrc: right -- i think that would be useful to know, but even more useful to know in aggregrate.  so you could add a statsd timer for the time spend waiting for a node and then get a system-wide view and trends.16:35
*** kun_huang has left #openstack-infra16:35
*** dimtruck is now known as zz_dimtruck16:36
timrcjeblair, Agreed, that would be useful.  I'd also like to know how many jobs are queued for a given node type vs the currently availability of each node type.  So one time series for zuul key'ed on node type (not sure this is even possible) and one time series for nodepool key'd on node type.16:41
jeblairtimrc: it's tricky in zuul -- zuul itself doesn't know node type (even if it might be responsible for selecting it in some (but not all) cases) -- it's not a built-in concept.  it will be in zuulv3 though.16:43
jeblairtimrc: nodepool knows demand by node type, so if you want to graph those (could be statsd guages) that would be super useful16:43
*** annegentle has joined #openstack-infra16:43
*** marzif_ has joined #openstack-infra16:45
*** annegentle has quit IRC16:47
*** jgriffit1 has joined #openstack-infra16:49
*** ddieterly has joined #openstack-infra16:50
*** mpopow has joined #openstack-infra16:52
*** btully has quit IRC16:55
*** mpopow has quit IRC16:56
*** puranamr has quit IRC17:02
*** wenlock has quit IRC17:03
*** heyongli has quit IRC17:04
*** heyongli has joined #openstack-infra17:05
*** amotoki has quit IRC17:06
*** leakypipes has quit IRC17:10
*** dims has quit IRC17:10
*** otter768 has joined #openstack-infra17:15
*** otter768 has quit IRC17:20
AJaegerfungi, tell us the address of your mailbox, so that we can junk mail you ;)17:23
TheJulia  /win 817:26
AJaegerjeblair, fungi: Btw. what's up with "gate-openstackci-beaker-centos7 NOT_REGISTERED" that I see on project-config and system-config? Any changes that need to be reviewed for this? Note this is a non-voting job, so no need to stop your construction work for that...17:26
*** armax has quit IRC17:31
*** jtomasek has quit IRC17:36
*** dims has joined #openstack-infra17:40
openstackgerritDave Walker proposed openstack-infra/project-config: Add check-requirements job to openstack/anchor  https://review.openstack.org/19947917:40
*** heyongli has quit IRC17:41
*** heyongli has joined #openstack-infra17:42
*** jasondotstar has joined #openstack-infra17:42
*** mrunge has quit IRC17:43
*** achanda has joined #openstack-infra17:50
*** puranamr has joined #openstack-infra17:51
timrcjeblair, Wold the information be useful both as a gauge and a time series?  I think it'd be useful to plot demand on our job volume graph.17:54
*** sdake has joined #openstack-infra17:54
*** sdake_ has joined #openstack-infra17:55
*** annegentle has joined #openstack-infra17:57
*** heyongli has quit IRC17:57
*** heyongli has joined #openstack-infra17:58
*** sdake has quit IRC17:59
*** Daviey has joined #openstack-infra17:59
*** rm_work|away is now known as rm_work18:00
*** markvoelker has joined #openstack-infra18:02
fungiAJaeger: 36.0347,-75.6859, Sol-3, Milky Way, Andromeda Group, Laniakea, 2.3473*10^62 Planck time, cosmological constant 0.692 (please limit contact to 3 spatial dimensions, linear time preferred)18:03
*** Kennan has joined #openstack-infra18:03
*** Kennan2 has quit IRC18:03
AJaegerfungi: not sure that smail mail will deliver this way to the bay ;)18:05
fungiAJaeger: i'm fairly certain gate-openstackci-beaker-centos7 is either registering with the wrong node type or missing an override in the relevant zuul parameter function (i haven't checked to see which), but also not sure whether the job should be centos6 instead18:05
AJaegerfungi: introduced by jeblair's change I2644665776d2f83e113d5123773b664050a67567 . Let's ask him ...18:06
*** salv-orlando has joined #openstack-infra18:07
*** markvoelker has quit IRC18:07
*** salv-orlando has quit IRC18:09
*** amotoki has joined #openstack-infra18:10
AJaegerfungi: place looks nice18:12
*** heyongli has quit IRC18:12
fungiAJaeger: it is, but also a lot of work!18:13
*** puranamr has quit IRC18:14
*** puranamr has joined #openstack-infra18:15
*** amotoki has quit IRC18:16
*** heyongli has joined #openstack-infra18:17
*** Somay has joined #openstack-infra18:22
*** dims has quit IRC18:23
*** jbrc has quit IRC18:25
AJaegerfungi: Looks like it's worth sitting in the garden and looking over the bay at the end of the day;)18:27
*** annegentle has quit IRC18:27
*** woodster_ has joined #openstack-infra18:29
*** Somay has quit IRC18:32
*** Somay has joined #openstack-infra18:34
fungiAJaeger: frequently, but at the moment we have a storm on the way so i'm trying to get some yardwork knocked out before it gets too wet out there18:35
*** che-arne has quit IRC18:37
*** SumitNaiksatam has quit IRC18:45
*** isviridov_away is now known as isviridov18:47
*** SumitNaiksatam has joined #openstack-infra18:48
*** annegentle has joined #openstack-infra18:50
*** unicell has joined #openstack-infra18:55
*** Somay has quit IRC19:02
*** Somay_ has joined #openstack-infra19:02
*** unicell1 has joined #openstack-infra19:06
*** unicell has quit IRC19:06
*** amotoki has joined #openstack-infra19:11
*** jasondotstar has quit IRC19:12
*** otter768 has joined #openstack-infra19:16
*** amotoki has quit IRC19:16
*** Pablo has joined #openstack-infra19:17
*** otter768 has quit IRC19:20
Clintjeblair: ok, i'll submit a patch to change the NEG regex a bit later19:22
*** Pablo is now known as pcaruana19:24
*** puranamr has quit IRC19:26
*** Somay_ has quit IRC19:27
*** kzaitsev_mb has joined #openstack-infra19:32
*** achanda has quit IRC19:34
*** jerryz has joined #openstack-infra19:36
*** sdake has joined #openstack-infra19:45
*** salv-orlando has joined #openstack-infra19:48
*** sdake_ has quit IRC19:48
*** zz_dimtruck is now known as dimtruck19:50
*** sabeen has joined #openstack-infra19:51
*** mpopow has joined #openstack-infra19:52
*** enikanorov2 has quit IRC19:53
*** salv-orlando has quit IRC19:56
*** mpopow has quit IRC19:57
*** jcoufal has quit IRC19:58
*** markvoelker has joined #openstack-infra20:03
*** markvoelker has quit IRC20:07
*** amotoki has joined #openstack-infra20:12
*** jamespage_ has joined #openstack-infra20:14
*** achanda has joined #openstack-infra20:16
*** harlowja_at_home has joined #openstack-infra20:16
*** amotoki has quit IRC20:17
*** sdake has quit IRC20:18
*** harlowja_at_home has quit IRC20:26
*** puranamr has joined #openstack-infra20:31
*** harlowja_at_home has joined #openstack-infra20:40
*** yamahata has joined #openstack-infra20:41
*** woodster_ has quit IRC20:41
*** yamahata has quit IRC20:46
*** isviridov is now known as isviridov_away21:00
*** dims has joined #openstack-infra21:01
*** patrickeast has quit IRC21:08
*** patrickeast_ has joined #openstack-infra21:08
*** fbo has quit IRC21:08
*** fbo has joined #openstack-infra21:10
*** amotoki has joined #openstack-infra21:13
*** jamespage_ has quit IRC21:16
*** otter768 has joined #openstack-infra21:17
*** amotoki has quit IRC21:18
*** dims has quit IRC21:19
*** otter768 has quit IRC21:21
*** dims has joined #openstack-infra21:22
*** dimtruck is now known as zz_dimtruck21:41
*** jasondotstar has joined #openstack-infra21:43
*** heyongli has quit IRC21:47
*** asselin_ has quit IRC21:49
*** heyongli has joined #openstack-infra21:50
*** mriedem has joined #openstack-infra21:51
*** zz_dimtruck is now known as dimtruck21:52
*** mriedemnweep has quit IRC21:53
*** mpopow has joined #openstack-infra21:53
*** dims has quit IRC21:54
*** heyongli has quit IRC21:55
*** heyongli has joined #openstack-infra21:55
openstackgerritlifeless proposed openstack/requirements: Place an accurate lower bound on pbr  https://review.openstack.org/20075821:56
*** harlowja_at_home has quit IRC21:56
*** mpopow has quit IRC21:58
*** markvoelker has joined #openstack-infra22:04
*** dmellado has quit IRC22:04
*** dmellado has joined #openstack-infra22:05
*** markvoelker has quit IRC22:08
*** amotoki has joined #openstack-infra22:14
*** amotoki has quit IRC22:19
*** wyatt8 has joined #openstack-infra22:22
*** wyatt8 has quit IRC22:23
*** jgriffith has quit IRC22:27
*** jgriffith has joined #openstack-infra22:28
*** cody-somerville has quit IRC22:29
openstackgerritMikhail S Medvedev proposed openstack-infra/puppet-openstackci: Add generic logstash manifests  https://review.openstack.org/19979022:30
*** heyongli has quit IRC22:34
*** raginbajin has quit IRC22:37
*** heyongli has joined #openstack-infra22:37
*** rossella_s has quit IRC22:37
*** rossella_s has joined #openstack-infra22:37
*** raginbajin has joined #openstack-infra22:39
*** ddieterly has quit IRC22:47
*** baoli has joined #openstack-infra22:49
*** baoli has quit IRC22:50
*** dims has joined #openstack-infra22:54
lifelessso thought22:58
lifelessperhaps we should stop telling people to install tox globally22:58
lifelessand instead script up:22:58
mordredlifeless: DOCKER!22:58
lifeless - grab a latest virtualenv via git/https-tarball/whatever22:58
lifeless - make a virtualenv22:58
lifeless - install tox and anything else we want latest versions of in that22:59
mordredlifeless: so - we started out with a script that handled things and moved from that to to22:59
mordredtox22:59
*** sdake_ has joined #openstack-infra22:59
lifeless - paste a PATH variable users can put into their .rc files22:59
*** salv-orlando has joined #openstack-infra22:59
*** dims has quit IRC22:59
lifelesswhere install-things would be 'use the pip which is bundled in that virtualenv and we know is sane'23:00
mordredyah. so - I'm starting to thing that distributing helper scripts to use virtualenv is our downfalling at all23:00
lifelessmordred: right, but now we're dealing with different tox versions and those incompats that happen23:00
mordredyah23:00
mordredno - I get the problem23:00
lifelessmordred: docker might be an answer too23:01
mordredbut I'm more and more of the mind that we keep solving 3 conflicting standards by making a 4th23:01
mordredand instead, a nice doc on "here's how virtualenv works - here are some helpers you might like" might get us further23:01
lifelessmordred: the one thing that new abstractions can't help with :)23:01
mordredyah23:01
lifelessA script and some docs are not mutually exclusive AFAICT23:02
mordredand instead of focusing on one-stop abstractions, focus on making sure that people who know how to use the toolchains will not be surprised23:02
lifelesswhat about 'here's how it works, and here's a common pattern we use to not depend on our distro vendors being up to date'23:02
*** heyongli has quit IRC23:02
lifelessand a nice script block folk can copy-paste if they want to23:02
mordredlifeless: I would argue that the existence of tox and run_tests.sh have led us to a place where 2-3 years in to testr, most openstack devs do not know how its command line works23:03
lifelessyes, which is bonkers :)23:03
lifelesswell23:03
lifelessthere is the test selection language problem23:03
lifelesswhich I totally want to solve23:03
lifelessI just need to convince anyone with time to work on it to not solve-for-tempest23:03
lifelessbut instead solve-for-general-case23:03
lifelessmtreinish: ^ I'm not talking about you. Honest.23:03
mordredlifeless: turns out there are not enough times in the days23:04
lifelessso I can do something easy here.23:04
lifelessI will figure out a bare minimum and blog it23:04
lifelessand we'll see23:04
*** markvan has joined #openstack-infra23:04
lifelessI had to do something similar to get pypy3 available the other day23:05
*** heyongli has joined #openstack-infra23:05
lifelessmordred: oh btw - https://review.openstack.org/#/c/200344/23:06
lifelessmordred: its green, it has one +2.23:06
lifelessmordred: wink wink nudge nudge23:06
clarkbMakefiles?23:07
clarkbprobably not going to make many happy23:07
lifelessclarkb: I think mordreds point is that abstractions that prevent learning are themselves a problem23:07
mordredwell - that and also makefiles would be another syncing operation23:08
lifelessSo what are the key things here23:08
lifelessI think they are:23:08
mordredbeer23:08
lifeless - we need to publish the known good versions of tools that are not automatically-managed23:08
*** pfallenop has quit IRC23:09
lifelesstoday thats tox, pip, virtualenv, setuptools23:09
lifeless[on dev machines]23:09
*** salv-orlando has quit IRC23:09
lifelessand the Python's that are installed and the various distro things like libssl-dev23:09
lifelessWe need to publish known-good so that a dev encountering trouble can consult and see if they are in new territory23:10
lifeless - we need a way for our entire dev community to get known good versions running locally23:10
lifeless[known good *might* be a set]23:10
lifeless  right now we don't really do that. Some folk do sudo -H pip install pip and then wonder why their machine is horked23:10
lifelessfor instance23:10
lifeless - we need to communicate actions where folk have to change those versions widely and clearly23:11
lifelesswhether thats by email, or by having test suites refuse to run, or whatever23:11
*** pfallenop has joined #openstack-infra23:11
* mordred does sudo pip install -U pip all the time ...23:12
* mordred also knows how to fix it when it breaks ...23:12
lifelessmordred: with python-pip installed?23:12
lifelessmordred: well yeah.23:12
mordredlifeless: I NEVER install python-pip23:12
lifelessmordred: right - but23:12
lifelesswe don't document that today23:12
mordredyah23:12
lifelessso23:12
lifelessI think it would be fine to have multiple mechanisms23:12
lifelessbut we need the publication, *a reference mechanism*, and the updates23:13
Sam-I-Amhowdy folks23:13
mordredmorning Sam-I-Am23:13
lifelesso/23:14
* Sam-I-Am looks at clock23:14
lifelessits beer o'clock.23:14
Sam-I-Amguess its morning somewhere23:14
lifeless1114 here23:14
lifelesslate morning23:14
Sam-I-Am1814 here, still saturday23:14
Sam-I-Amer, 1714... stupid irc box needs a tz fix23:14
*** amotoki has joined #openstack-infra23:14
clarkbya but evetyonr knoes how a makefile works23:16
Sam-I-Amtrying to weekend a bit here23:17
Sam-I-Ammore networking guide patches await on monday23:17
lifelessclarkb: whats your point? I'm missing something23:17
*** otter768 has joined #openstack-infra23:17
*** pfallenop has quit IRC23:19
*** amotoki has quit IRC23:19
*** markvoelker has joined #openstack-infra23:20
lifelessmordred: fungi: do you know where fungi's master-bindep file is ?23:20
clarkbif you want something instead of tox which is obthse and instead of shell acript which people update and add all the bugs to23:20
clarkbhave a simple makefile that works23:20
clarkbpeople understand it, it shows you the commands so if you want to do somethibg new you just run them23:21
clarkbyou dont feel like this 1k line shell acript needs updating23:21
lifelessclarkb: I think you might be solving for a different problem23:21
clarkbmaybe23:21
lifelesshow do you tell people they need to update?23:22
lifelesshow do you help people diagnose problems?23:22
*** otter768 has quit IRC23:22
clarkbwell for the secobd hopefully makefiles are well known enough people can help themselves23:23
clarkbfor the first we can sync it out like we do with the other file syncs? or do you mean package updates?23:23
*** pfallenop has joined #openstack-infra23:23
*** markvoelker has quit IRC23:24
*** jasondotstar has quit IRC23:24
*** annegentle has quit IRC23:25
*** kzaitsev_mb has quit IRC23:25
jrolllifeless: this isn't a useful comment, but what I'm reading here is that system packages for python things are yet again causing problems23:27
lifelessjroll: they are being held up as a reason not to do something in a list discussion23:28
lifelessand I'm evaluating the cause23:28
lifelessand process23:28
* jroll looks at the list23:28
lifelessjroll: the one about testr being inside the tox venvs23:29
jrollthanks23:29
lifelessmordred: in fact23:31
lifelesshttp://docs.openstack.org/infra/manual/python.html#python-unit-tests23:31
lifelessmordred: tells people to do what you tell people not to do23:31
*** cody-somerville has joined #openstack-infra23:33
*** cody-somerville has quit IRC23:33
*** cody-somerville has joined #openstack-infra23:33
jrolllifeless: so besides the main points in that thread -- I'm curious how many folks actually query the data in the testr db to learn things23:41
lifelessjroll: I don't know if you were around when we first introduced parallelisation23:42
lifelessjroll: but testr run --analyze-isolation23:42
lifelessjroll: was super useful during that period: and its an example of querying.23:42
lifelessjroll: testr run --failing23:42
lifelessjroll: is another example [runs just the failing tests]23:42
lifelessI can't speak for how often other people use things23:42
jrolllifeless: ok, I'm not aware of what all it can do, just curious23:42
jrollI've personally never used it much23:43
jroll--failing seems more useful when the db is separated by python version though23:43
lifelessjroll: so indeed and thats why testr is learning about test environments23:43
lifelessjroll: so it can reach out and report / execute on that23:43
lifelessbut I don't think you want it partitioned23:44
jrolllifeless: ok, I was looking at your points against separating testr db by tox env :)23:44
jrollsure23:44
lifelessyou want a holistic view. test_foo is failing on py26,p3223:44
jrollsometimes23:44
jrollother times I want, "re-run the tests that failed for each env per-env"23:45
lifelesssure23:45
lifelesstestr run --failing -e py26 # hypothetical23:45
jrolland we execute testr per-env, so a split seems to make sense23:45
jrollthe thing is nobody uses "testr run"23:45
jrollnot nobody, but you know what I mean23:46
lifelesssure23:46
lifelessthey use run_tests23:46
lifelessor tox23:46
lifelessor both23:46
lifelessthe point is what should the direction be23:46
lifelessdo we increase capability23:46
lifelessor reduce it?23:46
jrollyeah.23:47
*** ddieterly has joined #openstack-infra23:47
jrollso it sounds like testr could (one day?) replace tox, right?23:48
lifelessthere's a lot of overlap yes23:49
lifelessI can totally see testr invoking tox23:49
lifelessor tox not being there23:49
lifelessor using tox to setup the environments23:50
lifelessand testr to do the testing23:50
jrolltestr isn't capable of standing up an environment, correct?23:50
*** dims has joined #openstack-infra23:51
*** ddieterly has quit IRC23:52
lifelessjroll: it has a set of hooks for doing backend context setup23:52
lifelessjroll: (e.g. making containers, sshing to slave machines, querying OpenStack for available slaves, whatever)23:53
jrollinteresting.23:53
lifelessjroll: it doesn't [today] have a specific environment abstraction: it assumes homogeneous capabilities.23:53
lifelessjroll: but adding heterogeneous capabilities + tags-per-combination is on my very-interested-to-have list23:54
lifelessjroll: here's an old blog post that shows some of the plumbing https://rbtcollins.wordpress.com/2013/01/14/multi-machine-parallel-testing-of-nova-with-testrepository/23:54
jrolllifeless: cool, I'm not sure I have enough context to comment, I'd like to investigate more23:55

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!