Tuesday, 2016-01-26

*** r-daneel has quit IRC00:08
openstackgerritMerged openstack/ceilometer: remove useless notification listener helper  https://review.openstack.org/25081500:19
openstackgerritMerged openstack/gnocchi: Resource list filtered by project_id or created_by user_id and project_id  https://review.openstack.org/25976500:19
*** chlong has quit IRC00:20
*** chlong has joined #openstack-telemetry00:20
openstackgerritPradeep Kilambi proposed openstack/python-aodhclient: Add gnocchi alarm rules  https://review.openstack.org/26607300:26
*** diogogmt has quit IRC00:28
*** zqfan has joined #openstack-telemetry00:34
*** chlong has quit IRC00:41
*** chlong has joined #openstack-telemetry00:41
*** david-lyle has joined #openstack-telemetry00:42
*** chlong has quit IRC00:48
*** chlong has joined #openstack-telemetry00:48
*** chlong has quit IRC00:53
*** chlong has joined #openstack-telemetry00:53
*** cheneydc has joined #openstack-telemetry01:00
*** ljxiash has quit IRC01:12
*** Liuqing has joined #openstack-telemetry01:15
*** diogogmt has joined #openstack-telemetry01:24
*** ljxiash has joined #openstack-telemetry01:28
openstackgerritliusheng proposed openstack/aodh: Add mandatory limit query support of API  https://review.openstack.org/26483801:31
openstackgerritliusheng proposed openstack/aodh: Add mandatory limit query support of API  https://review.openstack.org/26483801:33
*** ildikov has quit IRC01:36
*** r-daneel has joined #openstack-telemetry01:39
*** r-daneel has quit IRC01:39
*** chlong has quit IRC01:55
*** chlong has joined #openstack-telemetry01:55
*** jwcroppe has quit IRC02:00
*** david-lyle has quit IRC02:05
openstackgerritliusheng proposed openstack/aodh: Add composite rule alarm API support  https://review.openstack.org/25772202:12
*** davidlenwell has quit IRC02:14
*** davidlenwell has joined #openstack-telemetry02:16
*** diogogmt has quit IRC02:28
*** thumpba has joined #openstack-telemetry02:29
*** Liuqing has quit IRC02:43
*** Liuqing has joined #openstack-telemetry02:44
*** chlong has quit IRC02:49
*** chlong has joined #openstack-telemetry02:49
*** superflyy has joined #openstack-telemetry02:50
*** liamji has joined #openstack-telemetry02:50
*** pradk has quit IRC03:02
*** jwcroppe has joined #openstack-telemetry03:04
*** pradk has joined #openstack-telemetry03:16
*** diogogmt has joined #openstack-telemetry03:17
*** chlong has quit IRC03:17
*** chlong has joined #openstack-telemetry03:18
*** chlong has quit IRC03:19
*** chlong has joined #openstack-telemetry03:19
*** prashantD_ has quit IRC03:22
*** david-lyle has joined #openstack-telemetry03:25
openstackgerritEdwin Zhai proposed openstack/aodh: Enable event-alarm timeout  https://review.openstack.org/27202803:25
*** vishwanathj has joined #openstack-telemetry03:31
*** jwcroppe has quit IRC03:35
*** harlowja has quit IRC03:54
*** superflyy has quit IRC04:01
*** ljxiash has quit IRC04:03
*** vishwanathj has quit IRC04:29
*** prashantD_ has joined #openstack-telemetry04:34
*** prashantD_ has quit IRC04:43
*** prashantD_ has joined #openstack-telemetry04:44
*** jwcroppe has joined #openstack-telemetry04:47
*** diogogmt has quit IRC04:56
*** pradk has quit IRC04:56
*** pradk has joined #openstack-telemetry05:08
*** jwcroppe has quit IRC05:20
*** zqfan has quit IRC05:21
*** yprokule has joined #openstack-telemetry05:27
*** Liuqing has quit IRC05:44
*** prashantD_ has quit IRC05:45
*** Liuqing has joined #openstack-telemetry05:45
*** ljxiash has joined #openstack-telemetry05:48
*** ildikov has joined #openstack-telemetry06:02
*** thumpba has quit IRC06:29
*** zqfan has joined #openstack-telemetry06:31
*** thumpba has joined #openstack-telemetry06:34
*** ifat_afek has joined #openstack-telemetry06:34
*** belmoreira has joined #openstack-telemetry06:37
*** zqfan has quit IRC06:40
*** _nadya_ has joined #openstack-telemetry06:48
*** rcernin has joined #openstack-telemetry06:53
*** _nadya_ has quit IRC06:58
openstackgerritliusheng proposed openstack/aodh: Add composite rule alarm evaluator  https://review.openstack.org/26122607:02
*** thumpba has quit IRC07:05
*** thumpba has joined #openstack-telemetry07:06
*** thumpba has quit IRC07:09
*** jwcroppe has joined #openstack-telemetry07:17
cheneydchi, is disk.read.requests.rate craeted by transformer? if so, why there is a pollster for it?07:20
cheneydcanynoe knew it?07:21
*** jwcroppe has quit IRC07:24
*** nijaba has quit IRC07:27
*** nijaba has joined #openstack-telemetry07:27
*** ljxiash has quit IRC07:30
*** ljxiash has joined #openstack-telemetry07:31
*** liamji has quit IRC07:31
*** liamji has joined #openstack-telemetry07:32
*** _nadya_ has joined #openstack-telemetry07:32
*** ljxiash has quit IRC07:34
*** ljxiash has joined #openstack-telemetry07:34
cheneydchello, anyone can help?07:48
*** safchain has joined #openstack-telemetry07:50
*** ljxiash_ has joined #openstack-telemetry07:59
*** ljxiash has quit IRC08:02
liushengcheneydc: that is because not all the virt drivers support these pollsters, e.g. libvirt cannot support disk rate meter.08:03
*** thumpba has joined #openstack-telemetry08:08
*** thumpba has quit IRC08:09
*** _nadya__ has joined #openstack-telemetry08:24
*** shardy has joined #openstack-telemetry08:24
*** _nadya_ has quit IRC08:24
*** mattyw has joined #openstack-telemetry08:26
*** Liuqing has quit IRC08:41
*** Liuqing has joined #openstack-telemetry08:42
_nadya__sileht: Hi Mehdi! Do you know anything about aodh-client release? When it will happen?08:47
sileht_nadya__, hi, no idea08:47
_nadya__sileht: in Mitaka we will be able to use aodh without the client, using ceilometer client, won't we?08:49
_nadya__or there are some additional features in aodh client?08:52
sileht_nadya__, we didn't plan to remove the alarmcli from ceilometerclient for now08:54
_nadya__sileht: ok, cool. Thanks for help!08:54
cheneydcliusheng: ok, I see that, but the transformer will genrate the rate from bytes, right?08:57
liushengcheneydc: yes08:59
cheneydcliusheng: so the pollster of disk rate is not necessary...08:59
liushengcheneydc: I think the transformer is an alternative approach...09:03
cheneydcliusheng: ok, seems to do more test :)  thanks for help09:04
*** eglynn has quit IRC09:12
jd__can someone review https://review.openstack.org/#/c/267607/ ?09:15
*** efoley has joined #openstack-telemetry09:16
*** cdent has joined #openstack-telemetry09:17
*** _nadya__ has quit IRC09:18
*** thorst has joined #openstack-telemetry09:18
*** r-mibu has quit IRC09:19
*** jwcroppe has joined #openstack-telemetry09:21
*** yassine__ has joined #openstack-telemetry09:21
*** jaypipes has joined #openstack-telemetry09:25
*** jwcroppe has quit IRC09:28
*** Liuqing has quit IRC09:29
*** Liuqing has joined #openstack-telemetry09:30
*** thorst has quit IRC09:44
*** thorst has joined #openstack-telemetry09:44
*** liamji has quit IRC09:46
*** thorst has quit IRC09:49
*** r-mibu has joined #openstack-telemetry09:50
*** Liuqing has quit IRC09:51
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Add some resource types tests  https://review.openstack.org/27041910:00
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Implements resource attribute int and float  https://review.openstack.org/27009110:00
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Implements resource attribute bool  https://review.openstack.org/27041810:00
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Implements resource attribute uuid  https://review.openstack.org/27009010:00
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Don't create Ceilometer resource types by default.  https://review.openstack.org/27032210:00
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Move legacy Ceilometer resource into indexer.  https://review.openstack.org/27026610:00
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Move resource type into their own sql table  https://review.openstack.org/26984310:00
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Implements resource type CRUD.  https://review.openstack.org/26984410:00
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Implements resource attribute string  https://review.openstack.org/26988810:00
*** idonotknow_ has joined #openstack-telemetry10:00
idonotknow_Hi,everyone. I am new to openstack, does anyone know how to configure event_definition.yaml to get the data from lbaas? Thank you very much10:02
*** cheneydc has quit IRC10:02
*** cdent has quit IRC10:08
*** cdent has joined #openstack-telemetry10:10
*** cdent has quit IRC10:18
*** cdent has joined #openstack-telemetry10:20
*** idonotknow__ has joined #openstack-telemetry10:33
*** idonotknow_ has quit IRC10:33
*** efoley has quit IRC10:51
*** yassine__ has quit IRC10:51
*** efoley has joined #openstack-telemetry10:53
*** _nadya_ has joined #openstack-telemetry10:54
*** thorst has joined #openstack-telemetry10:57
efoleyidonotknow_: This question is probably better suited to the mailing list. Add some more information about your configuration and usecase, and send a mail.10:59
*** chlong has quit IRC11:05
*** chlong has joined #openstack-telemetry11:10
*** thorst has quit IRC11:13
*** ljxiash_ has quit IRC11:15
*** thorst has joined #openstack-telemetry11:18
*** ljxiash has joined #openstack-telemetry11:19
openstackgerritJulien Danjou proposed openstack/gnocchi: ceph, swift: do not fail if unprocess measures already deleted  https://review.openstack.org/27247511:19
openstackgerritJulien Danjou proposed openstack/gnocchi: ceph, swift: do not fail if unprocess measures already deleted  https://review.openstack.org/27247511:20
*** ljxiash has quit IRC11:23
*** idegtiarov has quit IRC11:25
*** jwcroppe has joined #openstack-telemetry11:25
*** jwcroppe has quit IRC11:31
*** thorst has quit IRC11:37
*** ljxiash has joined #openstack-telemetry11:39
*** idegtiarov has joined #openstack-telemetry11:43
*** mattyw has quit IRC11:58
*** leitan has joined #openstack-telemetry12:02
*** ifat_afek_ has joined #openstack-telemetry12:04
*** ifat_afek has quit IRC12:04
*** ljxiash has quit IRC12:15
*** ljxiash has joined #openstack-telemetry12:15
*** ljxiash has quit IRC12:20
*** thorst has joined #openstack-telemetry12:24
leitanHi guys, are you aware of any bug on Ceilometer that doesnt report/update the revision_end field on Gnocchi when a resource doesnt exist anymore, for example instance termination ( disk, network, etc related to that instance) , were working on regexp querys and we need to search for ACTIVE resources in a period of time, but revision_end its always on None, making the filtering really hard12:25
*** efoley has quit IRC12:27
*** thorst has quit IRC12:28
*** thorst has joined #openstack-telemetry12:28
*** ifat_afek_ has quit IRC12:29
*** ifat_afek has joined #openstack-telemetry12:33
*** idonotknow__ has quit IRC12:36
openstackgerritJulien Danjou proposed openstack/gnocchi: ceph, swift: do not fail if unprocess measures already deleted  https://review.openstack.org/27247512:39
leitanjd__, are you aware of something similar ?12:40
*** idonotknow_ has joined #openstack-telemetry12:41
*** cheneydc has joined #openstack-telemetry12:44
*** mattyw has joined #openstack-telemetry12:51
*** thorst_ has joined #openstack-telemetry12:52
*** pradk has quit IRC12:52
*** efoley has joined #openstack-telemetry12:52
jd__leitan: this is a bug already reported in Ceilometer, it's not implemented yet :(12:53
jd__sileht: did you see our discussion about Ceph performance on Friday?12:53
leitanjd__, :(  , we'll try to add the missing code since we think its pretty important for consistent reports , ill search for that bug12:54
jd__leitan: cool!12:55
*** yassine__ has joined #openstack-telemetry12:55
*** thorst has quit IRC12:55
leitanjd__, BTW we applied the first mnaser patch, and its working (not looping over processed metrics again) , were waiting to test the cache layer part to see how it goes12:56
jd__cool12:56
jd__leitan: you work with mnaser ?12:56
*** nicodemus_ has joined #openstack-telemetry12:56
leitannope i work with nicodemus , alejandro comisario and sergio colinas12:56
nicodemus_did someone say my name? :P12:57
leitannicodemus_, no, nobody likes you dude :P12:57
nicodemus_T_T12:57
leitanjd__, i guess you guys emailed each other since tokio13:00
jd__leitan: oh sure13:00
*** ifat_afek has quit IRC13:03
*** thorst_ has quit IRC13:03
*** thorst has joined #openstack-telemetry13:06
*** thorst has quit IRC13:07
*** thorst has joined #openstack-telemetry13:11
nicodemus_hello mnaser13:15
mnaserhi there13:15
nicodemus_I tested your patch from #1536909, it's working13:16
mnasernicodemus_ so before the redis cache or anything, i think teh root problem to be solved is how jobs are racing (you must notice how your log gets spammed with "skipped")13:16
nicodemus_yes, it does13:16
mnaserand it's probably still pretty slow to go through the long list of items with rados python driver13:17
mnaserwhich apparently is planned to be addressed, at this point a fork out to /usr/bin/rados might be way faster13:17
silehtjd__, quickly13:18
nicodemus_I left the four metricd instances running all weekend, the number of objects on the gnocchi pool decreased by 200k only13:18
*** thorst_ has joined #openstack-telemetry13:18
nicodemus_it's quite slow13:18
*** gordc has joined #openstack-telemetry13:18
silehtjd__, librados use python threading to do IO, I guess that when too much IO are in progress at the same times GIL will not help13:18
mnaseri think the problem is literally the more workers yo have, the more likely they're going to be racing between each other13:19
sileht(each rados python API call do the C API call into a thread)13:19
mnasersileht: the annoyance is that its done in a new thread, not an existing one, so there's huge overheads13:20
mnaserin a 7.5 million xattr iterator = 7.5 million threads being created13:20
mnaserprofiling the code shows large # of thread locks13:20
nicodemus_I reported another bug yesterday (#1537767) with several ObjectNotFound in the logs, maybe also from the racing between them13:20
mnaserit is.. i looked at the storage code and a lot / most of it was very racy to be honest :\13:20
silehtmnaser, that's look like an issue of the current python lib13:21
jd__nicodemus_: I've already pushed a fix13:21
*** thorst has quit IRC13:21
mnaseri think the root problem here is that the main driver or metricd should have a properly implemented system of job distribution13:21
jd__concurrent code that is not racy? Does that exist? :)13:21
*** Walts has quit IRC13:22
nicodemus_jd__: that was quick! :) I'll give it a try13:22
jd__mnaser: improvement welcome13:22
mnaserjd__: yeah, i spent a big part of the weekend thinking about this issue but it seems like a huge task13:22
silehtjd__, what do you think about dropping librados and create another lib that doesn't use thread but just block13:22
jd__the current code has the upside of having a very low bottleneck13:22
jd__sileht: I don't think I'm qualified enough to answer that13:23
mnaserthe problem right now is that the more you scale, the more you have processes which are spinning in already-done records13:23
silehtjd__, we use only a small part of the API13:23
jd__mnaser: we should probably work on smaller batches at some point13:23
mnaserjd__ yep but that introduces a much more difficult task of scheduling this work13:24
jd__mnaser: yup13:24
jd__I think the first thing would be to meter what are the problem and performance issues of the current implementation, if any13:25
silehtjd__, or as quick workaround we can monkeypatch librados to disable the thread13:25
silehtjd__, this is a oneline13:25
jd__sileht: if that improves the performance without having any race condition issue, sure13:25
mnasersileht: i asked the specific dev why they started using threads.. apparently the issue was that it's possible that the SIGINT call to python won't make it if rados is doing work13:26
openstackgerritMerged openstack/gnocchi: storage,rest: add support for granularity in aggregation  https://review.openstack.org/26760713:26
mnaserbut given the fact that we have a daemon here and the calls are not long lived (we're not doing big file uploads), i think it could be okay in this case13:26
openstackgerritMerged openstack/gnocchi: rest: fix timestamp parsing for aggregates  https://review.openstack.org/26582413:26
silehtmnaser, I guess this is due to ctype usage, the SIGINT will occur, when the C func return13:27
*** jwcroppe has joined #openstack-telemetry13:27
mnasersileht: yeah, they had plans to move to a cython module (apparently python-rbd was ported and ceph driver is wip)13:28
openstackgerritJulien Danjou proposed openstack/gnocchi: storage: run expunge_metric in sync mode  https://review.openstack.org/27253513:30
silehtmnaser, yeah librbd in master uses cython now13:30
*** jwcroppe has quit IRC13:31
openstackgerritJulien Danjou proposed openstack/gnocchi: ceph, swift: do not fail if unprocess measures already deleted  https://review.openstack.org/27247513:33
*** liamji has joined #openstack-telemetry13:35
openstackgerritMohammed Naser proposed openstack/gnocchi: Skip already processed measurements  https://review.openstack.org/27149913:36
mnaser^ submitted again and addressed comments13:36
*** efoley has quit IRC13:40
*** jaypipes has quit IRC13:44
*** terriyu has joined #openstack-telemetry13:47
*** efoley has joined #openstack-telemetry13:49
*** julim has joined #openstack-telemetry13:50
*** terriyu has quit IRC13:54
*** diogogmt has joined #openstack-telemetry13:57
openstackgerritJulien Danjou proposed openstack/gnocchi: storage: autoconfigure coordination_url  https://review.openstack.org/27090714:02
*** ljxiash has joined #openstack-telemetry14:10
*** nicodemus_ has quit IRC14:17
*** diogogmt has quit IRC14:20
openstackgerritJulien Danjou proposed openstack/gnocchi: storage/carbonara: store TimeSerieAggregated in splits  https://review.openstack.org/25843414:22
jd__sileht: i'm thinking we should release 2.0.0 with this carbonara split first, and then 2.1.0 with your resource type work a bit later14:24
jd__I'd like to have 2.0.0 out pretty soon so we can fix it along the way14:24
silehtjd__, go ahead14:24
jd__having 2 major features in a single release seems harsh14:24
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Add some resource types tests  https://review.openstack.org/27041914:32
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Implements resource attribute int and float  https://review.openstack.org/27009114:32
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Implements resource attribute bool  https://review.openstack.org/27041814:32
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Implements resource attribute uuid  https://review.openstack.org/27009014:32
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Don't create Ceilometer resource types by default.  https://review.openstack.org/27032214:32
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Move legacy Ceilometer resource into indexer.  https://review.openstack.org/27026614:32
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Move resource type into their own sql table  https://review.openstack.org/26984314:32
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Implements resource type CRUD.  https://review.openstack.org/26984414:32
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Implements resource attribute string  https://review.openstack.org/26988814:32
jd__SPAM14:33
*** idonotknow_ has quit IRC14:34
*** pradk has joined #openstack-telemetry14:34
*** boris-42 has quit IRC14:34
*** yarkot has quit IRC14:35
gordcsileht: want to see if this makes sense: https://review.openstack.org/#/c/267625/14:35
*** boris-42 has joined #openstack-telemetry14:35
gordcjd__: i added you to talk... there were a lot more fields to fill out this time.14:35
*** davidlenwell has quit IRC14:35
jd__gordc: I saw that, thanks14:35
*** vishwanathj has joined #openstack-telemetry14:36
*** vishwanathj has quit IRC14:36
gordcjd__: feel free to change whatever. i just randomly chose a topic track14:37
jd__gordc: yeah I reviewed that, I just added a capital letter to the title, the rest looked ok!14:37
jd__fingers crossed14:37
jd__and I like that we're trying the big data track =]14:37
gordcwe do 'big data'14:38
gordci think my resume says that... along with machine learning... and robotics... and astronaut14:38
EmilienMand baseball14:39
gordcEmilienM: that's a given.14:41
jd__isn't that supposed to be hockey for Canadians?14:41
gordcjd__: it is if you have money.14:41
leitansileht, monkeypatching librados can reduce the overhead , definetively worth trying for the cost of the implementation, we can try the patched ceph if you want, we have a lot of measures going on14:42
silehtleitan, I'm currently testing a change that do that I will send the patch soon14:42
silehtgordc, that looks usefull14:42
leitansileht, awesome14:43
gordcsileht: cool cool, i may need to backport it to libety too14:43
gordcpradk: i'm thinking of releasing aodhclient as is... as 0.1.0 or something so we can verify what we have14:47
_nadya_gordc: Gordon, hi! Where are we going to release aodh-client?14:47
gordcand then we change to 1.0.0 eventually after gnocchi rules added14:47
jd__gordc: sileht: can you review https://review.openstack.org/#/c/269746/ so I can backport it to stable/1.3 ?14:47
_nadya_gordc: oops, let me read the logs....:)14:47
gordc_nadya_: did you type that same time as me or after i typed it?14:47
jd__gordc:  and we all know that Gnocchi rules…14:47
jd__*clap clap clap*14:47
gordcjd__: leave14:48
* jd__ ... -> []14:48
gordco/14:48
_nadya_gordc: hehe14:48
jd__😭14:48
*** ljxiash has quit IRC14:48
gordc_nadya_: i'm debating making release now so we can test14:48
gordc_nadya_: sound good?14:48
_nadya_gordc: +1 from me!14:48
gordcit's not complete though (just basic rules right now)14:49
gordc_nadya_: cool cool. will do it soon then.14:49
*** davidlenwell has joined #openstack-telemetry14:49
_nadya_cool14:49
openstackgerritJulien Danjou proposed openstack/gnocchi: rest: fix metric access for linked projects  https://review.openstack.org/26974614:50
silehtjd__, did you release a 1.3.X with this ? https://review.openstack.org/#/c/271296/14:50
jd__sileht: no, it'll be in 1.3.414:51
silehtoki thanks14:51
jd__sileht: is someone working on puppet seeing failure asking? :)14:51
silehtjd__, exactly14:52
jd__yeah pradk just asked me the same privately14:52
sileht:D14:52
pradkgordc, sure no update from Zi yet? i'll check with him and see if i can take over14:52
jd__at some point everyone should discuss publicly, we would not waste time guys14:52
* jd__ stares at EmilienM and pradk :p14:52
silehtagreed, we have more ears here :)14:52
pradkjd__, you guys should hang out in rdo channel14:52
pradk:)14:52
pradkwhere EmilienM discoers these awesome issues14:53
jd__sure though feel free to ask here directly :)14:53
pradksure14:53
pradkgordc, so you dont want to wait for gnocchi rules to merge then?14:53
EmilienMjd__: we discuss in public man14:54
pradkgordc, it be nice to have that in 0.1 but if we're late i guess we can get it out14:54
EmilienM /join #rdo14:54
gordcpradk: no.14:54
*** yprokule has quit IRC14:54
jd__EmilienM: ok than I only blame pradk!!14:54
pradkgordc, ok i'll check with Zi and what his plan for tests is14:54
EmilienMwe're debugging RDO packaging, and everything happens on this channel for that14:54
jd__:)14:54
gordcpradk: well. that's why i'm releasing as a pre-1.x... once we have all the rules we cna move to 1.x14:54
* pradk is happy to take the blame14:54
gordcpradk: i just want to verify what we have is alright in reality14:54
pradkgordc, understand14:55
EmilienMpradk is helping having RDO packaging at least ;-)14:55
*** jaypipes has joined #openstack-telemetry14:55
pradkliamji, are you around sir?14:55
jd__hehe14:55
*** cheneydc has quit IRC14:57
liamjiyes14:58
*** jwcroppe has joined #openstack-telemetry14:58
_nadya_gordc: alarming is removed from ceilometerclient?14:59
pradkliamji, are you close to getting the tests done for gnocchi alarm rules cli? any help needed?14:59
*** yprokule has joined #openstack-telemetry14:59
*** ljxiash has joined #openstack-telemetry15:00
liamji:pradk I think tempest_lib framework doesn't work for the gnocchi alarm rules because it needs to install the gnocchi first.15:01
gordc_nadya_: we will keep it. it's just going to be deprecated (but never removed).15:01
pradkliamji, you tried mocking the AlarmManager?15:01
_nadya_gordc: ok, thanks!15:02
pradkliamji, basically have it take in the cli input and mock the return from server15:02
pradkliamji, that way we dont need gnocchi15:02
pradkliamji, i suggest instead of functional make then unit and mock the shell15:02
liamji:pradk yes, okey, for it uses the Cliff framework, I am trying to fake a client used by AlarmManager and mock the respone. :)15:06
liamjinow i think I can use session client to init a client used by AlarmManager but it needs some time to test whether it works :(15:07
pradkliamji, cool15:08
openstackgerritMerged openstack/gnocchi: Skip already processed measurements  https://review.openstack.org/27149915:13
*** mragupat has joined #openstack-telemetry15:33
_nadya_jd__: sileht. gordc folks, please review https://review.openstack.org/#/c/209799/ . I've added some comments but I think that in general everything is ready to be merged15:34
gordc_nadya_: ack15:35
*** ljxiash has quit IRC15:38
*** ljxiash has joined #openstack-telemetry15:38
*** ljxiash has quit IRC15:39
*** ljxiash has joined #openstack-telemetry15:42
*** mattyw has quit IRC15:42
*** ljxiash has quit IRC15:42
*** ljxiash_ has joined #openstack-telemetry15:42
*** shardy_ has joined #openstack-telemetry15:53
*** shardy has quit IRC15:54
*** mattyw has joined #openstack-telemetry16:04
*** yprokule has quit IRC16:04
openstackgerritgordon chung proposed openstack/ceilometer: better support notification coordination  https://review.openstack.org/26762516:05
pradkgordc, will we have a new liberty release for ceilo and ceiloclient anytime soon?16:07
gordci just realeased ceilometer https://github.com/openstack/releases/blob/master/deliverables/liberty/ceilometer.yaml16:08
gordci don't think anything changes in ceiloclient liberty16:09
*** yprokule has joined #openstack-telemetry16:09
pradkgordc, ah cool.. i backedported a change to ceiloclient liberty few mins ago.. wanted to check if we can have a release once that merges16:10
gordcsure16:10
*** r-daneel has joined #openstack-telemetry16:10
*** jwcroppe has quit IRC16:11
gordcpradk: oh... we also need this https://review.openstack.org/#/c/271379/16:11
gordcnothing will merge in ceiloclient right now16:11
pradkoh16:11
pradkok16:11
*** yprokule has quit IRC16:12
gordcas usual, i have no idea if that change will fix one gate or break 6 gates... always a coin flip with project-config16:14
pradkgordc, is the ceilo liberty release you mentioned above already out?16:15
pradk5.0.2?16:16
pradki see tha tar , cool16:16
*** belmoreira has quit IRC16:16
gordcyeah.16:16
gordchttp://lists.openstack.org/pipermail/openstack-announce/2016-January/000936.html16:16
*** mattyw has quit IRC16:21
*** tongli has joined #openstack-telemetry16:22
*** mattyw has joined #openstack-telemetry16:23
*** diogogmt has joined #openstack-telemetry16:26
*** chlong is now known as chlong_zzz16:28
*** jwcroppe has joined #openstack-telemetry16:30
*** prashantD has joined #openstack-telemetry16:36
openstackgerritRohit Jaiswal proposed openstack/python-ceilometerclient: Enhances client to support unique meter retrieval  https://review.openstack.org/27263316:41
openstackgerritMerged openstack/gnocchi: storage/carbonara: store TimeSerieAggregated in splits  https://review.openstack.org/25843416:46
*** nicodemus_ has joined #openstack-telemetry16:57
openstackgerritMerged openstack/gnocchi: rest: fix metric access for linked projects  https://review.openstack.org/26974616:58
nicodemus_hello sileht17:00
*** vishwanathj has joined #openstack-telemetry17:00
silehtnicodemus_, hi17:00
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Allow to disable rados thread system  https://review.openstack.org/27265017:00
nicodemus_leitan mentioned that you are preparing the monkeypatch for gnocchi-metricd17:01
nicodemus_I'd be more than happy to try it out when ready17:01
silehtnicodemus_, yes but I have some trouble on my dev env (devstack related). So I'm kind of block until I solve them.17:02
silehtnicodemus_, that the idea: https://review.openstack.org/27265017:02
*** vishwana_ has joined #openstack-telemetry17:02
*** julim_ has joined #openstack-telemetry17:02
*** rbak has joined #openstack-telemetry17:03
*** vishwana_ is now known as vishwanathj_17:03
*** diogogmt_ has joined #openstack-telemetry17:04
nicodemus_sileht: great, I'll test it and let you know how it goes17:06
*** vishwanathj has quit IRC17:07
*** diogogmt has quit IRC17:07
*** julim has quit IRC17:07
*** nijaba has quit IRC17:07
*** diogogmt_ is now known as diogogmt17:07
*** nijaba has joined #openstack-telemetry17:08
*** nijaba has quit IRC17:08
*** nijaba has joined #openstack-telemetry17:08
*** thorst_ has quit IRC17:15
*** jaypipes has quit IRC17:16
*** cdent has quit IRC17:16
*** ljxiash_ has quit IRC17:17
*** openstackgerrit has quit IRC17:17
*** ljxiash has joined #openstack-telemetry17:17
*** openstackgerrit has joined #openstack-telemetry17:18
*** renatoarmani has joined #openstack-telemetry17:20
openstackgerritMerged openstack/gnocchi: ceph, swift: do not fail if unprocess measures already deleted  https://review.openstack.org/27247517:22
*** ljxiash has quit IRC17:23
*** thorst_ has joined #openstack-telemetry17:23
pradkjd__, gordc, we're having a versioning issue with gnocchi.. here is the situation17:24
pradkthe latest tag on master seems to be $ python setup.py --version17:24
pradk1.3.1.dev22317:24
pradkbut the latest stable tag is 1.3.317:25
stevelleanyone used keystone v3 auth with swift storage for gnocchi yet?17:25
pradkjd__, so when delorean does nightly builds, the master packages endup with older versions than stable17:25
*** thorst_ has quit IRC17:28
pradkjd__, can we bump the master tag to something newer than 1.3.1.dev223?  1.4.0a1 is what apevac suggested as a prerelease so it doesnt conflict with 1.3.* stream17:28
*** EmilienM has quit IRC17:30
*** EmilienM has joined #openstack-telemetry17:34
gordcpradk: we're tagging master as 2.0.0.17:38
gordcstevelle: you run into issues? keystonev3 should be tested alongside gate.17:38
* gordc is eating lunch so will be delayed a bit17:38
pradkgordc, ok when is it planned? currently ci fails as it always gets older liberty packages for mitaka17:39
stevelleI'm running into problems yes, gordc during db sync step and getting a stacktrace. likely my problem at this point.17:40
stevelleI'm concerned that I have my auth config wrong, however. The generated gnocchi.conf doesn't do enough to describe swift under v3 auth imho17:41
*** mattyw has quit IRC17:42
*** mattyw has joined #openstack-telemetry17:42
zigoI'm having a very hard time to package the new wsgi-intercept, needed by the new gabbi, itself needed by Ceilometer Mitaka b2.17:44
zigohttps://mitaka-trusty.pkgs.mirantis.com/job/python-wsgi-intercept/2/console17:44
zigoCould someone help me with it?17:44
*** diogogmt has quit IRC17:44
*** yassine__ has quit IRC17:48
gordcstevelle: can you paste stacktrace somewhere? paste.openstack.org17:53
stevellegordc: http://paste.openstack.org/show/Vqa25D5RC6aFYqyWtYXH/17:54
gordczigo: ... cdent doesn't seem to be here. don't know if you have some internal mirantis channel you can reach him on.17:54
zigoOk, will do.17:55
zigogordc: Though I think I have understood what the problem was.17:55
zigohttp_proxy / https_proxy beeing set ... :)17:55
gordczigo: cool cool.17:55
gordcif anything, just ignore gabbi, it's only for testing17:55
gordcpradk: no idea. i'm assuming only jd__ has release control over gnocchi17:56
*** diogogmt has joined #openstack-telemetry17:58
gordcstevelle: hmm... i'll need to dig around. seems like we configure swift backend with keystonev2 https://github.com/openstack/gnocchi/blob/master/devstack/plugin.sh#L25717:59
stevellegordc: that was my fear, no support for user domain or project domain would lead me to have a bad time18:00
stevellethanks for the eyeballs18:00
*** julim has joined #openstack-telemetry18:00
gordcstevelle: i'll take a look. the gnocchi service uses v3 so i imagine it should be possible18:02
gordcsileht: ^ if you have configuratoin already handy18:02
jd__pradk: hm, I see, I'll try to fix taht18:02
*** vishwanathj_ has quit IRC18:02
stevellegordc: I know swift client can use v2, I need to run for a bit but can poke more in a bit. will see what develops in channel here while I'm out18:03
stevelle(I believe it still defaults to 2)18:03
*** julim_ has quit IRC18:03
sileht/1/118:05
*** safchain has quit IRC18:08
*** thorst_ has joined #openstack-telemetry18:11
jd__pradk: https://review.openstack.org/#/c/272680/ should fix it18:13
*** harlowja has joined #openstack-telemetry18:18
*** mgarza has joined #openstack-telemetry18:19
*** thorst_ has quit IRC18:19
*** thorst_ has joined #openstack-telemetry18:19
*** thorst_ has quit IRC18:24
openstackgerritJulien Danjou proposed openstack/gnocchi: storage: run expunge_metric in sync mode  https://review.openstack.org/27253518:25
*** liamji has quit IRC18:27
*** efoley has quit IRC18:31
openstackgerritMerged openstack/ceilometer: better support notification coordination  https://review.openstack.org/26762518:36
pradkjd__, cool18:45
*** renatoarmani has quit IRC18:46
*** guillaume_ has joined #openstack-telemetry18:46
*** cdent has joined #openstack-telemetry18:56
*** jaosorior_ has joined #openstack-telemetry18:57
*** shardy_ has quit IRC19:04
*** samstudio8 has joined #openstack-telemetry19:08
openstackgerritMerged openstack/gnocchi: Generate configuration file in sdist  https://review.openstack.org/26970219:11
*** cdent has quit IRC19:13
openstackgerritgordon chung proposed openstack/ceilometer: raise coordination error if not registered  https://review.openstack.org/26829219:14
openstackgerritgordon chung proposed openstack/ceilometer: enable notification agent partitioning  https://review.openstack.org/26780819:14
nicodemus_sileht, do you have a moment?19:14
*** cdent has joined #openstack-telemetry19:15
*** arahal_ has joined #openstack-telemetry19:15
cdentjasonamyers: are you, like, actually around?19:16
jasonamyersyes19:16
cdentzounds!19:16
cdenthow's life?19:16
jasonamyersa touch crazy but good overall19:16
gordcnicodemus_: just for reference, he's based France so he may/may not be active19:17
jasonamyers11 days out from PyTennessee so it's full on organizer time19:17
nicodemus_gordc: oh, I see. Too bad :(19:17
nicodemus_I wanted to report back on testing his patch19:18
*** r-daneel has quit IRC19:18
gordcnicodemus_: you can probably type it out. i'm sure his bouncer will show it next time he's active... or i can tell him tomorrow if not.19:19
gordcor put it on the bug report... your choice :)19:19
*** arahal_ has quit IRC19:19
nicodemus_gordc: I believe there is no specific bug report for the monkeypatch, should I use the one for scaling problems with Ceph?19:21
gordcwe can track there sure.19:21
jd__nicodemus_: or comment in Gerrit directly19:28
*** thorst_ has joined #openstack-telemetry19:29
jd__nicodemus_: though seeing http://logs.openstack.org/50/272650/1/check/gate-gnocchi-dsvm-functional-ceph-mysql/ff89eb9/logs/devstacklog.txt.gz I don't think this patch is working :)19:30
nicodemus_jd__: sadly no.19:30
jd__nicodemus_: so how's everything with all the latest fixes I sent?19:30
nicodemus_gnocchi-metricd process keeps dying and respawning after about five minutes, and I don't see it processing19:31
jd__you have a backtrace?19:31
jd__or a log?19:31
nicodemus_no... the logs only show the debug line introduced by the patch (stating "Enable rados.run_in_thread monkeypatching") once per minute and nothing else19:33
*** thorst_ has quit IRC19:33
jd__oh you were talking about sileht's patch, yeah sure it's not going to work don't worry19:33
jd__he'll have to fix it :)19:33
jd__but other than that?19:33
*** thorst_ has joined #openstack-telemetry19:33
nicodemus_starting gnocchi-metricd on foreground did produce a trace, I'll upload it (just happened)19:34
*** diogogmt has quit IRC19:35
nicodemus_regarding your patch jd__, so far I didn't get any more ObjectNotFound19:36
jd__yay!19:36
jd__I know programming19:36
jd__FINALLY19:36
nicodemus_I'd like to give it some time to process19:36
jd__fair enough19:36
nicodemus_haha I've never had a doubt19:36
jd__thanks for your report :)19:37
nicodemus_glad to help :)19:37
jd__sileht: btw I had question in https://review.openstack.org/#/c/26740919:37
*** thorst_ has quit IRC19:38
*** cdent has quit IRC19:47
*** diogogmt has joined #openstack-telemetry19:49
*** renatoarmani has joined #openstack-telemetry19:50
*** cdent has joined #openstack-telemetry19:52
*** renatoarmani has quit IRC19:56
*** rcernin has quit IRC19:58
nicodemus_jd__, could you please take a look at http://paste.openstack.org/show/485073/ ?20:03
nicodemus_This error happened just now, after a while of metrics being processed20:03
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Allow to disable rados thread system  https://review.openstack.org/27265020:10
silehtnicodemus_, I have uploaded a fixed version (still untested by me)20:13
*** pradk has quit IRC20:14
*** pradk_ has joined #openstack-telemetry20:14
*** pradk_ is now known as pradk20:14
openstackgerritMerged openstack/gnocchi: Fix the wrong datetime format in _store_measures method  https://review.openstack.org/26840720:19
gordcnicodemus_: that's a real bug. you might want to open it.20:24
*** rcernin has joined #openstack-telemetry20:33
*** flwang has left #openstack-telemetry20:33
*** harlowja_ has joined #openstack-telemetry20:36
*** harlowja has quit IRC20:37
*** leitan has quit IRC20:43
nicodemus_sileht: I'm applying the new patch, but will have to test it in about 3 hours (it's taxing on ceph and there are cinder volume uploads that need to finish first)20:43
nicodemus_gordc: ok, I'm submitting it20:43
*** cdent has quit IRC20:44
*** harlowja has joined #openstack-telemetry20:45
*** harlowja_ has quit IRC20:45
openstackgerritgordon chung proposed openstack/ceilometer: fix locking in ceilometer  https://review.openstack.org/27272820:46
gordcnicodemus_: are you running a custom gnocchi environment? the line number in error doesn't match up20:52
*** pradk has quit IRC20:53
nicodemus_gordc: shouldn't be, I'm checking if I missed something20:54
*** pradk has joined #openstack-telemetry20:54
nicodemus_gordc: I'll have to pull from the repo, as quite a few things have changed since Jan 21 when I last pulled20:58
nicodemus_if that typeerror error persists, then I'll report it :)20:59
gordcnicodemus_: kk. it's probably still valid. just strange seeing different numbers.21:04
gordcyou should also have tooz >= 1.2421:07
gordcharlowja: what do the 1.x and 0.x tags in tooz represent?21:10
harlowjaversions?21:10
harlowja:-P21:10
gordc:) clever21:10
harlowja;)21:10
gordcharlowja: specific to a branch?21:11
harlowjanot entirely21:11
harlowjabranches are basically created at cycle boundaries21:11
harlowjabut versions happen in between21:11
harlowjaso 1+ version can be released in a cycle21:12
gordcyou mean 1.x and 0.x can be tied to same cycle?21:12
harlowjaie https://github.com/openstack/releases/blob/master/deliverables/liberty/tooz.yaml all versions in libery21:12
*** cdent has joined #openstack-telemetry21:12
gordci guess i'm really trying to figure out what version has this: https://github.com/openstack/tooz/commit/d01b7d7018b510d23a27249a2c8330e4936f197221:12
harlowjagordc i forget, there might have been a release time where both could of been in the same cycle21:12
harlowjaah that one21:12
nicodemus_I'm using tooz 1.2921:13
harlowjapretty sure 1.22+21:13
gordcnicodemus_: kk should be good.21:13
*** cdent has quit IRC21:13
gordcharlowja: kk. makes sense to me21:14
harlowjaok, its confusing i know, ha21:14
harlowjahttp://docs.openstack.org/developer/tooz/history.html#id821:14
harlowjau can search for the commit message there21:14
harlowjato match it to release21:15
harlowja'Accept blocking argument in lock’s context manager'21:15
gordcharlowja: ah yes, that's a bit easier.21:15
gordcharlowja: thanks!21:15
harlowjanp21:15
openstackgerritgordon chung proposed openstack/gnocchi: bump tooz  https://review.openstack.org/27274021:20
*** boris-42 has quit IRC21:23
*** rcernin has quit IRC21:28
*** julim has quit IRC21:30
*** nicodemus_ has quit IRC21:32
*** jaosorior_ has quit IRC21:39
*** mattyw has quit IRC21:44
*** dan-t has quit IRC22:21
*** davidlenwell has quit IRC22:24
*** davidlenwell has joined #openstack-telemetry22:25
*** prashantD has quit IRC22:28
*** prashantD_ has joined #openstack-telemetry22:29
*** ljxiash has joined #openstack-telemetry22:30
*** dan-t has joined #openstack-telemetry22:31
*** ljxiash has quit IRC22:34
openstackgerritgordon chung proposed openstack/ceilometer: fix locking in ceilometer  https://review.openstack.org/27272822:36
*** thorst_ has joined #openstack-telemetry22:44
*** thorst_ has quit IRC22:48
pradkgordc, hey22:51
gordcpradk: yep22:51
pradkgordc, i see you submitted a spec for upgrade docs .. is that done? we have a card on that, wondering if i can close it22:51
gordcupgrade docs?22:52
gordcpradk: rolling upgrades?22:52
pradkgordc, https://review.openstack.org/#/c/242216/ yea one we discussed at the summit22:52
gordcpradk: um. not quite.22:53
*** mragupat has quit IRC22:53
gordci basically need to translate that into our doc repo22:53
gordci was suppose to do it... but then i got distracted22:53
pradkgordc, ah ok22:53
gordcprobably tomorrow22:53
gordcpossibly22:53
pradk:)22:53
pradklemme know if i can help22:53
pradkgordc, anything else to be done in aodhclient? while i wait on Zi22:54
*** boris-42 has joined #openstack-telemetry22:54
gordcpradk: we need to eventually change heat and horizon to use it22:54
gordcheat, i think will need to wait until your gnocchi stuff is in22:55
pradkgordc, ok22:55
gordcpradk: do you recall why aodh -> gnoccih?22:56
gordcit checks gnocchi for rules?22:56
pradkgordc, the rules api talks to gnocchi to validate agg i think22:56
pradkagg methods that is22:56
gordci see22:56
gordcwas going to say move it out of gnocchi... but not sure.22:57
pradkgordc, you released 0.1? i'll package it up this week23:01
gordcpradk: yeah, it's out and about now23:02
pradknice23:02
*** tongli has quit IRC23:11
*** tongli has joined #openstack-telemetry23:13
openstackgerritOpenStack Proposal Bot proposed openstack/ceilometer: Updated from global requirements  https://review.openstack.org/27278023:22
openstackgerritOpenStack Proposal Bot proposed openstack/ceilometermiddleware: Updated from global requirements  https://review.openstack.org/27278123:22

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!