| *** Qiming has joined #openstack-ceilometer | 00:09 | |
| *** adam_g has joined #openstack-ceilometer | 00:10 | |
| *** Qiming has quit IRC | 00:14 | |
| adam_g | any weirdness going on around the switch to oslo.utils? running into grenade issues atm: http://paste.openstack.org/show/100732/ | 00:15 |
|---|---|---|
| adam_g | doh | 00:21 |
| adam_g | http://logs.openstack.org/14/115214/7/gate/gate-tempest-dsvm-full/876ee44/logs/screen-ceilometer-alarm-evaluator.txt.gz | 00:21 |
| adam_g | https://bugs.launchpad.net/ceilometer/+bug/1361917 | 00:41 |
| *** joannah has joined #openstack-ceilometer | 00:47 | |
| *** sbfox has joined #openstack-ceilometer | 00:48 | |
| *** joannah has quit IRC | 00:51 | |
| *** joannah has joined #openstack-ceilometer | 00:52 | |
| *** joannah has quit IRC | 00:53 | |
| *** joannah has joined #openstack-ceilometer | 00:54 | |
| *** alexpilotti has quit IRC | 00:56 | |
| *** sbfox has quit IRC | 00:56 | |
| *** joannah has quit IRC | 00:58 | |
| *** alexpilotti has joined #openstack-ceilometer | 01:02 | |
| *** joannah has joined #openstack-ceilometer | 01:05 | |
| *** alexpilotti has quit IRC | 01:06 | |
| *** joannah has quit IRC | 01:06 | |
| *** joannah has joined #openstack-ceilometer | 01:08 | |
| *** joannah has quit IRC | 01:09 | |
| *** Qiming has joined #openstack-ceilometer | 01:10 | |
| *** renlt has joined #openstack-ceilometer | 01:12 | |
| *** _cjones_ has quit IRC | 01:16 | |
| *** _cjones_ has joined #openstack-ceilometer | 01:17 | |
| *** _cjones_ has quit IRC | 01:21 | |
| *** sbfox has joined #openstack-ceilometer | 01:28 | |
| *** shakamunyi has quit IRC | 01:29 | |
| *** mitz_ has joined #openstack-ceilometer | 01:31 | |
| *** mitz has quit IRC | 01:33 | |
| *** shakamunyi has joined #openstack-ceilometer | 01:37 | |
| *** yasukun has joined #openstack-ceilometer | 01:37 | |
| *** nosnos has joined #openstack-ceilometer | 01:56 | |
| *** _cjones_ has joined #openstack-ceilometer | 02:06 | |
| *** rbak__ has joined #openstack-ceilometer | 02:19 | |
| *** fnaval has joined #openstack-ceilometer | 02:20 | |
| *** rbak_ has quit IRC | 02:21 | |
| *** _cjones_ has quit IRC | 02:23 | |
| *** renlt has quit IRC | 02:27 | |
| *** yasukun has quit IRC | 02:43 | |
| *** yasukun has joined #openstack-ceilometer | 02:43 | |
| *** harlowja is now known as harlowja_away | 02:44 | |
| *** changbl has joined #openstack-ceilometer | 03:12 | |
| *** stevelle has quit IRC | 03:19 | |
| *** sdake_ has quit IRC | 03:20 | |
| *** nosnos has quit IRC | 03:23 | |
| *** nosnos has joined #openstack-ceilometer | 03:24 | |
| *** stevelle has joined #openstack-ceilometer | 03:27 | |
| *** nosnos has quit IRC | 03:28 | |
| *** fnaval has quit IRC | 03:29 | |
| *** harlowja_away has quit IRC | 03:29 | |
| *** fnaval has joined #openstack-ceilometer | 03:30 | |
| *** yasukun has quit IRC | 03:36 | |
| *** yasukun has joined #openstack-ceilometer | 03:37 | |
| *** yasukun has quit IRC | 03:38 | |
| *** yasukun has joined #openstack-ceilometer | 03:38 | |
| *** nsaje has quit IRC | 03:50 | |
| *** nsaje has joined #openstack-ceilometer | 03:51 | |
| *** _cjones_ has joined #openstack-ceilometer | 03:51 | |
| *** nosnos has joined #openstack-ceilometer | 03:53 | |
| *** _cjones_ has quit IRC | 03:56 | |
| *** stevelle has quit IRC | 04:05 | |
| *** fnaval has quit IRC | 04:17 | |
| *** chuck_ has quit IRC | 04:49 | |
| *** zhiyan has joined #openstack-ceilometer | 04:51 | |
| *** _cjones_ has joined #openstack-ceilometer | 04:53 | |
| *** ildikov_ has quit IRC | 04:57 | |
| *** _cjones_ has quit IRC | 04:57 | |
| *** adriant has quit IRC | 05:16 | |
| *** idegtiarov has joined #openstack-ceilometer | 05:16 | |
| *** yasukun has quit IRC | 05:30 | |
| *** yasukun has joined #openstack-ceilometer | 05:31 | |
| nsaje | DinaBelova: o/ ping me when you're here | 05:42 |
| *** yatin has joined #openstack-ceilometer | 05:42 | |
| *** _cjones_ has joined #openstack-ceilometer | 05:53 | |
| *** _cjones_ has quit IRC | 05:58 | |
| *** k4n0 has joined #openstack-ceilometer | 05:59 | |
| *** ildikov_ has joined #openstack-ceilometer | 05:59 | |
| *** asalkeld has quit IRC | 06:17 | |
| *** Longgeek has joined #openstack-ceilometer | 06:20 | |
| *** asalkeld has joined #openstack-ceilometer | 06:21 | |
| *** Qiming has quit IRC | 06:27 | |
| *** atan8 has joined #openstack-ceilometer | 06:34 | |
| *** atan8 has quit IRC | 06:50 | |
| *** nosnos has quit IRC | 07:04 | |
| *** nosnos_ has joined #openstack-ceilometer | 07:04 | |
| *** Qiming has joined #openstack-ceilometer | 07:18 | |
| *** arezmerita has joined #openstack-ceilometer | 07:45 | |
| *** Qiming has quit IRC | 07:52 | |
| *** Qiming has joined #openstack-ceilometer | 07:52 | |
| *** _cjones_ has joined #openstack-ceilometer | 07:55 | |
| *** _cjones_ has quit IRC | 07:59 | |
| *** shakayumi has joined #openstack-ceilometer | 08:01 | |
| *** llu_office has joined #openstack-ceilometer | 08:03 | |
| *** nsaje_ has joined #openstack-ceilometer | 08:03 | |
| *** gpocente1 has joined #openstack-ceilometer | 08:05 | |
| *** _nadya_ has joined #openstack-ceilometer | 08:05 | |
| *** yatin has quit IRC | 08:05 | |
| *** jd__` has joined #openstack-ceilometer | 08:08 | |
| *** dhellmann_ has joined #openstack-ceilometer | 08:08 | |
| *** SergeyLukjanov2 has joined #openstack-ceilometer | 08:09 | |
| *** ruhe2 has joined #openstack-ceilometer | 08:09 | |
| *** Daviey_ has joined #openstack-ceilometer | 08:09 | |
| *** nsaje has quit IRC | 08:10 | |
| *** shakamunyi has quit IRC | 08:10 | |
| *** sbfox has quit IRC | 08:10 | |
| *** jd__ has quit IRC | 08:10 | |
| *** Daviey has quit IRC | 08:10 | |
| *** llu_linux has quit IRC | 08:10 | |
| *** gpocentek has quit IRC | 08:10 | |
| *** ruhe has quit IRC | 08:10 | |
| *** vissborg has quit IRC | 08:10 | |
| *** dhellmann has quit IRC | 08:10 | |
| *** SergeyLukjanov has quit IRC | 08:10 | |
| *** SergeyLukjanov2 is now known as SergeyLukjanov | 08:10 | |
| *** Daviey_ is now known as Daviey | 08:10 | |
| *** ruhe2 is now known as ruhe | 08:10 | |
| *** dhellmann_ has quit IRC | 08:12 | |
| *** jd__` is now known as jd__ | 08:12 | |
| *** dhellmann has joined #openstack-ceilometer | 08:12 | |
| *** Longgeek has quit IRC | 08:20 | |
| *** Longgeek has joined #openstack-ceilometer | 08:21 | |
| *** vissborg has joined #openstack-ceilometer | 08:23 | |
| *** idegtiarov has quit IRC | 08:24 | |
| *** idegtiarov has joined #openstack-ceilometer | 08:25 | |
| *** alexpilotti has joined #openstack-ceilometer | 08:25 | |
| *** Longgeek has quit IRC | 08:25 | |
| *** gpocente1 is now known as gpocentek | 08:28 | |
| *** gpocentek is now known as Guest32108 | 08:28 | |
| *** Guest32108 is now known as gpocentek | 08:30 | |
| *** gpocentek has quit IRC | 08:30 | |
| *** gpocentek has joined #openstack-ceilometer | 08:30 | |
| *** _nadya_ has quit IRC | 08:37 | |
| *** shakayumi has quit IRC | 08:40 | |
| *** Longgeek has joined #openstack-ceilometer | 08:43 | |
| *** inc0 has joined #openstack-ceilometer | 08:44 | |
| inc0 | good morning guys | 08:44 |
| *** nosnos_ has quit IRC | 08:45 | |
| *** nosnos has joined #openstack-ceilometer | 08:46 | |
| *** nosnos has quit IRC | 08:50 | |
| nsaje_ | good morning! | 08:50 |
| *** isviridov|away is now known as isviridov | 08:51 | |
| *** _cjones_ has joined #openstack-ceilometer | 08:56 | |
| *** _cjones_ has quit IRC | 09:00 | |
| *** idegtiarov has left #openstack-ceilometer | 09:03 | |
| *** nosnos has joined #openstack-ceilometer | 09:11 | |
| *** idegtiarov has joined #openstack-ceilometer | 09:13 | |
| *** ccrouch1 has quit IRC | 09:28 | |
| nsaje_ | DinaBelova: earth calling Dina :-) | 09:31 |
| Qiming | cannot start ceilometer-alarm-evaluator in devstack: AttributeError: 'module' object has no attribute 'import_object' | 09:36 |
| nsaje_ | Qiming: i think I was a bug report regarding that this morning | 09:36 |
| Qiming | nsaje_, any quick workaround ? | 09:37 |
| Qiming | nsaje_, I mean by changing package version or configuration options? | 09:37 |
| nsaje_ | Qiming: let me see | 09:37 |
| Qiming | nsaje_, thanks!!! | 09:38 |
| sileht | nsaje_, Qiming someone have tried a fix /1https://review.openstack.org/#/c/117129/1 | 09:38 |
| sileht | nsaje_, adam_g seems that oslo.utils have moved a public method to "protected" | 09:39 |
| sileht | Qiming, ^ | 09:39 |
| sileht | jd__, ^ | 09:39 |
| nsaje_ | why the heck did they put that into protected... can't just go around removing public methods | 09:42 |
| nsaje_ | sileht: what if we put a temporary ignore in pep config and use the protected method? Because fixing this in oslo.utils will require a new release, which is anything but fast | 09:43 |
| sileht | nsaje_, public exists | 09:44 |
| sileht | I have updated the review https://review.openstack.org/#/c/117129/1 | 09:44 |
| nsaje_ | sileht: great, ok then | 09:45 |
| sileht | jd__, eglynn-office , ildikov_ ^ | 09:45 |
| nsaje_ | sileht: I still don't like api changes though :) | 09:45 |
| *** Longgeek has quit IRC | 09:50 | |
| * sileht is waiting coredev until the end of my lunch break, before unblocking gate itself | 09:52 | |
| *** _cjones_ has joined #openstack-ceilometer | 09:56 | |
| *** _cjones_ has quit IRC | 10:01 | |
| idegtiarov | nsaje_: o/ | 10:10 |
| nsaje_ | idegtiarov: hey! | 10:11 |
| idegtiarov | nsaje_: we have completed HA testing with two CA and got from them the same notifications | 10:11 |
| idegtiarov | nsaje_: just duplicates | 10:12 |
| nsaje_ | idegtiarov: I've been waiting for one of you guys to give me some more input! | 10:12 |
| nsaje_ | idegtiarov: I can't reproduce that in devstack | 10:12 |
| nsaje_ | idegtiarov: we'll need to work togethet to debug it | 10:12 |
| nsaje_ | *together | 10:12 |
| idegtiarov | nsaje_: with pleaser | 10:13 |
| idegtiarov | *pleasure | 10:13 |
| *** Qiming has quit IRC | 10:13 | |
| nsaje_ | did you set up any custom logging in the code? otherwise I'll send you a patch to apply the central-agent-ha branch | 10:14 |
| nsaje_ | (or I could actually put the debug statements in the upstream tree as well) | 10:14 |
| idegtiarov | nsaje_: we have made some improvements in tooz zookiper driver | 10:15 |
| nsaje_ | idegtiarov: good, but I'll need debug output from coordination code | 10:15 |
| *** Longgeek has joined #openstack-ceilometer | 10:16 | |
| idegtiarov | nsaje_: in coordination part we only add suffix for resource_id depends on CA | 10:17 |
| nsaje_ | what suffix? | 10:17 |
| idegtiarov | nsaje_: to see from what CA we get meters ) | 10:18 |
| nsaje_ | ah, ok | 10:18 |
| nsaje_ | you save that in the sample? so you have that in publishing code actually? | 10:19 |
| idegtiarov | nsaje_: yep | 10:19 |
| *** inc0_ has joined #openstack-ceilometer | 10:19 | |
| idegtiarov | nsaje_: I think would be grate if you send your new patch in upstream | 10:21 |
| nsaje_ | idegtiarov: working on it as we speak | 10:21 |
| idegtiarov | nsaje_: :) | 10:22 |
| inc0_ | can I have review please?:) https://review.openstack.org/#/c/117137/ | 10:22 |
| *** inc0 has quit IRC | 10:22 | |
| sileht | inc0_, done | 10:30 |
| nsaje_ | idegtiarov: new patch up, adds debugging output | 10:31 |
| nsaje_ | idegtiarov: can you guys check what groups are being joined and what group members are being reported? | 10:32 |
| *** Longgeek has quit IRC | 10:32 | |
| inc0_ | sileht, about your comment, yes, it will generate 2 notifs because there are two notifs. I believe thats exactly how its supposed to work... | 10:32 |
| sileht | inc0_, this plugins doesn't record event of heat, but how many stack have been update/create/deleted | 10:33 |
| idegtiarov | nsaje_: ok! we are going to do that | 10:33 |
| *** flwang1 has joined #openstack-ceilometer | 10:33 | |
| *** yasukun has quit IRC | 10:34 | |
| *** yasukun has joined #openstack-ceilometer | 10:34 | |
| *** flwang1 has quit IRC | 10:34 | |
| *** flwang1 has joined #openstack-ceilometer | 10:35 | |
| inc0_ | sileht, shouldn't there be logic for stack couting elsewhere? I mean in my opinion we should record all events in ceilo, and then filter only .end ones when getting stack count. Some other metrics may for example count stack in progress, and then recording just .end actions won't be enough | 10:36 |
| sileht | inc0_, I think the bug is invalid, if you want to track with ceilometer in how many time a stack has been created, you need to configure the event part of ceilometer and use the event API | 10:36 |
| ildikov_ | sileht: nsaje: as the author pointed out that patch does not solve the issue it seems | 10:37 |
| DinaBelova | nsaje_, o/ | 10:37 |
| nsaje_ | inc0_: as sileht pointed out, notification plugins don't emit events, but samples. Events are handled separately in the event notification plugin | 10:37 |
| ildikov_ | sileht: nsaje: gate log: 2014-08-27 10:33:03.414 | *** Not Whitelisted *** 2014-08-27 10:20:37.681 24055 CRITICAL ceilometer [-] ImportError: Class ceilometer.alarm.service.SingletonAlarmService cannot be found | 10:38 |
| * DinaBelova just came to the office | 10:38 | |
| DinaBelova | wedding things to do :) | 10:38 |
| nsaje_ | DinaBelova: how can you have time to get married if central agent scaling isn't working?! :-) | 10:38 |
| nsaje_ | DinaBelova: I talked to idegtiarov regarding that, so we're progressing | 10:39 |
| DinaBelova | nsaje_, hehe, when we were planning the party I did not know it won't work :) | 10:39 |
| DinaBelova | nsaje_, yeah, /me reading | 10:39 |
| sileht | ildikov_, my bad, the new API import module, not class ... | 10:39 |
| DinaBelova | nsaje_, btw, we have devstack as well | 10:39 |
| inc0_ | nsaje_, sileht we don't want to have sample with create.start? | 10:39 |
| DinaBelova | it is just multinode with additional services | 10:40 |
| nsaje_ | DinaBelova: I'm guessing multinode is the culprit here | 10:40 |
| nsaje_ | DinaBelova: I can't reproduce it single node | 10:40 |
| DinaBelova | nsaje_, hm, even when you're testing the central agent itself? | 10:40 |
| DinaBelova | not the compute one? | 10:40 |
| ildikov_ | sileht: yeap, I've just checked that code now | 10:41 |
| nsaje_ | DinaBelova: no, but it's literally the same code path | 10:41 |
| nsaje_ | DinaBelova: well, we'll know more when we get debug output from the latest patch | 10:41 |
| DinaBelova | okay | 10:42 |
| nsaje_ | inc0_: the notification plugin you modified creates a sample named 'stack.create'. with your modifications, two of those samples would be created for each one creation of a stack | 10:42 |
| DinaBelova | nsaje_, so the compute ones (for the instances and the meters to collect from them) share the load okay? | 10:42 |
| *** zul has joined #openstack-ceilometer | 10:43 | |
| nsaje_ | DinaBelova: yep | 10:43 |
| nsaje_ | DinaBelova: I'm guessing there's a problem with coordination backend, somehow not getting group membership info | 10:43 |
| DinaBelova | nsaje_, a-ha! | 10:43 |
| inc0_ | nsaje_, is that a bad thing? I mean, when we count stacks we can count only stack.create.end samples, but shouldn't we also recore create.start ones? | 10:44 |
| nsaje_ | DinaBelova: not that, if there was an error connecting to the backend, it wouldn't duplicate samples. I'm guessing the agent receives info from tooz that he's the only member. But let's wait for the logs! | 10:44 |
| DinaBelova | nsaje_, yeah, let us find the issue | 10:44 |
| DinaBelova | nsaje_, sorry, that might take some time | 10:44 |
| DinaBelova | multynode devstack is not really stable thing :D | 10:45 |
| nsaje_ | inc0_: We have a meter that counts the number of stacks created. We want to create a sample when a stack is created. That is true when we receive a stack.create.end notification, right? | 10:45 |
| nsaje_ | inc0_: what you're talking about are events - http://docs.openstack.org/developer/ceilometer/events.html | 10:46 |
| inc0_ | yes, maybe then change meter itself?:) | 10:46 |
| nsaje_ | inc0_: there's a distinction between meters and events :-) meters measure some quantity, events represent events | 10:46 |
| nsaje_ | inc0_: do we want to know how many times a stack has begun to get created? Perhaps we do, I don't know, but it doesn't make much sense to me :) | 10:47 |
| inc0_ | nsaje_, yes, I know, but what notification plugin does is record sample. So if we are interested only in .end samples, maybe we should filter out that on meter side | 10:47 |
| inc0_ | nsaje_, we may want to know how many stacks are in progress:) | 10:48 |
| inc0_ | or failed | 10:48 |
| inc0_ | still, thats something meter should solve, not notification plugin imho | 10:49 |
| nsaje_ | inc0_: again, http://docs.openstack.org/developer/ceilometer/events.html | 10:49 |
| *** zul has quit IRC | 10:51 | |
| inc0_ | nsaje_, ok, well then I'll check event part of it then | 10:52 |
| inc0_ | if events are recorded | 10:52 |
| nsaje_ | ildikov_: I was in a docco mood so I revamped the python-ceilometerclient docs: https://review.openstack.org/#/c/117140/ | 10:55 |
| nsaje_ | ildikov_: current state doesn't really reflect well on us | 10:55 |
| *** ifarkas has quit IRC | 10:55 | |
| *** _cjones_ has joined #openstack-ceilometer | 10:57 | |
| *** ccrouch has joined #openstack-ceilometer | 10:57 | |
| *** Longgeek has joined #openstack-ceilometer | 11:00 | |
| *** _cjones_ has quit IRC | 11:01 | |
| *** ifarkas has joined #openstack-ceilometer | 11:02 | |
| *** zul has joined #openstack-ceilometer | 11:04 | |
| *** Qiming has joined #openstack-ceilometer | 11:07 | |
| *** dhellmann has quit IRC | 11:10 | |
| *** cdent has joined #openstack-ceilometer | 11:10 | |
| *** zul has quit IRC | 11:11 | |
| *** dhellmann has joined #openstack-ceilometer | 11:13 | |
| *** zul has joined #openstack-ceilometer | 11:14 | |
| *** ifarkas has quit IRC | 11:14 | |
| *** cdent has quit IRC | 11:15 | |
| *** cdent has joined #openstack-ceilometer | 11:16 | |
| *** nosnos has quit IRC | 11:20 | |
| *** nosnos has joined #openstack-ceilometer | 11:20 | |
| *** nosnos has quit IRC | 11:25 | |
| *** ifarkas has joined #openstack-ceilometer | 11:27 | |
| nsaje_ | DinaBelova, idegtiarov: how's the testing going? | 11:28 |
| *** flwang1 has quit IRC | 11:34 | |
| *** flwang2 has joined #openstack-ceilometer | 11:35 | |
| sileht | jd__, nsaje_, ildikov_ I have proposed an other approch for the import_utils issue, the API method have disapear because import_utils shouldn't be used for this purpose: https://review.openstack.org/#/c/117198/ | 11:40 |
| jd__ | sileht: +2 | 11:41 |
| jd__ | exactly what it should be | 11:41 |
| cdent | yes | 11:44 |
| *** yassine has joined #openstack-ceilometer | 11:49 | |
| nsaje_ | sileht: good idea | 11:53 |
| sileht | nsaje_, just the time you remove all of that with the new tooz evaluator :p | 11:55 |
| nsaje_ | sileht: yeah, hopefuly at least :-) that's why I said just put the hack in in the old patch, but this is better ofcourse | 11:55 |
| *** yasukun has quit IRC | 12:00 | |
| idegtiarov | nsaje_: we are in progress | 12:00 |
| *** idegtiarov has left #openstack-ceilometer | 12:01 | |
| *** idegtiarov has joined #openstack-ceilometer | 12:01 | |
| *** yasukun has joined #openstack-ceilometer | 12:03 | |
| *** yasukun has quit IRC | 12:08 | |
| *** asalkeld has quit IRC | 12:21 | |
| *** inc0 has joined #openstack-ceilometer | 12:27 | |
| * cdent goes home | 12:28 | |
| *** cdent has quit IRC | 12:28 | |
| *** inc0_ has quit IRC | 12:29 | |
| *** inc0__ has joined #openstack-ceilometer | 12:29 | |
| *** inc0 has quit IRC | 12:32 | |
| ildikov_ | nsaje_: I saw the docco, just didn't have time for making a proper review yet | 12:33 |
| nsaje_ | ildikov_: no rush, just letting you know :-) | 12:34 |
| *** inc0__ has quit IRC | 12:34 | |
| nsaje_ | DinaBelova, idegtiarov: if I'm not here when you finish, please e-mail me some logs from different agents, or at least check that they are joining the same groups and reporting the same membership set | 12:36 |
| *** flwang2 has quit IRC | 12:37 | |
| *** gordc has joined #openstack-ceilometer | 12:38 | |
| idegtiarov | nsaje_: now CA on our controller node do not set log notification about join any group at all | 12:39 |
| idegtiarov | nsaje_: jn conpute node we have almost all logs, continue testing | 12:39 |
| nsaje_ | so, compute node joins groups, central doesn't? | 12:40 |
| nsaje_ | *agent | 12:40 |
| idegtiarov | nsaje_: yes. it is | 12:40 |
| nsaje_ | what is your pipeline.yml? | 12:41 |
| nsaje_ | idegtiarov: ^ | 12:41 |
| idegtiarov | nsaje_: pipeline.yaml is the same on both nods | 12:42 |
| nsaje_ | can you paste it somewhere? | 12:42 |
| idegtiarov | nsaje_: yes, just a sec | 12:42 |
| idegtiarov | nsaje_: http://paste.openstack.org/show/101002/ | 12:45 |
| nsaje_ | idegtiarov: ok, I see the problem | 12:48 |
| idegtiarov | nsaje_: I'm looking | 12:49 |
| nsaje_ | idegtiarov: you don't actually use central agent :-) your pipeline config only uses compute pollsters | 12:49 |
| nsaje_ | idegtiarov: for example 'disk.read.bytes' is polled by ceilometer.compute.pollsters.disk:ReadBytesPollster | 12:50 |
| nsaje_ | idegtiarov: ok, I see you do have storage samples, checking that, gimme a sec | 12:52 |
| idegtiarov | nsaje_: so if we want polling 'storage.objects.*' it would be done by compute.pollster not central.agent? | 12:53 |
| nsaje_ | idegtiarov: nope, I missed that | 12:53 |
| idegtiarov | nsaje_: yep | 12:53 |
| idegtiarov | nsaje_: actually we are testing our swift service | 12:53 |
| nsaje_ | idegtiarov: yeah, so: swift pollster doesn't support partitioning! That's it! | 12:55 |
| nsaje_ | idegtiarov: explanation: it doesn't use a discovery plugin, it should, I'll submit a patch for it | 12:55 |
| nsaje_ | idegtiarov: I have no idea why it wasn't modified when discovery plugins were introduced | 12:55 |
| nsaje_ | :-) | 12:55 |
| idegtiarov | nsaje_: I have the same thoughts :-) | 12:56 |
| nsaje_ | idegtiarov: so can you guys check something else, like neutron? | 12:56 |
| *** julim has joined #openstack-ceilometer | 12:57 | |
| idegtiarov | nsaje_: after finish with swift we will try something else of course | 12:57 |
| nsaje_ | idegtiarov: ok, because partitioning won't work with swift | 12:58 |
| *** rbowen has joined #openstack-ceilometer | 12:58 | |
| Qiming | hi, any hint on this error? TypeError: 'unicode' object is not callable | 12:58 |
| nsaje_ | idegtiarov: until it's migrated to the new discovery model | 12:58 |
| *** _cjones_ has joined #openstack-ceilometer | 12:58 | |
| Qiming | context: File "/opt/stack/python-ceilometerclient/ceilometerclient/client.py", line 186, in _do_authenticate | 12:58 |
| idegtiarov | nsaje_: get it! ok we will see what service we can try testing next | 12:59 |
| nsaje_ | one that has discovery: 'xxx' specified in https://github.com/openstack/ceilometer/blob/master/etc/ceilometer/pipeline.yaml | 12:59 |
| nsaje_ | idegtiarov: or you see a discovery.py in its folder in the source | 12:59 |
| idegtiarov | nsaje_: ok. thank you | 13:00 |
| nsaje_ | idegtiarov: leaving for lunch now, bbl | 13:01 |
| idegtiarov | nsaje_: see you | 13:02 |
| *** jasondotstar has joined #openstack-ceilometer | 13:02 | |
| *** _cjones_ has quit IRC | 13:04 | |
| *** yassine has quit IRC | 13:06 | |
| DinaBelova | nsaje_, http://paste2.org/Vs9x8tkd | 13:07 |
| DinaBelova | some not the logs, but some result here | 13:07 |
| DinaBelova | nsaje_, btw - what gordc was testing? | 13:07 |
| DinaBelova | we used swift for central agent | 13:09 |
| DinaBelova | you used instances for the compute ones | 13:09 |
| *** cdent has joined #openstack-ceilometer | 13:11 | |
| gordc | DinaBelova: i don't need to say anything right? ^^ | 13:12 |
| DinaBelova | gordc, hehe, you're online :) | 13:13 |
| DinaBelova | I just forgot you're now :) | 13:13 |
| DinaBelova | now *here* | 13:13 |
| gordc | yep... sort of... still waking up | 13:13 |
| DinaBelova | gordc, what meters and rsources did you use to poll? | 13:13 |
| DinaBelova | hehe, good morning :) | 13:13 |
| gordc | DinaBelova: i used standard pipeline. | 13:13 |
| gordc | so basically everything | 13:14 |
| DinaBelova | a-ha | 13:14 |
| gordc | with neutron enabled | 13:14 |
| DinaBelova | a-ha, so neutron meters were duplicated as well? | 13:14 |
| DinaBelova | if so, nsaje_'s idea that the issue is with the discoveries is wrong | 13:15 |
| DinaBelova | as neutron has the default discovery | 13:15 |
| DinaBelova | if it's not the lbaas or vpnaas | 13:15 |
| DinaBelova | gordc, neutron meters were duplicated as well? | 13:17 |
| gordc | uh... i should try again. i was mostly just going based on fact that both central agent logs had the same log output | 13:17 |
| gordc | ie. 'Polling compute' on both... yada yada yada | 13:17 |
| DinaBelova | a-ha, so the compute meters were duplicated as well, | 13:18 |
| DinaBelova | not only the swift ones | 13:18 |
| DinaBelova | gordc, you see, nsaje_ proposed the idea for the bug reason - that if it's not the default discovery, it won't work | 13:19 |
| DinaBelova | but compute meters have default one | 13:19 |
| gordc | DinaBelova: we use discovery in compute meters? haven't looked at that in a while. | 13:23 |
| DinaBelova | gordc, it's 'default one' | 13:23 |
| DinaBelova | that's why nsaje_ says, his patch will work for them | 13:23 |
| DinaBelova | for the swift we need to set some written discovery - like "discovery: smth" in the pipeline | 13:24 |
| gordc | DinaBelova: hmm.. maybe it's an issue with logging then because i for sure saw duplicate logs for compute meters | 13:24 |
| DinaBelova | he thought, that the issue we had here with idegtiarov is that we're polling the swift | 13:24 |
| gordc | DinaBelova: i'll give it a try again now | 13:24 |
| DinaBelova | gordc, you might saw them in the compute agent logs? | 13:25 |
| DinaBelova | a-ha, no, really | 13:25 |
| DinaBelova | we have meter that is actually doing 'nova list' | 13:25 |
| DinaBelova | so the central agent will poll it itself | 13:25 |
| DinaBelova | gordc, as you might see in the http://paste2.org/Vs9x8tkd - second central agent even did not joined the group | 13:26 |
| DinaBelova | due to the logs | 13:26 |
| gordc | hmm.. interesting. i wonder if there's a way for me to check this in memcached | 13:27 |
| gordc | DinaBelova: i'll play around with it but i think there's some issues to be worked out | 13:27 |
| *** _nadya_ has joined #openstack-ceilometer | 13:28 | |
| DinaBelova | gordc, we checked it using last patch set by nsaje_ | 13:28 |
| DinaBelova | he added some debug messages | 13:28 |
| gordc | oh cool. i'll pull that in | 13:28 |
| *** rbak__ has quit IRC | 13:31 | |
| *** _nadya_ has quit IRC | 13:34 | |
| *** itisit has joined #openstack-ceilometer | 13:36 | |
| *** shakamunyi has joined #openstack-ceilometer | 13:41 | |
| *** Dafna is now known as Dafna_away | 13:57 | |
| *** shakamunyi has quit IRC | 13:58 | |
| *** rbak has joined #openstack-ceilometer | 14:06 | |
| *** ildikov_ has quit IRC | 14:09 | |
| *** joesavak has joined #openstack-ceilometer | 14:11 | |
| *** thomasem has joined #openstack-ceilometer | 14:11 | |
| *** shakamunyi has joined #openstack-ceilometer | 14:12 | |
| *** thomasem has quit IRC | 14:12 | |
| *** thomasem has joined #openstack-ceilometer | 14:16 | |
| gordc | nsaje_, DinaBelova: in a meeting... but it seems like it's working right now using memcached | 14:19 |
| Qiming | DEBUG ceilometer.compute.pollsters.cpu [-] Obtaining CPU Util is not implemented for LibvirtInspector from (pid=9761) get_samples /opt/stack/ceilometer/ceilometer/compute/pollsters/cpu.py:87 | 14:20 |
| Qiming | anybody please help me understand this? ^^^ | 14:21 |
| *** shakamunyi has quit IRC | 14:22 | |
| *** shakamunyi has joined #openstack-ceilometer | 14:23 | |
| *** Dafna_away is now known as Dafna | 14:27 | |
| *** tongli has joined #openstack-ceilometer | 14:30 | |
| *** yassine has joined #openstack-ceilometer | 14:31 | |
| *** ifarkas_ has joined #openstack-ceilometer | 14:36 | |
| *** ifarkas has quit IRC | 14:38 | |
| *** sdake_ has joined #openstack-ceilometer | 14:38 | |
| *** shakamunyi has quit IRC | 14:40 | |
| *** agrebennikov has joined #openstack-ceilometer | 14:47 | |
| *** agrebennikov has quit IRC | 14:47 | |
| *** agrebennikov has joined #openstack-ceilometer | 14:48 | |
| *** agrebennikov has joined #openstack-ceilometer | 14:49 | |
| agrebennikov | hi all, does anyone know how to set up ceilometer so that it put samples from instance Only if the instance is running? | 14:50 |
| DinaBelova | gordc, ok, have a good meeting :) may you please ensure that both compute and network meters are not duplicated and the load is shared please | 14:52 |
| *** renatoarmani has joined #openstack-ceilometer | 14:52 | |
| *** _nadya_ has joined #openstack-ceilometer | 14:53 | |
| *** openstackgerrit has joined #openstack-ceilometer | 14:54 | |
| openstackgerrit | Julien Danjou proposed a change to openstack/ceilometer: Switch to oslo.serialization https://review.openstack.org/117265 | 14:55 |
| gordc | Qiming:... it's not implemented in cpu util (i suppose libvirt does not provide this info) | 14:55 |
| gordc | in libvirt* | 14:55 |
| Qiming | gordc, thanks for the reply | 14:55 |
| gordc | Qiming: there is a cpu_util meter though which i believe we calculate based on cputime | 14:56 |
| *** Longgeek has quit IRC | 14:56 | |
| Qiming | gordc, strange enough, I waited a few more minutes, then I am getting cpu_util now | 14:56 |
| gordc | Qiming: yes, it's a derived meter... you need multiple 'cpu' meter samples before you get cpu_util samlpes | 14:58 |
| Qiming | gordc, I believe it is a transient error. after I modified pipeline yaml by changing 600 to 60 and restarted all ceilometer services, this problem is gone | 14:58 |
| Qiming | gordc, I was suspecting that my upgrade RHEL rpms are introducing some version mismatch problem, but it is not, :) | 14:58 |
| gordc | Qiming: nah, it's probably becaues you didn't wait long enough... you'll only cpu_util meters after second poll... so in 600 internal case, you'd need to wait 10 mins | 14:59 |
| Qiming | gordc, got it. | 14:59 |
| *** _cjones_ has joined #openstack-ceilometer | 15:00 | |
| gordc | agrebennikov: i'm not sure we have that functionality. we just get all instances on the host | 15:00 |
| gordc | agrebennikov: might be a feature to propose | 15:00 |
| gordc | DinaBelova: i'll give it a try. lbaas/vpnaas stuff is throwing a bunch of errors | 15:01 |
| *** tburnes has joined #openstack-ceilometer | 15:03 | |
| *** tburnes has quit IRC | 15:04 | |
| *** _cjones_ has quit IRC | 15:05 | |
| DinaBelova | gordc, do you have them installed? /me still did not try them >_< | 15:06 |
| gordc | DinaBelova: no... but it'll try to find them even if you don't and that's why i'm getting error | 15:07 |
| DinaBelova | :D | 15:07 |
| DinaBelova | hehe, okay, thanks :D | 15:07 |
| DinaBelova | really we're seeing quite strange thing right now | 15:07 |
| DinaBelova | if we'll connect to the zk | 15:08 |
| DinaBelova | directly | 15:08 |
| DinaBelova | we'll see no processed in the groups [compute-global, central-global] | 15:08 |
| DinaBelova | processes* | 15:08 |
| DinaBelova | that's kind of thing that makes we suspicious about tooz zk driver | 15:09 |
| idegtiarov | gordc: we see that both CA join the same group, but steel polling the same resource, as a result we have duplicates of the data | 15:10 |
| *** joesavak has quit IRC | 15:10 | |
| *** joesavak has joined #openstack-ceilometer | 15:11 | |
| *** Titilambert has quit IRC | 15:16 | |
| openstackgerrit | gordon chung proposed a change to openstack/ceilometer: update requirements https://review.openstack.org/116311 | 15:18 |
| gordc | DinaBelova: yeah seems like a tooz issue | 15:18 |
| *** ildikov has joined #openstack-ceilometer | 15:18 | |
| *** IvanBerezovskiy has left #openstack-ceilometer | 15:18 | |
| *** Taytay has joined #openstack-ceilometer | 15:18 | |
| gordc | idegtiarov: what's CA? central or compute? | 15:18 |
| *** Daviey has quit IRC | 15:18 | |
| *** Daviey_ has joined #openstack-ceilometer | 15:19 | |
| *** Daviey_ is now known as Daviey | 15:19 | |
| *** erecio has joined #openstack-ceilometer | 15:22 | |
| *** erecio has quit IRC | 15:22 | |
| *** agrebennikov has quit IRC | 15:22 | |
| *** ruhe has quit IRC | 15:22 | |
| *** gpocentek has quit IRC | 15:22 | |
| *** promulo_ has quit IRC | 15:22 | |
| *** sdake has quit IRC | 15:22 | |
| *** ityaptin has quit IRC | 15:22 | |
| DinaBelova | gordc, finally what's your verdict about memcached as a backend? | 15:22 |
| DinaBelova | was it ok? | 15:22 |
| *** arezmerita has quit IRC | 15:22 | |
| DinaBelova | should we search the problem in the common code or in the driver itself? | 15:22 |
| idegtiarov | gordc: both central agents | 15:22 |
| *** Longgeek has joined #openstack-ceilometer | 15:22 | |
| *** nealph__ has quit IRC | 15:22 | |
| gordc | DinaBelova: i get dups for compute agent | 15:22 |
| *** erecio has joined #openstack-ceilometer | 15:22 | |
| *** agrebennikov has joined #openstack-ceilometer | 15:22 | |
| *** ruhe has joined #openstack-ceilometer | 15:22 | |
| *** gpocentek has joined #openstack-ceilometer | 15:22 | |
| *** promulo_ has joined #openstack-ceilometer | 15:22 | |
| *** sdake has joined #openstack-ceilometer | 15:22 | |
| *** ityaptin has joined #openstack-ceilometer | 15:22 | |
| *** Longgeek has quit IRC | 15:22 | |
| *** erecio has quit IRC | 15:23 | |
| *** erecio has joined #openstack-ceilometer | 15:23 | |
| *** nealph__ has joined #openstack-ceilometer | 15:23 | |
| DinaBelova | gordc, okay, so that means discovery idea is inconsistent :) | 15:24 |
| DinaBelova | okay :) | 15:24 |
| DinaBelova | so here we are - it's smth wrong with tooz | 15:24 |
| DinaBelova | gordc, may you check in memcached directly how are the agents managed? | 15:24 |
| DinaBelova | I'm not sure how that looks like here | 15:24 |
| DinaBelova | but smth like we're done for ZK - went there directly and took a loook | 15:24 |
| *** jergerber has joined #openstack-ceilometer | 15:24 | |
| agrebennikov | hey, is it possible to do anything but calculations with transformers? I mean if I got the status of the instance from the resource (metadata)... Is it possible to put it into the sample? | 15:25 |
| *** stevelle has joined #openstack-ceilometer | 15:30 | |
| *** Dieterbe_ is now known as Dieterbe | 15:30 | |
| *** Dieterbe has quit IRC | 15:30 | |
| *** Dieterbe has joined #openstack-ceilometer | 15:30 | |
| *** thomasem has quit IRC | 15:35 | |
| *** dragondm has quit IRC | 15:37 | |
| *** openstack has joined #openstack-ceilometer | 16:18 | |
| openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/ceilometer: Updated from global requirements https://review.openstack.org/110096 | 16:20 |
| DinaBelova | gordc, afair you tried this with neutron | 16:21 |
| DinaBelova | we're turned on ip.floating meter | 16:21 |
| DinaBelova | created it | 16:21 |
| DinaBelova | and not meter data was there :) | 16:21 |
| DinaBelova | not notification, nothing | 16:21 |
| DinaBelova | :) | 16:21 |
| DinaBelova | so it looks like wer'e having smth wrong with neutron as well | 16:22 |
| DinaBelova | as it should use default discovery | 16:22 |
| DinaBelova | and nothing was there actually | 16:22 |
| *** _nadya_ has quit IRC | 16:22 | |
| nsaje | DinaBelova: we need integration tests right now :-) | 16:23 |
| DinaBelova | :D | 16:23 |
| DinaBelova | so in the discover method it were nothing in self.default_discovery | 16:24 |
| gordc | DinaBelova: are we suppose to have two groups? central-global and central-<hostname>? | 16:26 |
| nsaje | gordc: not really, I'll fix that, but thats not what's causing the issues | 16:28 |
| gordc | nsaje: i see yeah, just looked stranged... thanks for tracking this | 16:29 |
| *** ildikov_ has joined #openstack-ceilometer | 16:30 | |
| *** sbfox has joined #openstack-ceilometer | 16:31 | |
| *** ildikov has quit IRC | 16:33 | |
| *** sdake_ has quit IRC | 16:34 | |
| *** tburnes has joined #openstack-ceilometer | 16:34 | |
| DinaBelova | we're having [compute-global, central-global] groups | 16:35 |
| DinaBelova | gordc ^^ | 16:36 |
| DinaBelova | and that's not the hostname | 16:36 |
| DinaBelova | we're having compute-2 as a name | 16:36 |
| DinaBelova | and controller | 16:36 |
| *** tburnes has quit IRC | 16:37 | |
| *** Q^3 has joined #openstack-ceilometer | 16:37 | |
| *** Q^3 has quit IRC | 16:37 | |
| gordc | DinaBelova: but you have two central and two compute groups though right? i think that's what nsaje mentioned. | 16:37 |
| DinaBelova | gordc, ehm, no | 16:38 |
| nsaje | gordc: that's only if you enable partition king for compute | 16:38 |
| DinaBelova | just one central | 16:38 |
| DinaBelova | and one compute | 16:38 |
| DinaBelova | :-\ | 16:38 |
| nsaje | LOL, autocorrect, partitioning | 16:38 |
| gordc | nsaje: :) | 16:38 |
| DinaBelova | a-ha, yeah | 16:38 |
| gordc | cool cool. yeah i have partitioning enabled | 16:38 |
| DinaBelova | we're having no compue partitioning | 16:38 |
| DinaBelova | a-ha | 16:39 |
| DinaBelova | btw | 16:39 |
| gordc | going to head to lunch. thanks for debugging folks -- don't stay too late. i'll track messages when i get back | 16:40 |
| DinaBelova | gordc, nsaje - do you know what's up with the dicsovery?! we're having no default discovery for the ip.floating, image and image.size meters! | 16:40 |
| DinaBelova | gordc, ok | 16:40 |
| DinaBelova | they are all 'both' - notifications + polling | 16:40 |
| *** idegtiarov has quit IRC | 16:42 | |
| DinaBelova | a-a-and no meters from neutron at all | 16:42 |
| nsaje | DinaBelova Do you have them defined in the pipeline config? Do they exist in the code? | 16:43 |
| DinaBelova | and there are some from glance (but I guess they are from the notificaitons) | 16:43 |
| DinaBelova | yes | 16:43 |
| DinaBelova | we've set them in the pipeline | 16:43 |
| DinaBelova | well, let's about image ones | 16:43 |
| DinaBelova | they are defined in the pipeline | 16:43 |
| DinaBelova | I see them in the meter-list | 16:43 |
| DinaBelova | but in the pdb in the discover method | 16:44 |
| DinaBelova | there were no default discovery | 16:44 |
| DinaBelova | while the polling | 16:44 |
| DinaBelova | wtf?! | 16:44 |
| *** alexpilotti has quit IRC | 16:44 | |
| DinaBelova | glance has the default dicovery | 16:44 |
| DinaBelova | >_< | 16:45 |
| DinaBelova | <>_<> | 16:45 |
| nsaje | No no don't look at default discovery | 16:45 |
| DinaBelova | nsaje? | 16:46 |
| nsaje | If you have pdb in agentmanager.discover, you need to look at the second call | 16:46 |
| nsaje | First call is default discovery | 16:46 |
| nsaje | Second call is plugin discovery | 16:46 |
| DinaBelova | a-ha | 16:46 |
| DinaBelova | one moment | 16:46 |
| DinaBelova | so what's the reason I'm not i the get_my_subset method? | 16:48 |
| DinaBelova | there is pdb there | 16:50 |
| nsaje | DinaBelova: good question, I don't know from here | 16:52 |
| DinaBelova | a-ha, I see the reason - for the plugin discovery it'll be {"images": []} | 16:52 |
| DinaBelova | no discovery actually | 16:52 |
| DinaBelova | agrh | 16:52 |
| DinaBelova | a-ha, no, it were {"images": [{"status": "active", .... there as well - but no get_my_subset method call | 16:53 |
| nsaje | Break in the poll_and_publish method | 16:55 |
| nsaje | And follow from there, until the list of resources is passed to the pollsters | 16:55 |
| nsaje | DinaBelova: ^ | 16:55 |
| DinaBelova | uno momento | 16:55 |
| *** yassine has quit IRC | 16:56 | |
| DinaBelova | nsaje, argh, I need to go home | 16:57 |
| DinaBelova | let me try to copy all the logs | 16:57 |
| DinaBelova | to the paste | 16:57 |
| cdent | DinaBelova, nsaje: Just wanted to confirm that in a devstack, using memcached, and with a couple of instances spun up, I can get the partitioned compute-agent to work properly | 16:58 |
| cdent | But only after fixing some typos in the LOG.debug lines recently added | 16:58 |
| DinaBelova | cdent - multinode devstack? | 16:59 |
| cdent | Not yet, no, this is just a simple setup. | 16:59 |
| DinaBelova | ok | 16:59 |
| cdent | nsaje: If you're on your phone do you mind if I patch the logging fixes so that they are there? | 17:00 |
| nsaje | cdent: go ahead | 17:00 |
| nsaje | :-) | 17:00 |
| cdent | roger that, will do | 17:00 |
| openstackgerrit | Chris Dent proposed a change to openstack/ceilometer: Central agent work-load partitioning https://review.openstack.org/113549 | 17:01 |
| cdent | that makes the iterable, the members and the results visiable int he log | 17:04 |
| *** harlowja has joined #openstack-ceilometer | 17:04 | |
| DinaBelova | nsaje, gordc, cdent - https://www.dropbox.com/s/33bo93yrfqzpmci/ceilo.log?dl=0 logs from all the ceilo on the controller (more or less fresh close to the end - take a look on the timestamps) | 17:06 |
| DinaBelova | these logs are for the two days actually | 17:06 |
| nsaje | DinaBelova: thanks! Will take a look tomorrow | 17:07 |
| DinaBelova | btw, funny moment - now I see the errors in the alarm evaluation - I did not look on it while the testing | 17:07 |
| DinaBelova | but there are traces in the common log | 17:08 |
| DinaBelova | nsaje, np | 17:09 |
| *** pradk has joined #openstack-ceilometer | 17:12 | |
| *** jsavak has joined #openstack-ceilometer | 17:14 | |
| *** joesavak has quit IRC | 17:16 | |
| *** sbfox has quit IRC | 17:36 | |
| *** sdake_ has joined #openstack-ceilometer | 17:36 | |
| *** _nadya_ has joined #openstack-ceilometer | 17:40 | |
| *** _nadya_ has quit IRC | 17:42 | |
| *** sbfox has joined #openstack-ceilometer | 17:42 | |
| *** joesavak has joined #openstack-ceilometer | 17:44 | |
| *** jsavak has quit IRC | 17:47 | |
| *** sbfox has quit IRC | 17:55 | |
| *** _nadya_ has joined #openstack-ceilometer | 17:58 | |
| *** _nadya_ has quit IRC | 18:04 | |
| *** rbak has quit IRC | 18:07 | |
| *** sdake_ has quit IRC | 18:09 | |
| *** sbfox has joined #openstack-ceilometer | 18:10 | |
| cdent | biab | 18:16 |
| *** changbl has quit IRC | 18:26 | |
| *** rbak has joined #openstack-ceilometer | 18:27 | |
| *** changbl has joined #openstack-ceilometer | 18:32 | |
| *** zigo has quit IRC | 18:43 | |
| *** dmsimard is now known as dmsimard_away | 18:44 | |
| *** dmsimard_away is now known as dmsimard | 18:45 | |
| *** harlowja has quit IRC | 18:46 | |
| *** zigo has joined #openstack-ceilometer | 18:46 | |
| *** harlowja has joined #openstack-ceilometer | 18:46 | |
| *** _nadya_ has joined #openstack-ceilometer | 18:49 | |
| *** htruta has joined #openstack-ceilometer | 18:56 | |
| *** sdake_ has joined #openstack-ceilometer | 19:03 | |
| *** sbfox has quit IRC | 19:10 | |
| *** sbfox has joined #openstack-ceilometer | 19:13 | |
| gordc | cdent, nsaje: compute partitioning works for me as well on memcached... hashring doesn't really split that well but i assume that's because i only have a few nodes. | 19:18 |
| gordc | central agent doesn't work for me since there's no default discovery | 19:18 |
| gordc | for reference, this is my pipeline.yaml (it has no discovery configured: http://paste.openstack.org/show/101182/ | 19:21 |
| *** jsavak has joined #openstack-ceilometer | 19:22 | |
| *** sbfox has quit IRC | 19:22 | |
| *** r-daneel has joined #openstack-ceilometer | 19:24 | |
| *** joesavak has quit IRC | 19:24 | |
| *** joesavak has joined #openstack-ceilometer | 19:25 | |
| *** jsavak has quit IRC | 19:28 | |
| *** _nadya_ has quit IRC | 19:33 | |
| *** cdent_ has joined #openstack-ceilometer | 19:34 | |
| *** cdent has quit IRC | 19:36 | |
| *** cdent_ is now known as cdent | 19:36 | |
| *** cdent has quit IRC | 19:47 | |
| openstackgerrit | Eric Pendergrass proposed a change to openstack/python-ceilometerclient: Verify alarm found before modifying https://review.openstack.org/110345 | 19:47 |
| *** cdent has joined #openstack-ceilometer | 19:49 | |
| *** cdent has quit IRC | 19:49 | |
| *** cdent has joined #openstack-ceilometer | 19:57 | |
| *** flwang1 has joined #openstack-ceilometer | 19:57 | |
| *** xmltok has joined #openstack-ceilometer | 19:59 | |
| *** erecio has quit IRC | 20:07 | |
| *** flwang1 has quit IRC | 20:12 | |
| *** nsaje has quit IRC | 20:17 | |
| *** ccrouch has quit IRC | 20:20 | |
| *** sdake_ has quit IRC | 20:31 | |
| cdent | gordc: did you have any leads on why HASHSEED impacts WSME? | 20:32 |
| *** dmsimard is now known as dmsimard_away | 20:33 | |
| *** dmsimard_away is now known as dmsimard | 20:33 | |
| *** tongli has quit IRC | 20:35 | |
| *** julim has quit IRC | 20:36 | |
| gordc | cdent: nah i gave up... | 20:36 |
| gordc | again something not reproducible locally | 20:36 |
| cdent | How did you even figure it out? | 20:36 |
| gordc | the errors we were getting in ceilometer were all timed to sphinxext code that exists in wsme | 20:37 |
| gordc | when i ran tests there. i started fixing issues but i'd post it to gerrit and jenkins would failed | 20:37 |
| gordc | and then i started to run rechecks on the other patches and they all failed. | 20:37 |
| *** ildikov has joined #openstack-ceilometer | 20:37 | |
| cdent | was there any clue to it being hashseed, or just the fact that it was intermittent? | 20:38 |
| gordc | well i added a hashseed patch to wsme and it's the only patch passing... but that's pretty much the extent of my debugging | 20:38 |
| gordc | got to late. | 20:39 |
| gordc | i think it was a friday.lol | 20:39 |
| cdent | :) | 20:39 |
| *** rodrigods has joined #openstack-ceilometer | 20:40 | |
| gordc | i guess i should probably look at that again since gate is broken | 20:41 |
| *** ildikov_ has quit IRC | 20:41 | |
| cdent | Everything is broken :) | 20:41 |
| gordc | :) i guess that's what happens when you merge a 3500line patch | 20:42 |
| cdent | boom! what was that? | 20:42 |
| cdent | I had started looking back at the hashseed stuff, because I did the original fix. | 20:42 |
| gordc | want to look at the wsme issue? figured it's kind of late for you | 20:43 |
| *** dekozo has joined #openstack-ceilometer | 20:43 | |
| cdent | It is getting late for me, but I'm planning to skip out tomorrow morning to do some other stuff so wanted to see if I could get something useful done this evening (other than trying to push existing stuff through) | 20:45 |
| gordc | cool cool. have at it if you'd like | 20:45 |
| cdent | suggestion on how to get it down to its narrowest bit? | 20:46 |
| gordc | didn't get that far. | 20:46 |
| gordc | https://review.openstack.org/#/c/116371/ | 20:46 |
| gordc | that's my patch... it fails pretty regularly with a division by 0 error i think | 20:47 |
| cdent | Okay, I'll start there, as long as your happy with me jumping in there? | 20:47 |
| gordc | i can take a look at it later if anything. i haven't started much debugging so no worries | 20:48 |
| cdent | I'll see if I can push it along some and get back to you. | 20:49 |
| gordc | cdent: sounds good | 20:49 |
| *** asalkeld has joined #openstack-ceilometer | 20:58 | |
| cdent | I've pushed a new patch gordc which fixes the tests that is not good in the face of a random HASHSEED | 21:10 |
| cdent | But what I don't understand is how broken tests in WSME breaks the ceilo docs job? | 21:10 |
| cdent | Or is there a longer chain of issues here? | 21:11 |
| *** jsavak has joined #openstack-ceilometer | 21:11 | |
| *** joesavak has quit IRC | 21:14 | |
| cdent | Or to put it another way, gordc, what does your commit message have to do with the things you changed? | 21:19 |
| *** yassine has joined #openstack-ceilometer | 21:20 | |
| *** terriyu has joined #openstack-ceilometer | 21:20 | |
| *** sbfox has joined #openstack-ceilometer | 21:27 | |
| *** jasondotstar has quit IRC | 21:28 | |
| *** sdake_ has joined #openstack-ceilometer | 21:33 | |
| *** sdake_ has quit IRC | 21:33 | |
| *** sdake_ has joined #openstack-ceilometer | 21:33 | |
| *** jsavak has quit IRC | 22:04 | |
| openstackgerrit | Srinivas Sakhamuri proposed a change to openstack/ceilometer: Get meters query performance improvements using index. https://review.openstack.org/117361 | 22:05 |
| *** nsaje_ has quit IRC | 22:06 | |
| cdent | I think I must be done for the night. | 22:08 |
| * cdent waves | 22:08 | |
| *** cdent has quit IRC | 22:08 | |
| *** gordc has quit IRC | 22:08 | |
| *** rbowen has quit IRC | 22:12 | |
| *** pradk has quit IRC | 22:12 | |
| *** harlowja_ has joined #openstack-ceilometer | 22:13 | |
| *** harlowja_ has quit IRC | 22:15 | |
| *** harlowja_ has joined #openstack-ceilometer | 22:15 | |
| *** jergerber has quit IRC | 22:15 | |
| *** harlowja has quit IRC | 22:16 | |
| *** sbfox has quit IRC | 22:19 | |
| openstackgerrit | Srinivas Sakhamuri proposed a change to openstack/ceilometer: Get meters query performance improvements using index https://review.openstack.org/116748 | 22:19 |
| openstackgerrit | Eric Pendergrass proposed a change to openstack/python-ceilometerclient: Verify alarm found before modifying https://review.openstack.org/110345 | 22:23 |
| *** Daviey has quit IRC | 22:31 | |
| *** sbfox has joined #openstack-ceilometer | 22:32 | |
| *** sdake_ has quit IRC | 22:32 | |
| *** Daviey has joined #openstack-ceilometer | 22:42 | |
| *** yassine has quit IRC | 22:53 | |
| *** stevelle has quit IRC | 23:02 | |
| *** asalkeld has quit IRC | 23:12 | |
| *** itisit has quit IRC | 23:12 | |
| *** stevelle has joined #openstack-ceilometer | 23:13 | |
| *** dmsimard is now known as dmsimard_away | 23:14 | |
| openstackgerrit | Phil Neal proposed a change to openstack/ceilometer: Document the standard for PaaS service notifications https://review.openstack.org/113396 | 23:20 |
| *** sbfox has quit IRC | 23:23 | |
| *** asalkeld has joined #openstack-ceilometer | 23:24 | |
| *** ccrouch has joined #openstack-ceilometer | 23:25 | |
| *** ccrouch has quit IRC | 23:37 | |
| *** ccrouch1 has joined #openstack-ceilometer | 23:40 | |
| *** rbowen has joined #openstack-ceilometer | 23:41 | |
| *** sdake_ has joined #openstack-ceilometer | 23:45 | |
| *** sdake_ has quit IRC | 23:53 | |
| *** sdake_ has joined #openstack-ceilometer | 23:55 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!