| *** r-daneel has quit IRC | 00:03 | |
| *** r-daneel has joined #openstack-ceilometer | 00:04 | |
| *** nikhil__1 has joined #openstack-ceilometer | 00:11 | |
| *** therve has joined #openstack-ceilometer | 00:11 | |
| *** ekarlso- has joined #openstack-ceilometer | 00:11 | |
| *** ifarkas_ has joined #openstack-ceilometer | 00:12 | |
| *** stenchlarge has quit IRC | 00:12 | |
| *** ekarlso has quit IRC | 00:12 | |
| *** therve` has quit IRC | 00:12 | |
| *** nikhil___ has quit IRC | 00:12 | |
| *** lynxbat has quit IRC | 00:12 | |
| *** dhellmann_ has quit IRC | 00:12 | |
| *** xmltok_ has quit IRC | 00:12 | |
| *** ifarkas has quit IRC | 00:12 | |
| *** lynxbat has joined #openstack-ceilometer | 00:12 | |
| *** dhellmann has joined #openstack-ceilometer | 00:12 | |
| *** claudiub has quit IRC | 00:13 | |
| *** xmltok has joined #openstack-ceilometer | 00:13 | |
| *** packet has quit IRC | 00:18 | |
| openstackgerrit | gordon chung proposed a change to openstack/python-ceilometerclient: test https://review.openstack.org/118931 | 00:23 |
|---|---|---|
| openstackgerrit | A change was merged to openstack/ceilometer: XenAPI support: Update measurements documentation https://review.openstack.org/114874 | 00:24 |
| *** lynxbat has quit IRC | 00:28 | |
| *** promulo_ has joined #openstack-ceilometer | 00:40 | |
| *** r-daneel has quit IRC | 00:43 | |
| *** promulo_ has quit IRC | 00:54 | |
| *** atan8 has joined #openstack-ceilometer | 00:56 | |
| *** drjones has quit IRC | 01:06 | |
| *** gzhai has joined #openstack-ceilometer | 01:06 | |
| *** _cjones_ has joined #openstack-ceilometer | 01:06 | |
| *** _cjones_ has quit IRC | 01:11 | |
| *** atan8 has quit IRC | 01:14 | |
| *** liusheng has joined #openstack-ceilometer | 01:21 | |
| *** nosnos has joined #openstack-ceilometer | 01:54 | |
| *** theanalyst has quit IRC | 02:13 | |
| *** theanalyst has joined #openstack-ceilometer | 02:15 | |
| *** adriant has joined #openstack-ceilometer | 02:22 | |
| *** lynxbat has joined #openstack-ceilometer | 02:25 | |
| *** lynxbat has quit IRC | 02:33 | |
| *** dougwig has quit IRC | 02:36 | |
| *** dougwig_ has joined #openstack-ceilometer | 02:39 | |
| *** sbfox has quit IRC | 02:52 | |
| *** itisit has joined #openstack-ceilometer | 02:58 | |
| *** tongli has quit IRC | 03:05 | |
| cmyster | morning | 03:09 |
| *** ajc_ has joined #openstack-ceilometer | 03:14 | |
| liusheng | morning:D | 03:18 |
| *** shardy_z has quit IRC | 03:40 | |
| *** _cjones_ has joined #openstack-ceilometer | 03:46 | |
| *** _nadya_ has joined #openstack-ceilometer | 04:12 | |
| *** _nadya_ has quit IRC | 04:17 | |
| *** _nadya_ has joined #openstack-ceilometer | 04:47 | |
| *** itisit has quit IRC | 04:50 | |
| *** _cjones_ has quit IRC | 05:05 | |
| *** _cjones_ has joined #openstack-ceilometer | 05:05 | |
| *** _nadya_ has quit IRC | 05:10 | |
| *** _nadya_ has joined #openstack-ceilometer | 05:11 | |
| *** _nadya_ has quit IRC | 05:17 | |
| openstackgerrit | gordon chung proposed a change to openstack/ceilometer: normalise resource data https://review.openstack.org/111313 | 05:29 |
| *** nsaje-office is now known as nsaje | 05:41 | |
| *** Longgeek has joined #openstack-ceilometer | 05:44 | |
| *** _nadya_ has joined #openstack-ceilometer | 05:48 | |
| *** adriant has quit IRC | 05:50 | |
| *** harlowja is now known as harlowja_away | 05:50 | |
| *** _cjones_ has quit IRC | 06:00 | |
| *** _cjones_ has joined #openstack-ceilometer | 06:01 | |
| *** eglynn_ has joined #openstack-ceilometer | 06:02 | |
| *** _cjones_ has quit IRC | 06:05 | |
| openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/ceilometer: Imported Translations from Transifex https://review.openstack.org/118543 | 06:10 |
| *** Longgeek has quit IRC | 06:12 | |
| *** Longgeek has joined #openstack-ceilometer | 06:18 | |
| *** Longgeek_ has joined #openstack-ceilometer | 06:21 | |
| *** Longgeek_ has quit IRC | 06:22 | |
| *** Longgeek_ has joined #openstack-ceilometer | 06:23 | |
| *** Longgeek has quit IRC | 06:24 | |
| *** Longgeek has joined #openstack-ceilometer | 06:24 | |
| *** Longgeek_ has quit IRC | 06:26 | |
| *** samta has joined #openstack-ceilometer | 06:27 | |
| *** _nadya_ has quit IRC | 06:57 | |
| *** adam_g has quit IRC | 07:04 | |
| *** adam_g has joined #openstack-ceilometer | 07:06 | |
| *** adam_g has joined #openstack-ceilometer | 07:06 | |
| *** _nadya_ has joined #openstack-ceilometer | 07:16 | |
| *** Longgeek has quit IRC | 07:20 | |
| *** Longgeek has joined #openstack-ceilometer | 07:21 | |
| *** Longgeek_ has joined #openstack-ceilometer | 07:26 | |
| *** Longgeek_ has quit IRC | 07:27 | |
| *** Longgeek_ has joined #openstack-ceilometer | 07:27 | |
| *** Longgeek has quit IRC | 07:29 | |
| *** shardy has joined #openstack-ceilometer | 07:30 | |
| openstackgerrit | liusheng proposed a change to openstack/ceilometer: Check unsupported query filters of listing events https://review.openstack.org/96653 | 07:30 |
| *** ildikov has joined #openstack-ceilometer | 07:31 | |
| *** eglynn_ has quit IRC | 07:31 | |
| *** Longgeek has joined #openstack-ceilometer | 07:33 | |
| *** Longgeek_ has quit IRC | 07:36 | |
| *** Longgeek has quit IRC | 07:37 | |
| *** Longgeek has joined #openstack-ceilometer | 07:38 | |
| *** mspreitz has quit IRC | 07:40 | |
| nsaje | eglynn__: ouch, I just realized where Ironic drew inspiration for its hash ring impl: https://github.com/openstack/swift/blob/master/swift/common/ring/ring.py#L51 | 07:42 |
| *** gzhai has quit IRC | 07:48 | |
| *** arezmerita has quit IRC | 07:56 | |
| *** safchain has joined #openstack-ceilometer | 08:13 | |
| *** jbuckley has joined #openstack-ceilometer | 08:17 | |
| *** eglynn_ has joined #openstack-ceilometer | 08:31 | |
| nsaje | eglynn_: ouch, I just realized where Ironic drew inspiration for its hash ring impl: https://github.com/openstack/swift/blob/master/swift/common/ring/ring.py#L51 | 08:35 |
| nsaje | eglynn_: I tested the code from the blogpost of the dev that implemented the swift hash ring (http://greg.brim.net/page/building_a_consistent_hashing_ring.html) with our consistency tests | 08:36 |
| nsaje | eglynn_: it fails, so I'm off writing a new ML thread for swift :-) | 08:36 |
| *** flwang1 has joined #openstack-ceilometer | 08:48 | |
| eglynn_ | nsaje: nice digging! :) ... /me is just catching up with the latest on that ML thread now | 09:07 |
| *** Longgeek_ has joined #openstack-ceilometer | 09:13 | |
| *** Longgeek has quit IRC | 09:15 | |
| *** ifarkas_ has quit IRC | 09:15 | |
| *** ifarkas has joined #openstack-ceilometer | 09:17 | |
| *** Longgeek_ has quit IRC | 09:17 | |
| *** Longgeek has joined #openstack-ceilometer | 09:18 | |
| *** claudiub has joined #openstack-ceilometer | 09:25 | |
| *** flwang1 has quit IRC | 09:37 | |
| *** Longgeek_ has joined #openstack-ceilometer | 09:43 | |
| DinaBelova | nsajeб, you have hash ring diving session :) | 09:46 |
| *** Longgeek has quit IRC | 09:46 | |
| DinaBelova | nsaje ^^ :) | 09:47 |
| nsaje | yep :) | 09:47 |
| *** flwang1 has joined #openstack-ceilometer | 10:00 | |
| *** yasukun has quit IRC | 10:03 | |
| openstackgerrit | A change was merged to openstack/ceilometer: Switch to oslo.serialization https://review.openstack.org/117265 | 10:12 |
| *** nosnos has quit IRC | 10:14 | |
| *** nosnos has joined #openstack-ceilometer | 10:15 | |
| *** nosnos_ has joined #openstack-ceilometer | 10:18 | |
| *** Ugallu has joined #openstack-ceilometer | 10:18 | |
| *** nosnos has quit IRC | 10:19 | |
| *** Ugallu has quit IRC | 10:22 | |
| cmyster | eglynn_: heya, got some time for me ? | 10:23 |
| eglynn_ | cmyster: gimme a minute to finish up something | 10:23 |
| *** asalkeld has quit IRC | 10:23 | |
| cmyster | cool, ping us when done | 10:23 |
| *** flwang1 has quit IRC | 10:30 | |
| *** cdent has joined #openstack-ceilometer | 10:30 | |
| *** k4n0_ has quit IRC | 10:33 | |
| *** k4n0 has joined #openstack-ceilometer | 10:35 | |
| *** _nadya_ has quit IRC | 10:35 | |
| *** flwang1 has joined #openstack-ceilometer | 10:36 | |
| *** Ugallu has joined #openstack-ceilometer | 10:38 | |
| *** samta has quit IRC | 10:54 | |
| eglynn_ | cmyster: ... so what's up? | 10:58 |
| cmyster | >> pm | 10:59 |
| *** ajc_ has quit IRC | 11:25 | |
| cdent | eglynn_: you about, have a question on: https://bugs.launchpad.net/ceilometer/+bug/1348818 | 11:30 |
| eglynn_ | cdent: yeap, what's the question? | 11:30 |
| cdent | Assuming it was only made undone by the WSME + sphinx issues, and assuming those are properly fixed, I think it can probably be declared done again. | 11:31 |
| *** eglynn__ is now known as eglynn-officeafk | 11:31 | |
| *** arezmerita has joined #openstack-ceilometer | 11:33 | |
| eglynn_ | cdent: but the "revert" is still in place right? | 11:33 |
| eglynn_ | cdent: ... i.e. https://github.com/openstack/ceilometer/commit/1bd4a3fb | 11:33 |
| cdent | Ah, hadn't realized that ever went in | 11:33 |
| eglynn_ | cdent: wouldn't that have to be un-reverted in order to declare it done again? | 11:33 |
| cdent | Okay, well now would be the wrong time to unrevert that. | 11:34 |
| cdent | When we surface from the current gateness, I'll unrevert that and see how things go, shall I? | 11:34 |
| eglynn_ | cdent: agree ... prolly one to keep in your pocket until juno-3 is safely in the bag | 11:34 |
| eglynn_ | cdent: thanks! | 11:34 |
| * eglynn_ needs to eat :) | 11:35 | |
| *** eglynn_ is now known as eglynn-lunch | 11:35 | |
| *** flwang1 has quit IRC | 11:35 | |
| * cdent thinks that's a mighty fine idea | 11:35 | |
| *** flwang1 has joined #openstack-ceilometer | 11:35 | |
| openstackgerrit | Zhai, Edwin proposed a change to openstack/ceilometer: Add IPMI support https://review.openstack.org/115845 | 11:46 |
| openstackgerrit | Zhai, Edwin proposed a change to openstack/ceilometer: Add IPMI raw data fetching in IPMI agent https://review.openstack.org/119038 | 11:46 |
| openstackgerrit | Joe Hakim Rahme proposed a change to openstack/ceilometer: Run unit tests against MySQL https://review.openstack.org/117753 | 11:47 |
| *** underyx has quit IRC | 11:51 | |
| *** underyx has joined #openstack-ceilometer | 11:51 | |
| *** tongli has joined #openstack-ceilometer | 11:55 | |
| *** isviridov is now known as isviridov_away | 12:08 | |
| *** gordc has joined #openstack-ceilometer | 12:10 | |
| *** rbowen has quit IRC | 12:10 | |
| *** rbowen has joined #openstack-ceilometer | 12:11 | |
| *** itisit has joined #openstack-ceilometer | 12:42 | |
| *** itisit has left #openstack-ceilometer | 12:44 | |
| *** eglynn-lunch is now known as eglynn | 12:58 | |
| *** renatoarmani has joined #openstack-ceilometer | 13:07 | |
| openstackgerrit | gordon chung proposed a change to openstack/python-ceilometerclient: keystone discovery fallback support https://review.openstack.org/118931 | 13:09 |
| DinaBelova | gordc, o/ | 13:09 |
| gordc | DinaBelova: whatsup | 13:09 |
| *** itisit has joined #openstack-ceilometer | 13:10 | |
| DinaBelova | gordc, about your change https://review.openstack.org/113524 | 13:10 |
| gordc | sure | 13:11 |
| DinaBelova | ityaptin is finishing its performance testing right now | 13:11 |
| DinaBelova | we'll have the results in next 30 mins I guess | 13:11 |
| *** eglynn-officeafk is now known as eglynn-office | 13:11 | |
| DinaBelova | some approximate result is: your change gives 30-100% improvement | 13:11 |
| DinaBelova | gordc, that is actually really cool :) | 13:12 |
| gordc | DinaBelova: ... really? | 13:12 |
| *** k4n0 has quit IRC | 13:12 | |
| gordc | DinaBelova: that is not expected... i was going to give up on that patch since i didn't see much on my machine. | 13:12 |
| eglynn-office | DinaBelova, gordc: wow! | 13:12 |
| eglynn-office | DinaBelova: is that repeatable? | 13:12 |
| gordc | DinaBelova: what db are you using? | 13:12 |
| DinaBelova | that's ityaptin who's testing it using his scripts right now | 13:13 |
| ityaptin | gordc: I'm use mysql | 13:13 |
| DinaBelova | gordc - it's MySQL | 13:13 |
| DinaBelova | yeah | 13:13 |
| gordc | ityaptin: is it just default settings? | 13:13 |
| eglynn-office | DinaBelova, ityaptin: 30-100% is a fairly broad range, is that for different types of load scenarios? | 13:13 |
| DinaBelova | eglynn-office, some minutes are needed | 13:14 |
| DinaBelova | ityaptin has the results, but we need to process them :) | 13:14 |
| gordc | DinaBelova: cool cool... we'll let you guys finish up... but that's pretty good news if that's true. | 13:14 |
| ityaptin | eglynn-office, gordc: I will prepare exact results during the next hour and show it. | 13:14 |
| DinaBelova | gordc, np :) | 13:14 |
| gordc | ityaptin: thanks! | 13:14 |
| eglynn-office | ityaptin, DinaBelova, gordc: excellent! ... this will be great ammunition in terms of arguing the case for an FFE on the sql improvements | 13:15 |
| DinaBelova | eglynn-office, yeah, indeed | 13:15 |
| DinaBelova | eglynn-office, gordc - ityaptin will include lab configuration (the mysql part) as well to the results I guess | 13:16 |
| gordc | eglynn-office: agreed. i was going to throw it away when i got 10% increase... but even 30% sounds like a useful patch. | 13:16 |
| gordc | DinaBelova: ityaptin: thanks for all your help. | 13:17 |
| DinaBelova | gordc, pn | 13:17 |
| DinaBelova | np* | 13:17 |
| * gordc should add you guys as co-authors if patch gets accepted for ffe | 13:17 | |
| DinaBelova | gordc :D | 13:17 |
| eglynn-office | gordc: yep, 30% is definitely useful, whereas 100% would be awesome :) | 13:18 |
| DinaBelova | eglynn-office ;) | 13:18 |
| cdent | DinaBelova: which version of mysql? | 13:18 |
| nsaje | DinaBelova: you guys should do a Ceilometer: before & after (for example Icehouse vs. Juno) | 13:19 |
| openstackgerrit | gordon chung proposed a change to openstack/ceilometer: normalise resource data https://review.openstack.org/111313 | 13:19 |
| DinaBelova | ityaptin ^^ - may you answer cdent question? | 13:19 |
| nsaje | DinaBelova: so people see the improvements clearly | 13:19 |
| DinaBelova | nsaje, we're in process right now :) | 13:19 |
| nsaje | DinaBelova: awesome | 13:19 |
| DinaBelova | nsaje, the most nice improvement was the fact that API speed increased :) | 13:20 |
| *** isviridov_away is now known as isviridov | 13:20 | |
| * gordc wonders if it's worthwhile to just use sqla-core on all the queries... i'll wait for results | 13:20 | |
| cdent | What's the relative health of gnocchi these days? Did it get as far as hoped? | 13:27 |
| *** julim has joined #openstack-ceilometer | 13:27 | |
| eglynn-office | cdent: jd__ is on vacation this week, we'll discuss at the team meeting next week | 13:28 |
| cdent | ✔ | 13:28 |
| *** thomasem has joined #openstack-ceilometer | 13:38 | |
| *** alexpilotti has joined #openstack-ceilometer | 13:48 | |
| *** nosnos_ has quit IRC | 13:50 | |
| *** sbfox has joined #openstack-ceilometer | 13:50 | |
| *** nosnos has joined #openstack-ceilometer | 13:51 | |
| *** r-daneel has joined #openstack-ceilometer | 13:53 | |
| *** nosnos has quit IRC | 13:55 | |
| *** dougwig_ is now known as dougwig | 14:00 | |
| *** rbak has joined #openstack-ceilometer | 14:08 | |
| *** ssakhamuri_ has joined #openstack-ceilometer | 14:10 | |
| *** _nadya_ has joined #openstack-ceilometer | 14:12 | |
| *** underyx_ has joined #openstack-ceilometer | 14:14 | |
| *** underyx has quit IRC | 14:17 | |
| *** Ugallu has quit IRC | 14:17 | |
| *** ekarlso- has quit IRC | 14:17 | |
| *** lsmola has quit IRC | 14:17 | |
| *** harlowja_away has quit IRC | 14:17 | |
| *** ssakhamuri has quit IRC | 14:17 | |
| *** aviau has quit IRC | 14:17 | |
| *** underyx_ is now known as underyx | 14:17 | |
| *** ekarlso- has joined #openstack-ceilometer | 14:23 | |
| *** lsmola has joined #openstack-ceilometer | 14:25 | |
| openstackgerrit | Dina Belova proposed a change to openstack/ceilometer-specs: Add spec about central and compute agents merge. https://review.openstack.org/119077 | 14:27 |
| *** fabiog has joined #openstack-ceilometer | 14:30 | |
| *** lsmola is now known as 18VAAT2X4 | 14:33 | |
| ityaptin | eglynn, gordc: https://docs.google.com/document/d/1jdSO4euCVquWQUo-Rc83teL634G3H7euOCC05aTwErY/edit?usp=sharing | 14:33 |
| *** Ugallu has joined #openstack-ceilometer | 14:33 | |
| *** 17SAA4BEV has joined #openstack-ceilometer | 14:33 | |
| *** lsmola has joined #openstack-ceilometer | 14:33 | |
| *** ssakhamuri has joined #openstack-ceilometer | 14:33 | |
| *** aviau has joined #openstack-ceilometer | 14:33 | |
| *** 17SAA4BEV has quit IRC | 14:33 | |
| *** lsmola has quit IRC | 14:34 | |
| *** ssakhamuri has quit IRC | 14:34 | |
| *** aviau has quit IRC | 14:34 | |
| ityaptin | eglynn-office, gordc: Doc with charts and profile results. | 14:34 |
| *** jaypipes has joined #openstack-ceilometer | 14:34 | |
| ityaptin | https://docs.google.com/document/d/1jdSO4euCVquWQUo-Rc83teL634G3H7euOCC05aTwErY/edit?usp=sharing | 14:34 |
| eglynn | ityaptin: excellent :) thank you sir! ... /me reads | 14:34 |
| *** aviau has joined #openstack-ceilometer | 14:35 | |
| ityaptin | gordc, cdent: MySQL version 5.5.28 | 14:36 |
| cdent | thanks ityaptin | 14:36 |
| cdent | We've seen pretty big differences between mysql 5.5 and (mysql 5.6 or mariadb 5.5) | 14:37 |
| *** sbfox has quit IRC | 14:37 | |
| fabiog | ityaptin: apparently MySQL 5.6 does a better job leveraging indexes than 5.5 | 14:37 |
| fabiog | ityaptin: when you explicitly set an index then 5.5 will perform similarly as 5.6 but in the config we had it wasn't fully leveraging the existing indexes. I believe is related to improvements to the joins | 14:38 |
| ityaptin | fabiog: I can try to update MySQL and restart tests. | 14:40 |
| gordc | ityaptin: i believe your current test wouldn't have index i added... | 14:42 |
| gordc | that said, it'll have index on meter_id, and resource_id individually... just not across both | 14:42 |
| fabiog | ityaptin: please try that, you should notice a difference | 14:42 |
| *** ifarkas has quit IRC | 14:42 | |
| ityaptin | fabiog: ok :) | 14:43 |
| gordc | fabiog: would it improve write time? i would think the index is more for read performance? | 14:43 |
| fabiog | ityaptin: also you can try to apply only the index that Srini had and see if you notice changes there as we did: https://review.openstack.org/#/c/116748/ | 14:44 |
| fabiog | gordc: usually indexes improves read times | 14:44 |
| cdent | gordc: I don't think the issue is with that particular index, but rather with mysql's use of indexes at all | 14:45 |
| gordc | cdent: true. | 14:45 |
| cdent | so if there is an upgrade, even without an additional index, there may be differing performance, which is a useful datapoint | 14:45 |
| fabiog | gordc: if the db is smart (all are now :-)) it will build the index after the write is completed so it will not degrade writes | 14:45 |
| fabiog | cdent: yes | 14:45 |
| fabiog | cdent: the 5.6 is way more performant than 5.5 | 14:45 |
| openstackgerrit | gordon chung proposed a change to openstack/ceilometer: switch to sqlalchemy core https://review.openstack.org/113524 | 14:46 |
| gordc | ityaptin: i rebased https://review.openstack.org/#/c/113524/ so it'll have Srinivas' index as well. | 14:46 |
| fabiog | ityaptin: we should test the normalize patch and get overall performances on the before and after patch scenario with 5.5 and 5.6 | 14:48 |
| ityaptin | gordc, fabiog, cdent: is any mysql magic need for test? | 14:48 |
| fabiog | ityaptin: but if you want just to see the effect of indexes on 5..5 vs. 5.6 you can add the index that Srini proposed and you will see significant changes (just for your amusement ...) | 14:48 |
| fabiog | ityaptin: no, just run meter-list from the client and see the difference in performance (that is what we did) | 14:49 |
| fabiog | or sample-list | 14:49 |
| gordc | fabiog: cdent did something similar already... but with mariadb5.5 | 14:49 |
| fabiog | gordc: yes. I saw that. Thanks cdent that was useful | 14:50 |
| cdent | You're welcome. It was tedious but I was feeling stubborn. | 14:50 |
| fabiog | gordc: please send the pointer to ityaptin | 14:50 |
| cdent | https://tank.peermore.com/tanks/cdent-rhat/DatabasePerfTest | 14:50 |
| cdent | I should have done some 4 color glossies | 14:50 |
| fabiog | cdent: I think we need to apply more due diligence in understanding the improvement in performance we bring in | 14:51 |
| cdent | I agree | 14:51 |
| *** ildikov has quit IRC | 14:51 | |
| cdent | And think that in order to have that we need some kind of easy harness for testing that isn't backend dependent | 14:51 |
| *** Dafna has quit IRC | 14:52 | |
| cdent | We're probably already most of the way there, just need to get everyone on the same page. | 14:52 |
| fabiog | cdent: there is a "general" idea that Ceilometer is not performing well and if we add patches that are not going in the right directions we will give all the wrong signals | 14:52 |
| * cdent nods | 14:52 | |
| ityaptin | fabiog, gordc: ok. I'll try run tests with 5.5 and 5.6. | 14:52 |
| fabiog | ityaptin: super, please keep us posted with your results | 14:52 |
| ityaptin | fabiog, gordc: I'll ping you when it will be complete. | 14:53 |
| gordc | fabiog: agreed. good that we have multiple sources testing these patches. | 14:53 |
| gordc | ityaptin: thanks! | 14:53 |
| fabiog | gordc: I could not agree more | 14:53 |
| * cdent wants more hardware | 14:54 | |
| gordc | ityaptin: also, if possible, could you track how many meters/resources you are creating | 14:54 |
| gordc | cdent: same wish here. | 14:54 |
| ityaptin | gordc: one moment, please | 14:55 |
| cdent | and with a wave of hands, ityaptin makes new hardware show up on gordc's desk | 14:55 |
| ityaptin | I used 100k of samples and 100 resources | 14:55 |
| fabiog | ityaptin: just to make sure that you see what we saw ... you should have a sort of linear degradation when you increase resources | 14:57 |
| gordc | ityaptin: cool cool. works for me. just asking because the way db is set up now. it performs better when you have more repeat resources | 14:57 |
| gordc | fabiog: i assume you and i just said the same thing? | 14:58 |
| ityaptin | gordc, fabiog: ok) I can define resource count and will run tests with different resources count. | 14:58 |
| gordc | cdent: still waiting | 14:58 |
| gordc | ityaptin: that's your call. i just wanted to make sure it wasn't a single resource | 14:59 |
| cdent | It's _invisible_ hardware | 15:00 |
| gordc | cdent: funny. i seem to be stocked full of that lately. | 15:00 |
| cdent | Me too. I'd use it but I can never find the power switch. | 15:01 |
| *** ddieterly has joined #openstack-ceilometer | 15:02 | |
| *** r3pl4y has joined #openstack-ceilometer | 15:08 | |
| openstackgerrit | Ladislav Smola proposed a change to openstack/ceilometer: Adding another set of hardware metrics https://review.openstack.org/114954 | 15:16 |
| *** Longgeek has joined #openstack-ceilometer | 15:17 | |
| *** Longgeek_ has quit IRC | 15:20 | |
| nsaje | gordc, fabiog : I replied to you guys' comments on https://review.openstack.org/#/c/117728/ | 15:33 |
| *** rbowen is now known as DrBacchus | 15:36 | |
| *** _cjones_ has joined #openstack-ceilometer | 15:51 | |
| *** packet has joined #openstack-ceilometer | 15:53 | |
| cdent | gordc if you want to point me at the client bug I can dig into it this evening, I'm somewhat temporarily at lose ends | 16:01 |
| gordc | cdent: i didn't create a bug for it... | 16:02 |
| gordc | i think it's related to this: https://bugs.launchpad.net/python-ceilometerclient/+bug/1351841 | 16:02 |
| gordc | cdent: you can pretty much open any tempest log, and if you look at ceilometer-alarm-evaluator logs... you'll see error | 16:04 |
| cdent | I see if I can replicate it in some local tempest runs | 16:05 |
| * cdent nods | 16:05 | |
| gordc | i have this patch: https://review.openstack.org/#/c/118931/ | 16:05 |
| gordc | i'm not sure it's related. | 16:05 |
| cdent | i will, as they say, have a play | 16:05 |
| cdent | Is it not odd that the tempest log if full of all that noise but the test passes? | 16:05 |
| * cdent will take a short walk and then dig | 16:07 | |
| *** sbfox has joined #openstack-ceilometer | 16:07 | |
| *** sbfox has quit IRC | 16:08 | |
| gordc | cdent: sorry, looked away... yeah... i'm not sure why things are failing... that said, we don't have many tempest tests | 16:13 |
| *** stevelle_ has joined #openstack-ceilometer | 16:15 | |
| *** r3pl4y has quit IRC | 16:18 | |
| *** _nadya_ has quit IRC | 16:22 | |
| *** stevelle_ has quit IRC | 16:23 | |
| fabiog | nejc: ping | 16:28 |
| fabiog | nsaje: ping | 16:29 |
| nsaje | fabiog: o/ | 16:29 |
| fabiog | nsaje: I have one question regarding the region stuff and the pollsters that I cannot understand | 16:29 |
| nsaje | fabiog: fire away | 16:30 |
| fabiog | nsaje: if a pollster polls from its region it means that I have to have at least 1 central agent per region, is that right? | 16:30 |
| nsaje | yes, currently it is so | 16:30 |
| nsaje | Ceilometer has always polled just stuff in its own region | 16:30 |
| nsaje | that can change in the future, though :-) | 16:31 |
| fabiog | nsaje: sure that makes sense | 16:31 |
| fabiog | nsaje: the problem is with HA. If that central agent in region A dies, even if the work is partitioned there will be no pollster polling for region A since they are all running in other regions .. do you follow me? | 16:31 |
| nsaje | fabiog: yep, I do | 16:32 |
| nsaje | fabiog: well, first of all I'd do HA inside each region | 16:32 |
| *** jergerber has joined #openstack-ceilometer | 16:32 | |
| nsaje | fabiog: so, multiple central agents running inside each region | 16:32 |
| nsaje | fabiog: if all fail, tough luck at the moment, but the discovery mechanism could easily be extended for cross-region endpoint discovery | 16:33 |
| nsaje | fabiog: but is that a wise thing to do? It's quite a big amount of traffic to be pumping cross-region | 16:33 |
| fabiog | nsaje: yes it is a lot of traffic. But de facto you are defiting the purpose of regions ... | 16:34 |
| nsaje | fabiog: I'm not defeating it, since I'm not 'disabling' cross-region functionality, because it doesn't even exist yet :) | 16:35 |
| nsaje | fabiog: I'm just not enabling it, yet | 16:35 |
| fabiog | nsaje: having multiple regions kind of ensures that if one datacenter is down (really depends on how many AZ you have) you can still survive on the next | 16:35 |
| nsaje | fabiog: yes, but if one datacenter is down, why measure it? | 16:36 |
| fabiog | nsaje: well it could be only a portion of it that is affected | 16:36 |
| fabiog | nsaje: I think adding a sense of "stickiness" to the region is a good thing, but in case there are no pollster from that region others can take over | 16:37 |
| nsaje | fabiog: how much do other projects do cross-region? I can't think of a good example, but here goes: if glance is down, does nova in Region1 use glance in Region2 for images? | 16:37 |
| *** r3pl4y has joined #openstack-ceilometer | 16:38 | |
| fabiog | nsaje: if you want to reduce or eliminate outage, you probably have to | 16:38 |
| nsaje | fabiog: yes, but does it? | 16:38 |
| fabiog | nsaje: that is why you have AZ | 16:39 |
| fabiog | nsaje to eliminate or reduce this risk | 16:39 |
| fabiog | nsaje: now the problem is that in order to do a good job with the central agents you are pushing the burden to the installer/deployer | 16:40 |
| *** pradk has joined #openstack-ceilometer | 16:40 | |
| fabiog | nsaje: I can really have HA for Central Agents if I have at least one copy of the Central Agent in every AZ in my region | 16:41 |
| fabiog | nsaje: do you agree? | 16:41 |
| nsaje | fabiog: well, first I'd like to hear how other projects handle this. I asked about a use-case a few lines back, does nova in Region1 use glance in Region2 if glance in Region1 is down? | 16:42 |
| fabiog | nsaje: give me a sec and I will dig it out on how we do cross-region stuff | 16:45 |
| nsaje | fabiog: thanks | 16:46 |
| fabiog | nsaje: in general though if you have a DNS and a LoadBalancer you can move requests across regions | 16:46 |
| fabiog | nsaje: without the service to knwo about it | 16:46 |
| nsaje | fabiog: if you for example take a look at this image: http://kimizhang.wordpress.com/2013/08/26/openstack-zoning-regionavailability-zonehost-aggregate/ | 16:49 |
| nsaje | fabiog: I don't think services communicate cross-region | 16:50 |
| nsaje | fabiog: among themselves | 16:50 |
| nsaje | fabiog: IIUC, AZ are specific to nova, and regions are almost completely separate clouds, apart from Horizon&Keystone | 16:55 |
| nsaje | fabiog: so it's operator's responsibility to keep each of the regions healthy, which means running multiple central agents in HA in each region, if necessary | 16:55 |
| fabiog | nsaje: the nova guys are taking long to respond ... I will come back to this. | 16:55 |
| nsaje | fabiog: but that's just my understanding, I could be completely wrong here. Thanks for taking the time to discuss this! | 16:56 |
| fabiog | nsaje: I am trying to make sure that confining the pollsters to regions is not de-facto reducing the HA capabilities | 16:56 |
| *** eglynn has quit IRC | 16:57 | |
| nsaje | fabiog: yep, and I completely understand your position. I just want to make sure that we're not over-engineering something that wasn't meant to be in the first place | 16:57 |
| fabiog | nsaje: definitely having 1 CA on each AZ of each Region solves it | 16:57 |
| fabiog | nsaje: last question and then I will go back to reviewing the patch .... | 16:58 |
| fabiog | nsaje: do I need to specify region names/ids in the config of each of these Central Agents or they will be getting this somehow from Keystone? | 16:59 |
| nsaje | fabiog: hmm, good question, I guess you'd need to specify it as it is, let me check | 17:00 |
| *** isviridov is now known as isviridov_away | 17:01 | |
| nsaje | fabiog: yep, currently it uses the config option, can we get this from keystone? | 17:01 |
| nsaje | fabiog: there's a region_name property in keystoneclient.ServiceCatalog, so I guess we can use that | 17:04 |
| *** chuck_ has joined #openstack-ceilometer | 17:05 | |
| nsaje | fabiog: I'm not completely sure, but I think keystone returns endpoints in 'our' region only, if no region is passed in | 17:08 |
| nsaje | fabiog: https://github.com/openstack/python-keystoneclient/blob/32c94d8ecb40bf694b8233ee8ea146bb32dfaba1/keystoneclient/service_catalog.py#L98 | 17:09 |
| *** sbfox has joined #openstack-ceilometer | 17:09 | |
| *** jbuckley has quit IRC | 17:15 | |
| *** Longgeek_ has joined #openstack-ceilometer | 17:16 | |
| *** Longgeek has quit IRC | 17:19 | |
| *** chuck_ has quit IRC | 17:19 | |
| *** harlowja has joined #openstack-ceilometer | 17:20 | |
| *** claudiub has quit IRC | 17:28 | |
| fabiog | nsaje: keystone will return the region where the token was issued | 17:31 |
| nsaje | fabiog: great, then you can leave the region out in the config | 17:31 |
| fabiog | nsaje: considering that in normal cases you will get a token from a "local" keystone we could avoid to have the region in the config | 17:31 |
| fabiog | nsaje: this is a good thing to do because it removes the deployment knowledge of the Central Agent | 17:32 |
| nsaje | fabiog: I agree | 17:32 |
| fabiog | all the central agents now have the same config | 17:32 |
| fabiog | nsaje: please go ahead and make that change and I will review again. thanks a lot. I think we made a significant improvement here | 17:33 |
| nsaje | fabiog: I don't know if it's intended or not, but judging by the code, https://github.com/openstack/python-keystoneclient/blob/32c94d8ecb40bf694b8233ee8ea146bb32dfaba1/keystoneclient/service_catalog.py#L98 , the default behaviour is to return endpoints in our local region | 17:36 |
| nsaje | fabiog: this seems to disable listing all endpoints in all regions together, though | 17:36 |
| nsaje | fabiog: do you have somewhere you can test this quickly? otherwise I'll setup something tomorrow (it's almost 8pm here) | 17:37 |
| fabiog | nsaje: don't worry I will give it a look. You can however retrieve the region from the token and then make a call to keystone client using the region you got from the token | 17:41 |
| fabiog | nsaje: that should keep the current behaviour without having to have the config entry in the config | 17:42 |
| nsaje | fabiog: I'll probably do that, I don't think relying on keystoneclient not behaving as intended is wise | 17:42 |
| nsaje | fabiog: yep | 17:42 |
| fabiog | nsaje: I will put comments in the patch so you can go home now | 17:42 |
| nsaje | fabiog: thanks :-) | 17:42 |
| fabiog | nsaje: good night, talk to you tomorrow | 17:43 |
| nsaje | fabiog: good night! | 17:43 |
| *** packet has quit IRC | 17:45 | |
| *** packet has joined #openstack-ceilometer | 17:46 | |
| openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/ceilometer: Updated from global requirements https://review.openstack.org/110096 | 17:48 |
| *** sbfox has quit IRC | 17:52 | |
| openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/pycadf: Updated from global requirements https://review.openstack.org/119147 | 17:54 |
| *** eglynn has joined #openstack-ceilometer | 18:01 | |
| *** _nadya_ has joined #openstack-ceilometer | 18:03 | |
| *** sbfox has joined #openstack-ceilometer | 18:14 | |
| *** r3pl4y has quit IRC | 18:17 | |
| *** sbfox has quit IRC | 18:30 | |
| *** ddieterly has quit IRC | 18:31 | |
| *** ddieterly has joined #openstack-ceilometer | 18:32 | |
| *** promulo_ has joined #openstack-ceilometer | 18:34 | |
| *** ddieterly has quit IRC | 18:36 | |
| *** nikhil__1 is now known as nikhil | 18:38 | |
| *** nikhil is now known as nikhil_k | 18:38 | |
| *** sbfox has joined #openstack-ceilometer | 18:38 | |
| *** nikhil_k is now known as nikhil__ | 18:40 | |
| *** nikhil__ is now known as nikhilkomawar | 18:42 | |
| *** lynxbat has joined #openstack-ceilometer | 18:44 | |
| *** ddieterly has joined #openstack-ceilometer | 18:46 | |
| *** nikhilkomawar is now known as nikhil_k | 18:48 | |
| *** nikhil_k is now known as nikhilk | 18:49 | |
| *** nikhilk is now known as nikhilk_ | 18:50 | |
| *** nikhilk_ is now known as nikhil__ | 18:50 | |
| *** nikhil__ is now known as nikhil___ | 18:50 | |
| *** ddieterly has quit IRC | 18:51 | |
| *** ddieterly has joined #openstack-ceilometer | 18:51 | |
| *** sdake has quit IRC | 18:51 | |
| *** nikhil___ is now known as nikhil_k | 18:52 | |
| *** ddieterly has quit IRC | 18:55 | |
| *** ddieterly has joined #openstack-ceilometer | 18:56 | |
| *** stevelle_ has joined #openstack-ceilometer | 18:59 | |
| gordc | pradk: regarding the LBaas, FWaas work.. is there a reason they were implemented the way they were? ie using discovery rather than something like https://github.com/openstack/ceilometer/blob/master/ceilometer/network/floatingip.py | 18:59 |
| *** ddieterly has quit IRC | 19:00 | |
| *** ddieterl_ has joined #openstack-ceilometer | 19:00 | |
| pradk | gordc, originally thats how i had it in j-1 if you see.. then eglynn suggested to move it to use discovery so we could leverage central agent scaling. lemme dig up his comments | 19:02 |
| *** itisit1 has joined #openstack-ceilometer | 19:02 | |
| eglynn | gordc, pradk: the idea was that the central agent partitioning logic was going to be plugged into the discovery extensions | 19:03 |
| gordc | pradk: ah ok... i'll play with it as is... | 19:03 |
| *** itisit has quit IRC | 19:03 | |
| gordc | eglynn: cool cool. i need to fix a bug related to it and was wondering if i should make it more like how nsaje implemented discovery items in his current patch. | 19:04 |
| eglynn | yeah the fact that some central agent pollsters still don't use the discovery abstraction turned out to be problematic ... hence https://review.openstack.org/117728 | 19:04 |
| *** ddieterl_ has quit IRC | 19:04 | |
| *** ddieterly has joined #openstack-ceilometer | 19:05 | |
| pradk | eglynn, btw thoughts on https://bugs.launchpad.net/ceilometer/+bug/1357869 ? seems like in pipeline.yaml the discovery is scoped more globally and interfereing with generic source | 19:06 |
| * eglynn looks | 19:06 | |
| pradk | eglynn, will nsaje's discovery patch fix this issue as he seems to have moved the sources out of pipeline now? | 19:06 |
| eglynn | hmmm, is that a duplicate of https://bugs.launchpad.net/ceilometer/+bug/1354536 | 19:07 |
| pradk | eglynn, if i negate the meters in generic source all works well.. if not i see dups | 19:07 |
| pradk | looking | 19:07 |
| eglynn | pradk: what do you mean by a "generic source"? | 19:08 |
| pradk | eglynn, the catchall at the top of pipeline.yaml | 19:08 |
| eglynn | pradk: nsaje's patch introduces the concept of per-pollster default discovery, so as to avoid the explosion of sources in the pipeline.yaml | 19:09 |
| eglynn | pradk: ok, this does look like a separate bug to https://bugs.launchpad.net/ceilometer/+bug/1354536 | 19:10 |
| pradk | eglynn, hmm ok .. so the bug you pasted seems related, but the fix you have is just a unit test? at least i still see the issue on mine | 19:10 |
| pradk | eglynn, i discussed briefly with gordc last week and it seemed like the issue was the scope of discovery .. we water to wait until you get back from vacation to see what you thought | 19:11 |
| pradk | s/water/wanted | 19:11 |
| eglynn | pradk: so the original thought was that the generic catch-all source matching the network.services..* was not going to be a problem | 19:11 |
| eglynn | pradk: ... as no resources would be provided to the pollsters in that case | 19:12 |
| eglynn | pradk: ... as the appropriate discovery was not linked to the pollsters in that context | 19:12 |
| eglynn | pradk: ... obviously that reasoning was faulty in some way | 19:13 |
| eglynn | pradk: ... in any case, I'll take that bug and target it to RC1 | 19:13 |
| pradk | eglynn: cool, i was gonna take a stab at it and see if i can fix the pipeline.py's source to scope the discovery appropriately .. just wanted to wait and see what you thought the issue was | 19:14 |
| *** _nadya_ has quit IRC | 19:14 | |
| eglynn | pradk: a-ha, ok, feel free to grab it back if you want ... otherwise I'll look into it and get a fix into rc1 | 19:18 |
| *** packet has quit IRC | 19:24 | |
| *** Longgeek_ has quit IRC | 19:29 | |
| *** lynxbat has left #openstack-ceilometer | 19:38 | |
| openstackgerrit | Fabio Giannetti proposed a change to openstack/ceilometer-specs: Ceilometer RBAC Support for API https://review.openstack.org/112137 | 19:41 |
| *** stevelle_ has quit IRC | 19:54 | |
| *** liusheng has quit IRC | 20:01 | |
| *** liusheng has joined #openstack-ceilometer | 20:01 | |
| *** fabiog has quit IRC | 20:01 | |
| *** liusheng has quit IRC | 20:02 | |
| *** julim has quit IRC | 20:28 | |
| *** flwang1 has quit IRC | 20:29 | |
| cdent | gordc I've been poking at the keystone stuff and fell in a deep rabbit hole where I found something that doesn't seem right: http://paste.openstack.org/show/106024/ | 20:32 |
| cdent | sorry missed a bit: http://paste.openstack.org/show/106025/ | 20:33 |
| cdent | based on that, processes started by devstack will have an OS_AUTH_URL with a port of 35357 and path of /v2.0 whereas stuff I do after sourcing openrc will be :5000/v2.0 | 20:34 |
| cdent | as noted at https://bugs.launchpad.net/python-ceilometerclient/+bug/1351841/comments/7 | 20:35 |
| cdent | 35357 does not support /v2.0 | 20:35 |
| *** promulo_ has quit IRC | 20:38 | |
| cdent | gordc: doing an experiment at: https://review.openstack.org/#/c/119199/ | 20:41 |
| gordc | cdent: sounds good. might want to pop over to openstack-keystone if you don't want to wait for gate | 20:50 |
| *** itisit1 has quit IRC | 20:50 | |
| cdent | thanks gordc | 20:51 |
| *** promulo_ has joined #openstack-ceilometer | 20:57 | |
| *** itisit has joined #openstack-ceilometer | 20:59 | |
| gordc | cdent: thanks for looking at it. i'll probably be on and off next few days... (brother's getting married) | 21:05 |
| cdent | do you and eoghan have the same brother? | 21:05 |
| cdent | ;) | 21:05 |
| cdent | the keystone guys say it is a known issue and are looking up a ref | 21:05 |
| gordc | cdent: is his brother getting married too? | 21:08 |
| gordc | i'm half irish. /joke | 21:08 |
| nealph_ | cdent: care to take a look at the PaaS event docco and +1 if appropriate? https://review.openstack.org/#/c/113396/ | 21:08 |
| gordc | cdent: ah... awesome | 21:08 |
| *** sbfox has quit IRC | 21:09 | |
| cdent | sweet, https://review.openstack.org/#/c/118757/ just got +A | 21:10 |
| cdent | basic bug in keystone, not in "our" stuff | 21:10 |
| cdent | nealph_: would love to, cool if I wait and do it in about 11 hours? | 21:10 |
| nealph_ | cdent: could you be more specific on the time? | 21:11 |
| *** ddieterly has quit IRC | 21:11 | |
| nealph_ | cdent: I kid, I kid. | 21:11 |
| cdent | gordc: eglyn*'s brother isgetting married yes | 21:11 |
| cdent | :) | 21:11 |
| cdent | it's getting close to my bedtime | 21:11 |
| nealph_ | that's totally fine. | 21:11 |
| *** ddieterly has joined #openstack-ceilometer | 21:12 | |
| * nealph_ thought cdent was US-based... | 21:12 | |
| openstackgerrit | gordon chung proposed a change to openstack/ceilometer: Migrate the rest of the central agent pollsters to use discoveries https://review.openstack.org/117728 | 21:12 |
| openstackgerrit | gordon chung proposed a change to openstack/ceilometer: fix network discovery https://review.openstack.org/119211 | 21:12 |
| cdent | I'm US-accented, but based in the UK, but also not a morning person... | 21:12 |
| nealph_ | ha, fair enough. | 21:13 |
| *** r3pl4y has joined #openstack-ceilometer | 21:13 | |
| *** ddieterly has quit IRC | 21:14 | |
| *** ddieterly has joined #openstack-ceilometer | 21:15 | |
| *** sbfox has joined #openstack-ceilometer | 21:15 | |
| cdent | so I'll make a read of the paas stuff some morning coffee reading | 21:16 |
| cdent | night all | 21:16 |
| * cdent waves | 21:16 | |
| *** cdent has quit IRC | 21:16 | |
| *** gordc has quit IRC | 21:16 | |
| *** ddieterl_ has joined #openstack-ceilometer | 21:17 | |
| *** ddieterly has quit IRC | 21:18 | |
| *** thomasem has quit IRC | 21:23 | |
| *** itisit has quit IRC | 21:24 | |
| *** ajc_ has joined #openstack-ceilometer | 21:29 | |
| *** sbfox has quit IRC | 21:34 | |
| *** sbfox has joined #openstack-ceilometer | 21:38 | |
| *** asalkeld has joined #openstack-ceilometer | 21:38 | |
| *** sdake has joined #openstack-ceilometer | 21:41 | |
| *** sdake has quit IRC | 21:44 | |
| *** sdake has joined #openstack-ceilometer | 21:44 | |
| *** sbfox has quit IRC | 21:47 | |
| *** sbfox has joined #openstack-ceilometer | 21:47 | |
| *** tongli has quit IRC | 21:59 | |
| *** asalkeld has quit IRC | 22:09 | |
| *** pradk has quit IRC | 22:22 | |
| *** alexpilotti has quit IRC | 22:25 | |
| *** asalkeld has joined #openstack-ceilometer | 22:26 | |
| *** ddieterl_ has quit IRC | 22:29 | |
| *** ddieterly has joined #openstack-ceilometer | 22:29 | |
| *** sbfox has quit IRC | 22:31 | |
| *** ddieterly has quit IRC | 22:34 | |
| *** sbfox has joined #openstack-ceilometer | 22:37 | |
| *** sbfox has quit IRC | 22:53 | |
| *** rbak has quit IRC | 23:01 | |
| *** r-daneel has quit IRC | 23:07 | |
| *** ajc__ has joined #openstack-ceilometer | 23:10 | |
| *** gzhai has joined #openstack-ceilometer | 23:10 | |
| *** ajc_ has quit IRC | 23:13 | |
| *** eglynn has quit IRC | 23:20 | |
| *** gzhai has quit IRC | 23:24 | |
| *** gzhai has joined #openstack-ceilometer | 23:31 | |
| *** sdake has quit IRC | 23:57 | |
| *** promulo_ has quit IRC | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!