Tuesday, 2014-09-09

*** jeromatron has quit IRC00:37
*** charlesw has joined #magnetodb00:40
*** charlesw has quit IRC00:52
*** bogeyon18 has quit IRC02:09
*** openstackgerrit has quit IRC02:33
*** openstack has joined #magnetodb03:42
*** sendak.freenode.net sets mode: +ns 03:42
*** sendak.freenode.net sets mode: -o openstack03:46
-sendak.freenode.net- *** Notice -- TS for #magnetodb changed from 1410234156 to 138505268103:46
*** sendak.freenode.net sets mode: +ct-s 03:46
*** achuprin has joined #magnetodb03:46
*** idegtiarov has joined #magnetodb03:46
*** boris-42 has joined #magnetodb03:46
*** ikhudoshyn_ has joined #magnetodb03:46
*** aostapenko has joined #magnetodb03:46
*** igormarnat has joined #magnetodb03:46
*** rushiagr_away has joined #magnetodb03:46
*** ominakov has joined #magnetodb03:46
*** dukhlov has joined #magnetodb03:46
*** isviridov_away has joined #magnetodb03:46
*** [o__o] has joined #magnetodb03:46
*** anteaya has joined #magnetodb03:46
*** achudnovets has joined #magnetodb03:46
*** ChanServ has joined #magnetodb03:46
*** sendak.freenode.net sets mode: +o ChanServ03:46
*** sendak.freenode.net changes topic to "MagnetoDB - key-value database service for OpenStack (https://wiki.openstack.org/wiki/MagnetoDB, logs @ https://botbot.me/freenode/magnetodb/ and http://eavesdrop.openstack.org/irclogs/%23magnetodb/) | More info in our screencast http://goo.gl/21HRCf"03:46
*** rushiagr_away is now known as rushiagr04:29
rushiagrhi folks, think it's time to update magnetodb wiki04:43
rushiagrhttps://wiki.openstack.org/wiki/MagnetoDB04:43
rushiagrseems outdated04:43
*** jeromatron has joined #magnetodb05:06
*** rushiagr is now known as rushiagr_away05:07
*** jeromatron has quit IRC05:08
*** rushiagr_away is now known as rushiagr05:21
*** jeromatron has joined #magnetodb05:33
*** jeromatron has quit IRC05:49
*** jeromatron has joined #magnetodb06:05
*** jeromatron has quit IRC06:05
*** ajayaa has joined #magnetodb06:18
*** isviridov_away is now known as isviridov07:41
isviridovrushiagr, yeap, it is really really outdated. Now we have documentation at RTD magnetodb.readthedocs.org and openstack wiki will be used only for community process support.07:43
isviridovrushiagr, planned to start working on it this week07:43
rushiagrisviridov: okay. Thanks :)07:44
isviridovrushiagr, have you managed to start C* cluster behind the proxy?07:45
rushiagrisviridov: nope. I've given up on that07:58
rushiagrisviridov: I'm in the process of setting it up locally on my laptop (which isnt behind proxy)07:59
rushiagrisviridov: any idea on the minimum requirements of RAM for the devstack+mdb VM?07:59
rushiagrRAM is at a premium on my laptop, so I'd like to use as little as possible :)08:00
rushiagrI'm currently trying with 3.6G08:38
ajayaaHi isviridov,09:01
ajayaaHi dukhlov,09:05
ajayaaI was recently going through https://blueprints.launchpad.net/magnetodb/+spec/monitoring-api09:06
ajayaaIt is unclear on what is the scope of the blueprint and what all is going to be added.09:10
ajayaaCould we have something like a github repo for specs. somthing similar to https://github.com/openstack/keystone-specs09:11
*** openstackgerrit has joined #magnetodb09:21
*** rushiagr is now known as rushiagr_away09:21
*** rushiagr_away is now known as rushiagr09:34
isviridovHello ajayaa. Good point. Let me describe a bit10:13
isviridovajayaa, you are right, most of BP contains no information about implementation details. It is because we have a great communication within mdb team.10:15
isviridovajayaa, now we have contributors and we must make our processes working for everybody10:16
ajayaaisviridov, makes sense!10:16
ajayaa:)10:16
isviridovajayaa, not sure that we need such heavy process with formal approvement of specification, at least until we really need it. But I think that we MUST write a wiki page per every new feature or big change we are adding.10:17
isviridovajayaa, f.e. https://wiki.openstack.org/wiki/MagnetoDB/api or https://wiki.openstack.org/wiki/MagnetoDB/streamingbulkload10:18
isviridovajayaa, let me create the wiki for monitoring api and write down all thoughts about it.10:19
isviridovajayaa, ominakov will update it10:19
isviridovajayaa, if you have any questions right now, feel free to ask.10:19
ajayaaisviridov, In the monitoring api, Do we really want count of number of rows in a table?10:22
ajayaaIt is very expensive, as it will scan all the rows in a table.10:22
ajayaaisviridov, Also creating a wiki for a blueprint makes sense. Thanks! :)10:23
ajayaaisviridov, I think with this kind of queries coming from multiple sources, could easily overwhelm cassandra.10:25
isviridovWe have to provide the information about usage statistics - size of table in bytes, number of items, size of indexes in bytes so on. Another thing, such information should be available not only for tenant, but for external monitoring tool on system level.10:25
isviridovThat is why we need this API10:25
isviridovYou are talking about implementation, and here you are right. Query such a data too often can impact UX. But first API goes, next prototyping of working functionality, next caching the data so on.10:26
isviridovajayaa, we are now on the first stage. Do you have any ideas how to make it better already?10:27
ajayaaokay.10:28
ajayaaisviridov, There are ways in cassandra in which you can get an approximate estimate of rows.10:28
ajayaaBut that really depends on your usage.10:29
ajayaaIt could off by several factors if you have a lot of overwrite.10:29
isviridovWhat do you mean? Approximate data can be good enough.10:30
ajayaahttp://planetcassandra.org/blog/counting-key-in-cassandra/10:30
isviridovajayaa, I see. You know we are really close to using C* JMX for getting size of tables. Shouldn't be a problem to use it for count of items as well. I like it. But must be discussed with ominakov10:37
*** isviridov is now known as isviridov_away10:59
aostapenkoHello everybody. review this patches please https://review.openstack.org/119462        https://review.openstack.org/11531411:14
isviridov_awayajayaa, here it is https://wiki.openstack.org/wiki/MagnetoDB/specs/monitoring-api11:25
isviridov_awayThe whole list https://wiki.openstack.org/wiki/MagnetoDB/specs/11:25
ajayaathanks isviridov_away.11:28
*** isviridov_away is now known as isviridov11:29
openstackgerritA change was merged to stackforge/magnetodb: Fixes bug with put item predefined attributes  https://review.openstack.org/11946212:48
openstackgerritA change was merged to stackforge/magnetodb: Adds mechanism for request time measuring  https://review.openstack.org/11531412:57
isviridovominakov, around?13:22
ominakovisviridov, yep13:30
ominakovhi guys13:30
isviridovHello ominakov. Really wanted to talk with you.13:31
isviridovI've started drafting spec about monitoring API. Here it is https://wiki.openstack.org/wiki/MagnetoDB/specs/monitoring-api13:32
isviridovPlease add there implementation details so on. We have to be more open.13:32
isviridovHave to managed to talk with C* guys?13:33
*** charlesw has joined #magnetodb13:35
*** bogeyon18 has joined #magnetodb13:35
ominakovisviridov, ok, i'll add details and no i didn't have talk with C* guys yet13:41
ominakovisviridov,  jeromatron wrote only: "just checking with the opscenter guys now.  it sounds like that's what they do.  just get the jmx estimate and add it up through the cluster."13:41
ominakovtoday i'll try manage more details conversation13:42
openstackgerritDmitriy Ukhlov proposed a change to stackforge/magnetodb: Adapt cassandra tox tests to the latest code  https://review.openstack.org/12009413:46
openstackgerritAleksey Chuprin proposed a change to stackforge/magnetodb: (WIP) Investigation problem with tox job timeout  https://review.openstack.org/11946713:55
*** ajayaa has quit IRC14:09
openstackgerritA change was merged to stackforge/magnetodb: Heap memory parameters are configurable now  https://review.openstack.org/11945814:11
aostapenkohttps://bugs.launchpad.net/magnetodb/+bug/136730314:14
*** jeromatron has joined #magnetodb14:29
*** bogeyon18 has quit IRC14:48
*** bogeyon18 has joined #magnetodb15:05
*** bogeyon18 has quit IRC15:13
ominakovjeromatron, hello. If i right understand there are two ways to know count of rows in CF: 1) for rough estimate we can use JMX; 2) for exact value we should use COUNT(*) through all our data (it's very expensive operation). Right?15:18
*** bogeyon18 has joined #magnetodb15:23
jeromatronoh for number of rows, select count is very expensive, yes.  it will have to do a scan of all the data15:26
*** jeromatron has quit IRC15:39
openstackgerritA change was merged to stackforge/magnetodb: Adapt cassandra tox tests to the latest code  https://review.openstack.org/12009415:39
*** bogeyon18 has quit IRC16:06
*** jeromatron has joined #magnetodb16:27
*** rushiagr is now known as rushiagr_away16:49
*** bogeyon18 has joined #magnetodb17:14
*** rushiagr_away is now known as rushiagr17:14
*** rushiagr is now known as rushiagr_away17:20
*** rushiagr_away is now known as rushiagr17:21
*** isviridov is now known as isviridov_away17:22
*** rushiagr is now known as rushiagr_away17:23
*** bogeyon18 has quit IRC17:29
*** bogeyon18 has joined #magnetodb17:39
*** jeromatron has quit IRC18:23
*** jeromatron has joined #magnetodb18:31
*** bogeyon18 has quit IRC18:35
*** bogeyon18 has joined #magnetodb18:35
*** bogeyon18 has quit IRC18:58
*** openstackgerrit has quit IRC19:02
*** bogeyon18 has joined #magnetodb19:03
*** bogeyon18 has quit IRC19:35
*** bogeyon18 has joined #magnetodb19:40
*** openstackgerrit has joined #magnetodb19:42
*** bogeyon18 has quit IRC20:36
*** jeromatron has quit IRC21:54
*** jeromatron has joined #magnetodb21:56
*** charlesw has quit IRC21:59
*** jeromatron has quit IRC23:03
*** charlesw has joined #magnetodb23:15
*** jeromatron has joined #magnetodb23:28
*** charlesw has quit IRC23:30

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!