Comments on: First stats with Tokyo Cabinet http://blog.inkzee.com/index.php/2009/06/25/first-stats-with-tokyo-cabinet/ How to read more in less time Thu, 09 Sep 2010 13:51:39 +0000 http://wordpress.org/?v=2.9.1 hourly 1 By: Bruce http://blog.inkzee.com/index.php/2009/06/25/first-stats-with-tokyo-cabinet/comment-page-1/#comment-3017 Bruce Wed, 19 May 2010 16:32:50 +0000 http://blog.inkzee.com/?p=62#comment-3017 uhmmm interesting uhmmm interesting

]]> By: Pavel Guzhikov http://blog.inkzee.com/index.php/2009/06/25/first-stats-with-tokyo-cabinet/comment-page-1/#comment-2481 Pavel Guzhikov Tue, 29 Sep 2009 13:57:40 +0000 http://blog.inkzee.com/?p=62#comment-2481 Hi there. I'm doing a little research for my big project and looking for some good key-value db with success stories. Yeap, I know TC is really good. But what python bindings are you talking about? It's really important for me, so I'm here and waiting for your answer :] Thanks. Hi there.

I’m doing a little research for my big project and looking for some good key-value db with success stories.

Yeap, I know TC is really good. But what python bindings are you talking about? It’s really important for me, so I’m here and waiting for your answer :]

Thanks.

]]> By: abarrera http://blog.inkzee.com/index.php/2009/06/25/first-stats-with-tokyo-cabinet/comment-page-1/#comment-1201 abarrera Sun, 28 Jun 2009 16:52:37 +0000 http://blog.inkzee.com/?p=62#comment-1201 @Jorge, problem with BDB is that's it's slow compared to Tokyo Cabinet. I really don't need special extra functionality. I do few weird operations from a database point of view. Although TC also supports more abstract operations, alas BDB :) Check out the numbers: http://tokyocabinet.sourceforge.net/benchmark.pdf TC also has transactions, replication, logging, btree, hash, in-memory storage ;) I already use in-memory storage with memcache, which btw, is also supported by Tokyo Tyrant (access to the data through the memcache protocol). Thanks for the tips though! @Jorge, problem with BDB is that’s it’s slow compared to Tokyo Cabinet. I really don’t need special extra functionality. I do few weird operations from a database point of view. Although TC also supports more abstract operations, alas BDB :)

Check out the numbers: http://tokyocabinet.sourceforge.net/benchmark.pdf

TC also has transactions, replication, logging, btree, hash, in-memory storage ;)

I already use in-memory storage with memcache, which btw, is also supported by Tokyo Tyrant (access to the data through the memcache protocol).

Thanks for the tips though!

]]> By: Jorge http://blog.inkzee.com/index.php/2009/06/25/first-stats-with-tokyo-cabinet/comment-page-1/#comment-1136 Jorge Fri, 26 Jun 2009 12:42:25 +0000 http://blog.inkzee.com/?p=62#comment-1136 Alex, Glad that you integrated a container database system. Makes lots of sense for anything that is not database relational. Stats numbers are ok, I would recommend you BerkeleyDB better becaouse is more than a dbm giving you extra functionality, more power, etc... I developed a server implementation, an open source project: http://code.google.com/p/dbmd/ to make Bekeley distributed and not having to locally open database files and work on remote servers with bulk methods, etc... With BerkeleyDB you can have environments, transactions if you wise, replication, duplicate keys, BTREE, HASH, memory cache, etc... For example, you could have most popular feeds in an environment with some memory assigned (like 128MB), having a factor of 10 related to disk access, and the rest of feeds in a low memory environment. This would give you memory access for most popular feeds, disk speed access for less popular. Alex,

Glad that you integrated a container database system. Makes lots of sense for anything that is not database relational. Stats numbers are ok, I would recommend you BerkeleyDB better becaouse is more than a dbm giving you extra functionality, more power, etc…

I developed a server implementation, an open source project:
http://code.google.com/p/dbmd/

to make Bekeley distributed and not having to locally open database files and work on remote servers with bulk methods, etc…

With BerkeleyDB you can have environments, transactions if you wise, replication, duplicate keys, BTREE, HASH, memory cache, etc…

For example, you could have most popular feeds in an environment with some memory assigned (like 128MB), having a factor of 10 related to disk access, and the rest of feeds in a low memory environment. This would give you memory access for most popular feeds, disk speed access for less popular.

]]> By: abarrera http://blog.inkzee.com/index.php/2009/06/25/first-stats-with-tokyo-cabinet/comment-page-1/#comment-1109 abarrera Thu, 25 Jun 2009 14:52:52 +0000 http://blog.inkzee.com/?p=62#comment-1109 Basically, what you work with is a hash table, so you store pairs ok key -> value, for example, idLog -> processPID. They key here is to duplicate content. In a relational DB you normally try to minimize the duplicated content, here it's the opposite. You trade read/write access speeds for cpu and space. So for example, instead of joining 2 tables, you duplicate (a process called denormalization) the data under both keys: idLog:bla -> [field1, field2] idLog:bla2 -> [field1, field3, field4] You then do all sortings, filtering, etc on the business logic side of the app, instead of the database. Hope it helps a little ;) Basically, what you work with is a hash table, so you store pairs ok key -> value, for example, idLog -> processPID. They key here is to duplicate content. In a relational DB you normally try to minimize the duplicated content, here it’s the opposite. You trade read/write access speeds for cpu and space.

So for example, instead of joining 2 tables, you duplicate (a process called denormalization) the data under both keys:

idLog:bla -> [field1, field2]
idLog:bla2 -> [field1, field3, field4]

You then do all sortings, filtering, etc on the business logic side of the app, instead of the database.

Hope it helps a little ;)

]]> By: Ceporrock http://blog.inkzee.com/index.php/2009/06/25/first-stats-with-tokyo-cabinet/comment-page-1/#comment-1106 Ceporrock Thu, 25 Jun 2009 14:30:11 +0000 http://blog.inkzee.com/?p=62#comment-1106 Ok, I'm not really used to this advanced technology, I'm just the coffee-carrier-man at my office, but, can you explain it a little bit more? I mean, what is a tuple for, and how are relationships made in that schema-less designs :o Examples, please! Ok, I’m not really used to this advanced technology, I’m just the coffee-carrier-man at my office, but, can you explain it a little bit more? I mean, what is a tuple for, and how are relationships made in that schema-less designs :o Examples, please!

]]> By: abarrera http://blog.inkzee.com/index.php/2009/06/25/first-stats-with-tokyo-cabinet/comment-page-1/#comment-1101 abarrera Thu, 25 Jun 2009 10:47:21 +0000 http://blog.inkzee.com/?p=62#comment-1101 Thinking about using it at work? :P Thinking about using it at work? :P

]]> By: Gabriel http://blog.inkzee.com/index.php/2009/06/25/first-stats-with-tokyo-cabinet/comment-page-1/#comment-1100 Gabriel Thu, 25 Jun 2009 10:38:16 +0000 http://blog.inkzee.com/?p=62#comment-1100 uhmmm interesting uhmmm interesting

]]>