Now my perl-script that use it DB work very slow: program spend 4-5
minutes to find 40K records.
Script start every 10 minute, get client identification from some logs
(such as apache), find UUID in BDB and add if it not exists.
Use perl5.8.8, p5-BerkeleyDB-0.31, FreeBSD 6.2.

Settings:
Algorithm: B-Tree
Key - 67-72 bytes
Value - 1 byte - 1Kbyte
'bt_ndata' => 10500248,
'bt_int_pgfree' => 826208,
'bt_pagesize' => 16384,
'bt_free' => 0,
'bt_over_pgfree' => 0,
'bt_leaf_pg' => 197947,
'bt_dup_pg' => 0,
'bt_levels' => 3,
'bt_version' => 9,
'bt_dup_pgfree' => 0,
'bt_flags' => 0,
'bt_minkey' => 2,
'bt_re_pad' => 32,
'bt_nkeys' => 10500248,
'bt_magic' => 340322,
'bt_leaf_pgfree' => 1542999750,
'bt_metaflags' => 0,
'bt_maxkey' => 0,
'bt_re_len' => 0,
'bt_int_pg' => 348,
'bt_over_pg' => 0

How to increase performance?

P.S: I try:
- changed Pagesize to 1K,6K,8K,16K,32K,64K
- split one big BDB to 16 by first character in key
- use Hash
....but no effect.

On Tue, 13 Nov 2007 22:53:39 -0000, <palexvs (AT) gmail (DOT) com> wrote:
Don't use perl.

Perl is nice for quickly figuring out some things, mainly due to the
extension libraries. Perl isn't for speed.

I moved from perl to Common Lisp, times went from minutes to milliseconds.

Hmm, 13 Nov, I wonder if newserver has a problem....

--
One of the strokes of genius from McCarthy was making lists the center of the language - kt

--
Posted via a free Usenet account from http://www.teranews.com

On Tue, 13 Nov 2007 22:53:39 -0000, <palexvs (AT) gmail (DOT) com> wrote:
Don't use perl.

Perl is nice for quickly figuring out some things, mainly due to the
extension libraries. Perl isn't for speed.

I moved from perl to Common Lisp, times went from minutes to milliseconds.

Hmm, 13 Nov, I wonder if newserver has a problem....

--
One of the strokes of genius from McCarthy was making lists the center of the language - kt

--
Posted via a free Usenet account from http://www.teranews.com

On Tue, 13 Nov 2007 22:53:39 -0000, <palexvs (AT) gmail (DOT) com> wrote:
Don't use perl.

Perl is nice for quickly figuring out some things, mainly due to the
extension libraries. Perl isn't for speed.

I moved from perl to Common Lisp, times went from minutes to milliseconds.

Hmm, 13 Nov, I wonder if newserver has a problem....

--
One of the strokes of genius from McCarthy was making lists the center of the language - kt

--
Posted via a free Usenet account from http://www.teranews.com