dbTalk Databases Forums  

Size Limits in BDB

comp.databases.berkeley-db comp.databases.berkeley-db


Discuss Size Limits in BDB in the comp.databases.berkeley-db forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
Chad
 
Posts: n/a

Default Size Limits in BDB - 09-18-2003 , 06:12 AM






Hi there

My customer has a requirement to store 64 billion records.
I am looking for hard figures on size limits for BDB.
I would also be interested in actual testimonies as well as
theoretical limits.

- What is the limit on database file size ?
- Is anything special needed at compile time to support this limit or
is it a runtime confi matter ?
- What is the limit on number of records in Btree tables ?
- BTree databases with RECNUM support are limited to 4 billion
records. Is it a big job to widen the size of this field to support
bigger tables ?

Thanks
Chad.

Reply With Quote
  #2  
Old   
Keith Bostic
 
Posts: n/a

Default Re: Size Limits in BDB - 09-19-2003 , 08:49 AM






chadzakary (AT) hotmail (DOT) com (Chad) wrote in message news:<a4e918e3.0309180312.6de8a5ad (AT) posting (DOT) google.com>...

Quote:
My customer has a requirement to store 64 billion records.
I am looking for hard figures on size limits for BDB.
I would also be interested in actual testimonies as well as
theoretical limits.
For this information, see the "Database limits" section of the
Berkeley DB Reference Guide, included in your download package
and also available at:

http://www.sleepycat.com/docs/ref/am_misc/dbsizes.html

Quote:
- What is the limit on database file size ?
Using the maximum database page size of 65536, Berkeley DB has
a maximum database file size of 2^48 (256 terabytes). The
minimum database page size is 512 bytes, which results in a
minimum maximum database size of 2^41 (2 terabytes).

Quote:
- Is anything special needed at compile time to support this limit or
is it a runtime confi matter ?
No special support is needed at compile time.

Quote:
- What is the limit on number of records in Btree tables ?
There is no limit, unless the records need to be accessed by
record number instead of by key.

Quote:
- BTree databases with RECNUM support are limited to 4 billion
records. Is it a big job to widen the size of this field to support
bigger tables ?
It would not be a simple change. Specifically, the change would
change Berkeley DB's on-disk page format, which would potentially
impact the database transaction recovery code.

Regards,
--keith

=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Keith Bostic bostic (AT) sleepycat (DOT) com
Sleepycat Software Inc. keithbosticim (ymsgid)
118 Tower Rd. +1-781-259-3139
Lincoln, MA 01773 http://www.sleepycat.com


Reply With Quote
  #3  
Old   
Chad
 
Posts: n/a

Default Re: Size Limits in BDB - 09-22-2003 , 06:26 AM



Quote:
- BTree databases with RECNUM support are limited to 4 billion
records. Is it a big job to widen the size of this field to support
bigger tables ?

It would not be a simple change. Specifically, the change would
change Berkeley DB's on-disk page format, which would potentially
impact the database transaction recovery code.

Thanks Keith

I understand the file format changes, but in what way is the
transaction recovery code affected ?

Chad


Reply With Quote
  #4  
Old   
Keith Bostic
 
Posts: n/a

Default Re: Size Limits in BDB - 09-23-2003 , 09:17 AM



chadzakary (AT) hotmail (DOT) com (Chad) wrote in message news:<a4e918e3.0309220326.7285755f (AT) posting (DOT) google.com>...
Quote:
- BTree databases with RECNUM support are limited to 4 billion
records. Is it a big job to widen the size of this field to support
bigger tables ?

It would not be a simple change. Specifically, the change would
change Berkeley DB's on-disk page format, which would potentially
impact the database transaction recovery code.


I understand the file format changes, but in what way is the
transaction recovery code affected ?
Berkeley DB does physical logging, and so page format changes will
usually require new log records and recovery code changes as well.

Regards,
--keith

=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Keith Bostic bostic (AT) sleepycat (DOT) com
Sleepycat Software Inc. keithbosticim (ymsgid)
118 Tower Rd. +1-781-259-3139
Lincoln, MA 01773 http://www.sleepycat.com


Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.