dbTalk Databases Forums  

Does BDB work on SANs ?

comp.databases.berkeley-db comp.databases.berkeley-db


Discuss Does BDB work on SANs ? in the comp.databases.berkeley-db forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
Chad
 
Posts: n/a

Default Does BDB work on SANs ? - 09-01-2003 , 10:42 AM






Hi

I read that BDB supports databases up to 256 TB in size.

I have a customer requirement to store about 10 TB of data.
Considering using BDB. Not very knowledgable on mass storage options.
I would really like a simple Linux solution.

Thinking of spreading this across multiple (up to 20) IDE drives on
Linux.
I can manage creating the multiple small databases myself. Any
opinions ?

But my real question is : Somebody has told me that Storage Array
Networks are the way to go.Will BDB work on this ?? I read in the docs
that BDB needs to memory map the file and I would imagine this couldnt
work with SANs.

If anybody knows this or can suggest an alternative, that would be
great.

Thanks
Chad

Reply With Quote
  #2  
Old   
Michael Ubell
 
Posts: n/a

Default Re: Does BDB work on SANs ? - 09-01-2003 , 11:13 AM






Chad,

BerkeleyDB only needs to memory map what we call the environment region files.
These hold data which is shared amoung multiple processes accessing
the same databases. Please see:
http://www.sleepycat.com/docs/ref/env/region.html
Two things to note, first these files need not be in the same file
system as actual data, see:
http://www.sleepycat.com/docs/api_cx..._data_dir.html
Second, system memory can be used via shmget(2) instead of mmap if this is
not available at all:
http://www.sleepycat.com/docs/api_cx...#DB_SYSTEM_MEM

BerkeleyDB data storage should work on a SAN so long as it conforms
to the POSIX file system implimentation. You should be careful of
such a device that caches disk writes and does not write them through
to stable storage when the operating system is told to fsync(2) the file
as this can lead to data corruption after a system failure.

Michael Ubell
Sleepycat Software.

Ps. region.html contains a bug. Bullet 3. should say:
"If mmap is not available, the UNIX shmget interfaces MAY be used, ...."


Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.