3 Terabyte data warehouse system requirement

#11

Quote:

Analysis Services stores data a lot more efficiently than relational
databases

do, even if you load all the row-level detail into the cube, which is

Quote:

unlikely

But I think that's related to the questions that need to be asked: will
the queries be heavily-hitting the details? How much will the data
churn? 10 million rows / day? etc, etc.

At least before you spend several million in hardware. Again, a series
of prototypes would be invaluable to eliminating risks stemming from
these unknowns, or possibly-changing answers.

buck

#12

<bucknuggets (AT) yahoo (DOT) com> wrote

Quote:

Analysis Services stores data a lot more efficiently than relational
databases
do, even if you load all the row-level detail into the cube, which is
unlikely

But I think that's related to the questions that need to be asked:
will the queries be heavily-hitting the details? How much will the
data churn? 10 million rows / day? etc, etc.

At least before you spend several million in hardware. Again, a
series of prototypes would be invaluable to eliminating risks
stemming from these unknowns, or possibly-changing answers.

Yes, I agree; it's just that you ask a different set of questions if
it's a MOLAP solution, and test different scenarios. You certainly don't
breeze into an app of this size with as little information as the OP
provided.

#13

Nigel Pendse <nigelp.nospam (AT) compuserve (DOT) com> wrote:

Quote:

bucknuggets (AT) yahoo (DOT) com> wrote in message
hmm, I've never heard of a 3 tb molap cube, let alone it responding
very quickly.

The data would get a lot more compact with MOLAP storage -- typically
one could expect between a four- and ten-fold contraction.

The problem is that the contraction is very dependent on the dimensional
model. And a 300 GByte MOLAP cube still won't fit in ram on a current
machine.

Stephan

#14

"Stephan Eggermont" <stephan (AT) stack (DOT) nl> wrote

Quote:

Nigel Pendse <nigelp.nospam (AT) compuserve (DOT) com> wrote:
bucknuggets (AT) yahoo (DOT) com> wrote in message
hmm, I've never heard of a 3 tb molap cube, let alone it responding
very quickly.

The data would get a lot more compact with MOLAP storage -- typically
one could expect between a four- and ten-fold contraction.

The problem is that the contraction is very dependent on the
dimensional model. And a 300 GByte MOLAP cube still won't fit in ram
on a current machine.

Most MOLAP cubes don't fit in RAM -- why should this be a problem with
Analysis Services? Only a few OLAP servers, like TM1 and Alea, require
OLAP cubes to fit into RAM. Analysis Services cubes can be far larger
than the available RAM.

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

3 Terabyte data warehouse system requirement

comp.databases.olap comp.databases.olap

Re: 3 Terabyte data warehouse system requirement - 02-15-2005 , 05:31 PM

Re: 3 Terabyte data warehouse system requirement - 02-15-2005 , 05:59 PM

Re: 3 Terabyte data warehouse system requirement - 02-16-2005 , 04:51 AM

Re: 3 Terabyte data warehouse system requirement - 02-16-2005 , 05:51 AM