dbTalk Databases Forums  

Doubling in fact size greatly increases processing time

microsoft.public.sqlserver.olap microsoft.public.sqlserver.olap


Discuss Doubling in fact size greatly increases processing time in the microsoft.public.sqlserver.olap forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
Jesse O.
 
Posts: n/a

Default Doubling in fact size greatly increases processing time - 05-08-2006 , 05:57 PM






Lately we've experienced an increase in data rows from 15 million to 35
million daily.

The processing time has gone from 20 minutes to nearly three hours.
Aggregates have remained the same.

Am I experiencing data explosion?




Reply With Quote
  #2  
Old   
Jeje
 
Posts: n/a

Default Re: Doubling in fact size greatly increases processing time - 05-08-2006 , 06:02 PM






you have to reevaluate your aggregations because the old ones are too old.
the aggregation design is no longer optimal for the sizing.

also you have to play with your memory parameters because the new volume
required a different set of memory parameters.

you can also consider partitionning your cube. (3 * 15millions should be 3 *
20 minutes...)


"Jesse O." <jesperzz (AT) hotmail (DOT) com> wrote

Quote:
Lately we've experienced an increase in data rows from 15 million to 35
million daily.

The processing time has gone from 20 minutes to nearly three hours.
Aggregates have remained the same.

Am I experiencing data explosion?






Reply With Quote
  #3  
Old   
Jesse O.
 
Posts: n/a

Default Re: Doubling in fact size greatly increases processing time - 05-09-2006 , 01:54 AM



we partition by day, and there's no really other option....35 million rows a
day now.

i redesigned the aggs, went form 65 down to 20....not much of a difference
however.

which memory parameters?


"Jeje" <willgart (AT) hotmail (DOT) com> wrote

Quote:
you have to reevaluate your aggregations because the old ones are too old.
the aggregation design is no longer optimal for the sizing.

also you have to play with your memory parameters because the new volume
required a different set of memory parameters.

you can also consider partitionning your cube. (3 * 15millions should be 3
* 20 minutes...)


"Jesse O." <jesperzz (AT) hotmail (DOT) com> wrote in message
news:O%23iEALvcGHA.1276 (AT) TK2MSFTNGP03 (DOT) phx.gbl...
Lately we've experienced an increase in data rows from 15 million to 35
million daily.

The processing time has gone from 20 minutes to nearly three hours.
Aggregates have remained the same.

Am I experiencing data explosion?








Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.