dbTalk Databases Forums  

Shipping partitions between OLAP databases

microsoft.public.sqlserver.olap microsoft.public.sqlserver.olap


Discuss Shipping partitions between OLAP databases in the microsoft.public.sqlserver.olap forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
Jesse O
 
Posts: n/a

Default Shipping partitions between OLAP databases - 11-07-2005 , 11:24 AM






We are currently have a single OLAP database in AS2000. I'd like to split
this out into two separate - a process and query/reporting database. Both
being on the same server.

The reason being is that we process every hour, and during that 20 minute
process time window, querying is very, very slow. We have several large
dimensions (2 million members) which get incrementally updated every hour
and this plays havoc for querying on the underlying partitions.

So my question is, how do I go about this? Keeping the metadata databases in
sync shouldn't be a problem, and also copying the diff files shouldn't be
too hard. I've played with it a bit and found that the partitions will only
show up after restarting the service.

Anything helpful will be very much appreciated. Thank you!




Reply With Quote
  #2  
Old   
Jesse O
 
Posts: n/a

Default Re: Shipping partitions between OLAP databases - 11-07-2005 , 01:51 PM






Been playing with this and it seems that the only way to have the new data
show up on the production server is to restart the service.

Is this true? Is there anyway around this? Restarting the service takes 10
minutes since we have such large dimensions and we'd have to do this every
hour.


"Jesse O" <jesperzz (AT) hotmail (DOT) com> wrote

Quote:
We are currently have a single OLAP database in AS2000. I'd like to split
this out into two separate - a process and query/reporting database. Both
being on the same server.

The reason being is that we process every hour, and during that 20 minute
process time window, querying is very, very slow. We have several large
dimensions (2 million members) which get incrementally updated every hour
and this plays havoc for querying on the underlying partitions.

So my question is, how do I go about this? Keeping the metadata databases
in sync shouldn't be a problem, and also copying the diff files shouldn't
be too hard. I've played with it a bit and found that the partitions will
only show up after restarting the service.

Anything helpful will be very much appreciated. Thank you!






Reply With Quote
  #3  
Old   
scott_gunn@email.com
 
Posts: n/a

Default Re: Shipping partitions between OLAP databases - 11-07-2005 , 03:36 PM



Do your user's have a custom written GUI or are they using some off the
shelf OLAP query tool?

If you have a custom GUI you might could point everyone to the query
database while processing the other database, then once it's finished
processing switch everyone to point them to the processed database and
then start processing the other database - keep flip-flopping between
the two.

You'd probably need 2 separate servers to do this since the slowdown
you're seeing is most likely due to excessive CPU usage during
processing. Assuming that's the case you might be able to solve your
problem by adding memory or processors.

Are you doing incremental processing (creating a temporary partition
and processing with only the new data and then merging it)? Why are
you processing every hour? There may be some overall design change
that could solve your problems too...


Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.