dbTalk Databases Forums  

AMO - processing partitions incrementally

microsoft.public.sqlserver.olap microsoft.public.sqlserver.olap


Discuss AMO - processing partitions incrementally in the microsoft.public.sqlserver.olap forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
SandyS
 
Posts: n/a

Default AMO - processing partitions incrementally - 10-12-2006 , 12:00 PM






We are using AMO to dynamically create measure group partitions. The cube
and fact table are partitioned weekly and approx. 1mil rows are being
inserted per day. On a daily basis, using another AMO script, we would like
to only process incremental updates to the current/active partition (like we
can do for dimensions using the Process Update option). This option is not
available for partitions. Is the Process Incremental option available using
AMO? If yes, can you send a code example, or can you recommend an
alternative?

Reply With Quote
  #2  
Old   
Jesse O.
 
Posts: n/a

Default Re: AMO - processing partitions incrementally - 10-12-2006 , 05:36 PM






Definitely. It's available.

Sample: YourPartitionName.Process(ProcessType.ProcessUpdat e)

Is this what you're looking for?





"SandyS" <SandyS (AT) discussions (DOT) microsoft.com> wrote

Quote:
We are using AMO to dynamically create measure group partitions. The cube
and fact table are partitioned weekly and approx. 1mil rows are being
inserted per day. On a daily basis, using another AMO script, we would
like
to only process incremental updates to the current/active partition (like
we
can do for dimensions using the Process Update option). This option is
not
available for partitions. Is the Process Incremental option available
using
AMO? If yes, can you send a code example, or can you recommend an
alternative?



Reply With Quote
  #3  
Old   
SandyS
 
Posts: n/a

Default Re: AMO - processing partitions incrementally - 10-13-2006 , 04:13 PM



The ProcessType.ProcessUpdate option is not available for partitions
(according to books on-line, and I tried it anyway and an error was raised
saying the same). Also, in SSIS using the Analysis Services Processing Task,
ProcessUpdate can not be selected when the object type is Partition.

"Jesse O." wrote:

Quote:
Definitely. It's available.

Sample: YourPartitionName.Process(ProcessType.ProcessUpdat e)

Is this what you're looking for?





"SandyS" <SandyS (AT) discussions (DOT) microsoft.com> wrote in message
news:7B7C424B-11BF-4D69-B3FF-095DAE215BA0 (AT) microsoft (DOT) com...
We are using AMO to dynamically create measure group partitions. The cube
and fact table are partitioned weekly and approx. 1mil rows are being
inserted per day. On a daily basis, using another AMO script, we would
like
to only process incremental updates to the current/active partition (like
we
can do for dimensions using the Process Update option). This option is
not
available for partitions. Is the Process Incremental option available
using
AMO? If yes, can you send a code example, or can you recommend an
alternative?




Reply With Quote
  #4  
Old   
Jesse O.
 
Posts: n/a

Default Re: AMO - processing partitions incrementally - 10-14-2006 , 01:28 AM



My mistake.

Have you tried processtype.processadd?




"SandyS" <SandyS (AT) discussions (DOT) microsoft.com> wrote

Quote:
The ProcessType.ProcessUpdate option is not available for partitions
(according to books on-line, and I tried it anyway and an error was raised
saying the same). Also, in SSIS using the Analysis Services Processing
Task,
ProcessUpdate can not be selected when the object type is Partition.

"Jesse O." wrote:

Definitely. It's available.

Sample: YourPartitionName.Process(ProcessType.ProcessUpdat e)

Is this what you're looking for?





"SandyS" <SandyS (AT) discussions (DOT) microsoft.com> wrote in message
news:7B7C424B-11BF-4D69-B3FF-095DAE215BA0 (AT) microsoft (DOT) com...
We are using AMO to dynamically create measure group partitions. The
cube
and fact table are partitioned weekly and approx. 1mil rows are being
inserted per day. On a daily basis, using another AMO script, we would
like
to only process incremental updates to the current/active partition
(like
we
can do for dimensions using the Process Update option). This option is
not
available for partitions. Is the Process Incremental option available
using
AMO? If yes, can you send a code example, or can you recommend an
alternative?






Reply With Quote
  #5  
Old   
RB
 
Posts: n/a

Default Re: AMO - processing partitions incrementally - 10-15-2006 , 10:26 AM



You can also try processtype.processdefault. This detects if a process full
is required or a process incremental. I've had one or two issues with this in
the past but it might work for you.

Rahil

"Jesse O." wrote:

Quote:
My mistake.

Have you tried processtype.processadd?




"SandyS" <SandyS (AT) discussions (DOT) microsoft.com> wrote in message
news:43C642DA-8435-49DA-AC69-3E3106266BBA (AT) microsoft (DOT) com...
The ProcessType.ProcessUpdate option is not available for partitions
(according to books on-line, and I tried it anyway and an error was raised
saying the same). Also, in SSIS using the Analysis Services Processing
Task,
ProcessUpdate can not be selected when the object type is Partition.

"Jesse O." wrote:

Definitely. It's available.

Sample: YourPartitionName.Process(ProcessType.ProcessUpdat e)

Is this what you're looking for?





"SandyS" <SandyS (AT) discussions (DOT) microsoft.com> wrote in message
news:7B7C424B-11BF-4D69-B3FF-095DAE215BA0 (AT) microsoft (DOT) com...
We are using AMO to dynamically create measure group partitions. The
cube
and fact table are partitioned weekly and approx. 1mil rows are being
inserted per day. On a daily basis, using another AMO script, we would
like
to only process incremental updates to the current/active partition
(like
we
can do for dimensions using the Process Update option). This option is
not
available for partitions. Is the Process Incremental option available
using
AMO? If yes, can you send a code example, or can you recommend an
alternative?







Reply With Quote
  #6  
Old   
Akshai Mirchandani [MS]
 
Posts: n/a

Default Re: AMO - processing partitions incrementally - 10-16-2006 , 03:35 PM



To clarify: ProcessDefault will just bring an unprocessed object into a
processed state. Partitions cannot detect if they need to be re-processed
(unless you're using proactive caching).

To add rows to a partition, you should be using ProcessAdd and specifying an
out-of-line binding the defines which new rows should be added.

So your choices for partitions are:
- ProcessFull
- ProcessDefault (if the partition isn't processed)
- ProcessAdd (specifying new rows to be added)

Additionally, you can do other things like ProcessClear and ProcessIndexes,
etc but they're not relevant here...

This article has good information on this topic:

http://msdn.microsoft.com/library/de...asprocarch.asp

Thanks,
Akshai
--
Try out the MSDN Forums for Analysis Services at:
http://forums.microsoft.com/MSDN/Sho...ID=83&SiteID=1

This posting is provided "AS IS" with no warranties, and confers no rights
Please do not send email directly to this alias. This alias is for newsgroup
purposes only.

"RB" <RB (AT) discussions (DOT) microsoft.com> wrote

Quote:
You can also try processtype.processdefault. This detects if a process
full
is required or a process incremental. I've had one or two issues with this
in
the past but it might work for you.

Rahil

"Jesse O." wrote:

My mistake.

Have you tried processtype.processadd?




"SandyS" <SandyS (AT) discussions (DOT) microsoft.com> wrote in message
news:43C642DA-8435-49DA-AC69-3E3106266BBA (AT) microsoft (DOT) com...
The ProcessType.ProcessUpdate option is not available for partitions
(according to books on-line, and I tried it anyway and an error was
raised
saying the same). Also, in SSIS using the Analysis Services Processing
Task,
ProcessUpdate can not be selected when the object type is Partition.

"Jesse O." wrote:

Definitely. It's available.

Sample: YourPartitionName.Process(ProcessType.ProcessUpdat e)

Is this what you're looking for?





"SandyS" <SandyS (AT) discussions (DOT) microsoft.com> wrote in message
news:7B7C424B-11BF-4D69-B3FF-095DAE215BA0 (AT) microsoft (DOT) com...
We are using AMO to dynamically create measure group partitions.
The
cube
and fact table are partitioned weekly and approx. 1mil rows are
being
inserted per day. On a daily basis, using another AMO script, we
would
like
to only process incremental updates to the current/active partition
(like
we
can do for dimensions using the Process Update option). This option
is
not
available for partitions. Is the Process Incremental option
available
using
AMO? If yes, can you send a code example, or can you recommend an
alternative?









Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.