dbTalk Databases Forums  

Simultaneous partition processing

microsoft.public.sqlserver.olap microsoft.public.sqlserver.olap


Discuss Simultaneous partition processing in the microsoft.public.sqlserver.olap forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
mdx_newbie
 
Posts: n/a

Default Simultaneous partition processing - 10-04-2004 , 03:02 PM






Has anyone tried starting 3 to 5 Cube partition processes initiated at
the same time? I get errors saying the cube is locked. I can start
processing the partitions with a delay of about 10-20 secs.

They can process at the same, but they can't start processing at the
same time.

Is there a way to create a partition without locking the cube for the
first few seconds?

We use vbscript in a dts package to process our partitions.


Thanks.

Reply With Quote
  #2  
Old   
Dave Wickert [MSFT]
 
Posts: n/a

Default Re: Simultaneous partition processing - 10-04-2004 , 05:47 PM






Not to my knowledge. This is a requirement. The Parallel Processing Utility
and the DTS packages generated by SSABI use a mutex to ensure that there is
only one begin transaction and commit transaction is occurring at a time.
--
Dave Wickert [MSFT]
dwickert (AT) online (DOT) microsoft.com
Program Manager
BI SystemsTeam
SQL BI Product Unit (Analysis Services)
--
This posting is provided "AS IS" with no warranties, and confers no rights.

"mdx_newbie" <zoravars (AT) khalsa (DOT) com> wrote

Quote:
Has anyone tried starting 3 to 5 Cube partition processes initiated at
the same time? I get errors saying the cube is locked. I can start
processing the partitions with a delay of about 10-20 secs.

They can process at the same, but they can't start processing at the
same time.

Is there a way to create a partition without locking the cube for the
first few seconds?

We use vbscript in a dts package to process our partitions.


Thanks.



Reply With Quote
  #3  
Old   
mdx_newbie
 
Posts: n/a

Default Re: Simultaneous partition processing - 10-07-2004 , 02:24 PM



I was playing around with the ParallelProcess manager that comes with
the resource kit. I noticed if i set 4+ partitions to process at once
1 or more partition processing fails. If i restart it, it'll
start/finish successfully. Again the logs say there was a lock on the
cube. I also noticed in the ProcessLogs that even though many of the
partitions initiated from the ParallelProcess Manager, the timings in
the log were off a few secs. So if partitions 1, 2, 3, 4, 5, 6 were
started at once the log shows a slight (2-3) delay between each
partition processing.

So could there be a registry setting that could allow cube partition
re-processing requests to be queued if the partition is temporarily
locked? I know i'm reaching, but i thought i'd atleast ask.

The only way i can think about working around this is try connecting
to the cube, if it's locked then wait 15 secs and try again. Not sure
how to do this yet, but if you have any suggesstions please let me
know.

We're going to have some folks from Microsoft come in to re-configure
our SQL server and our Analysis server next month, but I don't want to
delay this untill then.

Please share your thoughts.

thanks..




"Dave Wickert [MSFT]" <dwickert (AT) online (DOT) microsoft.com> wrote

Quote:
Not to my knowledge. This is a requirement. The Parallel Processing Utility
and the DTS packages generated by SSABI use a mutex to ensure that there is
only one begin transaction and commit transaction is occurring at a time.
--
Dave Wickert [MSFT]
dwickert (AT) online (DOT) microsoft.com
Program Manager
BI SystemsTeam
SQL BI Product Unit (Analysis Services)
--
This posting is provided "AS IS" with no warranties, and confers no rights.

Reply With Quote
  #4  
Old   
Dave Wickert [MSFT]
 
Posts: n/a

Default Re: Simultaneous partition processing - 10-08-2004 , 08:38 PM



Here is a link to an updated version which addresses those problems:

http://www.microsoft.com/downloads/d...DisplayLang=en

--
Dave Wickert [MSFT]
dwickert (AT) online (DOT) microsoft.com
Program Manager
BI SystemsTeam
SQL BI Product Unit (Analysis Services)
--
This posting is provided "AS IS" with no warranties, and confers no rights.

"mdx_newbie" <zoravars (AT) khalsa (DOT) com> wrote

Quote:
I was playing around with the ParallelProcess manager that comes with
the resource kit. I noticed if i set 4+ partitions to process at once
1 or more partition processing fails. If i restart it, it'll
start/finish successfully. Again the logs say there was a lock on the
cube. I also noticed in the ProcessLogs that even though many of the
partitions initiated from the ParallelProcess Manager, the timings in
the log were off a few secs. So if partitions 1, 2, 3, 4, 5, 6 were
started at once the log shows a slight (2-3) delay between each
partition processing.

So could there be a registry setting that could allow cube partition
re-processing requests to be queued if the partition is temporarily
locked? I know i'm reaching, but i thought i'd atleast ask.

The only way i can think about working around this is try connecting
to the cube, if it's locked then wait 15 secs and try again. Not sure
how to do this yet, but if you have any suggesstions please let me
know.

We're going to have some folks from Microsoft come in to re-configure
our SQL server and our Analysis server next month, but I don't want to
delay this untill then.

Please share your thoughts.

thanks..




"Dave Wickert [MSFT]" <dwickert (AT) online (DOT) microsoft.com> wrote

Not to my knowledge. This is a requirement. The Parallel Processing
Utility
and the DTS packages generated by SSABI use a mutex to ensure that there
is
only one begin transaction and commit transaction is occurring at a
time.
--
Dave Wickert [MSFT]
dwickert (AT) online (DOT) microsoft.com
Program Manager
BI SystemsTeam
SQL BI Product Unit (Analysis Services)
--
This posting is provided "AS IS" with no warranties, and confers no
rights.




Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.