dbTalk Databases Forums  

Parallel process on 64Bit server with 4 CPU's

microsoft.public.sqlserver.olap microsoft.public.sqlserver.olap


Discuss Parallel process on 64Bit server with 4 CPU's in the microsoft.public.sqlserver.olap forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
yaniv
 
Posts: n/a

Default Parallel process on 64Bit server with 4 CPU's - 02-02-2006 , 02:00 AM






Hello,
We are using AS 2000 Enterprise with SP3 on a 4*4 64Bit machine
(4CPU's,4GB).
We are using the Parallel process utility that shipped with the MS SQL
resource kit.
We set the AS registry key "ProcessThreads" to 8 (the numbers of CPU's
multiply
by two), and restarted the AS service.

If we run the Parallel process utiliy trying to process Cube partitions
,
and set it to 2 Cpu's, then it works fine and the Partitions are
processed fine.
BUT,If we set it to run with more the 2 cpu's (3,4), then it it trys to
process 4 Partitions
on the same time, but it automaticly fails 2 Partitions.
The logs say nothing about an error.

We also tried it with our oun custom made Parallel process utility, but
it also failed.

Any ideas ?


Reply With Quote
  #2  
Old   
 
Posts: n/a

Default Re: Parallel process on 64Bit server with 4 CPU's - 02-02-2006 , 03:48 AM






Do you have any cubes that use private dimensions?

It's been a couple of years since I built a parallel processing utility
myself, so this may not be quite right, but my memory is as follows:

The first partition to process in a cube with a private dimension will
process any private dimensions and initialize the cube structure, if any
other "thread" tries to process a partition in this cube it will try to
do the same thing, be locked out and the partition will fail to process.
If the other "thread" starts up after the private dimensions are all
processed and the cube structure is initialized they will be able to
process without any issues.

From memory I don't think I found an easy way to detect this so I ended
processing all the shared dimension and initializing all the cube
structures (which processed any shared dimensions) on a single "thread"
before kicking off all the other "threads" to process the partitions.

As an aside, we had an 8 way 32-bit box that was running both SQL and AS
and found that 4 parallel partitions was about the sweet spot. My theory
was that there was one cpu each for SQL and AS for each partition, but
your mileage may vary.

HTH

--
Regards
Darren Gosbell [MCSD]
Blog: http://www.geekswithblogs.net/darrengosbell

In article <1138867218.640099.46580 (AT) g43g2000cwa (DOT) googlegroups.com>,
yaniv.inbar (AT) retalix (DOT) com says...
Quote:
Hello,
We are using AS 2000 Enterprise with SP3 on a 4*4 64Bit machine
(4CPU's,4GB).
We are using the Parallel process utility that shipped with the MS SQL
resource kit.
We set the AS registry key "ProcessThreads" to 8 (the numbers of CPU's
multiply
by two), and restarted the AS service.

If we run the Parallel process utiliy trying to process Cube partitions
,
and set it to 2 Cpu's, then it works fine and the Partitions are
processed fine.
BUT,If we set it to run with more the 2 cpu's (3,4), then it it trys to
process 4 Partitions
on the same time, but it automaticly fails 2 Partitions.
The logs say nothing about an error.

We also tried it with our oun custom made Parallel process utility, but
it also failed.

Any ideas ?



Reply With Quote
  #3  
Old   
Dave Wickert [MSFT]
 
Posts: n/a

Default Re: Parallel process on 64Bit server with 4 CPU's - 02-02-2006 , 09:04 AM



How about this one?
http://www.microsoft.com/downloads/d...DisplayLang=en
This is the parallel processing utility that most users are using these
days.
AS2K5 has it built-in, so this isn't an issue with it.

Run it from a 32-bit workstation that has access to the 64-bit server.

--
Dave Wickert [MSFT]
dwickert (AT) online (DOT) microsoft.com
Program Manager
BI Systems Team
SQL BI Product Unit (Analysis Services)
--
This posting is provided "AS IS" with no warranties, and confers no rights.


"yaniv" <yaniv.inbar (AT) retalix (DOT) com> wrote

Quote:
Hello,
We are using AS 2000 Enterprise with SP3 on a 4*4 64Bit machine
(4CPU's,4GB).
We are using the Parallel process utility that shipped with the MS SQL
resource kit.
We set the AS registry key "ProcessThreads" to 8 (the numbers of CPU's
multiply
by two), and restarted the AS service.

If we run the Parallel process utiliy trying to process Cube partitions
,
and set it to 2 Cpu's, then it works fine and the Partitions are
processed fine.
BUT,If we set it to run with more the 2 cpu's (3,4), then it it trys to
process 4 Partitions
on the same time, but it automaticly fails 2 Partitions.
The logs say nothing about an error.

We also tried it with our oun custom made Parallel process utility, but
it also failed.

Any ideas ?




Reply With Quote
  #4  
Old   
yaniv
 
Posts: n/a

Default Re: Parallel process on 64Bit server with 4 CPU's - 02-02-2006 , 09:55 AM



Nop, No private Dimension.


Reply With Quote
  #5  
Old   
yaniv
 
Posts: n/a

Default Re: Parallel process on 64Bit server with 4 CPU's - 02-02-2006 , 10:00 AM



We are using this Parallel Process utility - but i doesn't help.
Dave, you wrote that you run the ParallelProcess utility from 32 bit
machine against a 64bit machine -
well, we tried to run it from a 64bit machine (the Olap server).
Maybe this is the problem.
I looked at the MS Parallel process code, and saw that it uses Mutex,
i'm not familier with
64Bit machines, but i suspect that this Mutex object is causing the
problems.


Reply With Quote
  #6  
Old   
Dave Wickert [MSFT]
 
Posts: n/a

Default Re: Parallel process on 64Bit server with 4 CPU's - 02-04-2006 , 12:41 AM



You cannot run it from a 64-bit server. None of the libraries it uses, e.g.
DSO, runs under WOW. You need to run it (and any similar tool) from a 32-bit
workstation against the 64-bit server; not on the 64-bit server itself.
--
Dave Wickert [MSFT]
dwickert (AT) online (DOT) microsoft.com
Program Manager
BI Systems Team
SQL BI Product Unit (Analysis Services)
--
This posting is provided "AS IS" with no warranties, and confers no rights.


"yaniv" <yaniv.inbar (AT) retalix (DOT) com> wrote

Quote:
We are using this Parallel Process utility - but i doesn't help.
Dave, you wrote that you run the ParallelProcess utility from 32 bit
machine against a 64bit machine -
well, we tried to run it from a 64bit machine (the Olap server).
Maybe this is the problem.
I looked at the MS Parallel process code, and saw that it uses Mutex,
i'm not familier with
64Bit machines, but i suspect that this Mutex object is causing the
problems.




Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.