dbTalk Databases Forums  

How to speed Creating aggregations when processing?

microsoft.public.sqlserver.olap microsoft.public.sqlserver.olap


Discuss How to speed Creating aggregations when processing? in the microsoft.public.sqlserver.olap forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
nick
 
Posts: n/a

Default How to speed Creating aggregations when processing? - 07-10-2005 , 01:11 AM






The creating aggregations of processing is very slow on one of my cube. The
performance monitor shows the "Temp file bytes written/sec" is 10MB/s - after
I increased the "Process Buffer Size" to 200M.

Sounds the temp file written caused the problem.
Or anyway to reduce the memory consumption of dimension data? I want also
create more aggregations - currently some partition cannot have more then 40
aggregations, otherwise memory error.

Reply With Quote
  #2  
Old   
nick
 
Posts: n/a

Default RE: How to speed Creating aggregations when processing? - 07-10-2005 , 03:25 PM






Creating the 4th aggregations starts to use temp file when I set Process
Buffer Size to 200MB. And creating the 7th aggregations start to use temp
file when I set the buffer to 400MB. So it seems 3 aggregations will use
200MB.

And it cause memory error (Server memory low) when creating 30 to 40
aggregations.

The cube has 14 dimensions. Any skill to make it use less memory?

"nick" wrote:

Quote:
The creating aggregations of processing is very slow on one of my cube. The
performance monitor shows the "Temp file bytes written/sec" is 10MB/s - after
I increased the "Process Buffer Size" to 200M.

Sounds the temp file written caused the problem.
Or anyway to reduce the memory consumption of dimension data? I want also
create more aggregations - currently some partition cannot have more then 40
aggregations, otherwise memory error.

Reply With Quote
  #3  
Old   
pras
 
Posts: n/a

Default Re: How to speed Creating aggregations when processing? - 07-12-2005 , 03:40 AM



Since the cubes have 14 dimensions which is bit bigber cube
try
setting Aggregation usage property of the each dimension to "TOP Level
Only"
and use "Performance gain reaches" between 15 to 20 % during design the
storage for the cube.

Regards,
Prasanna


Reply With Quote
  #4  
Old   
Dave Wickert [MSFT]
 
Posts: n/a

Default Re: How to speed Creating aggregations when processing? - 07-12-2005 , 08:08 PM



One possible source for (server memory low) is if you are running out of
system page file. The default by Windows is not alway appropriate for the
way AS uses memory. If you look in the AS Operations Guide, we recommend
increasing the default size up to the maximum and adding a second page file
(sized with the amount of physical memory on the machine) on another disk.
http://www.microsoft.com/technet/pro.../anservog.mspx

--
Dave Wickert [MSFT]
dwickert (AT) online (DOT) microsoft.com
Program Manager
BI SystemsTeam
SQL BI Product Unit (Analysis Services)
--
This posting is provided "AS IS" with no warranties, and confers no rights.


"nick" <nick (AT) discussions (DOT) microsoft.com> wrote

Quote:
Creating the 4th aggregations starts to use temp file when I set Process
Buffer Size to 200MB. And creating the 7th aggregations start to use temp
file when I set the buffer to 400MB. So it seems 3 aggregations will use
200MB.

And it cause memory error (Server memory low) when creating 30 to 40
aggregations.

The cube has 14 dimensions. Any skill to make it use less memory?

"nick" wrote:

The creating aggregations of processing is very slow on one of my cube.
The
performance monitor shows the "Temp file bytes written/sec" is 10MB/s -
after
I increased the "Process Buffer Size" to 200M.

Sounds the temp file written caused the problem.
Or anyway to reduce the memory consumption of dimension data? I want also
create more aggregations - currently some partition cannot have more then
40
aggregations, otherwise memory error.



Reply With Quote
  #5  
Old   
nick
 
Posts: n/a

Default Re: How to speed Creating aggregations when processing? - 07-14-2005 , 08:36 PM



The OLAP server already installed 4GB RAM. So the page file should help since
the physical memory already cover all 32 bit address space? However, for
policy reason, we cannot enable the /3GB switch yet.

"Dave Wickert [MSFT]" wrote:

Quote:
One possible source for (server memory low) is if you are running out of
system page file. The default by Windows is not alway appropriate for the
way AS uses memory. If you look in the AS Operations Guide, we recommend
increasing the default size up to the maximum and adding a second page file
(sized with the amount of physical memory on the machine) on another disk.
http://www.microsoft.com/technet/pro.../anservog.mspx

--
Dave Wickert [MSFT]
dwickert (AT) online (DOT) microsoft.com
Program Manager
BI SystemsTeam
SQL BI Product Unit (Analysis Services)
--
This posting is provided "AS IS" with no warranties, and confers no rights.


"nick" <nick (AT) discussions (DOT) microsoft.com> wrote in message
news:19A52DFF-A536-4239-BB62-E07F3DEDA723 (AT) microsoft (DOT) com...
Creating the 4th aggregations starts to use temp file when I set Process
Buffer Size to 200MB. And creating the 7th aggregations start to use temp
file when I set the buffer to 400MB. So it seems 3 aggregations will use
200MB.

And it cause memory error (Server memory low) when creating 30 to 40
aggregations.

The cube has 14 dimensions. Any skill to make it use less memory?

"nick" wrote:

The creating aggregations of processing is very slow on one of my cube.
The
performance monitor shows the "Temp file bytes written/sec" is 10MB/s -
after
I increased the "Process Buffer Size" to 200M.

Sounds the temp file written caused the problem.
Or anyway to reduce the memory consumption of dimension data? I want also
create more aggregations - currently some partition cannot have more then
40
aggregations, otherwise memory error.




Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.