dbTalk Databases Forums  

Very Large Dimension

microsoft.public.sqlserver.olap microsoft.public.sqlserver.olap


Discuss Very Large Dimension in the microsoft.public.sqlserver.olap forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
Michael V
 
Posts: n/a

Default Very Large Dimension - 08-08-2003 , 03:34 AM






Hi All

I have seen some articles about this subject at one time ... can anybode
guide me ?

But when is it a very Large Dimension ? If a have a dimension table with 12
mio records but at a given
point in time there is only transactions on 10% of these dimensions - is it
then a Very Large Dimension or
isn't it a problem when there's no transactions on all the dimensions ?

\Michael V.



Reply With Quote
  #2  
Old   
Jon Jahren
 
Posts: n/a

Default Re: Very Large Dimension - 08-08-2003 , 04:56 AM






Michael,
Very Large Dimensions (VLD) are defined as about 4 mill members or more.
VLDs are managed in a seperate process (VLD Manager). The amount of
transactions are not an issue as this is a AS concept.

Jon Jahren

"Michael V" <123 (AT) test (DOT) com> wrote

Quote:
Hi All

I have seen some articles about this subject at one time ... can anybode
guide me ?

But when is it a very Large Dimension ? If a have a dimension table with
12
mio records but at a given
point in time there is only transactions on 10% of these dimensions - is
it
then a Very Large Dimension or
isn't it a problem when there's no transactions on all the dimensions ?

\Michael V.





Reply With Quote
  #3  
Old   
Jon Jahren
 
Posts: n/a

Default Re: Very Large Dimension - 08-08-2003 , 06:34 AM



Michael,
A seperate process (msmdvldm.exe) managing these dimensions when present in
your cubes. This process optimizes loading and processing for Very Large
Dimensions, and runs in a seperate process from the rest of you loading
dimensions. You can see VLDM as a on of the steps in the Processing window
when you manually process your shared dimensions.

If you want to, you can configure the VLD threshold in the registry. Play
with the VLDMThreshold key in HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\OLAP
Server\CurrentVersion.

Jon Jahren

"Michael V" <123 (AT) test (DOT) com> wrote

Quote:
Thanks Jon

A seperate process meaning a seperate utility program or a seperate way of
dealing
with these when extracting, transforming and loading to datawarehouse ?

\Michael V.

"Jon Jahren" <nospam_jon (AT) softscenario (DOT) no> wrote in message
news:uc0uZNZXDHA.2524 (AT) TK2MSFTNGP09 (DOT) phx.gbl...
Michael,
Very Large Dimensions (VLD) are defined as about 4 mill members or more.
VLDs are managed in a seperate process (VLD Manager). The amount of
transactions are not an issue as this is a AS concept.

Jon Jahren

"Michael V" <123 (AT) test (DOT) com> wrote in message
news:O7HWhfYXDHA.388 (AT) TK2MSFTNGP10 (DOT) phx.gbl...
Hi All

I have seen some articles about this subject at one time ... can
anybode
guide me ?

But when is it a very Large Dimension ? If a have a dimension table
with
12
mio records but at a given
point in time there is only transactions on 10% of these dimensions -
is
it
then a Very Large Dimension or
isn't it a problem when there's no transactions on all the dimensions
?

\Michael V.









Reply With Quote
  #4  
Old   
Michael V
 
Posts: n/a

Default Re: Very Large Dimension - 08-08-2003 , 07:00 AM



Yes - found it ..

But as I understand you're messages I don't need to do anything ? Analysis
itself tackles these dimensions separately when accessing this number of
members - I can adjust the number but that would mean that Analysis then
changes the opinion of when to do VLD.

Don't I need to do anything ? Partitioning (can jo do this on dimensions
?) - mark the dimension in Analysis as VLD ?

\Michael V.

"Jon Jahren" <nospam_jon (AT) softscenario (DOT) no> wrote

Quote:
Michael,
A seperate process (msmdvldm.exe) managing these dimensions when present
in
your cubes. This process optimizes loading and processing for Very Large
Dimensions, and runs in a seperate process from the rest of you loading
dimensions. You can see VLDM as a on of the steps in the Processing window
when you manually process your shared dimensions.

If you want to, you can configure the VLD threshold in the registry. Play
with the VLDMThreshold key in HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\OLAP
Server\CurrentVersion.

Jon Jahren

"Michael V" <123 (AT) test (DOT) com> wrote in message
news:uCmLUjZXDHA.2236 (AT) TK2MSFTNGP10 (DOT) phx.gbl...
Thanks Jon

A seperate process meaning a seperate utility program or a seperate way
of
dealing
with these when extracting, transforming and loading to datawarehouse ?

\Michael V.

"Jon Jahren" <nospam_jon (AT) softscenario (DOT) no> wrote in message
news:uc0uZNZXDHA.2524 (AT) TK2MSFTNGP09 (DOT) phx.gbl...
Michael,
Very Large Dimensions (VLD) are defined as about 4 mill members or
more.
VLDs are managed in a seperate process (VLD Manager). The amount of
transactions are not an issue as this is a AS concept.

Jon Jahren

"Michael V" <123 (AT) test (DOT) com> wrote in message
news:O7HWhfYXDHA.388 (AT) TK2MSFTNGP10 (DOT) phx.gbl...
Hi All

I have seen some articles about this subject at one time ... can
anybode
guide me ?

But when is it a very Large Dimension ? If a have a dimension table
with
12
mio records but at a given
point in time there is only transactions on 10% of these
dimensions -
is
it
then a Very Large Dimension or
isn't it a problem when there's no transactions on all the
dimensions
?

\Michael V.











Reply With Quote
  #5  
Old   
Jon Jahren
 
Posts: n/a

Default Re: Very Large Dimension - 08-08-2003 , 08:53 AM



Michael,
You're right - you don't have to do anything. Partitioning is not done on
dimensions so no problem here.

Jon Jahren

"Michael V" <123 (AT) test (DOT) com> wrote

Quote:
Yes - found it ..

But as I understand you're messages I don't need to do anything ? Analysis
itself tackles these dimensions separately when accessing this number of
members - I can adjust the number but that would mean that Analysis then
changes the opinion of when to do VLD.

Don't I need to do anything ? Partitioning (can jo do this on dimensions
?) - mark the dimension in Analysis as VLD ?

\Michael V.

"Jon Jahren" <nospam_jon (AT) softscenario (DOT) no> wrote in message
news:OtDxGEaXDHA.2516 (AT) TK2MSFTNGP09 (DOT) phx.gbl...
Michael,
A seperate process (msmdvldm.exe) managing these dimensions when present
in
your cubes. This process optimizes loading and processing for Very Large
Dimensions, and runs in a seperate process from the rest of you loading
dimensions. You can see VLDM as a on of the steps in the Processing
window
when you manually process your shared dimensions.

If you want to, you can configure the VLD threshold in the registry.
Play
with the VLDMThreshold key in
HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\OLAP
Server\CurrentVersion.

Jon Jahren

"Michael V" <123 (AT) test (DOT) com> wrote in message
news:uCmLUjZXDHA.2236 (AT) TK2MSFTNGP10 (DOT) phx.gbl...
Thanks Jon

A seperate process meaning a seperate utility program or a seperate
way
of
dealing
with these when extracting, transforming and loading to datawarehouse
?

\Michael V.

"Jon Jahren" <nospam_jon (AT) softscenario (DOT) no> wrote in message
news:uc0uZNZXDHA.2524 (AT) TK2MSFTNGP09 (DOT) phx.gbl...
Michael,
Very Large Dimensions (VLD) are defined as about 4 mill members or
more.
VLDs are managed in a seperate process (VLD Manager). The amount of
transactions are not an issue as this is a AS concept.

Jon Jahren

"Michael V" <123 (AT) test (DOT) com> wrote in message
news:O7HWhfYXDHA.388 (AT) TK2MSFTNGP10 (DOT) phx.gbl...
Hi All

I have seen some articles about this subject at one time ... can
anybode
guide me ?

But when is it a very Large Dimension ? If a have a dimension
table
with
12
mio records but at a given
point in time there is only transactions on 10% of these
dimensions -
is
it
then a Very Large Dimension or
isn't it a problem when there's no transactions on all the
dimensions
?

\Michael V.













Reply With Quote
  #6  
Old   
Sean Boon [MS]
 
Posts: n/a

Default Re: Very Large Dimension - 08-08-2003 , 03:42 PM



4 million members definitely qualifies as being a large dimension. As Jon
indicates you can use the VLDM to manage this dimension. While VLDM does
help, it also out of process from the Analysis Service itself. This means
that there will be a performance impact associated with it. That may or may
not be of a concern for you. All you have to do take advantage of VLDM is
set the VDLMThreshold key to a value that will force the VLDM to be used.

However, I'd strongly recommend that you look at the 64-bit edition of
Analysis Services. The 64-bit edition does not use VLDM and can load this
dimension into the main server process becuase the 64-bit edition can
support much larger amounts of virtual memory.

Sean


--
Sean Boon
SQL Server BI Product Unit

--
This posting is provided "AS IS" with no warranties, and confers no rights.
Use of included script samples are subject to the terms specified at
http://www.microsoft.com/info/cpyright.htm.

"Jon Jahren" <nospam_jon (AT) softscenario (DOT) no> wrote

Quote:
Michael,
You're right - you don't have to do anything. Partitioning is not done on
dimensions so no problem here.

Jon Jahren

"Michael V" <123 (AT) test (DOT) com> wrote in message
news:eX3KkSaXDHA.536 (AT) TK2MSFTNGP10 (DOT) phx.gbl...
Yes - found it ..

But as I understand you're messages I don't need to do anything ?
Analysis
itself tackles these dimensions separately when accessing this number of
members - I can adjust the number but that would mean that Analysis then
changes the opinion of when to do VLD.

Don't I need to do anything ? Partitioning (can jo do this on dimensions
?) - mark the dimension in Analysis as VLD ?

\Michael V.

"Jon Jahren" <nospam_jon (AT) softscenario (DOT) no> wrote in message
news:OtDxGEaXDHA.2516 (AT) TK2MSFTNGP09 (DOT) phx.gbl...
Michael,
A seperate process (msmdvldm.exe) managing these dimensions when
present
in
your cubes. This process optimizes loading and processing for Very
Large
Dimensions, and runs in a seperate process from the rest of you
loading
dimensions. You can see VLDM as a on of the steps in the Processing
window
when you manually process your shared dimensions.

If you want to, you can configure the VLD threshold in the registry.
Play
with the VLDMThreshold key in
HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\OLAP
Server\CurrentVersion.

Jon Jahren

"Michael V" <123 (AT) test (DOT) com> wrote in message
news:uCmLUjZXDHA.2236 (AT) TK2MSFTNGP10 (DOT) phx.gbl...
Thanks Jon

A seperate process meaning a seperate utility program or a seperate
way
of
dealing
with these when extracting, transforming and loading to
datawarehouse
?

\Michael V.

"Jon Jahren" <nospam_jon (AT) softscenario (DOT) no> wrote in message
news:uc0uZNZXDHA.2524 (AT) TK2MSFTNGP09 (DOT) phx.gbl...
Michael,
Very Large Dimensions (VLD) are defined as about 4 mill members or
more.
VLDs are managed in a seperate process (VLD Manager). The amount
of
transactions are not an issue as this is a AS concept.

Jon Jahren

"Michael V" <123 (AT) test (DOT) com> wrote in message
news:O7HWhfYXDHA.388 (AT) TK2MSFTNGP10 (DOT) phx.gbl...
Hi All

I have seen some articles about this subject at one time ... can
anybode
guide me ?

But when is it a very Large Dimension ? If a have a dimension
table
with
12
mio records but at a given
point in time there is only transactions on 10% of these
dimensions -
is
it
then a Very Large Dimension or
isn't it a problem when there's no transactions on all the
dimensions
?

\Michael V.















Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.