dbTalk Databases Forums  

How does the Slow Changing Dimension Wizard split up rows?

microsoft.public.sqlserver.dts microsoft.public.sqlserver.dts


Discuss How does the Slow Changing Dimension Wizard split up rows? in the microsoft.public.sqlserver.dts forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
Marc
 
Posts: n/a

Default How does the Slow Changing Dimension Wizard split up rows? - 04-26-2006 , 11:49 PM






Dear all

I'm trying to figure out how the slow changing dimension wizard works. I
want to use it for a Datawarehouse for a Date Dimension. All attributes are
changing attributes type 1.

I expected to work it this way:
1) New rows: They are inserted with the new row task
2) Updated rows: Rows get updated
3) Unchanged rows: If the input in the excel is the same as in the db, then
I expect that the SCD Wizard sends it this way.

Unfortunately my unchanged rows always get updated.

Can anybody point me to the right direction, how to get this right?


Best regards,

Marc

Reply With Quote
  #2  
Old   
Marc
 
Posts: n/a

Default RE: How does the Slow Changing Dimension Wizard split up rows? - 04-27-2006 , 12:17 AM






My problem is, that I'm expecting, that only changed rows should be updated.
But it looks that the SCD Wizard sends all rows to the Update flow, if a
attribute is set to changing attribute. Is this correct?



Best regards,

Marc


"Marc" wrote:

Quote:
Dear all

I'm trying to figure out how the slow changing dimension wizard works. I
want to use it for a Datawarehouse for a Date Dimension. All attributes are
changing attributes type 1.

I expected to work it this way:
1) New rows: They are inserted with the new row task
2) Updated rows: Rows get updated
3) Unchanged rows: If the input in the excel is the same as in the db, then
I expect that the SCD Wizard sends it this way.

Unfortunately my unchanged rows always get updated.

Can anybody point me to the right direction, how to get this right?


Best regards,

Marc

Reply With Quote
  #3  
Old   
AT
 
Posts: n/a

Default RE: How does the Slow Changing Dimension Wizard split up rows? - 04-27-2006 , 03:37 AM



Hello Marc,

Based on my scope, the unchanged rows shall not send to update flow. It
seems that you did not select the proper business key in SCD wizard.

Unchanged rows shall be added into unchanged output though there is no
default output is added by wizard.

Regards,

Peter Yang
MCSE2000/2003, MCSA, MCDBA
Microsoft Online Partner Support

When responding to posts, please "Reply to Group" via your newsreader so
that others may learn and benefit from your issue.

================================================== ===


This posting is provided "AS IS" with no warranties, and confers no rights.



Reply With Quote
  #4  
Old   
Marc
 
Posts: n/a

Default RE: How does the Slow Changing Dimension Wizard split up rows? - 04-27-2006 , 06:10 AM



Hello Peter

mmm - well it looks that the unchanged rows go through the update flow in my
package. This is what I do:
1) Extracting data out of excel
2) Get rid of null rows with a conditional split
3) Multicast to save extracted rows to raw file
4) On the other output flow of Multicast I make a data conversion of the
Business Key and the other attributes, because from excel numbers are doubles
and strings are in unicode
5) Derived Column: Add some housekeepting columns
6) SCD Component with a Update, Insert and a nonchanged flow

In my package, all unchanged rows flow to the update flow and not throug the
unchanged flow. Strange - I checked the businesskey: Its not changing inside
excel and a data conversion from double to a signed integer should not be a
problem, shouldn't it?

Well, I helped myself with a Script Component and computed a Hash Column.
This is followed by a Lookup Column, which checks if this value already exist
in the destination table. If yes, I know this row is unchanged, if the lookup
fails, I know the row is eather changed or new. This is followed by the SCD
Component.

After testing It looks to me that this path works but I guess this is max a
workaround. What do you think?

Regards, Marc


Regards,

Marc


""privatenews"" wrote:

Quote:
Hello Marc,

Based on my scope, the unchanged rows shall not send to update flow. It
seems that you did not select the proper business key in SCD wizard.

Unchanged rows shall be added into unchanged output though there is no
default output is added by wizard.

Regards,

Peter Yang
MCSE2000/2003, MCSA, MCDBA
Microsoft Online Partner Support

When responding to posts, please "Reply to Group" via your newsreader so
that others may learn and benefit from your issue.

================================================== ===


This posting is provided "AS IS" with no warranties, and confers no rights.




Reply With Quote
  #5  
Old   
AT
 
Posts: n/a

Default RE: How does the Slow Changing Dimension Wizard split up rows? - 04-28-2006 , 01:33 AM



Hello Marc,

I doubt different data type might be a problem. I copy the part of dest dim
table(lookup) as the source to another database, and choose the business
key (identity) in the SCD. No rows go to update flow under my test.

Regards,

Peter Yang
MCSE2000/2003, MCSA, MCDBA
Microsoft Online Partner Support

When responding to posts, please "Reply to Group" via your newsreader so
that others may learn and benefit from your issue.

================================================== ===


This posting is provided "AS IS" with no warranties, and confers no rights.



Reply With Quote
  #6  
Old   
Marc
 
Posts: n/a

Default RE: How does the Slow Changing Dimension Wizard split up rows? - 04-28-2006 , 04:39 AM



Dear Peter

Thanks for helping. I'm just used the SCD Wizard with a OLE DB Source and it
worked as you discribed. But with Excel Datasource, I had a problem.


Regards,


Marc


""privatenews"" wrote:

Quote:
Hello Marc,

I doubt different data type might be a problem. I copy the part of dest dim
table(lookup) as the source to another database, and choose the business
key (identity) in the SCD. No rows go to update flow under my test.

Regards,

Peter Yang
MCSE2000/2003, MCSA, MCDBA
Microsoft Online Partner Support

When responding to posts, please "Reply to Group" via your newsreader so
that others may learn and benefit from your issue.

================================================== ===


This posting is provided "AS IS" with no warranties, and confers no rights.




Reply With Quote
  #7  
Old   
AT
 
Posts: n/a

Default RE: How does the Slow Changing Dimension Wizard split up rows? - 04-30-2006 , 08:48 PM



Hello Marc,

It seems Excel or type conversion shall be the cause of the problem. You
may want to test to narrow down the issue.

Best Regards,

Peter Yang
MCSE2000/2003, MCSA, MCDBA
Microsoft Online Partner Support

When responding to posts, please "Reply to Group" via your newsreader so
that others may learn and benefit from your issue.

================================================== ===



This posting is provided "AS IS" with no warranties, and confers no rights.



Reply With Quote
  #8  
Old   
Marc
 
Posts: n/a

Default RE: How does the Slow Changing Dimension Wizard split up rows? - 05-01-2006 , 12:15 AM



Peter,

well, this issue is not that important for me because I have a workaround. I
was just curious why this happend.

Best regards,

Marc


""privatenews"" wrote:

Quote:
Hello Marc,

It seems Excel or type conversion shall be the cause of the problem. You
may want to test to narrow down the issue.

Best Regards,

Peter Yang
MCSE2000/2003, MCSA, MCDBA
Microsoft Online Partner Support

When responding to posts, please "Reply to Group" via your newsreader so
that others may learn and benefit from your issue.

================================================== ===



This posting is provided "AS IS" with no warranties, and confers no rights.




Reply With Quote
  #9  
Old   
Katrina
 
Posts: n/a

Default RE: How does the Slow Changing Dimension Wizard split up rows? - 04-15-2007 , 06:11 PM



I've got the exact same problem however my data is in SQL Server 2000 not in SQL. However the fields I am transferring from are chars and varchars and the fileds I am transferrring too are nvarchar and char.

Has anyone come across this? What do I need to do?

From http://www.developmentnow.com/g/103_...it-up-rows.htm

Posted via DevelopmentNow.com Groups
http://www.developmentnow.com

Reply With Quote
  #10  
Old   
Allan Mitchell
 
Posts: n/a

Default RE: How does the Slow Changing Dimension Wizard split up rows? - 04-16-2007 , 02:35 PM



Hello Katrinanospam (AT) developmentnow (DOT) com,

The SCD transform splits rows based really on two things

1. What you identify as the business key and
2. What you identify as the change type of the columns.

Data Type mismatches can be a problem in some components (try doing lookups
on floats)

Have you tried casting your columns to the same datatype as their respective
partner and see what happens?

Are you able to give a very very simple guaranteed to fail example (Recreation
scripts etc)?

--

Allan Mitchell
http://wiki.sqlis.com | http://www.sqlis.com | http://www.sqldts.com |
http://www.konesans.com

Quote:
I've got the exact same problem however my data is in SQL Server 2000
not in SQL. However the fields I am transferring from are chars and
varchars and the fileds I am transferrring too are nvarchar and char.

Has anyone come across this? What do I need to do?

From
http://www.developmentnow.com/g/103_...w-does-the-Slo
w-Changing-Dimension-Wizard-split-up-rows.htm

Posted via DevelopmentNow.com Groups
http://www.developmentnow.com



Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.