dbTalk Databases Forums  

Custom transformation component for joining input

microsoft.public.sqlserver.dts microsoft.public.sqlserver.dts


Discuss Custom transformation component for joining input in the microsoft.public.sqlserver.dts forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
Sturle
 
Posts: n/a

Default Custom transformation component for joining input - 06-02-2006 , 04:07 AM






Hi,

How do I create my own component that joins (actually it does a lot more, so
it's not a solution to use the existing merge join transform) two huge sorted
input streams without having to cache up too many rows internally in the
component?

To be more specific: What I wonder about is how to ensure that I read the
two input stream in the same pace. After reading some doc, it's not clear to
me how I can control this. It look like the data is pushed to the transform
component rather than pulled into the component. Is it e.g. possible to have
the two inputs to the component in different threads and pausing the thread
that is ahead of the other thread?

Thanks in advance,
Sturle

Reply With Quote
  #2  
Old   
Allan Mitchell
 
Posts: n/a

Default Re: Custom transformation component for joining input - 07-25-2006 , 01:35 PM






Have a look at this article by a guy doing the same thing.


http://www.sqlbi.eu/Home/tabid/36/ct...0/Default.aspx


Allan



"Sturle" <Sturle (AT) discussions (DOT) microsoft.com> wrote

Quote:
Hi,

How do I create my own component that joins (actually it does a lot more,
so
it's not a solution to use the existing merge join transform) two huge
sorted
input streams without having to cache up too many rows internally in the
component?

To be more specific: What I wonder about is how to ensure that I read the
two input stream in the same pace. After reading some doc, it's not clear
to
me how I can control this. It look like the data is pushed to the
transform
component rather than pulled into the component. Is it e.g. possible to
have
the two inputs to the component in different threads and pausing the
thread
that is ahead of the other thread?

Thanks in advance,
Sturle



Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.