Re: How to do a incremental data transfer ?

#1

Your source records should be identifiable by a Key value. You can then
move only records where the key is not in the destination.

How ?

1. Linked Server
2. Lookups
3. Trap INSERTS, DELETES, UPDATES using triggers and a trigger table.

--

----------------------------
Allan Mitchell (Microsoft SQL Server MVP)
MCSE,MCDBA
www.SQLDTS.com
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org

"Bonnie" <bonnie (AT) sina (DOT) com> wrote

Quote:

I scheduled a dts package to transfer over 100, 000 records from source to
destination table everyday.
Data stored in this table are posted history data and won't be updated.
Everytime, the table must be
truncated before each transformation and the processing is very time
consuming. Any other way to
transfer only those newly added records in order to shorten the process ?

As there is a increment ID field in this table, I have an idea :
Transfer only records from source with ID > max(ID) in destination

Does sql server tables have row id or row no. ?

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Re: How to do a incremental data transfer ?

microsoft.public.sqlserver.dts microsoft.public.sqlserver.dts

Re: How to do a incremental data transfer ? - 09-01-2003 , 09:13 AM