dbTalk Databases Forums  

Text File Import no Dups?

microsoft.public.sqlserver.dts microsoft.public.sqlserver.dts


Discuss Text File Import no Dups? in the microsoft.public.sqlserver.dts forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
JDP@Work
 
Posts: n/a

Default Text File Import no Dups? - 02-16-2004 , 05:11 PM






Am I correct in thinking that there is no way to not accidentially import data
from a CSV file daily data feed in the following PKG(?)

DataSource = CSV file
Transformation is Copy Column

I don't want a user to accidentially import the same feed twice.

My alternative is to use a linked server and insert the data w/a query in DTS.

TIA

JeffP....



Reply With Quote
  #2  
Old   
Darren Green
 
Posts: n/a

Default Re: Text File Import no Dups? - 02-17-2004 , 01:38 AM






Why do you think the file cannot be imported twice?
Are you moving or renaming the file after the import has completed?
Does you table have a PK or a unique constraint that will prevent the same
data being inserted again?

It won't happen by magic, so you need to either make the file unavailable
for a duplicate import or constrain the data in the table.

Have I missed the point?

--
Darren Green
http://www.sqldts.com


"JDP@Work" <JPGMTNoSpam (AT) sbcglobal (DOT) net> wrote

Quote:
Am I correct in thinking that there is no way to not accidentially import
data
from a CSV file daily data feed in the following PKG(?)

DataSource = CSV file
Transformation is Copy Column

I don't want a user to accidentially import the same feed twice.

My alternative is to use a linked server and insert the data w/a query in
DTS.

TIA

JeffP....





Reply With Quote
  #3  
Old   
JDP@Work
 
Posts: n/a

Default Re: Text File Import no Dups? - 02-17-2004 , 07:46 PM



No you hadn't missed anything, but I did find that I can connect directly to a
csv file which is very cool, I knew that I could as an Excel file.

Anyway, I have a unique sequential number column provided in the feed, there was
some duplication of the numbering early on, but the most recent feeds have been
clean and sequential. So I can say ....where contact_ID not in(select
contact_ID from....

I now can attempt to import the same file without any danger of getting dups.

TIA

JeffP....

"Darren Green" <darren.green (AT) reply-to-newsgroup-sqldts (DOT) com> wrote

Quote:
Why do you think the file cannot be imported twice?
Are you moving or renaming the file after the import has completed?
Does you table have a PK or a unique constraint that will prevent the same
data being inserted again?

It won't happen by magic, so you need to either make the file unavailable
for a duplicate import or constrain the data in the table.

Have I missed the point?

--
Darren Green
http://www.sqldts.com


"JDP@Work" <JPGMTNoSpam (AT) sbcglobal (DOT) net> wrote in message
news:O86AfIO9DHA.2432 (AT) TK2MSFTNGP10 (DOT) phx.gbl...
Am I correct in thinking that there is no way to not accidentially import
data
from a CSV file daily data feed in the following PKG(?)

DataSource = CSV file
Transformation is Copy Column

I don't want a user to accidentially import the same feed twice.

My alternative is to use a linked server and insert the data w/a query in
DTS.

TIA

JeffP....







Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.