dbTalk Databases Forums  

duplicate rows but no key on the tables

microsoft.public.sqlserver.dts microsoft.public.sqlserver.dts


Discuss duplicate rows but no key on the tables in the microsoft.public.sqlserver.dts forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
esther s via SQLMonster.com
 
Posts: n/a

Default duplicate rows but no key on the tables - 07-19-2005 , 01:22 AM







Dear All,

I have a table with 10 billion records but there are no key on it. I cannot
build a key on it as it is the data source.

However, the data source exits the duplicated rows.

I have used the DTS to transform the data into a new table and delete the
duplicated rows. As there are 10 billion records, i need to divide it into 3
parts and also the process lasts for 6 hours each part.

I want to ask is there any other good methods to slove my problem??

Thx


Esther


--
Message posted via SQLMonster.com
http://www.sqlmonster.com/Uwe/Forums...r-dts/200507/1

Reply With Quote
  #2  
Old   
Allan Mitchell
 
Posts: n/a

Default Re: duplicate rows but no key on the tables - 07-19-2005 , 05:23 AM






Can you not query for distinct rows for a start? You know what constitutes a
duplicate on the destination.


--



Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP)
www.SQLDTS.com - The site for all your DTS needs.
www.SQLIS.com - You thought DTS was good. here we show you the new stuff.
www.konesans.com - Consultancy from the people who know


"esther s via SQLMonster.com" <forum (AT) SQLMonster (DOT) com> wrote

Quote:
Dear All,

I have a table with 10 billion records but there are no key on it. I
cannot
build a key on it as it is the data source.

However, the data source exits the duplicated rows.

I have used the DTS to transform the data into a new table and delete the
duplicated rows. As there are 10 billion records, i need to divide it into
3
parts and also the process lasts for 6 hours each part.

I want to ask is there any other good methods to slove my problem??

Thx


Esther


--
Message posted via SQLMonster.com
http://www.sqlmonster.com/Uwe/Forums...r-dts/200507/1



Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.