dbTalk Databases Forums  

Fastest way to load text file into a table

microsoft.public.sqlserver.dts microsoft.public.sqlserver.dts


Discuss Fastest way to load text file into a table in the microsoft.public.sqlserver.dts forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
martino
 
Posts: n/a

Default Fastest way to load text file into a table - 07-09-2004 , 03:04 PM






Hello There!

I have a text file containing 3,876,240 rows and i am
using a simple DTS package to copy this text file into a
table with same column definition.

According to the Status bar on the "Executing DTS Package"
window it loaded in less than 3 minutes 3,876,200 rows and
then it totally slows down and for the last 240 rows it's
taking over 40 minutes, something gotta be wrong in what i
am doing.

Gotta be a faster way to do this load, please any ideas
are highly appreciated!!

thanks!!


Reply With Quote
  #2  
Old   
Andrew J. Kelly
 
Posts: n/a

Default Re: Fastest way to load text file into a table - 07-09-2004 , 03:28 PM






The time at the end is when it is updating all the indexes. How many
indexes do you have on the table and is the file in the order of the
clustered index?

--
Andrew J. Kelly SQL MVP


"martino" <anonymous (AT) discussions (DOT) microsoft.com> wrote

Quote:
Hello There!

I have a text file containing 3,876,240 rows and i am
using a simple DTS package to copy this text file into a
table with same column definition.

According to the Status bar on the "Executing DTS Package"
window it loaded in less than 3 minutes 3,876,200 rows and
then it totally slows down and for the last 240 rows it's
taking over 40 minutes, something gotta be wrong in what i
am doing.

Gotta be a faster way to do this load, please any ideas
are highly appreciated!!

thanks!!




Reply With Quote
  #3  
Old   
Narayana Vyas Kondreddi
 
Posts: n/a

Default Re: Fastest way to load text file into a table - 07-10-2004 , 02:01 AM



Have you considered using BULK INSERT command?
--
Vyas, MVP (SQL Server)
http://vyaskn.tripod.com/


"martino" <anonymous (AT) discussions (DOT) microsoft.com> wrote

Quote:
Hello There!

I have a text file containing 3,876,240 rows and i am
using a simple DTS package to copy this text file into a
table with same column definition.

According to the Status bar on the "Executing DTS Package"
window it loaded in less than 3 minutes 3,876,200 rows and
then it totally slows down and for the last 240 rows it's
taking over 40 minutes, something gotta be wrong in what i
am doing.

Gotta be a faster way to do this load, please any ideas
are highly appreciated!!

thanks!!




Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.