dbTalk Databases Forums  

Multiple connections from single source

microsoft.public.sqlserver.dts microsoft.public.sqlserver.dts


Discuss Multiple connections from single source in the microsoft.public.sqlserver.dts forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
ChrisElias271
 
Posts: n/a

Default Multiple connections from single source - 01-18-2012 , 09:04 AM






Hi.

I'm relatively new to DTS and SQL server 2000 and use it for
temporarily importing data sets for analysis of customer data ect.

I have been asked to work on some data that comes packaged in 27 fixed
width files to make up the complete quaterly extract.

I have written an import DTS package that uses 27 seperate bulk import
tasks to import that data using a common format file.

There are 90million rows in total with 60 fields. It takes around 34
minutes to create the table and fill it with the data through a single
connection, all on a local PC workstation.

I've tried duplicating the connection in the DTS package and re
configuring the Bulk Import task into 3 threads each using a seperate
connection. I was hoping to speed up the import by sharing the 27
files across 3 connections. I have xeon 4 core processor and enough
memory but it doesn't work, Ie make any quicker.

Presumably because it can only read a single file at a time from the
HDD?

Would a SSD solve this problem?

Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.