dbTalk Databases Forums  

DTS Performance tuning

microsoft.public.sqlserver.dts microsoft.public.sqlserver.dts


Discuss DTS Performance tuning in the microsoft.public.sqlserver.dts forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
Matt Cannen
 
Posts: n/a

Default DTS Performance tuning - 09-16-2003 , 04:13 PM








I am currently running a dts package that runs four processes in
parallel inserting records that meet certain criteria. The package
averages 7 mins for 150 dbf files. Average record count is around
4000-18000 records. Can someone provide some pointers that could speed
this process up. Everything is taken from db3 formats and input in
SQL2000 tables. I know this may sound vague but a point in a direction
of things to look at would be greatly appreciated.

*** Sent via Developersdex http://www.developersdex.com ***
Don't just participate in USENET...get rewarded for it!

Reply With Quote
  #2  
Old   
Darren Green
 
Posts: n/a

Default Re: DTS Performance tuning - 09-16-2003 , 04:28 PM






In article <u1jXsdJfDHA.4024 (AT) TK2MSFTNGP11 (DOT) phx.gbl>, Matt Cannen
<Matt (AT) Cannen (DOT) ?.invalid> writes
Quote:

I am currently running a dts package that runs four processes in
parallel inserting records that meet certain criteria. The package
averages 7 mins for 150 dbf files. Average record count is around
4000-18000 records. Can someone provide some pointers that could speed
this process up. Everything is taken from db3 formats and input in
SQL2000 tables. I know this may sound vague but a point in a direction
of things to look at would be greatly appreciated.

Use a single copy column transform per DataPump task.
Use separate connections for each DataPump task.
--
Darren Green (SQL Server MVP)
DTS - http://www.sqldts.com

PASS - the definitive, global community for SQL Server professionals
http://www.sqlpass.org



Reply With Quote
  #3  
Old   
Matt Cannen
 
Posts: n/a

Default Re: DTS Performance tuning - 09-17-2003 , 08:38 AM




Currently I do use the single copy column method. Also I use separate
connections to the database.


*** Sent via Developersdex http://www.developersdex.com ***
Don't just participate in USENET...get rewarded for it!

Reply With Quote
  #4  
Old   
Philip
 
Posts: n/a

Default Re: DTS Performance tuning - 09-18-2003 , 02:34 AM



Matt Cannen <Matt Cannen> wrote

Quote:
I am currently running a dts package that runs four processes in
parallel inserting records that meet certain criteria. The package
averages 7 mins for 150 dbf files. Average record count is around
4000-18000 records. Can someone provide some pointers that could speed
this process up. Everything is taken from db3 formats and input in
SQL2000 tables. I know this may sound vague but a point in a direction
of things to look at would be greatly appreciated.

*** Sent via Developersdex http://www.developersdex.com ***
Don't just participate in USENET...get rewarded for it!
Use Transform Data Tasks. If you are using some Lookup queries -
remove them and try to make separate Transform Data Tasks, which are
doing the same work. Two Transform Data Tasks perform better, than
one, which is using a lookup query. If your logic requires a lookup -
you've already done the best.


Reply With Quote
  #5  
Old   
Matt Cannen
 
Posts: n/a

Default Re: DTS Performance tuning - 09-18-2003 , 08:44 AM




Currently I use separate Transform data task on each dbf connection.
Inside my Transform data task I use an activeX script that has to parse
data inside my db3 file before allowing it to insert into SQL. Below is
my activeX is there maybe a better way to do this?

Function Main()

Dim pkg
set pkg = DTSGlobalVariables.Parent


IF CDate(Mid(DTSSource("EVENTTIME"),5,2) & "/" &
Mid(DTSSource("EVENTTIME"),7,2) & "/" & Mid(DTSSource("EVENTTIME"),1,4))
= CDate(DTSGlobalVariables("gv_ProcDate").Value) Then
DTSDestination("RECORDNUM") = DTSSource("RECORDNUM")
DTSDestination("FDISP") = DTSSource("FDISP")
DTSDestination("CALLSPAN") = DTSSource("CALLSPAN")
DTSDestination("EVENTTYPE") = DTSSource("EVENTTYPE")
DTSDestination("EVENTCODE") = DTSSource("EVENTCODE")
DTSDestination("OPERATOR") = DTSSource("OPERATOR")
DTSDestination("STATION") = DTSSource("STATION")
DTSDestination("EVENTTIME") = Mid(DTSSource("EVENTTIME"),9,6)
DTSDestination("EVENTDATE") = Mid(DTSSource("EVENTTIME"),1,8)
DTSDestination("DNIS") = DTSSource("DNIS")
DTSDestination("TELROOT")= Mid(DTSSource("PHONE"),7,4)
DTSDestination("PREFIX") = Mid(DTSSource("PHONE"),4,3)
DTSDestination("AREAC") = Mid(DTSSource("PHONE"),1,3)
DTSDestination("LISTNUM") = DTSSource("LISTNUM")
DTSDestination("CAMPAIGN") = DTSSource("CAMPAIGN")
DTSDestination("GROUPBY") = DTSSource("GROUPBY")
Main = DTSTransformStat_OK
Else
Main = DTSTransformStat_SkipRow
End if
End Function


*** Sent via Developersdex http://www.developersdex.com ***
Don't just participate in USENET...get rewarded for it!

Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.