dbTalk Databases Forums  

Slow DTS server performance

microsoft.public.sqlserver.dts microsoft.public.sqlserver.dts


Discuss Slow DTS server performance in the microsoft.public.sqlserver.dts forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
Fred Jones
 
Posts: n/a

Default Slow DTS server performance - 07-07-2003 , 10:19 AM






Hi,
I'm running SQL2k sp3 on a dual Xeon w/four drives/arrays
(SCSI)(OS on C:, Logs on E:, tempdb on F:, Data on G:
(500GB)). I have a large DTS package for processing text
files for billing and reporting purposes. The input file
averages 400,000 rows per day and ends up creating a
dozen tables that average 300k rows per file. Various
data is exported and zipped to disk with WinRAR. The
package is either executed manually on the server or
scheduled to run from the server

My problem is that the DTS package runs about 20% more
slowly on the server above than it does on my desktop
workstation (executed locally or as a job), which is a
plain old 1.8 P4 with a standard drive. When I check the
process both processors are running around 80%.

Another example is a single column update on a 1 million
row table (again executed on the server) with a single
join to an indexed table with 8,000 rows. This update
took over 2 1/2 hours.

I'm looking for advice and hints about how to start
researching theslowness problems.

Thanks,

Reply With Quote
  #2  
Old   
Allan Mitchell
 
Posts: n/a

Default Re: Slow DTS server performance - 07-07-2003 , 01:27 PM






I generally have

1. As many tasks executing in Parallel as I do processors (No More)
2. I configure memory to roughly 300 MB less than MAX

--


Allan Mitchell (Microsoft SQL Server MVP)
MCSE,MCDBA
www.SQLDTS.com
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org

"Fred Jones" <fredjonze (AT) nospam (DOT) hotmail.com> wrote

Quote:
Hi Allan,
Thanks for the response. I'll try your suggestion in
several hours when the server is idle. Out of curiosity,
why might setting SQL to 1 processor speed it up? There
are some packages that have parallel processes with 'max
tasks' set to the default of 4. I also tried adjusting
the fetch and commit values with no appreciable affect.

I checked the memory setting. It's set to dynamically
configure and the max is 1906MB out of 2047MB. Is this
too high?

Thanks,
-----Original Message-----
A quick one to try is to tell SQL Server to only use 1
processor. Does this
help the execution time ?

--


Allan Mitchell (Microsoft SQL Server MVP)
MCSE,MCDBA
www.SQLDTS.com
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org

"Fred Jones" <fredjonze (AT) nospam (DOT) hotmail.com> wrote in
message
news:012d01c3449b$1dc168a0$a101280a (AT) phx (DOT) gbl...
Hi,
I'm running SQL2k sp3 on a dual Xeon w/four
drives/arrays
(SCSI)(OS on C:, Logs on E:, tempdb on F:, Data on G:
(500GB)). I have a large DTS package for processing
text
files for billing and reporting purposes. The input
file
averages 400,000 rows per day and ends up creating a
dozen tables that average 300k rows per file. Various
data is exported and zipped to disk with WinRAR. The
package is either executed manually on the server or
scheduled to run from the server

My problem is that the DTS package runs about 20% more
slowly on the server above than it does on my desktop
workstation (executed locally or as a job), which is a
plain old 1.8 P4 with a standard drive. When I check
the
process both processors are running around 80%.

Another example is a single column update on a 1
million
row table (again executed on the server) with a single
join to an indexed table with 8,000 rows. This update
took over 2 1/2 hours.

I'm looking for advice and hints about how to start
researching theslowness problems.

Thanks,


.




Reply With Quote
  #3  
Old   
Fred Jones
 
Posts: n/a

Default Re: Slow DTS server performance - 07-07-2003 , 02:21 PM



Hi Allan,
In SQL properties I enabled processor 1 and disabled
processor 2. I also set the dropdown to use only 1
processor. I also tried disabling 1 and enabling 2. In
each case the processing times increased from 42 minutes
(with 2 processors) to almost 50 minutes with 1
processor. If I manually execute the package on my
development workstation (single 1.8 P4) it takes about 36
minutes to run.

On the server (with only processor 2 for SQL) I noticed
that processor 1 was running about 90% and processor 2
was running about 20%. Is this because of the VBScript in
the datapump? If so, any ideas why it runs faster on my
desktop that has a cheap drive and only 512 RAM? I guess
this doesn't explain the slow SQL updates using query
analyzer.

Thanks for your time,

Quote:
-----Original Message-----
A quick one to try is to tell SQL Server to only use 1
processor. Does this
help the execution time ?

--


Allan Mitchell (Microsoft SQL Server MVP)
MCSE,MCDBA
www.SQLDTS.com
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org

"Fred Jones" <fredjonze (AT) nospam (DOT) hotmail.com> wrote in
message
news:012d01c3449b$1dc168a0$a101280a (AT) phx (DOT) gbl...
Hi,
I'm running SQL2k sp3 on a dual Xeon w/four
drives/arrays
(SCSI)(OS on C:, Logs on E:, tempdb on F:, Data on G:
(500GB)). I have a large DTS package for processing
text
files for billing and reporting purposes. The input
file
averages 400,000 rows per day and ends up creating a
dozen tables that average 300k rows per file. Various
data is exported and zipped to disk with WinRAR. The
package is either executed manually on the server or
scheduled to run from the server

My problem is that the DTS package runs about 20% more
slowly on the server above than it does on my desktop
workstation (executed locally or as a job), which is a
plain old 1.8 P4 with a standard drive. When I check
the
process both processors are running around 80%.

Another example is a single column update on a 1
million
row table (again executed on the server) with a single
join to an indexed table with 8,000 rows. This update
took over 2 1/2 hours.

I'm looking for advice and hints about how to start
researching theslowness problems.

Thanks,


.


Reply With Quote
  #4  
Old   
Fred Jones
 
Posts: n/a

Default Re: Slow DTS server performance - 07-07-2003 , 03:26 PM



Hi Allan,
I don't know if I'm going crazy. I thought that both
processor we're enabled when I unchecked one...but now
I'm unable to enable other than processor two. Should I
be able to have both processors checked a the same time?

Thanks,
Quote:
-----Original Message-----
Hi Allan,
In SQL properties I enabled processor 1 and disabled
processor 2. I also set the dropdown to use only 1
processor. I also tried disabling 1 and enabling 2. In
each case the processing times increased from 42 minutes
(with 2 processors) to almost 50 minutes with 1
processor. If I manually execute the package on my
development workstation (single 1.8 P4) it takes about
36
minutes to run.

On the server (with only processor 2 for SQL) I noticed
that processor 1 was running about 90% and processor 2
was running about 20%. Is this because of the VBScript
in
the datapump? If so, any ideas why it runs faster on my
desktop that has a cheap drive and only 512 RAM? I
guess
this doesn't explain the slow SQL updates using query
analyzer.

Thanks for your time,

-----Original Message-----
A quick one to try is to tell SQL Server to only use 1
processor. Does this
help the execution time ?

--


Allan Mitchell (Microsoft SQL Server MVP)
MCSE,MCDBA
www.SQLDTS.com
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org

"Fred Jones" <fredjonze (AT) nospam (DOT) hotmail.com> wrote in
message
news:012d01c3449b$1dc168a0$a101280a (AT) phx (DOT) gbl...
Hi,
I'm running SQL2k sp3 on a dual Xeon w/four
drives/arrays
(SCSI)(OS on C:, Logs on E:, tempdb on F:, Data on G:
(500GB)). I have a large DTS package for processing
text
files for billing and reporting purposes. The input
file
averages 400,000 rows per day and ends up creating a
dozen tables that average 300k rows per file. Various
data is exported and zipped to disk with WinRAR. The
package is either executed manually on the server or
scheduled to run from the server

My problem is that the DTS package runs about 20% more
slowly on the server above than it does on my desktop
workstation (executed locally or as a job), which is a
plain old 1.8 P4 with a standard drive. When I check
the
process both processors are running around 80%.

Another example is a single column update on a 1
million
row table (again executed on the server) with a single
join to an indexed table with 8,000 rows. This update
took over 2 1/2 hours.

I'm looking for advice and hints about how to start
researching theslowness problems.

Thanks,


.

.


Reply With Quote
  #5  
Old   
Allan Mitchell
 
Posts: n/a

Default Re: Slow DTS server performance - 07-07-2003 , 04:34 PM



You should be able to enable both processors

--


Allan Mitchell (Microsoft SQL Server MVP)
MCSE,MCDBA
www.SQLDTS.com
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org

"Fred Jones" <fredjonze (AT) nospam (DOT) hotmail.com> wrote

Quote:
Hi Allan,
I don't know if I'm going crazy. I thought that both
processor we're enabled when I unchecked one...but now
I'm unable to enable other than processor two. Should I
be able to have both processors checked a the same time?

Thanks,
-----Original Message-----
Hi Allan,
In SQL properties I enabled processor 1 and disabled
processor 2. I also set the dropdown to use only 1
processor. I also tried disabling 1 and enabling 2. In
each case the processing times increased from 42 minutes
(with 2 processors) to almost 50 minutes with 1
processor. If I manually execute the package on my
development workstation (single 1.8 P4) it takes about
36
minutes to run.

On the server (with only processor 2 for SQL) I noticed
that processor 1 was running about 90% and processor 2
was running about 20%. Is this because of the VBScript
in
the datapump? If so, any ideas why it runs faster on my
desktop that has a cheap drive and only 512 RAM? I
guess
this doesn't explain the slow SQL updates using query
analyzer.

Thanks for your time,

-----Original Message-----
A quick one to try is to tell SQL Server to only use 1
processor. Does this
help the execution time ?

--


Allan Mitchell (Microsoft SQL Server MVP)
MCSE,MCDBA
www.SQLDTS.com
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org

"Fred Jones" <fredjonze (AT) nospam (DOT) hotmail.com> wrote in
message
news:012d01c3449b$1dc168a0$a101280a (AT) phx (DOT) gbl...
Hi,
I'm running SQL2k sp3 on a dual Xeon w/four
drives/arrays
(SCSI)(OS on C:, Logs on E:, tempdb on F:, Data on G:
(500GB)). I have a large DTS package for processing
text
files for billing and reporting purposes. The input
file
averages 400,000 rows per day and ends up creating a
dozen tables that average 300k rows per file. Various
data is exported and zipped to disk with WinRAR. The
package is either executed manually on the server or
scheduled to run from the server

My problem is that the DTS package runs about 20% more
slowly on the server above than it does on my desktop
workstation (executed locally or as a job), which is a
plain old 1.8 P4 with a standard drive. When I check
the
process both processors are running around 80%.

Another example is a single column update on a 1
million
row table (again executed on the server) with a single
join to an indexed table with 8,000 rows. This update
took over 2 1/2 hours.

I'm looking for advice and hints about how to start
researching theslowness problems.

Thanks,


.

.




Reply With Quote
  #6  
Old   
Jéjé
 
Posts: n/a

Default Re: Slow DTS server performance - 07-07-2003 , 10:19 PM



have you look at your performance counters ?
First you must identify the problem:
* CPU
* HD (Avg disk queue length)
* Memory

I've the same type of problem with a "big" server, but I've no time to find
the source of the problem.
I suspect the RAID 5 and the drives to be the problem in my case.

What is the result if you export your data to another computer instead-of
the local drive?
Where is your export folder actually?

"Fred Jones" <fredjonze (AT) nospam (DOT) hotmail.com> a écrit dans le message de
news:012d01c3449b$1dc168a0$a101280a (AT) phx (DOT) gbl...
Quote:
Hi,
I'm running SQL2k sp3 on a dual Xeon w/four drives/arrays
(SCSI)(OS on C:, Logs on E:, tempdb on F:, Data on G:
(500GB)). I have a large DTS package for processing text
files for billing and reporting purposes. The input file
averages 400,000 rows per day and ends up creating a
dozen tables that average 300k rows per file. Various
data is exported and zipped to disk with WinRAR. The
package is either executed manually on the server or
scheduled to run from the server

My problem is that the DTS package runs about 20% more
slowly on the server above than it does on my desktop
workstation (executed locally or as a job), which is a
plain old 1.8 P4 with a standard drive. When I check the
process both processors are running around 80%.

Another example is a single column update on a 1 million
row table (again executed on the server) with a single
join to an indexed table with 8,000 rows. This update
took over 2 1/2 hours.

I'm looking for advice and hints about how to start
researching theslowness problems.

Thanks,

---
Outgoing mail is certified Virus Free.
Checked by AVG anti-virus system (http://www.grisoft.com).
Version: 6.0.497 / Virus Database: 296 - Release Date: 2003-07-04




Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.