Re: How do you sort files in DTS?

#1

In message <4057715B-AD3C-4007-9C1B-814F4D3EC800 (AT) microsoft (DOT) com>, JUnits
<JUnits (AT) discussions (DOT) microsoft.com> writes

Quote:

This may be a dumb question, but how do you sort files in dts? I suppose you
could use the window sort command, but it doesn't allow you to specify colums
to sort on. Do you have to use a third party sort program?

I have a data warehouse load application that currently does most of the
processing in a staging database which is initially load via bcp. The
sorting, matching, cleaning, etc. happens in the database. I would like to
pull this processing out of the database and use text file processing to do
the etl and then bcp the results to the datawarehouse to speed up the
processing. However, this will be a tough task without a flexible sorting
program.

Does anybody do something similar?

Today I think you are better off doing this in a staging database. Not
sure how you can efficiently perform matches between files and files and
SQL for example.

No help at all I'm sure, but come SQL 2005 then things get a lot better,
and you can sort data inside DTS, whilst performing the entire ETL
process. If this is a new project you might have scope to start with SQL
2005 Beta 2, depending on delivery dates etc

--
Darren Green (SQL Server MVP)
DTS - http://www.sqldts.com

PASS - the definitive, global community for SQL Server professionals
http://www.sqlpass.org

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Re: How do you sort files in DTS?

microsoft.public.sqlserver.dts microsoft.public.sqlserver.dts

Re: How do you sort files in DTS? - 08-23-2004 , 03:22 PM