dbTalk Databases Forums  

DTS text file export to limited size file

microsoft.public.sqlserver.dts microsoft.public.sqlserver.dts


Discuss DTS text file export to limited size file in the microsoft.public.sqlserver.dts forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
justStartOnDTS
 
Posts: n/a

Default DTS text file export to limited size file - 05-04-2005 , 11:10 AM






Topic: DTS export data to a text file. One table to a text file. Works
perfectly well.
Problem: The next process that is using the text file does not admit file
size greater than 2 GB
Question: I need to instruct the package to export to many files, each up to
2 GB. mytext_1.txt, mytext_2.txt and so on till all data from the table to
export is done.
Who can help, some example/article will be beneficial.

Thanks
Mitch

Reply With Quote
  #2  
Old   
Darren Green
 
Posts: n/a

Default Re: DTS text file export to limited size file - 05-04-2005 , 12:10 PM






I would do this at a disk level, after the export. There are tools that
split files to span disks. May have to write something a bit clever to split
the file at a line delimiter, or perhaps just use it like a disk span tool,
and put it back together at the other end.


"justStartOnDTS" <justStartOnDTS (AT) discussions (DOT) microsoft.com> wrote

Quote:
Topic: DTS export data to a text file. One table to a text file. Works
perfectly well.
Problem: The next process that is using the text file does not admit file
size greater than 2 GB
Question: I need to instruct the package to export to many files, each up
to
2 GB. mytext_1.txt, mytext_2.txt and so on till all data from the table to
export is done.
Who can help, some example/article will be beneficial.

Thanks
Mitch



Reply With Quote
  #3  
Old   
justStartOnDTS
 
Posts: n/a

Default Re: DTS text file export to limited size file - 05-04-2005 , 12:58 PM



Thanks Darren,
I just wanted to be sure that there is no simple way of doing this in DTS.
Based on your answer and the answers from the thread "Huge table export to
multiple files?" (see below) I believe that my good choice will be create the
huge file and then use an execute task with a VBA code to split the file.
Doing so I sure re-invent the wheel.
The hard drive is big enough there is no need to span disks, just to split
the file.
Can you point some of the utilities that I can use? The OS is Win 2000
family with latest SP. (SQL is 2000)
Maybe create a batch file and added as a last task in DTS?

Thanks
Mitch

Is it possible to setup DTS to export a huge table (10 million rows) to a
series of text files, with a subset of the rows in each text file?
Something like "table1.dat", "table2.dat", etc.?


I know I can do this with VB, but then I need to loop through a query with a
different subset of the data being selected for each file. It seems like
there should be a way to do this automatically.
Or perhaps there's another tool?


--David H

Euan Garden Jun 26 2001, 1:50 am show options

Newsgroups: microsoft.public.sqlserver.dts
From: "Euan Garden" <e... (AT) spicedham (DOT) microsoft.com> - Find messages by this
author
Date: Mon, 25 Jun 2001 22:48:43 -0700
Local: Tues,Jun 26 2001 1:48 am
Subject: Re: Huge table export to multiple files?
Reply to Author | Forward | Print | Individual Message | Show original |
Report Abuse

Not without creating multiple transform tasks with different select
statements in the source, no.


-Euan

"Darren Green" wrote:

Quote:
I would do this at a disk level, after the export. There are tools that
split files to span disks. May have to write something a bit clever to split
the file at a line delimiter, or perhaps just use it like a disk span tool,
and put it back together at the other end.


"justStartOnDTS" <justStartOnDTS (AT) discussions (DOT) microsoft.com> wrote in message
news:C3D851B3-555B-48DC-A458-85DBC8C84AC4 (AT) microsoft (DOT) com...
Topic: DTS export data to a text file. One table to a text file. Works
perfectly well.
Problem: The next process that is using the text file does not admit file
size greater than 2 GB
Question: I need to instruct the package to export to many files, each up
to
2 GB. mytext_1.txt, mytext_2.txt and so on till all data from the table to
export is done.
Who can help, some example/article will be beneficial.

Thanks
Mitch




Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.