dbTalk Databases Forums  

Re: Loading from text files.

microsoft.public.sqlserver.dts microsoft.public.sqlserver.dts


Discuss Re: Loading from text files. in the microsoft.public.sqlserver.dts forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
Allan Mitchell
 
Posts: n/a

Default Re: Loading from text files. - 09-05-2003 , 01:53 AM






OK.

You can schedule a package to load from a directory every 15 mins no
proble,. All the files will be the same format so no problem. The only
quirk is the "What if I catch a file midway through the download". Well.


1. The files will be so small this is unlikely
2. If you can control the process that exports the files from each weather
station then have it on successful export add a control record to a table to
tell you it has finished sending the file. You can then use this as the
basis for your uploads.

You may find this article useful

Looping, Importing and Archiving
(http://www.sqldts.com/default.aspx?246)

--


Allan Mitchell (Microsoft SQL Server MVP)
MCSE,MCDBA
www.SQLDTS.com
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org

Reply With Quote
  #2  
Old   
Rana
 
Posts: n/a

Default Re: Loading from text files. - 09-05-2003 , 07:47 AM






Allan -
Thanks for your help.

I receive the files by ftp, telemetry and i cannot
control when the text files are received.
Also, the files are not in same format and are setup to
download into seperate folders based on the type of
weather data.

I will be doing some QA/QC on the data. So, Is it a good
idea to create csv text file every 15 minutes, for each
type of data(text files) i receive and then import data
from the csv formatted files.

I am considering Windows Scripts to work with the text
files i receive and create a csv formatted file(with data
from multiple text files) in a particular folder and let
DTS checks for updates in that that folder.

Thanks
-Rana.







Quote:
-----Original Message-----
OK.

You can schedule a package to load from a directory
every 15 mins no
proble,. All the files will be the same format so no
problem. The only
quirk is the "What if I catch a file midway through the
download". Well.


1. The files will be so small this is unlikely
2. If you can control the process that exports the
files from each weather
station then have it on successful export add a control
record to a table to
tell you it has finished sending the file. You can then
use this as the
basis for your uploads.

You may find this article useful

Looping, Importing and Archiving
(http://www.sqldts.com/default.aspx?246)

--


Allan Mitchell (Microsoft SQL Server MVP)
MCSE,MCDBA
www.SQLDTS.com
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org
.


Reply With Quote
  #3  
Old   
Allan Mitchell
 
Posts: n/a

Default Re: Loading from text files. - 09-05-2003 , 07:57 AM



If the files are a different format then I, as you do, download into
spereate directories. It keeps things clean. You can clean the data in the
files using VBScript in a DTS package. Moving the files to a "Clean Folder"
will work as well. This way you can control when the files arrive there. I
would not try and make this too complicated though.

--


Allan Mitchell (Microsoft SQL Server MVP)
MCSE,MCDBA
www.SQLDTS.com
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org

Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.