![]() | |
![]() |
| | Thread Tools | Display Modes |
#1
| |||
| |||
|
#2
| |||
| |||
|
|
I have a text file that is 25 fields long and contains about 150,000 records. The text file comes from an export of paradox data. The data isn't scrubbed very well, when i tried to take it directly from text file to database, gave errors such as invalid column, etc. That is because there are places in the file that the double quotes don't match up, dates are incorrect format, etc. I tried to fix most of it manually but then realized that the errors were endless. What is the best way to get this data to sql server despite the errors? Thanks, John |
#3
| |||
| |||
|
|
-----Original Message----- You are goint to have to scrub it no matter the method. You can do this in a whole raft of ways i.e. reading each line as 1 string and then in an Active Script transform |
|
name but one. -- Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP) www.SQLDTS.com - The site for all your DTS needs. www.Konesans.com "John" <anonymous (AT) discussions (DOT) microsoft.com> wrote in message news:650801c4cb45$7f89dd60$a601280a (AT) phx (DOT) gbl... I have a text file that is 25 fields long and contains about 150,000 records. The text file comes from an export of paradox data. The data isn't scrubbed very well, when i tried to take it directly from text file to database, gave errors such as invalid column, etc. That is because there are places in the file that the double quotes don't match up, dates are incorrect format, etc. I tried to fix most of it manually but then realized that the errors were endless. What is the best way to get this data to sql server despite the errors? Thanks, John . |
#4
| |||
| |||
|
|
Problem with scrubbing it is next week when they export it again, same situation. I guess I'll tell them to scrub it from their side. Suggestions? -----Original Message----- You are goint to have to scrub it no matter the method. You can do this in a whole raft of ways i.e. reading each line as 1 string and then in an Active Script transform scrubbing it to name but one. -- Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP) www.SQLDTS.com - The site for all your DTS needs. www.Konesans.com "John" <anonymous (AT) discussions (DOT) microsoft.com> wrote in message news:650801c4cb45$7f89dd60$a601280a (AT) phx (DOT) gbl... I have a text file that is 25 fields long and contains about 150,000 records. The text file comes from an export of paradox data. The data isn't scrubbed very well, when i tried to take it directly from text file to database, gave errors such as invalid column, etc. That is because there are places in the file that the double quotes don't match up, dates are incorrect format, etc. I tried to fix most of it manually but then realized that the errors were endless. What is the best way to get this data to sql server despite the errors? Thanks, John . |
![]() |
| Thread Tools | |
| Display Modes | |
| |