dbTalk Databases Forums  

Importing data from ODBC using AcuODBC Driver

microsoft.public.sqlserver.dts microsoft.public.sqlserver.dts


Discuss Importing data from ODBC using AcuODBC Driver in the microsoft.public.sqlserver.dts forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
JPO
 
Posts: n/a

Default Importing data from ODBC using AcuODBC Driver - 11-17-2003 , 04:48 AM






Hi there,

I'm currently trying to import data from a product system using an
ODBC driver called AcuODBC.

My problem is that the performance is just killing me. It is currently
taking 35min to import 95,000 rows of data (there are 700 columns). It
equates to approx 1.8M cells of data per min.

I know it must be able to be done quicker, dows anyone have any tips?

Thanks very much in advance.
JPO

Reply With Quote
  #2  
Old   
Allan Mitchell
 
Posts: n/a

Default Re: Importing data from ODBC using AcuODBC Driver - 11-17-2003 , 04:56 AM






I am unfamiliar with the driver itself but is there anything you can do in
its setup to speed things up?
Are you seeing the perf decrease on the INSERT side of the equation?
Do you have fast disks?
Do you have indexes on the destination?
Recovery model of the destination?
Triggers on the destination?

--

Allan Mitchell (Microsoft SQL Server MVP)
MCSE,MCDBA
www.SQLDTS.com
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org


"JPO" <justin.parry-okeden (AT) ge (DOT) com> wrote

Quote:
Hi there,

I'm currently trying to import data from a product system using an
ODBC driver called AcuODBC.

My problem is that the performance is just killing me. It is currently
taking 35min to import 95,000 rows of data (there are 700 columns). It
equates to approx 1.8M cells of data per min.

I know it must be able to be done quicker, dows anyone have any tips?

Thanks very much in advance.
JPO



Reply With Quote
  #3  
Old   
JPO
 
Posts: n/a

Default Re: Importing data from ODBC using AcuODBC Driver - 11-17-2003 , 04:39 PM



Hi there Alan,

Thanks for your points, I went back and checked off everything you
mentioned just in case I missed something. I think I have done
everything I can to speed up the performance:-

- We have a very fast disk set
- LOTS of RAM
- Recovery model set to 'SIMPLE'
- select into/bulkcopy turned on
- There are no indexes on the destination tables
- There are no trigers on the destination tables

I can load data from another MS-SQL DB into the same table approx 15
times faster, and I can load data from a flat file (NOT using
Bulk-Copy) about 5 times faster.

Is it just ODBC or is there something I can do to improve the
performance?

Thanks in advance for any help you can offer.
JPO

Reply With Quote
  #4  
Old   
Allan Mitchell
 
Posts: n/a

Default Re: Importing data from ODBC using AcuODBC Driver - 11-18-2003 , 12:27 PM



Then it sounds like the driver. Have you got any of the advanced options
set on the ODBC drivers?

--
--

Allan Mitchell (Microsoft SQL Server MVP)
MCSE,MCDBA
www.SQLDTS.com
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org

"JPO" <justin.parry-okeden (AT) ge (DOT) com> wrote

Quote:
Hi there Alan,

Thanks for your points, I went back and checked off everything you
mentioned just in case I missed something. I think I have done
everything I can to speed up the performance:-

- We have a very fast disk set
- LOTS of RAM
- Recovery model set to 'SIMPLE'
- select into/bulkcopy turned on
- There are no indexes on the destination tables
- There are no trigers on the destination tables

I can load data from another MS-SQL DB into the same table approx 15
times faster, and I can load data from a flat file (NOT using
Bulk-Copy) about 5 times faster.

Is it just ODBC or is there something I can do to improve the
performance?

Thanks in advance for any help you can offer.
JPO



Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.