dbTalk Databases Forums  

SSIS/DTS or simple insert?

microsoft.public.sqlserver.dts microsoft.public.sqlserver.dts


Discuss SSIS/DTS or simple insert? in the microsoft.public.sqlserver.dts forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
nick
 
Posts: n/a

Default SSIS/DTS or simple insert? - 12-26-2005 , 01:45 AM






I need to dump Access MDB files to SQL Server 2005. No extract and transfer,
just transfer the raw data. However, the mdb files can be reaching the
limitation of 2G.

Is there any benifit (especially performance) to use SSIS to load the MDB
files? Or a simple SQL statement (with openquery to open the oledb Jet
database, 'insert into '+@tablename + ' select * from openquery(....)) will
be the same?

Reply With Quote
  #2  
Old   
Jéjé
 
Posts: n/a

Default Re: SSIS/DTS or simple insert? - 12-26-2005 , 10:01 AM






there is a big difference !!!
SSIS use a bulk insert command which is far better then a simple insert
command.

you have to setup correctly the commit batch size.
for example, if you have 1 million of rows, setup the batch size to 10 000
insert 10 000 rows, commit this batch, then load the next 10 000 rows....
instead-o creating 1 transaction for the million of rows, multiple smaller
transaction are created.
this reduce the time taken to load the data, reduce the log file size
needed.

so the answer is clear: use SSIS.

"nick" <nick (AT) discussions (DOT) microsoft.com> wrote

Quote:
I need to dump Access MDB files to SQL Server 2005. No extract and
transfer,
just transfer the raw data. However, the mdb files can be reaching the
limitation of 2G.

Is there any benifit (especially performance) to use SSIS to load the MDB
files? Or a simple SQL statement (with openquery to open the oledb Jet
database, 'insert into '+@tablename + ' select * from openquery(....))
will
be the same?



Reply With Quote
  #3  
Old   
nick
 
Posts: n/a

Default Re: SSIS/DTS or simple insert? - 12-26-2005 , 11:09 PM



Yes, transaction batch is the different. However, how SSIS comparing with
bulk insert? Anyway to implement a kind of bulk insert using TSQL that read
ACCESS MDB files (via openrowset?)...

"Jéjé" wrote:

Quote:
there is a big difference !!!
SSIS use a bulk insert command which is far better then a simple insert
command.

you have to setup correctly the commit batch size.
for example, if you have 1 million of rows, setup the batch size to 10 000
insert 10 000 rows, commit this batch, then load the next 10 000 rows....
instead-o creating 1 transaction for the million of rows, multiple smaller
transaction are created.
this reduce the time taken to load the data, reduce the log file size
needed.

so the answer is clear: use SSIS.

"nick" <nick (AT) discussions (DOT) microsoft.com> wrote in message
news:2705757C-0AE0-4830-969B-46EAD54A0BA7 (AT) microsoft (DOT) com...
I need to dump Access MDB files to SQL Server 2005. No extract and
transfer,
just transfer the raw data. However, the mdb files can be reaching the
limitation of 2G.

Is there any benifit (especially performance) to use SSIS to load the MDB
files? Or a simple SQL statement (with openquery to open the oledb Jet
database, 'insert into '+@tablename + ' select * from openquery(....))
will
be the same?




Reply With Quote
  #4  
Old   
Jéjé
 
Posts: n/a

Default Re: SSIS/DTS or simple insert? - 12-27-2005 , 07:08 AM



openrowset its not a good option.
specially if you have to load a large volume of data.

the import data wizard will create the SSIS package for you with the bulk
insert tasks.
the TSQL version of the bulk insert works when the source is a flat file.

maybe a linked server could be used.

"nick" <nick (AT) discussions (DOT) microsoft.com> wrote

Quote:
Yes, transaction batch is the different. However, how SSIS comparing with
bulk insert? Anyway to implement a kind of bulk insert using TSQL that
read
ACCESS MDB files (via openrowset?)...

"Jéjé" wrote:

there is a big difference !!!
SSIS use a bulk insert command which is far better then a simple insert
command.

you have to setup correctly the commit batch size.
for example, if you have 1 million of rows, setup the batch size to 10
000
insert 10 000 rows, commit this batch, then load the next 10 000 rows....
instead-o creating 1 transaction for the million of rows, multiple
smaller
transaction are created.
this reduce the time taken to load the data, reduce the log file size
needed.

so the answer is clear: use SSIS.

"nick" <nick (AT) discussions (DOT) microsoft.com> wrote in message
news:2705757C-0AE0-4830-969B-46EAD54A0BA7 (AT) microsoft (DOT) com...
I need to dump Access MDB files to SQL Server 2005. No extract and
transfer,
just transfer the raw data. However, the mdb files can be reaching the
limitation of 2G.

Is there any benifit (especially performance) to use SSIS to load the
MDB
files? Or a simple SQL statement (with openquery to open the oledb Jet
database, 'insert into '+@tablename + ' select * from openquery(....))
will
be the same?






Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.