dbTalk Databases Forums  

Log gets filled

microsoft.public.sqlserver.dts microsoft.public.sqlserver.dts


Discuss Log gets filled in the microsoft.public.sqlserver.dts forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
Yog
 
Posts: n/a

Default Log gets filled - 02-08-2005 , 09:25 AM






I have a DTS job which copies 20 tables from a Sybase database to Microsoft
SQL Server database.

The sybase connectivity is a ODBC Connection, and SQL server native
connection.

The tasks are deleting from the SQL Server tables, and then Copy from Sybase
to SQL Server tables (select * from .. destination object).

Whenever I run this, the log file increases by 4000 MB for every run.

Is there a way I can avoid this logging.

Reply With Quote
  #2  
Old   
Sue Hoegemeier
 
Posts: n/a

Default Re: Log gets filled - 02-08-2005 , 10:33 AM






One option but it depends on your database, If you are
deleting all records in the SQL Server table, try truncating
the tables instead of deleting. If you have constraints that
prevent this, drop the constraints, truncate the tables,
recreate the constraints. Truncate logs the page
deallocations instead of each row deletion.

-Sue

On Tue, 8 Feb 2005 07:25:08 -0800, Yog
<Yog (AT) discussions (DOT) microsoft.com> wrote:

Quote:
I have a DTS job which copies 20 tables from a Sybase database to Microsoft
SQL Server database.

The sybase connectivity is a ODBC Connection, and SQL server native
connection.

The tasks are deleting from the SQL Server tables, and then Copy from Sybase
to SQL Server tables (select * from .. destination object).

Whenever I run this, the log file increases by 4000 MB for every run.

Is there a way I can avoid this logging.


Reply With Quote
  #3  
Old   
Andy S.
 
Posts: n/a

Default Re: Log gets filled - 02-08-2005 , 12:24 PM



Truncating is definitely a good suggestion as it beats DELETE performance.
You can also set the recovery model to Simple (DB Optionstrunc log on chkpt
= true, select into/bulk copy = 'true') or Bulk Logged (select into/bulk
copy = true ) to minimize logging during the load. Bear in mind, *you will
only be able to recover to the last full backup should you need to restore*,
so you'll want to review the backup and recovery reuqirements of your
environment.


"Sue Hoegemeier" <Sue_H (AT) nomail (DOT) please> wrote

Quote:
One option but it depends on your database, If you are
deleting all records in the SQL Server table, try truncating
the tables instead of deleting. If you have constraints that
prevent this, drop the constraints, truncate the tables,
recreate the constraints. Truncate logs the page
deallocations instead of each row deletion.

-Sue

On Tue, 8 Feb 2005 07:25:08 -0800, Yog
Yog (AT) discussions (DOT) microsoft.com> wrote:

I have a DTS job which copies 20 tables from a Sybase database to
Microsoft
SQL Server database.

The sybase connectivity is a ODBC Connection, and SQL server native
connection.

The tasks are deleting from the SQL Server tables, and then Copy from
Sybase
to SQL Server tables (select * from .. destination object).

Whenever I run this, the log file increases by 4000 MB for every run.

Is there a way I can avoid this logging.




Reply With Quote
  #4  
Old   
Allan Mitchell
 
Posts: n/a

Default Re: Log gets filled - 02-08-2005 , 12:45 PM



Also note that even though these options are set you may still blow the
log. SQL Server cannot get rid of any thing from the log until it has
written it to disk. For SQL Server to be able to do this it will have
to breathe during the load and this can be accomplished by "Batching"
the rows into chunks.



"Andy S." <andymcdba1 (AT) nospam (DOT) yahoo.com> wrote

Quote:
Truncating is definitely a good suggestion as it beats DELETE performance.

You can also set the recovery model to Simple (DB Optionstrunc log on
chkpt
= true, select into/bulk copy = 'true') or Bulk Logged (select into/bulk

copy = true ) to minimize logging during the load. Bear in mind, *you
will
only be able to recover to the last full backup should you need to
restore*,
so you'll want to review the backup and recovery reuqirements of your
environment.


"Sue Hoegemeier" <Sue_H (AT) nomail (DOT) please> wrote in message
news:76qh01hsv719baan2gg946pb44u7ike2ve (AT) 4ax (DOT) com...
One option but it depends on your database, If you are
deleting all records in the SQL Server table, try truncating
the tables instead of deleting. If you have constraints that
prevent this, drop the constraints, truncate the tables,
recreate the constraints. Truncate logs the page
deallocations instead of each row deletion.

-Sue

On Tue, 8 Feb 2005 07:25:08 -0800, Yog
Yog (AT) discussions (DOT) microsoft.com> wrote:

I have a DTS job which copies 20 tables from a Sybase database to
Microsoft
SQL Server database.

The sybase connectivity is a ODBC Connection, and SQL server native
connection.

The tasks are deleting from the SQL Server tables, and then Copy from
Sybase
to SQL Server tables (select * from .. destination object).

Whenever I run this, the log file increases by 4000 MB for every run.

Is there a way I can avoid this logging.



Reply With Quote
  #5  
Old   
Yog
 
Posts: n/a

Default Re: Log gets filled - 02-09-2005 , 11:27 AM



Thank you, I will try these options.

"Allan Mitchell" wrote:

Quote:
Also note that even though these options are set you may still blow the
log. SQL Server cannot get rid of any thing from the log until it has
written it to disk. For SQL Server to be able to do this it will have
to breathe during the load and this can be accomplished by "Batching"
the rows into chunks.



"Andy S." <andymcdba1 (AT) nospam (DOT) yahoo.com> wrote in message
news:andymcdba1 (AT) nospam (DOT) yahoo.com:
Truncating is definitely a good suggestion as it beats DELETE performance.

You can also set the recovery model to Simple (DB Optionstrunc log on
chkpt
= true, select into/bulk copy = 'true') or Bulk Logged (select into/bulk

copy = true ) to minimize logging during the load. Bear in mind, *you
will
only be able to recover to the last full backup should you need to
restore*,
so you'll want to review the backup and recovery reuqirements of your
environment.


"Sue Hoegemeier" <Sue_H (AT) nomail (DOT) please> wrote in message
news:76qh01hsv719baan2gg946pb44u7ike2ve (AT) 4ax (DOT) com...
One option but it depends on your database, If you are
deleting all records in the SQL Server table, try truncating
the tables instead of deleting. If you have constraints that
prevent this, drop the constraints, truncate the tables,
recreate the constraints. Truncate logs the page
deallocations instead of each row deletion.

-Sue

On Tue, 8 Feb 2005 07:25:08 -0800, Yog
Yog (AT) discussions (DOT) microsoft.com> wrote:

I have a DTS job which copies 20 tables from a Sybase database to
Microsoft
SQL Server database.

The sybase connectivity is a ODBC Connection, and SQL server native
connection.

The tasks are deleting from the SQL Server tables, and then Copy from
Sybase
to SQL Server tables (select * from .. destination object).

Whenever I run this, the log file increases by 4000 MB for every run.

Is there a way I can avoid this logging.




Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.