dbTalk Databases Forums  

Log File is growing

microsoft.public.sqlserver.dts microsoft.public.sqlserver.dts


Discuss Log File is growing in the microsoft.public.sqlserver.dts forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
Andrew J. Kelly
 
Posts: n/a

Default Re: Log File is growing - 12-23-2005 , 08:30 AM






Unless you are doing a minimally logged load (and I doubt you are) you will
always log at least as much data as you change or insert. Actually more
since there is some overhead as well. When you say increased do you mean
the physical size of the file or the amount of log space used?

--
Andrew J. Kelly SQL MVP


"Roy Goldhammer" <roy (AT) hotmail (DOT) com> wrote

Quote:
Hello there

I've run dts between two servers that connected by the internet, and one
of
the tables failed.

I've transfered 78Mb, and the log file has increased in 100Mb.

Whayd did the log file has increased that mutch?
and how can i prevent it?





Reply With Quote
  #2  
Old   
Andrew J. Kelly
 
Posts: n/a

Default Re: Log File is growing - 12-23-2005 , 09:38 AM






Look in BooksOnLine under "minimally logged bulk copy" for the conditions to
get a minimally logged load. While this is for BCP the rules still apply to
DTS loads. The key mostly with DTS is to make sure the TABLOCK checkbox is
enabled along with the other conditions mentioned. When you meet these
requirements you will only log the extent numbers of extents that were
modified during the load and not the actual data. This can reduce the
amount of data sent to the tran log dramatically and also speed up your
operation.

--
Andrew J. Kelly SQL MVP


"Roy Goldhammer" <roy (AT) hotmail (DOT) com> wrote

Quote:
Yes Andrew

The destination server is website which is limited to 256Mb of data and
256mb for Log

you said "minimally logged". what did you mean by that?

"Andrew J. Kelly" <sqlmvpnooospam (AT) shadhawk (DOT) com> wrote in message
news:eJE8A28BGHA.3584 (AT) TK2MSFTNGP11 (DOT) phx.gbl...
Unless you are doing a minimally logged load (and I doubt you are) you
will
always log at least as much data as you change or insert. Actually more
since there is some overhead as well. When you say increased do you mean
the physical size of the file or the amount of log space used?

--
Andrew J. Kelly SQL MVP


"Roy Goldhammer" <roy (AT) hotmail (DOT) com> wrote in message
news:uU$Dsw7BGHA.3744 (AT) TK2MSFTNGP10 (DOT) phx.gbl...
Hello there

I've run dts between two servers that connected by the internet, and
one
of
the tables failed.

I've transfered 78Mb, and the log file has increased in 100Mb.

Whayd did the log file has increased that mutch?
and how can i prevent it?









Reply With Quote
  #3  
Old   
Roy Goldhammer
 
Posts: n/a

Default Log File is growing - 12-23-2005 , 04:26 PM



Hello there

I've run dts between two servers that connected by the internet, and one of
the tables failed.

I've transfered 78Mb, and the log file has increased in 100Mb.

Whayd did the log file has increased that mutch?
and how can i prevent it?



Reply With Quote
  #4  
Old   
Roy Goldhammer
 
Posts: n/a

Default Re: Log File is growing - 12-23-2005 , 07:23 PM



Yes Andrew

The destination server is website which is limited to 256Mb of data and
256mb for Log

you said "minimally logged". what did you mean by that?

"Andrew J. Kelly" <sqlmvpnooospam (AT) shadhawk (DOT) com> wrote

Quote:
Unless you are doing a minimally logged load (and I doubt you are) you
will
always log at least as much data as you change or insert. Actually more
since there is some overhead as well. When you say increased do you mean
the physical size of the file or the amount of log space used?

--
Andrew J. Kelly SQL MVP


"Roy Goldhammer" <roy (AT) hotmail (DOT) com> wrote in message
news:uU$Dsw7BGHA.3744 (AT) TK2MSFTNGP10 (DOT) phx.gbl...
Hello there

I've run dts between two servers that connected by the internet, and one
of
the tables failed.

I've transfered 78Mb, and the log file has increased in 100Mb.

Whayd did the log file has increased that mutch?
and how can i prevent it?







Reply With Quote
  #5  
Old   
Andrew J. Kelly
 
Posts: n/a

Default Re: Log File is growing - 12-24-2005 , 07:58 AM



Usually all you need to do when using a DTS package is to make sure the
checkbox on the advanced options tab of the package for "Use TableLock" is
turned on.

--
Andrew J. Kelly SQL MVP


"Roy Goldhammer" <roy (AT) hotmail (DOT) com> wrote

Quote:
Thankes Andrew

It took me time to find out about it

It seems that i only need to use sp_tableoption 'tablename', 'table lock
on
bulk load', 'true'

But now have another problem.

I couldn't run this store procedure on tables who is not on my connection.
and if i reset the data(running script that rebuild it againg this option
return to default)

Is there a way to maintain this option?

"Andrew J. Kelly" <sqlmvpnooospam (AT) shadhawk (DOT) com> wrote in message
news:Ohsq7b9BGHA.312 (AT) TK2MSFTNGP09 (DOT) phx.gbl...
Look in BooksOnLine under "minimally logged bulk copy" for the conditions
to
get a minimally logged load. While this is for BCP the rules still apply
to
DTS loads. The key mostly with DTS is to make sure the TABLOCK checkbox
is
enabled along with the other conditions mentioned. When you meet these
requirements you will only log the extent numbers of extents that were
modified during the load and not the actual data. This can reduce the
amount of data sent to the tran log dramatically and also speed up your
operation.

--
Andrew J. Kelly SQL MVP


"Roy Goldhammer" <roy (AT) hotmail (DOT) com> wrote in message
news:eaLdNT9BGHA.3452 (AT) TK2MSFTNGP10 (DOT) phx.gbl...
Yes Andrew

The destination server is website which is limited to 256Mb of data and
256mb for Log

you said "minimally logged". what did you mean by that?

"Andrew J. Kelly" <sqlmvpnooospam (AT) shadhawk (DOT) com> wrote in message
news:eJE8A28BGHA.3584 (AT) TK2MSFTNGP11 (DOT) phx.gbl...
Unless you are doing a minimally logged load (and I doubt you are) you
will
always log at least as much data as you change or insert. Actually
more
since there is some overhead as well. When you say increased do you
mean
the physical size of the file or the amount of log space used?

--
Andrew J. Kelly SQL MVP


"Roy Goldhammer" <roy (AT) hotmail (DOT) com> wrote in message
news:uU$Dsw7BGHA.3744 (AT) TK2MSFTNGP10 (DOT) phx.gbl...
Hello there

I've run dts between two servers that connected by the internet, and
one
of
the tables failed.

I've transfered 78Mb, and the log file has increased in 100Mb.

Whayd did the log file has increased that mutch?
and how can i prevent it?













Reply With Quote
  #6  
Old   
Roy Goldhammer
 
Posts: n/a

Default Re: Log File is growing - 12-24-2005 , 01:35 PM



Thankes Andrew

It took me time to find out about it

It seems that i only need to use sp_tableoption 'tablename', 'table lock on
bulk load', 'true'

But now have another problem.

I couldn't run this store procedure on tables who is not on my connection.
and if i reset the data(running script that rebuild it againg this option
return to default)

Is there a way to maintain this option?

"Andrew J. Kelly" <sqlmvpnooospam (AT) shadhawk (DOT) com> wrote

Quote:
Look in BooksOnLine under "minimally logged bulk copy" for the conditions
to
get a minimally logged load. While this is for BCP the rules still apply
to
DTS loads. The key mostly with DTS is to make sure the TABLOCK checkbox
is
enabled along with the other conditions mentioned. When you meet these
requirements you will only log the extent numbers of extents that were
modified during the load and not the actual data. This can reduce the
amount of data sent to the tran log dramatically and also speed up your
operation.

--
Andrew J. Kelly SQL MVP


"Roy Goldhammer" <roy (AT) hotmail (DOT) com> wrote in message
news:eaLdNT9BGHA.3452 (AT) TK2MSFTNGP10 (DOT) phx.gbl...
Yes Andrew

The destination server is website which is limited to 256Mb of data and
256mb for Log

you said "minimally logged". what did you mean by that?

"Andrew J. Kelly" <sqlmvpnooospam (AT) shadhawk (DOT) com> wrote in message
news:eJE8A28BGHA.3584 (AT) TK2MSFTNGP11 (DOT) phx.gbl...
Unless you are doing a minimally logged load (and I doubt you are) you
will
always log at least as much data as you change or insert. Actually more
since there is some overhead as well. When you say increased do you
mean
the physical size of the file or the amount of log space used?

--
Andrew J. Kelly SQL MVP


"Roy Goldhammer" <roy (AT) hotmail (DOT) com> wrote in message
news:uU$Dsw7BGHA.3744 (AT) TK2MSFTNGP10 (DOT) phx.gbl...
Hello there

I've run dts between two servers that connected by the internet, and
one
of
the tables failed.

I've transfered 78Mb, and the log file has increased in 100Mb.

Whayd did the log file has increased that mutch?
and how can i prevent it?











Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.