dbTalk Databases Forums  

DTS Eating space

microsoft.public.sqlserver.dts microsoft.public.sqlserver.dts


Discuss DTS Eating space in the microsoft.public.sqlserver.dts forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
Joe
 
Posts: n/a

Default DTS Eating space - 07-16-2003 , 07:54 AM






Hi

I had an old architecture where VC code did a lot of data churning, now I
have converted them as DTS tasks. I suddenly realise that the data files get
full very soon, there is no great change done from existing arch, except
that there is a table that holds ingested data until processing is over

Can anyone give me some pointers where and what should be causing the
problem. Has anyone faced something similar to the mess that I am in

could you give me some reasons why using DTS blows my data file and eats
loads of hard disk space

thanks in advance

jeune



Reply With Quote
  #2  
Old   
Allan Mitchell
 
Posts: n/a

Default Re: DTS Eating space - 07-16-2003 , 09:06 AM






What could be happening is that SQL Server is eating space creating work
tables.

Couple of things that speed thigs up

1. Remove triggers
2. Remove non-essential indexes (reapply afterwards)
3. Insert in batches
4. Change recovery model to SIMPLE.


--

----------------------------
Allan Mitchell (Microsoft SQL Server MVP)
MCSE,MCDBA
www.SQLDTS.com
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org



"Joe" <joseph.jeune (AT) tfn (DOT) com> wrote

Quote:
Hi

I had an old architecture where VC code did a lot of data churning, now I
have converted them as DTS tasks. I suddenly realise that the data files
get
full very soon, there is no great change done from existing arch, except
that there is a table that holds ingested data until processing is over

Can anyone give me some pointers where and what should be causing the
problem. Has anyone faced something similar to the mess that I am in

could you give me some reasons why using DTS blows my data file and eats
loads of hard disk space

thanks in advance

jeune





Reply With Quote
  #3  
Old   
Joe
 
Posts: n/a

Default Re: DTS Eating space - 07-17-2003 , 05:53 AM



Point 1 - 3 are with regards to speed, but my issue is with space. The
recovery is simple on the db however. So these points have not actually
given me any clue, nor my work overnight on this. Any other clues with
regards to eating space since I am not sure how point 1-3 will reduce space
utilization

Thanks

Jeune
"Allan Mitchell" <allan (AT) no-spam (DOT) sqldts.com> wrote

Quote:
What could be happening is that SQL Server is eating space creating work
tables.

Couple of things that speed thigs up

1. Remove triggers
2. Remove non-essential indexes (reapply afterwards)
3. Insert in batches
4. Change recovery model to SIMPLE.


--

----------------------------
Allan Mitchell (Microsoft SQL Server MVP)
MCSE,MCDBA
www.SQLDTS.com
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org



"Joe" <joseph.jeune (AT) tfn (DOT) com> wrote in message
news:edUt0i5SDHA.2188 (AT) TK2MSFTNGP10 (DOT) phx.gbl...
Hi

I had an old architecture where VC code did a lot of data churning, now
I
have converted them as DTS tasks. I suddenly realise that the data files
get
full very soon, there is no great change done from existing arch, except
that there is a table that holds ingested data until processing is over

Can anyone give me some pointers where and what should be causing the
problem. Has anyone faced something similar to the mess that I am in

could you give me some reasons why using DTS blows my data file and
eats
loads of hard disk space

thanks in advance

jeune







Reply With Quote
  #4  
Old   
Allan Mitchell
 
Posts: n/a

Default Re: DTS Eating space - 07-17-2003 , 06:05 AM



The simple recovery mode cannot remove transactions that are not marked as
committed. So if you commit after every 500 or so then you only have 500
transactions in the log not 5 milllion


--

----------------------------
Allan Mitchell (Microsoft SQL Server MVP)
MCSE,MCDBA
www.SQLDTS.com
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org



"Joe" <joseph.jeune (AT) tfn (DOT) com> wrote

Quote:
Point 1 - 3 are with regards to speed, but my issue is with space. The
recovery is simple on the db however. So these points have not actually
given me any clue, nor my work overnight on this. Any other clues with
regards to eating space since I am not sure how point 1-3 will reduce
space
utilization

Thanks

Jeune
"Allan Mitchell" <allan (AT) no-spam (DOT) sqldts.com> wrote in message
news:uSv73N6SDHA.1992 (AT) TK2MSFTNGP12 (DOT) phx.gbl...
What could be happening is that SQL Server is eating space creating work
tables.

Couple of things that speed thigs up

1. Remove triggers
2. Remove non-essential indexes (reapply afterwards)
3. Insert in batches
4. Change recovery model to SIMPLE.


--

----------------------------
Allan Mitchell (Microsoft SQL Server MVP)
MCSE,MCDBA
www.SQLDTS.com
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org



"Joe" <joseph.jeune (AT) tfn (DOT) com> wrote in message
news:edUt0i5SDHA.2188 (AT) TK2MSFTNGP10 (DOT) phx.gbl...
Hi

I had an old architecture where VC code did a lot of data churning,
now
I
have converted them as DTS tasks. I suddenly realise that the data
files
get
full very soon, there is no great change done from existing arch,
except
that there is a table that holds ingested data until processing is
over

Can anyone give me some pointers where and what should be causing the
problem. Has anyone faced something similar to the mess that I am in

could you give me some reasons why using DTS blows my data file and
eats
loads of hard disk space

thanks in advance

jeune









Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.