dbTalk Databases Forums  

large data management

comp.databases.ms-sqlserver comp.databases.ms-sqlserver


Discuss large data management in the comp.databases.ms-sqlserver forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
Enorme Vigenti
 
Posts: n/a

Default large data management - 10-16-2007 , 02:33 AM






Hi all, I have a problem with sqlserver 2000 and large data management.
I have a database with a large tables.
Every table has a continuative input data flow
every morning a job delete old records from the tables (delete one most
old day)
but sometimes I belive that this operation is blocking for the table and
the continuative data flow on that table fails for timeout.
Infact the delete operation is most espesive in time resource. (4-5 hour
for every table)
I must say that the table has an index on datetime field.
I can't use trucate table because I can't delete all records.
In delete table can't use the option "with no lock"
perhaps I must to recalc datatime index on a table before delete? any
other idea?
tnx in advance

Reply With Quote
  #2  
Old   
Erland Sommarskog
 
Posts: n/a

Default Re: large data management - 10-16-2007 , 04:29 PM






Enorme Vigenti (LSimon5 (AT) libero (DOT) it) writes:
Quote:
Hi all, I have a problem with sqlserver 2000 and large data management.
I have a database with a large tables.
Every table has a continuative input data flow
every morning a job delete old records from the tables (delete one most
old day)
but sometimes I belive that this operation is blocking for the table and
the continuative data flow on that table fails for timeout.
Infact the delete operation is most espesive in time resource. (4-5 hour
for every table)
I must say that the table has an index on datetime field.
I can't use trucate table because I can't delete all records.
In delete table can't use the option "with no lock"
perhaps I must to recalc datatime index on a table before delete? any
other idea?
Had you been on SQL 2005, you could have used partitioned tables. This
requires Enterprise Edition, I should hasten to add. With partitioned
table, deleting old data can be as smooth as a metadata operation,
if you set it up correctly.

On SQL 2000 (and SQL 2005 Standard and lower editions) you can use
partitioned views. This requires some more work, but is still doable.
And again the delete can be as simple as dropping the table.

SQL Server MVP Stefan Delmarco has a good article on partitoned views
on http://www.fotia.co.uk/fotia/FA.02.S...dViews.01.aspx.

--
Erland Sommarskog, SQL Server MVP, esquel (AT) sommarskog (DOT) se

Books Online for SQL Server 2005 at
http://www.microsoft.com/technet/pro...ads/books.mspx
Books Online for SQL Server 2000 at
http://www.microsoft.com/sql/prodinf...ons/books.mspx


Reply With Quote
  #3  
Old   
Enorme Vigenti
 
Posts: n/a

Default Re: large data management - 10-17-2007 , 02:21 AM



Erland Sommarskog ha scritto:

Quote:
Had you been on SQL 2005, you could have used partitioned tables. This
requires Enterprise Edition, I should hasten to add. With partitioned
table, deleting old data can be as smooth as a metadata operation,
if you set it up correctly.

On SQL 2000 (and SQL 2005 Standard and lower editions) you can use
partitioned views. This requires some more work, but is still doable.
And again the delete can be as simple as dropping the table.

SQL Server MVP Stefan Delmarco has a good article on partitoned views
on http://www.fotia.co.uk/fotia/FA.02.S...dViews.01.aspx.

Many thanks :-)
Very good!


Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.