dbTalk Databases Forums  

copying large data on production environment

comp.databases.oracle.server comp.databases.oracle.server


Discuss copying large data on production environment in the comp.databases.oracle.server forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
mick.w
 
Posts: n/a

Default copying large data on production environment - 09-28-2010 , 08:55 AM






I need to copy large data from one table to another (insert into..
values (select * from ...)) on production environment (system must be
running). I can do this in few parts, copying data partition by
partition. Are there any hint for this problem to avoid slowdown of
system?

Reply With Quote
  #2  
Old   
joel garry
 
Posts: n/a

Default Re: copying large data on production environment - 09-28-2010 , 10:59 AM






On Sep 28, 6:55*am, "mick.w" <mic... (AT) poczta (DOT) fm> wrote:
Quote:
I need to copy large data from one table to another (insert into..
values (select * from ...)) on production environment (system must be
running). I can do this in few parts, copying data partition by
partition. Are there any hint for this problem to avoid slowdown of
system?
Well, something has got to give. First of all, which exact versions
of everything are you using? What kind of volumes of data are we
talking about? Are there times when the system is less heavily
loaded? How long do you have to do it? Are you using any tools like
Informatica, Toad, or just sql, or pl/sql? Are you on the server or
is a client machine involved? Does the data need any transform? Are
constraints the same? What kind of storage are you using?

In general, if you can do it in sql that will be faster than pl/sql or
other tools, although there are some situations where pl could be
faster, and some situations where you might want start/stop
capability. It is also possible that you could lower the priority of
the os process doing the transfer, if you have flexible time
constraints for completion.

Some obvious things to check in testing is how big redo files are, it
may make sense to make them bigger for this time. Same for undo,
though some people argue to let undo grow as much as needed (my
opinion is this is an exception to that, unless you are doing this
periodically).

Also, don't use select *, be explicit about the columns. That's just
good programming practice, and has a slight performance effect
(although normally too small to notice).

A more risky move would be to temporarily use noarchivelog mode, but
users would have to sign off on the risk of losing production data
during the load time. Not really a strategy for a system that needs
to keep running, but may be worth it if a small time window overrides
other considerations.

jg
--
@home.com is bogus.
http://www.ocregister.com/articles/l...-bradford.html

Reply With Quote
  #3  
Old   
mick.w
 
Posts: n/a

Default Re: copying large data on production environment - 09-30-2010 , 04:06 AM



Thanks for your response!

Quote:
Well, something has got to give. *First of all, which exact versions ofeverything are you using? *
Oracle 10.2.0.4.0
What kind of volumes of data are we talking about? *
What do you mean?
Are there times when the system is less heavily loaded?
Yes
*How long do you have to do it?
As I wrote, I can do this in a few parts. Probably client side will do
this at the weekends or nightly hours, so the time is enough
Quote:
*Are you using any tools like Informatica, Toad, or just sql, or pl/sql?
Just sql and pl/sql
*Are you on the server or is a client machine involved?
I am not on the server. I need to write scripts which client side will
execute
Quote:
*Does the data need any transform? *
I need to split data into to tables with the same structure. Primary
key must be changed
Quote:
Are constraints the same? *
Yes
What kind of storage are you using?
Storage will be enough.

Does executing command insert into ... values (select a, b from abc
partition(part1)) will produce a big slowdown? Does hint 'append'
could improve performance of this operation? (tables will be empty and
no records will be deleted from them for now)

Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.