dbTalk Databases Forums  

Streams advice

comp.databases.oracle.misc comp.databases.oracle.misc


Discuss Streams advice in the comp.databases.oracle.misc forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
Geoff Muldoon
 
Posts: n/a

Default Streams advice - 05-18-2008 , 07:30 PM






Sorry for the repost, but got zero replies to this post when first sent a
couple of weeks ago, and would really appreciate and advice or pointers
....

Hi all,

First of all - IANADBA. I'm just a developer / project manager.

Oracle 10.2.0.3 RAC cluster on Intel Linux, ASM on a SAN.

We have a series of instances on our RAC cluster, some of which support
largish 3rd party applications and some "developed in-house" including an
embrionic MIS DW.

Several of these need to exchange data, and currently this is being
achieved using a mix of bulk overnight partial copies and (near real-time,
some delay acceptable) table triggers.

I am keen to investigate the option of shifting to a consolidated approach
using Oracle Change Data Capture (aka Streams).

At some stage in the future we are also unfortunately likely to need to
add a MSSQL database (via Heterogenous Replication?) to this mix.

I've read (and absorbed a fraction of) the Oracle Streams Replication
Administrator's Guide, and think that the configuration option that will
best suit our needs is "Asynchronous AutoLog archive" mode.

Can any Streams-savvy people provide any general advice as to whether I'm
heading down the right or wrong path?

TIA

Geoff M

Reply With Quote
  #2  
Old   
Frank van Bortel
 
Posts: n/a

Default Re: Streams advice - 05-19-2008 , 02:09 PM






Geoff Muldoon wrote:
Quote:
Sorry for the repost, but got zero replies to this post when first sent a
couple of weeks ago, and would really appreciate and advice or pointers
...

Hi all,

First of all - IANADBA. I'm just a developer / project manager.

Oracle 10.2.0.3 RAC cluster on Intel Linux, ASM on a SAN.

We have a series of instances on our RAC cluster, some of which support
largish 3rd party applications and some "developed in-house" including an
embrionic MIS DW.

Several of these need to exchange data, and currently this is being
achieved using a mix of bulk overnight partial copies and (near real-time,
some delay acceptable) table triggers.

I am keen to investigate the option of shifting to a consolidated approach
using Oracle Change Data Capture (aka Streams).

At some stage in the future we are also unfortunately likely to need to
add a MSSQL database (via Heterogenous Replication?) to this mix.

I've read (and absorbed a fraction of) the Oracle Streams Replication
Administrator's Guide, and think that the configuration option that will
best suit our needs is "Asynchronous AutoLog archive" mode.

Can any Streams-savvy people provide any general advice as to whether I'm
heading down the right or wrong path?

TIA

Geoff M
What's wrong with table triggers (and obviously, database links)?
One stop further, materialized views - possibly with refresh on commit.
Only then (two stops further, one stop extra would be
Advanced Replication) comes Streams. There's quite a lot of
overhead in Streams, so make sure you stress test (when going
with Streams) in a production-like setup.

Frank


Reply With Quote
  #3  
Old   
Frank van Bortel
 
Posts: n/a

Default Re: Streams advice - 05-19-2008 , 02:09 PM



Geoff Muldoon wrote:
Quote:
Sorry for the repost, but got zero replies to this post when first sent a
couple of weeks ago, and would really appreciate and advice or pointers
...

Hi all,

First of all - IANADBA. I'm just a developer / project manager.

Oracle 10.2.0.3 RAC cluster on Intel Linux, ASM on a SAN.

We have a series of instances on our RAC cluster, some of which support
largish 3rd party applications and some "developed in-house" including an
embrionic MIS DW.

Several of these need to exchange data, and currently this is being
achieved using a mix of bulk overnight partial copies and (near real-time,
some delay acceptable) table triggers.

I am keen to investigate the option of shifting to a consolidated approach
using Oracle Change Data Capture (aka Streams).

At some stage in the future we are also unfortunately likely to need to
add a MSSQL database (via Heterogenous Replication?) to this mix.

I've read (and absorbed a fraction of) the Oracle Streams Replication
Administrator's Guide, and think that the configuration option that will
best suit our needs is "Asynchronous AutoLog archive" mode.

Can any Streams-savvy people provide any general advice as to whether I'm
heading down the right or wrong path?

TIA

Geoff M
What's wrong with table triggers (and obviously, database links)?
One stop further, materialized views - possibly with refresh on commit.
Only then (two stops further, one stop extra would be
Advanced Replication) comes Streams. There's quite a lot of
overhead in Streams, so make sure you stress test (when going
with Streams) in a production-like setup.

Frank


Reply With Quote
  #4  
Old   
Frank van Bortel
 
Posts: n/a

Default Re: Streams advice - 05-19-2008 , 02:09 PM



Geoff Muldoon wrote:
Quote:
Sorry for the repost, but got zero replies to this post when first sent a
couple of weeks ago, and would really appreciate and advice or pointers
...

Hi all,

First of all - IANADBA. I'm just a developer / project manager.

Oracle 10.2.0.3 RAC cluster on Intel Linux, ASM on a SAN.

We have a series of instances on our RAC cluster, some of which support
largish 3rd party applications and some "developed in-house" including an
embrionic MIS DW.

Several of these need to exchange data, and currently this is being
achieved using a mix of bulk overnight partial copies and (near real-time,
some delay acceptable) table triggers.

I am keen to investigate the option of shifting to a consolidated approach
using Oracle Change Data Capture (aka Streams).

At some stage in the future we are also unfortunately likely to need to
add a MSSQL database (via Heterogenous Replication?) to this mix.

I've read (and absorbed a fraction of) the Oracle Streams Replication
Administrator's Guide, and think that the configuration option that will
best suit our needs is "Asynchronous AutoLog archive" mode.

Can any Streams-savvy people provide any general advice as to whether I'm
heading down the right or wrong path?

TIA

Geoff M
What's wrong with table triggers (and obviously, database links)?
One stop further, materialized views - possibly with refresh on commit.
Only then (two stops further, one stop extra would be
Advanced Replication) comes Streams. There's quite a lot of
overhead in Streams, so make sure you stress test (when going
with Streams) in a production-like setup.

Frank


Reply With Quote
  #5  
Old   
Frank van Bortel
 
Posts: n/a

Default Re: Streams advice - 05-19-2008 , 02:09 PM



Geoff Muldoon wrote:
Quote:
Sorry for the repost, but got zero replies to this post when first sent a
couple of weeks ago, and would really appreciate and advice or pointers
...

Hi all,

First of all - IANADBA. I'm just a developer / project manager.

Oracle 10.2.0.3 RAC cluster on Intel Linux, ASM on a SAN.

We have a series of instances on our RAC cluster, some of which support
largish 3rd party applications and some "developed in-house" including an
embrionic MIS DW.

Several of these need to exchange data, and currently this is being
achieved using a mix of bulk overnight partial copies and (near real-time,
some delay acceptable) table triggers.

I am keen to investigate the option of shifting to a consolidated approach
using Oracle Change Data Capture (aka Streams).

At some stage in the future we are also unfortunately likely to need to
add a MSSQL database (via Heterogenous Replication?) to this mix.

I've read (and absorbed a fraction of) the Oracle Streams Replication
Administrator's Guide, and think that the configuration option that will
best suit our needs is "Asynchronous AutoLog archive" mode.

Can any Streams-savvy people provide any general advice as to whether I'm
heading down the right or wrong path?

TIA

Geoff M
What's wrong with table triggers (and obviously, database links)?
One stop further, materialized views - possibly with refresh on commit.
Only then (two stops further, one stop extra would be
Advanced Replication) comes Streams. There's quite a lot of
overhead in Streams, so make sure you stress test (when going
with Streams) in a production-like setup.

Frank


Reply With Quote
  #6  
Old   
Geoff Muldoon
 
Posts: n/a

Default Re: Streams advice - 05-19-2008 , 08:25 PM



Frank van Bortel says...
Quote:
Geoff Muldoon wrote:

I've read (and absorbed a fraction of) the Oracle Streams Replication
Administrator's Guide, and think that the configuration option that will
best suit our needs is "Asynchronous AutoLog archive" mode.

Can any Streams-savvy people provide any general advice as to whether I'm
heading down the right or wrong path?

TIA

Geoff M
What's wrong with table triggers (and obviously, database links)?
As stated, it's one of the main methodologies we currently use. There are
particular issues here (to do amongst other thing with application vendor
support, grrr) with that approach, which is one of the reasons we are
looking at Streams.

Quote:
One stop further, materialized views - possibly with refresh on commit.
An option, but likely to face the same obstacles here as the triggers
approach.

Quote:
Only then (two stops further, one stop extra would be
Advanced Replication) comes Streams. There's quite a lot of
overhead in Streams, so make sure you stress test (when going
with Streams) in a production-like setup.
We are particularly looking at Asynchronous Change Data Capture because it
"can be configured to have minimal performance impact on the source
database", so I presume you refer to overheads at the staging database and
overall server resource levels, rather than within the source databases.
Maybe overheads of the subscriber databases too?

Thanks for your thoughts, appreciated.

Geoff M


Reply With Quote
  #7  
Old   
Geoff Muldoon
 
Posts: n/a

Default Re: Streams advice - 05-19-2008 , 08:25 PM



Frank van Bortel says...
Quote:
Geoff Muldoon wrote:

I've read (and absorbed a fraction of) the Oracle Streams Replication
Administrator's Guide, and think that the configuration option that will
best suit our needs is "Asynchronous AutoLog archive" mode.

Can any Streams-savvy people provide any general advice as to whether I'm
heading down the right or wrong path?

TIA

Geoff M
What's wrong with table triggers (and obviously, database links)?
As stated, it's one of the main methodologies we currently use. There are
particular issues here (to do amongst other thing with application vendor
support, grrr) with that approach, which is one of the reasons we are
looking at Streams.

Quote:
One stop further, materialized views - possibly with refresh on commit.
An option, but likely to face the same obstacles here as the triggers
approach.

Quote:
Only then (two stops further, one stop extra would be
Advanced Replication) comes Streams. There's quite a lot of
overhead in Streams, so make sure you stress test (when going
with Streams) in a production-like setup.
We are particularly looking at Asynchronous Change Data Capture because it
"can be configured to have minimal performance impact on the source
database", so I presume you refer to overheads at the staging database and
overall server resource levels, rather than within the source databases.
Maybe overheads of the subscriber databases too?

Thanks for your thoughts, appreciated.

Geoff M


Reply With Quote
  #8  
Old   
Geoff Muldoon
 
Posts: n/a

Default Re: Streams advice - 05-19-2008 , 08:25 PM



Frank van Bortel says...
Quote:
Geoff Muldoon wrote:

I've read (and absorbed a fraction of) the Oracle Streams Replication
Administrator's Guide, and think that the configuration option that will
best suit our needs is "Asynchronous AutoLog archive" mode.

Can any Streams-savvy people provide any general advice as to whether I'm
heading down the right or wrong path?

TIA

Geoff M
What's wrong with table triggers (and obviously, database links)?
As stated, it's one of the main methodologies we currently use. There are
particular issues here (to do amongst other thing with application vendor
support, grrr) with that approach, which is one of the reasons we are
looking at Streams.

Quote:
One stop further, materialized views - possibly with refresh on commit.
An option, but likely to face the same obstacles here as the triggers
approach.

Quote:
Only then (two stops further, one stop extra would be
Advanced Replication) comes Streams. There's quite a lot of
overhead in Streams, so make sure you stress test (when going
with Streams) in a production-like setup.
We are particularly looking at Asynchronous Change Data Capture because it
"can be configured to have minimal performance impact on the source
database", so I presume you refer to overheads at the staging database and
overall server resource levels, rather than within the source databases.
Maybe overheads of the subscriber databases too?

Thanks for your thoughts, appreciated.

Geoff M


Reply With Quote
  #9  
Old   
Geoff Muldoon
 
Posts: n/a

Default Re: Streams advice - 05-19-2008 , 08:25 PM



Frank van Bortel says...
Quote:
Geoff Muldoon wrote:

I've read (and absorbed a fraction of) the Oracle Streams Replication
Administrator's Guide, and think that the configuration option that will
best suit our needs is "Asynchronous AutoLog archive" mode.

Can any Streams-savvy people provide any general advice as to whether I'm
heading down the right or wrong path?

TIA

Geoff M
What's wrong with table triggers (and obviously, database links)?
As stated, it's one of the main methodologies we currently use. There are
particular issues here (to do amongst other thing with application vendor
support, grrr) with that approach, which is one of the reasons we are
looking at Streams.

Quote:
One stop further, materialized views - possibly with refresh on commit.
An option, but likely to face the same obstacles here as the triggers
approach.

Quote:
Only then (two stops further, one stop extra would be
Advanced Replication) comes Streams. There's quite a lot of
overhead in Streams, so make sure you stress test (when going
with Streams) in a production-like setup.
We are particularly looking at Asynchronous Change Data Capture because it
"can be configured to have minimal performance impact on the source
database", so I presume you refer to overheads at the staging database and
overall server resource levels, rather than within the source databases.
Maybe overheads of the subscriber databases too?

Thanks for your thoughts, appreciated.

Geoff M


Reply With Quote
  #10  
Old   
Frank van Bortel
 
Posts: n/a

Default Re: Streams advice - 05-21-2008 , 07:10 AM



Geoff Muldoon wrote:

Quote:
We are particularly looking at Asynchronous Change Data Capture because it
"can be configured to have minimal performance impact on the source
database", so I presume you refer to overheads at the staging database and
overall server resource levels, rather than within the source databases.
Maybe overheads of the subscriber databases too?
No - source. Hopefully, things have improved with 10G; 9.2.0.4 was
simply a disaster.
Oh - and do not forget about maintenance on Streams; if something
goes wrong, you're probably screwed. try to test and break things,
and see if you can get them repaired. And document that thoroughly!
Quote:
Thanks for your thoughts, appreciated.

Welcome.
Geoff M
FvB


Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.