Home » Server Options » Streams & AQ » streams for warehousing
streams for warehousing [message #75735] Tue, 24 August 2004 08:52 Go to next message
john b.
Messages: 4
Registered: January 2001
Junior Member
this is a newbie question:

- we have a large warehouse that we want to replicate around the world.

- we need to replicate *large* tables, which have regular *large* volume data loads. can streams handle millions of batch updates?

- what are others experiences using streams for this kind of application on 9i? i hear 9205 is much more stable. opinions?

any wisdom welcome.

john
Re: streams for warehousing [message #75736 is a reply to message #75735] Tue, 24 August 2004 10:57 Go to previous messageGo to next message
andy
Messages: 92
Registered: December 1999
Member
You might consider Ixion IxPropagator for this type of application. It sounds like you have the type of environment that is well suited for it.

You can visit the website: www.ixionsoftware.com
Re: streams for warehousing [message #75737 is a reply to message #75736] Thu, 26 August 2004 10:41 Go to previous messageGo to next message
Ed Grimm
Messages: 1
Registered: August 2004
Junior Member
I am not sure what you categorize by large tables. At our site we have tables averaging 60million rows each, with the largest tables averaging around 200 million rows. We are processing on the average around 400-700 transactions per minute. Streams doesnt fall behind and consistenly maintains around a 2.5 second lag from time of creation at the source till time of commit at the target. We are planning to 'hub' out the streams to other sites which need different subsets of the schema.

We are operating on sun-servers running the 64bit version of Oracle Enterprise Server. We are currently running at 9.2.0.4(with the streams mega-patch) and are planning to upgrade to 9.2.0.5 in either september or october this year.

Hope it addresses your concerns.

Ed Grimm
BridgePoint, Inc.
Re: streams for warehousing [message #75738 is a reply to message #75737] Thu, 26 August 2004 12:14 Go to previous messageGo to next message
john b.
Messages: 4
Registered: January 2001
Junior Member
hey, thanks. sounds like it works fine.

any gotchas you know of?

john
Re: streams for warehousing [message #75739 is a reply to message #75737] Fri, 27 August 2004 06:44 Go to previous messageGo to next message
andy
Messages: 92
Registered: December 1999
Member
Well, not to brag, but IxPropagator replicates at up to 8000 TPS. It really depends on the environment. We have a client with tables that contain tens of millions of rows (although that doesn't really matter as much as how many inserts/updates/deletes they are processing when it comes to performance) and they are running 16 CPU boxes (HP) with 8 gig of ram. Typical replication rates are about 2000 rows per second (not transactions, but rows). Most of our clients are financial services, brokerage, or telecommunications companies that have to move a lot of data.

I have yet to see anything that really compares to IxPropagator, from a replication performance perspective.
Re: streams for warehousing [message #75740 is a reply to message #75737] Fri, 27 August 2004 12:11 Go to previous message
john b.
Messages: 4
Registered: January 2001
Junior Member
thanks ed.

if we also wanted to use streams to do
snapshots of data into development environments
to refresh, would that be a problem? does it
only stream data?
we may want to replicate a production table for testing, let people destructively test against it, then truncate & refresh again.
has anyone used oracle streams for this?

thanks, john
Previous Topic: dbms_rule_adm problem
Next Topic: Unable to apply changes to the target tables [no error generated at Apply]
Goto Forum:
  


Current Time: Thu Mar 28 15:43:11 CDT 2024