dbTalk Databases Forums  

Huge overhead of federation server: can it be improved

comp.databases.ibm-db2 comp.databases.ibm-db2


Discuss Huge overhead of federation server: can it be improved in the comp.databases.ibm-db2 forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
k_rus
 
Posts: n/a

Default Huge overhead of federation server: can it be improved - 05-26-2010 , 01:14 AM






Hi,

How much CPU intensive is WebSphere Federation Server 9.5?

We are using WebSphere Federation Server on top of DB2 v9.5 ESE LUW on
Windows Server 2003 to federate three databases: one is managed by
Oracle 10g, two others are managed by one DB2 Server. We noticed
problems with performance.
During the investigation I run simple query to transfer data from a
DB2 database through the federation server to a client desktop. The
transferred data are 2,5 million rows of an Integer indexed column
from one table, i.e., 10 MB. It takes 50 seconds to execute the
transferring query on the federation server with single CPU. The
bottleneck is the CPU on the federation server, which is loaded by
100%.
Later we added second CPU to the federation.The execution time of the
query was reduced down to 30 seconds.
Is it normal that an execution of a query, which transfers 10 MB of
data through federation, takes 30 seconds? Is there a way to improve
performance?

Best regards,
Ruslan

Reply With Quote
  #2  
Old   
Serge Rielau
 
Posts: n/a

Default Re: Huge overhead of federation server: can it be improved - 05-26-2010 , 06:27 AM






Not sure if thsi can be tracked via usenet.. have youconsidered opening
a PMR?
Some general thoughts: If the "remote" DB is local it could be you see
high CPU because of the bufferpool of both DB2 Fed and the source DB.
So that would be a good thing.

But can you get teh optimizer plan for the federated query?
Maybe it's just a bad plan?

Cheers
Serge


--
Serge Rielau
SQL Architect DB2 for LUW
IBM Toronto Lab

Reply With Quote
  #3  
Old   
Serge Rielau
 
Posts: n/a

Default Re: Huge overhead of federation server: can it be improved - 05-27-2010 , 07:25 AM



I don't think it's normal or expected....

--
Serge Rielau
SQL Architect DB2 for LUW
IBM Toronto Lab

Reply With Quote
  #4  
Old   
k_rus
 
Posts: n/a

Default Re: Huge overhead of federation server: can it be improved - 05-28-2010 , 08:11 AM



I also don't think that it is acceptable. We are in touch with a
consultant from IBM US and I am not able to convince him that it is
not normal and should be investigated.

I made more experiments with sizes of the transferred data.
Queries, which selects more columns from the same table, perform the
same as with one column, i.e., 30 seconds for 2,5 million rows.
A query, which selects a column of the same type (integer), from a
bigger tables, performs worse. E.g., transferring of 7,8 million rows
takes 1 min 30 sec. I.e., linear dependency between execution time and
selected number of rows.

Best regards,
Ruslan

Reply With Quote
  #5  
Old   
k_rus
 
Posts: n/a

Default Re: Huge overhead of federation server: can it be improved - 05-28-2010 , 09:36 AM



I also don't think that it is acceptable. We are in touch with a
consultant from IBM US and I am not able to convince him that it is
not normal and should be investigated.

I made more experiments with sizes of the transferred data.
Queries, which selects more columns from the same table, perform the
same as with one column, i.e., 30 seconds for 2,5 million rows.
A query, which selects a column of the same type (integer), from a
bigger tables, performs worse. E.g., transferring of 7,8 million rows
takes 1 min 30 sec. I.e., linear dependency between execution time and
selected number of rows.

Best regards,
Ruslan

Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.