Hi,

I have problem running POA threads, I have set Server POA thread
settings as follows.

jacorb.poa.thread_pool_min=15
jacorb.poa.thread_pool_max=15

and my client is generating 15 connections to contact server, At first
client is able to successfully establish 15 connections but not all
the 15 packets in poa queue are processing, some of the packets that
went into queue were staying in the queue for a long time and finally
throwing timeout exception, I simulated the case in our client, here
when client is ready to send packet 45, packets 3,4,5,6,7,10,13,14,15
are still in POA queue and got timeout exception(client timeout set to
5min).

Do anybody have explanation for such a behavior? we are able to
generate this consistently, Can we specify in corba properties to
knowledge the CORBA how to pick the request objects with in the POA
queue? Please help me in resolving this.

Following is the stack trace from client:

Time taken to process:39:2000 records is:52057
Time taken to process:38:2000 records is:52146
Sending a packet:44:2000:88000
Sending a packet:45:2000:90000
#org.omg.CORBA.TIMEOUT: client timeout reached
      at
org.jacorb.orb.giop.ReplyPlaceholder.getInputStream(ReplyPlaceholder.java:
140)
      at org.jacorb.orb.ReplyReceiver.getReply(ReplyReceiver.java:
267)
      at org.jacorb.orb.Delegate.invoke_internal(Delegate.java:963)
      at org.jacorb.orb.Delegate.invoke(Delegate.java:857)
      at org.omg.CORBA.portable.ObjectImpl._invoke(ObjectImpl.java:
76)
      at
com.dnb.emf1.corba.nextgencpsservice.generated._NextGen_CPSStub.processRecords(_NextGen_CPSStub.java:
31)
      at
com.dnb.emf1.corba.util.ProcessInquires.processRecords(ProcessInquires.java:
39)
      at
com.dnb.emf1.corba.util.ProcessInquires.run(ProcessInquires.java:28)
      at com.dnb.emf1.util.WorkerThread.run(ThreadPool.java:146)
      at java.lang.Thread.run(Thread.java:595)
Time taken to process:3:2000 records is:300044
Sending a packet:46:2000:92000
#org.omg.CORBA.TIMEOUT: client timeout reached
      at
org.jacorb.orb.giop.ReplyPlaceholder.getInputStream(ReplyPlaceholder.java:
140)
      at org.jacorb.orb.ReplyReceiver.getReply(ReplyReceiver.java:
267)
      at org.jacorb.orb.Delegate.invoke_internal(Delegate.java:963)
      at org.jacorb.orb.Delegate.invoke(Delegate.java:857)
      at org.omg.CORBA.portable.ObjectImpl._invoke(ObjectImpl.java:
76)
      at
com.dnb.emf1.corba.nextgencpsservice.generated._NextGen_CPSStub.processRecords(_NextGen_CPSStub.java:
31)
      at
com.dnb.emf1.corba.util.ProcessInquires.processRecords(ProcessInquires.java:
39)
      at
com.dnb.emf1.corba.util.ProcessInquires.run(ProcessInquires.java:28)
      at com.dnb.emf1.util.WorkerThread.run(ThreadPool.java:146)
      at java.lang.Thread.run(Thread.java:595)
Time taken to process:4:2000 records is:300045
Sending a packet:47:2000:94000
#org.omg.CORBA.TIMEOUT: client timeout reached
      at
org.jacorb.orb.giop.ReplyPlaceholder.getInputStream(ReplyPlaceholder.java:
140)
      at org.jacorb.orb.ReplyReceiver.getReply(ReplyReceiver.java:
267)
      at org.jacorb.orb.Delegate.invoke_internal(Delegate.java:963)
      at org.jacorb.orb.Delegate.invoke(Delegate.java:857)
      at org.omg.CORBA.portable.ObjectImpl._invoke(ObjectImpl.java:
76)
      at
com.dnb.emf1.corba.nextgencpsservice.generated._NextGen_CPSStub.processRecords(_NextGen_CPSStub.java:
31)
      at
com.dnb.emf1.corba.util.ProcessInquires.processRecords(ProcessInquires.java:
39)
      at
com.dnb.emf1.corba.util.ProcessInquires.run(ProcessInquires.java:28)
      at com.dnb.emf1.util.WorkerThread.run(ThreadPool.java:146)
      at java.lang.Thread.run(Thread.java:595)
Time taken to process:5:2000 records is:300058
Sending a packet:48:2000:96000
#org.omg.CORBA.TIMEOUT: client timeout reached
      at
org.jacorb.orb.giop.ReplyPlaceholder.getInputStream(ReplyPlaceholder.java:
140)
      at org.jacorb.orb.ReplyReceiver.getReply(ReplyReceiver.java:
267)
      at org.jacorb.orb.Delegate.invoke_internal(Delegate.java:963)
      at org.jacorb.orb.Delegate.invoke(Delegate.java:857)
      at org.omg.CORBA.portable.ObjectImpl._invoke(ObjectImpl.java:
76)
      at
com.dnb.emf1.corba.nextgencpsservice.generated._NextGen_CPSStub.processRecords(_NextGen_CPSStub.java:
31)
      at
com.dnb.emf1.corba.util.ProcessInquires.processRecords(ProcessInquires.java:
39)
      at
com.dnb.emf1.corba.util.ProcessInquires.run(ProcessInquires.java:28)
      at com.dnb.emf1.util.WorkerThread.run(ThreadPool.java:146)
      at java.lang.Thread.run(Thread.java:595)
Time taken to process:6:2000 records is:300142
Sending a packet:49:2000:98000
#org.omg.CORBA.TIMEOUT: client timeout reached
      at
org.jacorb.orb.giop.ReplyPlaceholder.getInputStream(ReplyPlaceholder.java:
140)
      at org.jacorb.orb.ReplyReceiver.getReply(ReplyReceiver.java:
267)
      at org.jacorb.orb.Delegate.invoke_internal(Delegate.java:963)
      at org.jacorb.orb.Delegate.invoke(Delegate.java:857)
      at org.omg.CORBA.portable.ObjectImpl._invoke(ObjectImpl.java:
76)
      at
com.dnb.emf1.corba.nextgencpsservice.generated._NextGen_CPSStub.processRecords(_NextGen_CPSStub.java:
31)
      at
com.dnb.emf1.corba.util.ProcessInquires.processRecords(ProcessInquires.java:
39)
      at
com.dnb.emf1.corba.util.ProcessInquires.run(ProcessInquires.java:28)
      at com.dnb.emf1.util.WorkerThread.run(ThreadPool.java:146)
      at java.lang.Thread.run(Thread.java:595)
Time taken to process:7:2000 records is:300167
#Sending a packet:50:2000:100000
org.omg.CORBA.TIMEOUT: client timeout reached
      at
org.jacorb.orb.giop.ReplyPlaceholder.getInputStream(ReplyPlaceholder.java:
140)
      at org.jacorb.orb.ReplyReceiver.getReply(ReplyReceiver.java:
267)
      at org.jacorb.orb.Delegate.invoke_internal(Delegate.java:963)
      at org.jacorb.orb.Delegate.invoke(Delegate.java:857)
      at org.omg.CORBA.portable.ObjectImpl._invoke(ObjectImpl.java:
76)
      at
com.dnb.emf1.corba.nextgencpsservice.generated._NextGen_CPSStub.processRecords(_NextGen_CPSStub.java:
31)
      at
com.dnb.emf1.corba.util.ProcessInquires.processRecords(ProcessInquires.java:
39)
      at
com.dnb.emf1.corba.util.ProcessInquires.run(ProcessInquires.java:28)
      at com.dnb.emf1.util.WorkerThread.run(ThreadPool.java:146)
      at java.lang.Thread.run(Thread.java:595)
Time taken to process:10:2000 records is:300024
org.omg.CORBA.TIMEOUT: client timeout reached
      at
org.jacorb.orb.giop.ReplyPlaceholder.getInputStream(ReplyPlaceholder.java:
140)
      at org.jacorb.orb.ReplyReceiver.getReply(ReplyReceiver.java:
267)
      at org.jacorb.orb.Delegate.invoke_internal(Delegate.java:963)
      at org.jacorb.orb.Delegate.invoke(Delegate.java:857)
      at org.omg.CORBA.portable.ObjectImpl._invoke(ObjectImpl.java:
76)
      at
com.dnb.emf1.corba.nextgencpsservice.generated._NextGen_CPSStub.processRecords(_NextGen_CPSStub.java:
31)
      at
com.dnb.emf1.corba.util.ProcessInquires.processRecords(ProcessInquires.java:
39)
      at
com.dnb.emf1.corba.util.ProcessInquires.run(ProcessInquires.java:28)
      at com.dnb.emf1.util.WorkerThread.run(ThreadPool.java:146)
      at java.lang.Thread.run(Thread.java:595)
Time taken to process:13:2000 records is:300090
org.omg.CORBA.TIMEOUT: client timeout reached
      at
org.jacorb.orb.giop.ReplyPlaceholder.getInputStream(ReplyPlaceholder.java:
140)
      at org.jacorb.orb.ReplyReceiver.getReply(ReplyReceiver.java:
267)
      at org.jacorb.orb.Delegate.invoke_internal(Delegate.java:963)
      at org.jacorb.orb.Delegate.invoke(Delegate.java:857)
      at org.omg.CORBA.portable.ObjectImpl._invoke(ObjectImpl.java:
76)
      at
com.dnb.emf1.corba.nextgencpsservice.generated._NextGen_CPSStub.processRecords(_NextGen_CPSStub.java:
31)
      at
com.dnb.emf1.corba.util.ProcessInquires.processRecords(ProcessInquires.java:
39)
      at
com.dnb.emf1.corba.util.ProcessInquires.run(ProcessInquires.java:28)
      at com.dnb.emf1.util.WorkerThread.run(ThreadPool.java:146)
      at java.lang.Thread.run(Thread.java:595)
Time taken to process:14:2000 records is:300026
org.omg.CORBA.TIMEOUT: client timeout reached
      at
org.jacorb.orb.giop.ReplyPlaceholder.getInputStream(ReplyPlaceholder.java:
140)
      at org.jacorb.orb.ReplyReceiver.getReply(ReplyReceiver.java:
267)
      at org.jacorb.orb.Delegate.invoke_internal(Delegate.java:963)
      at org.jacorb.orb.Delegate.invoke(Delegate.java:857)
      at org.omg.CORBA.portable.ObjectImpl._invoke(ObjectImpl.java:
76)
      at
com.dnb.emf1.corba.nextgencpsservice.generated._NextGen_CPSStub.processRecords(_NextGen_CPSStub.java:
31)
      at
com.dnb.emf1.corba.util.ProcessInquires.processRecords(ProcessInquires.java:
39)
      at
com.dnb.emf1.corba.util.ProcessInquires.run(ProcessInquires.java:28)
      at com.dnb.emf1.util.WorkerThread.run(ThreadPool.java:146)
      at java.lang.Thread.run(Thread.java:595)
Time taken to process:15:2000 records is:300043
Time taken to process:40:2000 records is:53069
Time taken to process:42:2000 records is:53116
Time taken to process:41:2000 records is:53340
Time taken to process:43:2000 records is:47951
Time taken to process:45:2000 records is:48100
Time taken to process:44:2000 records is:56282
Time taken to process:48:2000 records is:63923
Time taken to process:49:2000 records is:64031
Time taken to process:50:2000 records is:66486
Time taken to process:46:2000 records is:95398
Time taken to process:47:2000 records is:95324

Thanks
Sanat.