OSB 11.1.1.7: AQ Adapter Database Connection Leak and WebLogic Thread Dump Analyzing

This problem is very crucial and really hard to find the solution. Even causes to freeze all your WebLogic OSB domain’s threads and all the OSB services would be out of service and affects as service down for 10 minutes (default stuck timeout).

Environment: WebLogic 10.3.6, OSB: 11.1.1.7

When you see errors or stuck log as below, probably it’s about AQ adapter’s outbound datasource definition. By enabling and setting additional configurations you can solve the problem as a workaround.

Analyze: I’ve got some thread dumps and solved the problem by commenting these thread dumps. Thread dump analysis is never easy, so many problem patterns.

Thread Dump (Partial) – Thread8:

"[STUCK] ExecuteThread: '8' for queue: 'weblogic.kernel.Default (self-tuning)'" id=211 idx=0x34c tid=65273 prio=1 alive, in native, daemon
at jrockit/net/SocketNativeIO.readBytesPinned(Ljava/io/FileDescriptor;[BIII)I(Native Method)
at jrockit/net/SocketNativeIO.socketRead(SocketNativeIO.java:32)
at java/net/SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I(SocketInputStream.java)
at java/net/SocketInputStream.read(SocketInputStream.java:129)
at oracle/net/nt/MetricsEnabledInputStream.read(TcpNTAdapter.java:730)
at oracle/net/ns/Packet.receive(Packet.java:302)
at oracle/net/ns/DataPacket.receive(DataPacket.java:108)
at oracle/net/ns/NetInputStream.getNextPacket(NetInputStream.java:317)
at oracle/net/ns/NetInputStream.read(NetInputStream.java:262)
at oracle/net/ns/NetInputStream.read(NetInputStream.java:187)
at oracle/net/ns/NetInputStream.read(NetInputStream.java:104)
at oracle/jdbc/driver/T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:126)
at oracle/jdbc/driver/T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:82)
at oracle/jdbc/driver/T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1178)
at oracle/jdbc/driver/T4CTTIfun.receive(T4CTTIfun.java:314)
at oracle/jdbc/driver/T4CTTIfun.doRPC(T4CTTIfun.java:205)
at oracle/jdbc/driver/T4C8Oall.doOALL(T4C8Oall.java:548)
at oracle/jdbc/driver/T4CPreparedStatement.doOall8(T4CPreparedStatement.java:217)
at oracle/jdbc/driver/T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:947)
at oracle/jdbc/driver/OracleStatement.executeMaybeDescribe(OracleStatement.java:1283)
at oracle/jdbc/driver/OracleStatement.doExecuteWithTimeout(OracleStatement.java:1441)
at oracle/jdbc/driver/OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3769)
at oracle/jdbc/driver/OraclePreparedStatement.execute(OraclePreparedStatement.java:3954)
^-- Holding lock: oracle/jdbc/driver/T4CConnection@0x22fe561e0[thin lock]
at oracle/jdbc/driver/OraclePreparedStatementWrapper.execute(OraclePreparedStatementWrapper.java:1539)
at com/iwaysoftware/iwrepository/rdbms/oracle/OracleRepository.isClosed(OracleRepository.java:103)
at com/iwaysoftware/iwrepository/rdbms/oracle/OracleRepository.getConnection(OracleRepository.java:198)
^-- Holding lock: com/iwaysoftware/iwrepository/rdbms/oracle/OracleRepository@0x22fe53c20[biased lock]
at com/iwaysoftware/iwrepository/rdbms/RDBMSQuery.handlePrepareStatement(RDBMSQuery.java:178)
at com/iwaysoftware/iwrepository/rdbms/RDBMSQuery.<init>(RDBMSQuery.java:91)
at com/iwaysoftware/iwrepository/rdbms/oracle/OracleQuery.<init>(OracleQuery.java:36)
at com/iwaysoftware/iwrepository/rdbms/oracle/OracleRepository.prepareSelect(OracleRepository.java:343)
at com/iwaysoftware/af/container/IWAFRepositoryOP.getConfigs(IWAFRepositoryOP.java:163)
at com/iwaysoftware/af/container/IWAFRepositoryStorage.listConfigurations(IWAFRepositoryStorage.java:215)
at com/iwaysoftware/af/container/AdapterManager.listConfigurations(AdapterManager.java:142)
at com/iwaysoftware/af/container/AdapterManager.checkConfig(AdapterManager.java:562)
at com/iwaysoftware/af/container/AdapterManager.getActivatedAdapter(AdapterManager.java:252)
at com/iwaysoftware/af/container/IWAFContainer.getActivatedAdapter(IWAFContainer.java:615)
at com/ibi/afjca/spi/IWAFManagedConnection.getProxyAdapter(IWAFManagedConnection.java:100)
at com/ibi/afjca/cci/IWAFConnection.<init>(IWAFConnection.java:38)
at com/ibi/afjca/spi/IWAFManagedConnection.getConnection(IWAFManagedConnection.java:141)
at weblogic/connector/security/layer/AdapterLayer.getConnection(AdapterLayer.java:664)
at weblogic/connector/outbound/ConnectionHandlerBaseImpl.createConnectionHandle(ConnectionHandlerBaseImpl.java:365)
at weblogic/connector/outbound/ConnectionInfo.createConnectionHandle(ConnectionInfo.java:431)
at weblogic/connector/outbound/ConnectionManagerImpl.getConnection(ConnectionManagerImpl.java:321)
at weblogic/connector/outbound/ConnectionManagerImpl.allocateConnection(ConnectionManagerImpl.java:129)
at com/ibi/afjca/cci/IWAFConnectionFactory.getConnection(IWAFConnectionFactory.java:114)
at oracle/tip/adapter/sa/impl/fw/wsif/jca/WSIFPort_JCA$JCAConnectionPool.createJCAConnection(WSIFPort_JCA.java:1713)
at oracle/tip/adapter/sa/impl/fw/wsif/jca/WSIFPort_JCA$JCAConnectionPool$JCAConnection.init(WSIFPort_JCA.java:1439)
at oracle/tip/adapter/sa/impl/fw/wsif/jca/WSIFPort_JCA.obtainJCAConnection(WSIFPort_JCA.java:1085)
at oracle/tip/adapter/sa/impl/fw/wsif/jca/WSIFOperation_JCA.performOperation(WSIFOperation_JCA.java:406)
at oracle/tip/adapter/sa/impl/fw/wsif/jca/WSIFOperation_JCA.executeOperation(WSIFOperation_JCA.java:369)
at oracle/tip/adapter/sa/impl/fw/wsif/jca/WSIFOperation_JCA.executeRequestResponseOperation(WSIFOperation_JCA.java:328)
at oracle/tip/adapter/sa/impl/JCABindingReferenceImpl.invokeWsifProvider(JCABindingReferenceImpl.java:352)
at oracle/tip/adapter/sa/impl/JCABindingReferenceImpl.request(JCABindingReferenceImpl.java:259)
at com/bea/wli/sb/transports/jca/binding/JCATransportOutboundOperationBindingServiceImpl.invoke(JCATransportOutboundOperationBindingServiceImpl.java:150)
at com/bea/wli/sb/transports/jca/JCATransportEndpoint.sendRequestResponse(JCATransportEndpoint.java:209)
at com/bea/wli/sb/transports/jca/JCATransportEndpoint.send(JCATransportEndpoint.java:170)
at com/bea/wli/sb/transports/jca/JCATransportProvider.sendMessageAsync(JCATransportProvider.java:585)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
at jrockit/vm/Reflect.invokeMethod(Ljava/lang/Object;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
at sun/reflect/NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
at sun/reflect/NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)[optimized]
at java/lang/reflect/Method.invoke(Method.java:597)[optimized]
at com/bea/wli/sb/transports/Util$1.invoke(Util.java:83)
at com/sun/proxy/$Proxy136.sendMessageAsync(Lcom/bea/wli/sb/transports/TransportSender;Lcom/bea/wli/sb/transports/TransportSendListener;Lcom/bea/wli/sb/transports/TransportOptions;)V(Unknown Source)
at com/bea/wli/sb/transports/LoadBalanceFailoverListener.sendMessageAsync(LoadBalanceFailoverListener.java:148)
at com/bea/wli/sb/transports/LoadBalanceFailoverListener.sendMessageToServiceAsync(LoadBalanceFailoverListener.java:510)
at com/bea/wli/sb/transports/LoadBalanceFailoverListener.sendMessageToService(LoadBalanceFailoverListener.java:445)
at com/bea/wli/sb/transports/TransportManagerImpl.sendMessageToService(TransportManagerImpl.java:582)
at com/bea/wli/sb/transports/TransportManagerImpl.sendMessageAsync(TransportManagerImpl.java:449)
at com/bea/wli/sb/pipeline/PipelineContextImpl.doDispatch(PipelineContextImpl.java:691)
at com/bea/wli/sb/pipeline/PipelineContextImpl.dispatch(PipelineContextImpl.java:594)
at stages/routing/runtime/RouteRuntimeStep.processMessage(RouteRuntimeStep.java:128)
at com/bea/wli/sb/stages/StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:346)
at com/bea/wli/sb/pipeline/RouteNode.doRequest(RouteNode.java:106)
at com/bea/wli/sb/pipeline/Node.processMessage(Node.java:67)
at com/bea/wli/sb/pipeline/PipelineContextImpl.execute(PipelineContextImpl.java:1095)
at com/bea/wli/sb/pipeline/Router.processMessage(Router.java:214)
at com/bea/wli/sb/pipeline/MessageProcessor.processRequest(MessageProcessor.java:101)
at com/bea/wli/sb/pipeline/RouterManager$1.run(RouterManager.java:597)
at com/bea/wli/sb/pipeline/RouterManager$1.run(RouterManager.java:595)
at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)[inlined]
at weblogic/security/service/SecurityManager.runAs(SecurityManager.java:146)[optimized]
at com/bea/wli/sb/security/WLSSecurityContextService.runAs(WLSSecurityContextService.java:55)
at com/bea/wli/sb/pipeline/RouterManager.processMessage(RouterManager.java:594)
at com/bea/wli/sb/transports/TransportManagerImpl.receiveMessage(TransportManagerImpl.java:398)
at com/bea/wli/sb/transports/CoLocatedMessageContext$1.run(CoLocatedMessageContext.java:163)
at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)[inlined]
at weblogic/security/service/SecurityManager.runAs(SecurityManager.java:146)[optimized]
at weblogic/security/Security.runAs(Security.java:61)
at com/bea/wli/sb/util/security/SecurityUtils.runAs(SecurityUtils.java:58)
at com/bea/wli/sb/transports/CoLocatedMessageContext.send(CoLocatedMessageContext.java:158)
at com/bea/wli/sb/transports/http/wls/HttpTransportProvider.sendMessageAsync(HttpTransportProvider.java:215)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
at jrockit/vm/Reflect.invokeMethod(Ljava/lang/Object;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
at sun/reflect/NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
at sun/reflect/NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)[optimized]
at java/lang/reflect/Method.invoke(Method.java:597)[optimized]
at com/bea/wli/sb/transports/Util$1.invoke(Util.java:83)
at com/sun/proxy/$Proxy121.sendMessageAsync(Lcom/bea/wli/sb/transports/TransportSender;Lcom/bea/wli/sb/transports/TransportSendListener;Lcom/bea/wli/sb/transports/TransportOptions;)V(Unknown Source)
at com/bea/wli/sb/transports/LoadBalanceFailoverListener.sendMessageAsync(LoadBalanceFailoverListener.java:148)
at com/bea/wli/sb/transports/LoadBalanceFailoverListener.sendMessageToServiceAsync(LoadBalanceFailoverListener.java:510)
at com/bea/wli/sb/transports/LoadBalanceFailoverListener.sendMessageToService(LoadBalanceFailoverListener.java:445)
at com/bea/wli/sb/transports/TransportManagerImpl.sendMessageToService(TransportManagerImpl.java:582)
at com/bea/wli/sb/transports/TransportManagerImpl.sendMessageAsync(TransportManagerImpl.java:449)
at com/bea/wli/sb/pipeline/PipelineContextImpl.doDispatch(PipelineContextImpl.java:691)
at com/bea/wli/sb/pipeline/PipelineContextImpl.dispatchSync(PipelineContextImpl.java:560)
at stages/transform/runtime/WsCalloutRuntimeStep$WsCalloutDispatcher.dispatch(WsCalloutRuntimeStep.java:1391)
at stages/transform/runtime/WsCalloutRuntimeStep.processMessage(WsCalloutRuntimeStep.java:236)
at com/bea/wli/sb/stages/StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:346)
at com/bea/wli/sb/pipeline/PipelineStage.processMessage(PipelineStage.java:84)
at com/bea/wli/sb/pipeline/PipelineContextImpl.execute(PipelineContextImpl.java:1095)
at com/bea/wli/sb/pipeline/Pipeline.processMessage(Pipeline.java:141)
at com/bea/wli/sb/pipeline/PipelineContextImpl.execute(PipelineContextImpl.java:1095)
at com/bea/wli/sb/pipeline/PipelineNode.doRequest(PipelineNode.java:55)
at com/bea/wli/sb/pipeline/Node.processMessage(Node.java:67)
at com/bea/wli/sb/pipeline/PipelineContextImpl.execute(PipelineContextImpl.java:1095)
at com/bea/wli/sb/pipeline/Router.processMessage(Router.java:214)
at com/bea/wli/sb/pipeline/MessageProcessor.processRequest(MessageProcessor.java:101)
at com/bea/wli/sb/pipeline/RouterManager$1.run(RouterManager.java:597)
at com/bea/wli/sb/pipeline/RouterManager$1.run(RouterManager.java:595)
at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)[inlined]
at weblogic/security/service/SecurityManager.runAs(SecurityManager.java:146)[optimized]
at com/bea/wli/sb/security/WLSSecurityContextService.runAs(WLSSecurityContextService.java:55)
at com/bea/wli/sb/pipeline/RouterManager.processMessage(RouterManager.java:594)
at com/bea/wli/sb/transports/TransportManagerImpl.receiveMessage(TransportManagerImpl.java:398)
at com/bea/wli/sb/transports/http/generic/RequestHelperBase.invokePipeline(RequestHelperBase.java:185)
at com/bea/wli/sb/transports/http/wls/HttpTransportServlet$RequestHelperWLS.invokePipeline(HttpTransportServlet.java:228)
at com/bea/wli/sb/transports/http/generic/RequestHelperBase$1.run(RequestHelperBase.java:160)
at com/bea/wli/sb/transports/http/generic/RequestHelperBase$1.run(RequestHelperBase.java:158)
at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)[inlined]
at weblogic/security/service/SecurityManager.runAs(SecurityManager.java:146)[optimized]
at com/bea/wli/sb/transports/http/generic/RequestHelperBase.securedInvoke(RequestHelperBase.java:157)
at com/bea/wli/sb/transports/http/generic/RequestHelperBase.service(RequestHelperBase.java:105)
at com/bea/wli/sb/transports/http/wls/HttpTransportServlet.service(HttpTransportServlet.java:129)
at weblogic/servlet/FutureResponseServlet.service(FutureResponseServlet.java:24)
at javax/servlet/http/HttpServlet.service(HttpServlet.java:820)
at weblogic/servlet/internal/StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
at weblogic/servlet/internal/StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
at weblogic/servlet/internal/ServletStubImpl.execute(ServletStubImpl.java:301)
at weblogic/servlet/internal/ServletStubImpl.execute(ServletStubImpl.java:184)
at weblogic/servlet/internal/WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3732)
at weblogic/servlet/internal/WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3696)
at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
at weblogic/security/service/SecurityManager.runAs(SecurityManager.java:120)
at weblogic/servlet/internal/WebAppServletContext.securedExecute(WebAppServletContext.java:2273)
at weblogic/servlet/internal/WebAppServletContext.execute(WebAppServletContext.java:2179)
at weblogic/servlet/internal/ServletRequestImpl.run(ServletRequestImpl.java:1490)
at weblogic/work/ExecuteThread.execute(ExecuteThread.java:256)[optimized]
at weblogic/work/ExecuteThread.run(ExecuteThread.java:221)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace

"weblogic.cluster.MessageReceiver" id=212 idx=0x350 tid=65274 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: java/util/ArrayList@0x21a907020[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at weblogic/cluster/messaging/internal/server/UnicastFragmentSocket.receive(UnicastFragmentSocket.java:105)
^-- Lock released while waiting: java/util/ArrayList@0x21a907020[fat lock]
at weblogic/cluster/FragmentSocketWrapper.receive(FragmentSocketWrapper.java:98)
at weblogic/cluster/MulticastManager.run(MulticastManager.java:466)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace

"pool-12-thread-1" id=213 idx=0x354 tid=65285 prio=5 alive, parked, native_blocked
-- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0x235e9f420
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace

"pool-12-thread-2" id=214 idx=0x358 tid=65286 prio=5 alive, parked, native_blocked
-- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0x235e9f420
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace

"pool-12-thread-3" id=215 idx=0x35c tid=65287 prio=5 alive, parked, native_blocked
-- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0x235e9f420
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace

"pool-12-thread-4" id=216 idx=0x360 tid=65288 prio=5 alive, parked, native_blocked
-- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0x235e9f420
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace

&nbsp;

Connection Leak Detection:

When you see a screen like below from WebLogic Dashboard, it is obvious that you have connection leak problem.

Thread Dump Analyze:

Actually in this case the Thread Dump and this particular STUCK thread stack trace is telling most of the story. Thread #8 is attempting to do the following:

• OSB is called to execute a business function.
• At some point OSB delegate the execution of particular business service to the IWAY adapter which appears to be Siebel or SAP e.g. OSB >> Siebel/SAP via the Iway JCA adapter.
• OSB & Iway adapter is now attempting to create a new Connection…com.ibi.afjca.spi.IWAFManagedConnection.getConnection(IWAFManagedConnection.java:127)
• At this point, the Iway adapter is attempting to pull the configuration/meta details, from the Oracle DB repository …com.iwaysoftware.af.container.AdapterManager.listConfigurations(AdapterManager.java:142)
• com.iwaysoftware.iwrepository.rdbms.oracle.OracleRepository.prepareSelect(OracleRepository.java:343)
• The IWay adapter is now attempting to get a new JDBC Connection in order to execute the PreparedStatement (DB repository lookup) com.iwaysoftware.iwrepository.rdbms.oracle.OracleRepository.getConnection()
• Internally, the Iway adapter is now checking if the JDBC Connection is already closed or not…com.iwaysoftware.iwrepository.rdbms.oracle.OracleRepository.isClosed(OracleRepository.java:102)
• In order to do so (connection testing), The IWAY adapter now attempts to execute another PreparedStatement…oracle.jdbc.driver.OraclePreparedStatementWrapper.execute
• Such PreparedStatement ends up hanging since we can see Thread waiting forever in the Socket.read() operation (waiting for Oracle DB to write response back to the SocketOutputstream).

So what this is telling us is that the culprit appears to be inside the Iway adapter healthcheck of the JDBC Connection itself e.g. when it is trying to determine if the current Connection is closed or not. This can normally occur if:

• The Oracle database (Adapter / config repository) and this particular SQL is taking way too much time to respond.
• You are dealing with a stale JDBC Connection or already closed which is causing the SQL to hang forever since Oracle will never write any response back to this connection. I have seen very often faulty JDBC Connection healthcheck that ends up handing forever like this; especially when trying to execute a PreparedStatement directly from a STALE connection.

My recommendations:

• Ask Oracle to identify this particularely isClosed() SQL that the IWay adapter is sending to your Oracle databse. Ask your DBA to investigate if this SQL is taking too much time under certain conditions. They can easily prove this by generating and analyzing an AWR Report.
• Check if this Oracle DB repository is configured via a JDBC Connection pool inside OSB or not. Tuning the JDBC datasource may help prevent Stale connection.
• In addition, investigate with Oracle and the IWay adapter if we can configure a SQL/query timeout for this isClosed() healthcheck. That would prevent Threads getting stuck forever.

My Solution:

1) Firstly, set “inactive connection timeout” value between 60 sec and 300 sec (I’ve set 300) for AQ-Adapter datasource.

By enabling this setting you are going to see below errors, in the log file.

[WARNING] [BEA-001153] [JDBC] [host: ######] [nwaddr: ####] [tid: [ACTIVE].ExecuteThread: '15' for queue: 'weblogic.kernel.Defau 
lt (self-tuning)'] [userId: <WLS Kernel>] [ecid: a80fff9a887b4f5b:-36b8841b:14029148274:-7ffd-000000000000376c,0] [LOG_FILE: /OSB-PROD/OSB-SRV1.log] Forcibly 
releasing inactive/harvested connection "[weblogic.jdbc.wrapper.JTAConnection_weblogic_jdbc_wrapper_XAConnection_oracle_jdbc_driver_LogicalConnection-MWConsumerAQs-MultiDS-2, oracle.jdbc.driv 
er.LogicalConnection@22e3de05]" back into the data source connection pool "MWConsumerAQs-DS01", currently reserved by: java.lang.Exception[[ 
at weblogic.jdbc.common.internal.ConnectionEnv.setup(ConnectionEnv.java:356) 
at weblogic.common.resourcepool.ResourcePoolImpl.reserveResource(ResourcePoolImpl.java:364) 
at weblogic.common.resourcepool.ResourcePoolImpl.reserveResource(ResourcePoolImpl.java:330)

2) Change below default values for AQ-Adapter datasource.

• JCA Shrink Frequency
• Datasource Shrink Frequency
• Datasource Inactive Connection Timeout

Important: if you have set the “initial connection” to “0” on the jca adapter pool and the shrinking frequencies respect the following:

• jca shrinking < datasource shrinking < Inactive timeout

then the forcibly error should not occur.

My preferred values are,

• JCA Shrink Frequency Seconds: 180 << Datasource Shrink Frequency: 240 <<Datasource Inactive Connection Timeout: 300
• JCA DS Path –>  “Deployments -> AQ Adapter -> Configuration -> Outbound Connections Pools -> eis/aq/consumers -> Connection pool”

There are no optimal values for the settings; they really depend on traffic on your system and the time it takes to create a connection. The idea is to have a compromise between saving time in connection creation (having connections quickly available) and not keeping too many connections open when not needed.

The default values are 900 seconds for both the frequencies and Inactive not set. They usually work with normal traffic. If you want to set the Inactive Connection Timeout you also need to change the value for at least one of the frequencies so that we respect the constraint “JCA Shrinking < Datasource Shrinking < Inactive timeout”

If you have frequent high peaks of requests and slow opening connections (and if you can have a few connections open to DB without impacting any other application) you can also disable shrinking.

The problem has been solved and reported to Oracle Support. 
End of Post

M.Fevzi Korkutata | fevzi .korkutata @ admineer.com

 

---

Further Error Logs:

WLDF Diagnostic Incident Log:

Incident Id: 9
Incident Source: SYSTEM
Create Time: 
Problem Key: BEA-000337 [WebLogicServer]
ECID: a80fff9a887b4f5b:-3f7de2e:1401b797525:-8000-00000000000065d3
User Name: <WLS Kernel>
Error Message Id: BEA-000337

Context Values
--------------
dbRID : 0:1
DFW_SERVER_NAME : 
DFW_DOMAIN_NAME : 
DFW_USER_NAME : <WLS Kernel>

Description
-----------
Incident detected using watch rule "StuckThread":
Watch time: 
Watch ServerName: OSB-PROD-S01-5511
Watch RuleType: Log
Watch Rule: (SEVERITY = 'Error') AND ((MSGID = 'WL-000337') OR (MSGID = 'BEA-000337'))
Watch DomainName: OSB-PROD-DMN
Watch Data:
DATE : 
SERVER : 
MESSAGE : [STUCK] ExecuteThread: '8' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "657" seconds working on the request "Workmanager: WM_AirTransport_LV, Version: 0, Scheduled=true, Started=true, Started time: 657391 ms
[
POST /Inbound/XXX/XXX HTTP/1.1
TE: trailers, deflate, gzip, compress
User-Agent: Oracle HTTPClient Version 10h
SOAPAction: "http://XXXXXXX/SOA/wsdl/#######"
Accept-Encoding: gzip, x-gzip, compress, x-compress
ECID-Context: 1.8c56bf0503743707:-4c5047d4:1401abf385f:-8000-000000000005d0be;k^pgv0ZGZKSULGSPXKTPJHSRo4USpLPWn5MK9PRB9UQOjLUR^VAGm2HI1PQSKITOiJSSjISTj2HOnLOJjVRQpGULXSPQ^HOTdVQR
Content-type: text/xml; charset=UTF-8
Content-Length: 7779
Connection: Keep-Alive
X-Forwarded-For: 
Proxy-Client-IP: 
X-WebLogic-KeepAliveSecs: 30
X-WebLogic-Force-JVMID: -332482766

]", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
Thread-211 "[STUCK] ExecuteThread: '8' for queue: 'weblogic.kernel.Default (self-tuning)'" <alive, in native, suspended, priority=1, DAEMON> {
jrockit.net.SocketNativeIO.readBytesPinned(SocketNativeIO.java:???)
jrockit.net.SocketNativeIO.socketRead(SocketNativeIO.java:24)
java.net.SocketInputStream.socketRead0(SocketInputStream.java:???)
java.net.SocketInputStream.read(SocketInputStream.java:107)
oracle.net.nt.MetricsEnabledInputStream.read(TcpNTAdapter.java:719)
oracle.net.ns.Packet.receive(Packet.java:243)
oracle.net.ns.DataPacket.receive(DataPacket.java:108)
oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:309)
oracle.net.ns.NetInputStream.read(NetInputStream.java:254)
oracle.net.ns.NetInputStream.read(NetInputStream.java:187)
oracle.net.ns.NetInputStream.read(NetInputStream.java:92)
oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:122)
oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:77)
oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1173)
oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:305)
oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:182)
oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:384)
oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:70)
oracle.jdbc.driver.T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:934)
oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1248)
oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1352)
oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3737)
oracle.jdbc.driver.OraclePreparedStatement.execute(OraclePreparedStatement.java:3938)
^-- Holding lock: oracle.jdbc.driver.T4CConnection@29c4f837[thin lock]
oracle.jdbc.driver.OraclePreparedStatementWrapper.execute(OraclePreparedStatementWrapper.java:1539)
com.iwaysoftware.iwrepository.rdbms.oracle.OracleRepository.isClosed(OracleRepository.java:102)
com.iwaysoftware.iwrepository.rdbms.oracle.OracleRepository.getConnection(OracleRepository.java:198)
^-- Holding lock: com.iwaysoftware.iwrepository.rdbms.oracle.OracleRepository@45fca784[thin lock]
com.iwaysoftware.iwrepository.rdbms.RDBMSQuery.handlePrepareStatement(RDBMSQuery.java:176)
com.iwaysoftware.iwrepository.rdbms.RDBMSQuery.<init>(RDBMSQuery.java:73)
com.iwaysoftware.iwrepository.rdbms.oracle.OracleQuery.<init>(OracleQuery.java:36)
com.iwaysoftware.iwrepository.rdbms.oracle.OracleRepository.prepareSelect(OracleRepository.java:343)
com.iwaysoftware.af.container.IWAFRepositoryOP.getConfigs(IWAFRepositoryOP.java:156)
com.iwaysoftware.af.container.IWAFRepositoryStorage.listConfigurations(IWAFRepositoryStorage.java:213)
com.iwaysoftware.af.container.AdapterManager.listConfigurations(AdapterManager.java:142)
com.iwaysoftware.af.container.AdapterManager.checkConfig(AdapterManager.java:559)
com.iwaysoftware.af.container.AdapterManager.getActivatedAdapter(AdapterManager.java:251)
com.iwaysoftware.af.container.IWAFContainer.getActivatedAdapter(IWAFContainer.java:615)
com.ibi.afjca.spi.IWAFManagedConnection.getProxyAdapter(IWAFManagedConnection.java:91)
com.ibi.afjca.cci.IWAFConnection.<init>(IWAFConnection.java:32)
com.ibi.afjca.spi.IWAFManagedConnection.getConnection(IWAFManagedConnection.java:127)
weblogic.connector.security.layer.AdapterLayer.getConnection(AdapterLayer.java:661)
weblogic.connector.outbound.ConnectionHandlerBaseImpl.createConnectionHandle(ConnectionHandlerBaseImpl.java:361)
weblogic.connector.outbound.ConnectionInfo.createConnectionHandle(ConnectionInfo.java:431)
weblogic.connector.outbound.ConnectionManagerImpl.getConnection(ConnectionManagerImpl.java:307)
weblogic.connector.outbound.ConnectionManagerImpl.allocateConnection(ConnectionManagerImpl.java:109)
com.ibi.afjca.cci.IWAFConnectionFactory.getConnection(IWAFConnectionFactory.java:107)
oracle.tip.adapter.sa.impl.fw.wsif.jca.WSIFPort_JCA$JCAConnectionPool.createJCAConnection(WSIFPort_JCA.java:1707)
oracle.tip.adapter.sa.impl.fw.wsif.jca.WSIFPort_JCA$JCAConnectionPool$JCAConnection.init(WSIFPort_JCA.java:1436)
oracle.tip.adapter.sa.impl.fw.wsif.jca.WSIFPort_JCA.obtainJCAConnection(WSIFPort_JCA.java:1049)
oracle.tip.adapter.sa.impl.fw.wsif.jca.WSIFOperation_JCA.performOperation(WSIFOperation_JCA.java:386)
oracle.tip.adapter.sa.impl.fw.wsif.jca.WSIFOperation_JCA.executeOperation(WSIFOperation_JCA.java:339)
oracle.tip.adapter.sa.impl.fw.wsif.jca.WSIFOperation_JCA.executeRequestResponseOperation(WSIFOperation_JCA.java:328)
oracle.tip.adapter.sa.impl.JCABindingReferenceImpl.invokeWsifProvider(JCABindingReferenceImpl.java:274)
oracle.tip.adapter.sa.impl.JCABindingReferenceImpl.request(JCABindingReferenceImpl.java:257)
com.bea.wli.sb.transports.jca.binding.JCATransportOutboundOperationBindingServiceImpl.invoke(JCATransportOutboundOperationBindingServiceImpl.java:126)
com.bea.wli.sb.transports.jca.JCATransportEndpoint.sendRequestResponse(JCATransportEndpoint.java:204)
com.bea.wli.sb.transports.jca.JCATransportEndpoint.send(JCATransportEndpoint.java:141)
com.bea.wli.sb.transports.jca.JCATransportProvider.sendMessageAsync(JCATransportProvider.java:568)
sun.reflect.NativeMethodAccessorImpl.invoke0(NativeMethodAccessorImpl.java:???)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:27)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
java.lang.reflect.Method.invoke(Method.java:575)
com.bea.wli.sb.transports.Util$1.invoke(Util.java:57)
com.sun.proxy.$Proxy136.sendMessageAsync(Unknown Source)
com.bea.wli.sb.transports.LoadBalanceFailoverListener.sendMessageAsync(LoadBalanceFailoverListener.java:135)
com.bea.wli.sb.transports.LoadBalanceFailoverListener.sendMessageToServiceAsync(LoadBalanceFailoverListener.java:477)
com.bea.wli.sb.transports.LoadBalanceFailoverListener.sendMessageToService(LoadBalanceFailoverListener.java:444)
com.bea.wli.sb.transports.TransportManagerImpl.sendMessageToService(TransportManagerImpl.java:528)
com.bea.wli.sb.transports.TransportManagerImpl.sendMessageAsync(TransportManagerImpl.java:432)
com.bea.wli.sb.pipeline.PipelineContextImpl.doDispatch(PipelineContextImpl.java:604)
com.bea.wli.sb.pipeline.PipelineContextImpl.dispatch(PipelineContextImpl.java:581)
stages.routing.runtime.RouteRuntimeStep.processMessage(RouteRuntimeStep.java:83)
com.bea.wli.sb.stages.StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:343)
com.bea.wli.sb.pipeline.RouteNode.doRequest(RouteNode.java:106)
com.bea.wli.sb.pipeline.Node.processMessage(Node.java:65)
com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:1062)
com.bea.wli.sb.pipeline.Router.processMessage(Router.java:196)
com.bea.wli.sb.pipeline.MessageProcessor.processRequest(MessageProcessor.java:36)
com.bea.wli.sb.pipeline.RouterManager$1.run(RouterManager.java:597)
com.bea.wli.sb.pipeline.RouterManager$1.run(RouterManager.java:595)
weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:350)
weblogic.security.service.SecurityManager.runAs(SecurityManager.java:142)
com.bea.wli.sb.security.WLSSecurityContextService.runAs(WLSSecurityContextService.java:55)
com.bea.wli.sb.pipeline.RouterManager.processMessage(RouterManager.java:576)
com.bea.wli.sb.transports.TransportManagerImpl.receiveMessage(TransportManagerImpl.java:270)
com.bea.wli.sb.transports.CoLocatedMessageContext$1.run(CoLocatedMessageContext.java:163)
weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:350)
weblogic.security.service.SecurityManager.runAs(SecurityManager.java:142)
weblogic.security.Security.runAs(Security.java:60)
com.bea.wli.sb.util.security.SecurityUtils.runAs(SecurityUtils.java:58)
com.bea.wli.sb.transports.CoLocatedMessageContext.send(CoLocatedMessageContext.java:124)
com.bea.wli.sb.transports.http.wls.HttpTransportProvider.sendMessageAsync(HttpTransportProvider.java:203)
sun.reflect.NativeMethodAccessorImpl.invoke0(NativeMethodAccessorImpl.java:???)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:27)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
java.lang.reflect.Method.invoke(Method.java:575)
com.bea.wli.sb.transports.Util$1.invoke(Util.java:57)
com.sun.proxy.$Proxy121.sendMessageAsync(Unknown Source)
com.bea.wli.sb.transports.LoadBalanceFailoverListener.sendMessageAsync(LoadBalanceFailoverListener.java:135)
com.bea.wli.sb.transports.LoadBalanceFailoverListener.sendMessageToServiceAsync(LoadBalanceFailoverListener.java:477)
com.bea.wli.sb.transports.LoadBalanceFailoverListener.sendMessageToService(LoadBalanceFailoverListener.java:444)
com.bea.wli.sb.transports.TransportManagerImpl.sendMessageToService(TransportManagerImpl.java:528)
com.bea.wli.sb.transports.TransportManagerImpl.sendMessageAsync(TransportManagerImpl.java:432)
com.bea.wli.sb.pipeline.PipelineContextImpl.doDispatch(PipelineContextImpl.java:604)
com.bea.wli.sb.pipeline.PipelineContextImpl.dispatchSync(PipelineContextImpl.java:534)
stages.transform.runtime.WsCalloutRuntimeStep$WsCalloutDispatcher.dispatch(WsCalloutRuntimeStep.java:1385)
stages.transform.runtime.WsCalloutRuntimeStep.processMessage(WsCalloutRuntimeStep.java:159)
com.bea.wli.sb.stages.StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:343)
com.bea.wli.sb.pipeline.PipelineStage.processMessage(PipelineStage.java:84)
com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:1062)
com.bea.wli.sb.pipeline.Pipeline.processMessage(Pipeline.java:140)
com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:1062)
com.bea.wli.sb.pipeline.PipelineNode.doRequest(PipelineNode.java:51)
com.bea.wli.sb.pipeline.Node.processMessage(Node.java:65)
com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:1062)
com.bea.wli.sb.pipeline.Router.processMessage(Router.java:196)
com.bea.wli.sb.pipeline.MessageProcessor.processRequest(MessageProcessor.java:36)
com.bea.wli.sb.pipeline.RouterManager$1.run(RouterManager.java:597)
com.bea.wli.sb.pipeline.RouterManager$1.run(RouterManager.java:595)
weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:350)
weblogic.security.service.SecurityManager.runAs(SecurityManager.java:142)
com.bea.wli.sb.security.WLSSecurityContextService.runAs(WLSSecurityContextService.java:55)
com.bea.wli.sb.pipeline.RouterManager.processMessage(RouterManager.java:576)
com.bea.wli.sb.transports.TransportManagerImpl.receiveMessage(TransportManagerImpl.java:270)
com.bea.wli.sb.transports.http.generic.RequestHelperBase.invokePipeline(RequestHelperBase.java:185)
com.bea.wli.sb.transports.http.wls.HttpTransportServlet$RequestHelperWLS.invokePipeline(HttpTransportServlet.java:214)
com.bea.wli.sb.transports.http.generic.RequestHelperBase$1.run(RequestHelperBase.java:160)
com.bea.wli.sb.transports.http.generic.RequestHelperBase$1.run(RequestHelperBase.java:158)
weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:350)
weblogic.security.service.SecurityManager.runAs(SecurityManager.java:142)
com.bea.wli.sb.transports.http.generic.RequestHelperBase.securedInvoke(RequestHelperBase.java:152)
com.bea.wli.sb.transports.http.generic.RequestHelperBase.service(RequestHelperBase.java:69)
com.bea.wli.sb.transports.http.wls.HttpTransportServlet.service(HttpTransportServlet.java:108)
weblogic.servlet.FutureResponseServlet.service(FutureResponseServlet.java:24)
javax.servlet.http.HttpServlet.service(HttpServlet.java:815)
weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:224)
weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:108)
weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:207)
weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:184)
weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3702)
weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3696)
weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:308)
weblogic.security.service.SecurityManager.runAs(SecurityManager.java:116)
weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2209)
weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2131)
weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1457)
weblogic.work.ExecuteThread.execute(ExecuteThread.java:250)
weblogic.work.ExecuteThread.run(ExecuteThread.java:213)
}

SUBSYSTEM : WebLogicServer
USERID : <WLS Kernel>
SEVERITY : Error
THREAD : [ACTIVE] ExecuteThread: '5' for queue: 'weblogic.kernel.Default (self-tuning)'
MSGID : BEA-000337
MACHINE : zerprodosb01
TXID : 
CONTEXTID : a80fff9a887b4f5b:-3f7de2e:1401b797525:-8000-000000000000671d
TIMESTAMP : 1374876786301

Diagnostic Dumps
----------------

Name: jvm.threads
Dump Arguments: context=true, timing=true
Dump Files: jvm_threads3_i9.txt

Name: dms.metrics
Dump Arguments: dump=LocalDMS
Dump Files: dms_metrics4_i9.txt

Name: dfw.samplingArchive
Dump Files: dfw_samplingArchive6_i9.readme.txt

Name: odl.logs
Dump Arguments: ecid=a80fff9a887b4f5b:-3f7de2e:1401b797525:-8000-00000000000065d3, match_all=false, timestamp=1374876786336
Dump Files: odl_logs7_i9.txt

Name: jvm.flightRecording
Dump Files: jvm_flightRecording8_i9.jfr

 

 ===== FULL THREAD DUMP ===============

 

Oracle JRockit(R) R28.2.7-7-155314-1.6.0_45-20130329-0641-linux-x86_64

“Main Thread” id=1 idx=0x4 tid=64818 prio=5 alive, waiting, native_blocked
— Waiting for notification on: weblogic/t3/srvr/T3Srvr@0x2228afb30[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at weblogic/t3/srvr/T3Srvr.waitForDeath(T3Srvr.java:981)
^– Lock released while waiting: weblogic/t3/srvr/T3Srvr@0x2228afb30[fat lock]
at weblogic/t3/srvr/T3Srvr.run(T3Srvr.java:490)
at weblogic/Server.main(Server.java:71)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“(Signal Handler)” id=2 idx=0x8 tid=64819 prio=5 alive, native_blocked, daemon

“(OC Main Thread)” id=3 idx=0xc tid=64820 prio=5 alive, native_waiting, daemon

“(GC Worker Thread 1)” id=? idx=0x10 tid=64821 prio=5 alive, daemon

“(GC Worker Thread 2)” id=? idx=0x14 tid=64822 prio=5 alive, daemon

“(GC Worker Thread 3)” id=? idx=0x18 tid=64823 prio=5 alive, daemon

“(GC Worker Thread 4)” id=? idx=0x1c tid=64824 prio=5 alive, daemon

“(GC Worker Thread 5)” id=? idx=0x20 tid=64825 prio=5 alive, daemon

“(GC Worker Thread 6)” id=? idx=0x24 tid=64826 prio=5 alive, daemon

“(GC Worker Thread 7)” id=? idx=0x28 tid=64827 prio=5 alive, daemon

“(GC Worker Thread 8)” id=? idx=0x2c tid=64828 prio=5 alive, daemon

“(GC Worker Thread 9)” id=? idx=0x30 tid=64829 prio=5 alive, daemon

“(GC Worker Thread 10)” id=? idx=0x34 tid=64830 prio=5 alive, daemon

“(Code Generation Thread 1)” id=4 idx=0x38 tid=64831 prio=5 alive, native_waiting, daemon

“(Code Optimization Thread 1)” id=5 idx=0x3c tid=64832 prio=5 alive, native_waiting, daemon

“(VM Periodic Task)” id=6 idx=0x40 tid=64833 prio=10 alive, in native, daemon

“Finalizer” id=7 idx=0x44 tid=64834 prio=8 alive, native_waiting, daemon
at jrockit/memory/Finalizer.waitForFinalizees(J[Ljava/lang/Object;)I(Native Method)
at jrockit/memory/Finalizer.access$700(Finalizer.java:12)
at jrockit/memory/Finalizer$4.run(Finalizer.java:201)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“Reference Handler” id=8 idx=0x48 tid=64835 prio=10 alive, native_waiting, daemon
at java/lang/ref/Reference.waitForActivatedQueue(J)Ljava/lang/ref/Reference;(Native Method)
at java/lang/ref/Reference.access$100(Reference.java:11)
at java/lang/ref/Reference$ReferenceHandler.run(Reference.java:82)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“(Sensor Event Thread)” id=9 idx=0x4c tid=64836 prio=5 alive, native_blocked, daemon

“VM JFR Buffer Thread” id=10 idx=0x50 tid=64837 prio=5 alive, in native, daemon

“Timer-0” id=13 idx=0x54 tid=64838 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: java/util/TaskQueue@0x22286ddb0[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at java/util/TimerThread.mainLoop(Timer.java:483)
^– Lock released while waiting: java/util/TaskQueue@0x22286ddb0[fat lock]
at java/util/TimerThread.run(Timer.java:462)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“Timer-1” id=14 idx=0x58 tid=64840 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: java/util/TaskQueue@0x22286de38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/util/TimerThread.mainLoop(Timer.java:509)
^– Lock released while waiting: java/util/TaskQueue@0x22286de38[fat lock]
at java/util/TimerThread.run(Timer.java:462)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“[ACTIVE] ExecuteThread: ‘0’ for queue: ‘weblogic.kernel.Default (self-tuning)'” id=15 idx=0x5c tid=64841 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: weblogic/work/ExecuteThread@0x22286f038[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at weblogic/work/ExecuteThread.waitForRequest(ExecuteThread.java:205)
^– Lock released while waiting: weblogic/work/ExecuteThread@0x22286f038[fat lock]
at weblogic/work/ExecuteThread.run(ExecuteThread.java:226)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“JFR request timer” id=16 idx=0x60 tid=64842 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: java/util/TaskQueue@0x22286dec0[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at java/util/TimerThread.mainLoop(Timer.java:483)
^– Lock released while waiting: java/util/TaskQueue@0x22286dec0[fat lock]
at java/util/TimerThread.run(Timer.java:462)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“weblogic.time.TimeEventGenerator” id=18 idx=0x64 tid=64846 prio=9 alive, waiting, native_blocked, daemon
— Waiting for notification on: weblogic/time/common/internal/TimeTable@0x22280d5c8[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at weblogic/time/common/internal/TimeTable.snooze(TimeTable.java:286)
^– Lock released while waiting: weblogic/time/common/internal/TimeTable@0x22280d5c8[fat lock]
at weblogic/time/common/internal/TimeEventGenerator.run(TimeEventGenerator.java:117)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“JMAPI event thread” id=19 idx=0x68 tid=64847 prio=5 alive, in native, daemon

“weblogic.timers.TimerThread” id=20 idx=0x6c tid=64848 prio=9 alive, waiting, native_blocked, daemon
— Waiting for notification on: weblogic/timers/internal/TimerThread@0x22286dfe8[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at weblogic/timers/internal/TimerThread$Thread.run(TimerThread.java:262)
^– Lock released while waiting: weblogic/timers/internal/TimerThread@0x22286dfe8[fat lock]
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“[ACTIVE] ExecuteThread: ‘1’ for queue: ‘weblogic.kernel.Default (self-tuning)'” id=21 idx=0x70 tid=64849 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: oracle/tip/adapter/file/inbound/FilesToProcess@0x235e8e0c0[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at oracle/tip/adapter/file/inbound/FilesToProcess.dequeueToProcess(FilesToProcess.java:102)
^– Lock released while waiting: oracle/tip/adapter/file/inbound/FilesToProcess@0x235e8e0c0[fat lock]
at oracle/tip/adapter/file/inbound/ProcessWork.run(ProcessWork.java:269)
at weblogic/work/ContextWrap.run(ContextWrap.java:41)
at weblogic/work/SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:545)
at weblogic/work/ExecuteThread.execute(ExecuteThread.java:256)
at weblogic/work/ExecuteThread.run(ExecuteThread.java:221)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“NM Reaper” id=24 idx=0x74 tid=64850 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: java/util/TaskQueue@0x2227ddca0[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/util/TimerThread.mainLoop(Timer.java:509)
^– Lock released while waiting: java/util/TaskQueue@0x2227ddca0[fat lock]
at java/util/TimerThread.run(Timer.java:462)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ExecuteThread: ‘0’ for queue: ‘weblogic.socket.Muxer'” id=25 idx=0x78 tid=64851 prio=5 alive, blocked, native_blocked, daemon
— Blocked trying to get lock: java/lang/String@0x2227ec6e0[fat lock]
at jrockit/vm/Threads.waitForUnblockSignal()V(Native Method)
at jrockit/vm/Locks.fatLockBlockOrSpin(Locks.java:1411)[optimized]
at jrockit/vm/Locks.lockFat(Locks.java:1512)[optimized]
at jrockit/vm/Locks.monitorEnterSecondStageHard(Locks.java:1054)[optimized]
at jrockit/vm/Locks.monitorEnterSecondStage(Locks.java:1005)[optimized]
at jrockit/vm/Locks.monitorEnter(Locks.java:2179)[optimized]
at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:153)
at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)
at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ExecuteThread: ‘1’ for queue: ‘weblogic.socket.Muxer'” id=26 idx=0x7c tid=64852 prio=5 alive, in native, daemon
at jrockit/ext/epoll/EPoll.epollWait0(ILjava/nio/ByteBuffer;II)I(Native Method)
at jrockit/ext/epoll/EPoll.epollWait(EPoll.java:123)
at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:156)
^– Holding lock: java/lang/String@0x2227ec6e0[fat lock]
at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)
at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ExecuteThread: ‘2’ for queue: ‘weblogic.socket.Muxer'” id=27 idx=0x80 tid=64853 prio=5 alive, blocked, native_blocked, daemon
— Blocked trying to get lock: java/lang/String@0x2227ec6e0[fat lock]
at jrockit/vm/Threads.waitForUnblockSignal()V(Native Method)
at jrockit/vm/Locks.fatLockBlockOrSpin(Locks.java:1411)[optimized]
at jrockit/vm/Locks.lockFat(Locks.java:1512)[optimized]
at jrockit/vm/Locks.monitorEnterSecondStageHard(Locks.java:1054)[optimized]
at jrockit/vm/Locks.monitorEnterSecondStage(Locks.java:1005)[optimized]
at jrockit/vm/Locks.monitorEnter(Locks.java:2179)[optimized]
at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:153)
at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)
at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ExecuteThread: ‘3’ for queue: ‘weblogic.socket.Muxer'” id=28 idx=0x84 tid=64854 prio=5 alive, blocked, native_blocked, daemon
— Blocked trying to get lock: java/lang/String@0x2227ec6e0[fat lock]
at jrockit/vm/Threads.waitForUnblockSignal()V(Native Method)
at jrockit/vm/Locks.fatLockBlockOrSpin(Locks.java:1411)[optimized]
at jrockit/vm/Locks.lockFat(Locks.java:1512)[optimized]
at jrockit/vm/Locks.monitorEnterSecondStageHard(Locks.java:1054)[optimized]
at jrockit/vm/Locks.monitorEnterSecondStage(Locks.java:1005)[optimized]
at jrockit/vm/Locks.monitorEnter(Locks.java:2179)[optimized]
at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:153)
at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)
at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“VDE Transaction Processor Thread” id=31 idx=0x88 tid=64855 prio=2 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/octetstring/vde/backend/standard/TransactionProcessor@0x22286f2a8[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/octetstring/vde/backend/standard/TransactionProcessor.waitChange(TransactionProcessor.java:367)
^– Lock released while waiting: com/octetstring/vde/backend/standard/TransactionProcessor@0x22286f2a8[fat lock]
at com/octetstring/vde/backend/standard/TransactionProcessor.run(TransactionProcessor.java:212)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“DoSManager” id=34 idx=0x90 tid=64857 prio=6 alive, sleeping, native_waiting, daemon
at java/lang/Thread.sleep(J)V(Native Method)
at com/octetstring/vde/DoSManager.run(DoSManager.java:433)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“JPS FileChangeNotifier<clean-only>” id=35 idx=0x94 tid=64858 prio=5 alive, parked, native_blocked, daemon
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.parkNanos(LockSupport.java:196)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java/util/concurrent/DelayQueue.take(DelayQueue.java:164)
at java/util/concurrent/ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
at java/util/concurrent/ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“Runtime Authorization Event Notifier” id=36 idx=0x98 tid=64860 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: oracle/security/jps/az/internal/runtime/notifier/RuntimeEventNotifierImpl@0x22283fa08[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at oracle/security/jps/az/internal/runtime/notifier/RuntimeEventNotifierImpl.run(RuntimeEventNotifierImpl.java:230)
^– Lock released while waiting: oracle/security/jps/az/internal/runtime/notifier/RuntimeEventNotifierImpl@0x22283fa08[fat lock]
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“Timer-2” id=37 idx=0x9c tid=64861 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: java/util/TaskQueue@0x222876090[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at java/util/TimerThread.mainLoop(Timer.java:483)
^– Lock released while waiting: java/util/TaskQueue@0x222876090[fat lock]
at java/util/TimerThread.run(Timer.java:462)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“Timer-3” id=38 idx=0xa0 tid=64869 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: java/util/TaskQueue@0x222876118[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/util/TimerThread.mainLoop(Timer.java:509)
^– Lock released while waiting: java/util/TaskQueue@0x222876118[fat lock]
at java/util/TimerThread.run(Timer.java:462)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“Thread-16” id=39 idx=0xa4 tid=64870 prio=5 alive, parked, native_blocked
— Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0x2228761a0
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at weblogic/utils/concurrent/JDK15ConcurrentBlockingQueue.take(JDK15ConcurrentBlockingQueue.java:89)
at weblogic/store/internal/PersistentStoreImpl.getOutstandingWork(PersistentStoreImpl.java:676)
at weblogic/store/internal/PersistentStoreImpl.run(PersistentStoreImpl.java:751)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“LogFlusher” id=41 idx=0xac tid=64873 prio=5 alive, sleeping, native_waiting, daemon
at java/lang/Thread.sleep(J)V(Native Method)
at oracle/core/ojdl/BufferedLogWriter$Flusher.run(BufferedLogWriter.java:409)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“LogFlusher” id=42 idx=0xb0 tid=64874 prio=5 alive, sleeping, native_waiting, daemon
at java/lang/Thread.sleep(J)V(Native Method)
at oracle/core/ojdl/BufferedLogWriter$Flusher.run(BufferedLogWriter.java:409)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“LogFlusher” id=43 idx=0xb4 tid=64875 prio=5 alive, sleeping, native_waiting, daemon
at java/lang/Thread.sleep(J)V(Native Method)
at oracle/core/ojdl/BufferedLogWriter$Flusher.run(BufferedLogWriter.java:409)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“DFW Diagnostic Dump Sampling – JavaClassHistogram” id=44 idx=0xb8 tid=64877 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: [B@0x222876790[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at oracle/dfw/sampling/DumpSampling.run(DumpSampling.java:547)
^– Lock released while waiting: [B@0x222876790[fat lock]
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“DFW Diagnostic Dump Sampling – JVMThreadDump” id=45 idx=0xbc tid=64878 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: [B@0x222876978[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at oracle/dfw/sampling/DumpSampling.run(DumpSampling.java:547)
^– Lock released while waiting: [B@0x222876978[fat lock]
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“oracle.dfw.impl.incident – ADR Executor (created: Fri Jul 26 17:54:37 EEST 2013)” id=49 idx=0xcc tid=64883 prio=5 alive, parked, native_blocked, daemon
— Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0x222876b90
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“oracle.dfw.impl.incident.ADRHelper – purge incidents” id=51 idx=0xd4 tid=64885 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: java/util/TaskQueue@0x2228a6f48[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/util/TimerThread.mainLoop(Timer.java:509)
^– Lock released while waiting: java/util/TaskQueue@0x2228a6f48[fat lock]
at java/util/TimerThread.run(Timer.java:462)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“oracle.dfw.incident.IncidentCreatorThread” id=52 idx=0xd8 tid=64886 prio=5 alive, parked, native_blocked, daemon
— Parking to wait for: java/util/concurrent/FutureTask$Sync@0x11282e6a8
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:811)
at java/util/concurrent/locks/AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:969)
at java/util/concurrent/locks/AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1281)
at java/util/concurrent/FutureTask$Sync.innerGet(FutureTask.java:218)
at java/util/concurrent/FutureTask.get(FutureTask.java:83)
at java/util/concurrent/AbstractExecutorService.invokeAll(AbstractExecutorService.java:205)
at oracle/dfw/impl/incident/DiagnosticsDataExtractorImpl.processDumpActions(DiagnosticsDataExtractorImpl.java:1255)
at oracle/dfw/impl/incident/DiagnosticsDataExtractorImpl.processIncident(DiagnosticsDataExtractorImpl.java:940)
at oracle/dfw/impl/incident/DiagnosticsDataExtractorImpl.access$1100(DiagnosticsDataExtractorImpl.java:97)
at oracle/dfw/impl/incident/DiagnosticsDataExtractorImpl$IncidentCreatorThread.run(DiagnosticsDataExtractorImpl.java:2165)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“oracle.dfw.incident.FloodController” id=56 idx=0xe8 tid=64891 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: java/lang/Object@0x2228a5b30[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at oracle/dfw/impl/incident/FloodController.run(FloodController.java:136)
^– Lock released while waiting: java/lang/Object@0x2228a5b30[fat lock]
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“LogFlusher” id=61 idx=0xfc tid=64897 prio=5 alive, sleeping, native_waiting, daemon
at java/lang/Thread.sleep(J)V(Native Method)
at oracle/core/ojdl/BufferedLogWriter$Flusher.run(BufferedLogWriter.java:409)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“JMX Framework document pooling thread” id=66 idx=0x110 tid=64903 prio=4 alive, sleeping, native_waiting, daemon
at java/lang/Thread.sleep(J)V(Native Method)
at oracle/as/config/notification/filesystem/WatchingDocumentChangeNotifier.run(WatchingDocumentChangeNotifier.java:252)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“OracleTimeoutPollingThread” id=76 idx=0x138 tid=64913 prio=10 alive, sleeping, native_waiting, daemon
at java/lang/Thread.sleep(J)V(Native Method)
at oracle/jdbc/driver/OracleTimeoutPollingThread.run(OracleTimeoutPollingThread.java:155)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“Thread-48” id=77 idx=0x13c tid=64915 prio=5 alive, parked, native_blocked
— Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0x222877240
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at weblogic/utils/concurrent/JDK15ConcurrentBlockingQueue.take(JDK15ConcurrentBlockingQueue.java:89)
at weblogic/store/internal/PersistentStoreImpl.getOutstandingWork(PersistentStoreImpl.java:676)
at weblogic/store/internal/PersistentStoreImpl.run(PersistentStoreImpl.java:751)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“Thread-49” id=78 idx=0x140 tid=64916 prio=5 alive, parked, native_blocked
— Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0x222877310
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at weblogic/utils/concurrent/JDK15ConcurrentBlockingQueue.take(JDK15ConcurrentBlockingQueue.java:89)
at weblogic/store/internal/PersistentStoreImpl.getOutstandingWork(PersistentStoreImpl.java:676)
at weblogic/store/internal/PersistentStoreImpl.run(PersistentStoreImpl.java:751)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“[ACTIVE] ExecuteThread: ‘2’ for queue: ‘weblogic.kernel.Default (self-tuning)'” id=79 idx=0x144 tid=64919 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: oracle/tip/adapter/file/inbound/FilesToProcess@0x235e8e0c0[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at oracle/tip/adapter/file/inbound/FilesToProcess.dequeueToProcess(FilesToProcess.java:102)
^– Lock released while waiting: oracle/tip/adapter/file/inbound/FilesToProcess@0x235e8e0c0[fat lock]
at oracle/tip/adapter/file/inbound/ProcessWork.run(ProcessWork.java:269)
at weblogic/work/ContextWrap.run(ContextWrap.java:41)
at weblogic/work/SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:545)
at weblogic/work/ExecuteThread.execute(ExecuteThread.java:256)
at weblogic/work/ExecuteThread.run(ExecuteThread.java:221)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“LDAPConnThread-0 ldap://15.0.4.50:5500” id=80 idx=0x148 tid=64920 prio=5 alive, in native, daemon
at jrockit/net/SocketNativeIO.readBytesPinned(Ljava/io/FileDescriptor;[BIII)I(Native Method)
at jrockit/net/SocketNativeIO.socketRead(SocketNativeIO.java:32)
at java/net/SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I(SocketInputStream.java)
at java/net/SocketInputStream.read(SocketInputStream.java:129)
at java/io/BufferedInputStream.fill(BufferedInputStream.java:218)
at java/io/BufferedInputStream.read(BufferedInputStream.java:237)
^– Holding lock: java/io/BufferedInputStream@0x21e4af038[biased lock]
at netscape/ldap/ber/stream/BERElement.getElement(Lnetscape/ldap/ber/stream/BERTagDecoder;Ljava/io/InputStream;[I)Lnetscape/ldap/ber/stream/BERElement;(Unknown Source)
at netscape/ldap/LDAPConnThread.run()V(Unknown Source)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“LDAPConnThread-1 ldap://15.0.4.50:5500” id=81 idx=0x14c tid=64921 prio=5 alive, in native, daemon
at jrockit/net/SocketNativeIO.readBytesPinned(Ljava/io/FileDescriptor;[BIII)I(Native Method)
at jrockit/net/SocketNativeIO.socketRead(SocketNativeIO.java:32)
at java/net/SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I(SocketInputStream.java)
at java/net/SocketInputStream.read(SocketInputStream.java:129)
at java/io/BufferedInputStream.fill(BufferedInputStream.java:218)
at java/io/BufferedInputStream.read(BufferedInputStream.java:237)
^– Holding lock: java/io/BufferedInputStream@0x21e4b2c18[biased lock]
at netscape/ldap/ber/stream/BERElement.getElement(Lnetscape/ldap/ber/stream/BERTagDecoder;Ljava/io/InputStream;[I)Lnetscape/ldap/ber/stream/BERElement;(Unknown Source)
at netscape/ldap/LDAPConnThread.run()V(Unknown Source)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“Thread-50” id=82 idx=0x150 tid=64922 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: java/lang/ref/ReferenceQueue$Lock@0x2228779c0[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/ref/ReferenceQueue.remove(ReferenceQueue.java:118)
^– Lock released while waiting: java/lang/ref/ReferenceQueue$Lock@0x2228779c0[fat lock]
at java/lang/ref/ReferenceQueue.remove(ReferenceQueue.java:134)
at com/bea/wli/config/derivedcache/GarbageCollectionNotifier.run(GarbageCollectionNotifier.java:149)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“pool-3-thread-1” id=83 idx=0x154 tid=64923 prio=5 alive, parked, native_blocked
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.parkNanos(LockSupport.java:196)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java/util/concurrent/DelayQueue.take(DelayQueue.java:164)
at java/util/concurrent/ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
at java/util/concurrent/ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“Logger@9236199 3.7.1.1” id=85 idx=0x158 tid=64924 prio=3 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/tangosol/coherence/component/application/console/Coherence$Logger$Queue@0x222877bf8[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)
^– Lock released while waiting: com/tangosol/coherence/component/application/console/Coherence$Logger$Queue@0x222877bf8[fat lock]
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:39)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“PacketListener1” id=86 idx=0x15c tid=64926 prio=10 alive, native_blocked, daemon
at java/net/PlainDatagramSocketImpl.receive0(Ljava/net/DatagramPacket;)V(Native Method)
^– Holding lock: java/net/PlainDatagramSocketImpl@0x2205de7f8[recursive]
at java/net/PlainDatagramSocketImpl.receive(PlainDatagramSocketImpl.java:145)
^– Holding lock: java/net/PlainDatagramSocketImpl@0x2205de7f8[biased lock]
at java/net/DatagramSocket.receive(DatagramSocket.java:725)
^– Holding lock: java/net/DatagramPacket@0x21295ff30[biased lock]
^– Holding lock: java/net/DatagramSocket@0x2227b8dd8[biased lock]
at com/tangosol/coherence/component/net/socket/UdpSocket.receive(UdpSocket.CDB:22)
at com/tangosol/coherence/component/net/UdpPacket.receive(UdpPacket.CDB:1)
at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketListener.onNotify(PacketListener.CDB:20)
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:42)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“PacketListener1P” id=87 idx=0x160 tid=64927 prio=10 alive, native_blocked, daemon
at java/net/PlainDatagramSocketImpl.receive0(Ljava/net/DatagramPacket;)V(Native Method)
^– Holding lock: java/net/PlainDatagramSocketImpl@0x2205df758[recursive]
at java/net/PlainDatagramSocketImpl.receive(PlainDatagramSocketImpl.java:145)
^– Holding lock: java/net/PlainDatagramSocketImpl@0x2205df758[biased lock]
at java/net/DatagramSocket.receive(DatagramSocket.java:725)
^– Holding lock: java/net/DatagramPacket@0x212a30340[biased lock]
^– Holding lock: java/net/DatagramSocket@0x2227b8fc0[biased lock]
at com/tangosol/coherence/component/net/socket/UdpSocket.receive(UdpSocket.CDB:22)
at com/tangosol/coherence/component/net/UdpPacket.receive(UdpPacket.CDB:1)
at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketListener.onNotify(PacketListener.CDB:20)
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:42)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“PacketReceiver” id=88 idx=0x164 tid=64928 prio=10 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/tangosol/coherence/component/net/Cluster$PacketReceiver$InQueue@0x2227eca80[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[optimized]
^– Lock released while waiting: com/tangosol/coherence/component/net/Cluster$PacketReceiver$InQueue@0x2227eca80[fat lock]
at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketReceiver.onWait(PacketReceiver.CDB:2)
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:39)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“PacketPublisher” id=89 idx=0x168 tid=64929 prio=10 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/tangosol/coherence/component/net/Cluster$PacketPublisher$InQueue@0x2227ecdf0[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[optimized]
^– Lock released while waiting: com/tangosol/coherence/component/net/Cluster$PacketPublisher$InQueue@0x2227ecdf0[fat lock]
at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketPublisher.onWait(PacketPublisher.CDB:2)
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:39)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“PacketSpeaker” id=90 idx=0x16c tid=64930 prio=10 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/tangosol/coherence/component/net/Cluster$PacketSpeaker$BundlingQueue@0x2227ecbc0[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at com/tangosol/coherence/component/util/queue/ConcurrentQueue.waitForEntry(ConcurrentQueue.CDB:16)
^– Lock released while waiting: com/tangosol/coherence/component/net/Cluster$PacketSpeaker$BundlingQueue@0x2227ecbc0[fat lock]
at com/tangosol/coherence/component/util/queue/ConcurrentQueue.remove(ConcurrentQueue.CDB:7)
at com/tangosol/coherence/component/util/Queue.remove(Queue.CDB:1)
at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketSpeaker.onNotify(PacketSpeaker.CDB:21)
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:42)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“PacketListenerN” id=91 idx=0x170 tid=64931 prio=10 alive, in native, daemon
at java/net/PlainDatagramSocketImpl.receive0(Ljava/net/DatagramPacket;)V(Native Method)
^– Holding lock: java/net/PlainDatagramSocketImpl@0x2205dd838[recursive]
at java/net/PlainDatagramSocketImpl.receive(PlainDatagramSocketImpl.java:145)
^– Holding lock: java/net/PlainDatagramSocketImpl@0x2205dd838[biased lock]
at java/net/DatagramSocket.receive(DatagramSocket.java:725)
^– Holding lock: java/net/DatagramPacket@0x12a0620e8[biased lock]
^– Holding lock: java/net/MulticastSocket@0x2227b8bb8[biased lock]
at com/tangosol/coherence/component/net/socket/UdpSocket.receive(UdpSocket.CDB:22)
at com/tangosol/coherence/component/net/UdpPacket.receive(UdpPacket.CDB:1)
at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketListener.onNotify(PacketListener.CDB:20)
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:42)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“Cluster|Member(Id=1, Timestamp=2013-07-26 17:54:54.335, Address=127.0.0.1:7890, MachineId=60314, Location=site:,machine:localhost,process:64817, Role=OSB-node)” id=92 idx=0x174 tid=64932 prio=5 alive, in native, daemon
at sun/nio/ch/EPollArrayWrapper.epollWait(JIJI)I(Native Method)
at sun/nio/ch/EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun/nio/ch/EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun/nio/ch/SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
^– Holding lock: sun/nio/ch/Util$2@0x22247c160[biased lock]
^– Holding lock: java/util/Collections$UnmodifiableSet@0x22247c150[biased lock]
^– Holding lock: sun/nio/ch/EPollSelectorImpl@0x2227b7a70[biased lock]
at sun/nio/ch/SelectorImpl.select(SelectorImpl.java:80)[inlined]
at com/tangosol/coherence/component/net/TcpRing.select(TcpRing.CDB:11)[optimized]
at com/tangosol/coherence/component/util/daemon/queueProcessor/service/grid/ClusterService.onWait(ClusterService.CDB:6)
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:39)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“IpMonitor” id=93 idx=0x178 tid=64934 prio=6 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/tangosol/coherence/component/net/Cluster$IpMonitor@0x2227ece70[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[optimized]
^– Lock released while waiting: com/tangosol/coherence/component/net/Cluster$IpMonitor@0x2227ece70[fat lock]
at com/tangosol/coherence/component/util/daemon/IpMonitor.onWait(IpMonitor.CDB:4)
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:39)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“Invocation:Management:EventDispatcher” id=95 idx=0x17c tid=64935 prio=10 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/tangosol/coherence/component/util/daemon/queueProcessor/Service$EventDispatcher$Queue@0x2227ed068[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[optimized]
^– Lock released while waiting: com/tangosol/coherence/component/util/daemon/queueProcessor/Service$EventDispatcher$Queue@0x2227ed068[fat lock]
at com/tangosol/coherence/component/util/daemon/queueProcessor/Service$EventDispatcher.onWait(Service.CDB:7)
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:39)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“Invocation:Management” id=96 idx=0x180 tid=64936 prio=10 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/tangosol/coherence/component/util/daemon/queueProcessor/service/Grid$ReceiveQueue@0x2227ed250[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[optimized]
^– Lock released while waiting: com/tangosol/coherence/component/util/daemon/queueProcessor/service/Grid$ReceiveQueue@0x2227ed250[fat lock]
at com/tangosol/coherence/component/util/daemon/queueProcessor/Service.onWait(Service.CDB:4)
at com/tangosol/coherence/component/util/daemon/queueProcessor/service/Grid.onWait(Grid.CDB:3)
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:39)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“Timer-5” id=97 idx=0x184 tid=65136 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: java/util/TaskQueue@0x222877c78[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at java/util/TimerThread.mainLoop(Timer.java:483)
^– Lock released while waiting: java/util/TaskQueue@0x222877c78[fat lock]
at java/util/TimerThread.run(Timer.java:462)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“com.bea.osb.transports.jms.TimerThread” id=98 idx=0x188 tid=65137 prio=5 alive, parked, native_blocked, daemon
— Parking to wait for: java/util/concurrent/Semaphore$NonfairSync@0x222877da8
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:811)
at java/util/concurrent/locks/AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:969)
at java/util/concurrent/locks/AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1281)
at java/util/concurrent/Semaphore.acquire(Semaphore.java:286)
at com/bea/wli/sb/transports/jms/JmsAsyncMessageTable$TimeoutThread.run(JmsAsyncMessageTable.java:248)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 0” id=99 idx=0x18c tid=65138 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 1” id=100 idx=0x190 tid=65139 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 2” id=101 idx=0x194 tid=65140 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 3” id=102 idx=0x198 tid=65141 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 4” id=103 idx=0x19c tid=65142 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 5” id=104 idx=0x1a0 tid=65143 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 6” id=105 idx=0x1a4 tid=65144 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 7” id=106 idx=0x1a8 tid=65145 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 8” id=107 idx=0x1ac tid=65146 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 9” id=108 idx=0x1b0 tid=65147 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 10” id=109 idx=0x1b4 tid=65148 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 11” id=110 idx=0x1b8 tid=65149 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 12” id=111 idx=0x1bc tid=65150 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 13” id=112 idx=0x1c0 tid=65151 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 14” id=113 idx=0x1c4 tid=65152 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 15” id=114 idx=0x1c8 tid=65153 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 16” id=115 idx=0x1cc tid=65154 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 17” id=116 idx=0x1d0 tid=65155 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 18” id=117 idx=0x1d4 tid=65156 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 19” id=118 idx=0x1d8 tid=65157 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 20” id=119 idx=0x1dc tid=65158 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 21” id=120 idx=0x1e0 tid=65159 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 22” id=121 idx=0x1e4 tid=65160 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 23” id=122 idx=0x1e8 tid=65161 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 24” id=123 idx=0x1ec tid=65162 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 25” id=124 idx=0x1f0 tid=65163 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 26” id=125 idx=0x1f4 tid=65164 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 27” id=126 idx=0x1f8 tid=65165 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 28” id=127 idx=0x1fc tid=65166 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 29” id=128 idx=0x200 tid=65167 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 30” id=129 idx=0x204 tid=65168 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 31” id=130 idx=0x208 tid=65169 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 32” id=131 idx=0x20c tid=65170 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 33” id=132 idx=0x210 tid=65171 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 34” id=133 idx=0x214 tid=65172 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 35” id=134 idx=0x218 tid=65173 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 36” id=135 idx=0x21c tid=65174 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 37” id=136 idx=0x220 tid=65175 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 38” id=137 idx=0x224 tid=65176 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 39” id=138 idx=0x228 tid=65177 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 40” id=139 idx=0x22c tid=65178 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 41” id=140 idx=0x230 tid=65179 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 42” id=141 idx=0x234 tid=65180 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 43” id=142 idx=0x238 tid=65181 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 44” id=143 idx=0x23c tid=65182 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 45” id=144 idx=0x240 tid=65183 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 46” id=145 idx=0x244 tid=65184 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 47” id=146 idx=0x248 tid=65185 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 48” id=147 idx=0x24c tid=65186 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 49” id=148 idx=0x250 tid=65187 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 50” id=149 idx=0x254 tid=65188 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 51” id=150 idx=0x258 tid=65189 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 52” id=151 idx=0x25c tid=65190 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 53” id=152 idx=0x260 tid=65191 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 54” id=153 idx=0x264 tid=65192 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 55” id=154 idx=0x268 tid=65193 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 56” id=155 idx=0x26c tid=65194 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 57” id=156 idx=0x270 tid=65195 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 58” id=157 idx=0x274 tid=65196 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 59” id=158 idx=0x278 tid=65197 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 60” id=159 idx=0x27c tid=65198 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 61” id=160 idx=0x280 tid=65199 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 62” id=161 idx=0x284 tid=65200 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 63” id=162 idx=0x288 tid=65201 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 64” id=163 idx=0x28c tid=65202 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 65” id=164 idx=0x290 tid=65203 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 66” id=165 idx=0x294 tid=65204 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 67” id=166 idx=0x298 tid=65205 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 68” id=167 idx=0x29c tid=65206 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 69” id=168 idx=0x2a0 tid=65207 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 70” id=169 idx=0x2a4 tid=65208 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 71” id=170 idx=0x2a8 tid=65209 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 72” id=171 idx=0x2ac tid=65210 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 73” id=172 idx=0x2b0 tid=65211 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 74” id=173 idx=0x2b4 tid=65212 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 75” id=174 idx=0x2b8 tid=65213 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 76” id=175 idx=0x2bc tid=65214 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 77” id=176 idx=0x2c0 tid=65215 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 78” id=177 idx=0x2c4 tid=65216 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 79” id=178 idx=0x2c8 tid=65217 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 80” id=179 idx=0x2cc tid=65218 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 81” id=180 idx=0x2d0 tid=65219 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 82” id=181 idx=0x2d4 tid=65220 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 83” id=182 idx=0x2d8 tid=65221 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 84” id=183 idx=0x2dc tid=65222 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 85” id=184 idx=0x2e0 tid=65223 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 86” id=185 idx=0x2e4 tid=65224 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 87” id=186 idx=0x2e8 tid=65225 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 88” id=187 idx=0x2ec tid=65226 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 89” id=188 idx=0x2f0 tid=65227 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 90” id=189 idx=0x2f4 tid=65228 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 91” id=190 idx=0x2f8 tid=65229 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 92” id=191 idx=0x2fc tid=65230 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 93” id=192 idx=0x300 tid=65231 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 94” id=193 idx=0x304 tid=65232 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 95” id=194 idx=0x308 tid=65233 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 96” id=195 idx=0x30c tid=65234 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 97” id=196 idx=0x310 tid=65235 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 98” id=197 idx=0x314 tid=65236 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“ThreadPoolThread 99” id=198 idx=0x318 tid=65237 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/ibi/adapters/util/workmanager/CondVar.cvTimedWait(CondVar.java:74)
^– Lock released while waiting: com/ibi/adapters/util/workmanager/CondVar@0x222877f38[fat lock]
at com/ibi/adapters/util/workmanager/CondVar.cvWait(CondVar.java:44)
at com/ibi/adapters/util/workmanager/ThreadPool$ThreadPoolThread.run(ThreadPool.java:297)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“[ACTIVE] ExecuteThread: ‘3’ for queue: ‘weblogic.kernel.Default (self-tuning)'” id=199 idx=0x31c tid=65248 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: oracle/tip/adapter/file/inbound/FilesToProcess@0x235e8e0c0[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at oracle/tip/adapter/file/inbound/FilesToProcess.dequeueToProcess(FilesToProcess.java:102)
^– Lock released while waiting: oracle/tip/adapter/file/inbound/FilesToProcess@0x235e8e0c0[fat lock]
at oracle/tip/adapter/file/inbound/ProcessWork.run(ProcessWork.java:269)
at weblogic/work/ContextWrap.run(ContextWrap.java:41)
at weblogic/work/SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:545)
at weblogic/work/ExecuteThread.execute(ExecuteThread.java:256)
at weblogic/work/ExecuteThread.run(ExecuteThread.java:221)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“[ACTIVE] ExecuteThread: ‘4’ for queue: ‘weblogic.kernel.Default (self-tuning)'” id=200 idx=0x320 tid=65249 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: oracle/tip/adapter/file/inbound/FilesToProcess@0x235e8e0c0[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at oracle/tip/adapter/file/inbound/FilesToProcess.dequeueToProcess(FilesToProcess.java:102)
^– Lock released while waiting: oracle/tip/adapter/file/inbound/FilesToProcess@0x235e8e0c0[fat lock]
at oracle/tip/adapter/file/inbound/ProcessWork.run(ProcessWork.java:269)
at weblogic/work/ContextWrap.run(ContextWrap.java:41)
at weblogic/work/SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:545)
at weblogic/work/ExecuteThread.execute(ExecuteThread.java:256)
at weblogic/work/ExecuteThread.run(ExecuteThread.java:221)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“DmsThread-1” id=201 idx=0x324 tid=65251 prio=5 alive, parked, native_blocked, daemon
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.parkNanos(LockSupport.java:196)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java/util/concurrent/DelayQueue.take(DelayQueue.java:164)
at java/util/concurrent/ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
at java/util/concurrent/ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
at oracle/dms/aggregator/DmsThreadFactory$1$1.run(DmsThreadFactory.java:56)
at jrockit/vm/AccessController.doPrivileged(AccessController.java:232)
at oracle/dms/aggregator/DmsThreadFactory$1.run(DmsThreadFactory.java:51)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“Thread-52” id=202 idx=0x328 tid=65252 prio=5 alive, parked, native_blocked
— Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0x22287b3d8
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at weblogic/utils/concurrent/JDK15ConcurrentBlockingQueue.take(JDK15ConcurrentBlockingQueue.java:89)
at weblogic/store/internal/PersistentStoreImpl.getOutstandingWork(PersistentStoreImpl.java:676)
at weblogic/store/internal/PersistentStoreImpl.run(PersistentStoreImpl.java:751)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“Thread-53” id=203 idx=0x32c tid=65253 prio=5 alive, parked, native_blocked, daemon
— Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0x22287b478
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at com/bea/alsb/alert/sla/TaskCollector.run(TaskCollector.java:58)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“DistributedCache:ORA-OSB-deployments” id=207 idx=0x33c tid=65265 prio=10 alive, waiting, native_blocked, daemon
— Waiting for notification on: com/tangosol/coherence/component/util/daemon/queueProcessor/service/Grid$ReceiveQueue@0x2227ed520[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[optimized]
^– Lock released while waiting: com/tangosol/coherence/component/util/daemon/queueProcessor/service/Grid$ReceiveQueue@0x2227ed520[fat lock]
at com/tangosol/coherence/component/util/daemon/queueProcessor/Service.onWait(Service.CDB:4)
at com/tangosol/coherence/component/util/daemon/queueProcessor/service/Grid.onWait(Grid.CDB:3)
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:39)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“[ACTIVE] ExecuteThread: ‘5’ for queue: ‘weblogic.kernel.Default (self-tuning)'” id=208 idx=0x340 tid=65270 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: weblogic/work/ExecuteThread@0x222874830[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at weblogic/work/ExecuteThread.waitForRequest(ExecuteThread.java:205)
^– Lock released while waiting: weblogic/work/ExecuteThread@0x222874830[fat lock]
at weblogic/work/ExecuteThread.run(ExecuteThread.java:226)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“[ACTIVE] ExecuteThread: ‘6’ for queue: ‘weblogic.kernel.Default (self-tuning)'” id=209 idx=0x344 tid=65271 prio=5 alive, sleeping, native_waiting, daemon
at java/lang/Thread.sleep(J)V(Native Method)
at oracle/tip/adapter/file/inbound/PollWork.run(PollWork.java:382)
at weblogic/work/ContextWrap.run(ContextWrap.java:41)
at weblogic/work/SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:545)
at weblogic/work/ExecuteThread.execute(ExecuteThread.java:256)
at weblogic/work/ExecuteThread.run(ExecuteThread.java:221)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“[ACTIVE] ExecuteThread: ‘7’ for queue: ‘weblogic.kernel.Default (self-tuning)'” id=210 idx=0x348 tid=65272 prio=5 alive, sleeping, native_waiting, daemon
at java/lang/Thread.sleep(J)V(Native Method)
at oracle/tip/adapter/file/inbound/PollWork.run(PollWork.java:382)
at weblogic/work/ContextWrap.run(ContextWrap.java:41)
at weblogic/work/SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:545)
at weblogic/work/ExecuteThread.execute(ExecuteThread.java:256)
at weblogic/work/ExecuteThread.run(ExecuteThread.java:221)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“[STUCK] ExecuteThread: ‘8’ for queue: ‘weblogic.kernel.Default (self-tuning)'” id=211 idx=0x34c tid=65273 prio=1 alive, in native, daemon
at jrockit/net/SocketNativeIO.readBytesPinned(Ljava/io/FileDescriptor;[BIII)I(Native Method)
at jrockit/net/SocketNativeIO.socketRead(SocketNativeIO.java:32)
at java/net/SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I(SocketInputStream.java)
at java/net/SocketInputStream.read(SocketInputStream.java:129)
at oracle/net/nt/MetricsEnabledInputStream.read(TcpNTAdapter.java:730)
at oracle/net/ns/Packet.receive(Packet.java:302)
at oracle/net/ns/DataPacket.receive(DataPacket.java:108)
at oracle/net/ns/NetInputStream.getNextPacket(NetInputStream.java:317)
at oracle/net/ns/NetInputStream.read(NetInputStream.java:262)
at oracle/net/ns/NetInputStream.read(NetInputStream.java:187)
at oracle/net/ns/NetInputStream.read(NetInputStream.java:104)
at oracle/jdbc/driver/T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:126)
at oracle/jdbc/driver/T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:82)
at oracle/jdbc/driver/T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1178)
at oracle/jdbc/driver/T4CTTIfun.receive(T4CTTIfun.java:314)
at oracle/jdbc/driver/T4CTTIfun.doRPC(T4CTTIfun.java:205)
at oracle/jdbc/driver/T4C8Oall.doOALL(T4C8Oall.java:548)
at oracle/jdbc/driver/T4CPreparedStatement.doOall8(T4CPreparedStatement.java:217)
at oracle/jdbc/driver/T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:947)
at oracle/jdbc/driver/OracleStatement.executeMaybeDescribe(OracleStatement.java:1283)
at oracle/jdbc/driver/OracleStatement.doExecuteWithTimeout(OracleStatement.java:1441)
at oracle/jdbc/driver/OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3769)
at oracle/jdbc/driver/OraclePreparedStatement.execute(OraclePreparedStatement.java:3954)
^– Holding lock: oracle/jdbc/driver/T4CConnection@0x22fe561e0[thin lock]
at oracle/jdbc/driver/OraclePreparedStatementWrapper.execute(OraclePreparedStatementWrapper.java:1539)
at com/iwaysoftware/iwrepository/rdbms/oracle/OracleRepository.isClosed(OracleRepository.java:103)
at com/iwaysoftware/iwrepository/rdbms/oracle/OracleRepository.getConnection(OracleRepository.java:198)
^– Holding lock: com/iwaysoftware/iwrepository/rdbms/oracle/OracleRepository@0x22fe53c20[biased lock]
at com/iwaysoftware/iwrepository/rdbms/RDBMSQuery.handlePrepareStatement(RDBMSQuery.java:178)
at com/iwaysoftware/iwrepository/rdbms/RDBMSQuery.<init>(RDBMSQuery.java:91)
at com/iwaysoftware/iwrepository/rdbms/oracle/OracleQuery.<init>(OracleQuery.java:36)
at com/iwaysoftware/iwrepository/rdbms/oracle/OracleRepository.prepareSelect(OracleRepository.java:343)
at com/iwaysoftware/af/container/IWAFRepositoryOP.getConfigs(IWAFRepositoryOP.java:163)
at com/iwaysoftware/af/container/IWAFRepositoryStorage.listConfigurations(IWAFRepositoryStorage.java:215)
at com/iwaysoftware/af/container/AdapterManager.listConfigurations(AdapterManager.java:142)
at com/iwaysoftware/af/container/AdapterManager.checkConfig(AdapterManager.java:562)
at com/iwaysoftware/af/container/AdapterManager.getActivatedAdapter(AdapterManager.java:252)
at com/iwaysoftware/af/container/IWAFContainer.getActivatedAdapter(IWAFContainer.java:615)
at com/ibi/afjca/spi/IWAFManagedConnection.getProxyAdapter(IWAFManagedConnection.java:100)
at com/ibi/afjca/cci/IWAFConnection.<init>(IWAFConnection.java:38)
at com/ibi/afjca/spi/IWAFManagedConnection.getConnection(IWAFManagedConnection.java:141)
at weblogic/connector/security/layer/AdapterLayer.getConnection(AdapterLayer.java:664)
at weblogic/connector/outbound/ConnectionHandlerBaseImpl.createConnectionHandle(ConnectionHandlerBaseImpl.java:365)
at weblogic/connector/outbound/ConnectionInfo.createConnectionHandle(ConnectionInfo.java:431)
at weblogic/connector/outbound/ConnectionManagerImpl.getConnection(ConnectionManagerImpl.java:321)
at weblogic/connector/outbound/ConnectionManagerImpl.allocateConnection(ConnectionManagerImpl.java:129)
at com/ibi/afjca/cci/IWAFConnectionFactory.getConnection(IWAFConnectionFactory.java:114)
at oracle/tip/adapter/sa/impl/fw/wsif/jca/WSIFPort_JCA$JCAConnectionPool.createJCAConnection(WSIFPort_JCA.java:1713)
at oracle/tip/adapter/sa/impl/fw/wsif/jca/WSIFPort_JCA$JCAConnectionPool$JCAConnection.init(WSIFPort_JCA.java:1439)
at oracle/tip/adapter/sa/impl/fw/wsif/jca/WSIFPort_JCA.obtainJCAConnection(WSIFPort_JCA.java:1085)
at oracle/tip/adapter/sa/impl/fw/wsif/jca/WSIFOperation_JCA.performOperation(WSIFOperation_JCA.java:406)
at oracle/tip/adapter/sa/impl/fw/wsif/jca/WSIFOperation_JCA.executeOperation(WSIFOperation_JCA.java:369)
at oracle/tip/adapter/sa/impl/fw/wsif/jca/WSIFOperation_JCA.executeRequestResponseOperation(WSIFOperation_JCA.java:328)
at oracle/tip/adapter/sa/impl/JCABindingReferenceImpl.invokeWsifProvider(JCABindingReferenceImpl.java:352)
at oracle/tip/adapter/sa/impl/JCABindingReferenceImpl.request(JCABindingReferenceImpl.java:259)
at com/bea/wli/sb/transports/jca/binding/JCATransportOutboundOperationBindingServiceImpl.invoke(JCATransportOutboundOperationBindingServiceImpl.java:150)
at com/bea/wli/sb/transports/jca/JCATransportEndpoint.sendRequestResponse(JCATransportEndpoint.java:209)
at com/bea/wli/sb/transports/jca/JCATransportEndpoint.send(JCATransportEndpoint.java:170)
at com/bea/wli/sb/transports/jca/JCATransportProvider.sendMessageAsync(JCATransportProvider.java:585)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
at jrockit/vm/Reflect.invokeMethod(Ljava/lang/Object;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
at sun/reflect/NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
at sun/reflect/NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)[optimized]
at java/lang/reflect/Method.invoke(Method.java:597)[optimized]
at com/bea/wli/sb/transports/Util$1.invoke(Util.java:83)
at com/sun/proxy/$Proxy136.sendMessageAsync(Lcom/bea/wli/sb/transports/TransportSender;Lcom/bea/wli/sb/transports/TransportSendListener;Lcom/bea/wli/sb/transports/TransportOptions;)V(Unknown Source)
at com/bea/wli/sb/transports/LoadBalanceFailoverListener.sendMessageAsync(LoadBalanceFailoverListener.java:148)
at com/bea/wli/sb/transports/LoadBalanceFailoverListener.sendMessageToServiceAsync(LoadBalanceFailoverListener.java:510)
at com/bea/wli/sb/transports/LoadBalanceFailoverListener.sendMessageToService(LoadBalanceFailoverListener.java:445)
at com/bea/wli/sb/transports/TransportManagerImpl.sendMessageToService(TransportManagerImpl.java:582)
at com/bea/wli/sb/transports/TransportManagerImpl.sendMessageAsync(TransportManagerImpl.java:449)
at com/bea/wli/sb/pipeline/PipelineContextImpl.doDispatch(PipelineContextImpl.java:691)
at com/bea/wli/sb/pipeline/PipelineContextImpl.dispatch(PipelineContextImpl.java:594)
at stages/routing/runtime/RouteRuntimeStep.processMessage(RouteRuntimeStep.java:128)
at com/bea/wli/sb/stages/StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:346)
at com/bea/wli/sb/pipeline/RouteNode.doRequest(RouteNode.java:106)
at com/bea/wli/sb/pipeline/Node.processMessage(Node.java:67)
at com/bea/wli/sb/pipeline/PipelineContextImpl.execute(PipelineContextImpl.java:1095)
at com/bea/wli/sb/pipeline/Router.processMessage(Router.java:214)
at com/bea/wli/sb/pipeline/MessageProcessor.processRequest(MessageProcessor.java:101)
at com/bea/wli/sb/pipeline/RouterManager$1.run(RouterManager.java:597)
at com/bea/wli/sb/pipeline/RouterManager$1.run(RouterManager.java:595)
at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)[inlined]
at weblogic/security/service/SecurityManager.runAs(SecurityManager.java:146)[optimized]
at com/bea/wli/sb/security/WLSSecurityContextService.runAs(WLSSecurityContextService.java:55)
at com/bea/wli/sb/pipeline/RouterManager.processMessage(RouterManager.java:594)
at com/bea/wli/sb/transports/TransportManagerImpl.receiveMessage(TransportManagerImpl.java:398)
at com/bea/wli/sb/transports/CoLocatedMessageContext$1.run(CoLocatedMessageContext.java:163)
at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)[inlined]
at weblogic/security/service/SecurityManager.runAs(SecurityManager.java:146)[optimized]
at weblogic/security/Security.runAs(Security.java:61)
at com/bea/wli/sb/util/security/SecurityUtils.runAs(SecurityUtils.java:58)
at com/bea/wli/sb/transports/CoLocatedMessageContext.send(CoLocatedMessageContext.java:158)
at com/bea/wli/sb/transports/http/wls/HttpTransportProvider.sendMessageAsync(HttpTransportProvider.java:215)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
at jrockit/vm/Reflect.invokeMethod(Ljava/lang/Object;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
at sun/reflect/NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
at sun/reflect/NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)[optimized]
at java/lang/reflect/Method.invoke(Method.java:597)[optimized]
at com/bea/wli/sb/transports/Util$1.invoke(Util.java:83)
at com/sun/proxy/$Proxy121.sendMessageAsync(Lcom/bea/wli/sb/transports/TransportSender;Lcom/bea/wli/sb/transports/TransportSendListener;Lcom/bea/wli/sb/transports/TransportOptions;)V(Unknown Source)
at com/bea/wli/sb/transports/LoadBalanceFailoverListener.sendMessageAsync(LoadBalanceFailoverListener.java:148)
at com/bea/wli/sb/transports/LoadBalanceFailoverListener.sendMessageToServiceAsync(LoadBalanceFailoverListener.java:510)
at com/bea/wli/sb/transports/LoadBalanceFailoverListener.sendMessageToService(LoadBalanceFailoverListener.java:445)
at com/bea/wli/sb/transports/TransportManagerImpl.sendMessageToService(TransportManagerImpl.java:582)
at com/bea/wli/sb/transports/TransportManagerImpl.sendMessageAsync(TransportManagerImpl.java:449)
at com/bea/wli/sb/pipeline/PipelineContextImpl.doDispatch(PipelineContextImpl.java:691)
at com/bea/wli/sb/pipeline/PipelineContextImpl.dispatchSync(PipelineContextImpl.java:560)
at stages/transform/runtime/WsCalloutRuntimeStep$WsCalloutDispatcher.dispatch(WsCalloutRuntimeStep.java:1391)
at stages/transform/runtime/WsCalloutRuntimeStep.processMessage(WsCalloutRuntimeStep.java:236)
at com/bea/wli/sb/stages/StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:346)
at com/bea/wli/sb/pipeline/PipelineStage.processMessage(PipelineStage.java:84)
at com/bea/wli/sb/pipeline/PipelineContextImpl.execute(PipelineContextImpl.java:1095)
at com/bea/wli/sb/pipeline/Pipeline.processMessage(Pipeline.java:141)
at com/bea/wli/sb/pipeline/PipelineContextImpl.execute(PipelineContextImpl.java:1095)
at com/bea/wli/sb/pipeline/PipelineNode.doRequest(PipelineNode.java:55)
at com/bea/wli/sb/pipeline/Node.processMessage(Node.java:67)
at com/bea/wli/sb/pipeline/PipelineContextImpl.execute(PipelineContextImpl.java:1095)
at com/bea/wli/sb/pipeline/Router.processMessage(Router.java:214)
at com/bea/wli/sb/pipeline/MessageProcessor.processRequest(MessageProcessor.java:101)
at com/bea/wli/sb/pipeline/RouterManager$1.run(RouterManager.java:597)
at com/bea/wli/sb/pipeline/RouterManager$1.run(RouterManager.java:595)
at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)[inlined]
at weblogic/security/service/SecurityManager.runAs(SecurityManager.java:146)[optimized]
at com/bea/wli/sb/security/WLSSecurityContextService.runAs(WLSSecurityContextService.java:55)
at com/bea/wli/sb/pipeline/RouterManager.processMessage(RouterManager.java:594)
at com/bea/wli/sb/transports/TransportManagerImpl.receiveMessage(TransportManagerImpl.java:398)
at com/bea/wli/sb/transports/http/generic/RequestHelperBase.invokePipeline(RequestHelperBase.java:185)
at com/bea/wli/sb/transports/http/wls/HttpTransportServlet$RequestHelperWLS.invokePipeline(HttpTransportServlet.java:228)
at com/bea/wli/sb/transports/http/generic/RequestHelperBase$1.run(RequestHelperBase.java:160)
at com/bea/wli/sb/transports/http/generic/RequestHelperBase$1.run(RequestHelperBase.java:158)
at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)[inlined]
at weblogic/security/service/SecurityManager.runAs(SecurityManager.java:146)[optimized]
at com/bea/wli/sb/transports/http/generic/RequestHelperBase.securedInvoke(RequestHelperBase.java:157)
at com/bea/wli/sb/transports/http/generic/RequestHelperBase.service(RequestHelperBase.java:105)
at com/bea/wli/sb/transports/http/wls/HttpTransportServlet.service(HttpTransportServlet.java:129)
at weblogic/servlet/FutureResponseServlet.service(FutureResponseServlet.java:24)
at javax/servlet/http/HttpServlet.service(HttpServlet.java:820)
at weblogic/servlet/internal/StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
at weblogic/servlet/internal/StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
at weblogic/servlet/internal/ServletStubImpl.execute(ServletStubImpl.java:301)
at weblogic/servlet/internal/ServletStubImpl.execute(ServletStubImpl.java:184)
at weblogic/servlet/internal/WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3732)
at weblogic/servlet/internal/WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3696)
at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
at weblogic/security/service/SecurityManager.runAs(SecurityManager.java:120)
at weblogic/servlet/internal/WebAppServletContext.securedExecute(WebAppServletContext.java:2273)
at weblogic/servlet/internal/WebAppServletContext.execute(WebAppServletContext.java:2179)
at weblogic/servlet/internal/ServletRequestImpl.run(ServletRequestImpl.java:1490)
at weblogic/work/ExecuteThread.execute(ExecuteThread.java:256)[optimized]
at weblogic/work/ExecuteThread.run(ExecuteThread.java:221)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“weblogic.cluster.MessageReceiver” id=212 idx=0x350 tid=65274 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: java/util/ArrayList@0x21a907020[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at weblogic/cluster/messaging/internal/server/UnicastFragmentSocket.receive(UnicastFragmentSocket.java:105)
^– Lock released while waiting: java/util/ArrayList@0x21a907020[fat lock]
at weblogic/cluster/FragmentSocketWrapper.receive(FragmentSocketWrapper.java:98)
at weblogic/cluster/MulticastManager.run(MulticastManager.java:466)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“pool-12-thread-1” id=213 idx=0x354 tid=65285 prio=5 alive, parked, native_blocked
— Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0x235e9f420
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“pool-12-thread-2” id=214 idx=0x358 tid=65286 prio=5 alive, parked, native_blocked
— Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0x235e9f420
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“pool-12-thread-3” id=215 idx=0x35c tid=65287 prio=5 alive, parked, native_blocked
— Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0x235e9f420
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“pool-12-thread-4” id=216 idx=0x360 tid=65288 prio=5 alive, parked, native_blocked
— Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0x235e9f420
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“[STANDBY] ExecuteThread: ‘9’ for queue: ‘weblogic.kernel.Default (self-tuning)'” id=218 idx=0x364 tid=65291 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: weblogic/work/ExecuteThread@0x235eea8d8[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at weblogic/work/ExecuteThread.waitForRequest(ExecuteThread.java:205)
^– Lock released while waiting: weblogic/work/ExecuteThread@0x235eea8d8[fat lock]
at weblogic/work/ExecuteThread.run(ExecuteThread.java:226)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“DynamicListenThread[Default]” id=219 idx=0x368 tid=65292 prio=9 alive, in native, daemon
at java/net/PlainSocketImpl.socketAccept(Ljava/net/SocketImpl;)V(Native Method)
at java/net/PlainSocketImpl.accept(PlainSocketImpl.java:408)
^– Holding lock: java/net/SocksSocketImpl@0x235ef51d0[biased lock]
at java/net/ServerSocket.implAccept(ServerSocket.java:462)
at java/net/ServerSocket.accept(ServerSocket.java:430)
at weblogic/socket/WeblogicServerSocket.accept(WeblogicServerSocket.java:38)
at weblogic/server/channels/DynamicListenThread$SocketAccepter.accept(DynamicListenThread.java:535)
at weblogic/server/channels/DynamicListenThread$SocketAccepter.access$200(DynamicListenThread.java:417)
at weblogic/server/channels/DynamicListenThread.run(DynamicListenThread.java:173)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“[STANDBY] ExecuteThread: ’10’ for queue: ‘weblogic.kernel.Default (self-tuning)'” id=220 idx=0x36c tid=65294 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: weblogic/work/ExecuteThread@0x235eeb6c0[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at weblogic/work/ExecuteThread.waitForRequest(ExecuteThread.java:205)
^– Lock released while waiting: weblogic/work/ExecuteThread@0x235eeb6c0[fat lock]
at weblogic/work/ExecuteThread.run(ExecuteThread.java:226)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“[STANDBY] ExecuteThread: ’11’ for queue: ‘weblogic.kernel.Default (self-tuning)'” id=221 idx=0x370 tid=65297 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: weblogic/work/ExecuteThread@0x235ea1378[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at weblogic/work/ExecuteThread.waitForRequest(ExecuteThread.java:205)
^– Lock released while waiting: weblogic/work/ExecuteThread@0x235ea1378[fat lock]
at weblogic/work/ExecuteThread.run(ExecuteThread.java:226)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“[STANDBY] ExecuteThread: ’12’ for queue: ‘weblogic.kernel.Default (self-tuning)'” id=226 idx=0x384 tid=65314 prio=9 alive, waiting, native_blocked, daemon
— Waiting for notification on: weblogic/work/ExecuteThread@0x23040e6a8[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at weblogic/work/ExecuteThread.waitForRequest(ExecuteThread.java:205)
^– Lock released while waiting: weblogic/work/ExecuteThread@0x23040e6a8[fat lock]
at weblogic/work/ExecuteThread.run(ExecuteThread.java:226)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“[STANDBY] ExecuteThread: ’13’ for queue: ‘weblogic.kernel.Default (self-tuning)'” id=227 idx=0x388 tid=65315 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: weblogic/work/ExecuteThread@0x23042e6a8[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at weblogic/work/ExecuteThread.waitForRequest(ExecuteThread.java:205)
^– Lock released while waiting: weblogic/work/ExecuteThread@0x23042e6a8[fat lock]
at weblogic/work/ExecuteThread.run(ExecuteThread.java:226)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“oracle.dfw.impl.incident.DiagnosticsDataExtractorImpl – Incident Dump Executor (created: Sat Jul 27 01:13:06 EEST 2013)” id=1178 idx=0x3c0 tid=11306 prio=5 alive, daemon
at bea/jmapi/DiagnosticCommandImpl.execute(Ljava/lang/String;Ljava/io/FileDescriptor;)V(Native Method)
at bea/jmapi/DiagnosticCommandImpl.execute(DiagnosticCommandImpl.java:53)
at com/bea/jvm/DiagnosticCommand.execute(DiagnosticCommand.java:245)
at oracle/dfw/impl/dump/ExternalUtility.executeJRockitCommand(ExternalUtility.java:253)
at oracle/dfw/impl/dump/ExternalUtility.execute(ExternalUtility.java:97)
^– Holding lock: java/lang/Object@0x1041f9360[thin lock]
at oracle/dfw/impl/dump/ThreadDump.executeDump(ThreadDump.java:136)
at oracle/dfw/impl/dump/DumpManagerImpl.executeDump(DumpManagerImpl.java:567)
at oracle/dfw/impl/incident/DiagnosticsDataExtractorImpl$SingleDumpExecutor$2.run(DiagnosticsDataExtractorImpl.java:2050)
at oracle/dfw/impl/incident/DiagnosticsDataExtractorImpl$SingleDumpExecutor$2.run(DiagnosticsDataExtractorImpl.java:2046)
at jrockit/vm/AccessController.doPrivileged(AccessController.java:254)[optimized]
at oracle/security/jps/util/JpsSubject.doAsPrivileged(JpsSubject.java:324)
at oracle/security/jps/internal/jaas/AccActionExecutor.execute(AccActionExecutor.java:74)
at oracle/security/jps/internal/jaas/AbstractSubjectSecurity$ActionExecutorWrapper.execute(AbstractSubjectSecurity.java:242)
at oracle/security/jps/internal/jaas/CascadeActionExecutor$SubjectPrivilegedExceptionAction.run(CascadeActionExecutor.java:83)
at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)[inlined]
at weblogic/security/service/SecurityManager.runAs(SecurityManager.java:146)[optimized]
at weblogic/security/Security.runAs(Security.java:61)
at oracle/security/jps/wls/jaas/WlsActionExecutor.execute(WlsActionExecutor.java:51)
at oracle/security/jps/internal/jaas/CascadeActionExecutor.execute(CascadeActionExecutor.java:56)
at oracle/security/jps/internal/jaas/AbstractSubjectSecurity$ActionExecutorWrapper.execute(AbstractSubjectSecurity.java:242)
at oracle/security/jps/internal/jaas/AbstractSubjectSecurity.executeAs(AbstractSubjectSecurity.java:196)
at oracle/dfw/spi/weblogic/SecurityContextImpl.executeAs(SecurityContextImpl.java:130)
at oracle/dfw/impl/incident/DiagnosticsDataExtractorImpl$SingleDumpExecutor$3.run(DiagnosticsDataExtractorImpl.java:2063)
at oracle/dfw/impl/incident/DiagnosticsDataExtractorImpl$SingleDumpExecutor$3.run(DiagnosticsDataExtractorImpl.java:2059)
at jrockit/vm/AccessController.doPrivileged(AccessController.java:254)[inlined]
at jrockit/vm/AccessController.doPrivileged(AccessController.java:268)[optimized]
at oracle/dfw/impl/incident/DiagnosticsDataExtractorImpl$SingleDumpExecutor.call(DiagnosticsDataExtractorImpl.java:2056)
at oracle/dfw/impl/incident/DiagnosticsDataExtractorImpl$SingleDumpExecutor.call(DiagnosticsDataExtractorImpl.java:1963)
at java/util/concurrent/FutureTask$Sync.innerRun(FutureTask.java:303)
at java/util/concurrent/FutureTask.run(FutureTask.java:138)
at java/util/concurrent/ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“JCoTimeoutChecker” id=244 idx=0x3cc tid=65419 prio=5 alive, waiting, native_blocked, daemon
— Waiting for notification on: java/util/ArrayList@0x23041e6a0[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at com/sap/conn/jco/rt/AutoJobRunner.run(AutoJobRunner.java:124)
^– Lock released while waiting: java/util/ArrayList@0x23041e6a0[fat lock]
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“oracle.dfw.impl.incident.DiagnosticsDataExtractorImpl – Incident Dump Executor (created: Sat Jul 27 01:13:06 EEST 2013)” id=1179 idx=0x3e0 tid=11307 prio=5 alive, native_blocked, daemon
at java/util/zip/ZipFile.getEntry(JLjava/lang/String;Z)J(Native Method)
at java/util/zip/ZipFile.getEntry(ZipFile.java:150)
at java/util/jar/JarFile.getEntry(JarFile.java:209)
at java/util/jar/JarFile.getJarEntry(JarFile.java:192)
at sun/misc/URLClassPath$JarLoader.getResource(URLClassPath.java:757)
at sun/misc/URLClassPath.getResource(URLClassPath.java:169)
at java/net/URLClassLoader$1.run(URLClassLoader.java:194)
at jrockit/vm/AccessController.doPrivileged(AccessController.java:254)[optimized]
at java/net/URLClassLoader.findClass(URLClassLoader.java:190)
at java/lang/ClassLoader.loadClass(ClassLoader.java:306)
^– Holding lock: sun/misc/Launcher$AppClassLoader@0x22287d778[recursive]
at sun/misc/Launcher$AppClassLoader.loadClass(Launcher.java:308)
^– Holding lock: sun/misc/Launcher$AppClassLoader@0x22287d778[recursive]
at java/lang/ClassLoader.loadClass(ClassLoader.java:247)
at jrockit/vm/Classes.loadClassInternal(Classes.java:76)
^– Holding lock: sun/misc/Launcher$AppClassLoader@0x22287d778[thin lock]
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
at jrockit/vm/RNI.initializeClass(J)V(Native Method)
at oracle/dms/instrument/Noun.dumpMetrics(Noun.java:1759)
at oracle/dfw/impl/dump/DMSDump.executeDump(DMSDump.java:305)
at oracle/dfw/impl/dump/DumpManagerImpl.executeDump(DumpManagerImpl.java:567)
at oracle/dfw/impl/incident/DiagnosticsDataExtractorImpl$SingleDumpExecutor$2.run(DiagnosticsDataExtractorImpl.java:2050)
at oracle/dfw/impl/incident/DiagnosticsDataExtractorImpl$SingleDumpExecutor$2.run(DiagnosticsDataExtractorImpl.java:2046)
at jrockit/vm/AccessController.doPrivileged(AccessController.java:254)[optimized]
at oracle/security/jps/util/JpsSubject.doAsPrivileged(JpsSubject.java:324)
at oracle/security/jps/internal/jaas/AccActionExecutor.execute(AccActionExecutor.java:74)
at oracle/security/jps/internal/jaas/AbstractSubjectSecurity$ActionExecutorWrapper.execute(AbstractSubjectSecurity.java:242)
at oracle/security/jps/internal/jaas/CascadeActionExecutor$SubjectPrivilegedExceptionAction.run(CascadeActionExecutor.java:83)
at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)[inlined]
at weblogic/security/service/SecurityManager.runAs(SecurityManager.java:146)[optimized]
at weblogic/security/Security.runAs(Security.java:61)
at oracle/security/jps/wls/jaas/WlsActionExecutor.execute(WlsActionExecutor.java:51)
at oracle/security/jps/internal/jaas/CascadeActionExecutor.execute(CascadeActionExecutor.java:56)
at oracle/security/jps/internal/jaas/AbstractSubjectSecurity$ActionExecutorWrapper.execute(AbstractSubjectSecurity.java:242)
at oracle/security/jps/internal/jaas/AbstractSubjectSecurity.executeAs(AbstractSubjectSecurity.java:196)
at oracle/dfw/spi/weblogic/SecurityContextImpl.executeAs(SecurityContextImpl.java:130)
at oracle/dfw/impl/incident/DiagnosticsDataExtractorImpl$SingleDumpExecutor$3.run(DiagnosticsDataExtractorImpl.java:2063)
at oracle/dfw/impl/incident/DiagnosticsDataExtractorImpl$SingleDumpExecutor$3.run(DiagnosticsDataExtractorImpl.java:2059)
at jrockit/vm/AccessController.doPrivileged(AccessController.java:254)[inlined]
at jrockit/vm/AccessController.doPrivileged(AccessController.java:268)[optimized]
at oracle/dfw/impl/incident/DiagnosticsDataExtractorImpl$SingleDumpExecutor.call(DiagnosticsDataExtractorImpl.java:2056)
at oracle/dfw/impl/incident/DiagnosticsDataExtractorImpl$SingleDumpExecutor.call(DiagnosticsDataExtractorImpl.java:1963)
at java/util/concurrent/FutureTask$Sync.innerRun(FutureTask.java:303)
at java/util/concurrent/FutureTask.run(FutureTask.java:138)
at java/util/concurrent/ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

“oracle.dfw.impl.incident.DiagnosticsDataExtractorImpl – Incident Dump Executor (created: Sat Jul 27 01:13:06 EEST 2013)” id=1180 idx=0x3e4 tid=11308 prio=5 alive, native_blocked, daemon
at jrockit/vm/RNI.generateVirtualCode(Ljava/lang/Object;JJ)J(Native Method)
at oracle/dfw/sampling/DumpSampling.dumpArchives(DumpSampling.java:0)
at oracle/dfw/sampling/DumpSamplingArchive.executeDump(DumpSamplingArchive.java:78)
at oracle/dfw/impl/dump/DumpManagerImpl.executeDump(DumpManagerImpl.java:567)
at oracle/dfw/impl/incident/DiagnosticsDataExtractorImpl$SingleDumpExecutor$2.run(DiagnosticsDataExtractorImpl.java:2050)
at oracle/dfw/impl/incident/DiagnosticsDataExtractorImpl$SingleDumpExecutor$2.run(DiagnosticsDataExtractorImpl.java:2046)
at jrockit/vm/AccessController.doPrivileged(AccessController.java:254)[optimized]
at oracle/security/jps/util/JpsSubject.doAsPrivileged(JpsSubject.java:324)
at oracle/security/jps/internal/jaas/AccActionExecutor.execute(AccActionExecutor.java:74)
at oracle/security/jps/internal/jaas/AbstractSubjectSecurity$ActionExecutorWrapper.execute(AbstractSubjectSecurity.java:242)
at oracle/security/jps/internal/jaas/CascadeActionExecutor$SubjectPrivilegedExceptionAction.run(CascadeActionExecutor.java:83)
at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)[inlined]
at weblogic/security/service/SecurityManager.runAs(SecurityManager.java:146)[optimized]
at weblogic/security/Security.runAs(Security.java:61)
at oracle/security/jps/wls/jaas/WlsActionExecutor.execute(WlsActionExecutor.java:51)
at oracle/security/jps/internal/jaas/CascadeActionExecutor.execute(CascadeActionExecutor.java:56)
at oracle/security/jps/internal/jaas/AbstractSubjectSecurity$ActionExecutorWrapper.execute(AbstractSubjectSecurity.java:242)
at oracle/security/jps/internal/jaas/AbstractSubjectSecurity.executeAs(AbstractSubjectSecurity.java:196)
at oracle/dfw/spi/weblogic/SecurityContextImpl.executeAs(SecurityContextImpl.java:130)
at oracle/dfw/impl/incident/DiagnosticsDataExtractorImpl$SingleDumpExecutor$3.run(DiagnosticsDataExtractorImpl.java:2063)
at oracle/dfw/impl/incident/DiagnosticsDataExtractorImpl$SingleDumpExecutor$3.run(DiagnosticsDataExtractorImpl.java:2059)
at jrockit/vm/AccessController.doPrivileged(AccessController.java:254)[inlined]
at jrockit/vm/AccessController.doPrivileged(AccessController.java:268)[optimized]
at oracle/dfw/impl/incident/DiagnosticsDataExtractorImpl$SingleDumpExecutor.call(DiagnosticsDataExtractorImpl.java:2056)
at oracle/dfw/impl/incident/DiagnosticsDataExtractorImpl$SingleDumpExecutor.call(DiagnosticsDataExtractorImpl.java:1963)
at java/util/concurrent/FutureTask$Sync.innerRun(FutureTask.java:303)
at java/util/concurrent/FutureTask.run(FutureTask.java:138)
at java/util/concurrent/ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
— end of trace

Blocked lock chains
===================
Chain 2:
“ExecuteThread: ‘2’ for queue: ‘weblogic.socket.Muxer'” id=27 idx=0x80 tid=64853 waiting for java/lang/String@0x2227ec6e0 held by:
“ExecuteThread: ‘1’ for queue: ‘weblogic.socket.Muxer'” id=26 idx=0x7c tid=64852 in chain 1

Chain 3:
“ExecuteThread: ‘3’ for queue: ‘weblogic.socket.Muxer'” id=28 idx=0x84 tid=64854 waiting for java/lang/String@0x2227ec6e0 held by:
“ExecuteThread: ‘1’ for queue: ‘weblogic.socket.Muxer'” id=26 idx=0x7c tid=64852 in chain 1

Open lock chains
================
Chain 1:
“ExecuteThread: ‘0’ for queue: ‘weblogic.socket.Muxer'” id=25 idx=0x78 tid=64851 waiting for java/lang/String@0x2227ec6e0 held by:
“ExecuteThread: ‘1’ for queue: ‘weblogic.socket.Muxer'” id=26 idx=0x7c tid=64852 (active)

===== END OF THREAD DUMP ===============

===== THREAD TIMING STATISTICS =====

id Cpu/ms User/ms Blk/ms Wait/ms #Blk #Wait ECID
———- ———— ———— ———— ———— ———— ———— —————————————-
id=1 8200 7790 1 121710 53 120
id=2 0 0 0 0 0 0
id=3 80 50 0 0 0 0
id=4 10 10 0 0 0 0
id=5 76800 76200 0 0 0 0
id=6 1590570 1584290 0 0 0 0
id=7 90 90 0 0 0 0
id=8 10 10 0 0 0 0
id=9 0 0 0 0 0 0
id=10 31370 2910 0 0 0 0
id=13 10 10 0 22183467 0 24
id=14 4250 4070 0 26302321 1 13157
id=15 117240 111670 4736 26206225 27156 155390 a80fff9a887b4f5b:-3f7de2e:1401b797525:-8000-00000000000066b7
id=16 0 0 0 0 0 1
id=18 10 10 0 26200037 0 264
id=19 0 0 0 0 0 0
id=20 19690 14270 2 26299079 256 306438
id=21 920 800 29 26306700 14 5959
id=24 130 90 0 26300398 0 2634
id=25 2120 1810 19723846 0 8939 1
id=26 2260 1900 19628457 0 8976 1
id=27 2120 1780 19736816 0 8940 1
id=28 2330 1970 19774333 0 8941 1
id=31 80 70 0 161074 0 296
id=34 70 60 0 26310120 1 877
id=35 5230 3400 0 26306399 0 52616
id=36 0 0 0 0 0 1
id=37 0 0 0 0 0 1
id=38 4610 2930 0 26299084 1 8772
id=39 370 250 0 26305493 0 1338
id=41 230 150 0 26305647 0 5261
id=42 220 150 0 26305636 0 5261
id=43 210 140 0 26305638 0 5261
id=44 0 0 0 25522519 0 16
id=45 20 20 0 26302516 0 440
id=49 0 0 0 26309078 0 23
id=51 0 0 0 300053 0 8
id=52 10 10 0 26309106 0 1
id=56 10 10 0 26280060 0 439
id=61 240 150 0 26305729 0 5261
id=66 1910 1410 0 26306265 0 26303
id=76 1190 810 0 26301606 0 26298
id=77 0 0 0 340 0 6
id=78 0 0 0 295 0 13
id=79 290 210 4 26296005 3 5270
id=80 10 10 0 0 2 0
id=81 0 0 0 0 0 0
id=82 0 0 0 0 0 1
id=83 0 0 0 21599993 0 15
id=85 10 10 0 31041 0 7
id=86 0 0 0 0 0 0
id=87 0 0 0 0 2 0
id=88 2110 1640 0 26290604 112 26278
id=89 3990 2810 0 26288912 0 26279
id=90 0 0 0 0 1 1
id=91 1840 1090 0 0 1 0
id=92 6390 5340 0 0 60 0
id=93 1480 1110 0 26288706 20 26286
id=95 1490 1160 0 26288676 23 26287
id=96 1820 1430 0 26287621 0 26286
id=97 0 0 0 0 0 1
id=98 0 0 0 0 0 0
id=99 0 0 2 0 1 1
id=100 0 0 0 0 1 1
id=101 0 0 0 0 1 1
id=102 0 0 0 200 2 3
id=103 0 0 10 100 1 2
id=104 0 0 10 0 2 1
id=105 0 0 0 0 1 1
id=106 0 0 0 0 1 1
id=107 0 0 0 0 1 1
id=108 0 0 0 0 1 1
id=109 0 0 0 0 1 1
id=110 0 0 5 0 2 1
id=111 0 0 4 0 2 1
id=112 0 0 4 0 2 1
id=113 0 0 4 0 2 1
id=114 0 0 4 100 2 2
id=115 0 0 1 0 1 1
id=116 0 0 3 0 2 1
id=117 0 0 3 0 2 1
id=118 0 0 3 0 2 1
id=119 0 0 3 0 2 1
id=120 0 0 2 100 2 2
id=121 0 0 1 0 1 1
id=122 0 0 1 0 1 1
id=123 0 0 0 0 0 1
id=124 0 0 0 0 0 1
id=125 0 0 0 0 0 1
id=126 0 0 0 0 0 1
id=127 0 0 0 0 0 1
id=128 0 0 0 0 0 1
id=129 0 0 0 0 0 1
id=130 0 0 0 0 0 1
id=131 0 0 0 0 0 1
id=132 0 0 0 0 0 1
id=133 0 0 0 0 0 1
id=134 0 0 0 0 0 1
id=135 0 0 0 0 0 1
id=136 0 0 0 100 0 2
id=137 0 0 0 0 0 1
id=138 0 0 0 0 0 1
id=139 0 0 0 0 0 1
id=140 0 0 0 0 0 1
id=141 0 0 0 101 0 2
id=142 0 0 0 0 0 1
id=143 0 0 0 0 0 1
id=144 0 0 0 0 0 1
id=145 0 0 0 0 0 1
id=146 0 0 0 0 0 1
id=147 0 0 0 0 0 1
id=148 0 0 0 100 0 2
id=149 0 0 0 100 1 2
id=150 0 0 0 100 0 2
id=151 0 0 0 207 1 3
id=152 0 0 0 100 1 2
id=153 0 0 0 100 2 2
id=154 0 0 0 200 0 3
id=155 0 0 0 100 1 2
id=156 0 0 0 100 0 2
id=157 0 0 0 100 0 2
id=158 0 0 0 100 0 2
id=159 0 0 0 101 0 2
id=160 0 0 0 100 0 2
id=161 0 0 0 100 0 2
id=162 0 0 0 100 0 2
id=163 0 0 0 100 0 2
id=164 0 0 0 100 0 2
id=165 0 0 0 100 0 2
id=166 0 0 0 100 0 2
id=167 0 0 0 100 0 2
id=168 0 0 0 100 0 2
id=169 0 0 0 100 0 2
id=170 0 0 0 0 0 1
id=171 0 0 0 0 0 1
id=172 0 0 0 0 0 1
id=173 0 0 0 0 0 1
id=174 0 0 0 0 0 1
id=175 0 0 0 0 0 1
id=176 0 0 0 0 0 1
id=177 0 0 0 0 0 1
id=178 0 0 0 0 0 1
id=179 0 0 0 0 0 1
id=180 0 0 0 0 0 1
id=181 0 0 0 0 0 1
id=182 0 0 0 0 0 1
id=183 0 0 0 0 0 1
id=184 0 0 0 0 0 1
id=185 0 0 0 0 0 1
id=186 0 0 0 0 0 1
id=187 0 0 0 0 0 1
id=188 0 0 0 0 0 1
id=189 0 0 0 0 0 1
id=190 0 0 0 0 0 1
id=191 0 0 0 0 0 1
id=192 0 0 0 0 0 1
id=193 0 0 0 0 0 1
id=194 0 0 0 0 0 1
id=195 0 0 0 0 0 1
id=196 0 0 0 0 0 1
id=197 0 0 0 0 0 1
id=198 0 0 0 0 0 1
id=199 250 180 0 26273057 1 5271
id=200 260 170 1 26273061 1 5268
id=201 40340 40060 0 26229739 22 2092
id=202 10 10 0 21601002 0 55
id=203 0 0 0 0 0 0
id=207 2080 1730 1 26260537 1 26261
id=208 35470 32400 713 26210298 26657 149180 a80fff9a887b4f5b:-3f7de2e:1401b797525:-8000-00000000000066af
id=209 1230 900 0 26220595 1 439 a80fff9a887b4f5b:-3f7de2e:1401b797525:-8000-0000000000000007
id=210 520 390 0 26220746 1 442 a80fff9a887b4f5b:-3f7de2e:1401b797525:-8000-0000000000000009
id=211 21220 19210 498 25573733 24577 140237 a80fff9a887b4f5b:-3f7de2e:1401b797525:-8000-00000000000065d3
id=212 1010 860 5 26245291 5 2650
id=213 120 100 0 26219832 0 442
id=214 120 100 0 26219824 0 440
id=215 110 90 0 26219843 0 439
id=216 120 110 0 26219823 0 439
id=218 960 890 112 26219303 4031 1037 a80fff9a887b4f5b:-3f7de2e:1401b797525:-8000-000000000000671e
id=219 80 70 2 0 1 0
id=220 440 390 96 26216310 4064 1010
id=221 440 420 151 26215898 4035 980
id=226 110 100 3 26185442 49 963
id=227 90 70 8 26185388 48 966
id=1178 210 170 25 0 17 0
id=244 30 30 0 25860039 0 95
id=1179 170 150 16 0 13 0
id=1180 170 170 23 0 15 0

===== END OF THREAD TIMING STATISTICS =====

===== THREAD CONTEXT INFORMATION =====

id ECID RID Context Values
———- ————————————————– —– ————————————————————
id=15 a80fff9a887b4f5b:-3f7de2e:1401b797525:-8000-00000000000066b7 0
id=208 a80fff9a887b4f5b:-3f7de2e:1401b797525:-8000-00000000000066af 0 dbRID=0:3
id=209 a80fff9a887b4f5b:-3f7de2e:1401b797525:-8000-0000000000000007 0
id=210 a80fff9a887b4f5b:-3f7de2e:1401b797525:-8000-0000000000000009 0
id=211 a80fff9a887b4f5b:-3f7de2e:1401b797525:-8000-00000000000065d3 0 dbRID=0:1
id=218 a80fff9a887b4f5b:-3f7de2e:1401b797525:-8000-000000000000671e 0

===== END OF THREAD CONTEXT INFORMATION =====