History | Log In     View a printable version of the current page.  
   HOME       BROWSE PROJECT       FIND ISSUES   
    QUICK SEARCH:  
Issue Details (XML | Word | Printable)

Key: QUARTZ-555
Type: Bug Bug
Status: Closed Closed
Resolution: Fixed
Priority: Major Major
Assignee: James House
Reporter: Maciej Szefler
Votes: 1
Watchers: 0
Operations

If you were logged in you would be able to see more operations.
Quartz Scheduler

SimpleSemaphore.java contains concurrency bug that can cause

Created: 24/Jan/07 11:45 AM   Updated: 29/Mar/07 12:52 PM
Component/s: Job Stores
Affects Version/s: 1.6
Fix Version/s: 1.6.1

Environment: all

Flags: Patch, Important


 Description  « Hide
the SimpleSemaphore.releasLock method uses Object.notify() to signal the thread blocked on SimpleSemaphore.obtainLock(). But, since this is a multiplexed lock, the thread that is awoken with the notify() is not necessarily waiting for the lock that was released, hence the signal can get lost. Here is an example:

Thread0: obtainLock("B") --> got lock
Thread1: obtainLock("A") --> got lock
Thread2: obtainLock("B") --> wait()
Thread3: obtainLock("A") --> wait()
Thread1: releaseLock("A") --> notify() --> signal sent to thread thread2 (random)
Thread2: obtainLock("B") --> lock "B" still held, wait()
Thread0: releasLock("B") --> notify() --> signal sent to thread3 (random)
Thread3: obtainLock("A") --> gets lock "A"
... at this point Thread2 is blocked even though no one is holding lock B

Solution: change to notify() to notifyAll()




    

 All   Comments   Change History      Sort Order:
[ Permlink | « Hide ]
Maciej Szefler - [26/Jan/07 01:59 PM ]
The following thread dump demonstrates a deadlock condition caused by this bug:
                                             
Full thread dump Java HotSpot(TM) Server VM (1.5.0_08-b03 mixed mode):

"Thread-82" daemon prio=1 tid=0x0a264d18 nid=0x7cd5 in Object.wait() [0x8807d000..0x8807dee0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x94bdfe20> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
        - locked <0x94bdfe20> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132)
        at org.apache.batik.util.CleanerThread.run(Unknown Source)

"pool-2-thread-3" prio=1 tid=0x0a1b6bd8 nid=0x7c98 in Object.wait() [0x7bc4d000..0x7bc4e0e0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x922c12a0> (a org.quartz.impl.jdbcjobstore.SimpleSemaphore)
        at java.lang.Object.wait(Object.java:474)
        at org.quartz.impl.jdbcjobstore.SimpleSemaphore.obtainLock(SimpleSemaphore.java:96)
        - locked <0x922c12a0> (a org.quartz.impl.jdbcjobstore.SimpleSemaphore)
        at org.apache.ode.bpel.scheduler.quartz.JobStoreJTA.triggeredJobComplete(JobStoreJTA.java:1176)
        at org.quartz.core.QuartzScheduler.notifyJobStoreJobComplete(QuartzScheduler.java:1490)
        at org.quartz.core.JobRunShell.run(JobRunShell.java:262)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675)
        at java.lang.Thread.run(Thread.java:595)

"pool-2-thread-1" prio=1 tid=0x0a1bf0a8 nid=0x7c96 in Object.wait() [0x7fe4c000..0x7fe4d1e0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x922c12a0> (a org.quartz.impl.jdbcjobstore.SimpleSemaphore)
        at java.lang.Object.wait(Object.java:474)
        at org.quartz.impl.jdbcjobstore.SimpleSemaphore.obtainLock(SimpleSemaphore.java:96)
        - locked <0x922c12a0> (a org.quartz.impl.jdbcjobstore.SimpleSemaphore)
        at org.apache.ode.bpel.scheduler.quartz.JobStoreJTA.triggeredJobComplete(JobStoreJTA.java:1174)
        at org.quartz.core.QuartzScheduler.notifyJobStoreJobComplete(QuartzScheduler.java:1490)
        at org.quartz.core.JobRunShell.run(JobRunShell.java:262)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675)
        at java.lang.Thread.run(Thread.java:595)

"SessionScavenger" daemon prio=1 tid=0x85d92830 nid=0x7c7d waiting on condition [0x7ff4e000..0x7ff4eee0]
        at java.lang.Thread.sleep(Native Method)
        at org.mortbay.jetty.servlet.AbstractSessionManager$SessionScavenger.run(AbstractSessionManager.java:587)

"SessionScavenger" daemon prio=1 tid=0x0997f7a0 nid=0x7c7b waiting on condition [0x80050000..0x80050f60]
        at java.lang.Thread.sleep(Native Method)
        at org.mortbay.jetty.servlet.AbstractSessionManager$SessionScavenger.run(AbstractSessionManager.java:587)

"SessionScavenger" daemon prio=1 tid=0x86372f18 nid=0x7c7a waiting on condition [0x7c4a5000..0x7c4a5fe0]
        at java.lang.Thread.sleep(Native Method)
        at org.mortbay.jetty.servlet.AbstractSessionManager$SessionScavenger.run(AbstractSessionManager.java:587)

"SessionScavenger" daemon prio=1 tid=0x09b42000 nid=0x7c79 waiting on condition [0x7c52b000..0x7c52c060]
        at java.lang.Thread.sleep(Native Method)
        at org.mortbay.jetty.servlet.AbstractSessionManager$SessionScavenger.run(AbstractSessionManager.java:587)

"SessionScavenger" daemon prio=1 tid=0x09a5cfc0 nid=0x7c78 waiting on condition [0x7c5dc000..0x7c5dd0e0]
        at java.lang.Thread.sleep(Native Method)
        at org.mortbay.jetty.servlet.AbstractSessionManager$SessionScavenger.run(AbstractSessionManager.java:587)

"SessionScavenger" daemon prio=1 tid=0x87e6ca00 nid=0x7c77 waiting on condition [0x7c832000..0x7c832160]
        at java.lang.Thread.sleep(Native Method)
        at org.mortbay.jetty.servlet.AbstractSessionManager$SessionScavenger.run(AbstractSessionManager.java:587)

"SessionScavenger" daemon prio=1 tid=0x869ffc80 nid=0x7c75 waiting on condition [0x7c8b3000..0x7c8b31e0]
        at java.lang.Thread.sleep(Native Method)
        at org.mortbay.jetty.servlet.AbstractSessionManager$SessionScavenger.run(AbstractSessionManager.java:587)

"SessionScavenger" daemon prio=1 tid=0x084cc910 nid=0x7c73 waiting on condition [0x7f1ee000..0x7f1eee60]
        at java.lang.Thread.sleep(Native Method)
        at org.mortbay.jetty.servlet.AbstractSessionManager$SessionScavenger.run(AbstractSessionManager.java:587)

"Thread-81" prio=1 tid=0x084ccf98 nid=0x7c72 in Object.wait() [0x7fdcb000..0x7fdcbee0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x9230df08> (a org.apache.ode.axis2.deploy.DeploymentPoller$PollingThread)
        at org.apache.ode.axis2.deploy.DeploymentPoller$PollingThread.run(DeploymentPoller.java:182)
        - locked <0x9230df08> (a org.apache.ode.axis2.deploy.DeploymentPoller$PollingThread)

"RMI RenewClean-[127.0.0.1:39796]" daemon prio=1 tid=0x081fd940 nid=0x7c6e in Object.wait() [0x7ffcf000..0x7ffd00e0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x922e8100> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
        - locked <0x922e8100> (a java.lang.ref.ReferenceQueue$Lock)
        at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:501)
        at java.lang.Thread.run(Thread.java:595)

"RMI TCP Accept-2099" daemon prio=1 tid=0x8693a2c8 nid=0x7c6c runnable [0x873f5000..0x873f51e0]
        at java.net.PlainSocketImpl.socketAccept(Native Method)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
        - locked <0x92291e78> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:450)
        at java.net.ServerSocket.accept(ServerSocket.java:421)
        at sun.rmi.transport.tcp.TCPTransport.run(TCPTransport.java:340)
        at java.lang.Thread.run(Thread.java:595)

"RMI TCP Accept-0" daemon prio=1 tid=0x87ec3758 nid=0x7c6b runnable [0x874f6000..0x874f6e60]
        at java.net.PlainSocketImpl.socketAccept(Native Method)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
        - locked <0x9228e908> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:450)
        at java.net.ServerSocket.accept(ServerSocket.java:421)
        at sun.rmi.transport.tcp.TCPTransport.run(TCPTransport.java:340)
        at java.lang.Thread.run(Thread.java:595)

"pool-1-thread-1" prio=1 tid=0x8693d740 nid=0x7c6a waiting on condition [0x87373000..0x87373ee0]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1767)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
        at java.lang.Thread.run(Thread.java:595)

"QuartzScheduler_ODE-ODE_MisfireHandler" prio=1 tid=0x87ec4d38 nid=0x7c69 in Object.wait() [0x882fe000..0x882fef60]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x922c12a0> (a org.quartz.impl.jdbcjobstore.SimpleSemaphore)
        at java.lang.Object.wait(Object.java:474)
        at org.quartz.impl.jdbcjobstore.SimpleSemaphore.obtainLock(SimpleSemaphore.java:96)
        - locked <0x922c12a0> (a org.quartz.impl.jdbcjobstore.SimpleSemaphore)
        at org.apache.ode.bpel.scheduler.quartz.JobStoreJTA.doRecoverMisfires(JobStoreJTA.java:1202)
        at org.quartz.impl.jdbcjobstore.JobStoreSupport$MisfireHandler.manage(JobStoreSupport.java:2409)
        at org.quartz.impl.jdbcjobstore.JobStoreSupport$MisfireHandler.run(JobStoreSupport.java:2428)

"Thread-79" daemon prio=1 tid=0x081fdc38 nid=0x7c68 waiting on condition [0x800d1000..0x800d1fe0]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.geronimo.transaction.manager.TransactionTimer$CurrentTime.run(TransactionTimer.java:38)

"ODE_QuartzSchedulerThread" prio=1 tid=0x083bd468 nid=0x7c67 in Object.wait() [0x80152000..0x80153060]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x922c12a0> (a org.quartz.impl.jdbcjobstore.SimpleSemaphore)
        at java.lang.Object.wait(Object.java:474)
        at org.quartz.impl.jdbcjobstore.SimpleSemaphore.obtainLock(SimpleSemaphore.java:96)
        - locked <0x922c12a0> (a org.quartz.impl.jdbcjobstore.SimpleSemaphore)
        at org.apache.ode.bpel.scheduler.quartz.JobStoreJTA.acquireNextTrigger(JobStoreJTA.java:1054)
        at org.quartz.core.QuartzSchedulerThread.run(QuartzSchedulerThread.java:233)

"derby.rawStoreDaemon" daemon prio=1 tid=0x089116f0 nid=0x7c66 in Object.wait() [0x801d3000..0x801d40e0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91e93098> (a org.apache.derby.impl.services.daemon.BasicDaemon)
        at org.apache.derby.impl.services.daemon.BasicDaemon.rest(Unknown Source)
        - locked <0x91e93098> (a org.apache.derby.impl.services.daemon.BasicDaemon)
        at org.apache.derby.impl.services.daemon.BasicDaemon.run(Unknown Source)
        at java.lang.Thread.run(Thread.java:595)

"Timer-8" daemon prio=1 tid=0x092ee998 nid=0x7c65 in Object.wait() [0x80255000..0x80255160]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91f88f78> (a java.util.TaskQueue)
        at java.util.TimerThread.mainLoop(Timer.java:509)
        - locked <0x91f88f78> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:462)

"SessionScavenger" daemon prio=1 tid=0x082dbc20 nid=0x7c64 waiting on condition [0x802d6000..0x802d61e0]
        at java.lang.Thread.sleep(Native Method)
        at org.mortbay.jetty.servlet.AbstractSessionManager$SessionScavenger.run(AbstractSessionManager.java:587)

"Timer-7" daemon prio=1 tid=0x08b24118 nid=0x7c63 in Object.wait() [0x81fa3000..0x81fa3e60]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91dd9f78> (a java.util.TaskQueue)
        at java.util.TimerThread.mainLoop(Timer.java:509)
        - locked <0x91dd9f78> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:462)

"SessionScavenger" daemon prio=1 tid=0x08393490 nid=0x7c62 waiting on condition [0x82193000..0x82193ee0]
        at java.lang.Thread.sleep(Native Method)
        at org.mortbay.jetty.servlet.AbstractSessionManager$SessionScavenger.run(AbstractSessionManager.java:587)

"derby.antiGC" daemon prio=1 tid=0x08d0bc18 nid=0x7c61 in Object.wait() [0x82c71000..0x82c71f60]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91a40b78> (a org.apache.derby.impl.services.monitor.AntiGC)
        at java.lang.Object.wait(Object.java:474)
        at org.apache.derby.impl.services.monitor.AntiGC.run(Unknown Source)
        - locked <0x91a40b78> (a org.apache.derby.impl.services.monitor.AntiGC)
        at java.lang.Thread.run(Thread.java:595)

"Geronimo hot deploy scanner" daemon prio=1 tid=0x086c26f8 nid=0x7c60 sleeping[0x82efe000..0x82efefe0]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.geronimo.deployment.hot.DirectoryMonitor.run(DirectoryMonitor.java:194)
        at java.lang.Thread.run(Thread.java:595)

"SessionScavenger" daemon prio=1 tid=0x088cce10 nid=0x7c5f waiting on condition [0x83097000..0x83098060]
        at java.lang.Thread.sleep(Native Method)
        at org.mortbay.jetty.servlet.AbstractSessionManager$SessionScavenger.run(AbstractSessionManager.java:587)

"Geronimo Config Store Reaper" daemon prio=1 tid=0x08c6cbb8 nid=0x7c5e waiting on condition [0x834c5000..0x834c60e0]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.geronimo.deployment.Deployer$DeployerReaper.run(Deployer.java:438)
        at java.lang.Thread.run(Thread.java:595)

"GeronimoSSLListener2-24" prio=1 tid=0x08343d60 nid=0x7c5d in Object.wait() [0x837d2000..0x837d2160]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91774a20> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91774a20> (a org.mortbay.util.ThreadPool$PoolThread)

"GeronimoSSLListener2-23" prio=1 tid=0x08342e18 nid=0x7c5c in Object.wait() [0x83853000..0x838531e0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x917749a8> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x917749a8> (a org.mortbay.util.ThreadPool$PoolThread)

"GeronimoSSLListener2-22" prio=1 tid=0x08341ed0 nid=0x7c5b in Object.wait() [0x838d3000..0x838d3e60]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91774930> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91774930> (a org.mortbay.util.ThreadPool$PoolThread)

"GeronimoSSLListener2-21" prio=1 tid=0x08438eb0 nid=0x7c5a in Object.wait() [0x83954000..0x83954ee0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x917748b8> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x917748b8> (a org.mortbay.util.ThreadPool$PoolThread)

"GeronimoSSLListener2-20" prio=1 tid=0x08437f68 nid=0x7c59 in Object.wait() [0x839d5000..0x839d5f60]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91774840> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91774840> (a org.mortbay.util.ThreadPool$PoolThread)

"GeronimoSSLListener2-19" prio=1 tid=0x08437020 nid=0x7c58 in Object.wait() [0x83a56000..0x83a56fe0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x917747c8> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x917747c8> (a org.mortbay.util.ThreadPool$PoolThread)

"GeronimoSSLListener2-18" prio=1 tid=0x084360d8 nid=0x7c57 in Object.wait() [0x83ad7000..0x83ad8060]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91774750> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91774750> (a org.mortbay.util.ThreadPool$PoolThread)

"GeronimoSSLListener2-17" prio=1 tid=0x08435190 nid=0x7c56 in Object.wait() [0x83b58000..0x83b590e0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x917746d8> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x917746d8> (a org.mortbay.util.ThreadPool$PoolThread)

"GeronimoSSLListener2-16" prio=1 tid=0x084342c0 nid=0x7c55 in Object.wait() [0x83bda000..0x83bda160]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91774660> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91774660> (a org.mortbay.util.ThreadPool$PoolThread)

"GeronimoSSLListener2-15" prio=1 tid=0x08433300 nid=0x7c54 in Object.wait() [0x83c5b000..0x83c5b1e0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x917745e8> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x917745e8> (a org.mortbay.util.ThreadPool$PoolThread)

"GeronimoSSLListener2-14" prio=1 tid=0x08432440 nid=0x7c53 in Object.wait() [0x83cdb000..0x83cdbe60]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91774570> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91774570> (a org.mortbay.util.ThreadPool$PoolThread)

"GeronimoSSLListener2-13" prio=1 tid=0x083c94d0 nid=0x7c52 in Object.wait() [0x83d5c000..0x83d5cee0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x917744f8> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x917744f8> (a org.mortbay.util.ThreadPool$PoolThread)

"GeronimoSSLListener2-12" prio=1 tid=0x083c7580 nid=0x7c51 in Object.wait() [0x83ddd000..0x83dddf60]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91774480> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91774480> (a org.mortbay.util.ThreadPool$PoolThread)

"GeronimoSSLListener2-11" prio=1 tid=0x083c6638 nid=0x7c50 in Object.wait() [0x83e5e000..0x83e5efe0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91774408> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91774408> (a org.mortbay.util.ThreadPool$PoolThread)

"GeronimoSSLListener2-10" prio=1 tid=0x083c56f0 nid=0x7c4f in Object.wait() [0x83edf000..0x83ee0060]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91774390> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91774390> (a org.mortbay.util.ThreadPool$PoolThread)

"GeronimoSSLListener2-9" prio=1 tid=0x083c47a8 nid=0x7c4e in Object.wait() [0x83f60000..0x83f610e0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91774318> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91774318> (a org.mortbay.util.ThreadPool$PoolThread)

"GeronimoSSLListener2-8" prio=1 tid=0x083c3880 nid=0x7c4d in Object.wait() [0x83fe2000..0x83fe2160]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x917742a0> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x917742a0> (a org.mortbay.util.ThreadPool$PoolThread)

"GeronimoSSLListener2-7" prio=1 tid=0x0879a9f0 nid=0x7c4c in Object.wait() [0x84063000..0x840631e0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91774228> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91774228> (a org.mortbay.util.ThreadPool$PoolThread)

"GeronimoSSLListener2-6" prio=1 tid=0x08799b60 nid=0x7c4b in Object.wait() [0x840e3000..0x840e3e60]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x917741b0> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x917741b0> (a org.mortbay.util.ThreadPool$PoolThread)

"GeronimoSSLListener2-5" prio=1 tid=0x082c23c8 nid=0x7c4a in Object.wait() [0x84164000..0x84164ee0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91774138> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91774138> (a org.mortbay.util.ThreadPool$PoolThread)

"GeronimoSSLListener2-4" prio=1 tid=0x082be3c8 nid=0x7c49 in Object.wait() [0x841e5000..0x841e5f60]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x917740c0> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x917740c0> (a org.mortbay.util.ThreadPool$PoolThread)

"GeronimoSSLListener2-3" prio=1 tid=0x082bdca0 nid=0x7c48 in Object.wait() [0x84266000..0x84266fe0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91774048> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91774048> (a org.mortbay.util.ThreadPool$PoolThread)

"GeronimoSSLListener2-2" prio=1 tid=0x08984dc0 nid=0x7c47 in Object.wait() [0x842e7000..0x842e8060]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91773fd0> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91773fd0> (a org.mortbay.util.ThreadPool$PoolThread)

"GeronimoSSLListener2-1" prio=1 tid=0x08984730 nid=0x7c46 in Object.wait() [0x84368000..0x843690e0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91773f58> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91773f58> (a org.mortbay.util.ThreadPool$PoolThread)

"GeronimoSSLListener2-0" prio=1 tid=0x0845fbc8 nid=0x7c45 in Object.wait() [0x843ea000..0x843ea160]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91773ee0> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91773ee0> (a org.mortbay.util.ThreadPool$PoolThread)

"Acceptor [SSL: ServerSocket[addr=0.0.0.0/0.0.0.0,port=0,localport=8443]]" prio=1 tid=0x08460288 nid=0x7c44 runnable [0x8446b000..0x8446b1e0]
        at java.net.PlainSocketImpl.socketAccept(Native Method)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
        - locked <0x917735b8> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:450)
        at com.sun.net.ssl.internal.ssl.SSLServerSocketImpl.accept(SSLServerSocketImpl.java:259)
        at org.mortbay.util.ThreadedServer.acceptSocket(ThreadedServer.java:432)
        at org.mortbay.util.ThreadedServer$Acceptor.run(ThreadedServer.java:634)

"AJP13Listener1-9" prio=1 tid=0x087988e0 nid=0x7c43 in Object.wait() [0x844eb000..0x844ebe60]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x917775f0> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x917775f0> (a org.mortbay.util.ThreadPool$PoolThread)

"AJP13Listener1-8" prio=1 tid=0x08d2f398 nid=0x7c42 in Object.wait() [0x8456c000..0x8456cee0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91777578> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91777578> (a org.mortbay.util.ThreadPool$PoolThread)

"AJP13Listener1-7" prio=1 tid=0x08d2e498 nid=0x7c41 in Object.wait() [0x845ed000..0x845edf60]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91777500> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91777500> (a org.mortbay.util.ThreadPool$PoolThread)

"AJP13Listener1-6" prio=1 tid=0x08d2d598 nid=0x7c40 in Object.wait() [0x8466e000..0x8466efe0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91777488> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91777488> (a org.mortbay.util.ThreadPool$PoolThread)

"AJP13Listener1-5" prio=1 tid=0x0862d978 nid=0x7c3f in Object.wait() [0x846ef000..0x846f0060]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91777410> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91777410> (a org.mortbay.util.ThreadPool$PoolThread)

"AJP13Listener1-4" prio=1 tid=0x0862ca78 nid=0x7c3e in Object.wait() [0x84770000..0x847710e0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91777398> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91777398> (a org.mortbay.util.ThreadPool$PoolThread)

"AJP13Listener1-3" prio=1 tid=0x0862bc18 nid=0x7c3d in Object.wait() [0x847f2000..0x847f2160]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91777320> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91777320> (a org.mortbay.util.ThreadPool$PoolThread)

"AJP13Listener1-2" prio=1 tid=0x081f85d0 nid=0x7c3c in Object.wait() [0x84873000..0x848731e0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x917772a8> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x917772a8> (a org.mortbay.util.ThreadPool$PoolThread)

"AJP13Listener1-1" prio=1 tid=0x081f79d0 nid=0x7c3b in Object.wait() [0x848f3000..0x848f3e60]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91777230> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91777230> (a org.mortbay.util.ThreadPool$PoolThread)

"AJP13Listener1-0" prio=1 tid=0x081f5848 nid=0x7c3a in Object.wait() [0x84974000..0x84974ee0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x917771b8> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x917771b8> (a org.mortbay.util.ThreadPool$PoolThread)

"Acceptor ServerSocket[addr=0.0.0.0/0.0.0.0,port=0,localport=8009]" prio=1 tid=0x081f3fc0 nid=0x7c39 runnable [0x849f5000..0x849f5f60]
        at java.net.PlainSocketImpl.socketAccept(Native Method)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
        - locked <0x91777140> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:450)
        at java.net.ServerSocket.accept(ServerSocket.java:421)
        at org.mortbay.util.ThreadedServer.acceptSocket(ThreadedServer.java:432)
        at org.mortbay.util.ThreadedServer$Acceptor.run(ThreadedServer.java:634)

"Rollover" daemon prio=1 tid=0x081f44d0 nid=0x7c38 waiting on condition [0x84a76000..0x84a76fe0]
        at java.lang.Thread.sleep(Native Method)
        at org.mortbay.util.RolloverFileOutputStream$Rollover.run(RolloverFileOutputStream.java:300)

"SocketListener0-24" prio=1 tid=0x08630580 nid=0x7c37 in Object.wait() [0x84af7000..0x84af8060]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x917796e8> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x917796e8> (a org.mortbay.util.ThreadPool$PoolThread)

"SocketListener0-23" prio=1 tid=0x0862f638 nid=0x7c36 in Object.wait() [0x84b78000..0x84b790e0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91779670> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91779670> (a org.mortbay.util.ThreadPool$PoolThread)

"SocketListener0-22" prio=1 tid=0x0862e710 nid=0x7c35 in Object.wait() [0x84bfa000..0x84bfa160]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x917795f8> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x917795f8> (a org.mortbay.util.ThreadPool$PoolThread)

"SocketListener0-21" prio=1 tid=0x08754b80 nid=0x7c34 in Object.wait() [0x84c7b000..0x84c7b1e0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91779580> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91779580> (a org.mortbay.util.ThreadPool$PoolThread)

"SocketListener0-20" prio=1 tid=0x08753cb8 nid=0x7c33 in Object.wait() [0x84cfb000..0x84cfbe60]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91779508> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91779508> (a org.mortbay.util.ThreadPool$PoolThread)

"SocketListener0-19" prio=1 tid=0x086085a0 nid=0x7c32 in Object.wait() [0x84d7c000..0x84d7cee0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91779490> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91779490> (a org.mortbay.util.ThreadPool$PoolThread)

"SocketListener0-18" prio=1 tid=0x08607658 nid=0x7c31 in Object.wait() [0x84dfd000..0x84dfdf60]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91779418> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91779418> (a org.mortbay.util.ThreadPool$PoolThread)

"SocketListener0-17" prio=1 tid=0x08606710 nid=0x7c30 in Object.wait() [0x84e7e000..0x84e7efe0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x917793a0> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x917793a0> (a org.mortbay.util.ThreadPool$PoolThread)

"SocketListener0-16" prio=1 tid=0x082dd8e8 nid=0x7c2f in Object.wait() [0x84eff000..0x84f00060]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91779328> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91779328> (a org.mortbay.util.ThreadPool$PoolThread)

"SocketListener0-15" prio=1 tid=0x085d8500 nid=0x7c2e in Object.wait() [0x84f80000..0x84f810e0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x917792b0> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x917792b0> (a org.mortbay.util.ThreadPool$PoolThread)

"SocketListener0-14" prio=1 tid=0x08e24c30 nid=0x7c2d in Object.wait() [0x85002000..0x85002160]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91779238> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91779238> (a org.mortbay.util.ThreadPool$PoolThread)

"SocketListener0-13" prio=1 tid=0x08e23d08 nid=0x7c2c in Object.wait() [0x85083000..0x850831e0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x917791c0> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x917791c0> (a org.mortbay.util.ThreadPool$PoolThread)

"SocketListener0-12" prio=1 tid=0x08e38d90 nid=0x7c2b in Object.wait() [0x85103000..0x85103e60]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91779148> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91779148> (a org.mortbay.util.ThreadPool$PoolThread)

"SocketListener0-11" prio=1 tid=0x08e67ed0 nid=0x7c2a in Object.wait() [0x85184000..0x85184ee0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x917790d0> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x917790d0> (a org.mortbay.util.ThreadPool$PoolThread)

"SocketListener0-10" prio=1 tid=0x08f0eb40 nid=0x7c29 in Object.wait() [0x85205000..0x85205f60]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91779058> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91779058> (a org.mortbay.util.ThreadPool$PoolThread)

"SocketListener0-9" prio=1 tid=0x08f0dbf8 nid=0x7c28 in Object.wait() [0x85286000..0x85286fe0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91778fe0> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91778fe0> (a org.mortbay.util.ThreadPool$PoolThread)

"SocketListener0-8" prio=1 tid=0x08e35708 nid=0x7c27 in Object.wait() [0x85307000..0x85308060]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91778f68> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91778f68> (a org.mortbay.util.ThreadPool$PoolThread)

"SocketListener0-7" prio=1 tid=0x08721318 nid=0x7c26 in Object.wait() [0x85388000..0x853890e0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91778ef0> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91778ef0> (a org.mortbay.util.ThreadPool$PoolThread)

"SocketListener0-6" prio=1 tid=0x08ce9140 nid=0x7c25 in Object.wait() [0x8540a000..0x8540a160]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91778e78> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91778e78> (a org.mortbay.util.ThreadPool$PoolThread)

"SocketListener0-5" prio=1 tid=0x08ce8268 nid=0x7c24 in Object.wait() [0x8548b000..0x8548b1e0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91778e00> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91778e00> (a org.mortbay.util.ThreadPool$PoolThread)

"SocketListener0-4" prio=1 tid=0x08734ee0 nid=0x7c23 in Object.wait() [0x8550b000..0x8550be60]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91778d88> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91778d88> (a org.mortbay.util.ThreadPool$PoolThread)

"SocketListener0-3" prio=1 tid=0x081c7f18 nid=0x7c22 in Object.wait() [0x8558c000..0x8558cee0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91778d10> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91778d10> (a org.mortbay.util.ThreadPool$PoolThread)

"SocketListener0-2" prio=1 tid=0x085d7d08 nid=0x7c21 in Object.wait() [0x8560d000..0x8560df60]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91778c98> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91778c98> (a org.mortbay.util.ThreadPool$PoolThread)

"SocketListener0-1" prio=1 tid=0x0879ce70 nid=0x7c20 in Object.wait() [0x85afe000..0x85afefe0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91778c20> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91778c20> (a org.mortbay.util.ThreadPool$PoolThread)

"SocketListener0-0" prio=1 tid=0x0859ca10 nid=0x7c1f in Object.wait() [0x85cfe000..0x85cff060]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91778ba8> (a org.mortbay.util.ThreadPool$PoolThread)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:522)
        - locked <0x91778ba8> (a org.mortbay.util.ThreadPool$PoolThread)

"Acceptor ServerSocket[addr=0.0.0.0/0.0.0.0,port=0,localport=8080]" prio=1 tid=0x0879c960 nid=0x7c1e runnable [0x866f0000..0x866f10e0]
        at java.net.PlainSocketImpl.socketAccept(Native Method)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
        - locked <0x91778530> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:450)
        at java.net.ServerSocket.accept(ServerSocket.java:421)
        at org.mortbay.util.ThreadedServer.acceptSocket(ThreadedServer.java:432)
        at org.mortbay.util.ThreadedServer$Acceptor.run(ThreadedServer.java:634)

"Timer-6" daemon prio=1 tid=0x08520ee8 nid=0x7c1d in Object.wait() [0x86771000..0x86772160]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x916f1558> (a java.util.TaskQueue)
        at java.lang.Object.wait(Object.java:474)
        at java.util.TimerThread.mainLoop(Timer.java:483)
        - locked <0x916f1558> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:462)

"Timer-5" daemon prio=1 tid=0x085210b8 nid=0x7c1c in Object.wait() [0x8687e000..0x8687e1e0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x916f0a80> (a java.util.TaskQueue)
        at java.lang.Object.wait(Object.java:474)
        at java.util.TimerThread.mainLoop(Timer.java:483)
        - locked <0x916f0a80> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:462)

"derby.rawStoreDaemon" daemon prio=1 tid=0x086deed8 nid=0x7c1b in Object.wait() [0x868fe000..0x868fee60]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91687a68> (a org.apache.derby.impl.services.daemon.BasicDaemon)
        at org.apache.derby.impl.services.daemon.BasicDaemon.rest(Unknown Source)
        - locked <0x91687a68> (a org.apache.derby.impl.services.daemon.BasicDaemon)
        at org.apache.derby.impl.services.daemon.BasicDaemon.run(Unknown Source)
        at java.lang.Thread.run(Thread.java:595)

"Thread-9" daemon prio=1 tid=0x0850a8b0 nid=0x7c1a runnable [0x86558000..0x86558ee0]
        at java.net.PlainSocketImpl.socketAccept(Native Method)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
        - locked <0x91686820> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:450)
        at java.net.ServerSocket.accept(ServerSocket.java:421)
        at org.apache.derby.impl.drda.ClientThread$1.run(Unknown Source)
        at java.security.AccessController.doPrivileged(Native Method)
        at org.apache.derby.impl.drda.ClientThread.run(Unknown Source)
        at java.lang.Thread.run(Thread.java:595)

"Timer-4" daemon prio=1 tid=0x08e68d10 nid=0x7c19 in Object.wait() [0x865d9000..0x865d9f60]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x916869b8> (a java.util.TaskQueue)
        at java.util.TimerThread.mainLoop(Timer.java:509)
        - locked <0x916869b8> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:462)

"derby.NetworkServerStarter" daemon prio=1 tid=0x08508c10 nid=0x7c18 in Object.wait() [0x8665a000..0x8665afe0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x9182a230> (a java.lang.Object)
        at java.lang.Object.wait(Object.java:474)
        at org.apache.derby.impl.drda.NetworkServerControlImpl.blockingStart(Unknown Source)
        - locked <0x9182a230> (a java.lang.Object)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:585)
        at org.apache.derby.iapi.jdbc.DRDAServerStarter.run(Unknown Source)
        at java.lang.Thread.run(Thread.java:595)

"derby.antiGC" daemon prio=1 tid=0x08e99658 nid=0x7c17 in Object.wait() [0x86afe000..0x86aff060]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x9158e088> (a org.apache.derby.impl.services.monitor.AntiGC)
        at java.lang.Object.wait(Object.java:474)
        at org.apache.derby.impl.services.monitor.AntiGC.run(Unknown Source)
        - locked <0x9158e088> (a org.apache.derby.impl.services.monitor.AntiGC)
        at java.lang.Thread.run(Thread.java:595)

"service.EJB@19943439" daemon prio=1 tid=0x08f99830 nid=0x7c16 runnable [0x867f2000..0x867f30e0]
        at java.net.PlainSocketImpl.socketAccept(Native Method)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
        - locked <0x9159a0f0> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:450)
        at java.net.ServerSocket.accept(ServerSocket.java:421)
        at org.activeio.xnet.ServiceDaemon$SocketListener.run(ServiceDaemon.java:146)
        at java.lang.Thread.run(Thread.java:595)

"RMI LeaseChecker" daemon prio=1 tid=0x0853e5f0 nid=0x7c13 waiting on condition [0x87475000..0x87475e60]
        at java.lang.Thread.sleep(Native Method)
        at sun.rmi.transport.DGCImpl$LeaseChecker.run(DGCImpl.java:310)
        at java.lang.Thread.run(Thread.java:595)

"RMI RenewClean-[127.0.0.1:9999]" daemon prio=1 tid=0x08eece40 nid=0x7c11 in Object.wait() [0x87577000..0x87577f60]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x9164ab80> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
        - locked <0x9164ab80> (a java.lang.ref.ReferenceQueue$Lock)
        at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:501)
        at java.lang.Thread.run(Thread.java:595)

"GC Daemon" daemon prio=1 tid=0x87df7f78 nid=0x7c0f in Object.wait() [0x875f8000..0x875f9060]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91563fe8> (a sun.misc.GC$LatencyLock)
        at sun.misc.GC$Daemon.run(GC.java:100)
        - locked <0x91563fe8> (a sun.misc.GC$LatencyLock)

"RMI Reaper" prio=1 tid=0x87d0b300 nid=0x7c0e in Object.wait() [0x87679000..0x8767a0e0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91417ed0> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
        - locked <0x91417ed0> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132)
        at sun.rmi.transport.ObjectTable$Reaper.run(ObjectTable.java:336)
        at java.lang.Thread.run(Thread.java:595)

"RMI TCP Accept-9999" daemon prio=1 tid=0x87d0bbd0 nid=0x7c0d runnable [0x876fa000..0x876fb160]
        at java.net.PlainSocketImpl.socketAccept(Native Method)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
        - locked <0x9153cae8> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:450)
        at java.net.ServerSocket.accept(ServerSocket.java:421)
        at sun.rmi.transport.tcp.TCPTransport.run(TCPTransport.java:340)
        at java.lang.Thread.run(Thread.java:595)

"Socket Server: tcp://0.0.0.0:4242" daemon prio=1 tid=0x0906bd48 nid=0x7c0c runnable [0x8777b000..0x8777c1e0]
        at java.net.PlainSocketImpl.socketAccept(Native Method)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
        - locked <0x91522ef0> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:450)
        at java.net.ServerSocket.accept(ServerSocket.java:421)
        at org.activeio.net.SocketStreamChannelServer.accept(SocketStreamChannelServer.java:66)
        at org.activeio.net.SocketSyncChannelServer.accept(SocketSyncChannelServer.java:48)
        at org.activeio.adapter.SyncToAsyncChannelServer.run(SyncToAsyncChannelServer.java:140)
        at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
        at java.lang.Thread.run(Thread.java:595)

"LoginService login modules monitor" daemon prio=1 tid=0x08e48e30 nid=0x7c0b in Object.wait() [0x877fc000..0x877fce60]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x9155e1f0> (a EDU.oswego.cs.dl.util.concurrent.ClockDaemon)
        at EDU.oswego.cs.dl.util.concurrent.ClockDaemon.nextTask(Unknown Source)
        - locked <0x9155e1f0> (a EDU.oswego.cs.dl.util.concurrent.ClockDaemon)
        at EDU.oswego.cs.dl.util.concurrent.ClockDaemon$RunLoop.run(Unknown Source)
        at java.lang.Thread.run(Thread.java:595)

"FlushManager" daemon prio=1 tid=0x87c608a0 nid=0x7c0a sleeping[0x879fe000..0x879feee0]
        at java.lang.Thread.sleep(Native Method)
        at org.objectweb.howl.log.LogBufferManager$FlushManager.run(LogBufferManager.java:1232)

"LogFileManager.EventManager" daemon prio=1 tid=0x87d37f30 nid=0x7c09 in Object.wait() [0x87fc9000..0x87fc9f60]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91539ab8> (a java.lang.Object)
        at java.lang.Object.wait(Object.java:474)
        at org.objectweb.howl.log.LogFileManager$EventManager.run(LogFileManager.java:1220)
        - locked <0x91539ab8> (a java.lang.Object)

"RMI TCP Accept-1099" daemon prio=1 tid=0x08540278 nid=0x7c08 runnable [0x8787d000..0x8787dfe0]
        at java.net.PlainSocketImpl.socketAccept(Native Method)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
        - locked <0x91384e70> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:450)
        at java.net.ServerSocket.accept(ServerSocket.java:421)
        at sun.rmi.transport.tcp.TCPTransport.run(TCPTransport.java:340)
        at java.lang.Thread.run(Thread.java:595)

"Timer-3" daemon prio=1 tid=0x08e0cba0 nid=0x7c07 in Object.wait() [0x878fe000..0x878ff060]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x913a5380> (a java.util.TaskQueue)
        at java.util.TimerThread.mainLoop(Timer.java:509)
        - locked <0x913a5380> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:462)

"Timer-2" prio=1 tid=0x087651c8 nid=0x7c05 in Object.wait() [0x880fe000..0x880ff160]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x913a5438> (a java.util.TaskQueue)
        at java.lang.Object.wait(Object.java:474)
        at java.util.TimerThread.mainLoop(Timer.java:483)
        - locked <0x913a5438> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:462)

"Timer-1" daemon prio=1 tid=0x08590388 nid=0x7c04 in Object.wait() [0x884ff000..0x884ff1e0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91384f60> (a java.util.TaskQueue)
        at java.util.TimerThread.mainLoop(Timer.java:509)
        - locked <0x91384f60> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:462)

"Low Memory Detector" daemon prio=1 tid=0x08113580 nid=0x7c01 runnable [0x00000000..0x00000000]

"CompilerThread1" daemon prio=1 tid=0x081120b0 nid=0x7c00 waiting on condition [0x00000000..0x88c67208]

"CompilerThread0" daemon prio=1 tid=0x08111008 nid=0x7bff waiting on condition [0x00000000..0x88ce8288]

"AdapterThread" daemon prio=1 tid=0x0810fe80 nid=0x7bfe waiting on condition [0x00000000..0x00000000]

"Signal Dispatcher" daemon prio=1 tid=0x0810f058 nid=0x7bfd waiting on condition [0x00000000..0x00000000]

"Finalizer" daemon prio=1 tid=0x08103bd8 nid=0x7bfc in Object.wait() [0x88ea6000..0x88ea61e0]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91407d40> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
        - locked <0x91407d40> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132)
        at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)

"Reference Handler" daemon prio=1 tid=0x08103690 nid=0x7bfb in Object.wait() [0x88f26000..0x88f26e60]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x913dcf20> (a java.lang.ref.Reference$Lock)
        at java.lang.Object.wait(Object.java:474)
        at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
        - locked <0x913dcf20> (a java.lang.ref.Reference$Lock)

"main" prio=1 tid=0x0805d710 nid=0x7bf4 in Object.wait() [0xbfd52000..0xbfd522e8]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x91429918> (a org.apache.geronimo.kernel.basic.BasicKernel)
        at java.lang.Object.wait(Object.java:474)
        at org.apache.geronimo.system.main.Daemon.doStartup(Daemon.java:331)
        - locked <0x91429918> (a org.apache.geronimo.kernel.basic.BasicKernel)
        at org.apache.geronimo.system.main.Daemon.<init>(Daemon.java:74)
        at org.apache.geronimo.system.main.Daemon.main(Daemon.java:377)

"VM Thread" prio=1 tid=0x08101140 nid=0x7bfa runnable

"GC task thread#0 (ParallelGC)" prio=1 tid=0x08077f50 nid=0x7bf8 runnable

"GC task thread#1 (ParallelGC)" prio=1 tid=0x08078ba0 nid=0x7bf9 runnable

"VM Periodic Task Thread" prio=1 tid=0x08114a68 nid=0x7c02 waiting on condition