JVM Crash on Solaris
Hi,
We are seeing a pretty consistent crash thrown by our app when its been up for a while. I cant really see anything untoward in the dump files though, any ideas?
Thanks
Dave
#
# An unexpected error has been detected by HotSpot Virtual Machine:
#
# SIGSEGV (0xb) at pc=0xfe985380, pid=29468, tid=602
#
# Java VM: Java HotSpot(TM) Server VM (1.5.0_07-b03 mixed mode)
# Problematic frame:
# V [libjvm.so+0x185380]
#
T H R E A D
Current thread (0x007c6178): JavaThread "pool-1-thread-3" [_thread_in_vm, id=602]
siginfo:si_signo=11, si_errno=0, si_code=1, si_addr=0x7fe8c2e0
Registers:
O0=0x000329a0 O1=0x007d8483 O2=0x007d8b32 O3=0x00008de8
O4=0xfefc4000 O5=0x007c6178 O6=0xb1a7f1c8 O7=0xfe98531c
G1=0x00036cb8 G2=0xff034fcc G3=0x00009160 G4=0x00009000
G5=0xb5c3e060 G6=0x00000000 G7=0xfb166400 Y=0x00000000
PC=0xfe985380 nPC=0xfe985340
Top of Stack: (sp=0xb1a7f1c8)
0xb1a7f1c8:00000001 00000000 92026250 00000004
0xb1a7f1d8:ff01784c 0000635c 00006000 ff01784c
0xb1a7f1e8:7fe8c2b0 b5c40528 00000008 0000635c
0xb1a7f1f8:fefc4000 00006000 b1a7f228 fe9a6b94
0xb1a7f208:00000000 00000004 f9015d70 00000000
0xb1a7f218:00000000 00fd35ec 00000000 b1a7f4d0
0xb1a7f228:00fd35ec fefc4000 00000000 b1a7f320
0xb1a7f238:00000006 00000008 b5c40528 0000000e
Instructions: (pc=0xfe985380)
0xfe985370:81 e8 00 00 f0 06 20 38 80 a6 20 00 32 4f ff f1
0xfe985380:e4 06 20 30 7f fd da 9e 01 00 00 00 81 c7 e0 08
Stack: [0xb1a00000,0xb1a80000), sp=0xb1a7f1c8, free space=508k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [libjvm.so+0x185380]
V [libjvm.so+0x1a6b9c]
j com.sun.org.apache.xalan.internal.xsltc.runtime.AbstractTranslet.addParameter(Ljava/lang/String;Ljava/lang/Object;Z)Ljava/lang/Object;+8
j GregorSamsa.topLevel(Lcom/sun/org/apache/xalan/internal/xsltc/DOM;Lcom/sun/org/apache/xml/internal/dtm/DTMAxisIterator;Lcom/sun/org/apache/xml/internal/serializer/SerializationHandler;)V+77
j GregorSamsa.transform(Lcom/sun/org/apache/xalan/internal/xsltc/DOM;Lcom/sun/org/apache/xml/internal/dtm/DTMAxisIterator;Lcom/sun/org/apache/xml/internal/serializer/SerializationHandler;)V+35
j com.sun.org.apache.xalan.internal.xsltc.runtime.AbstractTranslet.transform(Lcom/sun/org/apache/xalan/internal/xsltc/DOM;Lcom/sun/org/apache/xml/internal/serializer/SerializationHandler;)V+9
j com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(Ljavax/xml/transform/Source;Lcom/sun/org/apache/xml/internal/serializer/SerializationHandler;Ljava/lang/String;)V+152
j com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(Ljavax/xml/transform/Source;Ljavax/xml/transform/Result;)V+119
j java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Ljava/lang/Runnable;)V+44
j java.util.concurrent.ThreadPoolExecutor$Worker.run()V+28
j java.lang.Thread.run()V+11
v ~StubRoutines::call_stub
V [libjvm.so+0x19addc]
V [libjvm.so+0x2c39d4]
V [libjvm.so+0x2e2f4c]
V [libjvm.so+0x2deae8]
V [libjvm.so+0x6691b0]
Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j com.sun.org.apache.xalan.internal.xsltc.runtime.AbstractTranslet.addParameter(Ljava/lang/String;Ljava/lang/Object;Z)Ljava/lang/Object;+8
j GregorSamsa.topLevel(Lcom/sun/org/apache/xalan/internal/xsltc/DOM;Lcom/sun/org/apache/xml/internal/dtm/DTMAxisIterator;Lcom/sun/org/apache/xml/internal/serializer/SerializationHandler;)V+77
j GregorSamsa.transform(Lcom/sun/org/apache/xalan/internal/xsltc/DOM;Lcom/sun/org/apache/xml/internal/dtm/DTMAxisIterator;Lcom/sun/org/apache/xml/internal/serializer/SerializationHandler;)V+35
j com.sun.org.apache.xalan.internal.xsltc.runtime.AbstractTranslet.transform(Lcom/sun/org/apache/xalan/internal/xsltc/DOM;Lcom/sun/org/apache/xml/internal/serializer/SerializationHandler;)V+9
j com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(Ljavax/xml/transform/Source;Lcom/sun/org/apache/xml/internal/serializer/SerializationHandler;Ljava/lang/String;)V+152
j com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(Ljavax/xml/transform/Source;Ljavax/xml/transform/Result;)V+119
j java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Ljava/lang/Runnable;)V+44
j java.util.concurrent.ThreadPoolExecutor$Worker.run()V+28
j java.lang.Thread.run()V+11
v ~StubRoutines::call_stub
P R O C E S S
Java Threads: ( => current thread )
0x0078b018 JavaThread "pool-1-thread-20" [_thread_blocked, id=619]
0x0078aab0 JavaThread "pool-1-thread-19" [_thread_blocked, id=618]
0x0078c540 JavaThread "pool-1-thread-18" [_thread_blocked, id=617]
0x006c9018 JavaThread "pool-1-thread-17" [_thread_blocked, id=616]
0x008e51e8 JavaThread "pool-1-thread-16" [_thread_blocked, id=615]
0x00fd1358 JavaThread "pool-1-thread-15" [_thread_blocked, id=614]
0x00636118 JavaThread "pool-1-thread-14" [_thread_blocked, id=613]
0x006c9fa8 JavaThread "pool-1-thread-13" [_thread_blocked, id=612]
0x00da4640 JavaThread "pool-1-thread-12" [_thread_blocked, id=611]
0x009af680 JavaThread "pool-1-thread-11" [_thread_blocked, id=610]
0x009aecd0 JavaThread "pool-1-thread-10" [_thread_blocked, id=609]
0x00f8c778 JavaThread "pool-1-thread-9" [_thread_blocked, id=608]
0x010c94b8 JavaThread "pool-1-thread-8" [_thread_blocked, id=607]
0x00d128f0 JavaThread "pool-1-thread-7" [_thread_blocked, id=606]
0x005d9940 JavaThread "pool-1-thread-6" [_thread_blocked, id=605]
0x00f903d8 JavaThread "pool-1-thread-5" [_thread_blocked, id=604]
0x0076f718 JavaThread "pool-1-thread-4" [_thread_blocked, id=603]
=>0x007c6178 JavaThread "pool-1-thread-3" [_thread_in_vm, id=602]
0x00d48cf0 JavaThread "pool-1-thread-2" [_thread_blocked, id=601]
0x010fcd20 JavaThread "pool-1-thread-1" [_thread_blocked, id=599]
0x00f94500 JavaThread "TIBCO EMS Session Dispatcher (227027)" [_thread_blocked, id=40]
0x007d4a40 JavaThread "TIBCO EMS TCPLink Reader (83257)" daemon [_thread_in_native, id=38]
0x00fd4b60 JavaThread "TIBCO EMS Session Dispatcher (227020)" [_thread_blocked, id=36]
0x006cb670 JavaThread "TIBCO EMS TCPLink Reader (83250)" daemon [_thread_in_native, id=34]
0x0087fb08 JavaThread "RMI LeaseChecker" daemon [_thread_blocked, id=30]
0x00f95f88 JavaThread "RMI RenewClean-[14.64.10.31:52656]" daemon [_thread_blocked, id=28]
0x00b95810 JavaThread "GC Daemon" daemon [_thread_blocked, id=26]
0x0098c1c8 JavaThread "RMI Reaper" [_thread_blocked, id=25]
0x00825420 JavaThread "RMI TCP Accept-14500" daemon [_thread_in_native, id=24]
0x00a3b980 JavaThread "TIBCO EMS TCPLink Reader (83233)" daemon [_thread_in_native, id=23]
0x00fcf670 JavaThread "TIBCO EMS TCPLink Reader (83228)" daemon [_thread_in_native, id=21]
0x00f922d0 JavaThread "TIBCO EMS Connections Pinger" daemon [_thread_blocked, id=19]
0x005a32f0 JavaThread "Thread-2" daemon [_thread_blocked, id=17]
0x005a85a0 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=15]
0x0076daf0 JavaThread "Timer-0" daemon [_thread_blocked, id=14]
0x0015c728 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=13]
0x0015add0 JavaThread "CompilerThread1" daemon [_thread_blocked, id=12]
0x0015a000 JavaThread "CompilerThread0" daemon [_thread_blocked, id=11]
0x001590e8 JavaThread "AdapterThread" daemon [_thread_blocked, id=10]
0x00158410 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=9]
0x0014b880 JavaThread "Finalizer" daemon [_thread_blocked, id=8]
0x0014b3e0 JavaThread "Reference Handler" daemon [_thread_blocked, id=7]
0x00037b88 JavaThread "main" [_thread_blocked, id=1]
Other Threads:
0x00149300 VMThread [id=6]
0x005a8bb8 WatcherThread [id=16]
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event])
[0x000329a0/0x00036cb8] OsrList_lock - owner thread: 0x007c6178
Heap
PSYoungGentotal 100352K, used 10009K [0xe3400000, 0xea000000, 0xf8c00000)
eden space 100160K, 9% used [0xe3400000,0xe3dc67b8,0xe95d0000)
from space 192K, 0% used [0xe9fd0000,0xe9fd0000,0xea000000)
tospace 192K, 0% used [0xe9fa0000,0xe9fa0000,0xe9fd0000)
PSOldGentotal 176128K, used 14703K [0xb8800000, 0xc3400000, 0xe3400000)
object space 176128K, 8% used [0xb8800000,0xb965bf20,0xc3400000)
PSPermGentotal 24576K, used 21658K [0xb4800000, 0xb6000000, 0xb8800000)
object space 24576K, 88% used [0xb4800000,0xb5d26af0,0xb6000000)
Dynamic libraries:
0x00010000 /usr/jdk/instances/jdk1.5.0/bin/java
0xff3f8000 /lib/libthread.so.1
0xff3a0000 /lib/libdl.so.1
0xff280000 /lib/libc.so.1
0xff270000 /platform/FJSV,GPUZC-M/lib/libc_psr.so.1
0xfe800000 /usr/jdk/instances/jdk1.5.0/jre/lib/sparc/server/libjvm.so
0xff230000 /lib/libsocket.so.1
0xff260000 /usr/lib/libsched.so.1
0xff1f0000 /usr/lib/libCrun.so.1
0xff1d0000 /lib/libm.so.1
0xff100000 /lib/libnsl.so.1
0xfe700000 /lib/libm.so.2
0xff0d0000 /lib/libscf.so.1
0xff0b0000 /lib/libdoor.so.1
0xff090000 /lib/libuutil.so.1
0xff070000 /lib/libmd5.so.1
0xff050000 /platform/FJSV,GPUZC-M/lib/libmd5_psr.so.1
0xfe7e0000 /lib/libmp.so.2
0xfe6d0000 /usr/jdk/instances/jdk1.5.0/jre/lib/sparc/native_threads/libhpi.so
0xfe680000 /usr/jdk/instances/jdk1.5.0/jre/lib/sparc/libverify.so
0xfe640000 /usr/jdk/instances/jdk1.5.0/jre/lib/sparc/libjava.so
0xfe610000 /usr/jdk/instances/jdk1.5.0/jre/lib/sparc/libzip.so
0xfbec0000 /usr/jdk/instances/jdk1.5.0/jre/lib/sparc/libmanagement.so
0xfbe90000 /usr/jdk/instances/jdk1.5.0/jre/lib/sparc/libnet.so
0xb36d0000 /usr/jdk/instances/jdk1.5.0/jre/lib/sparc/libj2pkcs11.so
0xb30c0000 /usr/lib/libpkcs11.so
0xb2f60000 /usr/lib/libcryptoutil.so.1
0xb2900000 /usr/lib/security/pkcs11_softtoken.so
0xb3890000 /usr/jdk/instances/jdk1.5.0/jre/lib/sparc/librmi.so
Environment Variables:
SHELL=/bin/bash
Signal Handlers:
SIGSEGV: [libjvm.so+0x6f60b8], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGBUS: [libjvm.so+0x6f60b8], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGFPE: [libjvm.so+0x276398], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGPIPE: [libjvm.so+0x276398], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGILL: [libjvm.so+0x276398], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGUSR2: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGHUP: [libjvm.so+0x66a38c], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGINT: [libjvm.so+0x66a38c], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGQUIT: [libjvm.so+0x66a38c], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGTERM: [libjvm.so+0x66a38c], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
S Y S T E M
OS:Solaris 10 6/06 s10s_u2wos_09a SPARC
Copyright 2006 Sun Microsystems, Inc. All Rights Reserved.
Use is subject to license terms.
Assembled 09 June 2006
uname:SunOS 5.10 Generic_118833-18 sun4us (T2 libthread)
rlimit: STACK 8192k, CORE infinity, NOFILE 65536, AS infinity
load average:0.04 0.04 0.04
CPU:total 4 has_v8, has_v9, has_vis1, has_vis2, is_ultra3
Memory: 8k page, physical 16777216k(13884520k free)
vm_info: Java HotSpot(TM) Server VM (1.5.0_07-b03) for solaris-sparc, built on May 3 2006 01:22:35 by unknown with unknown Workshop:0x550

