Internal error

We are gettijg the following error.

Any ideas what is happening or even where to start to look?

#

# An unexpected error has been detected by HotSpot Virtual Machine:

#

# Internal Error (41443F53504152430E43505001C8 01), pid=18362, tid=7

#

# Java VM: Java HotSpot(TM) 64-Bit Server VM (1.5.0_08-b03 mixed mode)

T H R E A D

Current thread (0x0000000100268ad0): JavaThread "CompilerThread0" daemon [_thread_in_native, id=7]

Stack: [0xffffffff6a000000,0xffffffff6a100000), sp=0xffffffff6a0fd2b0, free space=1012k

Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)

V [libjvm.so+0x8480e0]

V [libjvm.so+0x55bca0]

V [libjvm.so+0x2411b4]

V [libjvm.so+0x31a604]

V [libjvm.so+0x3194c4]

V [libjvm.so+0x317678]

V [libjvm.so+0x388238]

V [libjvm.so+0x37e76c]

V [libjvm.so+0x37ed34]

V [libjvm.so+0x44be78]

V [libjvm.so+0x3e537c]

V [libjvm.so+0x7b1108]

Current CompileTask:

opto: 34packNVBLQ.pack()Ljava/lang/String; (4345 bytes)

P R O C E S S

Java Threads: ( => current thread )

0x000000010026d200 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=9]

0x0000000100269ad0 JavaThread "CompilerThread1" daemon [_thread_blocked, id=8]

=>0x0000000100268ad0 JavaThread "CompilerThread0" daemon [_thread_in_native, id=7]

0x0000000100267ad0 JavaThread "AdapterThread" daemon [_thread_blocked, id=6]

0x0000000100266aa0 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=5]

0x0000000100244e00 JavaThread "Finalizer" daemon [_thread_blocked, id=4]

0x0000000100244820 JavaThread "Reference Handler" daemon [_thread_blocked, id=3]

0x000000010011df60 JavaThread "main" [_thread_in_native, id=1]

Other Threads:

0x0000000100240ab0 VMThread [id=2]

0x0000000100196680 WatcherThread [id=10]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

Heap

def new generationtotal 5056K, used 4848K [0xffffffff6a800000, 0xffffffff6ad10000, 0xffffffff6c400000)

eden space 4928K, 97% used [0xffffffff6a800000, 0xffffffff6acaf858, 0xffffffff6acd0000)

from space 128K, 39% used [0xffffffff6acf0000, 0xffffffff6acfca40, 0xffffffff6ad10000)

tospace 128K,0% used [0xffffffff6acd0000, 0xffffffff6acd0000, 0xffffffff6acf0000)

tenured generationtotal 10256K, used 7295K [0xffffffff6c400000, 0xffffffff6ce04000, 0xffffffff6fc00000)

the space 10256K, 71% used [0xffffffff6c400000, 0xffffffff6cb1ff18, 0xffffffff6cb20000, 0xffffffff6ce04000)

compacting perm gen total 21248K, used 6557K [0xffffffff6fc00000, 0xffffffff710c0000, 0xffffffff74c00000)

the space 21248K, 30% used [0xffffffff6fc00000, 0xffffffff70267530, 0xffffffff70267600, 0xffffffff710c0000)

No shared spaces configured.

Dynamic libraries:

0x0000000100000000 /usr/local/jdk1.5.0_08/bin/sparcv9/java

0xffffffff7f300000 /lib/64/libthread.so.1

0xffffffff7f400000 /lib/64/libdl.so.1

0xffffffff7ef00000 /lib/64/libc.so.1

0xffffffff7ee00000 /platform/SUNW,Sun-Fire-V240/lib/sparcv9/libc_psr.so.1

0xffffffff7e000000 /usr/local/jdk1.5.0_08/jre/lib/sparcv9/server/libjvm.so

0xffffffff7de00000 /lib/64/libsocket.so.1

0xffffffff7ed00000 /usr/lib/64/libsched.so.1

0xffffffff7dc00000 /usr/lib/64/libCrun.so.1

0xffffffff7da00000 /lib/64/libm.so.1

0xffffffff7d700000 /lib/64/libnsl.so.1

0xffffffff7d500000 /lib/64/libm.so.2

0xffffffff7d300000 /lib/64/libscf.so.1

0xffffffff7d000000 /lib/64/libdoor.so.1

0xffffffff7ce00000 /lib/64/libuutil.so.1

0xffffffff7cc00000 /lib/64/libmd5.so.1

0xffffffff7ca00000 /platform/SUNW,Sun-Fire-V240/lib/sparcv9/libmd5_psr.so.1

0xffffffff7c700000 /lib/64/libmp.so.2

0xffffffff7c300000 /usr/local/jdk1.5.0_08/jre/lib/sparcv9/native_threads/libhpi.so

0xffffffff7bf00000 /usr/local/jdk1.5.0_08/jre/lib/sparcv9/libverify.so

0xffffffff7bd00000 /usr/local/jdk1.5.0_08/jre/lib/sparcv9/libjava.so

0xffffffff7bb00000 /usr/local/jdk1.5.0_08/jre/lib/sparcv9/libzip.so

0xffffffff68f00000 /oracle/product/10.2.0/client/lib/libocijdbc10.so

0xffffffff67c00000 /oracle/product/10.2.0/client/lib/libclntsh.so.10.1

0xffffffff67800000 /oracle/product/10.2.0/client/lib/libnnz10.so

0xffffffff67500000 /lib/64/libkstat.so.1

0xffffffff67300000 /lib/64/libgen.so.1

0xffffffff67100000 /lib/64/libaio.so.1

0xffffffff66e00000 /lib/64/librt.so.1

0xffffffff66a00000 /app/mss/local/mss/lib/libMCSJ.so

0xffffffff66800000 /usr/local/mss/lib/libgcc_s.so.1

0xffffffff66500000 /usr/lib/iconv/sparcv9/geniconvtbl.so

VM Arguments:

jvm_args: -Dfile.encoding=Cp1256

java_command: callPlSql JORCALL

Launcher Type: SUN_STANDARD

Environment Variables:

CLASSPATH=:/oracle/product/10.2.0/client//jdbc/lib/ojdbc14.jar:/oracle/product/10.2.0/client//jdbc/lib/ojdbc14.jar:/oracle/product/10.2.0/client//sqlj/lib/runtime12.jar:/usr/local/mss/lib/jlinc.jar:/app/jor/nofs/classes:/usr/local/mss/lib/mssmcs.jar:.

PATH=/usr/local/ant/bin:/usr/local/jdk/bin/sparcv9:/usr/sbin:/sbin:/usr/sadm/bin:/usr/dt/bin:/usr/openwin/bin:/usr/bin:/usr/ucb:.:/usr/local/bin:/usr/local/mss/bin:/jkb/local/bin:/usr/ccs/bin:/oracle/product/10.2.0/client//bin/

LD_LIBRARY_PATH=/usr/local/jdk1.5.0_08/jre/lib/sparcv9/server:/usr/local/jdk1.5.0_08/jre/lib/sparcv9:/usr/local/jdk1.5.0_08/jre/../lib/sparcv9:/oracle/product/10.2.0/client/lib:/usr/local/mss/lib

SHELL=/bin/bash

Signal Handlers:

SIGSEGV: [libjvm.so+0x848b84], sa_mask[0]=0xffbffeff, sa_flags=0x00000004

SIGBUS: [libjvm.so+0x848b84], sa_mask[0]=0xffbffeff, sa_flags=0x00000004

SIGFPE: [libjvm.so+0x36d698], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c

SIGPIPE: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000

SIGILL: [libjvm.so+0x36d698], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c

SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000

SIGUSR2: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000

SIGHUP: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000

SIGINT: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000

SIGQUIT: [libjvm.so+0x7b2438], sa_mask[0]=0xffbffeff, sa_flags=0x00000004

SIGTERM: [libjvm.so+0x7b2438], sa_mask[0]=0xffbffeff, sa_flags=0x00000004

S Y S T E M

OS:Solaris 10 6/06 s10s_u2wos_09a SPARC

Copyright 2006 Sun Microsystems, Inc. All Rights Reserved.

Use is subject to license terms.

Assembled 09 June 2006

uname:SunOS 5.10 Generic_118833-20 sun4u (T2 libthread)

rlimit: STACK 8192k, CORE infinity, NOFILE 65536, AS infinity

load average:0.51 0.27 0.23

CPU:total 1 has_v8, has_v9, has_vis1, has_vis2, is_ultra3

Memory: 8k page, physical 2097152k(1085376k free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (1.5.0_08-b03) for solaris-sparc, built on Jun 28 2006 01:14:07 by unknown with unknown Workshop:0x550

[7168 byte] By [steve_rainbirda] at [2007-11-26 14:49:21]
# 1

You're hitting a fatal error in our code for generating spills. I think the frame is too large for the instruction we're trying to use. This looks like an instance of the bug 6272980 which is fixed in 1.6 but hasn't been fixed in 1.5. It probably should have been so were adding it to our list. It should appear in update 12 or 13. The fix consists of the compiler bailing out of the compile and disabling compilation of that method so it won't perform that well for you since that method will then run interpreted. I'd recommend breaking your method up a bit if you can. Extremely large methods aren't likely to perform as well as code which has been properly factored. You can work around the crash by adding -XX:CompileCommand=exclude,packNVBLQ,pack to disable compilation of that method.

tom

neverevera at 2007-7-8 8:37:20 > top of Java-index,Java HotSpot Virtual Machine,Specifications...
# 2
Thanks tom.
steve_rainbirda at 2007-7-8 8:37:20 > top of Java-index,Java HotSpot Virtual Machine,Specifications...
# 3
Tom,It doesnt always crash when this method is invoked.Would that still be indicative of the same problem?TIASteve
steve_rainbirda at 2007-7-8 8:37:20 > top of Java-index,Java HotSpot Virtual Machine,Specifications...
# 4

If the internal error number is the same in the crash log then it's the same issue. This is a case where the error number is pretty much unique for this issue. It could be the case that sometimes you see this issue and other times you don't. You might be on the edge of the limit so sometimes the compile is able to complete and other times it fails. Changes to your source code could cause it to go away as could differences in our profile feedback which might result in slightly different inlining decisions.

tom

neverevera at 2007-7-8 8:37:20 > top of Java-index,Java HotSpot Virtual Machine,Specifications...
# 5
Thanks Tom
steve_rainbirda at 2007-7-8 8:37:20 > top of Java-index,Java HotSpot Virtual Machine,Specifications...