HotSpot libc.so.6 error
our server has some important websites running on it,and it was runnin
good till a few weeks ago..
From then, we have been facing this strange problem.
and I have been unable to trace it in anyway, me being new to this..
also, it seems to be crashing at around the same time everyday..(+-1/2hr)
would be grateful , if someone could help me with this..
thanks
#
# An unexpected error has been detected by HotSpot Virtual Machine:
#
# SIGSEGV (0xb) at pc=0x4009cb68, pid=11201, tid=180236
#
# Java VM: Java HotSpot(TM) Server VM (1.5.0_04-b05 mixed mode)
# Problematic frame:
# C [libc.so.6+0x2bb68] exit+0x68
#
T H R E A D
Current thread (0x0811f5e0): JavaThread"CompilerThread1" daemon [_thread_in_native, id=12644]
siginfo:si_signo=11, si_errno=0, si_code=1, si_addr=0x00000004
Registers:
EAX=0x4002b760, EBX=0x401a0880, ECX=0x00000008, EDX=0x00000000
ESP=0xbe3fe3d4, EBP=0xbe3fe3ec, ESI=0x401a0e68, EDI=0x080582f8
EIP=0x4009cb68, CR2=0x00000004, EFLAGS=0x00010296
Top of Stack: (sp=0xbe3fe3d4)
0xbe3fe3d4:00000001 00000000 be3fe3fc 40709dcc
0xbe3fe3e4:080582f8 080582f8 be3fe40c 4059344f
0xbe3fe3f4:00000001 40709dcc be3fe40c 4059342b
0xbe3fe404:000be3fe 40709dcc be3fe4dc 403f4ce7
0xbe3fe414:00000000 080582f8 be3fe4dc 403f4cdd
0xbe3fe424:406fe5e0 4068bbff 080582f8 406fe5e0
0xbe3fe434:080582f8 406fe5e0 40680f3a 080582f8
0xbe3fe444:406fe5e0 4067f8ed 080582f8 406fe5e0
Instructions: (pc=0x4009cb68)
0x4009cb58:04 8b 45 08 89 04 24 ff 56 04 8b 93 2c a2 ff ff
0x4009cb68:8b 42 04 85 c0 75 c1 89 d0 8b 12 85 d2 89 93 2c
Stack: [0xbe201000,0xbe400000), sp=0xbe3fe3d4, free space=2036k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C [libc.so.6+0x2bb68] exit+0x68
V [libjvm.so+0x3ee44f]
V [libjvm.so+0x24fce7]
V [libjvm.so+0x1199bf]
V [libjvm.so+0x11a0c5]
V [libjvm.so+0x43ef3e]
V [libjvm.so+0x43899e]
V [libjvm.so+0x14fded]
V [libjvm.so+0x197e2e]
V [libjvm.so+0x19433a]
V [libjvm.so+0x1410b3]
V [libjvm.so+0x19c709]
V [libjvm.so+0x19c0e1]
V [libjvm.so+0x486d56]
V [libjvm.so+0x481773]
V [libjvm.so+0x3f1b68]
C [libpthread.so.0+0x5e51]
Current CompileTask:
opto: 83 !org.apache.tomcat.util.digester.Digester.startElement(Ljava/lang/String;Ljava/lang/String;Ljava/lang/String;Lorg/xml/sax/Attributes;)V (466 bytes)
P R O C E S S
Java Threads: ( => current thread )
0x08120a60 JavaThread"Low Memory Detector" daemon [_thread_blocked, id=12675]=>0x0811f5e0 JavaThread"CompilerThread1" daemon [_thread_in_native, id=12644]
0x0811e5c0 JavaThread"CompilerThread0" daemon [_thread_in_native, id=12612]
0x0811d4e8 JavaThread"AdapterThread" daemon [_thread_blocked, id=12578]
0x0811c6e0 JavaThread"Signal Dispatcher" daemon [_thread_blocked, id=12544]
0x081121d8 JavaThread"Finalizer" daemon [_thread_blocked, id=12419]
0x08111558 JavaThread"Reference Handler" daemon [_thread_blocked, id=12388]
0x0805b168 JavaThread"main" [_thread_in_native, id=11201]
Other Threads:
0x0810e990 VMThread [id=12356]
0x08121ef8 WatcherThread [id=12705]
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: None
Heap
PSYoungGentotal 448K, used 253K [0x4a0d0000, 0x4a170000, 0x4a170000)
eden space 256K, 80% used [0x4a0d0000,0x4a103490,0x4a110000)
from space 192K, 25% used [0x4a140000,0x4a14c000,0x4a170000)
tospace 192K, 0% used [0x4a110000,0x4a110000,0x4a140000)
PSOldGentotal 3776K, used 2854K [0x49b70000, 0x49f20000, 0x4a0d0000)
object space 3776K, 75% used [0x49b70000,0x49e39870,0x49f20000)
PSPermGentotal 16384K, used 7367K [0x45b70000, 0x46b70000, 0x49b70000)
object space 16384K, 44% used [0x45b70000,0x462a1e40,0x46b70000)
Dynamic libraries:
08048000-08056000 r-xp 00000000 08:05 15106884
08056000-08058000 rw-p 0000e000 08:05 15106884
08058000-08593000 rwxp 00000000 00:00 0
40000000-40016000 r-xp 00000000 08:05 7046407
40016000-40017000 rw-p 00015000 08:05 7046407
40017000-40018000 rw-p 00000000 00:00 0
40018000-40019000 r--p 00000000 00:00 0
40019000-4001d000 rwxp 00001000 00:00 0
4001d000-4002a000 r-xp 00000000 08:05 7048113
4002a000-4002c000 rw-p 0000c000 08:05 7048113
4002c000-4006e000 rw-p 00000000 00:00 0
4006e000-40070000 r-xp 00000000 08:05 7048102
40070000-40071000 rw-p 00002000 08:05 7048102
40071000-40199000 r-xp 00000000 08:05 7046410
40199000-401a1000 rw-p 00127000 08:05 7046410
401a1000-401a5000 rw-p 00000000 00:00 0
401a5000-406ac000 r-xp 00000000 08:05 15239580
406ac000-4070e000 rw-p 00506000 08:05 15239580
4070e000-40b24000 rw-p 00000000 00:00 0
40b24000-40b45000 r-xp 00000000 08:05 7048103
40b45000-40b46000 rw-p 00020000 08:05 7048103
40b46000-40b4c000 r-xp 00000000 08:05 15239578
40b4c000-40b4d000 rw-p 00006000 08:05 15239578
40b4d000-40b4f000 r--s 00000000 08:05 30654819
40b4f000-40b52000 r--s 00000000 08:05 28083497
40b52000-40b64000 r-xp 00000000 08:05 7048105
40b64000-40b65000 rw-p 00011000 08:05 7048105
40b65000-40b67000 rw-p 00000000 00:00 0
40b67000-40b6e000 r-xp 00000000 08:05 7048106
40b6e000-40b6f000 rw-p 00006000 08:05 7048106
40b6f000-40b77000 r-xp 00000000 08:05 7048110
40b77000-40b78000 rw-p 00007000 08:05 7048110
40b78000-40b80000 r-xp 00000000 08:05 7048108
40b80000-40b81000 rw-p 00008000 08:05 7048108
40b81000-40b89000 rw-s 00000000 08:05 7983091
40b89000-40b94000 r-xp 00000000 08:05 15239586
40b94000-40b95000 rw-p 0000b000 08:05 15239586
40b95000-40bb6000 r-xp 00000000 08:05 15239587
40bb6000-40bb8000 rw-p 00020000 08:05 15239587
40bb8000-40bcb000 r-xp 00000000 08:05 15239589
40bcb000-40bcd000 rw-p 00012000 08:05 15239589
40bcd000-431ad000 r--s 00000000 08:05 15240883
431ad000-43216000 rw-p 00000000 00:00 0
43216000-4329d000 r--s 00000000 08:05 15240208
4329d000-432b1000 r--s 00000000 08:05 15239625
432b1000-43aec000 r--s 00000000 08:05 15240211
43aec000-45b6c000 rwxp 00028000 00:00 0
45b6c000-45b6f000 r--s 00000000 08:05 28083506
45b70000-4a1b4000 rwxp 030ac000 00:00 0
4a1b4000-4a1da000 r--s 00000000 08:05 30654816
4a1da000-4a205000 r--s 00000000 08:05 30654818
4a205000-4a2c9000 r--s 00000000 08:05 30654821
4a2c9000-4a2cf000 r--s 00000000 08:05 28083495
4a2cf000-4a2d6000 r--s 00000000 08:05 28083498
4a2d6000-4a2df000 r--s 00000000 08:05 28083513
4a2df000-4a2e8000 r--s 00000000 08:05 28083514
4a2e8000-4a2f0000 r--s 00000000 08:05 28083515
4a2f0000-4a2f9000 r--s 00000000 08:05 28083516
4a2f9000-4a315000 r--s 00000000 08:05 28083517
4a315000-4a3f6000 r--s 00000000 08:05 28083518
4a3f6000-4a454000 r--s 00000000 08:05 28083519
4a454000-4a467000 r--s 00000000 08:05 28083520
4a467000-4a474000 r--s 00000000 08:05 28083521
4a474000-4a49a000 r--s 00000000 08:05 28083522
4a49a000-4a4a3000 r--s 00000000 08:05 28083523
4a4a3000-4a4af000 r--s 00000000 08:05 28083524
4a4af000-4a4c7000 r--s 00000000 08:05 28083525
4a4c7000-4a4ce000 r--s 00000000 08:05 28083526
4a4ce000-4a4f7000 r--s 00000000 08:05 28083527
4a4f7000-4a514000 r--s 00000000 08:05 28083528
4a514000-4a524000 r--s 00000000 08:05 28083529
4a524000-4a5c0000 r--s 00000000 08:05 28083530
4a5c0000-4a5db000 r--s 00000000 08:05 28083531
4a5db000-4a5e0000 r--s 00000000 08:05 28083533
4a5e0000-4a5e2000 r--s 00000000 08:05 28083534
4a5e2000-4a5e8000 r--s 00000000 08:05 28083536
4a5e8000-4a5ed000 r--s 00000000 08:05 28083538
4a5ed000-4a5fa000 r--s 00000000 08:05 28083539
4a5fa000-4a600000 r--s 00000000 08:05 25694264
4a600000-4a6fb000 rw-p 000ec000 00:00 0
4a6fb000-4a700000 p 0010d000 00:00 0
4a700000-4a7fb000 rw-p 001ec000 00:00 0
4a7fb000-4a800000 p 00217000 00:00 0
4a800000-4a81f000 r--s 00000000 08:05 28083537
4a81f000-4a85c000 r--s 00000000 08:05 28083540
4a85c000-4a870000 r-xp 00000000 08:05 15239592
4a870000-4a871000 rw-p 00013000 08:05 15239592
4a871000-4a87f000 r--s 00000000 08:05 25694259
4a87f000-4a88d000 r--s 00000000 08:05 25694261
4a88d000-4a891000 r--s 00000000 08:05 25694279
4a892000-4a8fd000 rw-p 00021000 00:00 0
4a900000-4a9fe000 rw-p 00076000 00:00 0
4a9fe000-4aa00000 p 0009f000 00:00 0
4aa00000-4aaff000 rw-p 000a1000 00:00 0
4aaff000-4ab00000 p 000ca000 00:00 0
4ab00000-4abde000 rw-p 00189000 00:00 0
4abde000-4ac00000 p 001b2000 00:00 0
4ac00000-4acfe000 rw-p 0023d000 00:00 0
4acfe000-4ad00000 p 00266000 00:00 0
4ad00000-4ad21000 rw-p 00000000 00:00 0
4ad65000-4ad72000 r--s 00000000 08:05 25694263
4ad72000-4ad7e000 r--s 00000000 08:05 25694266
4ad7e000-4ad84000 r--s 00000000 08:05 25694269
4ad84000-4ae31000 rw-p 00084000 00:00 0
4ae71000-4ae91000 r--s 00000000 08:05 25694260
4ae91000-4aee0000 r--s 00000000 08:05 25694262
4aee0000-4aefd000 r--s 00000000 08:05 25694265
4aefd000-4af28000 r--s 00000000 08:05 25694267
4af28000-4af43000 r--s 00000000 08:05 25694268
4af43000-4af4d000 r--s 00000000 08:05 25694270
4af4d000-4af62000 r--s 00000000 08:05 25694271
4af62000-4af72000 r--s 00000000 08:05 25694272
4af72000-4afc9000 r--s 00000000 08:05 25694273
4afc9000-4b028000 r--s 00000000 08:05 25694274
4b028000-4b031000 r--s 00000000 08:05 25694275
4b031000-4b081000 r--s 00000000 08:05 25694276
4b081000-4b13a000 r--s 00000000 08:05 25694277
4b13a000-4b168000 r--s 00000000 08:05 25694278
4b168000-4b1a1000 r--s 00000000 08:05 25694280
4b1a1000-4b222000 r--s 00000000 08:05 25694281
4b222000-4b22a000 r--s 00000000 08:05 25694282
4b22a000-4b230000 r--s 00000000 08:05 25694283
4b230000-4b289000 r--s 00000000 08:05 25694284
4b289000-4b2a8000 r--s 00000000 08:05 25694285
4b2a8000-4b39f000 r--s 00000000 08:05 25694286
4b39f000-4b3af000 r--s 00000000 08:05 25694287
4b3af000-4b46a000 rw-p 00000000 00:00 0
4b500000-4b538000 rw-p 00096000 00:00 0
4b538000-4b600000 p 000bf000 00:00 0
bde00000-bde01000 p 00000000 00:00 0
bde01000-be000000 rwxp 00001000 00:00 0
be001000-be004000 p 00003000 00:00 0
be004000-be200000 rwxp 00006000 00:00 0
be200000-be204000 p 00000000 00:00 0
be204000-be400000 rwxp 00004000 00:00 0
be400000-be404000 p 00000000 00:00 0
be404000-be600000 rwxp 00004000 00:00 0
be600000-be604000 p 00000000 00:00 0
be604000-be800000 rwxp 00004000 00:00 0
be801000-be804000 p 00003000 00:00 0
be804000-bea00000 rwxp 00006000 00:00 0
bea01000-bea04000 p 00003000 00:00 0
bea04000-bec00000 rwxp 00006000 00:00 0
bec01000-bec04000 p 00003000 00:00 0
bec04000-bee00000 rwxp 00006000 00:00 0
bee00000-bee01000 p 00000000 00:00 0
bee01000-bf000000 rwxp 00001000 00:00 0
bf000000-bf001000 p 00000000 00:00 0
bf001000-bf200000 rwxp 00001000 00:00 0
bf200000-bf201000 p 00000000 00:00 0
bf201000-bf400000 rwxp 00001000 00:00 0
bf400000-bf401000 p 00000000 00:00 0
bf401000-bf600000 rwxp 00001000 00:00 0
bf600000-bf601000 p 00000000 00:00 0
bf601000-bf800000 rwxp 00001000 00:00 0
bfe01000-bfe04000 p 00000000 00:00 0
bfe04000-c0000000 rwxp ffe05000 00:00 0
VM Arguments:
jvm_args: -Xmx5M -Djava.endorsed.dirs=/usr/local/jakarta-tomcat-5.5.9/common/endorsed -Dcatalina.base=/usr/local/jakarta-tomcat-5.5.9 -Dcatalina.home=/usr/local/jakarta-tomcat-5.5.9 -Djava.io.tmpdir=/usr/local/jakarta-tomcat-5.5.9/temp
java_command: org.apache.catalina.startup.Bootstrap start
Environment Variables:
PATH=/usr/local/jakarta-tomcat-5.5.9/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin/X11:/usr/local/jdk1.5.0_04/bin:.
LD_LIBRARY_PATH=/usr/local/jdk1.5.0_04/jre/lib/i386/server:/usr/local/jdk1.5.0_04/jre/lib/i386:/usr/local/jdk1.5.0_04/jre/../lib/i386
SHELL=/bin/bash
Signal Handlers:
SIGSEGV: [libjvm.so+0x4b8860], sa_mask[0]=0xfffbfeff, sa_flags=0x14000004
SIGBUS: [libjvm.so+0x4b8860], sa_mask[0]=0xfffbfeff, sa_flags=0x14000004
SIGFPE: [libjvm.so+0x3f00a0], sa_mask[0]=0xfffbfeff, sa_flags=0x14000004
SIGPIPE: [libjvm.so+0x3f00a0], sa_mask[0]=0xfffbfeff, sa_flags=0x14000004
SIGILL: [libjvm.so+0x3f00a0], sa_mask[0]=0xfffbfeff, sa_flags=0x14000004
SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGUSR2: [libjvm.so+0x3f23e0], sa_mask[0]=0x80000000, sa_flags=0x14000004
SIGHUP: [libjvm.so+0x3f1e10], sa_mask[0]=0xfffbfeff, sa_flags=0x14000004
SIGINT: [libjvm.so+0x3f1e10], sa_mask[0]=0xfffbfeff, sa_flags=0x14000004
SIGQUIT: [libjvm.so+0x3f1e10], sa_mask[0]=0xfffbfeff, sa_flags=0x14000004
SIGTERM: [libjvm.so+0x3f1e10], sa_mask[0]=0xfffbfeff, sa_flags=0x14000004
S Y S T E M
OS:3.0
uname:Linux 2.4.20-021stab028.17.777-enterprise #1 SMP Tue Jul 19 19:31:27 MSD 2005 i686
libc:glibc 2.3.2 linuxthreads-0.10 (fixed stack)
rlimit: STACK 2044k, CORE 0k, NPROC 256, NOFILE 1024, AS infinity
load average:2.58 0.73 0.43
CPU:total 4 family 15, cmov, cx8, fxsr, mmx, sse, sse2, ht
Memory: 4k page, physical 2018k(23k free), swap 4000k(2546k free)
vm_info: Java HotSpot(TM) Server VM (1.5.0_04-b05)for linux-x86, built on Jun 3 2005 02:09:05 by java_re with gcc 3.2.1-7a (J2SE release)
