I'm desperate :( cannot track memory leak.

Hello.

Maybe someone can help me on this because I have tried already everything.

Basically we have an application that after running about for 3 weeks it reaches a state of "Out of Memory Error" and stops functioning. I tried to compare dumps of JMAP tracking out every day that passes but didn't see any unusual "leftovers" ....

I'm using Java 6 Update 1 SE on Win 2003 and JConsole constantly to monitor the JVM state.

The java process reaches very high OS memory capture: i.e. in task manager "Mem Usage" = 500,000 and "VM Size" = 700,000 after a week of running.

Java is running with the following parameters: -Xmx1024m -server -XX:+FullSpeedJVMDI -Xrs

Jconsole however shows that the Heap Size = about 40mb and growing but after GCs it goes back to around 40mb ...

Question a: if the heap is only 40mb, why java captures 700mb of memory ?

One more detail, the application is not using any native code only Oracle JDBC connections that are well managed and closed (hopefully :)

I'm desperate I think I have tried it all - using JProfiler and also YourKit and JHAT but nothing :(

If someone might have some idea regarding this it will be mostly appreciated !

Thank you.

[1249 byte] By [kipodusha] at [2007-11-27 6:54:36]
# 1

> using

> JProfiler and also YourKit and JHAT but nothing :(

Under load or just via testing?

It might simply be something it the VM itself or the Oracle driver.

One simple solution to this is to just restart the server once a week. Pick a low usage time, like Sunday morning. If someone ******* then point out that at least such restarts are planned rather than the current state when the server just fails unexpectedly.

jschella at 2007-7-12 18:29:39 > top of Java-index,Java HotSpot Virtual Machine,Specifications...
# 2

> I'm desperate :( cannot track memory leak.

Please don't crosspost.

> Java is running with the following parameters:

> -Xmx1024m -server -XX:+FullSpeedJVMDI -Xrs

Apparently you should use -XX:-OmitStackTraceInFastThrow instead of -XX:+FullSpeedJVMDI

> Jconsole however shows that the Heap Size = about

> 40mb and growing but after GCs it goes back to around 40mb ...

The heap size is somewhat higher than the 'peaks', what the 'valleys' are is not relevant.

> Question a: if the heap is only 40mb, why java

> captures 700mb of memory ?

Are you using lots of threads? (stack space is separate from heap space).

tschodta at 2007-7-12 18:29:39 > top of Java-index,Java HotSpot Virtual Machine,Specifications...
# 3
It is under a production environment.Doing restart once a week is a problematic solution to a system thatshould give a high percentage uptime :/
kipodusha at 2007-7-12 18:29:39 > top of Java-index,Java HotSpot Virtual Machine,Specifications...
# 4

> > I'm desperate :( cannot track memory leak.

>

> Please don't crosspost.

Sorry about that :)

>

> > Java is running with the following parameters:

> > -Xmx1024m -server -XX:+FullSpeedJVMDI -Xrs

>

> Apparently you should use

> -XX:-OmitStackTraceInFastThrow instead of

> -XX:+FullSpeedJVMDI

>

> > Jconsole however shows that the Heap Size = about

> > 40mb and growing but after GCs it goes back to

> around 40mb ...

>

> The heap size is somewhat higher than the 'peaks',

> what the 'valleys' are is not relevant.

What do you mean ? At peak it can reach 130mb heap but still 700mb

process size ?

>

> > Question a: if the heap is only 40mb, why java

> > captures 700mb of memory ?

>

> Are you using lots of threads? (stack space is

> separate from heap space).

Hmmm, I am using threads, JConsole shows 84 threads most of the time with peaks of 120 threads..... to my knowledge it's not so much. Is there a way to monitor the stack usage ?

kipodusha at 2007-7-12 18:29:39 > top of Java-index,Java HotSpot Virtual Machine,Specifications...
# 5

> > > Jconsole however shows that the Heap Size = about

> > > 40mb and growing but after GCs it goes back to around 40mb ...

> >

> > The heap size is somewhat higher than the 'peaks',

> > what the 'valleys' are is not relevant.

>

> What do you mean ? At peak it can reach 130mb heap

The JVM is reluctant to give heap back to the OS.

You are seeing (Runtime.totalMemory()-Runtime.freeMemory()) sawtooth.

Probably Runtime.maxMemory() is stable around 150M to 200M ?

> but still 700mb process size ?

Then there's perm space (default up to 64M) usually not counted in regular heap usage. Initially this grows as classes are loaded - during usage it grows to store JIT compiler output.

There could be "direct memory" (default up to 64M) not counted in regular heap usage.

> >

> > > Question a: if the heap is only 40mb, why java

> > > captures 700mb of memory ?

> >

> > Are you using lots of threads? (stack space is

> > separate from heap space).

>

> Hmmm, I am using threads, JConsole shows 84 threads

> most of the time with peaks of 120 threads..... to my

> knowledge it's not so much. Is there a way to monitor

> the stack usage ?

The default stack size limit is 256k on windows so you are unlikely to ever use more than 32M for stack space.

You can probably expect the same for JVM overhead.

I don't know what kind of overhead JVMDI/JVMTI might add.

Unlikely to make up the rest I would say.

tschodta at 2007-7-12 18:29:39 > top of Java-index,Java HotSpot Virtual Machine,Specifications...
# 6

Well it is kind of a problem since the process was restarted and it is now on the start of it's growing cycle, but at the moment the parameters are:

VM Size (task manager): 199,908k

Mem Size (task manager): 166,972k

JConsole:

Heap size: peak 140mb, Currently: 58mb

Non heap memory: 23mb

Perm gen: 17mb

Code cache: 5mb

Old gen: Peak 56mb

Threads: 82

Runtime. Free Memory: 7014640

Runtime. Max Memory: 1034027008

Runtime. Total Memory: 97517568

> I don't know what kind of overhead JVMDI/JVMTI might

> add.

> Unlikely to make up the rest I would say.

Well the JVM dies even if not monitored/debugged so as you said unlikely it's the reason.

> There could be "direct memory" (default up to 64M)

> not counted in regular heap usage.

What do you mean direct memory ?

According to the parameters I have written above, can you maybe guide me what to look at on the next upcoming week ?

>The JVM is reluctant to give heap back to the OS.

> You are seeing

> (Runtime.totalMemory()-Runtime.freeMemory())

> sawtooth.

> Probably Runtime.maxMemory() is stable around 150M to

> 200M ?

maxMemory shows lot's more than 150m .... look above.

kipodusha at 2007-7-12 18:29:39 > top of Java-index,Java HotSpot Virtual Machine,Specifications...
# 7

> Well it is kind of a problem since the process was

> restarted and it is now on the start of it's growing

> cycle, but at the moment the parameters are:

>

> VM Size (task manager): 199,908k

> Mem Size (task manager): 166,972k

> JConsole:

> Heap size: peak 140mb, Currently: 58mb

> Non heap memory: 23mb

> Perm gen: 17mb

> Code cache: 5mb

> Old gen: Peak 56mb

> Threads: 82

> Runtime. Free Memory: 7014640

> Runtime. Max Memory: 1034027008

> Runtime. Total Memory: 97517568

Heap currently allocated: 93mb.

Current heap usage: 86mb.

Max heap size: 986mb (close enough to 1024mb).

> > I don't know what kind of overhead JVMDI/JVMTI might add.

> > Unlikely to make up the rest I would say.

>

> Well the JVM dies even if not monitored/debugged so

> as you said unlikely it's the reason.

I concur.

> > There could be "direct memory" (default up to 64M)

> > not counted in regular heap usage.

>

> What do you mean direct memory ?

Google [ [url=http://www.google.com/search?q=java+direct+memory]java direct memory[/url] ]

> According to the parameters I have written above, can

> you maybe guide me what to look at on the next upcoming week ?

> ... after running about for 3 weeks it reaches a state of "Out of Memory Error" and stops functioning.

> Jconsole ... shows that the Heap Size = about 40mb and growing but after GCs it goes back to around 40mb ...

> Question a: if the heap is only 40mb, why java captures 700mb of memory ?

Are you seeing 700mb reserved for the process days before it crashes?

If process memory allocation ramps up steadily while Runtime.totalMemory() stays stable [as well as other memory areas] - you might have located a JVM memory leak.

Have you tried a more mature JVM (like 1.4.2).

> >The JVM is reluctant to give heap back to the OS.

Looks like totalMemory() hits 140mb and then shrinks back to 100mb - just a sign of an application that sees peaks of high memory requirements yet still sees a lot of activity at other times.

> > You are seeing (Runtime.totalMemory()-Runtime.freeMemory()) sawtooth.

> > Probably Runtime.maxMemory() is stable around 150M to 200M ?

>

> maxMemory shows lot's more than 150m .... look above.

Yes, maxMemory is the total allowed - this will not change over the lifetime of the JVM.

I meant totalMemory - heap currently allocated.

tschodta at 2007-7-12 18:29:39 > top of Java-index,Java HotSpot Virtual Machine,Specifications...
# 8

> > Well it is kind of a problem since the process was

> > restarted and it is now on the start of it's

> growing

> > cycle, but at the moment the parameters are:

> >

> > VM Size (task manager): 199,908k

> > Mem Size (task manager): 166,972k

> > JConsole:

> > Heap size: peak 140mb, Currently: 58mb

> > Non heap memory: 23mb

> > Perm gen: 17mb

> > Code cache: 5mb

> > Old gen: Peak 56mb

> > Threads: 82

>

> > Runtime. Free Memory: 7014640

> > Runtime. Max Memory: 1034027008

> > Runtime. Total Memory: 97517568

>

> Heap currently allocated: 93mb.

> Current heap usage: 86mb.

> Max heap size: 986mb (close enough to 1024mb).

>

> > > I don't know what kind of overhead JVMDI/JVMTI

> might add.

> > > Unlikely to make up the rest I would say.

> >

> > Well the JVM dies even if not monitored/debugged

> so

> > as you said unlikely it's the reason.

>

> I concur.

>

> > > There could be "direct memory" (default up to

> 64M)

> > > not counted in regular heap usage.

> >

> > What do you mean direct memory ?

>

> Google [

> [url=http://www.google.com/search?q=java+direct+memory

> ]java direct memory[/url] ]

Did you mean something like the following ? or did u mean something else ?:

-XX:MaxDirectMemorySize=<size>

Specifies the maximum amount of memory in bytes that the Java NIO library can allocate for direct memory buffers. The default is 64 megabytes, which corresponds to

-XX:MaxDirectMemorySize=64m. The use of direct memory buffers can minimize the copying cost when doing I/O operations.

>

> According to the parameters I have written above,

> can

> you maybe guide me what to look at on the next

> upcoming week ?

>

> > ... after running about for 3 weeks it reaches a

> state of "Out of Memory Error" and stops

> functioning.

> > Jconsole ... shows that the Heap Size = about 40mb

> and growing but after GCs it goes back to around 40mb

> ...

> > Question a: if the heap is only 40mb, why java

> captures 700mb of memory ?

>

> Are you seeing 700mb reserved for the process days

> before it crashes?

Actually 700mb is just about after a week, usually when the JVM crashes

it reaches about 900mb. Usually when it reaches that point it runs for few hours and then crash. So the situation is that it is not ever "stable" on 700mb or so, it always raises more and more until crash.

> If process memory allocation ramps up steadily while

> Runtime.totalMemory() stays stable [as well as other

> memory areas] - you might have located a JVM memory

> leak.

> Have you tried a more mature JVM (like 1.4.2).

>

Originally the application is running under 1.4.2_12 I just run it under v6 in order to run tools like JConsole and JMAP etc .... so the problem also happens in 1.4.2 JVM :(

> > >The JVM is reluctant to give heap back to the OS.

>

> Looks like totalMemory() hits 140mb and then shrinks

> back to 100mb - just a sign of an application that

> sees peaks of high memory requirements yet still sees

> a lot of activity at other times.

>

>

> > > You are seeing

> (Runtime.totalMemory()-Runtime.freeMemory())

> sawtooth.

> > > Probably Runtime.maxMemory() is stable around

> 150M to 200M ?

> >

> > maxMemory shows lot's more than 150m .... look

> above.

>

> Yes, maxMemory is the total allowed - this will not

> change over the lifetime of the JVM.

> I meant totalMemory - heap currently allocated.

I will try to keep more tracking on these parameters (totalMemory,maxMemory & freeMemory) during the lifecycle of the JVM and I'll see what happens.

One more hint: Last week it was the first time that the JVM actually crashed (running under 1.6 and not 1.4.2) and not just stopped working with an "OutOfMemoryError" exception.

At its final last moment before crash the output to the console was:

kgefec: fatal error 0

kgepop: no error frame to pop to for error 21503

Googling on that landed on traces of something to do with the Oracle driver.

My next trial is to update the Oracle drivers version to see if it will help.

kipodusha at 2007-7-12 18:29:39 > top of Java-index,Java HotSpot Virtual Machine,Specifications...
# 9

> > > > There could be "direct memory" (default up to 64M)

> > > > not counted in regular heap usage.

> > >

> > > What do you mean direct memory ?

> >

> > Google [

> >

> [url=http://www.google.com/search?q=java+direct+memory

>

> > ]java direct memory[/url] ]

>

> Did you mean something like the following ? or did u

> mean something else ?:

>

> -XX:MaxDirectMemorySize=<size>

> Specifies the maximum amount of memory in bytes that

> the Java NIO library can allocate for direct memory

> buffers. The default is 64 megabytes, which

> corresponds to

> -XX:MaxDirectMemorySize=64m. The use of direct memory

> buffers can minimize the copying cost when doing I/O

> operations.

The -XX:MaxDirectMemorySize is how you change the default 64m, if necessary.

What I mean is; maybe 3rd party libraries (oracle) use direct memory - in which case it will not be more than 64m.

> > According to the parameters I have written above, can

> > you maybe guide me what to look at on the next

> > upcoming week ?

> >

> > > ... after running about for 3 weeks it reaches a

> > state of "Out of Memory Error" and stops functioning.

> > > Jconsole ... shows that the Heap Size = about 40mb

> > and growing but after GCs it goes back to around 40mb

> > ...

> > > Question a: if the heap is only 40mb, why java

> > captures 700mb of memory ?

> >

> > Are you seeing 700mb reserved for the process days

> > before it crashes?

>

> Actually 700mb is just about after a week,

> usually when the JVM crashes it reaches about 900mb.

> Usually when it reaches that point

> it runs for few hours and then crash. So the

> situation is that it is not ever "stable" on 700mb or

> so, it always raises more and more until crash.

> > If process memory allocation ramps up steadily while

> > Runtime.totalMemory() stays stable [as well as other

> > memory areas] - you might have located a JVM memory leak.

> > Have you tried a more mature JVM (like 1.4.2).

> >

>

> Originally the application is running under 1.4.2_12

> I just run it under v6 in order to run tools like

> JConsole and JMAP etc .... so the problem also

> happens in 1.4.2 JVM :(

>

> > > >The JVM is reluctant to give heap back to the OS.

> >

> > Looks like totalMemory() hits 140mb and then shrinks

> > back to 100mb - just a sign of an application that

> > sees peaks of high memory requirements yet still sees

> > a lot of activity at other times.

> >

> >

> > > > You are seeing (Runtime.totalMemory()-Runtime.freeMemory()) sawtooth.

> > > > Probably Runtime.maxMemory() is stable around 150M to 200M ?

> > >

> > > maxMemory shows lot's more than 150m .... look above.

> >

> > Yes, maxMemory is the total allowed - this will not change over the lifetime of the JVM.

> > I meant totalMemory - heap currently allocated.

>

> I will try to keep more tracking on these parameters

> (totalMemory,maxMemory & freeMemory) during the

> lifecycle of the JVM and I'll see what happens.

>

> One more hint: Last week it was the first time that

> the JVM actually crashed (running under 1.6 and not

> 1.4.2) and not just stopped working with an "OutOfMemoryError" exception.

> At its final last moment before crash the output to

> the console was:

>

> kgefec: fatal error 0

> kgepop: no error frame to pop to for error 21503

>

> Googling on that landed on traces of something to do

> with the Oracle driver.

> My next trial is to update the Oracle drivers version

> to see if it will help.

Could be the oracle jdbc driver uses JNI and is leaking memory in native code.

tschodta at 2007-7-12 18:29:39 > top of Java-index,Java HotSpot Virtual Machine,Specifications...
# 10

> > > > > There could be "direct memory" (default up to

> 64M)

> > > > > not counted in regular heap usage.

> > > >

> > > > What do you mean direct memory ?

> > >

> > > Google [

> > >

> >

> [url=http://www.google.com/search?q=java+direct+memory

>

> >

> > > ]java direct memory[/url] ]

> >

> > Did you mean something like the following ? or did

> u

> > mean something else ?:

> >

> > -XX:MaxDirectMemorySize=<size>

> > Specifies the maximum amount of memory in bytes

> that

> > the Java NIO library can allocate for direct

> memory

> > buffers. The default is 64 megabytes, which

> > corresponds to

> > -XX:MaxDirectMemorySize=64m. The use of direct

> memory

> > buffers can minimize the copying cost when doing

> I/O

> > operations.

>

> The -XX:MaxDirectMemorySize is how you change the

> default 64m, if necessary.

> What I mean is; maybe 3rd party libraries (oracle)

> use direct memory - in which case it will not be more

> than 64m.

>

>

> > > According to the parameters I have written above,

> can

> > > you maybe guide me what to look at on the next

> > > upcoming week ?

> > >

> > > > ... after running about for 3 weeks it reaches

> a

> > > state of "Out of Memory Error" and stops

> functioning.

> > > > Jconsole ... shows that the Heap Size = about

> 40mb

> > > and growing but after GCs it goes back to around

> 40mb

> > > ...

> > > > Question a: if the heap is only 40mb, why java

> > > captures 700mb of memory ?

> > >

> > > Are you seeing 700mb reserved for the process

> days

> > > before it crashes?

> >

> > Actually 700mb is just about after a week,

> > usually when the JVM crashes it reaches about

> 900mb.

> > Usually when it reaches that point

> > it runs for few hours and then crash. So the

> > situation is that it is not ever "stable" on 700mb

> or

> > so, it always raises more and more until crash.

>

> > If process memory allocation ramps up steadily

> while

> > Runtime.totalMemory() stays stable [as well as

> other

> > memory areas] - you might have located a JVM

> memory leak.

> > Have you tried a more mature JVM (like 1.4.2).

> >

>

> Originally the application is running under

> 1.4.2_12

> I just run it under v6 in order to run tools like

> JConsole and JMAP etc .... so the problem also

> happens in 1.4.2 JVM :(

>

> > > >The JVM is reluctant to give heap back to the

> OS.

> >

> > Looks like totalMemory() hits 140mb and then

> shrinks

> > back to 100mb - just a sign of an application

> that

> > sees peaks of high memory requirements yet still

> sees

> > a lot of activity at other times.

> >

> >

> > > > You are seeing

> (Runtime.totalMemory()-Runtime.freeMemory())

> sawtooth.

> > > > Probably Runtime.maxMemory() is stable around

> 150M to 200M ?

> > >

> > > maxMemory shows lot's more than 150m .... look

> above.

> >

> > Yes, maxMemory is the total allowed - this will

> not change over the lifetime of the JVM.

> > I meant totalMemory - heap currently allocated.

>

> I will try to keep more tracking on these

> parameters

> (totalMemory,maxMemory & freeMemory) during the

> lifecycle of the JVM and I'll see what happens.

>

> One more hint: Last week it was the first time that

> the JVM actually crashed (running under 1.6 and not

> 1.4.2) and not just stopped working with an

> "OutOfMemoryError" exception.

> At its final last moment before crash the output to

> the console was:

>

> kgefec: fatal error 0

> kgepop: no error frame to pop to for error 21503

>

> Googling on that landed on traces of something to

> do

> with the Oracle driver.

> My next trial is to update the Oracle drivers

> version

> to see if it will help.

>

> Could be the oracle jdbc driver uses JNI and is

> leaking memory in native code.

Ok, thank you very much.

I'll continue to investigate this and keep this thread posted :)

kipodusha at 2007-7-12 18:29:39 > top of Java-index,Java HotSpot Virtual Machine,Specifications...
# 11

> It is under a production environment.

> Doing restart once a week is a problematic solution

> to a system that

> should give a high percentage uptime :/

Yes, but again, currently you have no other solution.

And restarting it when there is low usage is better than having it fail during high usage.

jschella at 2007-7-12 18:29:39 > top of Java-index,Java HotSpot Virtual Machine,Specifications...
# 12
> > Could be the oracle jdbc driver uses JNI and is> leaking memory in native code.That would be the OCI driver.The thin driver is java only.
jschella at 2007-7-12 18:29:39 > top of Java-index,Java HotSpot Virtual Machine,Specifications...
# 13

Yap, I am going to try and test the system with thin client instead of the OCI driver to see the results.

> >

> > Could be the oracle jdbc driver uses JNI and is

> > leaking memory in native code.

>

> That would be the OCI driver.

> The thin driver is java only.

kipodusha at 2007-7-12 18:29:39 > top of Java-index,Java HotSpot Virtual Machine,Specifications...
# 14

Hi,

I am also facing the similar issue. I am running my web application in WebSphere App Server 5.1.12 and noticed that the Java process memory keeps increasing.

I have enabled the verbose GC and noticed it is fine. Also at any point in time, the Runtime.total - used is also fine. All these are very much within the limit.

I even generated a core dump files and compared them and found no hung thread or a suspect reported.

I have also tried JProfiler and found no objects allocated more than the limit.

Also i have checked thoriughly the code for connection or resultset or preparedstatement not getting closed and could find none.

Still MY JAVA PROCESS IN TOP keeps increasing and the server crashes once in 3 days.

Now we have a scheduled restart of the application everyday 5:00 AM to overcome the problem. What could be the issue.

I am using DB2 as the database and app is running in java 1.4.2. We also use one 3rd party jar for workflow (JBPM) which uses hibernate for database connectivity.

Any help on this is appreciated. Many thanks.

je22chapa at 2007-7-12 18:29:39 > top of Java-index,Java HotSpot Virtual Machine,Specifications...
# 15

Ok, I think I finally might have found the problem which was our prime suspect all this time (went to buy a champagne :)

The following is a dangerous component:

Oracle OCI driver for JDBC version 9.2.0.1 running on Win 2003.

This was tested under JVM 1.4.2_12 and also under JVM 1.6 Update 1.

Switching to a thin client and not the native OCI causes the JVM to be much much thinner in memory consumption and be steady, i.e. in task manager "Mem Usage:" 90,000 "VM Size" - 130,000 instead of the craziness it was before.

Just to be on the safe side I will post another message in about a week to see that the JVM state is still 100% ok.

Thank you all for helping me tschodt and jschell :)

kipodusha at 2007-7-21 22:09:05 > top of Java-index,Java HotSpot Virtual Machine,Specifications...
# 16

After 9 days or running the JVM seems to be stable with the following "Task Manager" readings - Mem Usage: 418692 VM Size: 438548

Over time the process memory grows and shrinks.

I am running a sampling program to measure the JVM footprint every minute and the results looks like the following:

Time MemSize VMSize Threads

12/06/2007 11:54:25 -> 132228 180504 42

12/06/2007 11:55:25 -> 181572 218392 87

12/06/2007 11:56:25 -> 179680 216328 86

12/06/2007 11:57:25 -> 179604 215976 87

12/06/2007 11:58:25 -> 228348 265220 86

12/06/2007 11:59:25 -> 179576 215908 87

12/06/2007 12:00:25 -> 179700 215368 87

12/06/2007 12:01:25 -> 179776 215936 87

12/06/2007 12:02:25 -> 179888 216040 87

12/06/2007 12:03:25 -> 277616 313744 86

12/06/2007 12:04:25 -> 277656 313784 86

12/06/2007 12:05:25 -> 229160 264520 89

12/06/2007 15:09:25 -> 202484 237184 92

12/06/2007 15:10:25 -> 202292 236876 93

12/06/2007 15:11:25 -> 202360 236928 92

12/06/2007 15:12:25 -> 42096 237188 92

12/06/2007 15:13:25 -> 151168 285948 92

12/06/2007 15:14:25 -> 213128 287096 92

12/06/2007 15:15:25 -> 165708 236672 92

12/06/2007 15:16:25 -> 169072 236824 92

12/06/2007 15:17:25 -> 169572 236636 92

12/06/2007 15:18:25 -> 173656 239548 92

12/06/2007 15:19:25 -> 173436 237444 93

12/06/2007 15:20:25 -> 173200 237312 92

12/06/2007 15:21:25 -> 173540 237684 93

12/06/2007 15:22:25 -> 173528 237648 92

12/06/2007 15:23:25 -> 173184 237064 93

12/06/2007 15:24:25 -> 173352 237228 93

12/06/2007 15:25:25 -> 173252 237116 92

12/06/2007 15:26:25 -> 173464 237356 93

12/06/2007 15:27:25 -> 173396 237320 93

12/06/2007 15:28:25 -> 173528 237452 93

12/06/2007 15:29:25 -> 173688 237372 93

12/06/2007 15:30:25 -> 173964 237696 93

12/06/2007 15:31:25 -> 173780 237288 94

12/06/2007 15:32:25 -> 174368 237928 93

12/06/2007 15:33:25 -> 174044 237348 92

12/06/2007 15:34:25 -> 174232 237568 93

12/06/2007 15:35:25 -> 174404 237600 92

12/06/2007 15:36:25 -> 174536 237736 94

12/06/2007 15:37:25 -> 175232 237976 92

12/06/2007 15:38:25 -> 175472 238220 92

12/06/2007 15:39:25 -> 174948 237596 92

12/06/2007 15:40:25 -> 174764 237312 92

12/06/2007 15:41:25 -> 175000 237548 92

12/06/2007 15:42:24 -> 174980 237300 91

12/06/2007 15:43:24 -> 176616 238836 92

12/06/2007 15:44:24 -> 176272 238108 92

12/06/2007 15:45:24 -> 176320 237964 93

12/06/2007 15:46:25 -> 177844 239368 92

12/06/2007 15:47:24 -> 177640 238856 92

12/06/2007 15:48:24 -> 177568 238140 92

12/06/2007 15:49:25 -> 177736 238184 94

12/06/2007 15:50:24 -> 179104 239256 93

12/06/2007 15:51:24 -> 179388 239364 92

12/06/2007 15:52:24 -> 179060 238772 93

12/06/2007 15:53:24 -> 179156 238440 94

12/06/2007 15:54:25 -> 195828 245044 97

12/06/2007 15:55:25 -> 191844 240524 96

12/06/2007 15:56:25 -> 192204 240668 97

12/06/2007 15:57:24 -> 194192 242436 95

12/06/2007 15:58:24 -> 193092 240488 95

12/06/2007 15:59:25 -> 174284 240644 96

12/06/2007 16:00:25 -> 177520 240552 95

12/06/2007 16:01:24 -> 182180 241160 97

12/06/2007 16:02:25 -> 182948 241396 96

12/06/2007 16:03:24 -> 183172 240984 95

12/06/2007 16:04:24 -> 183128 240712 97

12/06/2007 16:05:25 -> 184360 240956 98

12/06/2007 16:06:25 -> 185048 241500 97

12/06/2007 16:07:25 -> 185144 241064 98

12/06/2007 16:08:24 -> 186016 241064 95

12/06/2007 16:09:25 -> 186404 241284 98

12/06/2007 16:10:25 -> 186348 241308 96

12/06/2007 16:11:24 -> 186052 240784 95

12/06/2007 16:12:25 -> 186012 240708 96

12/06/2007 16:13:25 -> 186404 240896 95

12/06/2007 16:14:25 -> 186660 241108 96

12/06/2007 16:15:25 -> 186572 240928 98

12/06/2007 16:16:25 -> 186840 241088 96

12/06/2007 16:17:24 -> 187328 241296 95

12/06/2007 16:18:27 -> 187056 240836 95

12/06/2007 16:19:25 -> 187712 241392 95

12/06/2007 16:20:25 -> 203788 255856 97

12/06/2007 16:21:25 -> 192196 241056 97

12/06/2007 16:22:25 -> 192488 241184 97

12/06/2007 16:23:25 -> 192536 241080 100

12/06/2007 16:24:25 -> 195824 241144 97

12/06/2007 16:25:25 -> 196144 241280 97

12/06/2007 16:26:25 -> 197724 240980 98

12/06/2007 16:27:25 -> 198332 241200 97

12/06/2007 16:28:25 -> 198528 241376 98

12/06/2007 16:29:25 -> 198732 241220 98

12/06/2007 16:30:25 -> 198796 241156 96

12/06/2007 16:31:25 -> 198944 241152 98

12/06/2007 16:32:25 -> 199220 241060 96

12/06/2007 16:33:25 -> 206616 256068 96

12/06/2007 16:34:25 -> 199976 249472 97

12/06/2007 16:35:25 -> 194172 243632 96

12/06/2007 16:36:25 -> 186564 235976 97

12/06/2007 16:37:25 -> 182080 231460 97

12/06/2007 16:38:25 -> 175180 224556 98

12/06/2007 16:39:25 -> 172824 222244 97

12/06/2007 16:40:25 -> 173800 223060 99

12/06/2007 16:41:25 -> 179420 226032 95

12/06/2007 16:42:25 -> 181504 226628 95

12/06/2007 16:43:25 -> 179964 225024 94

12/06/2007 16:44:25 -> 179036 224008 94

12/06/2007 16:45:25 -> 179220 224208 95

12/06/2007 16:46:25 -> 177752 222716 94

12/06/2007 16:47:25 -> 177956 222804 95

12/06/2007 16:48:25 -> 178012 222848 94

12/06/2007 16:49:25 -> 177388 221600 97

12/06/2007 16:50:24 -> 175460 219588 94

12/06/2007 16:51:25 -> 175516 219636 94

12/06/2007 16:52:24 -> 175580 219640 94

12/06/2007 16:53:25 -> 174176 218236 94

12/06/2007 16:54:24 -> 174872 218920 94

12/06/2007 16:55:24 -> 175516 214976 95

12/06/2007 16:56:25 -> 17916 214940 94

12/06/2007 16:57:24 -> 126680 219680 95

12/06/2007 16:58:25 -> 129436 218652 94

12/06/2007 16:59:25 -> 131924 218852 94

12/06/2007 17:00:24 -> 136748 221788 94

12/06/2007 17:01:24 -> 141156 216068 94

12/06/2007 17:02:24 -> 141816 216116 94

12/06/2007 17:03:24 -> 142020 214696 97

12/06/2007 17:04:25 -> 141860 213372 94

12/06/2007 17:05:24 -> 142568 213460 96

12/06/2007 17:06:24 -> 141244 211716 94

12/06/2007 17:07:25 -> 140448 210928 94

12/06/2007 17:08:24 -> 138816 209156 94

12/06/2007 17:09:24 -> 138036 208368 95

12/06/2007 17:10:24 -> 136616 206920 94

12/06/2007 17:11:24 -> 136688 207012 95

12/06/2007 17:12:24 -> 135676 205976 94

12/06/2007 17:13:24 -> 135672 205996 95

12/06/2007 17:14:24 -> 134820 205104 94

12/06/2007 17:15:24 -> 133640 203836 94

12/06/2007 17:16:24 -> 133260 203372 94

12/06/2007 17:17:24 -> 132172 202220 94

12/06/2007 17:18:24 -> 131564 201592 94

12/06/2007 17:19:25 -> 130508 200440 94

12/06/2007 17:20:24 -> 130516 200452 94

12/06/2007 17:21:24 -> 129192 199064 94

12/06/2007 17:22:24 -> 129080 198872 95

12/06/2007 17:23:24 -> 127120 196684 95

12/06/2007 17:24:24 -> 126068 195444 96

12/06/2007 17:25:24 -> 124924 194180 97

12/06/2007 17:26:24 -> 124212 193128 94

12/06/2007 17:27:24 -> 123060 191876 94

12/06/2007 17:28:24 -> 122428 191204 94

12/06/2007 17:29:24 -> 120876 189604 94

12/06/2007 17:30:24 -> 120192 188904 94

12/06/2007 17:31:24 -> 118832 187496 94

12/06/2007 17:32:24 -> 118096 186716 94

12/06/2007 17:33:24 -> 116812 185376 94

12/06/2007 17:34:24 -> 116328 184740 94

12/06/2007 17:35:24 -> 115260 183512 94

12/06/2007 17:36:24 -> 114004 182164 94

12/06/2007 17:37:24 -> 112908 181024 94

12/06/2007 17:38:24 -> 111716 179768 94

12/06/2007 17:39:24 -> 110624 178668 95

12/06/2007 17:40:24 -> 109492 177492 94

12/06/2007 17:41:24 -> 124320 175336 94

12/06/2007 17:42:25 -> 122720 173716 94

12/06/2007 17:43:24 -> 121648 172664 95

12/06/2007 17:44:24 -> 120352 171348 94

12/06/2007 17:45:24 -> 119244 170276 95

12/06/2007 17:46:24 -> 118500 169488 94

12/06/2007 17:47:24 -> 118000 168972 94

12/06/2007 17:48:24 -> 117684 168600 94

12/06/2007 17:49:24 -> 31624 210792 94

12/06/2007 17:50:24 -> 52784 166996 94

12/06/2007 17:51:24 -> 72864 166048 94

12/06/2007 17:52:24 -> 75812 165124 95

12/06/2007 17:53:24 -> 80868 163128 95

12/06/2007 17:54:24 -> 81600 162372 95

12/06/2007 17:55:24 -> 82468 161472 95

12/06/2007 17:56:24 -> 82772 159812 94

12/06/2007 17:57:24 -> 82932 158624 95

12/06/2007 17:58:24 -> 83376 156640 95

12/06/2007 17:59:24 -> 83216 155276 94

12/06/2007 18:00:24 -> 83308 153924 96

12/06/2007 18:01:24 -> 97396 168548 94

12/06/2007 18:02:24 -> 100572 171352 94

12/06/2007 18:03:24 -> 100568 170392 94

12/06/2007 18:04:24 -> 100844 170360 94

12/06/2007 18:05:24 -> 100616 169716 95

12/06/2007 18:06:24 -> 101056 169320 94

12/06/2007 18:07:24 -> 101200 168668 95

12/06/2007 18:08:24 -> 100864 168228 94

16/06/2007 12:17:41 -> 179488 368864 94

16/06/2007 12:18:41 -> 179564 368916 94

16/06/2007 12:19:41 -> 179628 368996 95

17/06/2007 20:35:39 -> 190740 538340 95

17/06/2007 20:36:39 -> 190748 538316 93

17/06/2007 20:37:39 -> 190840 538256 93

17/06/2007 20:38:39 -> 190912 538328 93

17/06/2007 20:39:39 -> 191052 538492 93

17/06/2007 20:40:39 -> 191108 538548 93

17/06/2007 20:41:39 -> 190964 538196 93

17/06/2007 20:42:39 -> 190964 538196 93

17/06/2007 20:43:39 -> 191028 538260 93

17/06/2007 20:44:39 -> 191176 538320 94

17/06/2007 20:45:39 -> 191156 538284 93

17/06/2007 20:46:39 -> 191176 538320 94

17/06/2007 20:47:39 -> 191164 538288 93

19/06/2007 23:03:37 -> 395896 538456 93

19/06/2007 23:04:37 -> 395896 538456 93

19/06/2007 23:05:37 -> 395932 538492 93

19/06/2007 23:06:37 -> 395932 538492 93

19/06/2007 23:07:37 -> 395888 538784 94

19/06/2007 23:08:37 -> 395844 538724 93

19/06/2007 23:09:37 -> 396008 538904 94

19/06/2007 23:10:37 -> 395984 538872 93

19/06/2007 23:11:37 -> 395988 538868 93

19/06/2007 23:12:37 -> 395992 538496 93

19/06/2007 23:13:37 -> 396028 538532 93

19/06/2007 23:14:37 -> 396028 538532 93

19/06/2007 23:15:37 -> 396124 538628 93

19/06/2007 23:16:37 -> 396016 538712 93

19/06/2007 23:17:37 -> 396028 538724 93

19/06/2007 23:18:37 -> 396028 538724 93

19/06/2007 23:19:37 -> 396028 538724 93

19/06/2007 23:20:37 -> 396028 538724 93

19/06/2007 23:21:37 -> 396028 538724 93

19/06/2007 23:22:37 -> 396228 538620 93

19/06/2007 23:23:37 -> 396228 538620 93

19/06/2007 23:24:37 -> 396268 538660 93

19/06/2007 23:25:37 -> 396268 538660 93

19/06/2007 23:26:37 -> 396348 538760 94

19/06/2007 23:27:37 -> 396252 538660 94

19/06/2007 23:28:37 -> 396288 538696 94

19/06/2007 23:29:37 -> 396432 538844 94

19/06/2007 23:30:37 -> 396412 538808 93

19/06/2007 23:31:37 -> 396184 538580 93

19/06/2007 23:32:37 -> 396220 538616 93

19/06/2007 23:33:37 -> 396220 538616 93

19/06/2007 23:34:37 -> 396292 538688 93

19/06/2007 23:35:37 -> 396160 538616 93

19/06/2007 23:36:37 -> 396196 538652 93

19/06/2007 23:37:37 -> 396172 538628 93

19/06/2007 23:38:37 -> 396172 538628 93

19/06/2007 23:39:37 -> 396172 538628 93

19/06/2007 23:40:37 -> 396172 538628 93

19/06/2007 23:41:37 -> 396172 538628 93

19/06/2007 23:42:37 -> 396124 538584 93

19/06/2007 23:43:37 -> 396128 538584 93

19/06/2007 23:44:37 -> 396164 538620 93

19/06/2007 23:45:37 -> 396164 538620 93

19/06/2007 23:46:37 -> 396264 538720 93

19/06/2007 23:47:37 -> 396128 538648 93

19/06/2007 23:48:37 -> 396180 538700 93

19/06/2007 23:49:37 -> 396172 538696 93

21/06/2007 05:51:35 -> 472448 538228 94

21/06/2007 05:52:35 -> 472452 538228 94

21/06/2007 09:38:35 -> 476532 539412 94

21/06/2007 09:39:35 -> 476448 539340 95

21/06/2007 09:40:35 -> 476496 539348 94

21/06/2007 09:41:35 -> 477144 540008 95

21/06/2007 09:42:35 -> 476464 539188 94

21/06/2007 09:43:35 -> 476516 539240 94

21/06/2007 09:44:35 -> 476676 539412 95

21/06/2007 09:45:35 -> 476468 539084 95

21/06/2007 09:46:35 -> 476560 539176 95

21/06/2007 09:47:35 -> 476664 539280 95

21/06/2007 09:48:35 -> 476528 539072 94

21/06/2007 09:49:35 -> 476520 539060 94

21/06/2007 09:50:35 -> 476520 539060 94

21/06/2007 09:51:35 -> 477072 539616 94

21/06/2007 09:52:35 -> 476632 539072 94

21/06/2007 09:53:35 -> 476680 539120 94

21/06/2007 09:54:35 -> 476772 539208 94

21/06/2007 09:55:35 -> 476692 539048 94

21/06/2007 09:56:35 -> 476784 539136 94

21/06/2007 09:57:35 -> 476852 539204 94

21/06/2007 09:58:35 -> 476776 539052 94

21/06/2007 09:59:35 -> 476772 539052 94

21/06/2007 10:00:35 -> 477140 539556 96

21/06/2007 10:01:35 -> 477172 539508 94

21/06/2007 10:02:35 -> 478112 539940 96

21/06/2007 10:03:35 -> 478308 539404 95

21/06/2007 10:04:35 -> 479512 540600 97

21/06/2007 10:05:35 -> 478944 539640 97

21/06/2007 10:06:35 -> 479120 539584 95

21/06/2007 10:07:35 -> 479548 539732 97

21/06/2007 10:08:35 -> 479752 539664 97

21/06/2007 10:09:35 -> 479916 539760 98

21/06/2007 10:10:35 -> 479772 539300 95

21/06/2007 10:11:35 -> 481024 540596 96

21/06/2007 10:12:35 -> 480400 539856 95

21/06/2007 10:13:35 -> 480040 539416 95

21/06/2007 10:14:35 -> 480252 539644 96

21/06/2007 10:15:35 -> 480336 539584 95

21/06/2007 10:16:35 -> 480524 539644 96

21/06/2007 10:17:36 -> 480776 539492 96

21/06/2007 10:18:35 -> 481100 539864 95

21/06/2007 10:19:35 -> 481708 540368 95

21/06/2007 10:20:35 -> 480776 539332 94

21/06/2007 10:21:35 -> 480848 539420 95

21/06/2007 10:22:35 -> 480824 539384 94

21/06/2007 10:23:35 -> 480956 539528 95

21/06/2007 10:24:35 -> 480848 539336 94

21/06/2007 10:25:35 -> 481372 539812 95

21/06/2007 10:26:35 -> 481076 539436 94

21/06/2007 10:27:35 -> 481160 539428 94

21/06/2007 10:28:35 -> 481380 539664 95

21/06/2007 10:29:35 -> 481188 539396 94

21/06/2007 10:30:35 -> 481316 539552 95

21/06/2007 10:31:35 -> 481376 539380 94

21/06/2007 10:32:35 -> 481376 539384 94

21/06/2007 10:33:35 -> 481576 539588 94

21/06/2007 10:34:35 -> 481576 539580 94

21/06/2007 10:35:35 -> 481392 539348 94

21/06/2007 10:36:35 -> 481388 539344 94

21/06/2007 10:37:35 -> 481436 539396 94

21/06/2007 10:38:35 -> 481436 539392 94

21/06/2007 10:39:35 -> 481624 539588 100

21/06/2007 10:40:35 -> 481540 539448 94

21/06/2007 10:41:35 -> 481624 539560 96

21/06/2007 10:42:35 -> 481632 539536 94

21/06/2007 10:43:35 -> 481504 539332 94

21/06/2007 10:44:35 -> 481504 539332 94

21/06/2007 10:45:35 -> 481564 539392 94

21/06/2007 10:46:35 -> 481556 539384 94

21/06/2007 10:47:35 -> 481728 539524 95

21/06/2007 10:48:35 -> 481792 539584 95

21/06/2007 10:49:35 -> 481648 539388 95

21/06/2007 10:50:35 -> 481676 539420 95

21/06/2007 10:51:35 -> 501800 559504 94

21/06/2007 10:52:35 -> 482972 540236 95

21/06/2007 10:53:35 -> 483728 540992 94

21/06/2007 10:54:35 -> 485512 542804 95

21/06/2007 10:55:35 -> 485496 542772 94

21/06/2007 10:56:35 -> 483976 541072 94

21/06/2007 10:57:35 -> 485588 542680 94

21/06/2007 10:58:35 -> 483976 539364 94

21/06/2007 10:59:35 -> 485672 541092 95

21/06/2007 11:00:34 -> 487348 542744 94

21/06/2007 11:01:34 -> 484068 539428 95

21/06/2007 11:02:34 -> 485700 541064 94

21/06/2007 11:03:34 -> 487360 542724 94

21/06/2007 11:04:35 -> 484144 539512 97

21/06/2007 11:05:34 -> 485724 541064 94

21/06/2007 11:06:35 -> 487520 542876 96

21/06/2007 11:07:34 -> 484148 539480 95

21/06/2007 11:08:35 -> 485796 541136 95

21/06/2007 11:09:34 -> 484124 539460 96

21/06/2007 11:10:34 -> 484188 539508 95

21/06/2007 11:11:34 -> 485888 541212 95

21/06/2007 11:12:34 -> 485668 540996 95

21/06/2007 11:13:34 -> 485708 541028 95

21/06/2007 11:14:34 -> 487384 542724 95

21/06/2007 11:15:34 -> 488968 544324 94

21/06/2007 11:16:34 -> 488976 544300 94

21/06/2007 11:17:39 -> 485756 541096 95

21/06/2007 11:18:34 -> 487508 542828 95

21/06/2007 11:19:34 -> 484160 539456 95

21/06/2007 11:20:34 -> 485952 541252 95

21/06/2007 11:21:34 -> 488084 543368 94

21/06/2007 11:22:34 -> 488136 543424 94

21/06/2007 11:23:34 -> 485724 541008 94

21/06/2007 11:24:35 -> 487348 542648 94

21/06/2007 11:25:34 -> 487444 542720 94

21/06/2007 11:26:34 -> 484092 539356 94

21/06/2007 11:27:34 -> 485796 541072 94

21/06/2007 11:28:34 -> 485848 541120 94

21/06/2007 11:29:34 -> 484152 539372 94

21/06/2007 11:30:34 -> 485760 541000 94

21/06/2007 11:31:34 -> 485904 541128 94

21/06/2007 11:32:34 -> 484220 539380 94

21/06/2007 11:33:34 -> 485928 541120 94

21/06/2007 11:34:34 -> 485972 541152 94

21/06/2007 11:35:34 -> 487640 542828 94

21/06/2007 11:36:34 -> 485936 541052 94

21/06/2007 11:37:34 -> 485940 541056 94

21/06/2007 11:38:34 -> 487640 542752 94

21/06/2007 11:39:34 -> 489228 544364 94

21/06/2007 11:40:34 -> 485056 539196 94

21/06/2007 11:41:34 -> 487320 541432 94

21/06/2007 11:42:34 -> 488928 543060 94

21/06/2007 11:43:34 -> 485092 539168 94

21/06/2007 11:44:34 -> 486732 540824 94

21/06/2007 11:45:34 -> 488344 542432 94

21/06/2007 11:46:34 -> 486404 539304 95

21/06/2007 11:47:34 -> 488000 540904 94

21/06/2007 11:48:34 -> 489780 542688 95

21/06/2007 11:49:34 -> 486428 539184 94

21/06/2007 11:50:34 -> 488144 540920 95

21/06/2007 11:51:34 -> 489780 542552 94

21/06/2007 11:52:34 -> 486752 539424 95

21/06/2007 11:53:34 -> 488264 540988 94

21/06/2007 11:54:34 -> 489944 542680 95

21/06/2007 11:55:34 -> 486956 539460 94

21/06/2007 11:56:34 -> 488732 541312 98

21/06/2007 11:57:34 -> 488572 540904 95

21/06/2007 11:58:34 -> 488596 540908 94

21/06/2007 11:59:34 -> 490300 542604 94

21/06/2007 12:00:36 -> 492012 544344 95

21/06/2007 12:01:34 -> 486964 539184 94

21/06/2007 12:02:34 -> 487140 539200 95

21/06/2007 12:03:34 -> 488808 540828 94

21/06/2007 12:04:34 -> 486908 538860 95

21/06/2007 12:05:34 -> 489060 541020 94

21/06/2007 12:06:34 -> 490724 542708 94

21/06/2007 12:07:34 -> 486876 538732 95

21/06/2007 12:08:34 -> 488444 540300 94

21/06/2007 12:09:34 -> 490176 542052 95

21/06/2007 12:10:34 -> 486740 538516 94

21/06/2007 12:11:34 -> 488992 540792 95

21/06/2007 12:12:34 -> 490592 542392 94

21/06/2007 12:13:34 -> 490712 542508 95

21/06/2007 12:14:34 -> 488200 539936 94

21/06/2007 12:15:34 -> 488264 540012 95

21/06/2007 12:16:34 -> 489860 541592 94

21/06/2007 12:17:34 -> 491456 543184 94

21/06/2007 12:18:34 -> 486532 538196 94

21/06/2007 12:19:34 -> 488128 539804 94

21/06/2007 12:20:34 -> 489884 541572 95

21/06/2007 12:21:34 -> 487116 538920 94

21/06/2007 12:22:34 -> 488872 540712 95

21/06/2007 12:23:34 -> 490500 542320 94

21/06/2007 12:24:34 -> 486640 538284 94

21/06/2007 12:25:34 -> 488248 539908 94

21/06/2007 12:26:34 -> 489948 541604 94

21/06/2007 12:27:34 -> 490124 541828 97

21/06/2007 12:28:34 -> 488516 540288 94

21/06/2007 12:29:34 -> 490268 542072 96

21/06/2007 12:30:34 -> 486860 538440 94

21/06/2007 12:31:34 -> 488544 540112 94

21/06/2007 12:32:34 -> 490216 541788 94

21/06/2007 12:33:34 -> 486864 538416 94

21/06/2007 12:34:35 -> 488508 540068 94

21/06/2007 12:35:34 -> 490184 541744 94

21/06/2007 12:36:34 -> 490248 541820 95

21/06/2007 12:37:34 -> 487036 538432 94

21/06/2007 12:38:34 -> 488704 540128 95

21/06/2007 12:39:34 -> 487188 538508 94

21/06/2007 12:40:34 -> 488844 540164 94

21/06/2007 12:41:34 -> 488752 540144 94

21/06/2007 12:42:34 -> 488860 540256 95

21/06/2007 12:43:34 -> 487188 538352 94

21/06/2007 12:44:34 -> 488844 540040 95

21/06/2007 12:45:34 -> 488924 540100 94

21/06/2007 12:46:34 -> 490600 541772 94

21/06/2007 12:47:34 -> 487304 538228 94

21/06/2007 12:48:34 -> 487448 538372 94

21/06/2007 12:49:34 -> 489136 540064 94

21/06/2007 12:50:34 -> 488064 538760 95

21/06/2007 12:51:34 -> 489104 539224 95

21/06/2007 12:52:34 -> 489844 539988 95

21/06/2007 12:53:34 -> 490144 539952 96

21/06/2007 12:54:34 -> 490452 539800 97

21/06/2007 12:55:34 -> 490836 539584 95

21/06/2007 12:56:34 -> 491432 539672 96

21/06/2007 12:57:34 -> 492124 540300 95

21/06/2007 12:58:34 -> 492184 540268 94

21/06/2007 12:59:34 -> 491408 539272 94

21/06/2007 13:00:34 -> 491624 539492 94

21/06/2007 13:01:34 -> 492020 539948 94

21/06/2007 13:02:34 -> 493804 541756 95

21/06/2007 13:03:34 -> 491548 539368 94

21/06/2007 13:04:34 -> 493216 541064 95

21/06/2007 13:05:39 -> 491632 539284 95

21/06/2007 13:06:34 -> 491732 539380 95

21/06/2007 13:07:34 -> 493504 541156 95

21/06/2007 13:08:34 -> 493476 541048 94

21/06/2007 13:09:34 -> 493560 541120 94

21/06/2007 13:10:34 -> 492024 539548 95

21/06/2007 13:11:34 -> 493912 541320 94

21/06/2007 13:12:34 -> 492676 539632 97

21/06/2007 13:13:34 -> 492960 539828 95

21/06/2007 13:14:34 -> 493300 539912 96

21/06/2007 13:15:34 -> 493300 539684 95

21/06/2007 13:16:34 -> 493580 539732 97

21/06/2007 13:17:34 -> 493588 539444 95

21/06/2007 13:18:34 -> 494236 539828 96

21/06/2007 13:19:34 -> 494428 539892 95

21/06/2007 13:20:34 -> 494552 539840 94

21/06/2007 13:21:34 -> 494908 539812 96

21/06/2007 13:22:34 -> 494756 539628 95

21/06/2007 13:23:34 -> 495028 539692 95

21/06/2007 13:24:34 -> 495660 539948 95

21/06/2007 13:25:34 -> 495568 539792 97

21/06/2007 13:26:34 -> 496060 540028 96

21/06/2007 13:27:34 -> 495892 539560 96

21/06/2007 13:28:34 -> 496516 539880 96

21/06/2007 13:29:34 -> 498468 541728 95

21/06/2007 13:30:34 -> 497076 539872 96

21/06/2007 13:31:34 -> 497132 539836 97

21/06/2007 13:32:34 -> 497432 539892 96

21/06/2007 13:33:34 -> 497500 539844 96

21/06/2007 13:34:34 -> 497536 539604 95

21/06/2007 13:35:34 -> 497972 539880 96

21/06/2007 13:36:34 -> 498516 539748 96

21/06/2007 13:37:34 -> 498584 539828 97

21/06/2007 13:38:34 -> 498540 539744 97

21/06/2007 13:39:34 -> 498960 540028 96

21/06/2007 13:40:34 -> 498900 539784 95

21/06/2007 13:41:34 -> 499016 539916 95

21/06/2007 13:42:34 -> 499124 539860 95

21/06/2007 13:43:34 -> 514516 554972 96

21/06/2007 13:44:34 -> 499628 539832 95

21/06/2007 13:45:34 -> 499592 539576 95

21/06/2007 13:46:34 -> 500052 540032 96

21/06/2007 13:47:34 -> 499660 539512 95

21/06/2007 13:48:34 -> 500408 540052 96

21/06/2007 13:49:34 -> 516700 556060 96

21/06/2007 13:50:34 -> 500152 539376 94

21/06/2007 13:51:34 -> 500496 539692 96

21/06/2007 13:52:34 -> 502168 541328 94

21/06/2007 13:53:34 -> 519908 559068 94

21/06/2007 13:54:34 -> 500368 539340 95

21/06/2007 13:55:34 -> 518156 557136 94

21/06/2007 13:56:34 -> 500384 539456 95

21/06/2007 13:57:34 -> 516644 555720 94

21/06/2007 13:58:34 -> 500408 539412 94

21/06/2007 13:59:34 -> 518232 557220 94

21/06/2007 14:00:34 -> 518388 557376 94

21/06/2007 14:01:34 -> 517192 556040 94

21/06/2007 14:02:34 -> 518832 557684 94

21/06/2007 14:03:34 -> 500644 539404 94

21/06/2007 14:04:34 -> 502248 541020 94

21/06/2007 14:05:34 -> 519940 558708 94

21/06/2007 14:06:34 -> 519940 558708 94

21/06/2007 14:07:34 -> 537564 576348 94

21/06/2007 14:08:34 -> 502460 541180 94

21/06/2007 14:09:34 -> 518652 557376 95

21/06/2007 14:10:34 -> 503128 541276 95

21/06/2007 14:11:34 -> 520980 559044 95

21/06/2007 14:12:34 -> 501680 539524 94

21/06/2007 14:13:34 -> 519472 557324 94

21/06/2007 14:14:34 -> 503200 541064 94

21/06/2007 14:15:34 -> 519420 557276 94

21/06/2007 14:16:34 -> 521076 558940 94

21/06/2007 14:17:34 -> 519312 557128 94

21/06/2007 14:18:34 -> 519396 557212 94

21/06/2007 14:19:34 -> 537016 574848 94

21/06/2007 14:20:34 -> 503336 541016 94

21/06/2007 14:21:36 -> 517908 555508 94

21/06/2007 14:22:34 -> 519612 557208 94

21/06/2007 14:23:34 -> 501784 539356 94

21/06/2007 14:24:34 -> 501916 539492 94

21/06/2007 14:25:34 -> 518004 555492 94

21/06/2007 14:26:34 -> 519676 557160 94

21/06/2007 14:27:34 -> 535824 573320 94

21/06/2007 14:28:34 -> 501912 539392 94

21/06/2007 14:29:34 -> 519632 557116 94

21/06/2007 14:30:34 -> 519844 557324 94

21/06/2007 14:31:34 -> 518168 555548 94

21/06/2007 14:32:34 -> 519828 557208 94

21/06/2007 14:33:39 -> 502352 539576 95

21/06/2007 14:34:34 -> 502220 539360 94

21/06/2007 14:35:34 -> 520060 557208 94

21/06/2007 14:36:34 -> 502364 539504 95

21/06/2007 14:37:34 -> 520092 557204 94

21/06/2007 14:38:34 -> 521836 558968 95

21/06/2007 14:39:34 -> 518480 555536 94

21/06/2007 14:40:34 -> 520144 557208 94

21/06/2007 14:41:34 -> 520784 557160 94

21/06/2007 14:42:34 -> 520812 557184 94

21/06/2007 14:43:34 -> 538656 575044 94

21/06/2007 14:44:34 -> 504768 541184 97

21/06/2007 14:45:34 -> 520868 557240 94

21/06/2007 14:46:34 -> 503060 539328 96

21/06/2007 14:47:34 -> 520724 556948 94

21/06/2007 14:48:34 -> 503072 539180 95

21/06/2007 14:49:34 -> 520896 557020 95

21/06/2007 14:50:34 -> 503048 539068 94

21/06/2007 14:51:34 -> 519864 556088 95

21/06/2007 14:52:34 -> 503428 539640 95

21/06/2007 14:53:34 -> 519884 555724 95

21/06/2007 14:54:34 -> 503908 539712 95

21/06/2007 14:55:37 -> 509056 540372 95

21/06/2007 14:56:34 -> 508604 539584 97

21/06/2007 14:57:34 -> 525660 556444 99

21/06/2007 14:58:34 -> 509276 539588 95

21/06/2007 14:59:34 -> 510084 540064 102

21/06/2007 15:00:34 -> 510644 539668 95

21/06/2007 15:01:34 -> 527104 555856 96

21/06/2007 15:02:34 -> 512632 541300 95

21/06/2007 15:03:34 -> 528080 556592 97

21/06/2007 15:04:34 -> 511540 539796 98

21/06/2007 15:05:34 -> 438912 459076 95

21/06/2007 15:06:34 -> 422548 442708 96

21/06/2007 15:07:34 -> 439168 459256 96

21/06/2007 15:08:34 -> 422828 442804 97

21/06/2007 15:09:34 -> 437748 457640 95

21/06/2007 15:10:34 -> 422228 442688 100

21/06/2007 15:11:34 -> 422376 442736 95

21/06/2007 15:12:34 -> 422496 442792 95

21/06/2007 15:13:34 -> 438728 458904 95

21/06/2007 15:14:34 -> 422092 442308 94

21/06/2007 15:15:34 -> 438236 458520 98

21/06/2007 15:16:34 -> 422556 442592 95

21/06/2007 15:17:34 -> 438648 458612 94

21/06/2007 15:18:34 -> 421824 441712 95

21/06/2007 15:19:34 -> 437584 457480 95

21/06/2007 15:20:34 -> 420936 440848 96

21/06/2007 15:21:34 -> 436672 456536 95

21/06/2007 15:22:34 -> 419656 439500 94

21/06/2007 15:23:34 -> 437916 457776 94

21/06/2007 15:24:34 -> 419620 439476 95

21/06/2007 15:25:34 -> 436068 455996 95

21/06/2007 15:26:34 -> 419068 438924 95

21/06/2007 15:27:34 -> 434996 454856 95

21/06/2007 15:28:34 -> 418692 438548 95

That's it, I hope the memory leak is gone ! Beware when using the OCI driver !! Prefer the thin one if you can.

kipodusha at 2007-7-21 22:09:05 > top of Java-index,Java HotSpot Virtual Machine,Specifications...