DPS loses connection to directory intermittently

Directory proxy is intermittently loosing its connection to the master server. The issue continues even if there is no load on the proxy but seems to be more frequent when it is under a load.

May 12 2007 13:43:24 DPShost SunONEDPS[ 2359]: [CRITICAL][280803] Server ds.domain.com:55389 has gone down.

May 12 2007 13:43:25 DPShost SunONEDPS[ 2359]: [CRITICAL][280803] Server ds.domain.com:55389 has come up.

May 12 2007 14:25:03 DPShost SunONEDPS[ 2359]: [EXCEPTION][520501] Failed to connect to ds.domain.com

May 12 2007 14:25:03 DPShost SunONEDPS[ 2359]: [CRITICAL][280803] Server ds.domain.com:55389 has gone down.

May 12 2007 14:25:20 DPShost SunONEDPS[ 2359]: [EXCEPTION][520504] Connection re-established to ds.domain.com

May 12 2007 14:25:20 DPShost SunONEDPS[ 2359]: [CRITICAL][280803] Server ds.domain.com:55389 has come up.

May 12 2007 14:33:23 DPShost SunONEDPS[ 2359]: [CRITICAL][280803] Server ds.domain.com:55389 has gone down.

May 12 2007 14:33:24 DPShost SunONEDPS[ 2359]: [CRITICAL][280803] Server ds.domain.com:55389 has come up.

May 12 2007 15:35:03 DPShost SunONEDPS[ 2359]: [EXCEPTION][520501] Failed to connect to ds.domain.com

May 12 2007 15:35:03 DPShost SunONEDPS[ 2359]: [CRITICAL][280803] Server ds.domain.com:55389 has gone down.

May 12 2007 15:35:20 DPShost SunONEDPS[ 2359]: [EXCEPTION][520504] Connection re-established to ds.domain.com

May 12 2007 15:35:20 DPShost SunONEDPS[ 2359]: [CRITICAL][280803] Server ds.domain.com:55389 has come up.

Environment Details

Currently we have 2 Directory Server instances running on 1 server. One instance is our enterprise directory and the other instance is for Access Manager. We have 4 proxy instances running on 2 servers, each server has 1 proxy instance for the enterprise directory and 1 proxy instance for Access Manger.

We do have a firewall separating the proxies from the directory servers. The session timeouts are set to 1 hour which don抰 seem to coincide with the errors. Additionally we are not using connection pooling.

Sun Java(TM) System Directory Server/5.2_Patch_4_CGD_6305434_6

362045_6371707_6368504_6487298_6491030_6502522_1 B2006.342.1014 (64-bit)

Sun ONE Directory Proxy Server, Build 20050705.172444, Version 5.2_Patch_4

Has anyone experienced this? Thanks!

[2374 byte] By [nick50119a] at [2007-11-27 4:43:45]
# 1
It looks to me that the DS server went down for some reason, instead DPS lost connection to DS. Can you check the log in DS to see what was the root cause for that. I doubt it's not DPS related.
sun_iplaneta at 2007-7-12 9:55:33 > top of Java-index,Web & Directory Servers,Directory Servers...
# 2

Thanks for the response. i should have included this in my initial request, but the DS is not going down. in fact, while the DPS is showing the DS is down I can submit searches to the DS no problem. Additionally, while snooping the interface on the DS I can see traffic arriving ffrom the DPS server.

I have a ticket open with support as well, they indicate that the issue appears to occur around the time one heartbeat loop ends and another begins. They have recommended DPS patch 4.1 and hotfix 6429138.

nick50119a at 2007-7-12 9:55:33 > top of Java-index,Web & Directory Servers,Directory Servers...
# 3
DPS patch 4.1 and hotfix 6429138 did NOT resolve this issue
nick50119a at 2007-7-12 9:55:33 > top of Java-index,Web & Directory Servers,Directory Servers...