Sun Java System Directory Server - Performance Issue nearly 100% cpu utilization

Hello,

I have ds 5.2 with patch 4 installed. After starting the directory server the cpu usage growth

to about 95% cpu usage and keeps at that rate. Could anyone give me a hint to find the responsible operations or queries for that high usage?

I tried to execute the queries from the access log on another system without any performance impact therefore I haven't any idea how to find the root cause.

Thank's very much for any suggestions.

Joerg

[484 byte] By [Joerg_Ta] at [2007-11-26 23:12:19]
# 1

Which platform is this ?

On Solaris you can do pstack and post the extract with the active threads on this forum. It'll take a couple of seconds to understand which part of the server is running.

Otherwise, you may want to change the Access Log level to have also Internal operations logged.

You can check the error log for a line: search is not indexed (but no reference to a connection or a real search). If you have such thing, it could be a server internal search operation that is not going through an index.

Other details of interest are:

How many entries in the Directory Server ? Is replication configured ?

How many ACIs in the server ?

Are Roles and CoS used ? Heavily ?

Regards,

Ludovic

ludovicpa at 2007-7-10 14:09:58 > top of Java-index,Web & Directory Servers,Directory Servers...
# 2

Hello Ludovic,

the directory server is running on solaris 9.

The server has about 25000 entries and replication is enabled to one other master server.

I haven't anything changed with ACIs that should be the default number.

CoS is used and I would say heavily. For each request a CoS template is evaluated.

After starting the ldap server I see the message

WARNING<20805> - Backend Database - conn=-1 op=0 msgId=-1 - search is not indexed

for three times.

here the pstack output:

# pstack 7092

7092:./ns-slapd -D /c/ldap/current/slapd-user -i /c/ldap/current/slapd-user


lwp# 1 / thread# 1


ffffffff7f0a740c poll(ffffffff7ffff090, 5, 3e8)

ffffffff7d134bd0 _pr_poll_with_poll (0, 0, ffffffff7ffff090, 0, ffffffff67e00070, 0) + 4f0

ffffffff7ea2ff08 slapd_daemon (10032f920, 0, ffffffff7eb53968, ffffffff7eb4c810, 0, 8) + 228

0000000100019514 main (100000000, 0, 185, 1001be398, 1c1000, 1001c0a88) + c90

0000000100010d3c _start (0, 0, 0, 0, 0, 0) + 17c


lwp# 2 / thread# 2


ffffffff7f0a740c poll(ffffffff7331fc40, 0, 64)

ffffffff7c1108e8 select (0, 0, 0, 0, ffffffff7331fdb0, 30d4) + 6c

ffffffff7ec95518 DS_Sleep (2710, 0, 1486fc, ffffffff7331fe88, 100480070, 0) + 48

ffffffff76737fb0 ? (1003e4d88, ffffffff7686eff0, 11169c, 800, 958, 1002753e0)

ffffffff7d136a7c _pt_root (100260250, 0, 0, 0, 20000, ffffffff7331ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 3 / thread# 3


ffffffff7f0a740c poll(ffffffff7321fc30, 0, 3e8)

ffffffff7c1108e8 select (0, 0, 0, 0, ffffffff7321fda0, 0) + 6c

ffffffff7ec95518 DS_Sleep (186a0, 1400, 1590, ffffffff7edfa128, 1, 0) + 48

ffffffff76738c9c ? (1003e4d88, 1002602f0, ffffffff7687f910, 4000, ffff86e9, 1003e9584)

ffffffff7d136a7c _pt_root (1002602f0, 0, 0, 0, 20000, ffffffff7321ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 4 / thread# 4


ffffffff7c117dac lwp_park (0, ffffffff72b1fb60, 0)

ffffffff7c1154cc cond_wait_common (0, 100244750, ffffffff72b1fb60, 0, 0, 1) + 1dc

ffffffff7c115978 _cond_timedwait (100419778, 100244750, ffffffff72b1fda0, 0, 0, 0) + 220

ffffffff7c1159b4 cond_timedwait (100419778, 100244750, ffffffff72b1fda0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100419778, 100244750, ffffffff72b1fda0, 460a6c5b, 460a6c5b, 9c63e38) + c

ffffffff7d12e460 PR_WaitCondVar (100419770, 28093, 9c63e38, 0, 100419778, 3b9aca00) + 118

ffffffff767384cc ? (1003e94c0, 100260390, 37884, 0, ffffffff7686eff0, 2c00)

ffffffff7d136a7c _pt_root (100260390, 0, 0, 0, 20000, ffffffff72b1ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 5 / thread# 5


ffffffff7f0a740c poll(ffffffff72a1fc30, 0, 3e8)

ffffffff7c1108e8 select (0, 0, 0, 0, ffffffff72a1fda0, 0) + 6c

ffffffff7ec95518 DS_Sleep (186a0, 2000, ffffffff72a1fe88, ffffffff74300000, 0, 100210370) + 48

ffffffff76738e50 ? (1003e4d88, 800, bf8, 800, 958, 13630c)

ffffffff7d136a7c _pt_root (100260430, 0, 0, 0, 20000, ffffffff72a1ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 6 / thread# 6


ffffffff7f0a740c poll(ffffffff69b1f9b0, 0, 7d0)

ffffffff7c1108e8 select (0, 0, 0, 0, ffffffff69b1fb20, 0) + 6c

ffffffff7ec95518 DS_Sleep (30d40, 0, 2400, 5400, 54b0, 0) + 48

ffffffff7673cb1c ? (1003e4d88, 1003e94c0, 1d4c, 0, 400, 0)

ffffffff7d136a7c _pt_root (1002604d0, 0, 0, 0, 20000, ffffffff69b1ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 7 / thread# 7


ffffffff7f0a740c poll(ffffffff69a1fc60, 0, 3e8)

ffffffff7c1108e8 select (0, 0, 0, 0, ffffffff69a1fdd0, 0) + 6c

ffffffff7ec95518 DS_Sleep (186a0, 1002c6390, 10049fd68, 4, 0, 0) + 48

ffffffff76737dfc ? (1003e4d88, 100260570, 11169c, 800, 958, 100275250)

ffffffff7d136a7c _pt_root (100260570, 0, 0, 0, 20000, ffffffff69a1ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 8 / thread# 8


ffffffff7c117dac lwp_park (0, 0, 0)

ffffffff7c1156f8 cond_wait (100253e58, 100246f40, 111914, 1112f4, ffffffff7d1373ac, c60) + 10

ffffffff7c115734 pthread_cond_wait (100253e58, 100246f40, ffffffffffffffff, ffffffff7d12e100, 1, 1) + 8

ffffffff7d12e3b4 PR_WaitCondVar (100253e50, ffffffff, 0, ffffffff7d12e0d8, 1059cc2e0, 729c) + 6c

ffffffff7ec89ff4 slapi_wait_condvar (100253e50, 0, 1, 100900070, 0, 100900070) + 58

ffffffff76a04a64 ? (0, 10752c, 11169c, 800, 400, 4c0)

ffffffff7d136a7c _pt_root (100260610, 0, 0, 0, 20000, ffffffff6991ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 9 / thread# 9


ffffffff7c117dac lwp_park (0, ffffffff6980fb90, 0)

ffffffff7c1154cc cond_wait_common (0, 1002473c0, ffffffff6980fb90, 0, 0, 12c) + 1dc

ffffffff7c115978 _cond_timedwait (100255f38, 1002473c0, ffffffff6980fdd0, 0, 0, 0) + 220

ffffffff7c1159b4 cond_timedwait (100255f38, 1002473c0, ffffffff6980fdd0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255f38, 1002473c0, ffffffff6980fdd0, 460a6c8a, 460a6c8a, 220d1250) + c

ffffffff7d12e460 PR_WaitCondVar (100255f30, 8b792, 220d1250, 0, 100255f38, 3b9aca00) + 118

ffffffff7643f38c ? (0, 1002606b0, 11169c, 800, 958, 100277c30)

ffffffff7d136a7c _pt_root (1002606b0, 0, 0, 0, 10000, ffffffff6980ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 10 / thread# 10


ffffffff7f0a740c poll(ffffffff6970f300, 5, ea60)

ffffffff7d134bd0 _pr_poll_with_poll (0, 0, ffffffff6970f300, 0, 105e30070, 0) + 4f0

ffffffff7da01d58 prldap_poll (105e100e8, 105c70088, ea60, 105c700d0, 105e30070, 5) + 188

ffffffff7dd18e78 nsldapi_iostatus_poll (105dcf408, ffffffff6970f718, 1, 105e00070, ffffffffffffffff, ffffffff7da02db0) + 138

ffffffff7dd1f39c wait4msg (105dcf408, 1092afce0, 1, fffffffffffffffe, 1, ffffffff6970f980) + 83c

ffffffff7dd1e5f0 nsldapi_result_nolock (105dcf408, 1, 1, 1, ffffffff6970f958, ffffffff6970f980) + 84

ffffffff7dd1e4b4 ldap_result (105dcf408, 1, 1, ffffffff6970f958, ffffffff6970f980, 0) + c4

ffffffff764529f4 ? (109380070, 105e500a8, 105d000b0, 4838, 2400, 2750)

ffffffff7645186c conn_connect (109380070, 4800, 0, 105d000c0, 259, ffffffff7658baa0) + 3a4

ffffffff764288e0 repl_trs_ldap_bind (1092a3ed8, 100811018, ffffffffffffffff, fffffffffffffff8, 0, 1092a4329) + d8

ffffffff76426868 repl_trs_bind (1003b6c28, 0, ffffffff6970fd8c, ffffffff764348f8, 1003b6b88, 1) + 178

ffffffff7643503c repl5_trs_inc_run (0, 1003b6b88, ffffffff7657a1d0, 100810da8, 2, 9) + 574

ffffffff76456200 ? (100442b78, ffffffff7659a3f8, ffffffff7659a410, 37884, 2000, 4400)

ffffffff7d136a7c _pt_root (100260750, 0, 0, 0, 10000, ffffffff6970ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 11 / thread# 11


ffffffff7c117dac lwp_park (0, 0, 0)

ffffffff7c1156f8 cond_wait (100253f78, 100247ba0, 111914, 1112f4, ffffffff7d1373ac, c60) + 10

ffffffff7c115734 pthread_cond_wait (100253f78, 100247ba0, ffffffffffffffff, ffffffff7d12e100, 1, 1) + 8

ffffffff7d12e3b4 PR_WaitCondVar (100253f70, ffffffff, 0, ffffffff7d12e0d8, ffffffff6961fe78, ffffffff7580b4d8) + 6c

ffffffff7ec89ff4 slapi_wait_condvar (100253f70, 0, ffffffff7580b4e8, 1, 10000, ffffffff7ede9d08) + 58

ffffffff7570473c ? (100525ef0, 1002607f0, 11169c, 800, 958, 100277e60)

ffffffff7d136a7c _pt_root (1002607f0, 0, 0, 0, 20000, ffffffff6961ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 12 / thread# 12


ffffffff7c117dac lwp_park (0, ffffffff6951fb90, 0)

ffffffff7c1154cc cond_wait_common (0, 1002438b0, ffffffff6951fb90, 0, 0, 7) + 1dc

ffffffff7c115978 _cond_timedwait (100254658, 1002438b0, ffffffff6951fdd0, ffffffff7d12e100, 1002100f0, ffffffff7ec8a49c) + 220

ffffffff7c1159b4 cond_timedwait (100254658, 1002438b0, ffffffff6951fdd0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100254658, 1002438b0, ffffffff6951fdd0, 460a6c5a, 460a6c5a, 24188a20) + c

ffffffff7d12e460 PR_WaitCondVar (100254650, 93d94, 24188a20, 0, 100254658, 3b9aca00) + 118

ffffffff7eca2ba4 ? (7, 0, ffffffff7edfb918, 100359490, aae60, 1)

ffffffff7d136a7c _pt_root (100260890, 0, 0, 0, 20000, ffffffff6951ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 15 / thread# 15


ffffffff7ec6ef48 substr_dn_normalize (1009e00f0, 1009e012e, 70, 4, 1009e00fe, 1009e00ff) + 2a8

ffffffff7ec6f968 slapi_dn_normalize (1009e00f0, 0, 0, 10cf, 64, 64) + 10

ffffffff76a078b8 ? (ffffffffffffffff, ffffffffffffffff, 0, 0, 0, 1008e0430)

ffffffff76a07574 ? (101c0a090, 10099a020, ffffffff6931e4c0, 0, 248, 100900070)

ffffffff7ecba99c slapi_vattr_list_attrs (10099a020, ffffffff6931e630, c, ffffffff6931e63c, 0, e) + 1cc

ffffffff7ec8e750 ? (10099a020, 1092c95b0, 1092c97b8, 4, c, 1)

ffffffff7ec8f2ec send_ldap_search_entry_ext (1092c44e8, 10099a020, 3, 1092c95b0, 0, ffffffff7ee0b878) + 41c

ffffffff7ec8e5a0 send_ldap_search_entry (1092c44e8, 10099a020, 0, 1092c95b0, 0, 0) + 24

ffffffff7ecaf3d8 ? (1092c44e8, 1003b1998, 1, ffffffff6931eaf4, 0, 0)

ffffffff7ecaf83c ? (1092c44e8, 1, ffffffff6931eaf4, 0, 1003d5cc0, ffffffff6931e980)

ffffffff7ecaede8 op_shared_search (1092c44e8, 0, 1006b5790, 0, ffffffffffffffff, ffffffff7ede9d08) + 8c0

ffffffff7ea2efcc search_core_pb (1092c44e8, 1092c95b0, 0, 0, ffffffff7eb4c810, ffffffff7eb56088) + 6c4

ffffffff7ea3a710 dispatch_operation_core_pb (1092c44e8, 1092c44e8, c00, ffffffff7eb4c810, 0, d10) + cc

ffffffff7ea26420 ? (ffffffff68001b08, 1092c97b8, b2, 63, 2, 200000)

ffffffff7ea2672c ldap_frontend_main_using_core_api (ffffffff68001b08, 1092c97b8, 2, 1003d66b0, 100349878, 0) + fc

ffffffff7ea27764 ? (220, 100260930, 11169c, 800, 958, ffffffff680021f8)

ffffffff7d136a7c _pt_root (100260930, 0, 0, 0, 20000, ffffffff6931ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 16 / thread# 16


ffffffff7c117dac lwp_park (0, ffffffff67d1fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff67d1fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff67d1fca0, 1001c5390, 122c8c, ffffffff77057944) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff67d1fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff67d1fca0, 460a6c61, 460a6c61, 3549f7c0) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, da458, 3549f7c0, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff67d1fe88, ffffffff67d1fe80, ffffffff67d1fe7c, ffffffff67d1fe70, 0, 250)

ffffffff7ea2770c ? (220, 1002609d0, 11169c, 800, 958, ffffffff680019e0)

ffffffff7d136a7c _pt_root (1002609d0, 0, 0, 0, 20000, ffffffff67d1ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 17 / thread# 17


ffffffff7c117dac lwp_park (0, ffffffff67c1fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff67c1fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff67c1fca0, 1, ffffffff77193250, 1006b67d0) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff67c1fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff67c1fca0, 460a6c5f, 460a6c5f, fbe2e90) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, 407ba, fbe2e90, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff67c1fe88, ffffffff67c1fe80, ffffffff67c1fe7c, ffffffff67c1fe70, 0, 250)

ffffffff7ea2770c ? (220, 100260a70, 11169c, 800, 958, ffffffff680019e0)

ffffffff7d136a7c _pt_root (100260a70, 0, 0, 0, 20000, ffffffff67c1ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 18 / thread# 18


ffffffff7c117dac lwp_park (0, ffffffff67b1fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff67b1fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff67b1fca0, 1, ffffffff77193250, 1006b67d0) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff67b1fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff67b1fca0, 460a6c5c, 460a6c5c, 24045a28) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, 93869, 24045a28, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff67b1fe88, ffffffff67b1fe80, ffffffff67b1fe7c, ffffffff67b1fe70, 0, 250)

ffffffff7ea2770c ? (220, 100260b10, 11169c, 800, 958, ffffffff680019e0)

ffffffff7d136a7c _pt_root (100260b10, 0, 0, 0, 20000, ffffffff67b1ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 19 / thread# 19


ffffffff7c117dac lwp_park (0, ffffffff6791fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff6791fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff6791fca0, 1001c5390, 122c8c, ffffffff77057944) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff6791fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff6791fca0, 460a6c61, 460a6c61, 28c5c268) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, a7011, 28c5c268, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff6791fe88, ffffffff6791fe80, ffffffff6791fe7c, ffffffff6791fe70, 0, 250)

ffffffff7ea2770c ? (220, 100260bb0, 11169c, 800, 958, ffffffff68001668)

ffffffff7d136a7c _pt_root (100260bb0, 0, 0, 0, 20000, ffffffff6791ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 20 / thread# 20


ffffffff7c117dac lwp_park (0, ffffffff6781fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff6781fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff6781fca0, 1001c5390, 122c8c, ffffffff77057944) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff6781fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff6781fca0, 460a6c61, 460a6c61, 1f3c8560) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, 7ff1c, 1f3c8560, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff6781fe88, ffffffff6781fe80, ffffffff6781fe7c, ffffffff6781fe70, 0, 250)

ffffffff7ea2770c ? (220, 100260c50, 11169c, 800, 958, ffffffff680019e0)

ffffffff7d136a7c _pt_root (100260c50, 0, 0, 0, 20000, ffffffff6781ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 21 / thread# 21


ffffffff7c117dac lwp_park (0, ffffffff6771fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff6771fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff6771fca0, 1001c5390, 122c8c, ffffffff77057944) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff6771fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff6771fca0, 460a6c5f, 460a6c5f, 1351adc0) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, 4f218, 1351adc0, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff6771fe88, ffffffff6771fe80, ffffffff6771fe7c, ffffffff6771fe70, 0, 250)

ffffffff7ea2770c ? (220, 100260cf0, 11169c, 800, 958, ffffffff680019e0)

ffffffff7d136a7c _pt_root (100260cf0, 0, 0, 0, 20000, ffffffff6771ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 22 / thread# 22


ffffffff7c117dac lwp_park (0, ffffffff6761fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff6761fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff6761fca0, 1, ffffffff77193250, 1006b67d0) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff6761fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff6761fca0, 460a6c61, 460a6c61, 2cf1c0a8) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, b8179, 2cf1c0a8, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff6761fe88, ffffffff6761fe80, ffffffff6761fe7c, ffffffff6761fe70, 0, 250)

ffffffff7ea2770c ? (220, 100260d90, 11169c, 800, 958, ffffffff680019e0)

ffffffff7d136a7c _pt_root (100260d90, 0, 0, 0, 20000, ffffffff6761ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 23 / thread# 23


ffffffff7c117dac lwp_park (0, ffffffff6751fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff6751fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff6751fca0, 1001c5390, 122c8c, ffffffff77057944) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff6751fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff6751fca0, 460a6c61, 460a6c61, 2663c628) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, 9d3e9, 2663c628, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff6751fe88, ffffffff6751fe80, ffffffff6751fe7c, ffffffff6751fe70, 0, 250)

ffffffff7ea2770c ? (220, 100260e30, 11169c, 800, 958, ffffffff680019e0)

ffffffff7d136a7c _pt_root (100260e30, 0, 0, 0, 20000, ffffffff6751ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 24 / thread# 24


ffffffff7c117dac lwp_park (0, ffffffff6741fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff6741fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff6741fca0, 1, ffffffff77193250, 1006b67d0) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff6741fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff6741fca0, 460a6c61, 460a6c61, 2b283f90) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, b0c5a, 2b283f90, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff6741fe88, ffffffff6741fe80, ffffffff6741fe7c, ffffffff6741fe70, 0, 250)

ffffffff7ea2770c ? (220, 100260ed0, 11169c, 800, 958, ffffffff68001668)

ffffffff7d136a7c _pt_root (100260ed0, 0, 0, 0, 20000, ffffffff6741ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 25 / thread# 25


ffffffff7c117dac lwp_park (0, ffffffff6731fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff6731fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff6731fca0, 1, ffffffff77193250, 1006b67d0) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff6731fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff6731fca0, 460a6c5f, 460a6c5f, 12b926e0) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, 4cb0c, 12b926e0, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff6731fe88, ffffffff6731fe80, ffffffff6731fe7c, ffffffff6731fe70, 0, 250)

ffffffff7ea2770c ? (220, 100260f70, 11169c, 800, 958, ffffffff680019e0)

ffffffff7d136a7c _pt_root (100260f70, 0, 0, 0, 20000, ffffffff6731ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 26 / thread# 26


ffffffff7c117dac lwp_park (0, ffffffff6721fa60, 12)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff6721fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff6721fca0, 1, ffffffff77193250, 1006b67d0) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff6721fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff6721fca0, 460a6c5c, 460a6c5c, 24036fc8) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, 9382d, 24036fc8, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff6721fe88, ffffffff6721fe80, ffffffff6721fe7c, ffffffff6721fe70, 0, 250)

ffffffff7ea2770c ? (220, 100261010, 11169c, 800, 958, ffffffff680019e0)

ffffffff7d136a7c _pt_root (100261010, 0, 0, 0, 20000, ffffffff6721ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 27 / thread# 27


ffffffff7c117dac lwp_park (0, ffffffff6711fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff6711fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff6711fca0, 1001c5390, 122c8c, ffffffff77057944) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff6711fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff6711fca0, 460a6c61, 460a6c61, 2373a348) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, 9135d, 2373a348, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff6711fe88, ffffffff6711fe80, ffffffff6711fe7c, ffffffff6711fe70, 0, 250)

ffffffff7ea2770c ? (220, 1002610b0, 11169c, 800, 958, ffffffff680019e0)

ffffffff7d136a7c _pt_root (1002610b0, 0, 0, 0, 20000, ffffffff6711ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 28 / thread# 28


ffffffff7c117dac lwp_park (0, ffffffff6701fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff6701fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff6701fca0, 1, ffffffff77193250, 1006b67d0) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff6701fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff6701fca0, 460a6c5f, 460a6c5f, 13eaccf8) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, 5194b, 13eaccf8, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff6701fe88, ffffffff6701fe80, ffffffff6701fe7c, ffffffff6701fe70, 0, 250)

ffffffff7ea2770c ? (220, 100261150, 11169c, 800, 958, ffffffff680019e0)

ffffffff7d136a7c _pt_root (100261150, 0, 0, 0, 20000, ffffffff6701ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 29 / thread# 29


ffffffff7c117dac lwp_park (0, ffffffff66f1fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff66f1fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff66f1fca0, 1, ffffffff77193250, 1006b67d0) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff66f1fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff66f1fca0, 460a6c5f, 460a6c5f, daffb88) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, 38105, daffb88, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff66f1fe88, ffffffff66f1fe80, ffffffff66f1fe7c, ffffffff66f1fe70, 0, 250)

ffffffff7ea2770c ? (220, 1002611f0, 11169c, 800, 958, ffffffff680019e0)

ffffffff7d136a7c _pt_root (1002611f0, 0, 0, 0, 20000, ffffffff66f1ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 30 / thread# 30


ffffffff7c117dac lwp_park (0, ffffffff66e1fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff66e1fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff66e1fca0, 1, ffffffff77193250, 1006b67d0) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff66e1fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff66e1fca0, 460a6c61, 460a6c61, 279550e8) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, a2221, 279550e8, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff66e1fe88, ffffffff66e1fe80, ffffffff66e1fe7c, ffffffff66e1fe70, 0, 250)

ffffffff7ea2770c ? (220, 100261290, 11169c, 800, 958, ffffffff680019e0)

ffffffff7d136a7c _pt_root (100261290, 0, 0, 0, 20000, ffffffff66e1ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 31 / thread# 31


ffffffff7ec6ed5c substr_dn_normalize (1009e00f0, 1009e012e, 70, 4, 1009e0102, 1009e0103) + bc

ffffffff7ec6f968 slapi_dn_normalize (1009e00f0, 0, 0, 5e6, 64, 64) + 10

ffffffff76a078b8 ? (ffffffffffffffff, ffffffffffffffff, 0, 0, 0, 1008e0430)

ffffffff76a07574 ? (101c0a090, 1038d6e40, ffffffff66d1e4c0, 0, 248, 100900070)

ffffffff7ecba99c slapi_vattr_list_attrs (1038d6e40, ffffffff66d1e630, 4, ffffffff66d1e63c, 0, e) + 1cc

ffffffff7ec8e750 ? (1038d6e40, 0, 1092eb7c0, 1092eb568, 1092ead88, 0)

ffffffff7ec8f2ec send_ldap_search_entry_ext (1092eb568, 1038d6e40, 3, 0, 0, ffffffff7ee0b878) + 41c

ffffffff7ec8e5a0 send_ldap_search_entry (1092eb568, 1038d6e40, 0, 0, 0, 0) + 24

ffffffff7ecaf3d8 ? (1092eb568, 1003b1998, 1, ffffffff66d1eaf4, 0, 0)

ffffffff7ecaf83c ? (1092eb568, 1, ffffffff66d1eaf4, 0, 1090f0118, ffffffff66d1e980)

ffffffff7ecaede8 op_shared_search (1092eb568, 0, 1006b5790, 0, ffffffffffffffff, ffffffff7ede9d08) + 8c0

ffffffff7ea2efcc search_core_pb (1092eb568, 2, 0, 0, ffffffff7eb4c810, ffffffff7eb56088) + 6c4

ffffffff7ea3a710 dispatch_operation_core_pb (1092eb568, 1092eb568, c00, ffffffff7eb4c810, 0, d10) + cc

ffffffff7ea26420 ? (ffffffff68001e80, 1092eb7c0, 2, 63, 2, 200000)

ffffffff7ea2672c ldap_frontend_main_using_core_api (ffffffff68001e80, 1092eb7c0, 2, 1003d6bb8, 100349878, 0) + fc

ffffffff7ea27764 ? (220, 100261330, 11169c, 800, 958, ffffffff68001e80)

ffffffff7d136a7c _pt_root (100261330, 0, 0, 0, 20000, ffffffff66d1ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 32 / thread# 32


ffffffff7c117dac lwp_park (0, ffffffff66c1fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff66c1fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff66c1fca0, 1, ffffffff77193250, 1006b67d0) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff66c1fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff66c1fca0, 460a6c5c, 460a6c5c, 22e1ea98) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, 8ee0f, 22e1ea98, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff66c1fe88, ffffffff66c1fe80, ffffffff66c1fe7c, ffffffff66c1fe70, 0, 250)

ffffffff7ea2770c ? (220, 1002613d0, 11169c, 800, 958, ffffffff680019e0)

ffffffff7d136a7c _pt_root (1002613d0, 0, 0, 0, 20000, ffffffff66c1ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 33 / thread# 33


ffffffff7c117dac lwp_park (0, ffffffff66b1fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff66b1fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff66b1fca0, 1001c5390, 122c8c, ffffffff77057944) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff66b1fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff66b1fca0, 460a6c5c, 460a6c5c, 22e136e8) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, 8ede1, 22e136e8, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff66b1fe88, ffffffff66b1fe80, ffffffff66b1fe7c, ffffffff66b1fe70, 0, 250)

ffffffff7ea2770c ? (220, 100261470, 11169c, 800, 958, ffffffff680019e0)

ffffffff7d136a7c _pt_root (100261470, 0, 0, 0, 20000, ffffffff66b1ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 34 / thread# 34


ffffffff7c117dac lwp_park (0, ffffffff66a1fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff66a1fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff66a1fca0, 1001c5390, 122c8c, ffffffff77057944) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff66a1fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff66a1fca0, 460a6c60, 460a6c60, 2087e18) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, 853f, 2087e18, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff66a1fe88, ffffffff66a1fe80, ffffffff66a1fe7c, ffffffff66a1fe70, 0, 250)

ffffffff7ea2770c ? (220, 100261510, 11169c, 800, 958, ffffffff68001668)

ffffffff7d136a7c _pt_root (100261510, 0, 0, 0, 20000, ffffffff66a1ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 35 / thread# 35


ffffffff7c117dac lwp_park (0, ffffffff6691fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff6691fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff6691fca0, 1001c5390, 122c8c, ffffffff77057944) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff6691fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff6691fca0, 460a6c5f, 460a6c5f, 15b3fff0) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, 58e56, 15b3fff0, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff6691fe88, ffffffff6691fe80, ffffffff6691fe7c, ffffffff6691fe70, 0, 250)

ffffffff7ea2770c ? (220, 1002615b0, 11169c, 800, 958, ffffffff680019e0)

ffffffff7d136a7c _pt_root (1002615b0, 0, 0, 0, 20000, ffffffff6691ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 36 / thread# 36


ffffffff7c117dac lwp_park (0, ffffffff6681fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff6681fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff6681fca0, 1, ffffffff77193250, 1006b67d0) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff6681fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff6681fca0, 460a6c61, 460a6c61, 3085e3e8) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, c6c01, 3085e3e8, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff6681fe88, ffffffff6681fe80, ffffffff6681fe7c, ffffffff6681fe70, 0, 250)

ffffffff7ea2770c ? (220, 100261650, 11169c, 800, 958, ffffffff680019e0)

ffffffff7d136a7c _pt_root (100261650, 0, 0, 0, 20000, ffffffff6681ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 37 / thread# 37


ffffffff7c117dac lwp_park (0, ffffffff6671fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff6671fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff6671fca0, 1, ffffffff77193250, 1006b67d0) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff6671fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff6671fca0, 460a6c61, 460a6c61, 32503bd8) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, ce157, 32503bd8, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff6671fe88, ffffffff6671fe80, ffffffff6671fe7c, ffffffff6671fe70, 0, 250)

ffffffff7ea2770c ? (220, 1002616f0, 11169c, 800, 958, ffffffff680019e0)

ffffffff7d136a7c _pt_root (1002616f0, 0, 0, 0, 20000, ffffffff6671ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 38 / thread# 38


ffffffff7c117dac lwp_park (0, ffffffff6661fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff6661fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff6661fca0, 1001c5390, 122c8c, ffffffff77057944) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff6661fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff6661fca0, 460a6c64, 460a6c64, 12809a50) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, 4bc92, 12809a50, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff6661fe88, ffffffff6661fe80, ffffffff6661fe7c, ffffffff6661fe70, 0, 250)

ffffffff7ea2770c ? (220, 100261790, 11169c, 800, 958, ffffffff680019e0)

ffffffff7d136a7c _pt_root (100261790, 0, 0, 0, 20000, ffffffff6661ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 39 / thread# 39


ffffffff7c117dac lwp_park (0, ffffffff6651fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff6651fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff6651fca0, 1001c5390, 122c8c, ffffffff77057944) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff6651fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff6651fca0, 460a6c61, 460a6c61, 266383c0) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, 9d3d8, 266383c0, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff6651fe88, ffffffff6651fe80, ffffffff6651fe7c, ffffffff6651fe70, 0, 250)

ffffffff7ea2770c ? (220, 100261830, 11169c, 800, 958, ffffffff680019e0)

ffffffff7d136a7c _pt_root (100261830, 0, 0, 0, 20000, ffffffff6651ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 40 / thread# 40


ffffffff7c117dac lwp_park (0, ffffffff6641fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff6641fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff6641fca0, 1001c5390, 122c8c, ffffffff77057944) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff6641fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff6641fca0, 460a6c61, 460a6c61, 2372cc70) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, 91326, 2372cc70, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff6641fe88, ffffffff6641fe80, ffffffff6641fe7c, ffffffff6641fe70, 0, 250)

ffffffff7ea2770c ? (220, 1002618d0, 11169c, 800, 958, ffffffff680019e0)

ffffffff7d136a7c _pt_root (1002618d0, 0, 0, 0, 20000, ffffffff6641ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 41 / thread# 41


ffffffff7c117dac lwp_park (0, ffffffff6631fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff6631fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff6631fca0, 1, ffffffff77193250, 1006b67d0) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff6631fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff6631fca0, 460a6c61, 460a6c61, 2c59e1c0) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, b5a98, 2c59e1c0, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff6631fe88, ffffffff6631fe80, ffffffff6631fe7c, ffffffff6631fe70, 0, 250)

ffffffff7ea2770c ? (220, 100261970, 11169c, 800, 958, ffffffff68001668)

ffffffff7d136a7c _pt_root (100261970, 0, 0, 0, 20000, ffffffff6631ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 42 / thread# 42


ffffffff7c117dac lwp_park (0, ffffffff6621fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff6621fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff6621fca0, 1, ffffffff77193250, 1006b67d0) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff6621fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff6621fca0, 460a6c61, 460a6c61, 308566e8) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, c6be1, 308566e8, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff6621fe88, ffffffff6621fe80, ffffffff6621fe7c, ffffffff6621fe70, 0, 250)

ffffffff7ea2770c ? (220, 100261a10, 11169c, 800, 958, ffffffff680019e0)

ffffffff7d136a7c _pt_root (100261a10, 0, 0, 0, 20000, ffffffff6621ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 43 / thread# 43


ffffffff7c117dac lwp_park (0, ffffffff6611fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff6611fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff6611fca0, 1, ffffffff77193250, 1006b67d0) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff6611fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff6611fca0, 460a6c5f, 460a6c5f, 177df250) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, 60392, 177df250, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff6611fe88, ffffffff6611fe80, ffffffff6611fe7c, ffffffff6611fe70, 0, 250)

ffffffff7ea2770c ? (220, 100261ab0, 11169c, 800, 958, ffffffff68001668)

ffffffff7d136a7c _pt_root (100261ab0, 0, 0, 0, 20000, ffffffff6611ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 44 / thread# 44


ffffffff7c117dac lwp_park (0, ffffffff6601fa60, 0)

ffffffff7c1154cc cond_wait_common (0, 100247f00, ffffffff6601fa60, 0, 0, a) + 1dc

ffffffff7c115978 _cond_timedwait (100255c98, 100247f00, ffffffff6601fca0, 1001c5390, 122c8c, ffffffff77057944) + 220

ffffffff7c1159b4 cond_timedwait (100255c98, 100247f00, ffffffff6601fca0, c350, 0, 11b35c) + 14

ffffffff7c1159f4 pthread_cond_timedwait (100255c98, 100247f00, ffffffff6601fca0, 460a6c61, 460a6c61, 34b18468) + c

ffffffff7d12e460 PR_WaitCondVar (100255c90, d7d51, 34b18468, 0, 100255c98, 3b9aca00) + 118

ffffffff7ea26ab4 ? (ffffffff6601fe88, ffffffff6601fe80, ffffffff6601fe7c, ffffffff6601fe70, 0, 250)

ffffffff7ea2770c ? (220, 100261b50, 11169c, 800, 958, ffffffff680019e0)

ffffffff7d136a7c _pt_root (100261b50, 0, 0, 0, 20000, ffffffff6601ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)


lwp# 45 / thread# 45


ffffffff7f0a740c poll(ffffffff65f1fc60, 0, fa)

ffffffff7c1108e8 select (0, 0, 0, 0, ffffffff65f1fdd0, 7a12) + 6c

ffffffff7ec95518 DS_Sleep (61a8, 0, 11169c, ffffffff7d12e100, 0, 0) + 48

ffffffff7ea2fc9c time_thread (0, 100261bf0, 11169c, 800, 958, 100278810) + 34

ffffffff7d136a7c _pt_root (100261bf0, 0, 0, 0, 20000, ffffffff65f1ff48) + d4

ffffffff7c117c9c _lwp_start (0, 0, 0, 0, 0, 0)

Thank's

Joerg

Joerg_Ta at 2007-7-10 14:09:58 > top of Java-index,Web & Directory Servers,Directory Servers...
# 3

Joerg,

There is nothing special in the pstack.

There are 2 searches on-going (threads #15 and 31) and no other specific internal tasks.

Both of these searches are returning entries to the client application and in the process of evaluating CoS generated attributes.

So you were saying that when you start Directory Server, it goes to 95% CPU utilization, and keep at this rate. How much traffic is hitting the Directory Server on average ? Does this CPU utilization goes down if there is no access to the Directory Server ?

I am trying to understand if this is just an effect of Directory Server starting up (and either building caches, or starting some internal housekeeping threads) or an effect of the client operations.

I would definitely try to enable the Internal Operation Access Logging (see the Access Log in the Reference Guide).

I would also check if Referential Integrity plug-in is enabled and all attributes checked for integrity are indexed.

Regards,

Ludovic.

ludovicpa at 2007-7-10 14:09:58 > top of Java-index,Web & Directory Servers,Directory Servers...
# 4

Hi

I found the problem. For each search request a CoS Template was added to the requested

entry. The cosspecifier is the attribute uid and some CoS templates have had the same

value in the uid attribute field. That seems to confuse the ns-slapd and it didn't stop computing the request. After resolving that issue the cpu load goes done to a normal behaviour.

Thank's Ludovic for your time and help.

Joerg

Joerg_Ta at 2007-7-10 14:09:58 > top of Java-index,Web & Directory Servers,Directory Servers...
# 5
Joerg: Just wondering what exactly did you do to overcome this problem?Thx, Jane
murcusja at 2007-7-10 14:09:58 > top of Java-index,Web & Directory Servers,Directory Servers...
# 6

Hello Jane,

I just eliminated duplicate uid's, that's all I did to reolve the issue. The problem was that the uid field is the cosspecifier. And if you have more than one cos template (and all of them have the same attributes) that is referenced through a cosspecifier the system seams to get in trouble.

Joerg_Ta at 2007-7-10 14:09:58 > top of Java-index,Web & Directory Servers,Directory Servers...