Problem with ims5.1 tcp_local channel, enqueue, but won't dequeue

Last week our email server ims5.1.1 quit delivering on the tcp_local channel. Local and the intranet channels are fine, but we can't send to say yahoo for instance.

Only two of the three servers are affected. Messages are enqueued, but never dequeue. Postmaster gets error messages that connection timed out. Does anyone know what is happening? What debug tools can help me see what is going on?

The imta.cfg file is included below:

! $Id: imta.cnf,v 1.2 2002/01/16 20:29:08 root Exp $

!

! VERSION=1.2

! Modified by IMS administration server on: Thu Dec 20 13:03:05 MST 2001

!

! IMTA configuration file

!

! part I : rewrite rules

!

! DNS canonicalization rules. Uncomment this line to enable DNS

! address canonicalization.

! Please refer to the IMS documentation for details

!<IMTA_TABLE:dns_canonical.rules

!

! Domain Rewrite Rules.

! Uncomment this line to use domain rewrite rules

! from the configuration file instead of the domain database.

! Please refer to the SIMS documentation for details.

!><IMTA_TABLE:domains.rules

!

! Rules to select local users

iplanet.cc.utah.edu $U%$D@logh.cc.utah.edu

tiq.cc.utah.edu $U%$D@logh.cc.utah.edu

tiq.ks.cc.utah.edu $U%$D@logh.cc.utah.edu

taq.cc.utah.edu $U%$D@logh.cc.utah.edu

taq.ks.cc.utah.edu $U%$D@logh.cc.utah.edu

toj.cc.utah.edu $U%$D@logh.cc.utah.edu

toj.ks.cc.utah.edu $U%$D@logh.cc.utah.edu

logh.cc.utah.edu $U%$D@logh.cc.utah.edu

logh.ks.cc.utah.edu $U%$D@logh.cc.utah.edu

utah.edu $U%$D@logh.cc.utah.edu

!

! ims-ms

.ims-ms-daemon $U%$H.ims-ms-daemon@ims-ms-daemon

!

! native

.native-daemon $U%$H.native-daemon@native-daemon

!

! pipe

.pipe-daemon $U%$H.pipe-daemon@pipe-daemon

!

! tcp_local

! Rules for top level internet domains

><IMTA_TABLE:internet.rules

. $U%$H@tcp-daemon

!

! tcp_intranet

! Do mapping lookup for internal IP addresses

[] $E$R${INTERNAL_IP,$L}$U%[$L]@tcp_intranet-daemon

.utah.edu $U%$H.utah.edu@tcp_intranet-daemon

* $U%$&0.utah.edu

!

! tcp_relay

! Do mapping lookup for relay IP addresses

[] $E$R${RELAY_IP,$L}$U%[$L]@tcp_relay-daemon

!

! reprocess

reprocess $U%reprocess.logh.cc.utah.edu@reprocess-daemon

reprocess.logh.cc.utah.edu $U%reprocess.logh.cc.utah.edu@reprocess-daemon

!

! process

process $U%process.logh.cc.utah.edu@process-daemon

process.logh.cc.utah.edu $U%process.logh.cc.utah.edu@process-daemon

!

! defragment

defragment $U%defragment.logh.cc.utah.edu@defragment-daemon

defragment.logh.cc.utah.edu $U%defragment.logh.cc.utah.edu@defragment-daemon

!

! conversion

conversion $U%conversion.logh.cc.utah.edu@conversion-daemon

conversion.logh.cc.utah.edu $U%conversion.logh.cc.utah.edu@conversion-daemon

!

! bitbucket

bitbucket $U%bitbucket.logh.cc.utah.edu@bitbucket-daemon

bitbucket.logh.cc.utah.edu $U%bitbucket.logh.cc.utah.edu@bitbucket-daemon

!

! deleted

deleted-daemon $U%$H@deleted-daemon

.deleted-daemon $U%$H@deleted-daemon

!

! inactive

inactive-daemon $U%$H@inactive-daemon

.inactive-daemon $U%$H@inactive-daemon

!

! hold

hold-daemon $U%$H@hold-daemon

.hold-daemon $U%$H@hold-daemon

!

! part II : channel blocks

!

defaults logging notices 1 2 4 7 copywarnpost copysendpost postheadonly noswitchchannel immnonurgent maxjobs 7 defaulthost utah.edu utah.edu

!

! delivery channel to local /var/mail store

l subdirs 20 viaaliasrequired maxjobs 7 pool LOCAL_POOL

logh.cc.utah.edu

!

! ims-ms

ims-ms defragment subdirs 20 backoff "pt5m" "pt10m" "pt30m" "pt1h" "pt2h" "pt4h" maxjobs 1 pool IMS_POOL fileinto $U+$S@$D filter ssrd:$A

ims-ms-daemon

!

! native

native defragment subdirs 20 maxjobs 1

native-daemon

!

! pipe

pipe single defragment subdirs 20

pipe-daemon

!

! tcp_local

! tcp_local smtp mx single_sys remotehost inner switchchannel identnonelimited subdirs 20 maxjobs 7 pool SMTP_POOL maytlsserver maysaslserver saslswitchchannel tcp_auth

tcp_local smtp mx single_sys remotehost inner switchchannel identnonelimited subdirs 20 maxjobs 7 pool SMTP_POOL maytlsserver maysaslserver saslswitchchannel tcp_auth interfaceaddress 128.110.52.51

tcp-daemon

!

! tcp_intranet

tcp_intranet smtp mx single_sys subdirs 20 noreverse maxjobs 7 pool SMTP_POOL maytlsserver allowswitchchannel saslswitchchannel tcp_auth

tcp_intranet-daemon

!

! tcp_relay

tcp_relay smtp mx single_sys subdirs 20 noreverse maxjobs 7 pool SMTP_POOL maytlsserver allowswitchchannel saslswitchchannel tcp_auth

tcp_relay-daemon

!

! tcp_submit

tcp_submit submit smtp mx single_sys mustsaslserver maytlsserver

tcp_submit-daemon

!

! tcp_auth

tcp_auth smtp mx single_sys mustsaslserver

tcp_auth-daemon

!

! tcp_tas

tcp_tas smtp mx single_sys allowswitchchannel mustsaslserver maytlsserver deliveryflags 2

tcp_tas-daemon

!

! reprocess

reprocess

reprocess-daemon

!

! process

process

process-daemon

!

! defragment

defragment

defragment-daemon

!

! conversion

conversion

conversion-daemon

!

! bitbucket

bitbucket

bitbucket-daemon

!

! deleted

deleted

deleted-daemon

!

! inactive

inactive

inactive-daemon

!

! hold

hold slave

hold-daemon

!

! autoreply

autoreply defragment subdirs 20

autoreply-daemon>

[6069 byte] By [708716] at [2007-11-25 7:10:57]
# 1

We found the problem, in part II: channel blocks there was this entry:

! tcp_local

! tcp_local smtp mx single_sys remotehost inner switchchannel identnonelimited subdirs 20 maxjobs 7 pool SMTP_POOL maytlsserver maysaslserver saslswitchchannel tcp_auth

tcp_local smtp mx single_sys remotehost inner switchchannel identnonelimited subdirs 20 maxjobs 7 pool SMTP_POOL maytlsserver maysaslserver saslswitchchannel tcp_auth interfaceaddress 128.110.52.51

tcp-daemon

Removing the interfaceaddress 128.110.52.51

freed up the system and email started. The 128.110.52 net is behind a firewall.

We did not see this at first as we have a front end machine that does all smtp from users. The only time this channel is used is when people use the messanger express, (not yet deployed) or when they forward off campus. Since we are migrating 50,000 accounts, we did the forwards last! We never saw we had built it broken until we had load.

708716 at 2007-6-29 17:43:37 > top of Java-index,E-Mail, Calendar, & Collaboration,Sun Java System Messaging Server...