Problems starting syslog

Hello,

I noticed that the system has not been writing to /var/adm/messages for some time. Checked for the syslogd daemon and this wasn't running. So I tried restarting syslogd in debug mode:

impws02{root}# syslogd -d

main(1): Started at time Thu May 17 11:45:46 2007

hnc_init(1): hostname cache configured 128 entry ttl:600

getnets(1): found 1 addresses, they are: 0.0.0.0.2.2

amiloghost(1): testing 10.160.110.36.2.2

conf_init(1): I am loghost

cfline(1): (*.info;mail.err;mark.none/omniguard/ita/system/impws02/syslog)

cfline(1): (mail.debug /omniguard/ita/system/impws02/syslog.mdbg)

logerror(1): syslogd: /omniguard/ita/system/impws02/syslog.mdbg: No such file or directory

logerror_to_console(1): syslogd: /omniguard/ita/system/impws02/syslog.mdbg: No s uch file or directory

cfline(1): (*.err;kern.notice;auth.notice/dev/sysmsg)

cfline(1): (*.err;kern.debug;daemon.notice;mail.crit/var/adm/messages)

cfline(1): (*.alert;kern.err;daemon.erroperator)

cfline(1): (*.alert root)

cfline(1): (*.emerg *)

cfline(1): (mail.debug/var/log/syslog)

cfline(1): (local2.debug @tetris)

logerror(1): syslogd: line 35: unknown priority name "debug @tetris"

logerror_to_console(1): syslogd: line 35: unknown priority name "debug @tetris"

cfline(1): (daemon.notice/var/adm/tcp.net)

cfline(1): (auth.notice /var/adm/logins)

cfline(1): (*.debug@pacman)

syslogd: version 1.92

Started: Thu May 17 11:45:46 2007

Input message count: system 0, network 0

# Outputs: 10

priority = [file, facility]

0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 1 1 2 2 2 2 2

0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4

--

6 6 3 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 X FILE: /omniguard/ita/system/im pws02/syslog

5 3 3 3 5 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 X CONSOLE: /dev/sysmsg

7 3 2 5 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 X FILE: /var/adm/messages

3 1 1 3 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 X USERS: operator

1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 X USERS: root

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 X WALL:

X X 7 X X X X X X X X X X X X X X X X X X X X X X FILE: /var/log/syslog

X X X 5 X X X X X X X X X X X X X X X X X X X X X FILE: /var/adm/tcp.net

X X X X 5 X X X X X X X X X X X X X X X X X X X X FILE: /var/adm/logins

7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 X FORW: pacman

Facilities:

[00] kern:0

[01] user:8

[02] mail: 16

[03] daemon: 24

[04] auth: 32

[05] security: 32

[06] mark: 192

[07] syslog: 40

[08] lpr: 48

[09] news: 56

[10] uucp: 64

[11] cron: 120

[12] local0: 128

[13] local1: 136

[14] local2: 144

[15] local3: 152

[16] local4: 160

[17] local5: 168

[18] local6: 176

[19] local7: 184

Priorities:

[00] panic:0

[01] emerg:0

[02] alert:1

[03] crit:2

[04] err:3

[05] error:3

[06] warn:4

[07] warning:4

[08] notice:5

[09] info:6

[10] debug:7

[11] none: 16

Per File Statistics

FileTotDupsNofwdErrs

- ----

/omniguard/ita/system/impws02/syslog0000

/dev/sysmsg 0000

/var/adm/messages0000

operator0000

root0000

WALL0000

/var/log/syslog0000

/var/adm/tcp.net0000

/var/adm/logins0000

pacman 0000

logmsg(14): msg dispatcher started

logerror(1): syslogd: cannot open /dev/log: No such device or address

logerror_to_console(1): syslogd: cannot open /dev/log: No such device or address

openklog(1): cannot create /dev/log (0)

logerror(1): syslogd: can't open kernel log device - fatal

logerror_to_console(1): syslogd: can't open kernel log device - fatal

impws02{root}#

I then checked for file /de/log and it does exist:

lrwxrwxrwx1 rootother 27 Nov 11 2004 /dev/log -> ../devices/pseudo/log@0:log

Any suggestions gratefully recieved.

Thanks

[4186 byte] By [syslogd_questiona] at [2007-11-27 4:39:59]
# 1

> I then checked for file /de/log and it does exist:

> lrwxrwxrwx1 rootother 27 Nov 11 2004

> /dev/log -> ../devices/pseudo/log@0:log

That shows that a link exists, but does not show what the result of the link is.

What does 'ls -lL /dev/log' report?

--

Darren

Darren_Dunhama at 2007-7-12 9:50:51 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...
# 2
Darren I issued the command you suggested and got the following result:bash-2.03$ ls -lL /dev/logcrw-r--1 rootsys21, 5 Nov 11 2004 /dev/logthis presumable suggests that the file exists?
syslogd_questiona at 2007-7-12 9:50:51 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...
# 3

Indeed. You could go a little further and verify that '21' is in /etc/name_to_major, it will probably point to the 'log' device. From there you could run 'modinfo' and make sure the 'log' module was loaded.

If all those things are true, I don't have any real suggestions as to why the application is getting an error about the file not existing.

--

Darren

Darren_Dunhama at 2007-7-12 9:50:51 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...
# 4

I checked /etc/name_to_major and '21' is in that file:

log 21

However the last time /etc/name_to_major was updated is same date as syslog stopped working

Looking at modinfo, it looks like the log module is not loaded.

As a short term measure could I just do:

modload -p drv/log

?

Thanks

syslogd_questiona at 2007-7-12 9:50:51 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...
# 5

It shouldn't hurt anything. But if the module isn't loading by default, I'm going to guess that something is wrong that won't be fixed by simply modloading it.

I'd give it a try and look for any messages. Look through /etc/name_to_major and make sure nothing in there looks "odd" or that anything has a conflict (maybe another line with '21' in it).

--

Darren

Darren_Dunhama at 2007-7-12 9:50:51 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...
# 6

I ran modload and got the following result even though the actual file exists:

# modload -p /kernel/drv/log

can't load module: No such file or directory

even though the file exists:

# ls -l /kernel/drv/log

-rwxr-xr-x1 rootsys 6476 Dec 12 11:22 /kernel/drv/log

I checked out /etc/named_to_major and noticed no errors, we have an identical server which has exactly the same /etc/named_to_major (syslog works fine on this server), so i don't think this is the issue are ther any other avenues to look at?

Thanks you

syslogd_questiona at 2007-7-12 9:50:51 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...
# 7
Is this a 64-bit machine? That filename is a 32-bit driver.For instance, you might try modload /kernel/drv/sparcv9/log-- Darren
Darren_Dunhama at 2007-7-12 9:50:51 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...
# 8
Thanks for the reply, we are using 64bit environment, so I tried: $ modload /kernel/drv/sparcv9/logcan't load module: No such file or directoryAnd got the same result there are no other versions that I can try.Thanks Dave
syslogd_questiona at 2007-7-12 9:50:51 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...
# 9
Do you have that file?Earlier you showed an ls of /kernel/drv/log, but that's only the 32 bit driver. Is th 64 bit one there in /kernel/drv/sparcv9?-- Darren
Darren_Dunhama at 2007-7-12 9:50:51 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...
# 10

Hello,

Yes, here is the output from ls and file:

bash-2.03$ ls -l /kernel/drv/sparcv9/log -rwxr-xr-x1 rootsys 9328 Dec 12 11:22 /kernel/drv/sparcv9/log

bash-2.03$ file /kernel/drv/sparcv9/log

/kernel/drv/sparcv9/log:ELF 64-bit MSB relocatable SPARCV9 Version 1

bash-2.03$

Thanks,

Dave

syslogd_questiona at 2007-7-12 9:50:51 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...
# 11
Truss doesn't give any visibility into the modload process. It's possible that some kernel viewing with mdb might be useful, but I have no information about that.You've stumped me.-- Darren
Darren_Dunhama at 2007-7-12 9:50:51 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...
# 12
thanks for your help Darren - I will post if I get any further
syslogd_questiona at 2007-7-12 9:50:51 > top of Java-index,Solaris Operating System,Solaris Essentials - General Technical Questions...