JNIC and Panic + Reboot on Solaris 8 / E3500

Greetings all,

I have had some strange behaivor from one of my servers during the weekend. During a few hours between i have had 3 reboots + 500Mb VMCORE.0 file related to the following message below (as found in /var/adm/messages).

Has someone else here have had the same error or something close ? I am new to the job so no deep knowledge about the HW at the site.

Regards,

Pierre

Output from Messages:

Aug 4 21:12:57 epsu11 unix: [ID 836849 kern.notice]

Aug 4 21:12:57 epsu11 ^Mpanic[cpu18]/thread=2a10026bd20:

Aug 4 21:12:57 epsu11 unix: [ID 482697 kern.notice] jnic: Panic: JniPkgServer(0)

Aug 4 21:12:57 epsu11 unix: [ID 100000 kern.notice]

Aug 4 21:12:57 epsu11 genunix: [ID 723222 kern.notice] 000002a10026b7f0 jnic146x:JniSysBreak+44 (782871a8, 30002ed9d38, 0, 30

002ed6000, 30002ed9c58, 30002f69f68)

Aug 4 21:12:57 epsu11 genunix: [ID 179002 kern.notice] %l0-3: 0000004480001600 0000000000000016 0000000000000007 0000000010

00a408

Aug 4 21:12:57 epsu11 %l4-7: 000002a100a51520 0000000000694202 0000000000000004 000002a10026b900

Aug 4 21:12:57 epsu11 genunix: [ID 723222 kern.notice] 000002a10026b9a0 jnic146x:JniThreadServer+158 (30002ed9d58, 7826a83c,

20, 30002ed6e60, 7820ae68, 3000302e0a8)

Aug 4 21:12:58 epsu11 genunix: [ID 179002 kern.notice] %l0-3: 0000030002ed6e40 ffffffffffffffff 0000030002ed6be0 0000030002

ed6000

Aug 4 21:12:58 epsu11 %l4-7: 0000030002ed9d38 0000030002ed9d38 0000030002ed9d58 0000030002ed9b30

Aug 4 21:12:58 epsu11 genunix: [ID 723222 kern.notice] 000002a10026ba60 jnic146x:JniSysThreadServer0+a8 (30002ed6000, 30002ed

6e70, 30002ed6e68, 30002ed6e60, 10420, 78200000)

Aug 4 21:12:58 epsu11 genunix: [ID 179002 kern.notice] %l0-3: 000000007820a518 0000000000000005 0000030003bb6f40 0000030003

bb6d70

Aug 4 21:12:58 epsu11 %l4-7: 0000030003bb6e70 0000030008d95258 00000300040d1368 00000300040d1350

Aug 4 21:12:58 epsu11 unix: [ID 100000 kern.notice]

Aug 4 21:12:58 epsu11 genunix: [ID 672855 kern.notice] syncing file systems...

Aug 4 21:12:58 epsu11 jnic146x: [ID 948997 kern.notice] jnic146x0: FcScsiOsmTranStart(3): POLLED command

Aug 4 21:13:28 epsu11 unix: [ID 836849 kern.notice]

Aug 4 21:13:28 epsu11 ^Mpanic[cpu18]/thread=2a10026bd20:

Aug 4 21:13:28 epsu11 unix: [ID 715357 kern.notice] panic sync timeout

Aug 4 21:13:28 epsu11 unix: [ID 100000 kern.notice]

Aug 4 21:13:28 epsu11 genunix: [ID 353387 kern.notice] dumping to /dev/dsk/c1t5d0s1, offset 65536

Aug 4 21:14:01 epsu11 genunix: [ID 409368 kern.notice] ^M100% done: 52315 pages dumped, compression ratio 2.64,

Aug 4 21:14:01 epsu11 genunix: [ID 851671 kern.notice] dump succeeded

Aug 4 21:16:54 epsu11 genunix: [ID 540533 kern.notice] ^MSunOS Release 5.8 Version Generic_117350-06 64-bit

Aug 4 21:16:54 epsu11 genunix: [ID 913632 kern.notice] Copyright 1983-2003 Sun Microsystems, Inc. All rights

[3021 byte] By [PierreKlovsjo] at [2007-11-26 9:19:00]
# 1

Don't post the same question to multiple forums.

http://forum.sun.com/jive/post!reply.jspa?messageID=354210

http://forum.sun.com/jive/thread.jspa?threadID=103936

Sun never sold JNI-branded SBUS cards.

[url=http://sunsolve.sun.com/handbook_pub/Systems/E3500/components.html]E3500 Components List as shown in the SSH[/url]

You probably got the cards wien you purchased the external array(s).

EMC ?

Contact your storage vendor and have them give you guidance.

This could be a driver patch level issue.

rukbat at 2007-7-6 23:48:35 > top of Java-index,Storage Forums,Storage General Discussion...
# 2
Hello,Sorry about the misstake with 2 posts. I added the Storage forum after since it was more to the subject.My E3500 is attached to a StorageTek (HDS) 9970V Lightning bought and supported from SUN. Regards,Pierre
PierreKlovsjo at 2007-7-6 23:48:35 > top of Java-index,Storage Forums,Storage General Discussion...
# 3
Then I suggest you run Explorer and then open a support case with Sun.Let one of their Storage support enginers examine your issue.
rukbat at 2007-7-6 23:48:35 > top of Java-index,Storage Forums,Storage General Discussion...
# 4

Come on, that would be way toooo easy. I need something to do ;-)

Apparently the cards are generic JNI cards (SBUS) but never the less supported by SUN, or at least here in Paris. Just got the info from the former Sys Admin.

So we'll see what happens next.

Thanks for your information.

Regards,

Pierre

PierreKlovsjo at 2007-7-6 23:48:35 > top of Java-index,Storage Forums,Storage General Discussion...
# 5
It might be a local Sun support special but we never supported JNI SBUS cards corporate wide. Only some PCI ones and then after JNI cards under the Solaris drivers.I'd make sure you have the latest JNI drivers.
torreysun at 2007-7-6 23:48:35 > top of Java-index,Storage Forums,Storage General Discussion...
# 6

I would be interested in how it was determined that the cards are JNI Sbus cards. I had a look at the first message and could not determine that SBus is mentioned.

As far as I know all that was mentioned in the messages file was jnic146x which looks to me like it might be a Compact PCI card. To make things more interesting, why would you use a SBus card when there are PCI cards out there and we are talking about a Lightning Series HDS system.

When I was a Sun employee, I most definitely supported JNI PCI cards for a number of valued customer.

I have a TagmaStore USP 1100 and I need to attach a 10K to it.. I have been desperately searching for a personality plate to run Sun supported 2 Gb PCI cards. I have the PCI daughter board, two Dual 2 Gb PCI HBA's and no personality plate. Sun sold me the kit but cant find the plate. Now that is annoying..

I wish I was in Paris.

Stephen

stephen2602 at 2007-7-6 23:48:35 > top of Java-index,Storage Forums,Storage General Discussion...
# 7

Stephen,

My initial response was about SBUS cards,

because the Enterprise systems usually use that as their primary bus form-factor.

PCI ?They can do that as well, but it's not common.

cPCI ?Nope... I'm not aware of any cPCI I/O board on that platform.

As for the jnic146x specific modules?That's for a storage support erson

to figure out.

It's not my area of expertise.Thus my subsequent suggestion to run Explorer.

The JNI brand of cards have historically been sold by storage vendors,

and Pierre confirmed that they originally came from StorageTek.

Since Sun has now acquired StorageTek, he may have no alternative

but to go back to Sun for assistance.

Let's hope we get some follow-up info after the issue has been resolved.

rukbat at 2007-7-6 23:48:35 > top of Java-index,Storage Forums,Storage General Discussion...
# 8

Hello and sorry for the looong delay of answering.

Problem solved and it was a rather simple solution to it. The fu*king climate system was shutdown in the computer rooms during the weekend (only God knows why) hence the system(s) overheated, panicked and ..... as figured, rebooted due to this. If i would have read the logfiles a little more carefully this detail would have been visible to me.

I thank you guys for all your answers in regards to my problem that in the end had the human factor to blame or shall we say General Services....

Regards,

Pierre

PierreKlovsjo at 2007-7-6 23:48:35 > top of Java-index,Storage Forums,Storage General Discussion...
# 9

The kernel patch is down on this system, current Solaris 8 kernel patch is 117350-39. At one time Sun sold JNI FC HBAs as X options, these cards were listed in the handbook. A configuration option that would have been usual a few years ago was to combine JNI ( Sun version ) HBAs with non Sun storage products like EMC, IBM Total storage or Storagetek. Additionally ( as Rukbat mentioned ) a 3rd party storage vendor offers OEM HBAs installed with firmware specific for it's storage products. Even though the issue has been resolved it would be recommended to keep on top of alerts and patches for your system, these links will be useful:

http://www.sun.com/products-n-solutions/hardware/docs/Servers/Midrange_Servers/ enterprise_3500/index.html

http://sunsolve.sun.com/pub-cgi/show.pl?target=sunalert_patches#Sun_Enterprise_ 3500_Server

mlennon at 2007-7-6 23:48:35 > top of Java-index,Storage Forums,Storage General Discussion...