ZFS and external FireWire drives

We've been dabbling with options for external storage and just for the hell of it, decided to try out a couple of external (LaCie BigDisk Extreme Triple Interface) Firewire drives. The drives are connected to separate PCI-e FireWire 400 cards and were originally partitioned using fdisk and then formatted before adding to a zfs (mirrored) pool. We are using a T2000 (4core) on Solaris10 06/06.

I've noticed some problems with transfer speed (throughput) in other topics, so we have patched the kernel to include 118833-24.

To my great surprise we have been getting performance (see below) of up to 45MB/sec (yipee!!!). Unfortunately some files are falling back to the woefull speed of less than 1.5MB/sec (yech !!!). Is this normal / expected ? Why ?

Is there a tool I can use to monitor what is happening more closely ?

(Eg iostat or zfs iostat ?). Can you tune a ZFS pool ?

Any help/advice greatly appreciated.

Cheers,

Shaun

(Sorry I can't paste an image here, but the performance looks like this -)

fsize(MB) time(s)Mb/s

10.0520

20.0922.22222222

549.10.101832994

100.2835.71428571

200.5238.46153846

501.2639.68253968

1002.6437.87878788

2005.1738.68471954

500261.461.912338407

100023.243.10344828

20001278.51.564333203

30001391.12.156566746

40002501.651.598944697

50003735.11.338652245

[1436 byte] By [QPWS] at [2007-11-26 10:40:43]
# 1

An update on our experiences with ZFS and Firewire drives.

Unfortunately we hadn't actually patched the kernel to 118833-24, 23 was what it actually was (NOW it's 24).

We had successfully setup ZFS and one of the Firewire drives decided to play nasty and got corrupt somehow (we suspect the disks were dodgy to start with).

This lead to a kernel panic and the system went down in a screaming heap.

When it came back up the ZFS pool was showing that one of the drives in the mirror was stuffed, so I had to offline and remove it from the pool. Leaving the drive connected to the system only caused the system to "lock-up". So far (despite our problems) I am liking ZFS (kudos to Sun for this !).

We'll replace the drive and continue with the "testing".

QPWS at 2007-7-7 2:52:13 > top of Java-index,Sun Hardware,Other Sun Hardware...
# 2

Yet another update on procedings -

Kernal patching seems to have stabilized things a bit.

Although now we are getting a number of soft errors (> 10 per day) on BOTH NEW LaCie disks.

Firewire disks seem to equate to crap write speeds (< 2MB) with acceptible read speeds (>30MB).

Overall this looks like it was one big mistake !

QPWS at 2007-7-7 2:52:13 > top of Java-index,Sun Hardware,Other Sun Hardware...