Oldskooler Ramblings

the unlikely child born of the home computer wars

Hardware for an OpenIndiana ZFS file server

Posted by Trixter on October 6, 2013


It’s hard to be an Illumos user.  The amount of hardware that works correctly with OpenIndiana (my favorite OS right now) is not very well defined and relies on confirmations from the user community whether something works or not.  There are other ways to build a ZFS NAS, such as FreeNAS, but I’ve been using ZFS since it was in Solaris (x86) 10u3 and have followed the path of the devout:  Solaris 10 x86, to OpenSolaris, to OpenIndiana.

This blog post is not about how to build a ZFS fileserver; there are enough out there.  Rather, this post is about what hardware I chose to build mine.  I wanted to spend less than $1000, build something that had future storage upgrade potential, and had a motherboard + CPU that someone else had already verified as good for OpenIndiana.  I wanted ECC memory to further protect against what ZFS already protects against, and finally I wanted to boot off of a USB flash drive.

Here’s what I came up with.  Please forgive the NewEgg formatting, but at least the links are intact in case you want to go buy something:

Qty. Product Description
1 COOLER MASTER HAF series RC-912-KKN1 Black SECC/ ABS Plastic ATX Mid Tower Computer Case COOLER MASTER HAF series RC-912-KKN1 Black SECC/ ABS Plastic ATX Mid Tower Computer Case
Item #: N82E16811119233
Return Policy: Standard Return Policy
1 SUPERMICRO MBD-X9SCM-F-O LGA 1155 Intel C204 Micro ATX Intel Xeon E3 Server Motherboard SUPERMICRO MBD-X9SCM-F-O LGA 1155 Intel C204 Micro ATX Intel Xeon E3 Server Motherboard
Item #: N82E16813182253
Return Policy: Standard Return Policy
1 Rosewill CAPSTONE-550 550W Continuous @ 50°C, Intel Haswell Ready, 80 PLUS GOLD, ATX12V v2.31 & EPS12V v2.92, SLI/CrossFire Ready, Active PFC Power Supply Rosewill CAPSTONE-550 550W Continuous @ 50°C, Intel Haswell Ready, 80 PLUS GOLD, ATX12V v2.31 & EPS12V v2.92, SLI/CrossFire Ready, Active PFC Power Supply
Item #: N82E16817182068
Return Policy: Standard Return Policy
1 Intel Xeon E3-1230 Sandy Bridge 3.2GHz LGA 1155 80W Quad-Core Server Processor BX80623E31230 Intel Xeon E3-1230 Sandy Bridge 3.2GHz LGA 1155 80W Quad-Core Server Processor BX80623E31230
Item #: N82E16819115083
Return Policy: CPU Replacement Only Return Policy
1 Kingston 8GB 240-Pin DDR3 SDRAM DDR3 1333 ECC Unbuffered Server Memory Intel Model KVR13E9/8I Kingston 8GB 240-Pin DDR3 SDRAM DDR3 1333 ECC Unbuffered Server Memory Intel Model KVR13E9/8I
Item #: N82E16820239116
Return Policy: Memory Standard Return Policy
1 LG Black 14X BD-R 2X BD-RE 16X DVD+R 5X DVD-RAM 12X BD-ROM 4MB Cache SATA BDXL Blu-ray Burner, Bare Drive, 3D Play Back (WH14NS40) - OEM LG Black 14X BD-R 2X BD-RE 16X DVD+R 5X DVD-RAM 12X BD-ROM 4MB Cache SATA BDXL Blu-ray Burner, Bare Drive, 3D Play Back (WH14NS40) – OEM
Item #: N82E16827136250
Return Policy: Standard Return Policy
1 Kingston DataTraveler SE9 64GB USB 2.0 Flash Drive Model DTSE9H/64GB Kingston DataTraveler SE9 64GB USB 2.0 Flash Drive Model DTSE9H/64GB
Capacity: 64GB Color: Silver
Item #: 9SIA12K0X40410

This came out to roughly $730.

Normally I try to be fair and list pros and cons, but I only have good things to say about this arrangement.  Everything (hardware and software) worked correctly on the first try.  The performance is ludicrous; I can easily saturate a gigabit pipe with a 4-drive raidz.  There were no hitches installing OpenIndiana at all, even installing to the flash drive (which is connected to an internal USB header so it’s out of the way).  The drives are sideways so the power and sata cables can be routed behind the motherboard.  In fact, everything is routed behind the motherboard except for the main motherboard power cable.  The drives are on rails; while they aren’t hot-swap, it is very easy to swap them without using any tools.

Astute readers will wonder why I purchase a Sandy Bridge Xeon instead of something newer.  Ivy Bridge or Haswell would have given me more bang for my buck, but I wanted to play it safe with confirmed, tested hardware.  I was also unsure if my motherboard would support Ivy Bridge — it requires the latest BIOS to do so, but you need a Sandy Bridge to apply the latest BIOS!  Horrible catch-22.  So I played it safe with Sandy Bridge.  You also might be wondering why a blu-ray drive is there.  That is a “why not?” addition — if it’s possible to burn blu-ray media directly from the fileserver, that’s an additional win.  Even if I can’t, it was only $50 more than a DVD-ROM drive so hey, why not.

All of my previous builds have been from cast-off second-hand hardware; this is the first time I built it right the first time, and I wish I had done this years ago.  I have a good feeling this hardware will last me a good 6-8 years as-is.

Advertisements

Leave a Reply

Please log in using one of these methods to post your comment:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

 
%d bloggers like this: