RAID Z on an external enclosure?

New to OpenZFS on OS X (Or ZFS in general)? Ask your questions here!

Re: RAID Z on an external enclosure?

Postby murraypetera » Mon May 04, 2015 5:01 am

I have since setup my esata 4 disk array.

I used Kanex KTU10 Thunderbolt to USB 3.0 and eSATA on my Mac Mini
Connected to
Vantec NST-640SU3-BK NexStar HX4 Quad 3.5in SATA HDD to USB3.0/eSATA Externa

Fan speed is unfortunately an manual dial on the back of the box. On low it is not very loud and I have seen the box sleep when the server sleeps.

I got it all work fairly fast but now have a server crash issue which I posted here:
viewtopic.php?f=26&t=2267

Here is my quick start guide for others:

zpool create -d \
-o feature@async_destroy=enabled \
-o feature@empty_bpobj=enabled \
-o feature@lz4_compress=enabled \
-O compression=lz4 \
-O atime=off \
-o ashift=12 \
-O normalization=formD \
BigDog raidz1 /dev/disk2s2 /dev/disk3s2 /dev/disk4s2 /dev/disk5s2

zfs set mountpoint=/Volumes/BigDog BigDog

zfs umount -a
zfs mount -a

Recover after crash:
zpool import -R /a BigDog
zpool scrub BigDog
murraypetera
 
Posts: 25
Joined: Wed Apr 22, 2015 2:18 pm

Re: RAID Z on an external enclosure?

Postby murraypetera » Wed Oct 14, 2015 4:36 pm

I have since removed the Kanex KTU10 and gone with USB 2.0 and have not had a crash for some time now. So this setup seems stable.
It is south of slow. :(... when doing large copies from other disks to this zpool I get UI freezes for short time.

I updated my config to also add an SSD cache but with my USB flooded I'm not sure this help much with my current config for large copies.. I need to get them on different data lines which in theory the Thunderbolt adapter will do for me and I can run at USB 3.0 speeds.

I have just ordered a CalDigit TS2 and hope this will work better.

Also running on OS X 10.11.1 Beta, can't figure out how to easily get off beta, living on the fast lane.
ZFS from master src build. 1.4 pkg would not install.

Cheers
murraypetera
 
Posts: 25
Joined: Wed Apr 22, 2015 2:18 pm

Re: RAID Z on an external enclosure?

Postby murraypetera » Wed Oct 14, 2015 4:40 pm

For those looking to do same:

zpool create -d \
-o feature@async_destroy=enabled \
-o feature@empty_bpobj=enabled \
-o feature@lz4_compress=enabled \
-O compression=lz4 \
-O atime=off \
-o ashift=12 \
-O normalization=formD \
BigDog raidz \
/var/run/disk/by-id/media-377ED014-B3C4-4312-B093-F7AB621C8754 \
/var/run/disk/by-id/media-35BA1A84-36F3-064D-9808-863434B4B5F5 \
/var/run/disk/by-id/media-012B10E6-2873-C944-AF72-91A8252D024E \
/var/run/disk/by-id/media-1F0796E7-210D-8744-BD76-C84B4B091B72 \
cache /var/run/disk/by-id/media-574F4C76-458E-EE4E-BBB7-7A5E020D59A1


Big change from before is do NOT use /dev/disk on osx.. use /var/run/disk/by-id devices since these are static numbers and the /dev/disk changes depending on mount order!
murraypetera
 
Posts: 25
Joined: Wed Apr 22, 2015 2:18 pm

Re: RAID Z on an external enclosure?

Postby lundman » Wed Oct 14, 2015 6:49 pm

Unless you specify a specific version, with
Code: Select all
zpool create -O version=28
then default is to have all features enabled, so the list
Code: Select all
-o feature@async_destroy=enabled \
-o feature@empty_bpobj=enabled \
-o feature@lz4_compress=enabled \


is not needed. Doesn't hurt either, if you want to confirm it supports those features :)
User avatar
lundman
 
Posts: 1335
Joined: Thu Mar 06, 2014 2:05 pm
Location: Tokyo, Japan

Re: RAID Z on an external enclosure?

Postby ilovezfs » Sun Oct 25, 2015 12:20 am

murraypetera wrote:ZFS from master src build. 1.4 pkg would not install.

Install log? (install.log in Console.app or /var/log/install.log)
ilovezfs
 
Posts: 232
Joined: Thu Mar 06, 2014 7:58 am

Re: RAID Z on an external enclosure?

Postby ilovezfs » Sun Oct 25, 2015 12:27 am

As lundman said, the default is all features. However, in the command above murraypetera uses "-d," which overrides that default, so the explicit enables would be required if we want that to happen at create time:
-d
Do not enable any features on the new pool. Individual features
can be enabled by setting their corresponding properties to
enabled with the -o option. See zpool-features(5) for details
about feature properties.

There's an upstream pull request that allows you to specify "all features EXCEPT," but that pull request has not yet been accepted: https://github.com/zfsonlinux/zfs/pull/3465
ilovezfs
 
Posts: 232
Joined: Thu Mar 06, 2014 7:58 am

Re: RAID Z on an external enclosure?

Postby ilovezfs » Sun Oct 25, 2015 12:36 am

murraypetera wrote:/var/run/disk/by-id/media-377ED014-B3C4-4312-B093-F7AB621C8754 \
/var/run/disk/by-id/media-35BA1A84-36F3-064D-9808-863434B4B5F5 \
/var/run/disk/by-id/media-012B10E6-2873-C944-AF72-91A8252D024E \
/var/run/disk/by-id/media-1F0796E7-210D-8744-BD76-C84B4B091B72 \
cache /var/run/disk/by-id/media-574F4C76-458E-EE4E-BBB7-7A5E020D59A1

You do not need to prepend "/var/run/disk/by-id/" and can just say "media-377ED014-B3C4-4312-B093-F7AB621C8754" in the create command.

However, because those long names are annoying to have to copy paste or tab complete, and because the by-id links WILL NOT EXIST YET if you're giving ZFS the entire disk (the ID is the ID of the partition, and in the case of a whole disk ZFS does the partitioning during the create - chicken meet egg, egg meet chicken), which is what we recommend as best practice, it is usually better to do this:
Code: Select all
sudo zpool create swimmingpool raidz2 diskA diskB diskC diskD diskE
sudo zpool export swimmingpool
sudo zpool import -d /var/run/disk/by-id swimmingpool

(If instead you opt to do the partitioning yourself, the by-id links will already exist, and you can use those in create as you suggested.)
ilovezfs
 
Posts: 232
Joined: Thu Mar 06, 2014 7:58 am

Re: RAID Z on an external enclosure?

Postby murraypetera » Sun Jan 10, 2016 5:22 am

Jeff240sx or former,

Can you post your detailed confirms. I purchased a new thunderbolt adapter with usb3 and still get panics.

I am runn 1.4.2 on latest OS X

Thanks
murraypetera
 
Posts: 25
Joined: Wed Apr 22, 2015 2:18 pm

Previous

Return to Absolute Beginners Section

Who is online

Users browsing this forum: No registered users and 11 guests