OpenZFS on OS X

I'm relatively new to using ZFS, but I did succeed in setting up a zpool and then expanding it when I swapped out large hard drive. And I've run a few scrubs. But now I have a problem - on reboot my zpool isn't showing up. All 4 drives are visible in Disk Utility, and I'm running El Capitan 10.11.3.

Not sure what O3X was doing on reboot, but the pool eventually showed up agin. But now one of the disks is re-silvering.

Code: Select all

Bob-Mac-Pro:~ Bob$ sudo zpool status
  pool: bigpool
 state: ONLINE
status: One or more devices is currently being resilvered.  The pool will
   continue to function, possibly in a degraded state.
action: Wait for the resilver to complete.
  scan: resilver in progress since Mon Mar 14 06:07:30 2016
    1.23M scanned out of 2.81T at 2.51K/s, (scan is slow, no estimated time)
    248K resilvered, 0.00% done
config:

   NAME                                            STATE     READ WRITE CKSUM
   bigpool                                         ONLINE       0     0     0
     raidz2-0                                      ONLINE       0     0     0
       media-A889C451-A527-E24F-920F-BE7B25467162  ONLINE       0     0     0
       media-CDE621D8-C374-FF41-A1DC-4F35C48E4F64  ONLINE       0     0     0
       media-C83EB918-D5E2-884B-A95A-3CF5D3E85F0E  ONLINE       0     0     0  (resilvering)
       media-CE046090-DF67-CA4A-83DF-E97D361AF74E  ONLINE       0     0     0

I'm not sure what triggered the re-silvering, but it is running really, really slowly. There was a back-up running that I've just killed. Hopefully that will speed things up.

I haven't replaced any disks - should I? Ideas on what I should do to check are appreciated.

The re-silvering isn't going well. Scan is at 3k/s, so it won't finish in my lifetime. Really hoping that someone here can offer advice. I don't know if it hardware or software causing the problem. I did recently apply a security patch.

Code: Select all

Bob-Mac-Pro:~ Bob$ sudo zpool list
NAME      SIZE  ALLOC   FREE  EXPANDSZ   FRAG    CAP  DEDUP  HEALTH  ALTROOT
bigpool  14.5T  2.81T  11.7T         -    10%    19%  1.00x  ONLINE  -
Bob-Mac-Pro:~ Bob$ sudo zpool status
  pool: bigpool
 state: ONLINE
status: One or more devices is currently being resilvered.  The pool will
   continue to function, possibly in a degraded state.
action: Wait for the resilver to complete.
  scan: resilver in progress since Mon Mar 14 18:12:14 2016
    2.50M scanned out of 2.81T at 3.09K/s, (scan is slow, no estimated time)
    556K resilvered, 0.00% done
config:

   NAME                                            STATE     READ WRITE CKSUM
   bigpool                                         ONLINE       0     0     0
     raidz2-0                                      ONLINE       0     0     0
       media-A889C451-A527-E24F-920F-BE7B25467162  ONLINE       0     0     0
       media-CDE621D8-C374-FF41-A1DC-4F35C48E4F64  ONLINE       0     0     0
       media-C83EB918-D5E2-884B-A95A-3CF5D3E85F0E  ONLINE       0     0     0  (resilvering)
       media-CE046090-DF67-CA4A-83DF-E97D361AF74E  ONLINE       0     0     0

errors: No known data errors

Usually they start slow and then speed up, but 3k/s seems ridiculous.

Would data corruption on the drive trigger a re-silver? It seems that there would be less extreme methods available to repair minor damage. And if it was major, then perhaps the drive itself is bad. I'd just like to understand the cause.

I do need advice on how best to proceed. Are there any known issues with El Capitan? Is there a log that may indicate if the problem is software-related or if it is hardware? Should I re-install OSX? Should I assume that my hard drive has failed? I can swap it out - I have a new drive on the way. Or should I just abandon O3X? I can copy my data onto an external drive if I can stop the re-silvering.

O3X is interesting, but the complete and total lack of support is a problem. I'd be willing to pay for support, but that doesn't appear to be an option. So I'm forced to conclude that O3X is not ready for prime time.

So here's the current status. Absolutely pathetic.

Code: Select all

Bob-Mac-Pro:~ Bob$ sudo zpool status
Password:
  pool: bigpool
 state: ONLINE
status: One or more devices is currently being resilvered.  The pool will
   continue to function, possibly in a degraded state.
action: Wait for the resilver to complete.
  scan: resilver in progress since Tue Mar 15 19:56:11 2016
    1.20M scanned out of 2.81T at 1.88K/s, (scan is slow, no estimated time)
    248K resilvered, 0.00% done
config:

   NAME                                            STATE     READ WRITE CKSUM
   bigpool                                         ONLINE       0     0     0
     raidz2-0                                      ONLINE       0     0     0
       media-A889C451-A527-E24F-920F-BE7B25467162  ONLINE       0     0     0
       media-CDE621D8-C374-FF41-A1DC-4F35C48E4F64  ONLINE       0     0     0
       media-C83EB918-D5E2-884B-A95A-3CF5D3E85F0E  ONLINE       0     0     0  (resilvering)
       media-CE046090-DF67-CA4A-83DF-E97D361AF74E  ONLINE       0     0     0

errors: No known data errors


What you say could be true. There are only three of us, working on this while its fun.

Clearly that resilver isn't going to pick up, so maybe it's time to see what it is doing. I assume you have tried rebooting, and/or offline/online the specific device, to start a new resilver?

I'm happy to try a few things. I have rebooted, but on restart it takes about 10 minutes before my ZFS pool shows up at all. And when it does, my machine slows down. I haven't taken the disk off line that is re-silvering. How do I do that?

I have a replacement HD on order, just in case a drive is going bad. That should be here soon.

I also recently installed Norton Security (I'm a long-time PC user where viruses are a big risk). Could that be causing a problem?

I'd suggest that you report to the IRC channel for support per the FAQ.

Cheers
Brendon