OpenZFS on OS X

Hi, I upgraded to El Capitan and now one of my disks won't mount. I have tried the zpool online command to no avail. Copy of my terminal below. Any thoughts? I think what led to this was me foolishly not exporting the zpool before upgrade.

Thank you

Code: Select all

Robs-Mac-Pro:~ robbrown$ sudo zpool status BigDiskZFS
  pool: BigDiskZFS
 state: DEGRADED
status: One or more devices has been removed by the administrator.
   Sufficient replicas exist for the pool to continue functioning in a
   degraded state.
action: Online the device using 'zpool online' or replace the device with
   'zpool replace'.
  scan: scrub in progress since Thu Nov 16 18:58:52 2017
    1.10M scanned out of 1.01T at 35.3K/s, (scan is slow, no estimated time)
    0 repaired, 0.00% done
config:

   NAME                                            STATE     READ WRITE CKSUM
   BigDiskZFS                                      DEGRADED     0     0     0
     mirror-0                                      DEGRADED     0     0     0
       16002150932626784464                        REMOVED      0     0     0  was /private/var/run/disk/by-id/media-B470B88A-8ACF-4EAA-BE87-A6B89CAC98D8
       media-768C27ED-1283-44FF-8F3D-A91A4DC8E6A4  ONLINE       0     0     0

errors: No known data errors
Robs-Mac-Pro:~ robbrown$ sudo zpool online BigDiskZFS 16002150932626784464
warning: device '16002150932626784464' onlined, but remains in faulted state
use 'zpool replace' to replace devices that are no longer present
Robs-Mac-Pro:~ robbrown$ sudo zpool online BigDiskZFS 16002150932626784464


Nothing to do with missed exporting.

What disks do you have now? "diskutil list" and "zpool status -L" ?

lundman wrote:Nothing to do with missed exporting.

What disks do you have now? "diskutil list" and "zpool status -L" ?

Code: Select all

Robs-Mac-Pro:~ robbrown$ diskutil list
/dev/disk0 (internal, physical):
   #:                       TYPE NAME                    SIZE       IDENTIFIER
   0:      GUID_partition_scheme                        *512.1 GB   disk0
   1:                        EFI EFI                     209.7 MB   disk0s1
   2:                  Apple_HFS Macintosh SSD           416.5 GB   disk0s2
   3:                 Apple_Boot Recovery HD             650.0 MB   disk0s3
   4:                  Apple_HFS Recovery HD             784.2 MB   disk0s4
   5:                 Linux Swap                         1.0 GB     disk0s5
   6:           Linux Filesystem                         93.0 GB    disk0s6
/dev/disk1 (internal, physical):
   #:                       TYPE NAME                    SIZE       IDENTIFIER
   0:      GUID_partition_scheme                        *2.0 TB     disk1
   1:                        EFI EFI                     209.7 MB   disk1s1
   2:                  Apple_HFS Backup2TB               2.0 TB     disk1s2
/dev/disk2 (internal, physical):
   #:                       TYPE NAME                    SIZE       IDENTIFIER
   0:      GUID_partition_scheme                        *1.5 TB     disk2
   1:                        EFI EFI                     209.7 MB   disk2s1
   2:                        ZFS BigDiskZFS              1.5 TB     disk2s2
/dev/disk3 (internal, physical):
   #:                       TYPE NAME                    SIZE       IDENTIFIER
   0:      GUID_partition_scheme                        *1.5 TB     disk3
   1:                        EFI EFI                     209.7 MB   disk3s1
   2:                        ZFS BigDiskZFS              1.5 TB     disk3s2

and

Code: Select all

Robs-Mac-Pro:~ robbrown$ zpool status -L
  pool: BigDiskZFS
 state: DEGRADED
status: One or more devices has been removed by the administrator.
   Sufficient replicas exist for the pool to continue functioning in a
   degraded state.
action: Online the device using 'zpool online' or replace the device with
   'zpool replace'.
  scan: scrub in progress since Thu Nov 16 19:00:01 2017
    38.4G scanned out of 1.01T at 48.9M/s, 5h48m to go
    0 repaired, 3.71% done
config:

   NAME                      STATE     READ WRITE CKSUM
   BigDiskZFS                DEGRADED     0     0     0
     mirror-0                DEGRADED     0     0     0
       16002150932626784464  REMOVED      0     0     0  was /private/var/run/disk/by-id/media-B470B88A-8ACF-4EAA-BE87-A6B89CAC98D8
       disk2s2               ONLINE       0     0     0

errors: No known data errors


Have a look in /private/var/run/disk/by-id/ ? Did disk3 get renamed or something? You can always do something like

zpool export BigDiskZFS
zpool import -d /dev/ BigDiskZFS
zpool export BigDiskZFS
zpool impot -d /var/run/disk/by-id/ BigDiskZFS

I do see /private/var/run/disk/by-id/media-B470B88A-8ACF-4EAA-BE87-A6B89CAC98D8

... which is strange.

I tried the commands, but when I try to import using those commands, computer crashes. on reboot, zfs pool is actually mounted (but that disk shows UNAVAIL)

Perhaps I should remove the good disk and format the bad one, then somehow reimport into the pool?

You can zpool replace pool baddisk baddisk

To make it replace the "missing bad disk" with itself (the disk you know it should be using). But something does seem weird here, is the disk listed UNAVAIL working otherwise? Can you do a raw-read test with it?

lundman wrote:You can zpool replace pool baddisk baddisk

To make it replace the "missing bad disk" with itself (the disk you know it should be using). But something does seem weird here, is the disk listed UNAVAIL working otherwise? Can you do a raw-read test with it?

I tried:

Code: Select all

Robs-Mac-Pro:~ robbrown$ zpool replace BigDiskZFS 16002150932626784464 16002150932626784464
cannot open '16002150932626784464': no such device in /dev
must be a full path or shorthand device name


I then tried:

Code: Select all

Robs-Mac-Pro:~ robbrown$ sudo zpool replace BigDiskZFS media-B470B88A-8ACF-4EAA-BE87-A6B89CAC98D8 media-B470B88A-8ACF-4EAA-BE87-A6B89CAC98D8
invalid vdev specification
use '-f' to override the following errors:
/private/var/run/disk/by-id/media-B470B88A-8ACF-4EAA-BE87-A6B89CAC98D8 is part of active ZFS pool BigDiskZFS. Please see zpool(1M).
Robs-Mac-Pro:~ robbrown$


I then tried:

Code: Select all

Robs-Mac-Pro:~ robbrown$ sudo zpool replace -f BigDiskZFS media-B470B88A-8ACF-4EAA-BE87-A6B89CAC98D8 media-B470B88A-8ACF-4EAA-BE87-A6B89CAC98D8
invalid vdev specification
the following errors must be manually repaired:
/private/var/run/disk/by-id/media-B470B88A-8ACF-4EAA-BE87-A6B89CAC98D8 is part of active ZFS pool BigDiskZFS. Please see zpool(1M).
Robs-Mac-Pro:~ robbrown$


... The disk shows as REMOVED currently:


NAME STATE READ WRITE CKSUM
BigDiskZFS DEGRADED 0 0 0
mirror-0 DEGRADED 0 0 0
16002150932626784464 REMOVED 0 0 0 was /private/var/run/disk/by-id/media-B470B88A-8ACF-4EAA-BE87-A6B89CAC98D8
media-768C27ED-1283-44FF-8F3D-A91A4DC8E6A4 ONLINE 0 0 0

I think you need to move to /dev/disk names while you troubleshoot this, using "zpool import -d /dev/ BigDiskZFS" - The replace command is having problems opening the /var/run/dsk symlink, as if the disk is not there?

Sorry, can someone please provide a step by step instruction on how to remove the bad disk, then add it back to the pool? Or its over to Synology for me.

I managed to remove the offending disk:

Code: Select all

   NAME                                          STATE     READ WRITE CKSUM
   BigDiskZFS                                    ONLINE       0     0     0
     media-768C27ED-1283-44FF-8F3D-A91A4DC8E6A4  ONLINE       0     0     0


Now I am trying to add the old disk back into the pool, making it mirror the first disk. How do I do that?

I tried this, but think this command is for when you want to add two fresh disks to a pool; I have one disk existing already.

Code: Select all

Robs-Mac-Pro:~ robbrown$ sudo zpool add BigDiskZFS mirror media-768C27ED-1283-44FF-8F3D-A91A4DC8E6A4 media-B470B88A-8ACF-4EAA-BE87-A6B89CAC98D8
invalid vdev specification
use '-f' to override the following errors:
/private/var/run/disk/by-id/media-768C27ED-1283-44FF-8F3D-A91A4DC8E6A4 is part of active ZFS pool BigDiskZFS. Please see zpool(1M).