For reference onlyWhilst using three pools with ZEVO, preparing to test ZFS-OSX, I allowed a kernel panic (build 12F37 of OS X 10.8.5). A kernel core dump began, but I don't expect anyone to analyse a full dump so I chose to force a shut down.
With an external drive, I started pre-release build 13A584 of OS X 10.9 and made just a little use of ZFS-OSX with all three pools. As expected (following the panic), it was necessary to force the first imports. Terminal output was saved to a separate partition of the drive.
I returned to Mountain Lion with ZEVO and repartitioned the external drive, preparing for a next phase of testing of ZFS-OSX.
Around 20:10 on the evening of Sunday 2013-09-29 I realised that the pool named 'tall', to which I normally back up with Time Machine, was UNAVAIL (insufficient replicas):
- Code: Select all
gpes3e-gjp4:2013-06 gjp22$ date
Sun 29 Sep 2013 20:10:46 BST
gpes3e-gjp4:2013-06 gjp22$ zpool status
pool: gjp22
state: ONLINE
scan: scrub repaired 0 in 20h52m with 0 errors on Sun Sep 22 18:42:02 2013
config:
NAME STATE READ WRITE CKSUM
gjp22 ONLINE 0 0 0
GPTE_71B8BDA2-3EBA-4B91-9E1C-2AE2B1DAAD06 ONLINE 0 0 0 at disk9s2
cache
GPTE_4DE8B2ED-797A-407B-A11B-C51B96DBD4CB OFFLINE 0 0 0
errors: No known data errors
pool: tall
state: UNAVAIL
status: One or more devices are faulted in response to persistent errors. There are insufficient replicas for the pool to
continue functioning.
action: Destroy and re-create the pool from a backup source. Manually marking the device
repaired using 'zpool clear' may allow some data to be recovered.
scan: scrub repaired 0 in 76h17m with 0 errors on Sat Sep 21 21:45:31 2013
config:
NAME STATE READ WRITE CKSUM
tall UNAVAIL 0 0 0 insufficient replicas
GPTE_78301A52-4AFF-4D96-8DE9-E76ABC14909C ONLINE 0 0 0 at disk3s2
GPTE_99056308-F5E2-4314-852C-4DA04732A2D0 FAULTED 1 1 0 too many errors
errors: 69 data errors, use '-v' for a list
pool: zhandy
state: ONLINE
scan: scrub repaired 0 in 17h10m with 0 errors on Tue Sep 17 11:23:07 2013
config:
NAME STATE READ WRITE CKSUM
zhandy ONLINE 0 0 0
GPTE_A54431D5-B46F-44A9-83B4-76802A584C6E ONLINE 0 0 0 at disk4s2
errors: No known data errors
gpes3e-gjp4:2013-06 gjp22$ sudo zpol status -v tall
sudo: zpol: command not found
gpes3e-gjp4:2013-06 gjp22$ sudo zpool status -v tall
pool: tall
state: UNAVAIL
status: One or more devices are faulted in response to persistent errors. There are insufficient replicas for the pool to
continue functioning.
action: Destroy and re-create the pool from a backup source. Manually marking the device
repaired using 'zpool clear' may allow some data to be recovered.
scan: scrub repaired 0 in 76h17m with 0 errors on Sat Sep 21 21:45:31 2013
config:
NAME STATE READ WRITE CKSUM
tall UNAVAIL 0 0 0 insufficient replicas
GPTE_78301A52-4AFF-4D96-8DE9-E76ABC14909C ONLINE 0 0 0 at disk3s2
GPTE_99056308-F5E2-4314-852C-4DA04732A2D0 FAULTED 1 1 0 too many errors
errors: Permanent errors have been detected in the following files:
<0x3a30e>:<0x217f7>
tall:/.fseventsd/fc007477ca14dce6
<0x3a254>:<0x217f7>
tall/com.apple.backupd:/gpes3e-gjp4.sparsebundle/bands/6e0
tall/com.apple.backupd:<0x5019>
tall/com.apple.backupd:/gpes3e-gjp4.sparsebundle/bands/6e4
tall/com.apple.backupd:/.DS_Store
tall/com.apple.backupd:/gpes3e-gjp4.sparsebundle/bands/611
tall/com.apple.backupd:/gpes3e-gjp4.sparsebundle/bands/62d
tall/com.apple.backupd:<0x20073>
tall/com.apple.backupd:<0x20074>
tall/com.apple.backupd:/gpes3e-gjp4.sparsebundle/bands/650
tall/com.apple.backupd:/gpes3e-gjp4.sparsebundle/bands/665
tall/com.apple.backupd:/gpes3e-gjp4.sparsebundle/bands/2216
tall/com.apple.backupd:/.fseventsd/fc007477ca3db06b
tall/com.apple.backupd:/gpes3e-gjp4.sparsebundle/bands/772
tall/com.apple.backupd:/gpes3e-gjp4.sparsebundle/bands/77c
tall/com.apple.backupd:/gpes3e-gjp4.sparsebundle/bands/8a7
<0x3a3b9>:<0x217f7>
tall/com.bombich.ccc:/.fseventsd/fc007477ca14ea25
tall/com.bombich.ccc:/OS/Applications/additions/p/Paparazzi!/Paparazzi!.app/Contents/Resources/en.lproj/ServicesMenu.strings
tall/com.bombich.ccc:/OS/Applications/Cyberduck.app/Contents/Resources/en.lproj/ServicesMenu.strings
tall/com.bombich.ccc:/OS/Applications/Mail.app/Contents/Resources/en.lproj/ServicesMenu.strings
tall/com.bombich.ccc:/.Spotlight-V100/Store-V2/F7F59C98-AD5A-47E2-B7BE-09B8FEDC2705/.store.db
gpes3e-gjp4:2013-06 gjp22$ clear
… I'll not post my notes in their entirety, but ultimately I could not export the affected pool (a known issue with ZEVO in situations such as this) –
- Code: Select all
gpes3e-gjp4:2013-06 gjp22$ date
Sun 29 Sep 2013 20:19:25 BST
gpes3e-gjp4:2013-06 gjp22$ zfs mount
tall /Volumes/tall
tall/com.apple.backupd /Volumes/tall/com.apple.backupd
gjp22/casesensitive /Volumes/casesensitive
gjp22 /Volumes/gjp22
gjp22/opt /opt
gpes3e-gjp4:2013-06 gjp22$ zfs unmount -f tall/com.apple.backupd
gpes3e-gjp4:2013-06 gjp22$ zpool export tall
load: 6.41 cmd: zpool 3135 uninterruptible 0.00u 0.01s
load: 6.41 cmd: zpool 3135 uninterruptible 0.00u 0.01s
^Cload: 7.32 cmd: zpool 3135 uninterruptible 0.00u 0.01s
– so the session, which began with a verbose boot, probably ended with a forced shut down (or forced restart) when it became clear that shut down could not complete normally.
Now – looking closely at that first list of permanent errors – I'm almost certain that:
- the situation simply arose from me using something other than the usual bus for the pool
- prior use of ZFS-OSX was not contributory.
There's more …