ZFS reported errors across all 8-disks, zpool clear froze
Posted: Mon Jun 22, 2020 6:17 am
I set up a brand new raid this weekend.
14TB Toshiba Enterprise drives in a 8x14TB RaidZ-2 configuration in a Thunderbay 8 enclosure. Drives are in JBOD mode, I never installed SoftRAID.
The Thunderbay8 is connected via TB3 via a CalDigit dock to my MacBook Pro 16. All TB3 cabling is active cabling.
All brand new enclosure, drives, and cabling.
The Time Machine volume I setup was encrypting overnight, when I came back to my machine this morning ZetaWatch was going crazy about ZFS having detected errors. According to ZetaWatch, the errors were spread across all 8 drives leading me to think the drives momentarily
My understanding is at that point, all I/O should be blocked.......but the array sounded quite active.
I ran "zpool status -x" and got:
pool: thunderbay8
state: ONLINE
status: One or more devices are faulted in response to IO failures.
action: Make sure the affected devices are connected, then run 'zpool clear'.
see: http://zfsonlinux.org/msg/ZFS-8000-HC
scan: none requested
config:
NAME STATE READ WRITE CKSUM
thunderbay8 ONLINE 511 2.59K 0
raidz2-0 ONLINE 1.00K 22 0
media-1F05BCAF-68AB-114B-BD1A-BA1F22032F11 ONLINE 403 8 0
media-994DC03E-6EC1-DA40-96EA-B5A5CDD416AB ONLINE 400 8 0
media-93B9E6A5-033F-5C47-B353-D6B48E3974A3 ONLINE 413 8 0
media-EA30491F-D5B0-2A42-A916-1190CA1AE5C0 ONLINE 404 10 0
media-E71C76CC-FFE8-0F4E-AADB-D6CD251B3707 ONLINE 399 8 0
media-A31C3A93-C451-7948-B896-BB6C0817EBF6 ONLINE 408 8 0
media-734C3A59-F581-E546-8A08-C130BD886575 ONLINE 416 8 0
media-03C12506-E20C-CB44-9E9F-2BE6B24F8360 ONLINE 403 8 0
I then ran "zpool clear thunderbay8", all sound from the drives stopped, and then my console froze.
After a few minutes I tried restarting my Mac, but it just sat there, so I finally physically powered off my MacBook Pro and restarted.
Any ideas what is going on? This is my first experience with ZFS on OS X....
14TB Toshiba Enterprise drives in a 8x14TB RaidZ-2 configuration in a Thunderbay 8 enclosure. Drives are in JBOD mode, I never installed SoftRAID.
The Thunderbay8 is connected via TB3 via a CalDigit dock to my MacBook Pro 16. All TB3 cabling is active cabling.
All brand new enclosure, drives, and cabling.
The Time Machine volume I setup was encrypting overnight, when I came back to my machine this morning ZetaWatch was going crazy about ZFS having detected errors. According to ZetaWatch, the errors were spread across all 8 drives leading me to think the drives momentarily
My understanding is at that point, all I/O should be blocked.......but the array sounded quite active.
I ran "zpool status -x" and got:
pool: thunderbay8
state: ONLINE
status: One or more devices are faulted in response to IO failures.
action: Make sure the affected devices are connected, then run 'zpool clear'.
see: http://zfsonlinux.org/msg/ZFS-8000-HC
scan: none requested
config:
NAME STATE READ WRITE CKSUM
thunderbay8 ONLINE 511 2.59K 0
raidz2-0 ONLINE 1.00K 22 0
media-1F05BCAF-68AB-114B-BD1A-BA1F22032F11 ONLINE 403 8 0
media-994DC03E-6EC1-DA40-96EA-B5A5CDD416AB ONLINE 400 8 0
media-93B9E6A5-033F-5C47-B353-D6B48E3974A3 ONLINE 413 8 0
media-EA30491F-D5B0-2A42-A916-1190CA1AE5C0 ONLINE 404 10 0
media-E71C76CC-FFE8-0F4E-AADB-D6CD251B3707 ONLINE 399 8 0
media-A31C3A93-C451-7948-B896-BB6C0817EBF6 ONLINE 408 8 0
media-734C3A59-F581-E546-8A08-C130BD886575 ONLINE 416 8 0
media-03C12506-E20C-CB44-9E9F-2BE6B24F8360 ONLINE 403 8 0
I then ran "zpool clear thunderbay8", all sound from the drives stopped, and then my console froze.
After a few minutes I tried restarting my Mac, but it just sat there, so I finally physically powered off my MacBook Pro and restarted.
Any ideas what is going on? This is my first experience with ZFS on OS X....