I have an array of 4 3Tb disks, 2 mirrored VDEVs attached via thunderbolt. I'm getting very slow performance on it, and am trying to figure out why. Here's the current speeds (pool is scrubbing, so it should be pretty max maxed out?) These speeds seem consistent with what I'm getting from copying files around.
- Code: Select all
zpool iostat -v 5
capacity operations bandwidth
pool alloc free read write read write
---------------------------------------------- ----- ----- ----- ----- ----- -----
PlayPool 1.96T 3.49T 123 136 12.2M 6.07M
mirror 1.36T 1.37T 113 64 11.9M 2.50M
media-7D5A5263-F73A-C841-8F1D-16AA3345F709 - - 57 32 5.98M 1.25M
media-6EA69111-A906-9B41-B8A9-33D457B225AF - - 56 31 5.90M 1.25M
mirror 613G 2.12T 9 71 380K 3.57M
media-FCAC5C92-96E6-C84B-A5CE-8ABA81176602 - - 4 35 182K 1.78M
media-4F980611-DE99-924D-9F5A-3FAB9FA8BDF5 - - 4 36 198K 1.78M
---------------------------------------------- ----- ----- ----- ----- ----- -----
capacity operations bandwidth
pool alloc free read write read write
---------------------------------------------- ----- ----- ----- ----- ----- -----
PlayPool 1.96T 3.49T 85 149 8.68M 7.70M
mirror 1.36T 1.37T 81 71 8.54M 3.82M
media-7D5A5263-F73A-C841-8F1D-16AA3345F709 - - 40 36 4.10M 1.91M
media-6EA69111-A906-9B41-B8A9-33D457B225AF - - 41 35 4.44M 1.91M
mirror 613G 2.12T 4 77 141K 3.88M
media-FCAC5C92-96E6-C84B-A5CE-8ABA81176602 - - 1 38 79.5K 1.94M
media-4F980611-DE99-924D-9F5A-3FAB9FA8BDF5 - - 2 38 61.6K 1.94M
---------------------------------------------- ----- ----- ----- ----- ----- -----
capacity operations bandwidth
pool alloc free read write read write
---------------------------------------------- ----- ----- ----- ----- ----- -----
PlayPool 1.96T 3.49T 100 154 10.6M 10.6M
mirror 1.36T 1.37T 98 69 10.5M 4.15M
media-7D5A5263-F73A-C841-8F1D-16AA3345F709 - - 52 35 5.77M 2.08M
media-6EA69111-A906-9B41-B8A9-33D457B225AF - - 45 34 4.76M 2.08M
mirror 613G 2.12T 2 84 73.2K 6.41M
media-FCAC5C92-96E6-C84B-A5CE-8ABA81176602 - - 1 42 32.9K 3.21M
media-4F980611-DE99-924D-9F5A-3FAB9FA8BDF5 - - 1 42 40.4K 3.21M
---------------------------------------------- ----- ----- ----- ----- ----- -----
capacity operations bandwidth
pool alloc free read write read write
---------------------------------------------- ----- ----- ----- ----- ----- -----
PlayPool 1.96T 3.49T 130 131 14.2M 6.69M
mirror 1.36T 1.37T 128 53 14.2M 2.49M
media-7D5A5263-F73A-C841-8F1D-16AA3345F709 - - 63 26 7.14M 1.25M
media-6EA69111-A906-9B41-B8A9-33D457B225AF - - 64 26 7.05M 1.25M
mirror 613G 2.12T 1 78 35.0K 4.20M
media-FCAC5C92-96E6-C84B-A5CE-8ABA81176602 - - 1 38 5.39K 2.10M
media-4F980611-DE99-924D-9F5A-3FAB9FA8BDF5 - - 0 39 29.6K 2.10M
---------------------------------------------- ----- ----- ----- ----- ----- -----
Here's the current settings:
- Code: Select all
zfs get all PlayPool
NAME PROPERTY VALUE SOURCE
PlayPool type filesystem -
PlayPool creation Mon Jul 18 20:14 2016 -
PlayPool used 1.96T -
PlayPool available 3.32T -
PlayPool referenced 3.12M -
PlayPool compressratio 1.03x -
PlayPool mounted yes -
PlayPool quota none default
PlayPool reservation none default
PlayPool recordsize 128K default
PlayPool mountpoint /Volumes/PlayPool default
PlayPool sharenfs off default
PlayPool checksum on default
PlayPool compression lz4 local
PlayPool atime on local
PlayPool devices on default
PlayPool exec on default
PlayPool setuid on default
PlayPool readonly off default
PlayPool zoned off default
PlayPool snapdir hidden default
PlayPool aclmode passthrough default
PlayPool aclinherit restricted default
PlayPool canmount on default
PlayPool xattr on default
PlayPool copies 1 default
PlayPool version 5 -
PlayPool utf8only on -
PlayPool normalization formD -
PlayPool casesensitivity insensitive -
PlayPool vscan off default
PlayPool nbmand off default
PlayPool sharesmb off default
PlayPool refquota none default
PlayPool refreservation none default
PlayPool primarycache all default
PlayPool secondarycache all default
PlayPool usedbysnapshots 0 -
PlayPool usedbydataset 3.12M -
PlayPool usedbychildren 1.96T -
PlayPool usedbyrefreservation 0 -
PlayPool logbias latency default
PlayPool dedup off default
PlayPool mlslabel none default
PlayPool sync standard default
PlayPool refcompressratio 1.90x -
PlayPool written 3.12M -
PlayPool logicalused 2.03T -
PlayPool logicalreferenced 2.76M -
PlayPool filesystem_limit none default
PlayPool snapshot_limit none default
PlayPool filesystem_count none default
PlayPool snapshot_count none default
PlayPool snapdev hidden default
PlayPool com.apple.browse on default
PlayPool com.apple.ignoreowner off default
PlayPool com.apple.mimic_hfs off default
PlayPool shareafp off default
PlayPool redundant_metadata all default
PlayPool overlay off default
And the original creation command:
- Code: Select all
create -f -o ashift=12 -O casesensitivity=insensitive -O normalization=formD -O compression=lz4 PlayPool disk5
It's obviously been built up with additional disks quite a bit since then.
When I first boot the computer, it actually seems to run about as fast as the hardware will allow - but then it rapidly (~1min?) decays back to it's current state - averaging maybe 10M/s. (The scrub tells me it's averaging 4.42M/s)
Any ideas on what I should investigate to fix this?