Expected performance?

Here you can discuss every aspect of OpenZFS on OS X. Note: not for support requests!

Expected performance?

Postby trevize » Fri May 23, 2014 2:02 pm

Greetings all. I'm new to OpenZFS but not at all new to ZFS. I've been using ZFS on Solaris since Sun released it's first betas.

Anyway. Curious what people are getting on their Macs for pool performance. I'm running on a MacPro 3,1 as my home server.

# zpool iostat -v 5 5
capacity operations bandwidth
pool alloc free read write read write
------------ ----- ----- ----- ----- ----- -----
snarfsrv1 687G 21.2T 2 1.05K 155K 128M
raidz1 687G 21.2T 2 1.05K 155K 128M
disk3s2 - - 0 292 7.49K 18.2M
disk4s2 - - 1 295 18.5K 18.3M
disk5s2 - - 1 287 22.2K 17.9M
disk6s2 - - 1 307 22.1K 19.0M
disk7s2 - - 1 310 22.6K 19.2M
disk8s2 - - 0 303 18.0K 18.9M
disk9s2 - - 1 312 22.1K 19.5M
disk10s2 - - 1 300 22.0K 18.6M
------------ ----- ----- ----- ----- ----- -----
snarfsrv2 68.4G 7.21T 0 0 0 0
raidz1 68.4G 7.21T 0 0 0 0
disk12s2 - - 0 0 0 0
disk13s2 - - 0 0 0 0
disk15s2 - - 0 0 0 0
disk14s2 - - 0 0 0 0
------------ ----- ----- ----- ----- ----- -----


capacity operations bandwidth
pool alloc free read write read write
------------ ----- ----- ----- ----- ----- -----
snarfsrv1 689G 21.2T 1 4.69K 9.80K 132M
raidz1 689G 21.2T 1 4.69K 9.80K 132M
disk3s2 - - 1 656 1.80K 19.1M
disk4s2 - - 0 654 1.20K 19.1M
disk5s2 - - 0 663 1.30K 19.4M
disk6s2 - - 1 638 1.50K 18.3M
disk7s2 - - 0 641 1.20K 17.9M
disk8s2 - - 0 620 1023 17.8M
disk9s2 - - 1 640 1.60K 18.1M
disk10s2 - - 1 633 1.40K 18.3M
------------ ----- ----- ----- ----- ----- -----
snarfsrv2 68.4G 7.21T 0 105 76.8K 8.63M
raidz1 68.4G 7.21T 0 105 76.8K 8.63M
disk12s2 - - 0 56 17.0K 2.89M
disk13s2 - - 0 57 25.6K 2.89M
disk15s2 - - 0 57 8.50K 2.89M
disk14s2 - - 0 56 25.7K 2.89M
------------ ----- ----- ----- ----- ----- -----

capacity operations bandwidth
pool alloc free read write read write
------------ ----- ----- ----- ----- ----- -----
snarfsrv1 684G 21.2T 0 1.28K 0 152M
raidz1 684G 21.2T 0 1.28K 0 152M
disk3s2 - - 0 585 0 22.2M
disk4s2 - - 0 581 0 22.0M
disk5s2 - - 0 582 0 22.2M
disk6s2 - - 0 596 0 22.4M
disk7s2 - - 0 596 0 22.4M
disk8s2 - - 0 595 0 22.4M
disk9s2 - - 0 595 0 22.4M
disk10s2 - - 0 578 0 22.0M
------------ ----- ----- ----- ----- ----- -----
snarfsrv2 68.1G 7.21T 0 0 0 0
raidz1 68.1G 7.21T 0 0 0 0
disk12s2 - - 0 0 0 0
disk13s2 - - 0 0 0 0
disk15s2 - - 0 0 0 0
disk14s2 - - 0 0 0 0
------------ ----- ----- ----- ----- ----- -----
trevize
 
Posts: 3
Joined: Fri May 23, 2014 1:54 pm

Re: Expected performance?

Postby Brendon » Fri May 23, 2014 3:20 pm

Hi trevize

You don't say much about your hardware, particularly RAM and disk configuration.

There are people here getting anywhere between 20 MB/sec (USB 2) all the way unto 800 MB/Sec multiple ESATA ports, lots of drives.

Personally my 5 disk raidz2 thunderbolt peaks at about 500 MB/Sec.

Cheers
Brendon

trevize wrote:Greetings all. I'm new to OpenZFS but not at all new to ZFS. I've been using ZFS on Solaris since Sun released it's first betas.

Anyway. Curious what people are getting on their Macs for pool performance. I'm running on a MacPro 3,1 as my home server.

# zpool iostat -v 5 5
capacity operations bandwidth
pool alloc free read write read write
------------ ----- ----- ----- ----- ----- -----
snarfsrv1 687G 21.2T 2 1.05K 155K 128M
raidz1 687G 21.2T 2 1.05K 155K 128M
disk3s2 - - 0 292 7.49K 18.2M
disk4s2 - - 1 295 18.5K 18.3M
disk5s2 - - 1 287 22.2K 17.9M
disk6s2 - - 1 307 22.1K 19.0M
disk7s2 - - 1 310 22.6K 19.2M
disk8s2 - - 0 303 18.0K 18.9M
disk9s2 - - 1 312 22.1K 19.5M
disk10s2 - - 1 300 22.0K 18.6M
------------ ----- ----- ----- ----- ----- -----
snarfsrv2 68.4G 7.21T 0 0 0 0
raidz1 68.4G 7.21T 0 0 0 0
disk12s2 - - 0 0 0 0
disk13s2 - - 0 0 0 0
disk15s2 - - 0 0 0 0
disk14s2 - - 0 0 0 0
------------ ----- ----- ----- ----- ----- -----


capacity operations bandwidth
pool alloc free read write read write
------------ ----- ----- ----- ----- ----- -----
snarfsrv1 689G 21.2T 1 4.69K 9.80K 132M
raidz1 689G 21.2T 1 4.69K 9.80K 132M
disk3s2 - - 1 656 1.80K 19.1M
disk4s2 - - 0 654 1.20K 19.1M
disk5s2 - - 0 663 1.30K 19.4M
disk6s2 - - 1 638 1.50K 18.3M
disk7s2 - - 0 641 1.20K 17.9M
disk8s2 - - 0 620 1023 17.8M
disk9s2 - - 1 640 1.60K 18.1M
disk10s2 - - 1 633 1.40K 18.3M
------------ ----- ----- ----- ----- ----- -----
snarfsrv2 68.4G 7.21T 0 105 76.8K 8.63M
raidz1 68.4G 7.21T 0 105 76.8K 8.63M
disk12s2 - - 0 56 17.0K 2.89M
disk13s2 - - 0 57 25.6K 2.89M
disk15s2 - - 0 57 8.50K 2.89M
disk14s2 - - 0 56 25.7K 2.89M
------------ ----- ----- ----- ----- ----- -----

capacity operations bandwidth
pool alloc free read write read write
------------ ----- ----- ----- ----- ----- -----
snarfsrv1 684G 21.2T 0 1.28K 0 152M
raidz1 684G 21.2T 0 1.28K 0 152M
disk3s2 - - 0 585 0 22.2M
disk4s2 - - 0 581 0 22.0M
disk5s2 - - 0 582 0 22.2M
disk6s2 - - 0 596 0 22.4M
disk7s2 - - 0 596 0 22.4M
disk8s2 - - 0 595 0 22.4M
disk9s2 - - 0 595 0 22.4M
disk10s2 - - 0 578 0 22.0M
------------ ----- ----- ----- ----- ----- -----
snarfsrv2 68.1G 7.21T 0 0 0 0
raidz1 68.1G 7.21T 0 0 0 0
disk12s2 - - 0 0 0 0
disk13s2 - - 0 0 0 0
disk15s2 - - 0 0 0 0
disk14s2 - - 0 0 0 0
------------ ----- ----- ----- ----- ----- -----
Brendon
 
Posts: 286
Joined: Thu Mar 06, 2014 12:51 pm

Re: Expected performance?

Postby trevize » Fri May 23, 2014 5:34 pm

MacPro 2008 3,1
16GB ram
8x 3TB drives
4x 2TB drivers

The 8x 3TB drives are zpool snarfsrv1 on a highpoint 642L Sata3 controller. The 4x 2TB are on another 642L sata3 controller.

The 3TB drives are WD SAN drives 5400RPM. The 2TB are a mix of Seagate, Hitachi and Western Digital 7200RPM drives.

My "important" stuff is on the 3TB drives as they are the most stable and are all exactly the same type of drives.


Basically I am just interested in other people's configs and performance stats.
trevize
 
Posts: 3
Joined: Fri May 23, 2014 1:54 pm

Re: Expected performance?

Postby Brendon » Fri May 23, 2014 6:59 pm

Are you running version 1.2.7?

Brendon

trevize wrote:MacPro 2008 3,1
16GB ram
8x 3TB drives
4x 2TB drivers

The 8x 3TB drives are zpool snarfsrv1 on a highpoint 642L Sata3 controller. The 4x 2TB are on another 642L sata3 controller.

The 3TB drives are WD SAN drives 5400RPM. The 2TB are a mix of Seagate, Hitachi and Western Digital 7200RPM drives.

My "important" stuff is on the 3TB drives as they are the most stable and are all exactly the same type of drives.


Basically I am just interested in other people's configs and performance stats.
Brendon
 
Posts: 286
Joined: Thu Mar 06, 2014 12:51 pm

Re: Expected performance?

Postby trevize » Sat May 24, 2014 5:52 am

Brendon wrote:Are you running version 1.2.7?

Brendon




yes
trevize
 
Posts: 3
Joined: Fri May 23, 2014 1:54 pm

Re: Expected performance?

Postby roemer » Tue May 27, 2014 1:59 pm

Brendon wrote:Personally my 5 disk raidz2 thunderbolt peaks at about 500 MB/Sec.


Just curious: With what kind of drives (SSDs or HDDs (slow/fast?)) do you get those speeds on raidz2? And what enclosure(s) are you using?
roemer
 
Posts: 73
Joined: Sat Mar 15, 2014 2:32 pm

Re: Expected performance?

Postby Brendon » Tue May 27, 2014 4:37 pm

Roemer,

Nothing special - its a Lacie 5Big 10GB Thunderbolt. No Cache devices.

I need to stress that is peek performance - copying large files from point A to point B for example. All HDD based systems are massively impacted by IOPS limits etc, so if you're manipulating small files performance will drop significantly.

Cheers
Brendon

roemer wrote:
Brendon wrote:Personally my 5 disk raidz2 thunderbolt peaks at about 500 MB/Sec.


Just curious: With what kind of drives (SSDs or HDDs (slow/fast?)) do you get those speeds on raidz2? And what enclosure(s) are you using?
Brendon
 
Posts: 286
Joined: Thu Mar 06, 2014 12:51 pm


Return to General Discussions

Who is online

Users browsing this forum: No registered users and 7 guests