Compression and beachballs... Configuration tips?

Here you can discuss every aspect of OpenZFS on OS X. Note: not for support requests!

Re: Compression and beachballs... Configuration tips?

Postby DanielSmedegaardBuus » Fri Aug 29, 2014 1:20 am

ilovezfs wrote:No it's a kernel extension. Are you making a suggestion?


Only if it were FUSE-based, then that might explain it, as the behavior is similar to ZFS-FUSE back in the days.

Is there anything else I need to do to get ARC changes to kick in? I've set it to 4GB, but something like an hour later, according to sysctl it's actually using less arc_meta than before I made the change ~400 MB vs ~1GB.
DanielSmedegaardBuus
 
Posts: 11
Joined: Thu Aug 28, 2014 11:00 pm

Re: Compression and beachballs... Configuration tips?

Postby DanielSmedegaardBuus » Fri Aug 29, 2014 1:33 am

DanielSmedegaardBuus wrote:Is there anything else I need to do to get ARC changes to kick in? I've set it to 4GB, but something like an hour later, according to sysctl it's actually using less arc_meta than before I made the change ~400 MB vs ~1GB.


Actually, it seems to have frozen. It seems to do this after a while of heavy I/O. Performance gets incrementally worse, and after a while, trying to query zpool or zfs commands will hang indefinitely, OS X file dialogs and Finder windows will block, and the only way to get a working system is to force-shutdown the laptop and restart. Hmmm... And console isn't revealing anything at all.
DanielSmedegaardBuus
 
Posts: 11
Joined: Thu Aug 28, 2014 11:00 pm

Re: Compression and beachballs... Configuration tips?

Postby DanielSmedegaardBuus » Fri Aug 29, 2014 1:56 am

Maybe this is all Yosemite-related...

Gonna use my Ubuntu machine for the time being and back up via ssh, then check back in once Yosemite is out of beta :)
DanielSmedegaardBuus
 
Posts: 11
Joined: Thu Aug 28, 2014 11:00 pm

Re: Compression and beachballs... Configuration tips?

Postby DanielSmedegaardBuus » Thu May 12, 2016 11:12 pm

It's funny — I just installed O3X on my new Capitan computer yesterday evening, created a dedupped, gzip-9 compressed pool on a similar 500 GB drive, then started copying to it. Fans started spinning like crazy, but it did progress.

After a little over an hour I checked on the progress (the fans had spun down by now), and it took me about a minute to fight through beachballs to get a df command run. It had copied 13 GB. It took me about five minutes to shut the computer down. Very unresponsive, lots of beachballing.

I then ran an Ubuntu live cd in a 4 GB virtual machine, and let it copy overnight inside that. A little shy of 300 GB completed by this morning, fully responsive system, fans never kicked in.

Something's really, really wrong with O3X...
DanielSmedegaardBuus
 
Posts: 11
Joined: Thu Aug 28, 2014 11:00 pm

Re: Compression and beachballs... Configuration tips?

Postby Brendon » Fri May 13, 2016 2:40 pm

Can I please ask that you provide a lot more information regarding your configuration, hardware, software and what you were attempting to copy...from what to where. If I have similar gear I will attempt to reproduce whatever it is that you're doing.

- Brendon
Brendon
 
Posts: 277
Joined: Thu Mar 06, 2014 12:51 pm

Re: Compression and beachballs... Configuration tips?

Postby Brendon » Fri May 13, 2016 3:37 pm

For what its worth. Running in a VM on a 2011 macbook pro , 2 CPUs, 2GB of RAM allocated to VM. 2.2 GHz Intel Core i7. This is not a configuration I'd recommend. Compressed deduplication, your mileage may vary, to quote Lundman "Friends don't let friends dedup".

Create Pool (disk0...3 are all 20G virtual disks hosted on a single SSD):

Code: Select all
sudo zpool create  -f -o ashift=12 -O compression=lz4 -O dedup=on -O casesensitivity=insensitive -O normalization=formD tank mirror disk1 disk2 disk3


Transfer a large app from /Applications to tank (Xcode.app):

Code: Select all
sudo time rsync -rv Xcode.app /Volumes/tank/

... copying ...

sent 10521231341 bytes  received 9286148 bytes  7117619.12 bytes/sec
total size is 10488497050  speedup is 1.00
     1478.67 real        78.00 user       568.56 sys


Thats a 20 minute copy, ~10G @7 MB/sec. Final state of the pool. Was browsing the web a little in the VM. Machine felt busy.

Code: Select all
big-vm-mac-imac:tank zfs-tests$ zfs get used tank
NAME  PROPERTY  VALUE  SOURCE
tank  used      8.02G  -


Export the tank:

Code: Select all
sudo time zpool export tank
Running process: '/usr/sbin/diskutil' 'unmount' '/Volumes/tank'
Unmount failed for /Volumes/tank
cannot unmount '/Volumes/tank': umount failed
        0.44 real         0.01 user         0.02 sys


Shutdown VM ... took 15-20 seconds I guess.

EDIT: A few more configurations and performance measurements...

No deuplication, but retain silly mirror.

Code: Select all
big-vm-mac-imac:Applications zfs-tests$ sudo zpool create  -f -o ashift=12 -O compression=lz4 -O casesensitivity=insensitive -O normalization=formD tank mirror disk1 disk2 disk3

sent 10521231341 bytes  received 9286148 bytes  7932593.21 bytes/sec
total size is 10488497050  speedup is 1.00
     1326.44 real        79.26 user       582.01 sys


Single disk, no dedup.

Code: Select all
sudo zpool create  -f -o ashift=12 -O compression=lz4 -O casesensitivity=insensitive -O normalization=formD tank disk1

sent 10521231341 bytes  received 9286148 bytes  14220820.38 bytes/sec
total size is 10488497050  speedup is 1.00
      739.41 real        76.07 user       513.08 sys


Single disk, dedup, 19% slower than the no dedup configuration.

Code: Select all
sudo zpool create  -f -o ashift=12 -O compression=lz4 -O dedup=on -O casesensitivity=insensitive -O normalization=formD tank disk1

sent 10521231341 bytes  received 9286148 bytes  11616676.77 bytes/sec
total size is 10488497050  speedup is 1.00
      905.94 real        78.46 user       533.19 sys
Brendon
 
Posts: 277
Joined: Thu Mar 06, 2014 12:51 pm

Previous

Return to General Discussions

Who is online

Users browsing this forum: No registered users and 1 guest

cron