Maybe relevant: before removing the multi-gigabyte files (before the most recent snapshots), I changed the snapdir property value –
– and almost certainly did so whilst the file system was mounted.
(Why hide it? So that Disk Inventory X could give me a good view of the volume without traversing snapshots.)
Today I reverted to visible for the snapdir, then exported and imported but still there's not the expected mass in any recent snapshot:
- Code: Select all
macbookpro08-centrim:~ gjp22$ zfs get snapdir zhandy
NAME PROPERTY VALUE SOURCE
zhandy snapdir hidden local
macbookpro08-centrim:~ gjp22$ zfs set snapdir=visible zhandy
macbookpro08-centrim:~ gjp22$ zfs list -t snapshot | grep "Gi -" | grep zhandy
macbookpro08-centrim:~ gjp22$ zpool export zhandy
macbookpro08-centrim:~ gjp22$ sudo tail -n 50 /private/var/log/system.log | grep zhandy
Password:
Mar 28 08:00:28 macbookpro08-centrim kernel[0]: zfsx_unmount: '/Volumes/zhandy' (umount)
Mar 28 08:00:28 macbookpro08-centrim kernel[0]: zfsvfs_teardown: '/Volumes/zhandy' (txg_wait_synced in 113 ms)
Mar 28 08:00:34 macbookpro08-centrim kernel[0]: ZFSLabelScheme:willTerminate: this 0xffffff802dca4200 provider 0xffffff80291e4300 'zfs vdev for 'zhandy''
Mar 28 08:00:34 macbookpro08-centrim kernel[0]: ZFSLabelScheme:stop: 0xffffff802dca4200 goodbye 'zfs vdev for 'zhandy''
Mar 28 08:00:42 macbookpro08-centrim kernel[0]: ZFSLabelScheme:probe: label 'zhandy', vdev 2173720822411009046
Mar 28 08:00:42 macbookpro08-centrim kernel[0]: ZFSLabelScheme:start: 'zhandy' critical mass with 1 vdev(s) (importing)
Mar 28 08:00:42 macbookpro08-centrim kernel[0]: zfsx_kev_importpool:'zhandy' (8649809893956376149)
Mar 28 08:00:44 macbookpro08-centrim kernel[0]: zfsx_vdm_open: 'zhandy' disk5s2
Mar 28 08:00:44 macbookpro08-centrim kernel[0]: zfsx_mount: '/Volumes/zhandy'
macbookpro08-centrim:~ gjp22$ zfs list -t snapshot | grep "Gi -" | grep zhandy
A comprehensive view of file system snapdir property values throughout the life of the pool:
- Code: Select all
macbookpro08-centrim:~ gjp22$ zpool history zhandy | grep snapdir
2012-12-06.18:00:52 zpool create -o ashift=12 -O casesensitivity=insensitive -O normalization=formD -O atime=off -O snapdir=visible -O compression=gzip-9 zhandy /dev/disk2
2012-12-07.20:23:24 zfs create -o casesensitivity=insensitive -o normalization=formD -o atime=off -o snapdir=visible -o compression=gzip-9 zhandy/Pocket Time Machine
2012-12-08.16:34:14 zfs create -o casesensitivity=insensitive -o normalization=formD -o atime=off -o snapdir=visible -o compression=gzip-9 zhandy/Pocket Time Machine
2013-03-26.19:44:50 zfs set snapdir=hidden zhandy
2013-03-28.07:59:59 zfs set snapdir=visible zhandy
Browsing the list of snapshots, then opening one in Finder:
- Code: Select all
macbookpro08-centrim:~ gjp22$ cd /Volumes/zhandy/.zfs
macbookpro08-centrim:.zfs gjp22$ ls -al
total 48
dr-xr-xr-x 3 root admin 3 6 Dec 18:00 .
drwxrwxr-x+ 20 gjp22 admin 25 27 Mar 11:56 ..
dr-xr-xr-x 38 root admin 38 28 Mar 08:00 snapshot
macbookpro08-centrim:.zfs gjp22$ cd snapshot
macbookpro08-centrim:snapshot gjp22$ ls -hl
total 0
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-12-224158
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-13-003952
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-13-092155
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-13-102154
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-17-072706
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-17-082706
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-17-092706
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-17-102706
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-19-022206
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-19-032206
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-19-075930
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-19-102926
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-19-112927
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-19-122927
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-19-134210
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-20-075025
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-20-085024
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-20-095024
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-20-105024
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-20-115024
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-20-180101
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-23-191414
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-23-195116
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-23-204418
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-24-115609
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-25-113051
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-25-123050
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-25-133050
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-25-143050
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-25-153049
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-25-163049
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-26-065933
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-26-175344
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-27-020918
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-27-060937
dr-xr-xr-x 2 root admin 2B 28 Mar 08:00 2013-03-27-062020
macbookpro08-centrim:snapshot gjp22$ open 2013-03-27-060937
macbookpro08-centrim:snapshot gjp22$ clear
Focusing on the directory (and subdirectories) from which I removed the multi-gigabyte files:
2013-03-27-060937, 96G in the VirtualBox directory- Code: Select all
macbookpro08-centrim:snapshot gjp22$ sudo du -hs /Volumes/zhandy/.zfs/snapshot/2013-03-27-060937/Users/gjp22/Library/VirtualBox
96G /Volumes/zhandy/.zfs/snapshot/2013-03-27-060937/Users/gjp22/Library/VirtualBox
Back one step on the timeline, opening the previous snapshot in Finder:
- Code: Select all
macbookpro08-centrim:snapshot gjp22$ open 2013-03-27-020918
macbookpro08-centrim:snapshot gjp22$ clear
2013-03-27-020918, 128G in the VirtualBox directory- Code: Select all
macbookpro08-centrim:snapshot gjp22$ sudo du -hs /Volumes/zhandy/.zfs/snapshot/2013-03-27-020918/Users/gjp22/Library/VirtualBox
128G /Volumes/zhandy/.zfs/snapshot/2013-03-27-020918/Users/gjp22/Library/VirtualBox
There we have it:
– but
nothing like that 32 amongst the snapshots for the day:
- Code: Select all
macbookpro08-centrim:~ gjp22$ zfs list -t snapshot | grep zhandy@2013-03-27
zhandy@2013-03-27-020918 177Mi - 439Gi -
zhandy@2013-03-27-060937 408Ki - 408Gi -
zhandy@2013-03-27-062020 440Ki - 408Gi -
A current DiskInventory X view of the VirtualBox directoryThe ~311 GB is curious, especially as the view is not of the root of the file system (and so, should not encounter snapdir stuff). However it's a relatively old app, circa 2006, so I might not expect it to work perfectly in a ZFS environment.
An error-free scrub on 2013-03-25- Code: Select all
macbookpro08-centrim:~ gjp22$ sudo zpool status -v zhandy
pool: zhandy
state: ONLINE
scan: scrub repaired 0 in 13h20m with 0 errors on Mon Mar 25 11:45:50 2013
config:
NAME STATE READ WRITE CKSUM
zhandy ONLINE 0 0 0
GPTE_A54431D5-B46F-44A9-83B4-76802A584C6E ONLINE 0 0 0 at disk2s2
errors: No known data errors
– and I'm almost certain that I have never seen an error for this pool.
----
I'm tempted to scrub … but as this pool is puzzling/worrying me, I have decided to stop all automated scrubs until things are understandable.
Note to self:
- Code: Select all
macbookpro08-centrim:~ gjp22$ date
Thu 28 Mar 2013 10:34:44 GMT
macbookpro08-centrim:~ gjp22$ sudo launchctl list | grep scrub
- 0 com.getgreenbytes.zfs.autopoolscrubs
- 0 com.getgreenbytes.zevo.forum.satadru.zpadmin-scrub
macbookpro08-centrim:~ gjp22$ defaults read /Library/LaunchDaemons/com.getgreenbytes.zevo.forum.satadru.zpadmin-scrub
{
Label = "com.getgreenbytes.zevo.forum.satadru.zpadmin-scrub";
ProgramArguments = (
"/opt/local/bin/com.getgreenbytes.zevo.forum.satadru.zpadmin.pl",
"-scrub"
);
StartCalendarInterval = {
Hour = 10;
Minute = 0;
Weekday = 1;
};
StartOnMount = 0;
}
macbookpro08-centrim:~ gjp22$ sudo launchctl unload -w /Library/LaunchDaemons/com.getgreenbytes.zevo.forum.satadru.zpadmin-scrub.plist
macbookpro08-centrim:~ gjp22$ defaults read /System/Library/Filesystems/zfs.fs/Contents/Resources/launchd/zfs_autopoolscrubs-weekly
{
EnvironmentVariables = {
"COM_GETGREENBYTES_ZFS_NOLOAD" = 1;
};
KeepAlive = 0;
Label = "com.getgreenbytes.zfs.autopoolscrubs";
ProgramArguments = (
"/System/Library/Filesystems/zfs.fs/Contents/Resources/bin/zpool",
scrub,
automatic
);
RunAtLoad = 0;
StandardOutPath = "/dev/null";
StartInterval = 604800;
}
macbookpro08-centrim:~ gjp22$ sudo launchctl unload -w /System/Library/Filesystems/zfs.fs/Contents/Resources/launchd/zfs_autopoolscrubs-weekly.plist
macbookpro08-centrim:~ gjp22$ sudo launchctl list | grep scrub
macbookpro08-centrim:~ gjp22$