ZFS incompatibility with iCloud, Dropbox

Moderators: jhartley, MSR734, nola

ZFS incompatibility with iCloud, Dropbox

Post by jollyjinx » Wed Feb 13, 2013 9:02 am

I'm using ZFS as homedirectory. I was looking at my CPU stats and thought that Dropbox and ubd ( icloud daemon) were creating some CPU load. I've asked a couple of friends (using HFS+) to give me their stats and it seems that on their machines neither Dropbox nor ubd are creating any cpu load.

Anybody else experiencing this problem ?

Jolly aka Patrick
jollyjinx Offline


 
Posts: 60
Joined: Sun Sep 16, 2012 12:40 pm
Location: Munich - Germany

More details please

Post by grahamperrin » Wed Feb 13, 2013 5:07 pm

Which version and build of the OS?

Et cetera – thanks.
grahamperrin Offline

User avatar
 
Posts: 1596
Joined: Fri Sep 14, 2012 10:21 pm
Location: Brighton and Hove, United Kingdom

Re: ZFS incompatibility with iCloud, Dropbox

Post by jollyjinx » Wed Feb 13, 2013 6:00 pm

10.8.2 with current updates.
Zevo 1.1.1
Dropbox 1.6.16

I tired Dropbox 1.7.3 ( current beta today but that was even worse ).

I don't think it's related to Dropbox but something those programs use to check for changes ( fsevents ? ). I've even recreated all Spotlight indexes on all zfs datasets as well as removed .fsevents directories and let them automatically recreate after reboot. Still behaves the same.
jollyjinx Offline


 
Posts: 60
Joined: Sun Sep 16, 2012 12:40 pm
Location: Munich - Germany

No problem with FSEvents, ubd or Dropbox with ZEVO

Post by grahamperrin » Wed Feb 13, 2013 9:44 pm

I use the same version of ZEVO on Mountain Lion for my home directory
~
without any problems. Neither the ubiquity daemon nor Dropbox uses excessive CPU, and I can't sense any problem around FSEvents with ZEVO.

Is your Dropbox the default
~/Dropbox
and free from aliases or symlinks to other paths?

Is your use of Mobile Documents normal, are all your apps' uses of iCloud trustworthy?

What's shown in ubiquity.log and other ubd-releated log files? In system.log?

Is there a reason for including ubd and Dropbox in the same topic; does ubd activity appear wrong only when Dropbox runs?
grahamperrin Offline

User avatar
 
Posts: 1596
Joined: Fri Sep 14, 2012 10:21 pm
Location: Brighton and Hove, United Kingdom

Re: ZFS incompatibility with iCloud, Dropbox

Post by jollyjinx » Fri Feb 15, 2013 4:26 am

Well for some reason the 'All Messages' log does not show the contents for the ubiquity.log in Console.app.
Ubiquity log file is filling up like crazy.

I've disabled iCloud - word of advice never do that. You will never know what you are missing.
removed the then old ~/Library/Mobile Documents.## folder.
I've danced the 'Repair Permissions' dance,
Rebooted and
resetup iCloud.

After the inital sync everything was fine - even with the Dropbox daemon which I don't understand why it should have something to do with iCloud , but anyways.

I rebooted and logged back in and it ubd is using up CPU again.

Workaround:
I've disabled iCloud.
I've renabled it.
High CPU for the inital sync.
Fine after that.
Never reboot again.



Messages that fill up the ubiquity log, attached are a few examples:

Code: Select all
[warn]        fac0604119 [13/02/15 09:30:34.954] {3B228A41} 500.fsevents update_item_unsafe:2763 unlocked! fields (file-id) of item i:0x0018000000001ec4 c:0x0002000000002ef7 rk:413 p:0x0018000000001e97 r:0x0002000000000100 pkg:0x0018000000001e93 o:0x0016 le:0x0016000000001291 n:"tile_blackboard_red.jpg" s:(not-live-yet|staged|in-pkg|in-cloud) f:1610583 z:37568 mt:1349965346 md:0644/-rw-r--r-- ck:01f32d6d9dbb8b9423fec2a922cdfe2bb42f919f39 
[warn]       23656763f6a [13/02/15 09:53:10.366] {3B228A41} 500.fsevents update_item_unsafe:2763 unlocked! fields (file-id) of item i:0x00160000000002b7 c:0x000200000000357c rk:980 p:0x00160000000002ac r:0x0002000000000100 pkg:0x00160000000002ac o:0x0016 le:0x001b0000000002c4 n:"preview-micro.jpg" s:(not-live-yet|staged|in-pkg|in-cloud) f:1619924 z:5832 mt:1359974461 md:0644/-rw-r--r-- ck:0100d998c16628d702088b1552bdf261b3b8705f8a 
[warn]       2365695df99 [13/02/15 09:53:10.368] {3B228A41} 500.fsevents update_item_unsafe:2763 unlocked! fields (file-id) of item i:0x00160000000002b6 c:0x0002000000003582 rk:981 p:0x00160000000002ac r:0x0002000000000100 pkg:0x00160000000002ac o:0x0016 le:0x001b0000000002c3 n:"preview-web.jpg" s:(not-live-yet|staged|in-pkg|in-cloud) f:1619921 z:24137 mt:1359974461 md:0644/-rw-r--r-- ck:01f8e54b92b672f8b2ec5e3b10e773cd81f63423d4 
[warn]       23656b81d0d [13/02/15 09:53:10.370] {3B228A41} 500.fsevents update_item_unsafe:2763 unlocked! fields (state) of item i:0x00160000000002b7 c:0x000200000000357c rk:980 p:0x00160000000002ac r:0x0002000000000100 pkg:0x00160000000002ac o:0x0016 le:0x001b0000000002c4 n:"preview-micro.jpg" s:(in-pkg|in-cloud) f:1619924 z:5832 mt:1359974461 md:0644/-rw-r--r-- ck:0100d998c16628d702088b1552bdf261b3b8705f8a  orig-s:(not-live-yet|staged|in-pkg|in-cloud)



[ERROR]      237e9ed9cd6 [13/02/15 09:53:17.135] {3B228A41} 500.fsevents update_volume_status:177 could not get volume status for /Local/Users/jolly/Library/Application Support/Ubiquity/peer-3B228A41-ECAD-1EDB-839D-A30E45CA46F5-v23 (Inappropriate ioctl for device)
[ERROR]      237e9eede82 [13/02/15 09:53:17.135] {3B228A41} 500.fsevents update_volume_status:177 could not get volume status for /Local/Users/jolly/Library/Mobile Documents/ (Inappropriate ioctl for device)
[ERROR]      23ee749b959 [13/02/15 09:53:47.155] {3B228A41} 500.fsevents update_volume_status:177 could not get volume status for /Local/Users/jolly/Library/Application Support/Ubiquity/peer-3B228A41-ECAD-1EDB-839D-A30E45CA46F5-v23 (Inappropriate ioctl for device)


[ERROR]       fac088dd79 [13/02/15 09:30:34.957] {3B228A41} 500.fsevents gen_store_for_item_id:130 failed to open generational storage for file with url "file://localhost/Local/Users/jolly/Library/Mobile%20Documents/com~apple~Keynote/Documents/Fusion%20drive.key-tef"; error 5
[ERROR]       fac089a6bd [13/02/15 09:30:34.957] {3B228A41} 500.fsevents put_file_in_gen_store:409 failed to get genstore for item id 0x001a000000000193
[ERROR]       fac08a594f [13/02/15 09:30:34.957] {3B228A41} 500.fsevents make_pkg_live:628 failed to copy pkg 0x0018000000001e93 (original 0x001a000000000193) from stage "/Local/Users/jolly/Library/Mobile Documents/.ubd/peer-3B228A41-ECAD-1EDB-839D-A30E45CA46F5-v23/ftr/pkg-0x0018000000001e93" to gen store
[ERROR]       fac08b06be [13/02/15 09:30:34.957] {3B228A41} 500.fsevents make_generations_live:3595 failed to make pkg 0x001a000000000193 live
[warn]        fac9786546 [13/02/15 09:30:35.106] {3B228A41} 500.client-{57B2726E}-186 update_item_unsafe:2763 unlocked! fields (state) of item i:0x0016000000001250 c:0x0002000000002a9d rk:242 p:0x001600000000124f r:0x0002000000000100 pkg:0x001600000000124a o:0x0019 le:0x00190000000003cb n:"Gradient_BACKGROUND.jpg" s:(not-live-yet|staged|in-pkg|in-cloud) f:1610362 z:50741 mt:1352396119 md:0644/-rw-r--r-- ck:01bcece837dbc57a341f2bf6e894b804aa5ae87a1c  orig-s:(not-live-yet|in-pkg|needs-ftr|in-cloud|force-fetch)
[warn]        faca58e09d [13/02/15 09:30:35.121] {3B228A41} 500.client-{57B2726E}-186 update_item_unsafe:2763 unlocked! fields (state) of item i:0x0016000000001251 c:0x0002000000002a9e rk:243 p:0x001600000000124f r:0x0002000000000100 pkg:0x001600000000124a o:0x0019 le:0x00190000000003cb n:"Screen Shot 2012-11-08 at 17.24.37 .tiff" s:(not-live-yet|staged|in-pkg|in-cloud) f:1610366 z:3806810 mt:1352396119 md:0644/-rw-r--r-- ck:01672e902244adcb2c66fa6051558c721bcc66a9e8  orig-s:(not-live-yet|in-pkg|needs-ftr|in-cloud|force-fetch)


[ERROR]       fafb56d6f7 [13/02/15 09:30:35.943] {3B228A41} 500.mmcs get_fd_for_item_with_error:1205 failed to open 0x001600000000124d at '/.vol/16777230/1610382', owned by 0x0019 (No such file or directory)
[ERROR]       fafb57ca06 [13/02/15 09:30:35.943] {3B228A41} 500.mmcs get_fd_for_item_with_error:1213 Couldn't find fd for item 0x001600000000124d at path "/.vol/16777230/1610382"
[ERROR]       fafb5c79e6 [13/02/15 09:30:35.943] {3B228A41} 500.mmcs get_fd_for_item_with_error:1205 failed to open 0x001600000000124e at '/.vol/16777230/1610383', owned by 0x0019 (No such file or directory)
[ERROR]       fafb5cf3ae [13/02/15 09:30:35.944] {3B228A41} 500.mmcs get_fd_for_item_with_error:1213 Couldn't find fd for item 0x001600000000124e at path "/.vol/16777230/1610383"
jollyjinx Offline


 
Posts: 60
Joined: Sun Sep 16, 2012 12:40 pm
Location: Munich - Germany

Re: ZFS incompatibility with iCloud, Dropbox

Post by mk01 » Fri Feb 15, 2013 3:13 pm

there are general issues with ubd process (high cpu usage), but they should not be related to zevo.

try google and focus on those with ubd and peer certificates.
mk01 Offline


 
Posts: 65
Joined: Mon Sep 17, 2012 1:16 am

Re: ZFS incompatibility with iCloud, Dropbox

Post by jollyjinx » Wed Feb 20, 2013 12:42 pm

I've tried a couple of things, disabling and renabling iCloud , with certificates removed inbetween and a reboot.
Nothing helped.

Then I've created a new user on a HFS+ partition, logged in , setup the same icloud account with that user. After removing then that user and reloogin in to my original zfs account ubd no longer uses much cpu, nor are the logs getting very fast large.

ubd does still log the following however:
Code: Select all

[ERROR]      746d009e5f8 [13/02/20 18:30:33.085] {0B1EB14F} 2702.fsevents update_volume_status:177 could not get volume status for /Local/Users/jolly/Library/Application Support/Ubiquity/peer-0B1EB14F-95A1-326D-878E-36E40032C76F-v23 (Inappropriate ioctl for device)
[ERROR]      746d00c6d76 [13/02/20 18:30:33.086] {0B1EB14F} 2702.fsevents update_volume_status:177 could not get volume status for /Local/Users/jolly/Library/Mobile Documents/ (Inappropriate ioctl for device)
[ERROR]      74dcf9688f9 [13/02/20 18:31:03.142] {0B1EB14F} 2702.fsevents update_volume_status:177 could not get volume status for /Local/Users/jolly/Library/Application Support/Ubiquity/peer-0B1EB14F-95A1-326D-878E-36E40032C76F-v23 (Inappropriate ioctl for device)



Maybe ubd does not expect to have root, the Users home and Users Library on different filesystems ?
jollyjinx Offline


 
Posts: 60
Joined: Sun Sep 16, 2012 12:40 pm
Location: Munich - Germany

Re: ZFS incompatibility with iCloud, Dropbox

Post by jollyjinx » Wed Feb 20, 2013 1:07 pm

I've dug a bit deeper with fs_usage.

So ubd is doing the following:

Code: Select all
18:55:07.821009  fsctl                  [ 25]           /Local/Users/jolly/Library/Application Support/Ubiquity/peer-0B1EB14F-95A1-326D-878E-36E40032C76F-v23                                                                 0.000014   ubd.14095
18:55:07.821082  stat64                                 /Local/Users/jolly/Library/Logs/Ubiquity/jolly/ubiquity.log                                                                                                           0.000050   ubd.14095
18:55:07.821194  write             F=7    B=0x10a                                                                                                                                                                             0.000110   ubd.14095
18:55:07.821199  fsctl                  [ 25]           /Local/Users/jolly/Library/Mobile Documents                                                                                                                           0.000004   ubd.14095
18:55:07.821208  stat64                                 /Local/Users/jolly/Library/Logs/Ubiquity/jolly/ubiquity.log                                                                                                           0.000004   ubd.14095
18:55:07.821235  write             F=7    B=0xd1                                                                                                                                                                              0.000027   ubd.14095
18:55:07.821243  sendto            F=13   B=0x1                                                                                                                                                                               0.000006   ubd.14095
18:55:07.821253  select                   S=1                                                                                                                                                                                 0.000271 W ubd.14096
18:55:07.821258  recvfrom          F=14   B=0x1                                                                                                                                                                               0.000004   ubd.14096



which results in the following log entry:

Code: Select all
[ERROR]      89e42f2410c [13/02/20 18:55:08.146] {0B1EB14F} 2702.fsevents update_volume_status:177 could not get volume status for /Local/Users/jolly/Library/Application Support/Ubiquity/peer-0B1EB14F-95A1-326D-878E-36E40032C76F-v23 (Inappropriate ioctl for device)
[ERROR]      89e42f4eebd [13/02/20 18:55:08.146] {0B1EB14F} 2702.fsevents update_volume_status:177 could not get volume status for /Local/Users/jolly/Library/Mobile Documents/ (Inappropriate ioctl for device)



looking up errno.h you will see:

#define ENOTTY 25 /* Inappropriate ioctl for device */

which means that the erorr is correctly output. It's not a tty.

If this error is caused by ZFS or something else - no idea. Just wanted to let you know.

Patrick
jollyjinx Offline


 
Posts: 60
Joined: Sun Sep 16, 2012 12:40 pm
Location: Munich - Germany

~/Library

Post by grahamperrin » Wed Feb 20, 2013 1:48 pm

jollyjinx wrote:… root, the Users home and Users Library on different filesystems …


Do you mean that there are separate file systems for the following areas?

~

~/Library
grahamperrin Offline

User avatar
 
Posts: 1596
Joined: Fri Sep 14, 2012 10:21 pm
Location: Brighton and Hove, United Kingdom

Re: ZFS incompatibility with iCloud, Dropbox

Post by jollyjinx » Wed Feb 20, 2013 1:56 pm

Yes, they are:

Code: Select all
KRO>zfs list
NAME                                                        USED   AVAIL   REFER  MOUNTPOINT
puddle                                                     347Gi  16.9Gi   656Ki  /Volumes/puddle
puddle/Local                                               346Gi  16.9Gi  2.15Gi  /Local
puddle/Local/Users                                         344Gi  16.9Gi  4.75Mi  /Local/Users
puddle/Local/Users/jolly                                   344Gi  16.9Gi  62.3Gi  /Local/Users/jolly
puddle/Local/Users/jolly/Disks                            26.8Gi  16.9Gi  22.7Gi  /Local/Users/jolly/Disks
puddle/Local/Users/jolly/Downloads                        2.30Gi  16.9Gi   808Mi  /Local/Users/jolly/Downloads
puddle/Local/Users/jolly/Dropbox                          10.3Gi  16.9Gi  3.28Gi  /Local/Users/jolly/Dropbox
puddle/Local/Users/jolly/Library                           105Gi  16.9Gi  25.2Gi  /Local/Users/jolly/Library
puddle/Local/Users/jolly/Library/Caches                   3.53Gi  16.9Gi   524Mi  /Local/Users/jolly/Library/Caches
puddle/Local/Users/jolly/Library/Logs                     17.4Gi  16.9Gi  98.9Mi  /Local/Users/jolly/Library/Logs
puddle/Local/Users/jolly/Library/Mail                     16.3Gi  16.9Gi  15.0Gi  /Local/Users/jolly/Library/Mail
puddle/Local/Users/jolly/Library/Mail Downloads           5.18Mi  16.9Gi   612Ki  /Local/Users/jolly/Library/Mail Downloads
puddle/Local/Users/jolly/Library/Saved Application State   407Mi  16.9Gi  11.6Mi  /Local/Users/jolly/Library/Saved Application State
puddle/Local/Users/jolly/Pictures                         87.5Gi  16.9Gi  85.7Gi  /Local/Users/jolly/Pictures
jollyjinx Offline


 
Posts: 60
Joined: Sun Sep 16, 2012 12:40 pm
Location: Munich - Germany

Next

Return to General Discussion

Who is online

Users browsing this forum: ilovezfs and 1 guest

cron