Not sure if this is a bug in 2.1.6 release - imaginary files

Developer discussions.

Not sure if this is a bug in 2.1.6 release - imaginary files

Postby Sharko » Thu Dec 01, 2022 10:05 pm

This could be something, might be nothing...

I was doing some merging of data from an old dataset to the working dataset MICRON/HOME, and as part of that I have an OldLibrary folder and a Library folder sitting side by side in my non-admin user's future home directory under ZFS, at /Volumes/MICRON/HOME/Users/userkurt. The Library folder was ditto'ed from the boot drive at /Users/userkurt/Library to /Volumes/MICRON/HOME/Users/userkurt/Library. The OldLibrary folder is the former Library folder (simply renamed with mv) from when this whole dataset was stilling living under Mojave/ZFS 1.9.4.

So, I do the ditto command to copy over the Thunderbird support files buried in OldLibrary:
Code: Select all
sh-3.2# pwd
/Volumes/MICRON/HOME/Users/userkurt
sh-3.2# ls Library/ | less
sh-3.2# ditto OldLibrary/Thunderbird/Profiles Library/Thunderbird/Profiles
ditto: /Volumes/MICRON/HOME/Users/userkurt/Library/Thunderbird/Profiles/00b83lu0.Userkurt/ImapMail/mail.messagingengine.com/.BC.T_CbMaJh: Result too large
ditto: /Volumes/MICRON/HOME/Users/userkurt/Library/Thunderbird/Profiles/00b83lu0.Userkurt/.BC.T_SWDxZq: Result too large
ditto: /Volumes/MICRON/HOME/Users/userkurt/Library/Thunderbird/Profiles/00b83lu0.Userkurt/.BC.T_2QeXBn: Result too large
ditto: /Volumes/MICRON/HOME/Users/userkurt/Library/Thunderbird/Profiles/00b83lu0.Userkurt/.BC.T_Y1ukLa: Result too large
ditto: /Volumes/MICRON/HOME/Users/userkurt/Library/Thunderbird/Profiles/00b83lu0.Userkurt/.BC.T_dVi28t: Result too large
ditto: /Volumes/MICRON/HOME/Users/userkurt/Library/Thunderbird/Profiles/00b83lu0.Userkurt/.BC.T_JLZkbm: Result too large
ditto: /Volumes/MICRON/HOME/Users/userkurt/Library/Thunderbird/Profiles/00b83lu0.Userkurt/.BC.T_eJaPMD: Result too large
ditto: /Volumes/MICRON/HOME/Users/userkurt/Library/Thunderbird/Profiles/00b83lu0.Userkurt/.BC.T_1FmpBI: Result too large
ditto: /Volumes/MICRON/HOME/Users/userkurt/Library/Thunderbird/Profiles/00b83lu0.Userkurt/.BC.T_qCUQ7I: Result too large
ditto: /Volumes/MICRON/HOME/Users/userkurt/Library/Thunderbird/Profiles/00b83lu0.Userkurt/Mail/Local Folders/.BC.T_E5U97I: Result too large
ditto: /Volumes/MICRON/HOME/Users/userkurt/Library/Thunderbird/Profiles/00b83lu0.Userkurt/Mail/Local Folders/.BC.T_lqhLDg: Result too large
ditto: /Volumes/MICRON/HOME/Users/userkurt/Library/Thunderbird/Profiles/00b83lu0.Userkurt/Mail/Local Folders/.BC.T_5pk8Cw: Result too large
ditto: /Volumes/MICRON/HOME/Users/userkurt/Library/Thunderbird/Profiles/00b83lu0.Userkurt/Mail/Local Folders/.BC.T_u7xIp2: Result too large
ditto: /Volumes/MICRON/HOME/Users/userkurt/Library/Thunderbird/Profiles/00b83lu0.Userkurt/Mail/smart mailboxes/.BC.T_mxhs8j: Result too large
ditto: /Volumes/MICRON/HOME/Users/userkurt/Library/Thunderbird/Profiles/00b83lu0.Userkurt/Mail/smart mailboxes/.BC.T_ZA1HRP: Result too large
ditto: /Volumes/MICRON/HOME/Users/userkurt/Library/Thunderbird/Profiles/00b83lu0.Userkurt/Mail/smart mailboxes/.BC.T_TwsrCF: Result too large
ditto: /Volumes/MICRON/HOME/Users/userkurt/Library/Thunderbird/Profiles/00b83lu0.Userkurt/Mail/smart mailboxes/.BC.T_yC9Nog: Result too large


Huh, I think, that is strange that I've got these huge files that don't fit in the 183GB available space. I've never seen ditto complain about files being too large before. So I go looking for these large files, but I don't find them with ls:

Code: Select all
sh-3.2# ls -A - a -l /Volumes/MICRON/HOME/Users/userkurt/OldLibrary/Thunderbird/Profiles/00b83lu0.Userkurt/
total 1049737
drwx------@ 18 userkurt  staff        105 Nov 30 22:07 .
drwxr-xr-x@  3 userkurt  staff          4 Dec 20  2010 ..
-rw-------@  1 userkurt  staff       6148 Jul 23  2014 .DS_Store
-rw-r--r--   1 userkurt  staff          0 Nov 27 21:26 .parentlock
-rw-r--r--@  1 userkurt  staff       2799 Nov 28 22:48 AlternateServices.txt
drwxr-xr-x   9 userkurt  staff         19 Jun 26  2020 ImapMail
drwxr-xr-x   9 userkurt  staff         10 Jan 12  2014 Mail
-rw-r--r--@  1 userkurt  staff          0 Aug 21  2021 SecurityPreloadState.txt
-rw-r--r--@  1 userkurt  staff       3009 Nov 28 21:33 SiteSecurityServiceState.txt
-rw-r--r--   1 userkurt  staff          4 Oct 20  2020 Telemetry.ShutdownTime.txt
-rw-r--r--@  1 userkurt  staff     751911 Apr  9  2014 TestPilotErrorLog.log
drwxr-xr-x@  2 userkurt  staff          5 Apr  9  2012 TestPilotExperimentFiles
drwxr-xr-x@  2 userkurt  staff          4 Dec  7  2006 US
-rw-r--r--   1 userkurt  staff     450141 Oct 11  2020 abook.mab.bak
-rw-r--r--   1 userkurt  staff    1015808 Oct  7 08:23 abook.sqlite
-rw-r--r--   1 userkurt  staff    1015808 Aug 30  2021 abook.v2.sqlite
-rw-r--r--   1 userkurt  staff    1015808 Jul  2 16:35 abook.v3.sqlite
-rw-r--r--@  1 userkurt  staff       2366 Nov 27 21:26 addonStartup.json.lz4
-rw-r--r--@  1 userkurt  staff         24 Nov 28 21:31 addons.json
-rw-r--r--@  1 userkurt  staff     524288 Aug  2  2014 addons.sqlite
-rw-r--r--@  1 userkurt  staff     524288 Aug  4  2014 blist.sqlite
-rw-------@  1 userkurt  staff     575337 Dec  2  2018 blocklist-addons.json
-rw-------@  1 userkurt  staff      27953 Apr 22  2017 blocklist-gfx.json
-rw-------@  1 userkurt  staff     139100 Sep 14  2018 blocklist-plugins.json
-rw-------   1 userkurt  staff     961517 Oct 20  2020 blocklist.xml
drwx------   2 userkurt  staff          4 Dec  9  2019 blocklists
drwx------   3 userkurt  staff          3 Oct 24  2020 browser-extension-data
drwx------   3 userkurt  staff          6 Nov 30 22:07 calendar-data
-rw-------@  1 userkurt  staff     393216 Dec 23  2018 cert8.db
-rw-------@  1 userkurt  staff     425984 Jul  4 10:17 cert9.db
-rw-------@  1 userkurt  staff        769 Jun 12  2015 cert_override.txt
-rw-r--r--@  1 userkurt  staff      98304 Oct  9  2013 chromeappsstore.sqlite
-rw-------   1 userkurt  staff        220 Nov 27 21:26 compatibility.ini
-rw-r--r--@  1 userkurt  staff     175952 Nov 30  2011 compreg.dat
-rw-r--r--@  1 userkurt  staff     229376 Oct 28  2020 content-prefs.sqlite
-rw-r--r--@  1 userkurt  staff     524288 Oct  7 08:23 cookies.sqlite
drwx------@  3 userkurt  staff          4 Nov 27 21:27 crashes
drwx------   3 userkurt  staff          5 Nov 30 22:07 datareporting
-rw-r--r--   1 userkurt  staff         23 May 21  2022 directoryTree.json
-rw-r--r--   1 userkurt  staff        112 Jul  2 16:35 encrypted-openpgp-passphrase.txt
-rw-r--r--   1 userkurt  staff      98304 Oct 24  2020 enigmail.sqlite
-rw-------   1 userkurt  staff        801 Aug 30  2021 extension-preferences.json
drwxr-xr-x   3 userkurt  staff          3 Jun 14  2021 extensions
-rw-r--r--@  1 userkurt  staff        187 Dec 23  2018 extensions.ini
-rw-r--r--@  1 userkurt  staff      26484 Nov 28 21:35 extensions.json
-rw-r--r--@  1 userkurt  staff       3482 Nov 30  2011 extensions.rdf
-rw-r--r--@  1 userkurt  staff     458752 Aug  2  2014 extensions.sqlite
-rw-r--r--@  1 userkurt  staff    5242880 Sep  4  2021 favicons.sqlite
-rw-r--r--@  1 userkurt  staff     125284 Nov 30 22:07 folderCache.json
-rw-r--r--@  1 userkurt  staff       2099 Nov 17  2018 folderTree-1.json
-rw-r--r--   1 userkurt  staff       2581 Nov 30 22:07 folderTree.json
-rw-r--r--@  1 userkurt  staff     262144 Aug 30  2021 formhistory.sqlite
-rw-r--r--   1 userkurt  staff  971866112 Nov 30 21:54 global-messages-db.sqlite
drwx------   3 userkurt  staff          3 Apr 27  2017 gmp
-rw-r--r--   1 userkurt  staff       1368 Jul  2 16:35 handlers.json
-rw-r--r--@  1 userkurt  staff     229768 Oct 20  2020 history.mab.bak
-rw-r--r--   1 userkurt  staff    1441792 Nov 30 22:07 history.sqlite
-rw-r--r--   1 userkurt  staff    1441792 Aug 30  2021 history.v2.sqlite
-rw-r--r--   1 userkurt  staff    1441792 Jul  2 16:35 history.v3.sqlite
-rw-------   1 userkurt  staff      62941 Jan 10  2021 junklog.html
-rw-------@  1 userkurt  staff      16384 Dec 23  2018 key3.db
-rw-------@  1 userkurt  staff     294912 Dec 16  2018 key4.db
-rw-r--r--@  1 userkurt  staff    2097152 Dec  9  2019 kinto.sqlite
-rw-r--r--@  1 userkurt  staff      39811 Jun 17  2015 localstore.rdf
-rw-------   1 userkurt  staff      11571 Jun 26  2020 logins-backup.json
-rw-r--r--   1 userkurt  staff      11631 Jul  2 16:35 logins.json
-rw-r--r--@  1 userkurt  staff        482 Jan 10  2010 mailViews.dat
-rw-r--r--@  1 userkurt  staff       7589 Jun  8  2017 mimeTypes.rdf
drwxr-xr-x   2 userkurt  staff          2 Jun  5  2019 minidumps
-rw-r--r--   1 userkurt  staff     229376 Oct 24  2020 openpgp.sqlite
-rw-r--r--@  1 userkurt  staff      13312 Nov 28 21:05 permissions.sqlite
-rw-------@  1 userkurt  staff        895 Dec 16  2018 pkcs11.txt
-rw-r--r--@  1 userkurt  staff    5242880 Nov 30 22:07 places.sqlite
-rw-------   1 userkurt  staff        228 Oct  4  2020 pluginreg.dat
-rw-r--r--   1 userkurt  staff          0 Nov 23  2020 prefs-1.js
-rw-r--r--   1 userkurt  staff          0 Nov 23  2020 prefs-2.js
-rw-r--r--   1 userkurt  staff          0 Nov 23  2020 prefs-3.js
-rw-r--r--   1 userkurt  staff          0 Nov 23  2020 prefs-4.js
-rw-r--r--   1 userkurt  staff          0 Nov 23  2020 prefs-5.js
-rw-r--r--   1 userkurt  staff          0 Nov 23  2020 prefs-6.js
-rw-r--r--@  1 userkurt  staff      81117 Nov 30 22:05 prefs.js
drwx------   2 userkurt  staff          4 Nov 30 22:07 saved-telemetry-pings
-rw-r--r--@  1 userkurt  staff          2 Aug  7  2012 search-metadata.json
-rw-------@  1 userkurt  staff      16618 Apr  9  2016 search.json
-rw-r--r--@  1 userkurt  staff        276 Nov 27 21:26 search.json.mozlz4
-rw-r--r--@  1 userkurt  staff      65536 Mar 20  2012 search.sqlite
-rw-------   1 userkurt  staff      16384 Jan 10  2010 secmod.db
drwxr-xr-x   2 userkurt  staff          3 Oct 24  2020 security_state
-rw-r--r--@  1 userkurt  staff        534 Nov 30 22:07 session.json
-rw-r--r--@  1 userkurt  staff        549 Nov 27 21:31 session.json.backup
-rw-r--r--@  1 userkurt  staff        204 Nov 30 22:07 sessionCheckpoints.json
drwxr-xr-x   2 userkurt  staff          3 Jul  2 16:41 settings
-rw-r--r--@  1 userkurt  staff      17408 Feb 23  2015 signons.sqlite
drwxr-xr-x   5 userkurt  staff          6 Aug 30  2021 storage
-rw-r--r--@  1 userkurt  staff      98304 Aug  8  2015 storage.sdb
-rw-r--r--@  1 userkurt  staff       4096 Nov 30 22:07 storage.sqlite
-rw-r--r--@  1 userkurt  staff      98304 Mar 27  2012 testpilot_week_in_the_life_results.sqlite
-rw-------@  1 userkurt  staff         25 Apr 16  2016 times.json
-rw-r--r--   1 userkurt  staff     392641 Jan 10  2021 training.dat
-rw-r--r--@  1 userkurt  staff          8 Jan 10  2021 traits.dat
-rw-r--r--   1 userkurt  staff          0 Aug 29  2007 urlclassifier2.sqlite
-rw-r--r--@  1 userkurt  staff       1097 Nov 30 22:07 virtualFolders.dat
-rw-r--r--@  1 userkurt  staff      98304 Oct 31  2021 webappsstore.sqlite
-rw-r--r--@  1 userkurt  staff     121651 Nov 30  2011 xpti.dat
-rw-------@  1 userkurt  staff      17059 Nov 30 22:06 xulstore.json
sh-3.2#


Code: Select all
sh-3.2# find ./OldLibrary -name ".BC.T*" -print
sh-3.2#


(I ran a find on "*.sqlite" just to check my syntax, and it returned pages of results - lots of sqlite databases in a MacOS Library folder!)

So, I do not see the files in that listing that start with ".BC.T_" anywhere... does anyone have any ideas about what is going on here?

By the way, I saw similar behavior when I used ditto to copy the Firefox profile from OldLibrary to (new) Library as well.
Sharko
 
Posts: 230
Joined: Thu May 12, 2016 12:19 pm

Re: Not sure if this is a bug in 2.1.6 release - imaginary f

Postby lundman » Thu Dec 01, 2022 10:11 pm

Could be Ditto uses a dot-random name during the copy, then renames to the correct name when transfer is done, but something goes wrong
User avatar
lundman
 
Posts: 1335
Joined: Thu Mar 06, 2014 2:05 pm
Location: Tokyo, Japan

Re: Not sure if this is a bug in 2.1.6 release - imaginary f

Postby Sharko » Fri Dec 02, 2022 9:25 am

I will retry with the Library copy and not worry about these profiles - Firefox sync should take care of Firefox, and I can probably manually copy just the local mailboxes into a new Thunderbird profile. You're probably right about the temporary names. I guess I could check the sizes of the profiles in Library versus OldLibrary and see if they really were skipping over data copying. It's just weird in that the dataset I'm working within has something like 163GB free, so it seems unthinkable that there is something in OldLIbrary that big.
Sharko
 
Posts: 230
Joined: Thu May 12, 2016 12:19 pm


Return to OpenZFS on OS X Development

Who is online

Users browsing this forum: No registered users and 12 guests

cron