Installed 2.0.0 for Mojave; zfs pool not seen

Developer discussions.

Installed 2.0.0 for Mojave; zfs pool not seen

Postby Sharko » Tue Sep 22, 2020 8:16 pm

Hi Mr. Lundman,

I downloaded the Mojave image of 2.0.0 you posted today in the announcements section, and installed it on my up-to-date secondary Mac Pro 5,1 running 10.14.6. I didn't uninstall first, just installed over the top of 1.92(?). I run an APFS partition for boot, and I had a second partition that was set up as a FileVault encrypted zpool. During the install I got the referral to the security pane of System Preferences, and I approved the Lundman kext. After installation it didn't seem like my path had 'zfs' and 'zpool' commands in it, so I rebooted. After reboot the zfs and zpool commands worked, but no joy in importing the old filesystem. The partition appears to be unlocked properly:

Code: Select all
sh-3.2# diskutil cs list
CoreStorage logical volume groups (1 found)
|
+-- Logical Volume Group EE68FFC7-32B3-4922-B290-FB3152709961
    =========================================================
    Name:         MicronData
    Status:       Online
    Size:         875024449536 B (875.0 GB)
    Free Space:   8749056 B (8.7 MB)
    |
    +-< Physical Volume 1751FC94-923D-4DF0-BA7E-7B606E84E6BA
    |   ----------------------------------------------------
    |   Index:    0
    |   Disk:     disk0s3
    |   Status:   Online
    |   Size:     875024449536 B (875.0 GB)
    |
    +-> Logical Volume Family 344D87F7-FE51-4B27-B412-A25867A9B772
        ----------------------------------------------------------
        Encryption Type:         AES-XTS
        Encryption Status:       Unlocked
        Conversion Status:       Complete
        High Level Queries:      Fully Secure
        |                        Passphrase Required
        |                        Accepts New Users
        |                        Has Visible Users
        |                        Has Volume Key
        |
        +-> Logical Volume B479966B-6EDC-474C-B0D3-0C6DCC435654
            ---------------------------------------------------
            Disk:                  disk2
            Status:                Online
            Size (Total):          874663378944 B (874.7 GB)
            Revertible:            Yes (unlock and decryption required)
            LV Name:               MicronData
            Volume Name:           MICRONDATA
            Content Hint:          Apple_HFS
sh-3.2# zpool import MICRONDATA
cannot import 'MICRONDATA': no such pool available
sh-3.2# zpool import -a
sh-3.2#


That last attempt to import anything ('-a') returns to the command prompt very quickly, and no pool is imported. Any suggestions? I could boot from a backup, and import the pool from a 1.94 kext system, just to verify that it is there.

Thank you for supporting those of us still on Mojave (for another year!).
Sharko
 
Posts: 230
Joined: Thu May 12, 2016 12:19 pm

Re: Installed 2.0.0 for Mojave; zfs pool not seen

Postby Sharko » Sat Sep 26, 2020 3:38 pm

OK, egg on face time: ZFS 2.0.0.0 was not able to import a pool because there was no pool there to import! I thought I had fully set up a ZFS pool on that drive, but I don't see anything to import when that disk is connected to a openzfsonosx 1.9.2 system. So, nothing to see here, sorry to waste anyone's time and electrons.

Kurt
Sharko
 
Posts: 230
Joined: Thu May 12, 2016 12:19 pm

Re: Installed 2.0.0 for Mojave; zfs pool not seen

Postby lundman » Sun Sep 27, 2020 4:00 pm

No actually, there is a import problem - it only scans one path, including if you pass it one. I'll have to roll out new pkg soon.
User avatar
lundman
 
Posts: 1335
Joined: Thu Mar 06, 2014 2:05 pm
Location: Tokyo, Japan

Re: Installed 2.0.0 for Mojave; zfs pool not seen

Postby tangles » Tue Oct 06, 2020 6:25 am

Was just posting here a moment ago after installing and creating a new pool with ZFS 2.0.0 and bam… KP… ouchy…

Code: Select all
panic(cpu 0 caller 0xffffff80194471ec): "Double fault at 0xffffff801932b114, registers:\n" "CR0: 0x000000008001003b, CR2: 0xffffff8765e57ff8, CR3: 0x00000001a606214b, CR4: 0x00000000001626e0\n" "RAX: 0xffffff80ba5d95a0, RBX: 0xffffff8019c9d618, RCX: 0x0000000002000000, RDX: 0x0000000003000000\n" "RSP: 0xffffff8765e58000, RBP: 0xffffff8765e58000, RSI: 0x0000000050775d80, RDI: 0xffffff8019c9d618\n" "R8:  0x000000000000000f, R9:  0x0000000000000000, R10: 0x0000000000000002, R11: 0x0000000000000200\n" "R12: 0xffffff8765e58088, R13: 0x000000000500c004, R14: 0xffffff8765e58094, R15: 0xffffff8019c9d618\n" "RFL: 0x0000000000010006, RIP: 0xffffff801932b114, CS:  0x0000000000000008, SS:  0x0000000000000010\n" "Error code: 0x0000000000000000\n"@/AppleInternal/BuildRoot/Library/Caches/com.apple.xbs/Sources/xnu/xnu-6153.141.2/osfmk/i386/trap_native.c:168
Backtrace (CPU 0), Frame : Return Address
0xffffff8019151310 : 0xffffff801931a65d
0xffffff8019151360 : 0xffffff8019454a75
0xffffff80191513a0 : 0xffffff80194465fe
0xffffff80191513f0 : 0xffffff80192c0a40
0xffffff8019151410 : 0xffffff8019319d27
0xffffff8019151510 : 0xffffff801931a117
0xffffff8019151560 : 0xffffff8019ac1a6c
0xffffff80191515d0 : 0xffffff80194471ec
0xffffff80191516c0 : 0xffffff8019ac1bb8
0xffffff80191516d0 : 0xffffff80192c12bf
0xffffff8765e58000 : 0xffffff801943b9dd
0xffffff8765e58040 : 0xffffff8019313a8b
0xffffff8765e58070 : 0xffffff8019899358
0xffffff8765e580a0 : 0xffffff7f9f7a1bf1
0xffffff8765e580c0 : 0xffffff7f9f79b6a7
0xffffff8765e58120 : 0xffffff7f9f78c6cd
0xffffff8765e581b0 : 0xffffff7f9f48ef5f
0xffffff8765e58200 : 0xffffff7f9f491c1f
0xffffff8765e58420 : 0xffffff7f9f4b0282
0xffffff8765e58530 : 0xffffff7f9f4af741
0xffffff8765e585e0 : 0xffffff7f9f4be49b
0xffffff8765e58630 : 0xffffff7f9f5c8224
0xffffff8765e586a0 : 0xffffff7f9f5cafa2
0xffffff8765e58740 : 0xffffff7f9f5e6713
0xffffff8765e58900 : 0xffffff7f9f5e628c
0xffffff8765e58960 : 0xffffff7f9f635d3c
0xffffff8765e58990 : 0xffffff7f9f626c19
0xffffff8765e589f0 : 0xffffff8019574a08
0xffffff8765e58a70 : 0xffffff801957419f
0xffffff8765e58ad0 : 0xffffff8019575532
0xffffff8765e58b00 : 0xffffff80195779a3
0xffffff8765e58b80 : 0xffffff7f9f62969c
0xffffff8765e58c30 : 0xffffff7f9f634f68
0xffffff8765e58cf0 : 0xffffff7f9f634b67
0xffffff8765e58d20 : 0xffffff7f9f5e6750
0xffffff8765e58ee0 : 0xffffff7f9f5e628c
0xffffff8765e58f40 : 0xffffff7f9f635d3c
0xffffff8765e58f70 : 0xffffff7f9f626c19
0xffffff8765e58fd0 : 0xffffff8019574a08
0xffffff8765e59050 : 0xffffff801957419f
0xffffff8765e590b0 : 0xffffff8019575532
0xffffff8765e590e0 : 0xffffff80195779a3
0xffffff8765e59160 : 0xffffff7f9f62969c
0xffffff8765e59210 : 0xffffff7f9f634f68
0xffffff8765e592d0 : 0xffffff7f9f634b67
0xffffff8765e59300 : 0xffffff7f9f5e6750
0xffffff8765e594c0 : 0xffffff7f9f5e628c
0xffffff8765e59520 : 0xffffff7f9f635d3c
0xffffff8765e59550 : 0xffffff7f9f626c19
0xffffff8765e595b0 : 0xffffff8019574a08
0xffffff8765e59630 : 0xffffff801957419f
0xffffff8765e59690 : 0xffffff8019575532
0xffffff8765e596c0 : 0xffffff80195779a3
0xffffff8765e59740 : 0xffffff7f9f62969c
0xffffff8765e597f0 : 0xffffff7f9f634f68
0xffffff8765e598b0 : 0xffffff7f9f634b67
0xffffff8765e598e0 : 0xffffff7f9f5e6750
0xffffff8765e59aa0 : 0xffffff7f9f5e628c
0xffffff8765e59b00 : 0xffffff7f9f635d3c
0xffffff8765e59b30 : 0xffffff7f9f626c19
0xffffff8765e59b90 : 0xffffff8019574a08
0xffffff8765e59c10 : 0xffffff801957419f
0xffffff8765e59c70 : 0xffffff8019575532
0xffffff8765e59ca0 : 0xffffff80195779a3
0xffffff8765e59d20 : 0xffffff7f9f62969c
0xffffff8765e59dd0 : 0xffffff7f9f634f68
0xffffff8765e59e90 : 0xffffff7f9f634b67
0xffffff8765e59ec0 : 0xffffff7f9f5e6750
0xffffff8765e5a080 : 0xffffff7f9f5e628c
0xffffff8765e5a0e0 : 0xffffff7f9f635d3c
0xffffff8765e5a110 : 0xffffff7f9f626c19
0xffffff8765e5a170 : 0xffffff8019574a08
0xffffff8765e5a1f0 : 0xffffff801957419f
0xffffff8765e5a250 : 0xffffff8019575532
0xffffff8765e5a280 : 0xffffff80195779a3
0xffffff8765e5a300 : 0xffffff7f9f62969c
0xffffff8765e5a3b0 : 0xffffff7f9f634f68
0xffffff8765e5a470 : 0xffffff7f9f634b67
0xffffff8765e5a4a0 : 0xffffff7f9f5e6750
0xffffff8765e5a660 : 0xffffff7f9f5e628c
   Backtrace continues...
      Kernel Extensions in backtrace:
         net.lundman.zfs(2.0)[0C0F2732-8439-3E0A-A97C-AE2B9EEC3C6F]@0xffffff7f9f488000->0xffffff7fa0cb4fff
            dependency: com.apple.iokit.IOStorageFamily(2.1)[CB3CB8CA-881A-37F3-A96B-8063CAF0476D]@0xffffff7f99f17000

BSD process name corresponding to current thread: mdsync

Mac OS version:
19H2

Kernel version:
Darwin Kernel Version 19.6.0: Mon Aug 31 22:12:52 PDT 2020; root:xnu-6153.141.2~1/RELEASE_X86_64
Kernel UUID: 05D51A3D-3A87-3FF0-98C3-9CF3827A3EDD
Kernel slide:     0x0000000019000000
Kernel text base: 0xffffff8019200000
__HIB  text base: 0xffffff8019100000
System model name: MacPro6,1 (Mac-F60DEB81FF30ACF6)
System shutdown begun: NO
Panic diags file available: YES (0x0)

System uptime in nanoseconds: 16615447900744
last loaded kext at 15717399537002: >!AXsanScheme   3 (addr 0xffffff7f9f475000, size 32768)
last unloaded kext at 15367382866888: >!AXsanScheme   3 (addr 0xffffff7f9f46e000, size 32768)
loaded kexts:
net.lundman.zfs   2.0.0
com.cisco.kext.acsock   4.9.0
com.intel.driver.EnergyDriver   3.7.0
com.ATTO.driver.ATTOThunderLinkNC   2.12.0f1
|SCSITaskUserClient   422.120.3
@filesystems.smbfs   3.4.4
>!AFWOHCI   5.6.2
@fileutil   20.036.15
@filesystems.autofs   3.0
>AGPM   111.4.4
>!APlatformEnabler   2.7.0d0
>X86PlatformShim   1.0.0
>!AUpstreamUserClient   3.6.8
>!AMCCSControl   1.14
@kext.AMDFramebuffer   3.1.0
@kext.AMDRadeonX4000   3.1.0
@kext.AMDRadeonServiceManager   3.1.0
>!AGraphicsDevicePolicy   5.2.6
@AGDCPluginDisplayMetrics   5.2.6
>!AHV   1
>!AHDA   283.15
|IOUserEthernet   1.0.1
>!AMGPUPowerControl   5.2.6
|IO!BSerialManager   7.0.6f7
>pmtelemetry   1
@Dont_Steal_Mac_OS_X   7.0.0
>eficheck   1
>!ALPC   3.1
>!AThunderboltIP   3.1.4
>AudioAUUC   1.70
>!A!IMCEReporter   115
@kext.AMD7000!C   3.1.0
>!A!ISlowAdaptiveClocking   4.0.0
>!AVirtIO   1.0
@filesystems.hfs.kext   522.100.5
@!AFSCompression.!AFSCompressionTypeDataless   1.0.0d1
@BootCache   40
@!AFSCompression.!AFSCompressionTypeZlib   1.0.0
@filesystems.apfs   1412.141.1
>!AAHCIPort   341.140.1
|!ABCM5701Ethernet   10.3.5
>AirPort.BrcmNIC   1400.1.1
@private.KextAudit   1.0
>!AACPIEC   6.1
>!AACPIButtons   6.1
>!AHPET   1.8
>!ARTC   2.0
>!ASMBIOS   2.1
>!AAPIC   1.7
>!A!ICPUPowerManagementClient   222.0.0
$!AImage4   1
@nke.applicationfirewall   303
$TMSafetyNet   8
@!ASystemPolicy   2.0.0
>!A!ICPUPowerManagement   222.0.0
|EndpointSecurity   1
>!AXsanScheme   3
>usb.cdc.ncm   5.0.0
|IOFireWireIP   2.3.0
|IOFireWire!F   4.7.5
>!AHIDKeyboard   209
@kext.triggers   1.0
>!ASMBus!C   1.0.18d1
@kext.AMDRadeonX4030HWLibs   1.0
|IOAccelerator!F2   438.7.3
@kext.AMDRadeonX4000HWServices   3.1.0
|IOAVB!F   850.1
>DspFuncLib   283.15
@kext.OSvKernDSPLib   529
>!ABacklightExpert   1.1.0
>!AGraphicsControl   5.2.6
|IONDRVSupport   576.1
@!AGPUWrangler   5.2.6
>X86PlatformPlugin   1.0.0
>IOPlatformPlugin!F   6.0.0d8
@kext.AMDSupport   3.1.0
@!AGraphicsDeviceControl   5.2.6
|IOSlowAdaptiveClocking!F   1.0.0
>!AHDA!C   283.15
|IOGraphics!F   576.1
|IOHDA!F   283.15
@plugin.IOgPTPPlugin   840.3
|Broadcom!BHost!CUSBTransport   7.0.6f7
|IO!BHost!CUSBTransport   7.0.6f7
|IO!BHost!CTransport   7.0.6f7
|IO!B!F   7.0.6f7
|IO!BPacketLogger   7.0.6f7
>!UAudio   323.4
>usb.cdc   5.0.0
>usb.networking   5.0.0
>usb.!UHostCompositeDevice   1.2
>usb.!UHub   1.2
>!AThunderboltDPOutAdapter   6.2.6
>!AThunderboltPCIUpAdapter   2.5.4
|IOAudio!F   300.2
@vecLib.kext   1.2.0
|IOSerial!F   11
|IOSurface   269.11
@filesystems.hfs.encodings.kext   1
>!AThunderboltDPInAdapter   6.2.6
>!AThunderboltDPAdapter!F   6.2.6
>!AThunderboltPCIDownAdapter   2.5.4
|IOAHCIBlock!S   316.100.5
|IOSCSIParallel!F   3.0.0
>!AThunderboltNHI   5.8.6
|IOThunderbolt!F   7.6.1
>usb.!UXHCIPCI   1.2
>usb.!UXHCI   1.2
|IOAHCI!F   290.0.1
|IOEthernetAVB!C   1.1.0
|IO80211!F   1200.12.2b1
>mDNSOffloadUserClient   1.0.1b8
>corecapture   1.0.4
|IOSkywalk!F   1
>usb.!UEHCIPCI   1.2
>usb.!UEHCI   1.2
>usb.!UHostPacketFilter   1.0
|IOUSB!F   900.4.2
|IOSMBus!F   1.1
>!AEFINVRAM   2.1
|IOHID!F   2.0.0
>!AEFIRuntime   2.1
$quarantine   4
$sandbox   300.0
@kext.!AMatch   1.0.0d1
>DiskImages   493.0.0
>!AFDEKeyStore   28.30
>!AEffaceable!S   1.0
>!ASSE   1.0
>!AKeyStore   2
>!UTDM   489.120.1
|IOSCSIBlockCommandsDevice   422.120.3
>!ACredentialManager   1.0
>KernelRelayHost   1
>!ASEPManager   1.0.1
>IOSlaveProcessor   1
|IOUSBMass!SDriver   157.140.1
|IOSCSIArchitectureModel!F   422.120.3
|IO!S!F   2.1
|IOUSBHost!F   1.2
>!UHostMergeProperties   1.2
>usb.!UCommon   1.0
>!ABusPower!C   1.0
|CoreAnalytics!F   1
>!AMobileFileIntegrity   1.0.5
@kext.CoreTrust   1
|IOTimeSync!F   840.3
|IONetworking!F   3.4
|IOReport!F   47
>!AACPIPlatform   6.1
>!ASMC   3.1.9
>watchdog   1
|IOPCI!F   2.9
|IOACPI!F   1.4
@kec.pthread   1
@kec.corecrypto   1.0
@kec.Libm   1
tangles
 
Posts: 195
Joined: Tue Jun 17, 2014 6:54 am

Re: Installed 2.0.0 for Mojave; zfs pool not seen

Postby tangles » Tue Oct 06, 2020 6:46 am

Anyway,

What I was going to ask Mr Lundy is what zfs attributes do you now recommend to mimic APFS instead of HFS?

At present, all I'm doing to create a pool is: (example is with a single flash storage disk that I called Wedgie)

Prepare the disk(s):
Code: Select all
sudo diskutil unmountDisk /dev/diskn
sudo dd if=/dev/zero of=/dev/rdiskn bs=1024k count=10240


Code: Select all
sudo zpool history Wedgie
Password:
History for 'Wedgie':
2020-10-07.00:43:53 zpool create Wedgie /dev/disk4
2020-10-07.00:44:29 zfs set reservation=1m Wedgie
2020-10-07.00:44:53 zfs set atime=off Wedgie
2020-10-07.00:45:57 zfs set compression=on Wedgie

and then setup posix
Code: Select all
sudo chown -Rf unknown:staff /Volumes/Wedgie
sudo chmod o-rwx /Volumes/Wedgie


zpool create will set the following defaults settings that are of interest to me:
Code: Select all
NAME    PROPERTY               VALUE                  SOURCE
Wedgie  utf8only               off                    -
Wedgie  normalization          none                   -
Wedgie  casesensitivity        sensitive              -


Besides the com.apple.* attributes:
Code: Select all
Wedgie  com.apple.browse       on                     default
Wedgie  com.apple.ignoreowner  off                    default
Wedgie  com.apple.mimic        off                    default
Wedgie  com.apple.devdisk      poolonly               default


I only ever store data on ZFS pools and not macOS apps, so do I need to even set the mimic attribute in this case?
Is there anything else we should be setting on a pool to play nice with macOS?

I was reading mjtsai blog about normalisation with APFS and am I correct in thinking we're okay as long as we stick to utf8?

What also concerns me is:
Code: Select all
NAME    PROPERTY               VALUE                  SOURCE
Wedgie  aclmode                discard


I'd prefer inherit…

Thoughts?
tangles
 
Posts: 195
Joined: Tue Jun 17, 2014 6:54 am

Re: Installed 2.0.0 for Mojave; zfs pool not seen

Postby lundman » Wed Oct 07, 2020 5:12 pm

Ah I should remove those .pkg files - import problems, and file-based pools bug. Working on new pkg today once the Summit is done.
User avatar
lundman
 
Posts: 1335
Joined: Thu Mar 06, 2014 2:05 pm
Location: Tokyo, Japan

Re: Installed 2.0.0 for Mojave; zfs pool not seen

Postby RJVB » Fri Mar 12, 2021 3:15 am

tangles wrote:Besides the com.apple.* attributes:
Code: Select all
Wedgie  com.apple.browse       on                     default
Wedgie  com.apple.ignoreowner  off                    default
Wedgie  com.apple.mimic        off                    default
Wedgie  com.apple.devdisk      poolonly               default


I only ever store data on ZFS pools and not macOS apps, so do I need to even set the mimic attribute in this case?
Is there anything else we should be setting on a pool to play nice with macOS?


I suppose it could depend on whether or not you use that data in/from applications that might store metadata in a resource fork or something similar that's HFS/APFS specific (you can probably check that by using those apps on data that's stored on a remote disk mounted over Samba). Another reason would be if you want to enable Spotlight and/or TimeMachine on those volumes.
Barring that, the Mac's OS is a certified Unix so you should not need any Mac mimicry in ZFS other than setting related to case sensitivity, normalisation and Unicode (and then again only if you want these settings to behave the same way rather than as they do in the rest of the world ;) ).

FWIW, those are dataset attributes, no? I routinely unset com.apple.browse on datasets that have a mountpoint that's not directly under /Volumes because I have no use for those datasets to appear as (often lots) of additional icons on my desktop.
RJVB
 
Posts: 54
Joined: Tue May 23, 2017 12:32 pm


Return to OpenZFS on OS X Development

Who is online

Users browsing this forum: No registered users and 13 guests

cron