Consistent kernel panics - zfs-macOS-2.2.3rc5

[benjamin]

I'm trying to destroy an old time machine volume I created on my zfs filesytem but it consistently causes a kernel panic.

Intel i7 Mac mini and I've upgraded to Sequoia 15.2 and zfs-macOS-2.2.3rc5 but the issue remains.

Code: Select all

NAME               USED  AVAIL  REFER  MOUNTPOINT
EXTERNAL          9.51T  7.25T  8.31T  /Volumes/EXTERNAL
EXTERNAL/tmdisk1  1.00T  8.24T  10.8G  -

No matter what I try,

Code: Select all

sudo zfs destroy EXTERNAL/tmdisk1

results in a kernel panic.

Panic itself looks like it's in apfs, I just want to delete the volume and reclaim the space:

Code: Select all

panic(cpu 7 caller 0xffffff8020345f0e): Kernel trap at 0xffffff8022dc2bd9, type 14=page fault, registers:
CR0: 0x000000008001003b, CR2: 0x00000000000000c8, CR3: 0x00000000340e2000, CR4: 0x00000000003626e0
RAX: 0x0000000000000000, RBX: 0xffffffa1429dfef8, RCX: 0x0000000000000005, RDX: 0x0000000000000000
RSP: 0xffffffa1429dfdb0, RBP: 0xffffffa1429dfe70, RSI: 0xffffff8022f50d2d, RDI: 0xffffff90d796e000
R8:  0x0000000000004000, R9:  0xffffff85a91a1340, R10: 0x0000000000007000, R11: 0x00000000000000c0
R12: 0xffffff90d796e000, R13: 0xffffffa0ce85ad40, R14: 0xffffff90d796e084, R15: 0x0000000000000000
RFL: 0x0000000000010246, RIP: 0xffffff8022dc2bd9, CS:  0x0000000000000008, SS:  0x0000000000000000
Fault CR2: 0x00000000000000c8, Error code: 0x0000000000000000, Fault CPU: 0x7, PL: 0, VF: 1

Panicked task 0xffffff8742602110: 530 threads: pid 0: kernel_task
Backtrace (CPU 7), panicked thread: 0xffffff95a381a5a0, Frame : Return Address
0xffffffa1429df670 : 0xffffff80201e8351
0xffffffa1429df6c0 : 0xffffff802035611c
0xffffffa1429df700 : 0xffffff80203459e3
0xffffffa1429df7d0 : 0xffffff802017d971
0xffffffa1429df7f0 : 0xffffff80201e8647
0xffffffa1429df8f0 : 0xffffff80201e7ce2
0xffffffa1429df960 : 0xffffff80209d34f8
0xffffffa1429dfa50 : 0xffffff8020345f0e
0xffffffa1429dfbd0 : 0xffffff8020345c07
0xffffffa1429dfca0 : 0xffffff802017d971
0xffffffa1429dfcc0 : 0xffffff8022dc2bd9
0xffffffa1429dfe70 : 0xffffff80203cca7f
0xffffffa1429dfee0 : 0xffffff8022dc2a65
0xffffffa1429dffa0 : 0xffffff802017d19e
      Kernel Extensions in backtrace:
         com.apple.filesystems.apfs(2317.61.2)[B35F3280-A666-3A0F-A339-71F5BA7C3F78]@0xffffff8022d90000->0xffffff8022f51fff
            dependency: com.apple.driver.AppleEFINVRAM(2.1)[3F1A6025-6D21-30D4-81D2-9271CF2B2E6B]@0xffffff80216ba000->0xffffff80216c4fff
            dependency: com.apple.driver.AppleEffaceableStorage(1.0)[6BF4BAA2-B98E-3399-81EF-70D7656B6FAE]@0xffffff80216d1000->0xffffff80216d6fff
            dependency: com.apple.iokit.CoreAnalyticsFamily(1)[8EEA9C5C-D5EA-3CFB-9A8B-78B0AC27A2E4]@0xffffff8021cd7000->0xffffff8021ce0fff
            dependency: com.apple.iokit.IOStorageFamily(2.1)[4B0CF2F6-B2D4-37B7-BD27-A96CBA970155]@0xffffff8022784000->0xffffff802279afff
            dependency: com.apple.kec.corecrypto(14.0)[71EB7861-89E8-3F92-A589-0B636129D376]@0xffffff8022f97000->0xffffff8023019fff
            dependency: com.apple.security.AppleImage4(7.0.0)[4511F3E2-2D46-3601-851F-23E7EE092978]@0xffffff8021746000->0xffffff802176afff

Process name corresponding to current thread (0xffffff95a381a5a0): kernel_task

Mac OS version:
24C101

Kernel version:
Darwin Kernel Version 24.2.0: Fri Dec  6 18:41:43 PST 2024; root:xnu-11215.61.5~2/RELEASE_X86_64
Kernel UUID: 1AF74199-8232-377B-9439-FC14897F5A39
roots installed: 0
KernelCache slide: 0x000000001fe00000
KernelCache base:  0xffffff8020000000
Kernel slide:      0x000000001fee4000
Kernel text base:  0xffffff80200e4000
__HIB  text base: 0xffffff801ff00000
System model name: Macmini8,1 (Mac-7BA5B2DFE22DDD8C)
System shutdown begun: NO
Hibernation exit count: 0

System uptime in nanoseconds: 221776147734
Last Sleep:           absolute           base_tsc          base_nano
  Uptime  : 0x00000033a2e377bd
  Sleep   : 0x0000000000000000 0x0000000000000000 0x0000000000000000
  Wake    : 0x0000000000000000 0x0000000a96030c80 0x0000000000000000
Compressor Info: 0% of compressed pages limit (OK) and 0% of segments limit (OK) with 0 swapfiles and OK swap space
Zone info:
  Zone map: 0xffffff80d581c000 - 0xffffffa0d581c000
  . PGZ   : 0xffffff80d581c000 - 0xffffff80dd81d000
  . VM    : 0xffffff80dd81d000 - 0xffffff85a91b6000
  . RO    : 0xffffff85a91b6000 - 0xffffff87424e9000
  . GEN0  : 0xffffff87424e9000 - 0xffffff8c0de82000
  . GEN1  : 0xffffff8c0de82000 - 0xffffff90d981b000
  . GEN2  : 0xffffff90d981b000 - 0xffffff95a51b4000
  . GEN3  : 0xffffff95a51b4000 - 0xffffff9a70b4e000
  . DATA  : 0xffffff9a70b4e000 - 0xffffffa0d581c000
  Metadata: 0xffffffa0f582c000 - 0xffffffa11582c000
  Bitmaps : 0xffffffa11582c000 - 0xffffffa12182c000
  Extra   : 0 - 0

last started kext at 16074896676: >AudioAUUC   1.70 (addr 0xffffff7fb520f000, size 12288)
loaded kexts:
org.openzfsonosx.zfs   2.2.3
>AudioAUUC   1.70
>AGPM   137
>!APlatformEnabler   2.7.0d0
>X86PlatformShim   1.0.0
@filesystems.autofs   3.0
>!AUpstreamUserClient   3.6.12
>!AMCCSControl   1.17
>!AGFXHDA   400.1
>!ABridgeAudio!C   500.2
>!AGraphicsDevicePolicy   8.1.10
@AGDCPluginDisplayMetrics   8.1.10
>pmtelemetry   1
@filesystems.nfs   1
|IOUserEthernet   1.0.1
>usb.!UUserHCI   1
>!ARXE   1.0
>!AHV   1
>!A!IKBLGraphics   23.0.0
>ACPI_SMC_PlatformPlugin   1.0.0
>!AFIVRDriver   4.1.0
>BridgeAudioCommunication   500.2
>!AAVEBridge   6.1
>!A!ICFLGraphicsFramebuffer   23.0.0
>!A!IPCHPMC   2.0.1
>!AThunderboltNHISpeedTest   0.0.1
>!AThunderboltIP   4.0.3
>!A!ISlowAdaptiveClocking   4.0.0
|SCSITaskUserClient   500
>!UMass!SInterfaceNub   556
>usb.!UHostBillboardDevice   1.0
>BCMWLANFirmware4388.Hashstore   1
>BCMWLANFirmware4387.Hashstore   1
>BCMWLANFirmware4378.Hashstore   1
>BCMWLANFirmware4377.Hashstore   1
>BCMWLANFirmware4364.Hashstore   1
>!AFileSystemDriver   3.0.1
@filesystems.tmpfs   1
@filesystems.lifs   1
@filesystems.hfs.kext   677.60.1
@BootCache   40
@!AFSCompression.!AFSCompressionTypeZlib   1.0.0
@!AFSCompression.!AFSCompressionTypeDataless   1.0.0d1
@filesystems.apfs   2317.61.2
|!ABCM5701Ethernet   11.0.0
>!ABCMWLANBusInterfacePCIeMac   1
>!ASDXC   3.5.3
@private.KextAudit   1.0
>!AACPIButtons   6.1
>!ASMBIOS   2.1
>!AACPIEC   6.1
>!AAPIC   1.7
@!ASystemPolicy   2.0.0
@nke.applicationfirewall   406
|IOKitRegistryCompatibility   1
|EndpointSecurity   1
@Dont_Steal_Mac_OS_X   7.0.0
>!ADiskImages2   379.60.1
@kec.!AEncryptedArchive   1
>usb.cdc.acm   5.0.0
>usb.serial   6.0.0
>!ASMBus!C   1.0.18d1
>!UAudio   720.24
>!AAudioClockLibs   420.3
>!AHDA!C   600.2
|IOHDA!F   600.2
|IOAudio!F   600.2
@vecLib.kext   1.2.0
>!AGraphicsControl   8.1.10
>!A!ILpssUARTv1   3.0.60
>!A!ILpssUARTCommon   3.0.60
>!AOnboardSerial   1.0
>!ASMBusPCI   1.0.14d1
@kext.triggers   1.0
>IOHIDPowerSource   1
>!ACallbackPowerSource   1
|IOAVB!F   1320.3
>!AUIO   1
|IORDMA!F   1.0
>!ARSMChannel   1
|IORSM!F   1
>!AIPAppender   1.0
@plugin.IOgPTPPlugin   1320.8
>IOPlatformPluginLegacy   1.0.0
>X86PlatformPlugin   1.0.0
>driverkit.serial   6.0.0
|IONDRVSupport   598
|IOAccelerator!F2   485
>IOPlatformPlugin!F   6.0.0d8
>!AThunderboltEDMSink   5.0.3
@!AGPUWrangler   8.1.10
@!AGraphicsDeviceControl   8.1.10
|IOGraphics!F   598
|IOSlowAdaptiveClocking!F   1.0.0
>usb.IOUSBHostHIDDevice   1.2
>usb.!UHub   1.2
>usb.cdc.ecm   5.0.0
>usb.cdc.ncm   5.0.0
>!AThunderboltDPOutAdapter   8.5.1
>!AThunderboltPCIUpAdapter   4.1.1
>usb.cdc   5.0.0
>usb.networking   5.0.0
>usb.!UHostCompositeDevice   1.2
>!AThunderboltPCIDownAdapter   4.1.1
>!AThunderboltDPInAdapter   8.5.1
>!AThunderboltDPAdapter!F   8.5.1
>!AHPM   3.4.4
>!A!ILpssI2C!C   3.0.60
>!A!ILpssI2C   3.0.60
>!A!ILpssDmac   3.0.60
>!ABSDKextStarter   3
|IOSurface   372.3.4
@filesystems.hfs.encodings.kext   1
>!ASyntheticGame!C   12.2.1
>!AXsanScheme   3
>!AThunderboltNHI   7.2.81
|IOThunderbolt!F   9.3.3
>usb.!UVHCIBCE   1.2
>usb.!UVHCICommonBCE   1.0
>usb.!UVHCI   1.2
>usb.!UVHCICommon   1.0
>!AEffaceableNOR   1.0
|IOBufferCopy!C   1.1.0
|IOBufferCopyEngine!F   1
>!ABCMWLANCoreMac   1.0.0
|IO80211!F   1200.13.1
>IOImageLoader   1.0.0
|IONVMe!F   2.1.0
>!AOLYHALMac   1
|IOSerial!F   11
>corecapture   1.0.4
>usb.!UHostPacketFilter   1.0
|IOUSB!F   900.4.2
>usb.!UXHCIPCI   1.2
>usb.!UXHCI   1.2
>!AEFINVRAM   2.1
>!AEFIRuntime   2.1
>!ASMCRTC   1.0
|IOSMBus!F   1.1
|IOHID!F   2.0.0
|IOTimeSync!F   1320.8
|IOSkywalk!F   1.0
>mDNSOffloadUserClient   1.0.1b8
|IONetworking!F   3.4
>DiskImages   493.0.0
|IO!B!F   9.0.0
|IOReport!F   47
$quarantine   4
$sandbox   300.0
@kext.!AMatch   1.0.0d1
>!ASSE   1.0
>!ALockdownMode   1
>!AKeyStore   2
>!UTDM   556
|IOUSBMass!SDriver   250.60.2
|IOUSBHost!F   1.2
>!UHostMergeProperties   1.2
>usb.!UCommon   1.0
>!ABusPower!C   1.0
|IOSCSIBlockCommandsDevice   500
|IOSCSIArchitectureModel!F   500
>!AFDEKeyStore   28.30
>!AEffaceable!S   1.0
|IO!S!F   2.1
>!ACyrus   1
>!AMobileFileIntegrity   1.0.5
$!AImage4   7.0.0
@kext.CoreTrust   1
>!ACredentialManager   1.0
|CoreAnalytics!F   1
>!ASEPManager   1.0.1
>IOSlaveProcessor   1
>!AACPIPlatform   6.1
>!ASMC   3.1.9
|IOPCI!F   2.9
|IOACPI!F   1.4
>watchdog   1
@kec.pthread   1
@kec.XrtHostedXnu   1
@kec.Libm   1
@kec.Compression   1.0
@kec.corecrypto   14.0


[benjamin]

Got there!

I resized it as small as it would go and rebooted. No longer mounted by MacOS and destroy worked:

Code: Select all

sudo zfs set volsize=128k EXTERNAL/tmdisk1

Code: Select all

% zfs list -r EXTERNAL
NAME               USED  AVAIL  REFER  MOUNTPOINT
EXTERNAL          8.51T  8.25T  8.31T  /Volumes/EXTERNAL
EXTERNAL/tmdisk1  1.88M  8.25T   168K  -
% sudo zfs destroy EXTERNAL/tmdisk1
... asking ZVOL to export 'disk13'
Unmount of all volumes on disk13 was successful
% zfs list -r EXTERNAL
NAME       USED  AVAIL  REFER  MOUNTPOINT
EXTERNAL  8.51T  8.25T  8.31T  /Volumes/EXTERNAL

It's been bothering me for weeks!

[Sharko]

(You revised your original post, but here is what I wrote in response to that anyway. Glad that you got it sorted out.)

I thought that the latest version on the Intel side was rc4? Perhaps you’re mistaken on the version? I don’t think that many people have done much testing with Sequoia and the Intel ZFS release.

Do you have keepsyms turned on? It would probably help Mr. Lundman if the actual function calls were visible.

Is your ZFS pool on a portion of the internal disk? I’m guessing probably not, since that would require a hard partition of the internal disk, and almost no one does that anymore. If it’s on an external disk you might have to scrounge up another disk of sufficient size to move the ZFS datasets that you still want to keep off the problematic pool, and then just use Disk Utility to wipe that problem pool to turn it back into something like an HFS volume that you can start over with.