Page 1 of 1

2.2.0 kernel crash on Sonoma x64

PostPosted: Thu Nov 16, 2023 4:43 am
by Bleistein
Upgraded a running 2.1.6 system to release version 2.2.0.

Get kernel crashes during boot. After disabling the auto import in the boot sequence I was able to import the pool (without mounting) and setting the encryption password. After mounting one filesystem it was possible to access file for about 5 seconds before the system crashes.

Code: Select all
panic(cpu 4 caller 0xffffff801f788fb3): Kernel trap at 0xffffff7fb540cac5, type 14=page fault, registers:
CR0: 0x000000008001003b, CR2: 0x0000000000000000, CR3: 0x0000000033226000, CR4: 0x00000000003626e0
RAX: 0x0000000000000000, RBX: 0x0000000000000000, RCX: 0x0000000000000000, RDX: 0x0000000000000000
RSP: 0xffffffa907b13b80, RBP: 0xffffffa907b13bc0, RSI: 0x0000000000000000, RDI: 0xffffffa907b13a54
R8:  0x000000007fffffff, R9:  0xffffff7fb5795bc7, R10: 0x0000000000000008, R11: 0x0000000000000000
R12: 0xffffffb1880be610, R13: 0xffffffb1880be760, R14: 0x0000000000000000, R15: 0xffffffb18bdcffb0
RFL: 0x0000000000010202, RIP: 0xffffff7fb540cac5, CS:  0x0000000000000008, SS:  0x0000000000000010
Fault CR2: 0x0000000000000000, Error code: 0x0000000000000000, Fault CPU: 0x4, PL: 0, VF: 1

Panicked task 0xffffff9052bfd428: 369 threads: pid 0: kernel_task
Backtrace (CPU 4), panicked thread: 0xffffff9051c2d0c8, Frame : Return Address
0xffffffa907b13500 : 0xffffff801f63aca1
0xffffffa907b13550 : 0xffffff801f7993c0
0xffffffa907b13590 : 0xffffff801f788b0c
0xffffffa907b13610 : 0xffffff801f5d7971
0xffffffa907b13630 : 0xffffff801f63af8d
0xffffffa907b13720 : 0xffffff801f63a633
0xffffffa907b13780 : 0xffffff801fdd957b
0xffffffa907b13870 : 0xffffff801f788fb3
0xffffffa907b139f0 : 0xffffff801f788c97
0xffffffa907b13a70 : 0xffffff801f5d7971
0xffffffa907b13a90 : 0xffffff7fb540cac5
0xffffffa907b13bc0 : 0xffffff7fb5404f1b
0xffffffa907b13d10 : 0xffffff7fb55e6f3d
0xffffffa907b13d50 : 0xffffff7fb5427a9f
0xffffffa907b13d80 : 0xffffff7fb5434ee9
0xffffffa907b13db0 : 0xffffff7fb543b750
0xffffffa907b13e10 : 0xffffff7fb55d881e
0xffffffa907b13e80 : 0xffffff7fb55cff6a
0xffffffa907b13ec0 : 0xffffff7fb541adfd
0xffffffa907b13f60 : 0xffffff7fb541baa1
0xffffffa907b13fa0 : 0xffffff801f5d719e
      Kernel Extensions in backtrace:
         org.openzfsonosx.zfs(2.2)[A3746221-5C5A-3A65-BB7C-E1CE5D58EE64]@0xffffff7fb5402000->0xffffff7fb5886fff
            dependency: com.apple.iokit.IOStorageFamily(2.1)[A96D850A-038F-31D7-9F3D-A6775064548E]@0xffffff8021a59000->0xffffff8021a70fff

Process name corresponding to current thread (0xffffff9051c2d0c8): kernel_task

Mac OS version:
23B81

Kernel version:
Darwin Kernel Version 23.1.0: Mon Oct  9 21:27:27 PDT 2023; root:xnu-10002.41.9~6/RELEASE_X86_64
Kernel UUID: 7C8FE931-57C6-38AD-9EBB-CC5572293AE6
roots installed: 0
KernelCache slide: 0x000000001f200000
KernelCache base:  0xffffff801f400000
Kernel slide:      0x000000001f2e0000
Kernel text base:  0xffffff801f4e0000
__HIB  text base: 0xffffff801f300000
System model name: Macmini8,1 (Mac-7BA5B2DFE22DDD8C)
System shutdown begun: NO
Hibernation exit count: 0

System uptime in nanoseconds: 29466033263
Last Sleep:           absolute           base_tsc          base_nano
  Uptime  : 0x00000006dc500040
  Sleep   : 0x0000000000000000 0x0000000000000000 0x0000000000000000
  Wake    : 0x0000000000000000 0x000000058e0346c7 0x0000000000000000
Compressor Info: 0% of compressed pages limit (OK) and 0% of segments limit (OK) with 0 swapfiles and OK swap space
Zone info:
  Zone map: 0xffffff8050cdc000 - 0xffffffa050cdc000
  . PGZ   : 0xffffff8050cdc000 - 0xffffff8054cdd000
  . VM    : 0xffffff8054cdd000 - 0xffffff8521010000
  . RO    : 0xffffff8521010000 - 0xffffff86ba676000
  . GEN0  : 0xffffff86ba676000 - 0xffffff8b869a9000
  . GEN1  : 0xffffff8b869a9000 - 0xffffff9052cdc000
  . GEN2  : 0xffffff9052cdc000 - 0xffffff951f00f000
  . GEN3  : 0xffffff951f00f000 - 0xffffff99eb342000
  . DATA  : 0xffffff99eb342000 - 0xffffffa050cdc000
  Metadata: 0xffffffa8e09dc000 - 0xffffffa9009dc000
  Bitmaps : 0xffffffa9009dc000 - 0xffffffa9069dc000
  Extra   : 0 - 0

last started kext at 7677887268: @filesystems.autofs   3.0 (addr 0xffffff7fb496f000, size 32768)
loaded kexts:
org.openzfsonosx.zfs   2.2.0
@filesystems.autofs   3.0
>!APlatformEnabler   2.7.0d0
>AGPM   135
>X86PlatformShim   1.0.0
>!AGraphicsDevicePolicy   8.1.9
@AGDCPluginDisplayMetrics   8.1.9
>!AUpstreamUserClient   3.6.11
>!AMCCSControl   1.17
>pmtelemetry   1
@filesystems.nfs   1
|IOUserEthernet   1.0.1
>usb.!UUserHCI   1
>!ASunrise   1
>!AHV   1
>!ABridgeAudio!C   400.1
>ACPI_SMC_PlatformPlugin   1.0.0
>!A!IKBLGraphics   22.0.1
>!AGFXHDA   300.1
>!AFIVRDriver   4.1.0
>!A!ICFLGraphicsFramebuffer   22.0.1
>BridgeAudioCommunication   400.1
>!A!ISlowAdaptiveClocking   4.0.0
>!A!IPCHPMC   2.0.1
>!AAVEBridge   6.1
>!AThunderboltIP   4.0.3
|SCSITaskUserClient   492
>!UODD   556
>!UMass!SInterfaceNub   556
>BCMWLANFirmware4388.Hashstore   1
>BCMWLANFirmware4387.Hashstore   1
>BCMWLANFirmware4378.Hashstore   1
>BCMWLANFirmware4377.Hashstore   1
>BCMWLANFirmware4364.Hashstore   1
>BCMWLANFirmware4355.Hashstore   1
>!AFileSystemDriver   3.0.1
@filesystems.tmpfs   1
@filesystems.lifs   1
@filesystems.hfs.kext   650.0.2
@BootCache   40
@!AFSCompression.!AFSCompressionTypeZlib   1.0.0
@!AFSCompression.!AFSCompressionTypeDataless   1.0.0d1
>!AAHCIPort   380
@filesystems.apfs   2235.41.1
>!ABCMWLANBusInterfacePCIeMac   1
>!ASDXC   3.4.3
|!ABCM5701Ethernet   11.0.0
@private.KextAudit   1.0
>!AACPIButtons   6.1
>!ASMBIOS   2.1
>!AACPIEC   6.1
>!AAPIC   1.7
@!ASystemPolicy   2.0.0
@nke.applicationfirewall   404
|IOKitRegistryCompatibility   1
|EndpointSecurity   1
@Dont_Steal_Mac_OS_X   7.0.0
>!ADiskImages2   273
@kec.!AEncryptedArchive   1
|IOAVB!F   1200.18
>!AGraphicsControl   8.1.9
>!A!ILpssUARTv1   3.0.60
>!A!ILpssUARTCommon   3.0.60
>!AOnboardSerial   1.0
>!ASMBus!C   1.0.18d1
@kext.triggers   1.0
>IOHIDPowerSource   1
>!ACallbackPowerSource   1
>!ARSMChannel   1
|IORSM!F   1
>!AIPAppender   1.0
>!UAudio   610.3
>!AAudioClockLibs   300.1
>IOPlatformPluginLegacy   1.0.0
>X86PlatformPlugin   1.0.0
>usb.IOUSBHostHIDDevice   1.2
>!AHDA!C   500.3
|IOHDA!F   500.3
|IOAudio!F   500.4
@vecLib.kext   1.2.0
|IONDRVSupport   598
>!ASMBusPCI   1.0.14d1
@plugin.IOgPTPPlugin   1200.91
|IOAccelerator!F2   481.0.1
@!AGPUWrangler   8.1.9
@!AGraphicsDeviceControl   8.1.9
|IOGraphics!F   598
|IOSlowAdaptiveClocking!F   1.0.0
>IOPlatformPlugin!F   6.0.0d8
>!AThunderboltEDMSink   5.0.3
>driverkit.serial   6.0.0
|IOAHCIBlock!S   355
|IOSCSIMultimediaCommandsDevice   492
|IOBD!S!F   1.8
|IODVD!S!F   1.8
|IOCD!S!F   1.8
>!AThunderboltDPOutAdapter   8.5.1
>!AThunderboltPCIUpAdapter   4.1.1
>usb.cdc.ecm   5.0.0
>usb.cdc.ncm   5.0.0
>usb.cdc   5.0.0
>usb.networking   5.0.0
>usb.!UHostCompositeDevice   1.2
>!AThunderboltPCIDownAdapter   4.1.1
>!AThunderboltDPInAdapter   8.5.1
>!AThunderboltDPAdapter!F   8.5.1
>!AHPM   3.4.4
>!A!ILpssI2C!C   3.0.60
>!A!ILpssI2C   3.0.60
>!A!ILpssDmac   3.0.60
>!ABSDKextStarter   3
|IOSurface   352.0.3
@filesystems.hfs.encodings.kext   1
>!ASyntheticGame!C   11.1.9
|IOAHCI!F   304
>!AXsanScheme   3
>!AThunderboltNHI   7.2.81
|IOThunderbolt!F   9.3.3
>!ABCMWLANCoreMac   1.0.0
|IO80211!F   1200.13.0
>IOImageLoader   1.0.0
>!AOLYHALMac   1
|IOSerial!F   11
>corecapture   1.0.4
>usb.!UVHCIBCE   1.2
>usb.!UVHCICommonBCE   1.0
>usb.!UVHCI   1.2
>usb.!UVHCICommon   1.0
>!AEffaceableNOR   1.0
|IOBufferCopy!C   1.1.0
|IOBufferCopyEngine!F   1
|IONVMe!F   2.1.0
>usb.!UHostPacketFilter   1.0
|IOUSB!F   900.4.2
>usb.!UXHCIPCI   1.2
>usb.!UXHCI   1.2
>!AEFINVRAM   2.1
>!AEFIRuntime   2.1
>!ASMCRTC   1.0
|IOSMBus!F   1.1
|IOHID!F   2.0.0
|IOTimeSync!F   1200.91
|IOSkywalk!F   1.0
>mDNSOffloadUserClient   1.0.1b8
|IONetworking!F   3.4
>DiskImages   493.0.0
|IO!B!F   9.0.0
|IOReport!F   47
$quarantine   4
$sandbox   300.0
@kext.!AMatch   1.0.0d1
>!ASSE   1.0
>!ALockdownMode   1
>!AKeyStore   2
>!UTDM   556
|IOUSBMass!SDriver   243
|IOSCSIBlockCommandsDevice   492
|IOSCSIArchitectureModel!F   492
>!AFDEKeyStore   28.30
>!AEffaceable!S   1.0
|IO!S!F   2.1
>!ACyrus   1
>!ACredentialManager   1.0
>KernelRelayHost   1
|IOUSBHost!F   1.2
>!UHostMergeProperties   1.2
>usb.!UCommon   1.0
>!AMobileFileIntegrity   1.0.5
$!AImage4   5.0.0
@kext.CoreTrust   1
|CoreAnalytics!F   1
>!ABusPower!C   1.0
>!ASEPManager   1.0.1
>IOSlaveProcessor   1
>!AACPIPlatform   6.1
>!ASMC   3.1.9
|IOPCI!F   2.9
|IOACPI!F   1.4
>watchdog   1
@kec.pthread   1
@kec.XrtHostedXnu   1
@kec.Libm   1
@kec.Compression   1.0
@kec.corecrypto   14.0

Re: 2.2.0 kernel crash on Sonoma x64

PostPosted: Thu Nov 16, 2023 7:46 pm
by Jimbo
Yep, I'm seeing this too.

@lundman, there wasn't any functional change to RC3, correct? So, there might be something b0rked with the Sonoma build. If I install the 2.2.0 release Catalina package on Sonoma (a la RC3) pools import and can be mounted without panic.

Re: 2.2.0 kernel crash on Sonoma x64

PostPosted: Thu Nov 16, 2023 8:23 pm
by lundman
Ah ? How peculiar, let me look at it

Re: 2.2.0 kernel crash on Sonoma x64

PostPosted: Thu Nov 16, 2023 8:50 pm
by lundman
rats, it had --enable-debug in there.

This should work better:

OpenZFSonOsX-2.2.0-Sonoma-14.pkg
(16.53 MiB) Downloaded 174 times


How shall we indicate this to people hmm

Re: 2.2.0 kernel crash on Sonoma x64

PostPosted: Thu Nov 16, 2023 9:45 pm
by Jimbo
I'll give that a pkg a go now.

The release one from the DMG also caused panics on unload on one of my machines too - had to trigger-panic-medic again to get it replaced.

As to how to how to communicate this... :D

Re: 2.2.0 kernel crash on Sonoma x64

PostPosted: Thu Nov 16, 2023 9:46 pm
by lundman
If you mean the same Sonoma x86 from DMG, then yes, identical package. If another version, I need to know about it.

Re: 2.2.0 kernel crash on Sonoma x64

PostPosted: Thu Nov 16, 2023 10:08 pm
by Jimbo
Yeah, sorry, the kexts from the Sonoma x86 package from the DMG were causing panics on unload.

The new Sonoma package above seems to be behaving itself on my machines.