Kernel Panic Issues after installing 2.0.0 RC5 on Big Sur

[lundman]

This dance is interesting:

Code: Select all

0xffffffb11fb18ae0 : 0xffffff801c943ac4 mach_kernel : _vfs_init_io_attributes + 0x7f4
0xffffffb11fb18b60 : 0xffffff7fbdcba775 net.lundman.zfs : _zfs_znode_getvnode + 0x1b5
0xffffffb11fb18c00 : 0xffffff7fbdcc04dc net.lundman.zfs : _zfs_zget_ext + 0x3cc
0xffffffb11fb18cb0 : 0xffffff7fbdc8f582 net.lundman.zfs : _zfs_rmnode + 0x102
0xffffffb11fb18ea0 : 0xffffff7fbdcb85a0 net.lundman.zfs : _zfs_vnop_reclaim + 0x180
0xffffffb11fb18ed0 : 0xffffff801c940f93 mach_kernel : _vnode_getiocount + 0x1233


It's here to get rid of a vnode, calls reclaim, and we call rmnode to remove it, but we have to go fetch another vnode (zget) for some reason, which ends up calling reclaim again, until we run out of stack.

[lundman]

Posted new version to address the reclaim loop - turns out the old port calls it ASYNC due to this reason so that has been copied over.

In theory you want
# md5sum OpenZFSonOsX-2.0.0-Big.Sur-11.0.pkg
45a0914cc5d36856f79495995a5e068e OpenZFSonOsX-2.0.0-Big.Sur-11.0.pkg

# zpool version
zfs-2.0.0-rc1_249_g9b6619e77e
zfs-kmod-zfs-2.0.0-rc1-249-g9b6619e77e-dirty

[Jimbo]

Downloading the new version to give it a try.

Any thoughts about why I was/am getting on-boot panics when I clear/reset boot-args and not getting on-boot panics if I set boot-args="keepsyms=1 debug=0x146"?

[Jimbo]

Thanks @lundman

The new versions doesn't panic when deleting lots of files now, excellent!

It still complains about the disk not being ejected properly prior to being unmounted - this seems to only apply to the root data set (or maybe the pool?). There are no warnings/errors shown when exporting child data sets.

I'll play around more with it later.

Cheers!
James

[Jimbo]

Hmm... ok, with the latest build, I'm getting a panic on boot with a Parallels VM on iMac Pro - Intel Xeon W - (invalid opcode, avx512f again?):

Code: Select all

panic(cpu 0 caller 0xffffff800c7efa76): Kernel trap at 0xffffff7fadcc4190, type 6=invalid opcode, registers:
CR0: 0x00000000c001003b, CR2: 0x000000010d000004, CR3: 0x00000000108d5000, CR4: 0x00000000001606e0
RAX: 0x0000000000000000, RBX: 0x0000000000004000, RCX: 0x0000000000000000, RDX: 0x0000000000000100
RSP: 0xffffffb06ebcbb10, RBP: 0xffffffb06ebcbb10, RSI: 0xffffffb06f768000, RDI: 0xffffffb06f788000
R8:  0x0000000000004000, R9:  0xffffff7fadcc4180, R10: 0xffffffb06f78c000, R11: 0xffffffffffffc000
R12: 0x0000000000000000, R13: 0xffffffb06ebcbb28, R14: 0xffffffb06ebcbb28, R15: 0xffffffb06ebcbb58
RFL: 0x0000000000010246, RIP: 0xffffff7fadcc4190, CS:  0x0000000000000008, SS:  0x0000000000000000
Fault CR2: 0x000000010d000004, Error code: 0x0000000000000000, Fault CPU: 0x0 VMM, PL: 0, VF: 0

Backtrace (CPU 0), Frame : Return Address
0xffffffb06ebcb530 : 0xffffff800c6bc66d mach_kernel : _handle_debugger_trap + 0x3dd
0xffffffb06ebcb580 : 0xffffff800c7ff073 mach_kernel : _kdp_i386_trap + 0x143
0xffffffb06ebcb5c0 : 0xffffff800c7ef6aa mach_kernel : _kernel_trap + 0x55a
0xffffffb06ebcb610 : 0xffffff800c661a2f mach_kernel : _return_from_trap + 0xff
0xffffffb06ebcb630 : 0xffffff800c6bbf0d mach_kernel : _DebuggerTrapWithState + 0xad
0xffffffb06ebcb750 : 0xffffff800c6bc1f8 mach_kernel : _panic_trap_to_debugger + 0x268
0xffffffb06ebcb7c0 : 0xffffff800cebee1a mach_kernel : _panic + 0x54
0xffffffb06ebcb830 : 0xffffff800c7efa76 mach_kernel : _sync_iss_to_iks + 0x2c6
0xffffffb06ebcb9b0 : 0xffffff800c7ef75d mach_kernel : _kernel_trap + 0x60d
0xffffffb06ebcba00 : 0xffffff800c661a2f mach_kernel : _return_from_trap + 0xff
0xffffffb06ebcba20 : 0xffffff7fadcc4190 net.lundman.zfs : _raidz_copy_abd_cb + 0x10
0xffffffb06ebcbb10 : 0xffffff7fada72227 net.lundman.zfs : _abd_iterate_func2 + 0x297
0xffffffb06ebcbbf0 : 0xffffff7fadcc2f42 net.lundman.zfs : _avx512f_gen_p + 0x42
0xffffffb06ebcbc30 : 0xffffff7fadb376d0 net.lundman.zfs : _vdev_raidz_math_generate + 0x40
0xffffffb06ebcbc40 : 0xffffff7fadb33d09 net.lundman.zfs : _vdev_raidz_generate_parity + 0x19
0xffffffb06ebcbcb0 : 0xffffff7fadb37a78 net.lundman.zfs : _vdev_raidz_math_init + 0x258
0xffffffb06ebcbd20 : 0xffffff7fadb19571 net.lundman.zfs : _spa_init + 0x131
0xffffffb06ebcbd60 : 0xffffff7fadb67344 net.lundman.zfs : _zfs_kmod_init + 0x24
0xffffffb06ebcbd90 : 0xffffff7fadb74164 net.lundman.zfs : __ZN20net_lundman_zfs_zvol5startEP9IOService + 0x1a4
0xffffffb06ebcbdd0 : 0xffffff800cdef09b mach_kernel : __ZN9IOService14startCandidateEPS_ + 0xeb
0xffffffb06ebcbe40 : 0xffffff800cdeec46 mach_kernel : __ZN9IOService15probeCandidatesEP12OSOrderedSet + 0xce6
0xffffffb06ebcbef0 : 0xffffff800cdeddcf mach_kernel : __ZN9IOService14doServiceMatchEj + 0x30f
0xffffffb06ebcbf50 : 0xffffff800cdf0b46 mach_kernel : __ZN15_IOConfigThread4mainEPvi + 0x186
0xffffffb06ebcbfa0 : 0xffffff800c66113e mach_kernel : _call_continuation + 0x2e
      Kernel Extensions in backtrace:
         net.lundman.zfs(2.0)[9A69A216-52E1-31F2-B7F9-5A8CF86C5E50]@0xffffff7fada70000->0xffffff7fadd9ffff
            dependency: com.apple.iokit.IOStorageFamily(2.1)[3FE3BE82-782C-3D93-8EFA-F06A4594D17C]@0xffffff800f137000->0xffffff800f148fff

Process name corresponding to current thread: kernel_task
Boot args: keepsyms=1 -serial=0x2

Mac OS version:
20B29

Kernel version:
Darwin Kernel Version 20.1.0: Sat Oct 31 00:07:11 PDT 2020; root:xnu-7195.50.7~2/RELEASE_X86_64
Kernel UUID: 84C6DC45-6B02-335F-9439-5D2A9BC385A4
KernelCache slide: 0x000000000c400000
KernelCache base:  0xffffff800c600000
Kernel slide:      0x000000000c410000
Kernel text base:  0xffffff800c610000
__HIB  text base: 0xffffff800c500000
System model name: Parallels16,1 (Mac-7BA5B2D9E42DDD94)
System shutdown begun: NO
Panic diags file available: YES (0x0)
Hibernation exit count: 0

System uptime in nanoseconds: 12914777113
Last Sleep:           absolute           base_tsc          base_nano
  Uptime  : 0x0000000301c7dff0
  Sleep   : 0x0000000000000000 0x0000000000000000 0x0000000000000000
  Wake    : 0x0000000000000000 0x0000000d35211398 0x0000000000000000
last started kext at 11020104453: >!AHIDKeyboard   222 (addr 0xffffff800da8d000, size 16384)
loaded kexts:
net.lundman.zfs   2.0.0
com.parallels.kext.tg   16.1.0 48950
com.parallels.kext.video   16.1.0 48950
>!AHDAHardwareConfigDriver   283.15
>!AGraphicsDevicePolicy   6.1.27
>!AHDA   283.15
@AGDCPluginDisplayMetrics   6.1.27
>pmtelemetry   1
>LuaHardwareAccess   1.0.16
|IOUserEthernet   1.0.1
>usb.!UUserHCI   1
|IO!BSerialManager   8.0.1f5
@Dont_Steal_Mac_OS_X   7.0.0
>!AHV   1
>!ADiskImages2   1
>!A!IMCEReporter   115
>!APVPanic   1
>!AUpstreamUserClient   3.6.8
>!AMCCSControl   1.14
>!AFIVRDriver   4.1.0
>!A!ISlowAdaptiveClocking   4.0.0
>ACPI_SMC_PlatformPlugin   1.0.0
|SCSITaskUserClient   436.40.6
>!AFileSystemDriver   3.0.1
@filesystems.tmpfs   1
@filesystems.hfs.kext   556.41.1
@BootCache   40
@!AFSCompression.!AFSCompressionTypeZlib   1.0.0
@!AFSCompression.!AFSCompressionTypeDataless   1.0.0d1
@filesystems.apfs   1677.50.1
>!AAHCIPort   346
>!A!I8254XEthernet   3.1.5
@private.KextAudit   1.0
>!AACPIButtons   6.1
>!AHPET   1.8
>!ARTC   2.0
>!ASMBIOS   2.1
>!AAPIC   1.7
@!ASystemPolicy   2.0.0
@nke.applicationfirewall   310
|IOKitRegistryCompatibility   1
|EndpointSecurity   1
>!AHIDKeyboard   222
>!AGraphicsControl   6.1.27
>DspFuncLib   283.15
@kext.OSvKernDSPLib   529
|IOSerial!F   11
|IOAVB!F   900.12
>!AHDA!C   283.15
|IOHDA!F   283.15
|IOAudio!F   300.6.1
@vecLib.kext   1.2.0
@plugin.IOgPTPPlugin   900.11
|IOEthernetAVB!C   1.1.0
>!ASMBus!C   1.0.18d1
|IOSMBus!F   1.1
|IONDRVSupport   585
@!AGPUWrangler   6.1.27
@!AGraphicsDeviceControl   6.1.27
|IOSlowAdaptiveClocking!F   1.0.0
|IOGraphics!F   585
>IOPlatformPluginLegacy   1.0.0
>IOPlatformPlugin!F   6.0.0d8
>usb.IOUSBHostHIDDevice   1.2
>usb.cdc   5.0.0
>usb.networking   5.0.0
>usb.!UHostCompositeDevice   1.2
|IOSCSIMultimediaCommandsDevice   436.40.6
|IOBD!S!F   1.8
|IODVD!S!F   1.8
|IOCD!S!F   1.8
>!ABSDKextStarter   3
|IOSurface   289.3
|IOSkywalk!F   1
>mDNSOffloadUserClient   1.0.1b8
@filesystems.hfs.encodings.kext   1
>!AXsanScheme   3
|IOAHCISerialATAPI   268
|IOAHCIBlock!S   332
>usb.!UUHCIPCI   1.2
>usb.!UUHCI   1.2
|IOAHCI!F   294
>usb.!UEHCIPCI   1.2
>usb.!UEHCI   1.2
>usb.!UHostPacketFilter   1.0
|IOUSB!F   900.4.2
>!AEFINVRAM   2.1
>!AEFIRuntime   2.1
|IOHID!F   2.0.0
$!AImage4   3.0.0
|IOTimeSync!F   900.11
|IONetworking!F   3.4
>DiskImages   493.0.0
|IO!B!F   8.0.1f5
|IOReport!F   47
|IO!BPacketLogger   8.0.1f5
$quarantine   4
$sandbox   300.0
@kext.!AMatch   1.0.0d1
|CoreAnalytics!F   1
>!ASSE   1.0
>!AKeyStore   2
>!UTDM   511.40.9
|IOUSBMass!SDriver   184.40.6
|IOSCSIBlockCommandsDevice   436.40.6
|IO!S!F   2.1
|IOSCSIArchitectureModel!F   436.40.6
>!AMobileFileIntegrity   1.0.5
@kext.CoreTrust   1
>!AFDEKeyStore   28.30
>!AEffaceable!S   1.0
>!ACredentialManager   1.0
>KernelRelayHost   1
|IOUSBHost!F   1.2
>!UHostMergeProperties   1.2
>usb.!UCommon   1.0
>!ABusPower!C   1.0
>!ASEPManager   1.0.1
>IOSlaveProcessor   1
>!AACPIPlatform   6.1
>!ASMC   3.1.9
|IOPCI!F   2.9
|IOACPI!F   1.4
>watchdog   1
@kec.pthread   1
@kec.corecrypto   1.0
@kec.Libm   1


[dguisinger01]

I have tried every single build (including the 5th that came out today). Every single one has given a kernel panic on boot. None of the fixes appear to have fixed anything for me.

I am on a 2019 MBP16.

[lundman]

Turn on keepsym, and post stack please

[Jimbo]

The Big Sur 2.0-rc5.pkg seems to have gone from News & Announcements - Big Sur 2.0-rc5.pkg? Only the Catalina version is there now?

[lundman]

Corrected!

[Jimbo]

Downloaded! Thanks @lundman!