Cannot send->file->receive

[perry]

I use send|receive pipelines to great effect, both locally and through ssh. Never had an "unexplainable" failure there. But recently I went through a bout of benchmarking (qualifying a TrueNAS appliance), and in the process tried to break up the pipe by sending to a file and then receiving from the file. And that breaks, weirdly.

This works fine:

$ sw_vers
ProductName: macOS
ProductVersion: 13.5
BuildVersion: 22G74
$ zfs --version
zfs-macOS-2.1.6-1
zfs-kmod-2.1.6-1
$ zfs send -Re main/test/src@snap | zfs receive -Fuv main/test/dst
receiving full stream of main/test/src@snap into main/test/dst@snap

This doesn't:

$ zfs send -Re main/test/src@snap >/tmp/stream
$ zfs receive -Fuv main/test/dst </tmp/stream
receiving full stream of main/test/src@snap into main/test/dst@snap
cannot receive new filesystem stream: incompatible embedded data stream feature with encrypted receive.

Nothing in this pool is encrypted. This is entirely reproducible (src contains a single trivial file). It works (with a file) on Linux (TrueNAS-SCALE-22.12.3.3, zfs-2.1.11-1). It fails when macOS is sending and Linux is receiving. It seems to work on a 10.15.7 system running zfs-macOS-2.1.0-1. A stream generated there still fails to receive on the 13.5 system. Receiving a stream generated on 13.5 on the 10.15.7 system fails but complains about "checksum mismatch". It's all terribly confounding.

The only mention of this problem is https://github.com/openzfs/zfs/issues/8886, but that got closed as intermittent and ultimately unreproducible.

Any ideas? How do I debug this? FWIW, the entire stream file is 2MB and contains no secrets, so I'm happy to share it.

Cheers
-- perry

[sper23]

I also have been unable to receive snapshots from a file on 2.1.6— see my post here: https://openzfsonosx.org/forum/viewtopic.php?f=26&t=3811

The error message is different ("invalid backup stream" vs. "incompatible embedded data" or "checksum mismatch"), so it is possible that the underlying problems are different. But the effect is the same— receiving snapshots from files works fine on 2.1.0 but not on 2.1.6. Actually I'd be happy to solve this for myself by downgrading my Ventura system to zfs-MacOS-2.1.0, but 2.1.0 hangs on boot for me under Ventura.

Thanks.

[sper23]

See my recent update to the other thread here: https://openzfsonosx.org/forum/viewtopic.php?f=26&t=3811

Maybe that will resolve the issue for you.