How to fix: errors: Permanent errors have been detected?

All your general support questions for OpenZFS on OS X.

How to fix: errors: Permanent errors have been detected?

Postby novice » Wed Jun 09, 2021 7:25 pm

Hi everyone,

Recently I was facing error:

mirror0: checksum error 20
disk1 checksum error 40
disk2 checksum error 40
mirror1
disk3
disk4
mirror2
disk5
disk6
errors: Permanent errors have been detected in the following files:
/foo/bar
/foo/baz

What I did was replaced disk2 with a new one and resilvered. And got:

mirror0: checksum error 2
disk1 checksum error 4
disk2_new checksum error 4
mirror1
disk3
disk4
mirror2
disk5
disk6
errors: Permanent errors have been detected in the following files:
/foo/bar
/foo/baz

I ignored the checksum error (reduced from 20 to 2, 40 to 4) and did a scrub.

After the scrub finished, still got:
mirror0: checksum error 2
disk1 checksum error 4
disk2_new checksum error 4
mirror1
disk3
disk4
mirror2
disk5
disk6
errors: Permanent errors have been detected in the following files:
/foo/bar
/foo/baz

When I read these two files, I got io error.

I was wondering:
1. is what I did with resilver correct? Could I do things better?
2. is there anyway to read these files with error anyway (ignoring the error)? I tried to disable checksum, but still got io error when read it.
3. how to clear the error message "errors: Permanent errors have been detected in the following files:" after I recovered the two files?

Thanks!
novice
 
Posts: 8
Joined: Tue May 25, 2021 8:49 pm

Re: How to fix: errors: Permanent errors have been detected?

Postby lundman » Mon Jun 21, 2021 4:45 pm

I think you should "rm" the two files, but you also need to make sure any snapshot/bookmark that contain them have been removed, then you run a "zpool clear" command.
User avatar
lundman
 
Posts: 1335
Joined: Thu Mar 06, 2014 2:05 pm
Location: Tokyo, Japan

Re: How to fix: errors: Permanent errors have been detected?

Postby novice » Fri Jul 02, 2021 8:23 pm

Thanks! I replaced disk and removed these two files, the errors are gone now.
After using ZFS I begin to see file corruption very occasionally, I guess before using ZFS, I simply did not know data was corrupted :)
novice
 
Posts: 8
Joined: Tue May 25, 2021 8:49 pm

Re: How to fix: errors: Permanent errors have been detected?

Postby JasonBelec » Wed Jul 07, 2021 6:08 am

Might I suggested you test the hardware your ZFS is on. We usually see these issues with hardware, like bad cables, bad back planes, bad power, very rarely is it a drive issue per say.
JasonBelec
 
Posts: 32
Joined: Mon Oct 26, 2015 1:07 pm

Re: How to fix: errors: Permanent errors have been detected?

Postby novice » Sat Jul 10, 2021 9:57 am

Thanks all. Seems it's bad cable.
novice
 
Posts: 8
Joined: Tue May 25, 2021 8:49 pm


Return to General Help

Who is online

Users browsing this forum: No registered users and 33 guests