Re: [RFC][PATCH] ChunkFS: fs fission for faster fsck

!MAILaRCHIVE_VOTE_RePLACE
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
To: David Chinner <dgc@...>
Cc: Valerie Henson <val_henson@...>, Amit Gud <gud@...>, Nikita Danilov <nikita@...>, David Lang <david.lang@...>, <linux-fsdevel@...>, <linux-kernel@...>, <riel@...>, <zab@...>, <arjan@...>, <suparna@...>, <brandon@...>, <karunasagark@...>
Date: Thursday, April 26, 2007 - 6:21 pm

On Thu, 26 April 2007 10:47:40 +1000, David Chinner wrote:

Option 1: you notice something odd while serving userspace.
Option 2: a checking/scrubbing daemon of some sorts.

The first will obviously miss any corruption in data that is not touched
for a long time (ever?).


Only chance I see is to treat this list as hints.  It should contain all
chunks that possibly have links.  It may also contain chunks that don't
have links.  By keeping strict FFS-style ordering of all relevant
writes, any mismatch should only cost fsck time.

Managing this list appears to be less than trivial.  Might actually be
easier to have LogFS-style rmap for each object in the filesystem.


If you have 5000 redundant copies of data and all get corrupted, you are
doomed.  I don't expect my filesystem to recover after having written
0x00 over the whole device.

Being able to recover a single corruption happening anywhere on the
device is already a huge step forward.  Of course most current
filesystems wouldn't even be able to detect all possible corruptions.
That alone would be a step forward.

One of the smart things of ZFS is to checksum everything.  Among the
Linux filesystems only JFFS2 seems to do it, but it cannot distinguish
between corrupted data and incomplete writes before a crash.  It
definitely costs performance, but that is the price one has to pay if
errors are to be detected.

Jörn

-- 
Do not stop an army on its way home.
-- Sun Tzu
-
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
[RFC][PATCH] ChunkFS: fs fission for faster fsck, Amit Gud, (Mon Apr 23, 7:21 am)
Re: [RFC][PATCH] ChunkFS: fs fission for faster fsck, Nikita Danilov, (Tue Apr 24, 7:44 am)
Re: [RFC][PATCH] ChunkFS: fs fission for faster fsck, David Lang, (Tue Apr 24, 2:27 pm)
Re: [RFC][PATCH] ChunkFS: fs fission for faster fsck, Nikita Danilov, (Tue Apr 24, 3:34 pm)
Re: [RFC][PATCH] ChunkFS: fs fission for faster fsck, Valerie Henson, (Wed Apr 25, 6:43 pm)
Re: [RFC][PATCH] ChunkFS: fs fission for faster fsck, David Chinner, (Wed Apr 25, 6:54 am)
Re: [RFC][PATCH] ChunkFS: fs fission for faster fsck, Valerie Henson, (Wed Apr 25, 7:03 pm)
Re: [RFC][PATCH] ChunkFS: fs fission for faster fsck, Valerie Henson, (Fri Apr 27, 1:07 am)
Re: [RFC][PATCH] ChunkFS: fs fission for faster fsck, Valerie Henson, (Sat Apr 28, 2:50 am)
Re: [RFC][PATCH] ChunkFS: fs fission for faster fsck, David Chinner, (Wed Apr 25, 8:47 pm)
Re: [RFC][PATCH] ChunkFS: fs fission for faster fsck, Jörn, (Thu Apr 26, 6:21 pm)
Re: [RFC][PATCH] ChunkFS: fs fission for faster fsck, Andreas Dilger, (Wed Apr 25, 7:38 am)
Re: [RFC][PATCH] ChunkFS: fs fission for faster fsck, Valerie Henson, (Wed Apr 25, 7:06 pm)
Re: [RFC][PATCH] ChunkFS: fs fission for faster fsck, David Lang, (Tue Apr 24, 3:26 pm)
Re: [RFC][PATCH] ChunkFS: fs fission for faster fsck, Nikita Danilov, (Wed Apr 25, 7:34 am)
Re: [RFC][PATCH] ChunkFS: fs fission for faster fsck, Valerie Henson, (Wed Apr 25, 6:47 pm)
Re: [RFC][PATCH] ChunkFS: fs fission for faster fsck, Jeff Dike, (Thu Apr 26, 10:14 am)
Re: [RFC][PATCH] ChunkFS: fs fission for faster fsck, Jeff Dike, (Thu Apr 26, 12:05 pm)
Re: [RFC][PATCH] ChunkFS: fs fission for faster fsck, Valerie Henson, (Fri Apr 27, 12:58 am)
Re: [RFC][PATCH] ChunkFS: fs fission for faster fsck, Jeff Dike, (Fri Apr 27, 11:06 am)
Re: [RFC][PATCH] ChunkFS: fs fission for faster fsck, Valerie Henson, (Tue May 1, 1:26 pm)
Re: [RFC][PATCH] ChunkFS: fs fission for faster fsck, David Lang, (Wed Apr 25, 12:39 pm)
Re: [RFC][PATCH] ChunkFS: fs fission for faster fsck, Suparna Bhattacharya, (Mon Apr 23, 12:28 pm)
Re: [RFC][PATCH] ChunkFS: fs fission for faster fsck, Suparna Bhattacharya, (Mon Apr 23, 12:32 pm)