Re: [RFC] Parallelize IO for e2fsck

!MAILaRCHIVE_VOTE_RePLACE
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
To: David Chinner <dgc@...>
Cc: Andreas Dilger <adilger@...>, <linux-ext4@...>, <linux-fsdevel@...>, <linux-kernel@...>, Ric Wheeler <ric@...>, Theodore Ts'o <tytso@...>, Valerie Henson <val@...>
Date: Tuesday, January 22, 2008 - 1:42 pm

>I think there is a clear need for applications to be able to

The problem with that approach is that the Fsck process doesn't know how 
its need for memory compares with other process' need for memory.  How 
much memory should it give up?  Maybe it should just quit altogether if 
other processes are in danger of deadlocking.  Or maybe it's best for it 
to keep all its memory and let some other frivolous process give up its 
memory instead.

It's the OS's job to have a view of the entire system and make resource 
allocation decisions.

If it's just a matter of the application choosing a better page frame to 
vacate than what the kernel would have taken, (which is more a matter of 
self-interest than resource allocation), then Fsck can do that more 
directly by just monitoring its own page fault rate.  If it's high, then 
it's using more real memory than the kernel thinks it's entitled to and it 
can reduce its memory footprint to improve its speed.  It can even check 
whether an access to readahead data caused a page fault; if so, it knows 
reading ahead is actually making things worse and therefore reduce 
readahead until the page faults stop happening.

--
Bryan Henderson                     IBM Almaden Research Center
San Jose CA                         Filesystems

-
To unsubscribe from this list: send the line "unsubscribe linux-fsdevel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
[RFC] Parallelize IO for e2fsck, Valerie Henson, (Wed Jan 16, 5:30 pm)
Re: [RFC] Parallelize IO for e2fsck, Andreas Dilger, (Mon Jan 21, 7:00 pm)
Re: [RFC] Parallelize IO for e2fsck, David Chinner, (Mon Jan 21, 11:38 pm)
Re: [RFC] Parallelize IO for e2fsck, Bryan Henderson, (Tue Jan 22, 1:42 pm)
Re: [RFC] Parallelize IO for e2fsck, Andreas Dilger, (Tue Jan 22, 3:05 am)
Re: [RFC] Parallelize IO for e2fsck, David Chinner, (Tue Jan 22, 4:16 am)
Re: [RFC] Parallelize IO for e2fsck, , (Tue Jan 22, 12:17 am)
Re: [RFC] Parallelize IO for e2fsck, Andreas Dilger, (Tue Jan 22, 3:00 am)
Re: [RFC] Parallelize IO for e2fsck, Theodore Tso, (Tue Jan 22, 10:40 am)
Re: [RFC] Parallelize IO for e2fsck, Pavel Machek, (Mon Jan 28, 3:30 pm)
Re: [RFC] Parallelize IO for e2fsck, Theodore Tso, (Mon Jan 28, 3:56 pm)
Re: [RFC] Parallelize IO for e2fsck, , (Tue Jan 29, 4:29 am)
Re: [RFC] Parallelize IO for e2fsck, Pavel Machek, (Mon Jan 28, 4:01 pm)
Re: [RFC] Parallelize IO for e2fsck, KOSAKI Motohiro, (Sun Feb 3, 9:51 am)
Re: [RFC] Parallelize IO for e2fsck, Arnaldo Carvalho de Melo, (Tue Jan 22, 10:57 am)
Re: [RFC] Parallelize IO for e2fsck, Alan Cox, (Tue Jan 22, 9:05 am)
Re: [RFC] Parallelize IO for e2fsck, David Chinner, (Thu Jan 17, 9:15 pm)
Re: [RFC] Parallelize IO for e2fsck, Valerie Henson, (Thu Jan 17, 9:43 pm)