login
Header Space

 
 

Re: Versioning file system

Score:
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
To: Chris Mason <chris.mason@...>
Cc: Jörn <joern@...>, alan <alan@...>, H. Peter Anvin <hpa@...>, Jack Stone <jack@...>, <linux-kernel@...>, <linux-fsdevel@...>, <akpm@...>, <viro@...>
Date: Monday, June 18, 2007 - 7:18 pm

On Mon, Jun 18, 2007 at 11:32:38AM -0400, Chris Mason wrote:

I have no filesystem programming experience, but I am certainly
interested, and I'm spending some time reading through the code that
you've written so far.  Oh, and running it - though I'm probably going
to want to fiddle with some smaller filesystems than my entire Maildir
set if I want to make any sense of the structure dumps!

That and of course if I get involved in development I can be sure that
my favourite workload (big Cyrus installs) is well optimized for!

Actually, my biggest interest is decent unlink performance, in
particular when you are unlinking multiple items in a directory or
even the entire directory plus everything in it.  I find that to be
an incredibly slow and IO hurting operation.  We run cyr_expire
(the process in Cyrus that actually deletes expunged messages) once
per week, and only one process at a time on a machine which might have
20 otherwise busy instances of Cyrus running - because the IO hit on
those data partitions is massive.  Load average more than doubles and
the log entries for commands which took longer than a second to return
increase massively.

And this is on a Sunday when there's barely any use compared to a
weekday.

So yeah, my main interest is making unlink (especially multiple unlinks
from the same directory) into a less extreme experience.

Bron.
-
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
Versioning file system, Jack Stone, (Fri Jun 15, 6:23 pm)
Re: Versioning file system, Kok, Auke, (Fri Jun 15, 6:57 pm)
Re: Versioning file system, alan, (Fri Jun 15, 7:01 pm)
Re: Versioning file system, Johannes Weiner, (Sat Jun 16, 7:20 am)
Re: Versioning file system, Chris Snook, (Fri Jun 15, 6:52 pm)
Re: Versioning file system, Jack Stone, (Sat Jun 16, 4:25 am)
Re: Versioning file system, Chris Snook, (Tue Jun 19, 2:03 pm)
Re: Versioning file system, Lennart Sorensen, (Tue Jun 19, 4:43 pm)
Re: Versioning file system, Bryan Henderson, (Tue Jun 19, 7:35 pm)
Re: Versioning file system, Trond Myklebust, (Tue Jun 19, 8:27 pm)
Re: Versioning file system, Bryan Henderson, (Wed Jun 20, 1:04 pm)
Re: Versioning file system, Chris Snook, (Wed Jun 20, 1:33 pm)
Re: Versioning file system, H. Peter Anvin, (Wed Jun 20, 1:10 pm)
Re: Versioning file system, H. Peter Anvin, (Wed Jun 20, 1:00 am)
Re: Versioning file system, , (Tue Jun 19, 6:07 pm)
Re: Versioning file system, Lennart Sorensen, (Tue Jun 19, 6:21 pm)
Re: Versioning file system, H. Peter Anvin, (Tue Jun 19, 6:13 pm)
Re: Versioning file system, Jan Harkes, (Tue Jun 19, 7:07 pm)
Re: Versioning file system, H. Peter Anvin, (Tue Jun 19, 7:12 pm)
Re: Versioning file system, H. Peter Anvin, (Tue Jun 19, 3:08 pm)
Re: Versioning file system, Alan Cox, (Tue Jun 19, 5:50 pm)
Re: Versioning file system, H. Peter Anvin, (Tue Jun 19, 6:07 pm)
Re: Versioning file system, Ph. Marek, (Wed Jun 20, 4:05 am)
Re: Versioning file system, Jack Stone, (Tue Jun 19, 3:12 pm)
Re: Versioning file system, Bernd Petrovitsch, (Wed Jun 20, 4:34 am)
Re: Versioning file system, Chris Snook, (Tue Jun 19, 4:10 pm)
Re: Versioning file system, Jack Stone, (Tue Jun 19, 4:14 pm)
Re: Versioning file system, Chris Snook, (Tue Jun 19, 4:31 pm)
Re: Versioning file system, H. Peter Anvin, (Tue Jun 19, 3:15 pm)
Re: Versioning file system, Jack Stone, (Tue Jun 19, 3:22 pm)
Re: Versioning file system, Jack Stone, (Tue Jun 19, 3:06 pm)
Re: Versioning file system, Chris Snook, (Tue Jun 19, 4:03 pm)
Re: Versioning file system, Jack Stone, (Tue Jun 19, 4:08 pm)
Re: Versioning file system, John Stoffel, (Tue Jun 19, 4:34 pm)
Re: Versioning file system, Matthew Wilcox, (Tue Jun 19, 4:38 pm)
Re: Versioning file system, John Stoffel, (Tue Jun 19, 5:02 pm)
Re: Versioning file system, Jack Stone, (Tue Jun 19, 4:38 pm)
Re: Versioning file system, Chris Snook, (Tue Jun 19, 4:15 pm)
Re: Versioning file system, Jack Stone, (Tue Jun 19, 4:27 pm)
Re: Versioning file system, H. Peter Anvin, (Fri Jun 15, 6:38 pm)
Re: Versioning file system, alan, (Fri Jun 15, 6:51 pm)
Re: Versioning file system, Jörn, (Sat Jun 16, 10:53 am)
Re: Versioning file system, Andreas Dilger, (Mon Jun 18, 5:45 am)
Re: Versioning file system, Sorin Faibish, (Sat Sep 29, 1:44 pm)
Re: Versioning file system, Chris Mason, (Mon Jun 18, 11:32 am)
Re: Versioning file system, Bron Gondwana, (Mon Jun 18, 7:18 pm)
Re: Versioning file system, Theodore Tso, (Mon Jun 18, 10:01 am)
Re: Versioning file system, alan, (Mon Jun 18, 12:16 pm)
Re: Versioning file system, Theodore Tso, (Mon Jun 18, 1:29 pm)
Re: Versioning file system, Erik Mouw, (Wed Jul 4, 1:32 pm)
Re: Versioning file system, John Stoffel, (Thu Jul 5, 9:57 am)
Re: Versioning file system, Erik Mouw, (Thu Jul 5, 1:57 pm)
Re: Versioning file system, Chris Mason, (Thu Jul 5, 10:23 am)
Re: Versioning file system, Theodore Tso, (Wed Jul 4, 4:47 pm)
Re: Versioning file system, Erik Mouw, (Thu Jul 5, 1:55 pm)
Re: Versioning file system, Jeremy Allison, (Mon Jun 18, 1:33 pm)
Re: Versioning file system, Theodore Tso, (Mon Jun 18, 4:30 pm)
Re: Versioning file system, J. Bruce Fields, (Mon Jun 18, 4:50 pm)
Re: Versioning file system, H. Peter Anvin, (Mon Jun 18, 1:46 pm)
Re: Versioning file system, Jörn, (Mon Jun 18, 6:13 am)
Re: Versioning file system, Jack Stone, (Mon Jun 18, 5:54 am)
Re: Versioning file system, Jack Stone, (Sat Jun 16, 4:11 am)
Re: Versioning file system, Jeffrey V. Merkey, (Sat Jun 16, 5:46 am)
Re: Versioning file system, Graham Murray, (Sat Jun 16, 7:42 am)
Re: Versioning file system, Jeffrey V. Merkey, (Sat Jun 16, 6:12 am)
Re: Versioning file system, Jan Harkes, (Sat Jun 16, 12:49 pm)
Re: Versioning file system, Jeffrey V. Merkey, (Sat Jun 16, 4:03 pm)
Re: Versioning file system, Dale Amon, (Sat Jun 16, 5:06 pm)
Re: Versioning file system, Jan Harkes, (Sat Jun 16, 4:39 pm)
Re: Versioning file system, Alan Cox, (Sat Jun 16, 6:17 pm)
Re: Versioning file system, Dale Amon, (Sun Jun 17, 6:11 pm)
Re: Versioning file system, Jeffrey V. Merkey, (Sat Jun 16, 10:18 pm)
Re: Versioning file system, Jeffrey V. Merkey, (Sat Jun 16, 10:39 pm)
Re: Versioning file system, Jack Stone, (Sat Jun 16, 4:43 pm)
Re: Versioning file system, Alan Cox, (Sat Jun 16, 4:08 pm)
Re: Versioning file system, Jeffrey V. Merkey, (Sat Jun 16, 5:25 pm)
Re: Versioning file system, Jack Stone, (Sat Jun 16, 3:38 pm)
Re: Versioning file system, Mark Williamson, (Sat Jun 16, 9:15 am)
Re: Versioning file system, Jeffrey V. Merkey, (Sat Jun 16, 3:57 pm)
Re: Versioning file system, H. Peter Anvin, (Fri Jun 15, 6:59 pm)
Re: Versioning file system, alan, (Fri Jun 15, 7:06 pm)
speck-geostationary