Re: [PATCH 00/23] per device dirty throttling -v8

Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
From: Theodore Tso
Date: Sunday, August 5, 2007 - 7:46 am

On Sun, Aug 05, 2007 at 01:49:26AM +0100, Alan Cox wrote:

In addition, big server boxes are usually not reading a huge *number*
of files per second.  The place where you see this as a problem is (a)
compilation, thanks to huge /usr/include hierarchies (and here things
have gotten worse over time as include files have gotten much more
complex than in the early Unix days), and (b) silly desktop apps that
want to scan huge numbers of XML files or who want to read every
single image file on the desktop or in an open file browser window to
show c00l icons.  Oh, and I guess I should include Maildir setups.

If you are always reading from the same small set of files (i.e., a
database workload), then those inodes only get updated every 5 seconds
(the traditional/default metadata update sync time, as well as the
default ext3 journal update time), it's no big deal.  Or if you are
running a mail server, most of the time the mail queue files are
getting updated anyway as you process them, and usually the mail is
delivered before 5 seconds is up anyway.  

So earlier, when Ingo characterized it as, "whenever you read from a
file, even one in memory cache.... do a write!", it's probably a bit
unfair.  Traditional Unix systems simply had very different workload
characteristics than many modern dekstop systems today.

							- Ted
-
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
[PATCH 00/23] per device dirty throttling -v8, Peter Zijlstra, (Fri Aug 3, 5:37 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Linus Torvalds, (Fri Aug 3, 3:21 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Fri Aug 3, 11:32 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sat Aug 4, 12:07 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sat Aug 4, 3:33 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Linus Torvalds, (Sat Aug 4, 9:15 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Linus Torvalds, (Sat Aug 4, 9:17 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sat Aug 4, 9:37 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Andrew Morton, (Sat Aug 4, 9:41 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Andrew Morton, (Sat Aug 4, 9:51 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sat Aug 4, 9:56 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Diego Calleja, (Sat Aug 4, 10:02 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sat Aug 4, 10:17 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Nikita Danilov, (Sat Aug 4, 10:26 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Diego Calleja, (Sat Aug 4, 10:38 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Linus Torvalds, (Sat Aug 4, 10:39 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Diego Calleja, (Sat Aug 4, 10:51 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Jeff Garzik, (Sat Aug 4, 11:08 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Florian Weimer, (Sat Aug 4, 12:16 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sat Aug 4, 12:21 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Linus Torvalds, (Sat Aug 4, 12:47 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Linus Torvalds, (Sat Aug 4, 12:49 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sat Aug 4, 1:00 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sat Aug 4, 1:11 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Arjan van de Ven, (Sat Aug 4, 1:13 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Arjan van de Ven, (Sat Aug 4, 1:13 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Jeff Garzik, (Sat Aug 4, 1:28 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sat Aug 4, 1:28 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Arjan van de Ven, (Sat Aug 4, 1:34 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sat Aug 4, 2:03 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Theodore Tso, (Sat Aug 4, 2:48 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Ilpo Järvinen, (Sat Aug 4, 3:39 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Claudio Martins, (Sat Aug 4, 4:51 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Andi Kleen, (Sat Aug 4, 5:26 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Andi Kleen, (Sat Aug 4, 5:28 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Andrew Morton, (Sat Aug 4, 11:00 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sun Aug 5, 12:13 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sun Aug 5, 12:18 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sun Aug 5, 12:21 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sun Aug 5, 12:28 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Andrew Morton, (Sun Aug 5, 12:29 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sun Aug 5, 12:37 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sun Aug 5, 12:39 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Florian Weimer, (Sun Aug 5, 12:57 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Willy Tarreau, (Sun Aug 5, 1:53 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Jeff Garzik, (Sun Aug 5, 2:04 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Jakob Oestergaard, (Sun Aug 5, 3:20 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Jakob Oestergaard, (Sun Aug 5, 3:29 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Jeff Garzik, (Sun Aug 5, 3:42 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Jakob Oestergaard, (Sun Aug 5, 3:58 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sun Aug 5, 5:46 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sun Aug 5, 5:54 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sun Aug 5, 5:56 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sun Aug 5, 5:58 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Diego Calleja, (Sun Aug 5, 6:22 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Willy Tarreau, (Sun Aug 5, 6:29 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Jakob Oestergaard, (Sun Aug 5, 6:46 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Theodore Tso, (Sun Aug 5, 7:46 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Theodore Tso, (Sun Aug 5, 8:00 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Linus Torvalds, (Sun Aug 5, 9:45 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sun Aug 5, 10:55 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Jeff Garzik, (Sun Aug 5, 10:59 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Arjan van de Ven, (Sun Aug 5, 11:01 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Arjan van de Ven, (Sun Aug 5, 11:02 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Arjan van de Ven, (Sun Aug 5, 11:08 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sun Aug 5, 11:08 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sun Aug 5, 11:09 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Dave Jones, (Sun Aug 5, 11:44 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sun Aug 5, 12:09 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Alan Cox, (Sun Aug 5, 12:11 pm)
[patch] implement smarter atime updates support, Ingo Molnar, (Sun Aug 5, 12:22 pm)
[patch] implement smarter atime updates support, v2, Ingo Molnar, (Sun Aug 5, 12:28 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Alan Cox, (Sun Aug 5, 12:29 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sun Aug 5, 12:32 pm)
Re: [patch] implement smarter atime updates support, Arjan van de Ven, (Sun Aug 5, 12:53 pm)
Re: [patch] implement smarter atime updates support, Arjan van de Ven, (Sun Aug 5, 1:22 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Andrew Morton, (Sun Aug 5, 1:33 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Christoph Hellwig, (Sun Aug 5, 1:34 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Christoph Hellwig, (Sun Aug 5, 1:36 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Christoph Hellwig, (Sun Aug 5, 1:41 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Christoph Hellwig, (Sun Aug 5, 1:43 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Theodore Tso, (Sun Aug 5, 3:46 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, David Chinner, (Sun Aug 5, 4:43 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, David Chinner, (Sun Aug 5, 5:24 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sun Aug 5, 11:39 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sun Aug 5, 11:52 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sun Aug 5, 11:57 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Sun Aug 5, 11:58 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Andi Kleen, (Mon Aug 6, 3:42 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Willy Tarreau, (Mon Aug 6, 6:12 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Chris Mason, (Mon Aug 6, 6:47 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Dave Jones, (Mon Aug 6, 8:59 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Mon Aug 6, 9:16 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Chuck Ebbert, (Mon Aug 6, 11:03 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Jeff Garzik, (Mon Aug 6, 11:53 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Alan Cox, (Mon Aug 6, 12:37 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Chuck Ebbert, (Mon Aug 6, 12:46 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Miklos Szeredi, (Mon Aug 6, 1:26 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Ingo Molnar, (Tue Aug 7, 12:05 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Bill Davidsen, (Tue Aug 7, 11:55 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Bill Davidsen, (Tue Aug 7, 12:09 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Alan Cox, (Tue Aug 7, 12:35 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Bill Davidsen, (Tue Aug 7, 2:20 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Karel Zak, (Wed Aug 8, 3:43 am)
Re: [PATCH 00/23] per device dirty throttling -v8, richard kennedy, (Wed Aug 8, 5:25 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Andi Kleen, (Wed Aug 8, 6:54 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Bill Davidsen, (Wed Aug 8, 10:44 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Bill Davidsen, (Wed Aug 8, 11:22 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Jeff Garzik, (Wed Aug 8, 12:39 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Bill Davidsen, (Wed Aug 8, 1:31 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Martin J. Bligh, (Wed Aug 8, 2:10 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Andrew Morton, (Wed Aug 8, 2:21 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Martin Bligh, (Wed Aug 8, 5:54 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Greg Trounson, (Wed Aug 8, 5:57 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Andi Kleen, (Wed Aug 8, 7:33 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Lionel Elie Mamane, (Wed Aug 8, 11:25 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Chuck Ebbert, (Thu Aug 9, 8:02 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Diego Calleja, (Thu Aug 9, 9:22 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Bill Davidsen, (Thu Aug 9, 5:21 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Bill Davidsen, (Thu Aug 9, 9:04 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Bill Davidsen, (Thu Aug 9, 9:17 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Valdis.Kletnieks, (Fri Aug 10, 10:19 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Valerie Henson, (Sat Aug 11, 4:14 pm)
Re: [PATCH 00/23] per device dirty throttling -v8, Helge Hafting, (Tue Aug 14, 2:57 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Helge Hafting, (Thu Aug 16, 3:18 am)
Re: [PATCH 00/23] per device dirty throttling -v8, Dave Jones, (Thu Aug 16, 5:45 pm)