Re: OOM killer gripe (was Re: What still uses the block layer?)

!MAILaRCHIVE_VOTE_RePLACE
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
To: Nick Piggin <nickpiggin@...>
Cc: Eric W. Biederman <ebiederm@...>, Rob Landley <rob@...>, Theodore Tso <tytso@...>, James Bottomley <James.Bottomley@...>, Matthew Wilcox <matthew@...>, <linux-kernel@...>, <linux-scsi@...>, Jens Axboe <axboe@...>, Suparna Bhattacharya <suparna@...>, Nick Piggin <piggin@...>
Date: Thursday, October 18, 2007 - 9:00 am

On Tue, Oct 16, 2007 at 05:34:15PM +1000, Nick Piggin wrote:

Right. But you need a differential hit rate of only a few percent on
that 1020 extra kb of data you swapped in versus the 1Mb of data you
swapped out for this to be advantageous.

With "differential hit rate" I mean the chances of getting a hit on
the 1Mb of data just paged in, minus the chances of getting a hit on
the 1Mb of data just paged out. 

With a little luck that 1Mb that is paged out didn't get used for
quite a while, while there is a hint that the 1Mb you're paging in
is active, as one of its sub-pages just got a hit.

So... IMHO, it would be useful to implement something that pages out
chunks of memory larger than a single hardware page. This would reduce
the size of the memory management tables (*), as well as improve disk
throughput if things DO come to paging....

This should of course be configurable. Some workloads are better off
with a virtual page size of 8k, some with 128k. some with 1M.

As far as I can see, the "page-cluster" parameter defines how many
pages at a time are selected for page-out at a time. This increases
the page-out efficiency. Improving the page-in efficiency is also
useful: It is the other half of hte equation.

	Roger. 


(*) If the kernel starts working with a 1Mb virtual page size, you
need a 256 times smaller mapping table between processes and memory or
swap. Of course, the hardware doesn't support this (actually, it does
for 1Mb virtual pages), so you'll have to create 256 page table
entries for the hardware instead of just one.



-- 
** R.E.Wolff@BitWizard.nl ** http://www.BitWizard.nl/ ** +31-15-2600998 **
**    Delftechpark 26 2628 XH  Delft, The Netherlands. KVK: 27239233    **
*-- BitWizard writes Linux device drivers for any device you may have! --*
Q: It doesn't work. A: Look buddy, doesn't work is an ambiguous statement. 
Does it sit on the couch all day? Is it unemployed? Please be specific! 
Define 'it' and what it isn't doing. --------- Adapted from lxrbot FAQ
-
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
What still uses the block layer?, Rob Landley, (Thu Oct 11, 9:11 pm)
Re: What still uses the block layer?, Matthew Wilcox, (Sat Oct 13, 6:05 pm)
Re: What still uses the block layer?, James Bottomley, (Sun Oct 14, 6:24 pm)
Re: What still uses the block layer?, Luben Tuikov, (Sun Oct 14, 8:45 pm)
Re: What still uses the block layer?, Rob Landley, (Mon Oct 15, 2:51 am)
Re: What still uses the block layer?, Luben Tuikov, (Mon Oct 15, 4:37 am)
Re: What still uses the block layer?, Rob Landley, (Sun Oct 14, 7:45 pm)
Re: What still uses the block layer?, James Bottomley, (Mon Oct 15, 9:10 am)
Re: What still uses the block layer?, Rob Landley, (Mon Oct 15, 5:51 pm)
Re: What still uses the block layer?, Greg KH, (Mon Oct 15, 2:00 am)
Re: What still uses the block layer?, Rob Landley, (Mon Oct 15, 4:36 am)
Re: What still uses the block layer?, Greg KH, (Mon Oct 15, 1:25 pm)
Re: What still uses the block layer?, Rob Landley, (Mon Oct 15, 6:54 pm)
Re: What still uses the block layer?, Jeff Garzik, (Mon Oct 15, 2:46 pm)
Re: What still uses the block layer?, Bill Davidsen, (Wed Oct 17, 7:43 pm)
Re: What still uses the block layer?, Stefan Richter, (Tue Oct 16, 2:33 am)
Re: What still uses the block layer?, Matthew Wilcox, (Mon Oct 15, 2:00 pm)
Re: What still uses the block layer?, Arjan van de Ven, (Mon Oct 15, 10:00 am)
Re: What still uses the block layer?, Matthew Garrett, (Mon Oct 15, 2:56 pm)
Re: What still uses the block layer?, Alan Cox, (Mon Oct 15, 9:08 am)
Re: What still uses the block layer?, Christoph Hellwig, (Mon Oct 15, 4:52 am)
Re: What still uses the block layer?, Theodore Tso, (Sun Oct 14, 9:45 pm)
Re: What still uses the block layer?, Rob Landley, (Mon Oct 15, 4:04 am)
Re: What still uses the block layer?, , (Wed Oct 17, 1:34 am)
Re: What still uses the block layer?, , (Wed Oct 17, 2:07 am)
Re: What still uses the block layer?, Theodore Tso, (Mon Oct 15, 9:21 am)
Re: What still uses the block layer?, , (Mon Oct 15, 10:51 pm)
Re: What still uses the block layer?, Douglas Gilbert, (Mon Oct 15, 10:46 am)
Re: What still uses the block layer?, Alan Cox, (Mon Oct 15, 9:29 am)
Re: What still uses the block layer?, Jeff Garzik, (Mon Oct 15, 1:44 pm)
Re: What still uses the block layer?, Theodore Tso, (Mon Oct 15, 9:35 am)
Re: What still uses the block layer?, Loïc Grenié, (Mon Oct 15, 6:32 am)
Re: What still uses the block layer?, Rob Landley, (Mon Oct 15, 5:09 pm)
Re: What still uses the block layer?, Julian Calaby, (Mon Oct 15, 5:06 am)
Re: What still uses the block layer?, Rob Landley, (Mon Oct 15, 6:08 am)
Re: What still uses the block layer?, Greg KH, (Mon Oct 15, 1:33 pm)
Re: What still uses the block layer?, , (Mon Oct 15, 10:54 pm)
Re: What still uses the block layer?, Matthew Wilcox, (Tue Oct 16, 12:04 am)
Re: What still uses the block layer?, Greg KH, (Tue Oct 16, 12:21 am)
Re: What still uses the block layer?, , (Tue Oct 16, 1:00 am)
Re: What still uses the block layer?, Arjan van de Ven, (Tue Oct 16, 12:11 am)
Re: What still uses the block layer?, , (Tue Oct 16, 12:15 am)
Re: OOM killer gripe (was Re: What still uses the block laye..., Eric W. Biederman, (Mon Oct 15, 11:55 pm)
Re: OOM killer gripe (was Re: What still uses the block laye..., Eric W. Biederman, (Tue Oct 16, 12:38 am)
Re: OOM killer gripe (was Re: What still uses the block laye..., Eric W. Biederman, (Tue Oct 16, 5:31 am)
Re: OOM killer gripe (was Re: What still uses the block laye..., Rogier Wolff, (Thu Oct 18, 9:00 am)
Re: OOM killer gripe (was Re: What still uses the block laye..., Eric W. Biederman, (Tue Oct 16, 12:45 am)
Re: What still uses the block layer?, David Newall, (Sun Oct 14, 1:54 am)
Re: What still uses the block layer?, Stefan Richter, (Sun Oct 14, 1:46 pm)
Re: What still uses the block layer?, Rob Landley, (Sun Oct 14, 7:36 pm)
Re: What still uses the block layer?, Stefan Richter, (Mon Oct 15, 1:44 am)
Re: What still uses the block layer?, Rob Landley, (Mon Oct 15, 5:26 am)
Re: What still uses the block layer?, Wilfried Klaebe, (Mon Oct 15, 4:29 pm)
Re: What still uses the block layer?, Matthew Wilcox, (Mon Oct 15, 12:08 pm)
Re: What still uses the block layer?, Stefan Richter, (Mon Oct 15, 1:10 pm)
Re: What still uses the block layer?, , (Mon Oct 15, 11:06 pm)
Re: What still uses the block layer?, Alan Cox, (Tue Oct 16, 6:19 am)
Re: What still uses the block layer?, , (Tue Oct 16, 3:54 pm)
Re: What still uses the block layer?, Matthew Wilcox, (Tue Oct 16, 3:54 pm)
Re: What still uses the block layer?, , (Tue Oct 16, 4:55 pm)
Re: What still uses the block layer?, Gabor Gombas, (Wed Oct 17, 5:48 am)
Re: What still uses the block layer?, , (Wed Oct 17, 5:04 pm)
Re: What still uses the block layer?, Stefan Richter, (Wed Oct 17, 1:23 pm)
Re: What still uses the block layer?, Alan Cox, (Tue Oct 16, 5:49 pm)
Re: What still uses the block layer?, Theodore Tso, (Tue Oct 16, 4:34 pm)
Re: What still uses the block layer?, Stefan Richter, (Tue Oct 16, 4:56 pm)
Re: What still uses the block layer?, Stefan Richter, (Tue Oct 16, 4:18 pm)
Re: What still uses the block layer?, Stefan Richter, (Tue Oct 16, 1:56 am)
Re: What still uses the block layer?, Tilman Schmidt, (Sun Oct 14, 6:35 pm)