logo
Published on KernelTrap (http://kerneltrap.org)

Linux: VM Swappiness Autoregulation

By nimrod
Created Oct 23 2003 - 14:06

Con Kolivas [interview [0]] strikes again, this time with a patch that regulates the VM subsystem's "swappiness" on-the-fly, depending on the percent of RAM being used by applications (it does not take disk cache into account). Con explained the effects of this patch:

"This has the effect of preventing applications from being swapped out if the ram is filling up with cached data. Conversely, if many applications are in ram the swappiness increases which means the application currently in use gets to stay in physical ram while other less used applications are swapped out.

"For desktop enthusiasts this means if you are copying large files around like ISO images or leave your machine unattended for a while it will not swap out your applications. Conversely if the machine has a lot of applications currently loaded it will give the currently running applications preference and swap out the less used ones."

Swappiness is a kernel "knob" (located in /proc/sys/vm/swappiness) used to tweak how much the kernel favors swap over RAM; high swappiness means the kernel will swap out a lot, and low swappiness means the kernel will try not to use swap space.

Update: Con posted an updated [1] version of the patch.


From: Con Kolivas [1] [email blocked]
To: linux-kernel
Subject: [PATCH] Autoregulate vm swappiness 2.6.0-test8
Date: 2003-10-23 13:37:50

The vm_swappiness dial in 2.6 was never quite the right setting without me 
constantly changing it depending on the workload. If I was copying large 
files or encoding video it was best at 0. If I was using lots of applications 
it was best much higher. Furthermore it depended on the amount of ram in the 
machine I was using. This patch was done just for fun a while back but it 
turned out to be quite effectual so I thought I'd make it available for the 

wider community to play with. Do whatever you like with it.

This patch autoregulates the vm_swappiness dial in 2.6 by making it equal to 
the percentage of physical ram consumed by application pages. 

This has the effect of preventing applications from being swapped out if the 
ram is filling up with cached data. 

Conversely, if many applications are in ram the swappiness increases which 
means the application currently in use gets to stay in physical ram while 
other less used applications are swapped out. 

For desktop enthusiasts this means if you are copying large files around like 
ISO images or leave your machine unattended for a while it will not swap out 
your applications. Conversely if the machine has a lot of applications 
currently loaded it will give the currently running applications preference 
and swap out the less used ones.

The performance effect on larger boxes seems to be either unchanged or slight 
improvement (1%) in database benchmarks.

The value in vm_swappiness is updated only when the vm is under pressure to 
swap and you can check the last vm_swappiness value under pressure by
cat /proc/sys/vm/swappiness

Manually setting the swappiness with this patch in situ has no effect. This 
patch has been heavily tested without noticable harm. Note I am not sure of 
the best way to do this so it may look rather crude.

Patch against 2.6.0-test8

Con

--- linux-2.6.0-test8-base/mm/vmscan.c	2003-10-19 20:24:36.000000000 +1000
+++ linux-2.6.0-test8-am/mm/vmscan.c	2003-10-22 17:56:18.501329888 +1000
@@ -47,7 +47,7 @@
 /*
  * From 0 .. 100.  Higher means more swappy.
  */
-int vm_swappiness = 60;
+int vm_swappiness = 0;
 static long total_memory;
 
 #ifdef ARCH_HAS_PREFETCH
@@ -595,11 +595,13 @@ refill_inactive_zone(struct zone *zone, 
 	int pgmoved;
 	int pgdeactivate = 0;
 	int nr_pages = nr_pages_in;
+	int pg_size;
 	LIST_HEAD(l_hold);	/* The pages which were snipped off */
 	LIST_HEAD(l_inactive);	/* Pages to go onto the inactive_list */
 	LIST_HEAD(l_active);	/* Pages to go onto the active_list */
 	struct page *page;
 	struct pagevec pvec;
+	struct sysinfo i;
 	int reclaim_mapped = 0;
 	long mapped_ratio;
 	long distress;
@@ -642,6 +644,16 @@ refill_inactive_zone(struct zone *zone, 
 	mapped_ratio = (ps->nr_mapped * 100) / total_memory;
 
 	/*
+	 * Autoregulate vm_swappiness to be application pages % -ck.
+	 */
+	si_meminfo(&i);
+	si_swapinfo(&i);
+	pg_size = get_page_cache_size() - i.bufferram ;
+	vm_swappiness = 100 - (((i.freeram + i.bufferram +
+		(pg_size - swapper_space.nrpages)) * 100) /
+		(i.totalram ? i.totalram : 1));
+
+	/*
 	 * Now decide how much we really want to unmap some pages.  The mapped
 	 * ratio is downgraded - just because there's a lot of mapped memory
 	 * doesn't necessarily mean that page reclaim isn't succeeding.



From: Martin J. Bligh [email blocked]
To: linux-kernel
Subject: Re: [PATCH] Autoregulate vm swappiness 2.6.0-test8
Date: 2003-10-23 14:42:34

> +	 * Autoregulate vm_swappiness to be application pages % -ck.
> +	 */
> +	si_meminfo(&i);
> +	si_swapinfo(&i);
> +	pg_size = get_page_cache_size() - i.bufferram ;
> +	vm_swappiness = 100 - (((i.freeram + i.bufferram +
> +		(pg_size - swapper_space.nrpages)) * 100) /
> +		(i.totalram ? i.totalram : 1));
> +
> +	/*

It seems that you don't need si_swapinfo here, do you? i.freeram,
i.bufferram, and i.totalram all come from meminfo, as far as I can
see? Maybe I'm missing a bit ...

M.



From: Con Kolivas [email blocked]
To: linux-kernel
Subject: Re: [PATCH] Autoregulate vm swappiness 2.6.0-test8
Date: 2003-10-23 15:03:19

On Friday 24 October 2003 00:42, Martin J. Bligh wrote:
> > +	 * Autoregulate vm_swappiness to be application pages % -ck.
> > +	 */
> > +	si_meminfo(&i);
> > +	si_swapinfo(&i);
> > +	pg_size = get_page_cache_size() - i.bufferram ;
> > +	vm_swappiness = 100 - (((i.freeram + i.bufferram +
> > +		(pg_size - swapper_space.nrpages)) * 100) /
> > +		(i.totalram ? i.totalram : 1));
> > +
> > +	/*
>
> It seems that you don't need si_swapinfo here, do you? i.freeram,
> i.bufferram, and i.totalram all come from meminfo, as far as I can
> see? Maybe I'm missing a bit ...

Well I did do it a while ago and it seems I got carried away adding and 
subtracting info indeed. :-) Here's a simpler patch that does the same thing.

Con


--- linux-2.6.0-test8-base/mm/vmscan.c	2003-10-19 20:24:36.000000000 +1000
+++ linux-2.6.0-test8-am/mm/vmscan.c	2003-10-24 00:46:52.000000000 +1000
@@ -47,7 +47,7 @@
 /*
  * From 0 .. 100.  Higher means more swappy.
  */
-int vm_swappiness = 60;
+int vm_swappiness = 0;
 static long total_memory;
 
 #ifdef ARCH_HAS_PREFETCH
@@ -600,6 +600,7 @@ refill_inactive_zone(struct zone *zone, 
 	LIST_HEAD(l_active);	/* Pages to go onto the active_list */
 	struct page *page;
 	struct pagevec pvec;
+	struct sysinfo i;
 	int reclaim_mapped = 0;
 	long mapped_ratio;
 	long distress;
@@ -642,6 +643,13 @@ refill_inactive_zone(struct zone *zone, 
 	mapped_ratio = (ps->nr_mapped * 100) / total_memory;
 
 	/*
+	 * Autoregulate vm_swappiness to be application pages% -ck
+	 */
+	si_meminfo(&i);
+	vm_swappiness = 100 - (((i.freeram + get_page_cache_size() -
+		swapper_space.nrpages) * 100) / (i.totalram ? i.totalram : 1));
+
+	/*
 	 * Now decide how much we really want to unmap some pages.  The mapped
 	 * ratio is downgraded - just because there's a lot of mapped memory
 	 * doesn't necessarily mean that page reclaim isn't succeeding.



Related Links:


Source URL:
http://kerneltrap.org/node/1044