login
Header Space

 
 

Re: linux+glibc memory allocator, poor performance

Score:
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
To: LKML <linux-kernel@...>, Linus Torvalds <torvalds@...>
Date: Wednesday, March 12, 2008 - 4:09 pm

On Wed, 12 Mar 2008 19:14:06 +0100, Xose Vazquez Perez wrote:

Assume a SMP system that has 8 CPUs. The main problem of requesting
pages is the BKL (Big Kernel Lock) in this SMP system used for mutual
exclusion of the shared resource (the memory).

To solve this major problem, i propose you freely to allocate 8 local caches
of (e.g.) 2 MiB each CPU (total 2MiB x 8 CPUs = 16 MiB) acting as
8 producer buffers for globally many consumer tasks (e.g. >= 20).

When the some producer buffer is empty then it does unfrequently BKL to
allocate another 2 MiB more from the shared resource (the memory).

In the reverse, it's simple, return back the unused pages to the local buffer
of the producer, and when this full then to do BKL too to unallocate its half
to the shared resource (the memory).

   Sincerely, J.C.Pizarro
--
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
Re: linux+glibc memory allocator, poor performance, J.C. Pizarro, (Wed Mar 12, 4:09 pm)
Re: linux+glibc memory allocator, poor performance, Rik van Riel, (Wed Mar 12, 5:22 pm)
Re: linux+glibc memory allocator, poor performance, J.C. Pizarro, (Thu Mar 13, 8:23 am)
Re: linux+glibc memory allocator, poor performance, David Newall, (Thu Mar 13, 1:57 am)
Re: linux+glibc memory allocator, poor performance, David Newall, (Thu Mar 13, 6:50 am)
Re: linux+glibc memory allocator, poor performance, Mike Galbraith, (Thu Mar 13, 2:12 am)
Re: linux+glibc memory allocator, poor performance, David Newall, (Thu Mar 13, 2:22 am)
Re: linux+glibc memory allocator, poor performance, Pekka Enberg, (Thu Mar 13, 5:10 am)
Re: linux+glibc memory allocator, poor performance, Pekka Enberg, (Thu Mar 13, 8:48 am)
Re: linux+glibc memory allocator, poor performance, Willy Tarreau, (Fri Mar 14, 2:05 am)
Re: linux+glibc memory allocator, poor performance, David Newall, (Thu Mar 13, 3:40 pm)
Re: linux+glibc memory allocator, poor performance, Stephen Clark, (Fri Mar 14, 8:11 am)
Re: linux+glibc memory allocator, poor performance, Pekka Enberg, (Thu Mar 13, 4:05 pm)
Re: linux+glibc memory allocator, poor performance, J.C. Pizarro, (Thu Mar 13, 9:55 am)
Re: linux+glibc memory allocator, poor performance, David Newall, (Thu Mar 13, 7:04 am)
Re: linux+glibc memory allocator, poor performance, Christoph Hellwig, (Thu Mar 13, 3:38 am)
Re: linux+glibc memory allocator, poor performance, David Newall, (Thu Mar 13, 7:02 am)
speck-geostationary