Re: tipc_init(), WARNING: at arch/x86/mm/highmem_32.c:52, [2.6.24-rc4-git5: Reported regressions from 2.6.23]

!MAILaRCHIVE_VOTE_RePLACE
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
To: Ingo Molnar <mingo@...>
Cc: Linus Torvalds <torvalds@...>, Andrew Morton <akpm@...>, Matt Mackall <mpm@...>, Rafael J. Wysocki <rjw@...>, LKML <linux-kernel@...>
Date: Friday, December 14, 2007 - 12:07 am

On Sat, 8 Dec 2007, Ingo Molnar wrote:


Well this is double crap. First of all SLUB does not do memclear twice. 
There is no reason to assume that SLUB has the problem just because SLOB 
hat that. A "fix" for that nonexistent problem went into Linus tree. WTH 
is going on?

SLUB was done because of a series of problem with the basic concepts of 
SLAB that treaten it usability in the future.
 

I agree, SLABs architecture is pretty tight and I was one of those who 
helped it along to be that way.

However, SLAB is just fundamentally wrong for todays machine. The key 
problem today is cacheline fetch latency and that problem will increase 
significantly in the future. Sure under some circumstances that exploit 
the fact that SLAB sometimes gets its guesses on the cpu cache right SLAB 
can still win but the more processors and nodes we get the more it will 
become difficult to keep SLAB around and the more it will become 
difficult to establish what cachelines are in the cpu cache.


If you guarantee that all the regression of SLAB vs. SLUB are addressed 
then thats fine but AFAICT that is not possible.

Here is a list of some of the benefits of SLUB just in case we forgot:


- SLUB is performance wise much faster than SLAB. This can be more than a
  factor of 10 (case of concurrent allocations / frees on multiple
  processors). See http://lkml.org/lkml/2007/10/27/245

- Single threaded allocation speed is up to double that of SLAB

- Remote freeing of objectcs in a NUMA systems is typically 30% faster.

- Debugging on SLAB is difficult. Requires recompile of the kernel
  and the resulting output is difficult to interpret. SLUB can apply
  debugging options to a subset of the slabcaches in order to allow
  the system to work with maximum speed. This is necessary to detect
  difficult to reproduce race conditions.

- SLAB can capture huge amounts of memory in its queues. The problem
  gets worse the more processors and NUMA nodes are in the system. The 
  amount of memory limits the number of per cpu objects one can configure.

- SLAB requires a pass through all slab caches every 2 seconds to
  expire objects. This is a problem both for realtime and MPI jobs
  that cannot take such a processor outage.

- SLAB does not have a sophisticated slabinfo tool to report the
  state of slab objects on the system. Can provide details of
  object use.

- SLAB requires the update of two words for freeing
  and allocation. SLUB can do that by updating a single
  word which allows to avoid enabling and disabling interrupts if
  the processor supports an atomic instruction for that purpose.
  This is important for realtime kernels where special measures
  may have to be implemented if one wants to disable interrupts.

- SLAB requires memory to be set aside for queues (processors
  times number of slabs times queue size). SLUB requires none of that.

- SLUB merges slab caches with similar characteristics to
  reduce the memory footprint even further.

- SLAB performs object level NUMA management which creates
  a complex allocator complexity. SLUB manages NUMA on the level of
  slab pages reducing object management overhead.

- SLUB allows remote node defragmentation to avoid the buildup
  of large partial lists on a single node.

- SLUB can actively reduce the fragmentation of slabs through
  slab cache specific callbacks (not merged yet)

- SLUB has resiliency features that allow it to isolate a problem
  object and continue after diagnostics have been performed.

- SLUB creates rarely used DMA caches on demand instead of creating
  them all on bootup (SLAB).

--
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
2.6.24-rc4-git5: Reported regressions from 2.6.23, Rafael J. Wysocki, (Fri Dec 7, 10:40 pm)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Ingo Molnar, (Mon Dec 10, 4:42 pm)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Andrew Morton, (Mon Dec 10, 4:59 pm)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Ingo Molnar, (Mon Dec 10, 6:45 pm)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Ingo Molnar, (Mon Dec 10, 7:04 pm)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Stefano Brivio, (Mon Dec 10, 7:34 pm)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Ingo Molnar, (Tue Dec 11, 5:01 am)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Stefano Brivio, (Tue Dec 11, 5:10 pm)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Guillaume Chazarain, (Mon Dec 10, 7:53 pm)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Ingo Molnar, (Tue Dec 11, 4:48 am)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Arjan van de Ven, (Mon Dec 10, 7:56 pm)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Guillaume Chazarain, (Mon Dec 10, 8:01 pm)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Arjan van de Ven, (Mon Dec 10, 9:06 pm)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Ingo Molnar, (Tue Dec 11, 4:43 am)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Guillaume Chazarain, (Mon Dec 10, 4:57 pm)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Andrew Morton, (Sun Dec 9, 7:54 am)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Rafael J. Wysocki, (Sun Dec 9, 10:24 am)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Fabio Comolli, (Sat Dec 8, 2:53 am)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Andrew Morton, (Sat Dec 8, 5:23 am)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Rafael J. Wysocki, (Sat Dec 8, 6:11 pm)
Re: tipc_init(), WARNING: at arch/x86/mm/highmem_32.c:52, [2..., Christoph Lameter, (Thu Dec 13, 6:03 pm)
Re: tipc_init(), WARNING: at arch/x86/mm/highmem_32.c:52, [2..., Rafael J. Wysocki, (Sun Dec 9, 10:17 am)
Re: tipc_init(), WARNING: at arch/x86/mm/highmem_32.c:52, [2..., Christoph Lameter, (Fri Dec 14, 12:07 am)
Re: tipc_init(), WARNING: at arch/x86/mm/highmem_32.c:52, [2..., Christoph Lameter, (Thu Dec 13, 6:07 pm)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Andrew Morton, (Sat Dec 8, 5:52 am)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Linus Torvalds, (Sun Dec 9, 2:41 pm)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Linus Torvalds, (Sun Dec 9, 9:57 pm)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Ingo Molnar, (Mon Dec 10, 4:21 am)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Ingo Molnar, (Mon Dec 10, 4:41 am)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Linus Torvalds, (Mon Dec 10, 11:38 am)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Linus Torvalds, (Sun Dec 9, 2:36 pm)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Andrew Morton, (Sat Dec 8, 5:46 am)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Andrew Morton, (Sat Dec 8, 5:42 am)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Roland Dreier, (Sat Dec 8, 2:57 pm)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Theodore Tso, (Sat Dec 8, 3:40 pm)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Rafael J. Wysocki, (Sat Dec 8, 6:30 pm)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Theodore Tso, (Sat Dec 8, 10:15 pm)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Takashi Iwai, (Thu Dec 13, 6:49 am)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Takashi Iwai, (Thu Dec 20, 11:42 am)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Andrew Morton, (Sat Dec 8, 5:36 am)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Rafael J. Wysocki, (Sun Dec 9, 10:20 am)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Andreas Mohr, (Sat Dec 8, 6:12 am)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Andrew Morton, (Sat Dec 8, 6:20 am)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Andreas Mohr, (Sat Dec 8, 6:55 am)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Andreas Mohr, (Sun Dec 9, 3:59 pm)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Matthew Garrett, (Sat Dec 8, 6:28 am)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Andrew Morton, (Sat Dec 8, 5:29 am)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Rafael J. Wysocki, (Sat Dec 8, 6:17 pm)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Richard Purdie, (Sat Dec 8, 6:44 am)
Re: 2.6.24-rc4-git5: Reported regressions from 2.6.23, Rafael J. Wysocki, (Sat Dec 8, 6:32 pm)