SLUB performance regression vs SLAB

!MAILaRCHIVE_VOTE_RePLACE
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
To: Christoph Lameter <clameter@...>
Cc: Nick Piggin <nickpiggin@...>, Christoph Hellwig <hch@...>, Mel Gorman <mel@...>, <linux-fsdevel@...>, <linux-kernel@...>, David Chinner <dgc@...>, Jens Axboe <jens.axboe@...>
Date: Thursday, October 4, 2007 - 12:16 pm

On Mon, Oct 01, 2007 at 01:50:44PM -0700, Christoph Lameter wrote:

Could you cut out the snarky remarks?  It takes a long time to run a
test, and testing every one of the patches you send really isn't high
on anyone's priority list.  The performance team have also been having
problems getting stable results with recent kernels, adding to the delay.
The good news is that we do now have committment to testing upstream
kernels, so you should see results more frequently than you have been.

I'm taking over from Suresh as liason for the performance team, so
if you hear *anything* from *anyone* else at Intel about performance,
I want you to cc me about it.  OK?  And I don't want to hear any more
whining about hearing different things from different people.

So, on "a well-known OLTP benchmark which prohibits publishing absolute
numbers" and on an x86-64 system (I don't think exactly which model
is important), we're seeing *6.51%* performance loss on slub vs slab.
This is with a 2.6.23-rc3 kernel.  Tuning the boot parameters, as you've
asked for before (slub_min_order=2, slub_max_order=4, slub_min_objects=8)
gets back 0.38% of that.  It's still down 6.13% over slab.

For what it's worth, 2.6.23-rc3 already has a 1.19% regression versus
RHEL 4.5, so the performance guys are really unhappy about going up to
almost 8% regression.

In the detailed profiles, __slab_free is the third most expensive
function, behind only spin locks.  get_partial_node is right behind it
in fourth place, and kmem_cache_alloc is sixth.  __slab_alloc is eight
and kmem_cache_free is tenth.  These positions don't change with the
slub boot parameters.

Now, where do we go next?  I suspect that 2.6.23-rc9 has significant
changes since -rc3, but I'd like to confirm that before kicking off
another (expensive) run.  Please, tell me what useful kernels are to test.

-- 
Intel are signing my paycheques ... these opinions are still mine
"Bill, look, we understand that you're interested in selling us this
operating system, but compare it to ours.  We can't possibly take such
a retrograde step."
-
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
[15/17] SLUB: Support virtual fallback via SLAB_VFALLBACK, Christoph Lameter, (Tue Sep 18, 11:36 pm)
Re: [15/17] SLUB: Support virtual fallback via SLAB_VFALLBACK, Christoph Lameter, (Fri Sep 28, 1:33 pm)
Re: [15/17] SLUB: Support virtual fallback via SLAB_VFALLBACK, Christoph Lameter, (Mon Oct 1, 4:50 pm)
SLUB performance regression vs SLAB, Matthew Wilcox, (Thu Oct 4, 12:16 pm)
Re: SLUB performance regression vs SLAB, Christoph Lameter, (Thu Oct 4, 1:38 pm)
Re: SLUB performance regression vs SLAB, Arjan van de Ven, (Thu Oct 4, 1:50 pm)
Re: SLUB performance regression vs SLAB, David Miller, (Thu Oct 4, 4:48 pm)
RE: SLUB performance regression vs SLAB, David Schwartz, (Thu Oct 4, 7:39 pm)
Re: SLUB performance regression vs SLAB, Chuck Ebbert, (Thu Oct 4, 7:49 pm)
RE: SLUB performance regression vs SLAB, David Schwartz, (Fri Oct 5, 12:18 am)
Re: SLUB performance regression vs SLAB, Matthew Wilcox, (Thu Oct 4, 4:58 pm)
Re: SLUB performance regression vs SLAB, Christoph Lameter, (Thu Oct 4, 5:11 pm)
Re: SLUB performance regression vs SLAB, David Miller, (Thu Oct 4, 5:05 pm)
Re: SLUB performance regression vs SLAB, Peter Zijlstra, (Thu Oct 4, 2:26 pm)
Re: SLUB performance regression vs SLAB, Christoph Lameter, (Thu Oct 4, 1:58 pm)
Re: SLUB performance regression vs SLAB, Matthew Wilcox, (Thu Oct 4, 2:32 pm)
Re: SLUB performance regression vs SLAB, Christoph Lameter, (Thu Oct 4, 1:49 pm)
Re: SLUB performance regression vs SLAB, Matthew Wilcox, (Thu Oct 4, 3:28 pm)
Re: SLUB performance regression vs SLAB, David Miller, (Thu Oct 4, 4:55 pm)
Re: SLUB performance regression vs SLAB, Chuck Ebbert, (Thu Oct 4, 5:02 pm)
Re: SLUB performance regression vs SLAB, Peter Zijlstra, (Fri Oct 5, 4:32 pm)
Re: SLUB performance regression vs SLAB, David Miller, (Fri Oct 5, 5:31 pm)
Re: SLUB performance regression vs SLAB, David Miller, (Thu Oct 4, 5:11 pm)
Re: SLUB performance regression vs SLAB, Chuck Ebbert, (Thu Oct 4, 5:47 pm)
Re: SLUB performance regression vs SLAB, David Miller, (Thu Oct 4, 6:07 pm)
Re: SLUB performance regression vs SLAB, David Chinner, (Thu Oct 4, 6:23 pm)
Re: SLUB performance regression vs SLAB, Jens Axboe, (Fri Oct 5, 2:48 am)
Re: SLUB performance regression vs SLAB, Matthew Wilcox, (Fri Oct 5, 7:56 am)
Re: SLUB performance regression vs SLAB, Christoph Lameter, (Fri Oct 5, 3:27 pm)
Re: SLUB performance regression vs SLAB, Jens Axboe, (Fri Oct 5, 8:37 am)
Re: SLUB performance regression vs SLAB, Pekka Enberg, (Fri Oct 5, 5:19 am)
Re: SLUB performance regression vs SLAB, Jens Axboe, (Fri Oct 5, 5:28 am)
Re: SLUB performance regression vs SLAB, Andi Kleen, (Fri Oct 5, 7:12 am)
Re: SLUB performance regression vs SLAB, Jens Axboe, (Fri Oct 5, 8:39 am)
Re: SLUB performance regression vs SLAB, Christoph Lameter, (Fri Oct 5, 3:31 pm)
Re: SLUB performance regression vs SLAB, Christoph Lameter, (Fri Oct 5, 3:32 pm)
Re: SLUB performance regression vs SLAB, Matthew Wilcox, (Thu Oct 4, 5:05 pm)
Re: SLUB performance regression vs SLAB, Christoph Lameter, (Thu Oct 4, 10:43 pm)
Re: SLUB performance regression vs SLAB, Arjan van de Ven, (Thu Oct 4, 10:53 pm)
Re: SLUB performance regression vs SLAB, Christoph Lameter, (Thu Oct 4, 3:05 pm)
Re: SLUB performance regression vs SLAB, Siddha, Suresh B, (Thu Oct 4, 3:46 pm)
Re: [15/17] SLUB: Support virtual fallback via SLAB_VFALLBACK, Christoph Lameter, (Mon Oct 1, 5:10 pm)
Re: [15/17] SLUB: Support virtual fallback via SLAB_VFALLBACK, Christoph Lameter, (Fri Sep 28, 2:20 pm)
Re: [15/17] SLUB: Support virtual fallback via SLAB_VFALLBACK, Christoph Lameter, (Mon Oct 1, 5:01 pm)
Re: [15/17] SLUB: Support virtual fallback via SLAB_VFALLBACK, Christoph Lameter, (Mon Oct 1, 4:55 pm)
Re: [15/17] SLUB: Support virtual fallback via SLAB_VFALLBACK, Christoph Lameter, (Mon Oct 1, 5:38 pm)
Re: [15/17] SLUB: Support virtual fallback via SLAB_VFALLBACK, Christoph Lameter, (Mon Oct 1, 5:52 pm)
Re: [15/17] SLUB: Support virtual fallback via SLAB_VFALLBACK, Christoph Lameter, (Fri Sep 28, 2:41 pm)