Re: larger default page sizes...

Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
From: Peter Chubb
Date: Tuesday, March 25, 2008 - 4:41 pm

>>>>> "David" == David Miller <davem@davemloft.net> writes:

David> From: Christoph Lameter <clameter@sgi.com> Date: Tue, 25 Mar
David> 2008 10:48:19 -0700 (PDT)


David> Transparent automatic hugepages are definitely doable, I don't
David> know why you think this requires application changes.

It's actually harder than it looks.  Ian Wienand just finished his
Master's project in this area, so we have *lots* of data.  The main
issue is that, at least on Itanium, you have to turn off the hardware
page table walker for hugepages if you want to mix superpages and
standard pages in the same region. (The long format VHPT isn't the
panacea we'd like it to be because the hash function it uses depends
on the page size).  This means that although you have fewer TLB misses
with larger pages, the cost of those TLB misses is three to four times
higher than with the standard pages.  In addition, to set up a large
page takes more effort... and it turns out there are few applications
where the cost is amortised enough, so on SpecCPU for example, some
tests improved performance slightly, some got slightly worse.

What we saw was essentially that we could almost eliminate DTLB misses,
other than the first, for a huge page.  For most applications, though,
the extra cost of that first miss, plus the cost of setting up the
huge page, was greater than the few hundred DTLB misses we avoided.

I'm expecting Ian to publish the full results soon.

Other architectures (where the page size isn't tied into the hash
function, so the hardware walked can be used for superpages) will have
different tradeoffs.

--
Dr Peter Chubb  http://www.gelato.unsw.edu.au  peterc AT gelato.unsw.edu.au
http://www.ertos.nicta.com.au           ERTOS within National ICT Australia
--
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
[11/14] vcompound: Fallbacks for order 1 stack allocations ..., Christoph Lameter, (Thu Mar 20, 11:17 pm)
Re: [11/14] vcompound: Fallbacks for order 1 stack allocat ..., Christoph Lameter, (Fri Mar 21, 10:33 am)
Re: [11/14] vcompound: Fallbacks for order 1 stack allocat ..., Christoph Lameter, (Fri Mar 21, 10:40 am)
Re: [11/14] vcompound: Fallbacks for order 1 stack allocat ..., Christoph Lameter, (Fri Mar 21, 12:04 pm)
Re: [11/14] vcompound: Fallbacks for order 1 stack allocat ..., Christoph Lameter, (Mon Mar 24, 11:27 am)
Re: [11/14] vcompound: Fallbacks for order 1 stack allocat ..., Christoph Lameter, (Mon Mar 24, 12:53 pm)
larger default page sizes..., David Miller, (Mon Mar 24, 1:37 pm)
Re: larger default page sizes..., Christoph Lameter, (Mon Mar 24, 2:05 pm)
RE: larger default page sizes..., Luck, Tony, (Mon Mar 24, 2:25 pm)
Re: larger default page sizes..., David Miller, (Mon Mar 24, 2:43 pm)
Re: larger default page sizes..., David Miller, (Mon Mar 24, 2:46 pm)
Re: larger default page sizes..., Paul Mackerras, (Mon Mar 24, 8:29 pm)
Re: larger default page sizes..., David Miller, (Mon Mar 24, 9:15 pm)
Re: larger default page sizes..., Paul Mackerras, (Tue Mar 25, 4:50 am)
Re: larger default page sizes..., Andi Kleen, (Tue Mar 25, 5:05 am)
RE: [11/14] vcompound: Fallbacks for order 1 stack allocat ..., Christoph Lameter, (Tue Mar 25, 10:42 am)
Re: larger default page sizes..., Christoph Lameter, (Tue Mar 25, 10:48 am)
Re: [11/14] vcompound: Fallbacks for order 1 stack allocat ..., Christoph Lameter, (Tue Mar 25, 10:55 am)
Re: larger default page sizes..., Dave Hansen, (Tue Mar 25, 11:27 am)
RE: [11/14] vcompound: Fallbacks for order 1 stack allocat ..., Christoph Lameter, (Tue Mar 25, 12:25 pm)
Re: larger default page sizes..., Paul Mackerras, (Tue Mar 25, 2:27 pm)
Re: larger default page sizes..., David Miller, (Tue Mar 25, 4:22 pm)
Re: larger default page sizes..., David Miller, (Tue Mar 25, 4:32 pm)
Re: larger default page sizes..., Peter Chubb, (Tue Mar 25, 4:41 pm)
RE: larger default page sizes..., Luck, Tony, (Tue Mar 25, 4:49 pm)
Re: larger default page sizes..., David Miller, (Tue Mar 25, 4:49 pm)
Re: larger default page sizes..., David Miller, (Tue Mar 25, 5:16 pm)
Re: larger default page sizes..., Peter Chubb, (Tue Mar 25, 5:25 pm)
Re: larger default page sizes..., David Miller, (Tue Mar 25, 5:31 pm)
Re: larger default page sizes..., David Mosberger-Tang, (Tue Mar 25, 5:34 pm)
Re: larger default page sizes..., David Miller, (Tue Mar 25, 5:39 pm)
Re: larger default page sizes..., Peter Chubb, (Tue Mar 25, 5:57 pm)
Re: larger default page sizes..., John Marvin, (Tue Mar 25, 9:16 pm)
Re: larger default page sizes..., David Miller, (Tue Mar 25, 9:36 pm)
Re: larger default page sizes..., Paul Mackerras, (Tue Mar 25, 10:24 pm)
Re: larger default page sizes..., Nish Aravamudan, (Wed Mar 26, 8:54 am)
Re: larger default page sizes..., Linus Torvalds, (Wed Mar 26, 8:59 am)
RE: larger default page sizes..., Luck, Tony, (Wed Mar 26, 10:05 am)
Re: larger default page sizes..., Christoph Lameter, (Wed Mar 26, 10:56 am)
Re: larger default page sizes..., Mel Gorman, (Wed Mar 26, 11:54 am)
Re: larger default page sizes..., David Miller, (Wed Mar 26, 4:21 pm)
Re: larger default page sizes..., Paul Mackerras, (Wed Mar 26, 6:08 pm)
Re: larger default page sizes..., Paul Mackerras, (Wed Mar 26, 8:00 pm)