login
Login
/
Register
Search
Forums
News
Blogs
Features
Site
Home
»
Mailing list archives
»
linux-kernel
»
2007
»
October
»
2
Re: A unresponsive file system can hang all I/O in the system on linux-2.6.23-rc6 (dirty_thresh problem?)
view
thread
!MAILaRCHIVE_VOTE_RePLACE
Previous message: [
thread
] [
date
] [
author
]
Next message: [
thread
] [
date
] [
author
]
[view in full thread]
From:
Randy Dunlap <randy.dunlap@...>
To: Peter Zijlstra <a.p.zijlstra@...>
Cc: Andrew Morton <akpm@...>, lkml <linux-kernel@...>, Zach Brown <zach.brown@...>, Ingo Molnar <mingo@...>
Subject:
Re: A unresponsive file system can hang all I/O in the system on linux-2.6.23-rc6 (dirty_thresh problem?)
Date: Tuesday, October 2, 2007 - 11:42 am
On Tue, 02 Oct 2007 15:36:01 +0200 Peter Zijlstra wrote:
quoted text
> On Fri, 2007-09-28 at 12:16 -0700, Andrew Morton wrote: > > > (Searches for the lockstat documentation) > > > > Did we forget to do that? > > yeah,... > > /me quickly whips up something
Thanks. Just some typos noted below.
quoted text
> Signed-off-by: Peter Zijlstra <a.p.zijlstra@chello.nl> > --- > Documentation/lockstat.txt | 119 +++++++++++++++++++++++++++++++++++++++++++++ > 1 file changed, 119 insertions(+) > > Index: linux-2.6/Documentation/lockstat.txt > =================================================================== > --- /dev/null > +++ linux-2.6/Documentation/lockstat.txt > @@ -0,0 +1,119 @@ > + > +LOCK STATISTICS > + > +- WHAT > + > +As the name suggests, it provides statistics on locks. > + > +- WHY > + > +Because things like lock contention can severely impact performance. > + > +- HOW > + > +Lockdep already has hooks in the lock functions and maps lock instances to > +lock classes. We build on that. The graph below shows the relation between > +the lock functions and the various hooks therein. > + > + __acquire > + | > + lock _____ > + | \ > + | __contended > + | | > + | <wait> > + | _______/ > + |/ > + | > + __acquired > + | > + . > + <hold> > + . > + | > + __release > + | > + unlock > + > +lock, unlock - the regular lock functions > +__* - the hooks > +<> - states > + > +With these hooks we provide the following statistics: > + > + con-bounces - number of lock contention that involved x-cpu data > + contentions - number of lock acquisitions that had to wait > + wait time min - shortest (non 0) time we ever had to wait for a lock
(non-0)
quoted text
> + max - longest time we ever had to wait for a lock > + total - total time we spend waiting on this lock > + acq-bounes - number of lock acquisitions that involved x-cpu data
-bounces
quoted text
> + acquisitions - number of times we took the lock > + hold time min - shortest (non 0) time we ever held the lock
(non-0)
quoted text
> + max - longest time we ever held the lock > + total - total time this lock was held > + > +From these number various other statistics can be derived, such as: > + > + hold time average = hold time total / acquisitions > + > +These numbers are gathered per lock class, per read/write state (when > +applicable). > + > +It also tracks (4) contention points per class. A contention point is a call > +site that had to wait on lock acquisition. > + > + - USAGE > + > +Look at the current lock statistics: > + > +(line numbers not part of actual output, done for clarity in the explanation below) > + > +# less /proc/lock_stat > + > +01 lock_stat version 0.2 > +02 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- > +03 class name con-bounces contentions waittime-min waittime-max waittime-total acq-bounces acquisitions holdtime-min holdtime-max holdtime-total > +04 -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
...
quoted text
> +15 dcache_lock 180 [<ffffffff802c0d7e>] sys_getcwd+0x11e/0x230 > +16 dcache_lock 165 [<ffffffff802c002a>] d_alloc+0x15a/0x210 > +17 dcache_lock 33 [<ffffffff8035818d>] _atomic_dec_and_lock+0x4d/0x70 > +18 dcache_lock 1 [<ffffffff802beef8>] shrink_dcache_parent+0x18/0x130 > + > +This except shows the first two lock class statistics. Line 01 shows the output
excerpt
quoted text
> +version - each time the format changes this will be updated. Line 02-04 show > +the header with column descriptions. Lines 05-10 and 13-18 show the actual > +statistics. These statistics come in two parts; the actual stats separated by a > +short separator (line 08, 14) from the contention points. > + > +The first lock (05-10) is a read/write lock, and shows two lines above the > +short separator. The contention points don't match the column descriptors, > +they have two: contentions and [<IP>] symbol.
... --- ~Randy -
unsubscribe notice
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to
majordomo@vger.kernel.org
More majordomo info at
http://vger.kernel.org/majordomo-info.html
Please read the FAQ at
http://www.tux.org/lkml/
Previous message: [
thread
] [
date
] [
author
]
Next message: [
thread
] [
date
] [
author
]
Messages in current thread:
A unresponsive file system can hang all I/O in the system on...
, Chakri n
, (Fri Sep 28, 2:32 am)
Re: A unresponsive file system can hang all I/O in the syste...
, Fengguang Wu
, (Sat Sep 29, 7:04 am)
Re: A unresponsive file system can hang all I/O in the syste...
, Chuck Ebbert
, (Mon Oct 1, 11:57 am)
[PATCH] writeback: avoid possible balance_dirty_pages() lock...
, Fengguang Wu
, (Mon Oct 1, 10:00 pm)
Re: [PATCH] writeback: avoid possible balance_dirty_pages() ...
, Andrew Morton
, (Mon Oct 1, 10:14 pm)
Re: [PATCH] writeback: avoid possible balance_dirty_pages() ...
, Fengguang Wu
, (Tue Oct 2, 8:13 am)
Re: A unresponsive file system can hang all I/O in the syste...
, Peter Zijlstra
, (Sat Sep 29, 7:48 am)
Re: A unresponsive file system can hang all I/O in the syste...
, Fengguang Wu
, (Sat Sep 29, 8:28 am)
Re: A unresponsive file system can hang all I/O in the syste...
, Peter Zijlstra
, (Sat Sep 29, 10:43 am)
Re: A unresponsive file system can hang all I/O in the syste...
, Andrew Morton
, (Fri Sep 28, 2:50 am)
Re: A unresponsive file system can hang all I/O in the syste...
, Daniel Phillips
, (Fri Sep 28, 8:46 pm)
Re: A unresponsive file system can hang all I/O in the syste...
, Trond Myklebust
, (Fri Sep 28, 1:00 pm)
Re: A unresponsive file system can hang all I/O in the syste...
, Andrew Morton
, (Fri Sep 28, 2:49 pm)
Re: A unresponsive file system can hang all I/O in the syste...
, Trond Myklebust
, (Fri Sep 28, 3:16 pm)
KDB?
, Daniel Phillips
, (Fri Sep 28, 9:51 pm)
Re: A unresponsive file system can hang all I/O in the syste...
, Andrew Morton
, (Fri Sep 28, 3:26 pm)
Re: A unresponsive file system can hang all I/O in the syste...
, Trond Myklebust
, (Fri Sep 28, 3:52 pm)
Re: A unresponsive file system can hang all I/O in the syste...
, Daniel Phillips
, (Fri Sep 28, 4:24 pm)
Re: A unresponsive file system can hang all I/O in the syste...
, Andrew Morton
, (Fri Sep 28, 4:10 pm)
Re: A unresponsive file system can hang all I/O in the syste...
, Trond Myklebust
, (Fri Sep 28, 4:32 pm)
Re: A unresponsive file system can hang all I/O in the syste...
, Andrew Morton
, (Fri Sep 28, 4:43 pm)
Re: A unresponsive file system can hang all I/O in the syste...
, Chakri n
, (Fri Sep 28, 5:36 pm)
Re: A unresponsive file system can hang all I/O in the syste...
, Chakri n
, (Fri Sep 28, 7:33 pm)
Re: A unresponsive file system can hang all I/O in the syste...
, Peter Zijlstra
, (Fri Sep 28, 2:48 pm)
Re: A unresponsive file system can hang all I/O in the syste...
, Andrew Morton
, (Fri Sep 28, 3:16 pm)
Re: A unresponsive file system can hang all I/O in the syste...
, Peter Zijlstra
, (Tue Oct 2, 9:36 am)
Re: A unresponsive file system can hang all I/O in the syste...
, Randy Dunlap
, (Tue Oct 2, 11:42 am)
[PATCH] lockstat: documentation
, Peter Zijlstra
, (Wed Oct 3, 5:28 am)
Re: [PATCH] lockstat: documentation
, Ingo Molnar
, (Wed Oct 3, 5:35 am)
Re: A unresponsive file system can hang all I/O in the syste...
, Jonathan Corbet
, (Fri Sep 28, 9:28 am)
Re: A unresponsive file system can hang all I/O in the syste...
, Andrew Morton
, (Fri Sep 28, 2:04 pm)
Re: A unresponsive file system can hang all I/O in the syste...
, Peter Zijlstra
, (Fri Sep 28, 9:35 am)
Re: A unresponsive file system can hang all I/O in the syste...
, Daniel Phillips
, (Fri Sep 28, 9:27 pm)
Re: [linux-pm] Re: A unresponsive file system can hang all I...
, Alan Stern
, (Fri Sep 28, 12:45 pm)
Re: A unresponsive file system can hang all I/O in the syste...
, Peter Zijlstra
, (Fri Sep 28, 2:59 am)
Re: A unresponsive file system can hang all I/O in the syste...
, Chakri n
, (Fri Sep 28, 4:27 am)
Re: A unresponsive file system can hang all I/O in the syste...
, Peter Zijlstra
, (Fri Sep 28, 4:40 am)
Re: A unresponsive file system can hang all I/O in the syste...
, Chakri n
, (Fri Sep 28, 5:01 am)
Re: A unresponsive file system can hang all I/O in the syste...
, Peter Zijlstra
, (Fri Sep 28, 5:12 am)
Re: A unresponsive file system can hang all I/O in the syste...
, Chakri n
, (Fri Sep 28, 5:20 am)
Re: A unresponsive file system can hang all I/O in the syste...
, Peter Zijlstra
, (Fri Sep 28, 5:23 am)
Re: A unresponsive file system can hang all I/O in the syste...
, Chakri n
, (Fri Sep 28, 6:36 am)
Navigation
Create content
Mailing list archives
Recent posts
Popular discussions
linux-kernel
:
Greg Kroah-Hartman
[PATCH 004/196] Chinese: add translation of SubmittingPatches
Alan Stern
Re: 2.6.22-rc2-mm1
Satyam Sharma
Re: [PATCH 0/24] make atomic_read() behave consistently across all architectures
William Lee Irwin III
Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]
git
:
linux-netdev
:
Dale Farnsworth
Re: [PATCH 03/39] mv643xx_eth: shorten reg names
Jarek Poplawski
Re: HTB accuracy for high speed
Gerrit Renker
[PATCH 15/37] dccp: Set per-connection CCIDs via socket options
Jarek Poplawski
[PATCH] pkt_sched: Destroy gen estimators under rtnl_lock().
openbsd-misc
:
Colocation donated by:
Who's online
There are currently
10 users
and
1049 guests
online.
Online users
zeekec
noelbarclaybvs
buygibsonguita
weightlossprog
hemmroidsjxrvr
ironman1
abovegroundpoo
searchtheinter
acne411
vivschlegel
Syndicate