Scalability requirements for sysv ipc (was: ipc: store ipcs into IDRs)

!MAILaRCHIVE_VOTE_RePLACE
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
To: Linux Kernel Mailing List <linux-kernel@...>
Cc: Nadia Derbey <Nadia.Derbey@...>, Andrew Morton <akpm@...>, Paul E. McKenney <paulmck@...>
Date: Friday, March 21, 2008 - 5:41 am

Hi all,

I noticed that sysv ipc now uses very special locking: first a global 
rw-semaphore, then within that semaphore rcu:
 > linux-2.6.25-rc3:/ipc/util.c:
ids->rw_mutex is a per-namespace (i.e.: usually global) semaphore. Thus 
ipc_lock writes into a global cacheline. Everything else is based on 
per-object locking, especially sysv sem doesn't contain a single global 
lock/statistic counter/...
That can't be the Right Thing (tm): Either there are cases where we need 
the scalability (then using IDRs is impossible), or the scalability is 
never needed (then the remaining parts from RCU should be removed).
I don't have a suitable test setup, has anyone performed benchmarks 
recently?
Is sysv semaphore still important, or have all apps moved to posix 
semaphores/futexes?
Nadia: Do you have access to a suitable benchmark?

A microbenchmark on a single-cpu system doesn't help much (except that 
2.6.25 is around factor 2 slower for sysv msg ping-pong between two 
tasks compared to the numbers I remember from older kernels....)

--
    Manfred
--
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
Scalability requirements for sysv ipc (was: ipc: store ipcs ..., Manfred Spraul, (Fri Mar 21, 5:41 am)
Re: Scalability requirements for sysv ipc, Manfred Spraul, (Fri Mar 21, 9:33 am)
Re: Scalability requirements for sysv ipc, Nadia Derbey, (Tue Mar 25, 12:00 pm)
Re: Scalability requirements for sysv ipc, Paul E. McKenney, (Fri Mar 21, 10:13 am)
Re: Scalability requirements for sysv ipc, Manfred Spraul, (Fri Mar 21, 12:08 pm)
Re: Scalability requirements for sysv ipc, Mike Galbraith, (Sat Mar 22, 1:43 am)
Re: Scalability requirements for sysv ipc, Bill Davidsen, (Thu Mar 27, 6:29 pm)
Re: Scalability requirements for sysv ipc, Manfred Spraul, (Fri Mar 28, 5:49 am)
Re: Scalability requirements for sysv ipc, Manfred Spraul, (Sat Mar 22, 6:10 am)
Re: Scalability requirements for sysv ipc, Mike Galbraith, (Sat Mar 22, 7:53 am)
Re: Scalability requirements for sysv ipc, Manfred Spraul, (Sat Mar 22, 10:22 am)
Re: Scalability requirements for sysv ipc, Mike Galbraith, (Sat Mar 22, 3:35 pm)
Re: Scalability requirements for sysv ipc, Mike Galbraith, (Sun Mar 23, 3:08 am)
Re: Scalability requirements for sysv ipc, Mike Galbraith, (Sun Mar 23, 3:20 am)
Re: Scalability requirements for sysv ipc, Manfred Spraul, (Sun Mar 23, 2:38 am)
Re: Scalability requirements for sysv ipc, Mike Galbraith, (Sun Mar 23, 3:15 am)
Re: Scalability requirements for sysv ipc, Manfred Spraul, (Sat Mar 22, 3:08 pm)
Re: Scalability requirements for sysv ipc, Mike Galbraith, (Tue Mar 25, 11:50 am)
Re: Scalability requirements for sysv ipc, Peter Zijlstra, (Tue Mar 25, 12:13 pm)
Re: Scalability requirements for sysv ipc, Mike Galbraith, (Wed Mar 26, 2:18 am)
Re: Scalability requirements for sysv ipc, Mike Galbraith, (Tue Mar 25, 2:31 pm)