Re: Ten percent test

Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
From: Con Kolivas
Date: Friday, April 6, 2007 - 11:50 pm

On Friday 06 April 2007 20:03, Ingo Molnar wrote:

I'm terribly sorry but you have completely missed my intentions then. I was 
_not_ trying to improve mainline's interactivity at all. My desire was to fix 
the unfairness that mainline has, across the board without compromising 
fairness. You said yourself that an approach that fixed a lot and had a small 
number of regressions would be worth it. In a surprisingly ironic turnaround 
two bizarre things happened. People found SD fixed a lot of their 
interactivity corner cases which were showstoppers. That didn't surprise me 
because any unfair design will by its nature get it wrong sometimes. The even 
_more_ surprising thing is that you're now using interactivity as the 
argument against SD. I did not set out to create better interactivity, I set 
out to create widespread fairness without too much compromise to 
interactivity. As I said from the _very first email_, there would be cases of 
interactivity in mainline that performed better.


That was one user. As I mentioned in an earlier thread, the problem with email 
threads on drawn out issues on lkml is that all that people remember is the 
last one creating noise, and that has only been the noise from Mike for 2 
weeks now. Has everyone forgotten the many many users who reported the 
advantages first up which generated the interest in the first place? Why have 
they stopped reporting? Well the answer is obvious; all the signs suggest 
that SD is slated for mainline. It is on the path, Linus has suggested it and 
now akpm is asking if it's ready for 2.6.22. So they figure there is no point 
testing and replying any further. SD is ready for prime time, finalised and 
does everything I intended it to. This is where I have to reveal to them the 
horrible truth. This is no guarantee it will go in. In fact, this one point 
that you (Ingo) go on and on about is not only a quibble, but you will call 
it an absolute showstopper. As maintainer of the cpu scheduler, in its 
current form you will flatly refuse it goes to mainline citing the 5% of 
cases where interactivity has regressed. So people will tell me to fix it, 
right?... Read on for this to unfold.


I'm sorry but this is a mis-representation to me, as I suggested on an earlier 
thread where I disagree about what an interactivity estimator is. The idea of 
fence posts in a clock that are passed as a way of metering out 
earliest-deadline-first in a design is well established. The matrix is simply 
an array designed for O(1) lookups of the fence posts. That is not the same 
as "oh how much have we slept in the last $magic_number period and how much 
extra time should we get for that".


And BANG there is the bullet you will use against SD from here to eternity. SD 
obeys fairness at all costs. Your interactivity regression is that SD causes 
progressive slowdown with load which by definition is fairness. You 
repeatedly ask me to address it and there is on unfailing truth; the only way 
to address it is to add unfairness to the design. So why don't I? Because the 
simple fact is that any unfairness no matter how carefully administered or 
metered will always have cases where it's wrong. Look at the title of this 
email for example - it's yet another exploit for the mainline sleep/run 
mechanism. This does _not_ mean I'm implying people are logging into servers 
and running ./tenp to hang the machine. What it demonstrates is a way of 
reproducing the scenario which is biting people with real world loads. It's 
entirely believable that a simple p2p app could be behaving like tenp, only 
generating a small load and it could take ages to log in and use the console. 
Willy has complained this is why people stick to 2.4. Sure I can create 
interactivity tweaks worse than anyone else. I will not, though, because that 
precisely undoes what is special about SD. It never looks backwards, and is 
predictable to absurdity. So you'll argue that mainline can manage it 
below...


I have yet to see someone find an "exploit" for SD's current design. Mainline 
is all about continually patching up the intrinsic design (and fixing this 
one test case is not the be all and end all).


Well you see a race. I do not. I see a flat predictable performance from SD 
where there will always be slowdown with load. I have no intention of 
changing that. Mike is making an admirable attempt to fix issues as they are 
pointed out. You say there are no regressions but I see absolutely no testers 
of his patches besides himself and you. If I introduce any unfairness based 
on sleep behaviour into SD I'll be undoing the whole point of the design and 
end up chasing new regressions. So I won't quibble over the numbers. SD has 
produced a lot of improvements and fairness that mainline struggles with ever 
increasing patches to emulate, but SD does so at the expense of proportional 
slowdown with load. At least I accept that and will no longer put my health 
at risk trying to "fix" it by "breaking" it. SD is done.

I feel sorry for the many users out there who are simply "waiting for it to 
end up in mainline" who just discovered you will veto it on that basis. 
lwn.net had it wrong; this was far more painful than any previous attempt to 
get anything into mainline.

My health has been so badly affected by this that I've been given an ultimatum 
and must turn my computer off till I get well now which may be weeks. I 
already know the massive flameage and last-word comments that are likely to 
be fired off before the inevitable decision to veto it.


さようなら

-- 
-ck
-
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
[PATCH] sched: staircase deadline misc fixes, Con Kolivas, (Wed Mar 28, 9:37 am)
Re: [ck] [PATCH] sched: staircase deadline misc fixes, Prakash Punnoor, (Wed Mar 28, 10:34 am)
Re: [PATCH] sched: staircase deadline misc fixes, Ingo Molnar, (Wed Mar 28, 11:48 am)
Re: [PATCH] sched: staircase deadline misc fixes, Con Kolivas, (Wed Mar 28, 4:44 pm)
Re: [PATCH] sched: staircase deadline misc fixes, Mike Galbraith, (Wed Mar 28, 10:50 pm)
Re: [PATCH] sched: staircase deadline misc fixes, Mike Galbraith, (Wed Mar 28, 11:29 pm)
Re: [PATCH] sched: staircase deadline misc fixes, Con Kolivas, (Wed Mar 28, 11:36 pm)
Re: [PATCH] sched: staircase deadline misc fixes, Mike Galbraith, (Wed Mar 28, 11:54 pm)
Re: [PATCH] sched: staircase deadline misc fixes, Mike Galbraith, (Thu Mar 29, 1:18 am)
Re: [ck] Re: [PATCH] sched: staircase deadline misc fixes, michael chang, (Thu Mar 29, 5:55 am)
Re: [ck] [PATCH] sched: staircase deadline misc fixes, Prakash Punnoor, (Sat Mar 31, 11:40 pm)
Re: [PATCH] sched: staircase deadline misc fixes, Con Kolivas, (Mon Apr 2, 7:35 pm)
Re: [PATCH] sched: staircase deadline misc fixes, Con Kolivas, (Mon Apr 2, 7:37 pm)
Re: [PATCH] sched: staircase deadline misc fixes, Mike Galbraith, (Mon Apr 2, 10:31 pm)
Re: [PATCH] sched: staircase deadline misc fixes, Mike Galbraith, (Mon Apr 2, 11:00 pm)
Re: [PATCH] sched: staircase deadline misc fixes, Ingo Molnar, (Mon Apr 2, 11:01 pm)
Re: [PATCH] sched: staircase deadline misc fixes, Mike Galbraith, (Mon Apr 2, 11:11 pm)
Re: [PATCH] sched: staircase deadline misc fixes, Mike Galbraith, (Tue Apr 3, 3:57 am)
Re: [PATCH] sched: staircase deadline misc fixes, Mike Galbraith, (Thu Apr 5, 4:02 am)
Re: [PATCH] sched: staircase deadline misc fixes, Ingo Molnar, (Thu Apr 5, 4:09 am)
Re: [PATCH] sched: staircase deadline misc fixes, Mike Galbraith, (Thu Apr 5, 4:12 am)
Re: [PATCH] sched: staircase deadline misc fixes, Ingo Molnar, (Thu Apr 5, 4:15 am)
[test] sched: SD-latest versus Mike's latest, Ingo Molnar, (Thu Apr 5, 4:54 am)
Re: [test] sched: SD-latest versus Mike's latest, Mike Galbraith, (Thu Apr 5, 5:10 am)
Re: [test] sched: SD-latest versus Mike's latest, Ingo Molnar, (Thu Apr 5, 5:12 am)
Re: [test] sched: SD-latest versus Mike's latest, Mike Galbraith, (Thu Apr 5, 5:24 am)
Re: [PATCH] sched: staircase deadline misc fixes, Johannes Stezenbach, (Thu Apr 5, 6:18 am)
Re: [PATCH] sched: staircase deadline misc fixes, Mike Galbraith, (Thu Apr 5, 8:28 am)
Re: [test] sched: SD-latest versus Mike's latest, Con Kolivas, (Thu Apr 5, 9:08 am)
Re: [test] sched: SD-latest versus Mike's latest, Ingo Molnar, (Thu Apr 5, 12:05 pm)
Re: [test] sched: SD-latest versus Mike's latest, Mike Galbraith, (Thu Apr 5, 1:29 pm)
Ten percent test, Con Kolivas, (Thu Apr 5, 6:03 pm)
Re: Ten percent test, Mike Galbraith, (Fri Apr 6, 2:07 am)
Re: Ten percent test, Con Kolivas, (Fri Apr 6, 2:28 am)
Re: Ten percent test, Ingo Molnar, (Fri Apr 6, 3:03 am)
Re: Ten percent test, Mike Galbraith, (Fri Apr 6, 3:40 am)
Re: Ten percent test, Mike Galbraith, (Fri Apr 6, 3:48 am)
Re: Ten percent test, Con Kolivas, (Fri Apr 6, 11:50 pm)
Re: Ten percent test, Gene Heskett, (Sat Apr 7, 9:12 am)
Re: Ten percent test, Mike Galbraith, (Sat Apr 7, 9:32 am)
Re: Ten percent test, Ingo Molnar, (Sat Apr 7, 11:08 am)
Re: Ten percent test, Gene Heskett, (Sat Apr 7, 11:23 am)
Re: Ten percent test, Ingo Molnar, (Sat Apr 7, 11:52 am)
Re: Ten percent test, Mike Galbraith, (Sat Apr 7, 12:14 pm)
Re: Ten percent test, Gene Heskett, (Sat Apr 7, 1:30 pm)
Re: Ten percent test, Gene Heskett, (Sat Apr 7, 1:31 pm)
Re: Ten percent test, Ingo Molnar, (Sun Apr 8, 3:41 am)
Re: Ten percent test, Ingo Molnar, (Sun Apr 8, 3:58 am)
Re: Ten percent test, Gene Heskett, (Sun Apr 8, 4:33 am)
Re: Ten percent test, Mike Galbraith, (Sun Apr 8, 4:40 am)
Re: Ten percent test, Mike Galbraith, (Sun Apr 8, 5:02 am)
Re: Ten percent test, Ed Tomlinson, (Sun Apr 8, 6:08 am)
Re: Ten percent test, Gene Heskett, (Sun Apr 8, 10:04 am)
Re: Ten percent test, Gene Heskett, (Sun Apr 8, 10:56 am)
Re: Ten percent test, Gene Heskett, (Sun Apr 8, 10:57 am)
Re: Ten percent test, Rene Herman, (Sun Apr 8, 11:51 am)
Re: Ten percent test, Mike Galbraith, (Sun Apr 8, 9:03 pm)
Re: Ten percent test, Gene Heskett, (Sun Apr 8, 9:08 pm)
Re: Ten percent test, Mike Galbraith, (Sun Apr 8, 9:17 pm)
Re: Ten percent test, Mike Galbraith, (Sun Apr 8, 9:19 pm)
Re: Ten percent test, Mike Galbraith, (Sun Apr 8, 9:23 pm)
Re: Ten percent test, Gene Heskett, (Sun Apr 8, 10:16 pm)
Re: Ten percent test, Gene Heskett, (Sun Apr 8, 10:23 pm)
Re: Ten percent test, Mike Galbraith, (Sun Apr 8, 10:38 pm)
Re: Ten percent test, Mike Galbraith, (Sun Apr 8, 10:59 pm)
Re: Ten percent test, Mike Galbraith, (Sun Apr 8, 11:06 pm)
Re: Ten percent test, Mike Galbraith, (Sun Apr 8, 11:09 pm)
Re: Ten percent test, Mike Galbraith, (Mon Apr 9, 1:24 am)
Re: Ten percent test, Ed Tomlinson, (Mon Apr 9, 4:26 am)
Re: Ten percent test, Rene Herman, (Mon Apr 9, 5:14 am)
Re: Ten percent test, Gene Heskett, (Mon Apr 9, 6:01 am)
Re: Ten percent test, Andreas Mohr, (Mon Apr 9, 6:27 am)
Re: Ten percent test, Ingo Molnar, (Mon Apr 9, 6:53 am)
Re: Ten percent test, Ingo Molnar, (Mon Apr 9, 7:15 am)
Re: Ten percent test, Rene Herman, (Mon Apr 9, 8:37 am)
Re: Ten percent test, Mike Galbraith, (Mon Apr 9, 9:50 am)
Re: Ten percent test, Rene Herman, (Mon Apr 9, 10:05 am)
Re: Ten percent test, Mike Galbraith, (Mon Apr 9, 10:10 am)
Re: Ten percent test, Ingo Molnar, (Mon Apr 9, 10:48 am)
Re: Ten percent test, William Lee Irwin III, (Mon Apr 9, 10:51 am)
Re: Ten percent test, Ingo Molnar, (Mon Apr 9, 11:03 am)
Re: Ten percent test, William Lee Irwin III, (Mon Apr 9, 11:44 am)
Re: Ten percent test, Rene Herman, (Mon Apr 9, 12:09 pm)
Re: Ten percent test, Rene Herman, (Mon Apr 9, 12:54 pm)
Re: Ten percent test, Gene Heskett, (Mon Apr 9, 12:56 pm)
Re: Ten percent test, Mike Galbraith, (Mon Apr 9, 7:39 pm)
Re: Ten percent test, Ed Tomlinson, (Tue Apr 10, 4:23 am)
Re: Ten percent test, Mike Galbraith, (Tue Apr 10, 5:04 am)
Re: [ck] Re: Ten percent test, Martin Steigerwald, (Sun Apr 22, 3:48 am)
Re: [ck] Re: Ten percent test, Con Kolivas, (Sun Apr 22, 4:15 am)
Re: [PATCH] sched: staircase deadline misc fixes, Andrew Morton, (Mon Apr 23, 1:58 am)