Re: [announce] CFS-devel, performance improvements

Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
From: Roman Zippel
Date: Wednesday, September 12, 2007 - 3:17 pm

Hi,

On Tue, 11 Sep 2007, Ingo Molnar wrote:


I'm must really say, I'm quite impressed by your efforts to give me as 
little credit as possible.
On the one hand it's of course positive to see so much sudden activity, on 
the other hand I'm not sure how much had happened if I hadn't posted my 
patch, I don't really think it were my complaints about CFS's complexity 
that finally lead to the improvements in this area. I presented the basic 
concepts of my patch already with my first CFS review, but at that time 
you didn't show any interest and instead you were rather quick to simply 
dismiss it. My patch did not add that much new, it's mostly a conceptual 
improvement and describes the math in more detail, but it also 
demonstrated a number of improvements.


Am I the only one who can't clone that thing? So I can't go into much 
detail about the individual changes here.
The thing that makes me curious, is that it also includes patches by 
others. It can't be entirely explained with the Kernel Summit, as this is 
not the first time patches appear out of the blue in form of a git tree. 
The funny/sad thing is that at some point Linus complained about Con that 
his development activity happend on a separate mailing list, but there was 
at least a place to go to. CFS's development appears to mostly happen in 
private. Patches may be your primary form of communication, but that isn't 
true for many other people, with patches a lot of intent and motivation 
for a change is lost. I know it's rather tempting to immediately try out 
an idea first, but would it really hurt you so much to formulate an idea 
in a more conventional manner? Are you afraid it might hurt your 
ueberhacker status by occasionally screwing up in public? Patches on the 
other hand have the advantage to more easily cover that up by simply 
posting a fix - it makes it more difficult to understand what's going on.
A more conventional way of communication would give more people a chance 
to participate, they may not understand every detail of the patch, but 
they can try to understand the general concepts and apply them to their 
own situation and eventually come up with some ideas/improvements of their 
own, they would be less dependent on you to come up with a solution to 
their problem. Unless of course that's exactly what you want - unless you 
want to be in full control of the situation and you want to be the hero 
that saves the day.


In the patch you really remove _a_lot_ of stuff. You also removed a lot of 
things I tried to get you to explain them to me. On the one hand I could 
be happy that these things are gone, as they were the major road block to 
splitting up my own patch. On the other hand it still leaves me somewhat 
unsatisfied, as I still don't know what that stuff was good for.
In a more collaborative development model I would have expected that you 
tried to explain these features, which could have resulted in a discussion 
how else things can be implemented or if it's still needed at all. Instead 
of this you now simply decide unilaterally that these things are not 
needed anymore.

BTW the old sleeper fairness logic "that worked out fine" is actually 
completely gone and is now conceptually closer to what I'm already doing 
in my patch (only the amount of sleeper bonus differs).


Well, one could say that you used every little trick in the book to get 
these numbers down. On the other hand at this point it's a little unclear 
whether you maybe removed it a little too much to get there, so the 
significance of these numbers is a bit limited.


I can't quite see that, the wait_runtime metric is relative to fair_clock 
and this is gone without any replacement, in my patch I at least 
calculate these values for the debug output, but in your patch even that 
is simply gone, so I'm not sure what you actually compare "side by side".


At this point it gets really interesting - I'm amazed how much you stress 
the differences. If we take the basic math as I more simply explained it 
in this example http://lkml.org/lkml/2007/9/3/168, you now also make the 
step from the relative wait_runtime value to an absolute virtual time 
value. Basically it's really the same thing, only the resolution differs. 
This means you already reimplemented a key element of my patch, so would 
you please give me at least that much credit?
The rest of the math is indeed different - it's simply missing. What is 
there is IMO not really adequate. I guess you will see the differences, 
once you test a bit more with different nice levels. There's a good reason 
I put that much effort into maintaining a good, but still cheap average, 
it's needed for a good task placement. There is of course more than one 
way to implement this, so you'll have good chances to simply reimplement 
it somewhat differently, but I'd be surprised if it would be something 
completely different.

To make it very clear to everyone else: this is primarely not about 
getting some credit, although that's not completely unimportant of course. 
This is about getting adequate help. I had to push very hard to get any 
kind of acknowledgment with scheduler issues only to be rewarded with 
silence, so that I was occassionally wondering myself, whether I'm just 
hallucinating all this. Only after I provide the prove that further 
improvements are possible is there some activity. But instead of providing 
help (e.g. by answering my questions) Ingo just goes ahead and 
reimplements the damn thing himself and simply throws out all questionable 
items instead of explaining them.
The point is that I have no real interest in any stinking competition, I 
have no interest to be reduced to simply complaining all the time. I'm 
more interested in a cooperation, but that requires better communication 
and an actual exchange of ideas, patches are no real communication, they 
are a supplement and should rather be the end result instead of means to 
get anything started. A collaboration could bundle the individual 
strengths, so that this doesn't degenerate into a contest of who's the 
greatest hacker.
Is this really too much to expect?

bye, Roman
-
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
[announce] CFS-devel, performance improvements, Ingo Molnar, (Tue Sep 11, 1:04 pm)
Re: [announce] CFS-devel, performance improvements, Roman Zippel, (Tue Sep 11, 5:42 pm)
Re: [announce] CFS-devel, performance improvements, Rob Hussey, (Tue Sep 11, 6:16 pm)
Re: [announce] CFS-devel, performance improvements, Mike Galbraith, (Tue Sep 11, 11:20 pm)
Re: [announce] CFS-devel, performance improvements, Roman Zippel, (Wed Sep 12, 3:17 pm)
Re: [announce] CFS-devel, performance improvements, debian developer, (Thu Sep 13, 12:17 am)
Re: [announce] CFS-devel, performance improvements, debian developer, (Thu Sep 13, 12:34 am)
Re: [announce] CFS-devel, performance improvements, Ingo Molnar, (Thu Sep 13, 12:52 am)
Re: [announce] CFS-devel, performance improvements, Rob Hussey, (Thu Sep 13, 1:42 am)
Re: [announce] CFS-devel, performance improvements, Ingo Molnar, (Thu Sep 13, 2:06 am)
Re: [announce] CFS-devel, performance improvements, Ingo Molnar, (Thu Sep 13, 2:19 am)
Re: [announce] CFS-devel, performance improvements, Rob Hussey, (Thu Sep 13, 2:24 am)
Re: [announce] CFS-devel, performance improvements, Ingo Molnar, (Thu Sep 13, 2:31 am)
Re: [announce] CFS-devel, performance improvements, Rob Hussey, (Thu Sep 13, 2:36 am)
Re: [announce] CFS-devel, performance improvements, Rob Hussey, (Thu Sep 13, 2:43 am)
Re: [announce] CFS-devel, performance improvements, Rob Hussey, (Thu Sep 13, 3:17 am)
Re: [announce] CFS-devel, performance improvements, Peter Zijlstra, (Thu Sep 13, 4:35 am)
Re: [announce] CFS-devel, performance improvements, Ingo Molnar, (Thu Sep 13, 4:48 am)
Re: [announce] CFS-devel, performance improvements, Roman Zippel, (Thu Sep 13, 5:14 am)
Re: [announce] CFS-devel, performance improvements, Roman Zippel, (Thu Sep 13, 5:35 am)
Re: [announce] CFS-devel, performance improvements, Peter Zijlstra, (Thu Sep 13, 5:44 am)
Re: [announce] CFS-devel, performance improvements, Ingo Molnar, (Thu Sep 13, 5:47 am)
Re: [announce] CFS-devel, performance improvements, Ingo Molnar, (Thu Sep 13, 7:28 am)
Re: [announce] CFS-devel, performance improvements, Roman Zippel, (Thu Sep 13, 9:50 am)
Re: [announce] CFS-devel, performance improvements, Peter Zijlstra, (Thu Sep 13, 10:06 am)
Re: [announce] CFS-devel, performance improvements, Peter Zijlstra, (Thu Sep 13, 10:09 am)
Re: [announce] CFS-devel, performance improvements, Kyle Moffett, (Thu Sep 13, 11:28 am)
Re: [announce] CFS-devel, performance improvements, Sam Ravnborg, (Thu Sep 13, 12:01 pm)
Re: [announce] CFS-devel, performance improvements, Peter Zijlstra, (Thu Sep 13, 12:08 pm)
Re: [announce] CFS-devel, performance improvements, Willy Tarreau, (Thu Sep 13, 4:08 pm)
Re: [announce] CFS-devel, performance improvements, Rob Hussey, (Thu Sep 13, 6:47 pm)
Re: [announce] CFS-devel, performance improvements, Rob Hussey, (Thu Sep 13, 7:26 pm)
Re: [announce] CFS-devel, performance improvements, Kyle Moffett, (Thu Sep 13, 11:59 pm)
Re: [announce] CFS-devel, performance improvements, Peter Zijlstra, (Fri Sep 14, 4:16 am)
Re: [announce] CFS-devel, performance improvements, Roman Zippel, (Fri Sep 14, 4:46 am)
Re: [announce] CFS-devel, performance improvements, Roman Zippel, (Fri Sep 14, 5:04 am)
Re: [announce] CFS-devel, performance improvements, Peter Zijlstra, (Fri Sep 14, 5:17 am)
Re: [announce] CFS-devel, performance improvements, Roman Zippel, (Fri Sep 14, 5:26 am)
Re: [announce] CFS-devel, performance improvements, Roman Zippel, (Fri Sep 14, 6:10 am)
Re: [announce] CFS-devel, performance improvements, Roman Zippel, (Fri Sep 14, 7:50 am)
Re: [announce] CFS-devel, performance improvements, Roman Zippel, (Fri Sep 14, 8:13 am)
Re: [announce] CFS-devel, performance improvements, Arjan van de Ven, (Fri Sep 14, 8:26 am)
Re: [announce] CFS-devel, performance improvements, Arjan van de Ven, (Fri Sep 14, 8:56 am)
Re: [announce] CFS-devel, performance improvements, Willy Tarreau, (Fri Sep 14, 10:54 am)