Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
From: Willy Tarreau
Date: Sunday, April 15, 2007 - 5:45 am

On Sun, Apr 15, 2007 at 01:39:27PM +0300, Pekka Enberg wrote:

That's not exactly the problem. There are people who work very hard to
try to improve some areas of the kernel. They progress slowly, and
acquire more and more skills. Sometimes they feel like they need to
change some concepts and propose those changes which are required for
them to go further, or to develop faster. Those are rejected. So they
are constrained to work in a delimited perimeter from which it is
difficult for them to escape.

Then, the same person who rejected their changes comes with something
shiny new, better and which took him far less time. But he sort of
broke the rules because what was forbidden to the first persons is
suddenly permitted. Maybe for very good reasons, I'm not discussing
that. The good reason should have been valid the first time too.

The fact is that when changes are rejected, we should not simply say
"no", but explain why and define what would be acceptable. Some people
here have excellent teaching skills for this, but most others do not.
Anyway, the rules should be the same for everybody.

Also, there is what can be perceived as marketting here. Con worked
on his idea with convictions, he took time to write some generous
documentation, but he hit a wall where his concept was suboptimal on
a given workload. But at least, all the work was oriented on a technical
basis : design + code + doc.

Then, Ingo comes in with something looking amazingly better, with
virtually no documentation, an appealing announcement, and a shiny
advertising at boot. All this implemented without the constraints
other people had to respect. It already looks like definitive work
which will be merge as-is without many changes except a few bugfixes.

If those were two companies, the first one would simply have accused
the second one of not having respected contracts and having employed
heaving marketting to take the first place.

People here do not code for a living, they do it at least because they
believe in what they are doing, and some of them want a bit of gratitude
for their work. I've met people who were proud to say they implement
this or that feature in the kernel, so it is something important for
them. And being cited in an email is nothing compared to advertising
at boot time.

When the discussion was blocked between Con and Mike concerning the
design problems, it is where a new discussion should have taken place.
Ingo could have publicly spoken with them about his ideas of killing
the O(1) scheduler and replacing it with an rbtree-based one, and using
part of Bill's work to speed up development.

It is far easier to resign when people explain what concepts are wrong
and how they think they will do than when they suddenly present something
out of nowhere which is already better.

And it's not specific to Ingo (though I think his ability to work that
fast alone makes him tend to practise this more often than others).

Imagine if Con had worked another full week on his scheduler with better
results on Mike's workload, but still not as good as Ingo's, and they both
published at the same time. You certainly can imagine he would have preferred
to be informed first that it was pointless to continue in that direction.

Now I hope he and Bill will get over this and accept to work on improving
this scheduler, because I really find it smarter than a dumb O(1). I even
agree with Mike that we now have a solid basis for future work. But for
this, maybe a good starting point would be to remove the selfish printk
at boot, revert useless changes (SCHED_NORMAL->SCHED_FAIR come to mind)
and improve the documentation a bit so that people can work together on
the new design, without feeling like their work will only server to
promote X or Y.

Regards,
Willy

-
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Fri Apr 13, 2:21 pm)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., Michal Piotrowski, (Fri Apr 13, 2:57 pm)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Fri Apr 13, 3:21 pm)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Fri Apr 13, 4:30 pm)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Fri Apr 13, 4:58 pm)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., Eric W. Biederman, (Sat Apr 14, 10:15 am)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., Eric W. Biederman, (Sat Apr 14, 10:44 am)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., Eric W. Biederman, (Sat Apr 14, 11:40 am)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Sat Apr 14, 12:48 pm)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Sat Apr 14, 9:01 pm)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., Willy Tarreau, (Sun Apr 15, 5:45 am)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Sun Apr 15, 8:26 am)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Sun Apr 15, 8:47 am)
Re: Kaffeine problem with CFS, Ingo Molnar, (Sun Apr 15, 9:13 am)
Re: Kaffeine problem with CFS, Ingo Molnar, (Sun Apr 15, 9:25 am)
Re: Kaffeine problem with CFS, Christoph Pfister, (Sun Apr 15, 9:55 am)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., Jonathan Lundell, (Sun Apr 15, 12:00 pm)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Sun Apr 15, 12:35 pm)
Re: Kaffeine problem with CFS, S.Çağlar, (Sun Apr 15, 3:14 pm)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Sun Apr 15, 4:39 pm)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Sun Apr 15, 4:54 pm)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Sun Apr 15, 8:04 pm)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Mon Apr 16, 4:04 am)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Mon Apr 16, 6:46 am)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Mon Apr 16, 8:45 am)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Mon Apr 16, 9:13 am)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., Michael K. Edwards, (Mon Apr 16, 4:10 pm)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Mon Apr 16, 11:09 pm)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Mon Apr 16, 11:14 pm)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Mon Apr 16, 11:26 pm)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Tue Apr 17, 12:09 am)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Tue Apr 17, 1:23 am)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Tue Apr 17, 1:24 am)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Tue Apr 17, 2:05 am)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Tue Apr 17, 2:57 am)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Tue Apr 17, 4:31 am)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Tue Apr 17, 1:05 pm)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Tue Apr 17, 3:32 pm)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., Michael K. Edwards, (Tue Apr 17, 4:00 pm)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Tue Apr 17, 4:07 pm)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., Michael K. Edwards, (Tue Apr 17, 4:52 pm)
Re: Kaffeine problem with CFS, Ingo Molnar, (Wed Apr 18, 1:27 am)
Re: Kaffeine problem with CFS, Ingo Molnar, (Wed Apr 18, 1:57 am)
Re: Kaffeine problem with CFS, Christoph Pfister, (Wed Apr 18, 1:57 am)
Re: Kaffeine problem with CFS, Ingo Molnar, (Wed Apr 18, 2:01 am)
Re: Kaffeine problem with CFS, Ingo Molnar, (Wed Apr 18, 2:06 am)
Re: Kaffeine problem with CFS, Mike Galbraith, (Wed Apr 18, 2:12 am)
Re: Kaffeine problem with CFS, Christoph Pfister, (Wed Apr 18, 2:13 am)
Re: Kaffeine problem with CFS, Ingo Molnar, (Wed Apr 18, 2:17 am)
Re: Kaffeine problem with CFS, Christoph Pfister, (Wed Apr 18, 2:25 am)
Re: Kaffeine problem with CFS, Ingo Molnar, (Wed Apr 18, 2:28 am)
Re: Kaffeine problem with CFS, Christoph Pfister, (Wed Apr 18, 2:52 am)
Re: Kaffeine problem with CFS, Christoph Pfister, (Wed Apr 18, 3:04 am)
Re: Kaffeine problem with CFS, Ingo Molnar, (Wed Apr 18, 3:17 am)
Re: Kaffeine problem with CFS, Ingo Molnar, (Wed Apr 18, 3:32 am)
Re: Kaffeine problem with CFS, Ingo Molnar, (Wed Apr 18, 3:37 am)
Re: Kaffeine problem with CFS, Ingo Molnar, (Wed Apr 18, 3:49 am)
Re: Kaffeine problem with CFS, Ingo Molnar, (Wed Apr 18, 3:53 am)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Wed Apr 18, 6:08 am)
Re: CFS and suspend2: hang in atomic copy, Christian Hesse, (Wed Apr 18, 1:45 pm)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Thu Apr 19, 12:57 am)
Renice X for cpu schedulers, Con Kolivas, (Thu Apr 19, 4:59 am)
Re: Renice X for cpu schedulers, Peter Williams, (Thu Apr 19, 5:42 am)
Re: Renice X for cpu schedulers, Mark Lord, (Thu Apr 19, 6:17 am)
Re: Renice X for cpu schedulers, Con Kolivas, (Thu Apr 19, 8:10 am)
Re: Renice X for cpu schedulers, Mark Lord, (Thu Apr 19, 9:15 am)
Re: Renice X for cpu schedulers, Gene Heskett, (Thu Apr 19, 11:16 am)
Re: Renice X for cpu schedulers, Gene Heskett, (Thu Apr 19, 11:21 am)
Re: Renice X for cpu schedulers, Ray Lee, (Thu Apr 19, 12:26 pm)
Re: Renice X for cpu schedulers, Michael K. Edwards, (Thu Apr 19, 2:35 pm)
Re: Renice X for cpu schedulers, Con Kolivas, (Thu Apr 19, 3:47 pm)
Re: Renice X for cpu schedulers, Con Kolivas, (Thu Apr 19, 3:56 pm)
Re: Renice X for cpu schedulers, Con Kolivas, (Thu Apr 19, 5:17 pm)
Re: Renice X for cpu schedulers, Michael K. Edwards, (Thu Apr 19, 5:20 pm)
Re: Renice X for cpu schedulers, Ray Lee, (Thu Apr 19, 5:56 pm)
Re: Renice X for cpu schedulers, Ed Tomlinson, (Thu Apr 19, 6:17 pm)
Re: Renice X for cpu schedulers, Linus Torvalds, (Thu Apr 19, 6:27 pm)
Re: Renice X for cpu schedulers, Gene Heskett, (Thu Apr 19, 7:00 pm)
Re: Renice X for cpu schedulers, Gene Heskett, (Thu Apr 19, 7:01 pm)
Re: Renice X for cpu schedulers, Nick Piggin, (Thu Apr 19, 8:57 pm)
Re: Renice X for cpu schedulers, Nick Piggin, (Thu Apr 19, 9:09 pm)
Re: Renice X for cpu schedulers, Mike Galbraith, (Thu Apr 19, 10:24 pm)
Re: [Announce] [patch] Modular Scheduler Core and Complete ..., William Lee Irwin III, (Thu Apr 19, 10:26 pm)
Re: Renice X for cpu schedulers, Bill Huey, (Thu Apr 19, 10:34 pm)
Re: Renice X for cpu schedulers, Mark Lord, (Sat Apr 21, 7:55 am)
Re: Renice X for cpu schedulers, Mark Lord, (Sun Apr 22, 5:54 am)
Re: Renice X for cpu schedulers, Con Kolivas, (Sun Apr 22, 5:58 am)
Re: Renice X for cpu schedulers, Ray Lee, (Tue Apr 24, 8:50 am)
Re: Renice X for cpu schedulers, Matt Mackall, (Tue Apr 24, 9:23 am)