login
Header Space

 
 

Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation

Score:
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
To: Peter Zijlstra <a.p.zijlstra@...>
Cc: Ingo Molnar <mingo@...>, Thomas Gleixner <tglx@...>, Oleg Nesterov <oleg@...>, Steven Rostedt <rostedt@...>, Paul Jackson <pj@...>, <linux-kernel@...>
Date: Wednesday, February 27, 2008 - 7:38 pm

Peter Zijlstra wrote:
General impressions:
- "cpu_system_map" is %100 identical to the "~cpu_isolated_map" as in my 
patches. It's updated from different place but functionally wise it's very 
much the same. I guess you did not like the 'isolated' name ;-). As I 
mentioned before I'm not hung up on the name so it's cool :).

- Updating cpu_system_map from cpusets
There are a couple of things that I do not like about this approach:
1. We lost the ability to isolate CPUs at boot. Which means slower boot times 
for me (ie before I can start my apps I need to create cpuset, etc). Not a big 
deal, I can live with it.

2. We now need another notification mechanism to propagate the updates to the 
cpu_system_map. That by itself is not a big deal. The big deal is that now we 
need to basically audit the kernel and make sure that everything affected must
have proper notifier and react to the mask changes.
For example your current patch does not move the timers and I do not think it 
makes sense to go and add notifier for the timers. I think the better approach 
is to use CPU hotplug here. ie Enforce the rule that cpu_system_map is updated 
  only when CPU is off-line.
By bringing CPU down first we get a lot of features for free. All the kernel 
threads, timers, softirqs, HW irqs, workqueues, etc are properly 
terminated/moved/canceled/etc. This gives us a very clean state when we bring 
the CPU back online with "system" bit cleared (or "isolated" bit set like in 
my patches). I do not see a good reason for reimplementing that functionality 
via system_map notifiers.

I'll comment more on the individual patches.

Do not forget the "stop machine", or more specifically module loading/unloading.

Max
--
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
[RFC/PATCH 0/4] CPUSET driven CPU isolation, Peter Zijlstra, (Wed Feb 27, 6:21 pm)
[RFC/PATCH] cpuset: cpuset irq affinities, Peter Zijlstra, (Fri Feb 29, 2:55 pm)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Christoph Hellwig, (Sun Mar 2, 1:18 am)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Paul Jackson, (Fri Feb 29, 4:55 pm)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Peter Zijlstra, (Fri Feb 29, 5:14 pm)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Paul Jackson, (Fri Feb 29, 5:53 pm)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Max Krasnyanskiy, (Fri Feb 29, 5:42 pm)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Paul Jackson, (Fri Feb 29, 6:00 pm)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Ingo Molnar, (Fri Feb 29, 5:32 pm)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Ingo Molnar, (Fri Feb 29, 5:29 pm)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Ingo Molnar, (Fri Feb 29, 3:02 pm)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Max Krasnyanskiy, (Fri Feb 29, 4:52 pm)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Peter Zijlstra, (Fri Feb 29, 5:03 pm)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Max Krasnyanskiy, (Fri Feb 29, 5:20 pm)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Peter Zijlstra, (Mon Mar 3, 7:57 am)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Paul Jackson, (Mon Mar 3, 1:36 pm)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Peter Zijlstra, (Mon Mar 3, 1:57 pm)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Paul Jackson, (Mon Mar 3, 2:10 pm)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Paul Menage, (Mon Mar 3, 2:41 pm)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Paul Jackson, (Mon Mar 3, 2:52 pm)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Paul Menage, (Tue Mar 4, 1:26 am)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Paul Jackson, (Tue Mar 4, 2:15 am)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Paul Menage, (Tue Mar 4, 2:21 am)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Paul Jackson, (Tue Mar 4, 2:26 am)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Paul Menage, (Tue Mar 4, 2:34 am)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Paul Jackson, (Tue Mar 4, 2:51 am)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Peter Zijlstra, (Mon Mar 3, 2:18 pm)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Paul Jackson, (Tue Mar 4, 3:35 am)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Peter Zijlstra, (Tue Mar 4, 7:06 am)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Max Krasnyanskiy, (Tue Mar 4, 3:52 pm)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Paul Jackson, (Tue Mar 4, 9:11 pm)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Peter Zijlstra, (Wed Mar 5, 4:37 am)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Paul Jackson, (Thu Mar 6, 9:47 am)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Peter Zijlstra, (Thu Mar 6, 11:21 am)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Paul Jackson, (Thu Mar 6, 11:40 pm)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Paul Jackson, (Fri Mar 7, 2:39 am)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Paul Menage, (Fri Mar 7, 4:47 am)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Paul Jackson, (Fri Mar 7, 10:57 am)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Max Krasnyansky, (Wed Mar 5, 3:17 pm)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Ingo Molnar, (Wed Mar 5, 4:50 am)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Paul Jackson, (Wed Mar 5, 8:35 am)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Ingo Molnar, (Wed Mar 5, 8:43 am)
Re: [RFC/PATCH] cpuset: cpuset irq affinities, Paul Jackson, (Wed Mar 5, 1:44 pm)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Mark Hounschell, (Thu Feb 28, 8:12 am)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Max Krasnyansky, (Thu Feb 28, 3:57 pm)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Ingo Molnar, (Thu Feb 28, 3:50 am)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Andrew Morton, (Fri Feb 29, 4:31 am)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Ingo Molnar, (Fri Feb 29, 5:10 am)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Max Krasnyanskiy, (Fri Feb 29, 2:06 pm)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Andrew Morton, (Fri Feb 29, 4:36 am)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Max Krasnyanskiy, (Thu Feb 28, 1:48 pm)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Paul Jackson, (Thu Feb 28, 4:08 am)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Ingo Molnar, (Thu Feb 28, 5:08 am)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Max Krasnyansky, (Thu Feb 28, 4:23 pm)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Paul Jackson, (Thu Feb 28, 5:17 am)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Ingo Molnar, (Thu Feb 28, 6:46 am)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Max Krasnyansky, (Thu Feb 28, 4:11 pm)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Paul Jackson, (Thu Feb 28, 4:13 pm)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Max Krasnyansky, (Thu Feb 28, 4:26 pm)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Paul Jackson, (Thu Feb 28, 4:27 pm)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Max Krasnyansky, (Thu Feb 28, 4:45 pm)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Paul Jackson, (Thu Feb 28, 1:47 pm)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, David Rientjes, (Thu Feb 28, 5:32 am)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, David Rientjes, (Thu Feb 28, 6:12 am)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Paul Jackson, (Thu Feb 28, 1:37 pm)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, David Rientjes, (Thu Feb 28, 5:24 pm)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Paul Jackson, (Thu Feb 28, 6:46 pm)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, David Rientjes, (Thu Feb 28, 7:00 pm)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Paul Jackson, (Thu Feb 28, 8:16 pm)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, David Rientjes, (Thu Feb 28, 9:05 pm)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Paul Jackson, (Thu Feb 28, 11:34 pm)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, David Rientjes, (Fri Feb 29, 12:00 am)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Paul Jackson, (Fri Feb 29, 2:53 am)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Peter Zijlstra, (Thu Feb 28, 6:26 am)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Max Krasnyanskiy, (Wed Feb 27, 7:38 pm)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Peter Zijlstra, (Thu Feb 28, 6:19 am)
Re: [RFC/PATCH 0/4] CPUSET driven CPU isolation, Max Krasnyanskiy, (Thu Feb 28, 1:33 pm)
speck-geostationary