You're most welcome. The pleasure is all mine.
There is not much my customers HPC jobs can do with notification before
swap. Their jobs either have the main memory they need to perform the
requested calculations with the desired performance, or their job is
useless and should be killed. Unlike the applications you describe,
my customers jobs have no way, once running, to adapt to less memory.
They can only adapt to less memory by being restarted with a different
set of resource requests to the job scheduler (the application that
manages job requests, assigns them CPU, memory and other resources,
and monitors, starts, stops and pauses jobs.)
The primary difficulty my HPC customers have is killing such jobs fast
enough, before a bad job (one that attempts to use more memory than it
signed up for) can harm the performance of other users and the rest of
the system.
I don't mind if a pages are slowly or occassionally written to swap;
but as soon as the task wants to reclaim big chunks of memory by
writing thousands of pages at once to swap, it must die, and die
before it can queue more than a handful of those pages to the swapper.
Yes - understood and agreed - as I guessed, cpusets are not configured
in embedded systems.
Yes - I agree that my ideas were quite different. Please don't
hesitate to reject every one of them, like a Samurai slicing through
air with his favorite sword <grin>.
For your work, yes that hook is too late. Agreed.
Depending on what we're trying to do:
1) warn applications of swap coming soon (your case),
2) show how close we are to swapping,
3) show how much swap has happened already,
4) kill instantly if try to swap (my hpc case),
5) measure file i/o caused by memory pressure, or
6) perhaps other goals,
we will need to hook different places in the kernel.
It may well be that your hooks for embedded are simply in different
places than my hooks for HPC. If so, that's fine.
I look forward to your further thoughts.
--
I won't rest till it's the best ...
Programmer, Linux Scalability
Paul Jackson <pj@sgi.com> 1.940.382.4214
--
