I have a machine with 32 bit Linux 2.6.22-15 (Ubuntu Gutsy) that is installed on a 8 GB server with two quad core CPU.
The problem is that it slowly runs out of LOWMEM.
Every minute it loses approximately 400 KB of LOWMEM, as evidenced by
grep LowFree /proc/meminfo
This seems to be fairly constant throughout the day. During the day the machine really took a beating and performed admirably, moving approximately 70 megabits of data per second on average. It was also busy computing stuff. However, the rate of low memory decline did not seem to depend on how busy the machine was.
Here's the printout of lowmem throughout the day starting at 6:40am.
http://igor.chudov.com/tmp/lowmem.txt
any ideas, I am getting desperate
This leads to invokation of OOM-Killer and system lockup
I think that I can handle it with nightly reboots, but it is BAD BAD BAD
Update or switch to 64-bit
Firstly, 2.6.22 is rather old in kernel terms - if this is a self-built kernel, update to 2.6.26. If it's a distro kernel, go via their bug reporting route, and get the distro to help you fix this.
Secondly, if you've got modern quad core CPUs, you should be able to run a 64-bit kernel with a 32-bit userland (assuming you're tied to 32-bit due to software you run on top of it). 64-bit kernels would treat all 8GB as lowmem, and would solve the issue for you.
If updating to 2.6.26 doesn't solve things, a .config and dmesg will help in tracking down what's misconfigured.