login
Header Space

 
 

Re: [ANNOUNCE] Ramback: faster than a speeding bullet

Score:
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
To: Pavel Machek <pavel@...>
Cc: <david@...>, David Newall <davidn@...>, Chris Friesen <cfriesen@...>, Alan Cox <alan@...>, <linux-kernel@...>
Date: Saturday, March 15, 2008 - 4:51 pm

Hi Pavel,

On Saturday 15 March 2008 13:18, Pavel Machek wrote:

Ramback is supposed to prevent that by allowing only a limited amount
of application IO during flush mode.  Currently this is accomplished
by making each application write wait synchronously on the one before
it, until flushing completes.  This allows only a small amount of
application traffic, something like 5% bandwidth.  This solution is
admittedly crude, and over time it will be improved to look more like
a realtime scheduler, because this is in fact a realtime scheduling
problem.

Once flushing completes, application writes are still serialized and
thus slow, which is a stronger condition than necessary to maintain
transactional integrity for the filesystem.  Eventually this will be
optimized.

For now, the maximum flush is only a few hundred MB on my workstation,
which leaves a huge safety margin even with my $100 UPS.  And the risk,
however small, of having to run a lossy e2fsck because the battery got
old and the power did run out, is mitigated by the fact that ramback
runs on my kernel hacking partition, and everything unique there just
gets uploaded to the internet regularly anyway.  This serves as my
replication algorithm.  Note: I strongly recommend that any critical
data entrusted to ramback be replicated to mitigate the risk of system
failure, however small.


No, you are missing some essential pieces.  Ramback has two operating
modes:

  1) writeback (when ups-backed line power is available)
  2) writethrough (when running on ups power)

Plus, it has the daemon driven flushing for ups mode, and daemon driven
one-pass populating for startup mode.  That is all ramback is, but you
do not quite get there with your solution above.

Also, ramback works with generic block devices, opening up a wide range
of applications that your proposal does not.


We sure do.  Readahead sucks enormously in Linux.


I hope that my work inspires other people like you to go in and work
on some of the VM/VFS/BIO brokenness that helps make ramback such a
big win.  In the meantime, it is useful to be clear on just what we
have here, and why some people care about it a lot.

Daniel
--
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
[ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Mon Mar 10, 2:46 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Wed Mar 12, 1:27 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Tue Mar 11, 1:22 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Chris Snook, (Mon Mar 10, 2:49 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Artur Skawina, (Mon Mar 10, 10:51 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Mon Mar 10, 11:50 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Wed Mar 12, 1:29 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Thu Mar 13, 1:39 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 2:14 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 3:14 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Willy Tarreau, (Sat Mar 15, 4:59 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 5:25 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 5:51 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 5:17 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Sun Mar 16, 1:42 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Krzysztof Halasa, (Sun Mar 16, 6:15 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 16, 6:38 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Krzysztof Halasa, (Sun Mar 16, 7:08 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 16, 7:43 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 16, 4:48 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Bernd Eckenfels, (Sat Mar 15, 7:18 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Willy Tarreau, (Sat Mar 15, 5:54 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 6:33 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Willy Tarreau, (Sat Mar 15, 7:22 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 11:33 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Krzysztof Halasa, (Sun Mar 16, 6:02 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Theodore Tso, (Sun Mar 16, 3:04 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Willy Tarreau, (Sun Mar 16, 2:56 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Krzysztof Halasa, (Sun Mar 16, 6:12 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Sun Mar 16, 1:24 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Krzysztof Halasa, (Sat Mar 15, 7:57 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 6:00 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 16, 5:57 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Sun Mar 16, 9:31 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 16, 10:42 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Mon Mar 17, 1:52 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Mon Mar 17, 3:14 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Mon Mar 17, 4:25 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Pavel Machek, (Sun Mar 23, 5:33 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 23, 4:44 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Mon Mar 17, 2:56 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Mon Mar 17, 4:16 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Willy Tarreau, (Mon Mar 17, 1:30 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Ric Wheeler, (Mon Mar 17, 9:52 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 16, 6:36 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 16, 7:39 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Rik van Riel, (Thu Mar 13, 4:27 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 10:23 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, John Stoffel, (Fri Mar 14, 10:00 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Fri Mar 14, 1:22 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Fri Mar 14, 1:42 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Chris Friesen, (Wed Mar 12, 2:11 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Wed Mar 12, 6:56 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Thu Mar 13, 1:45 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 2:17 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 3:12 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 5:49 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 4:06 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 5:16 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Pavel Machek, (Sat Mar 15, 4:18 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 4:51 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 3:32 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Thu Mar 13, 3:50 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 4:03 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Pavel Machek, (Sat Mar 15, 4:26 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 5:05 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Mike Snitzer, (Sat Mar 15, 4:40 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Thu Mar 13, 2:30 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 2:50 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Pavel Machek, (Sat Mar 15, 9:32 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 4:22 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Pavel Machek, (Sat Mar 15, 5:33 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 5:47 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Thu Mar 13, 3:05 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 3:13 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Artur Skawina, (Tue Mar 11, 9:32 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Artur Skawina, (Tue Mar 11, 10:31 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Rik van Riel, (Mon Mar 10, 3:01 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Tue Mar 11, 12:28 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Grzegorz Kulewski, (Mon Mar 10, 3:51 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Mon Mar 10, 4:23 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Lars Marowsky-Bree, (Mon Mar 10, 5:03 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Tue Mar 11, 7:14 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Lars Marowsky-Bree, (Tue Mar 11, 7:23 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Tue Mar 11, 7:50 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Lars Marowsky-Bree, (Tue Mar 11, 5:56 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Ric Wheeler, (Thu Mar 13, 9:27 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 3:02 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Ric Wheeler, (Thu Mar 13, 3:12 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 3:38 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Tue Mar 11, 7:30 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Tue Mar 11, 7:02 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Matthias Schniedermeyer, (Thu Mar 13, 5:15 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Chris Friesen, (Tue Mar 11, 1:26 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Tue Mar 11, 3:56 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Willy Tarreau, (Tue Mar 11, 4:53 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Wed Mar 12, 4:17 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Rik van Riel, (Thu Mar 13, 4:34 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 10:20 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Mike Snitzer, (Wed Mar 12, 10:41 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Tue Mar 11, 12:23 am)
speck-geostationary