Re: [ANNOUNCE] Ramback: faster than a speeding bullet

Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
From: Daniel Phillips
Date: Wednesday, March 12, 2008 - 1:17 am

On Tuesday 11 March 2008 13:53, Willy Tarreau wrote:

So we have a flock of people arguing that you can't trust Linux.  Well
maybe there are situations were you can't, but what can you trust?
Disk firmware?  Bios?  Big maybes everywhere.  In my experience, Linux
is very reliable.  I think Linus, Andrew and others care an awful lot
about that and go to considerable lengths to make it true.  Got a list
of Linux kernel flaws that bring down a system?  Tell me and I will not
use that version to run a transaction processing system, or I will fix
them or get them fixed.

But please do not tell me that Linux is too unreliable to run a
transaction processing system.  If Linux can't do it, then what can?

By the way, the huge ramdisk that Violin ships runs Linux inside, to
manage the raided, hotswappable memory modules.  (Even cooler: they
run Linux on a soft processor implemented on a big FPGA.)  Does anybody
think that they did not test to make sure Linux does not compromise
their MTBF in any way?

In practice, for the week I was able to test the box remotely and the
10 days I had it in my hands, the thing was solid as a rock.  Good
hardware engineering and a nice kernel I say.


Sure.  Leaving out dodgy stuff like hald, other bits I could mention,
is probably a good idea.  Scary thing is, thinks like hald are actually
being run on servers but that is another issue entirely.

It wasn't too long ago that NFS client was in the dodgy category, with
oops, lockups, whathaveyou.  It is pretty solid now, but it takes a
while for the bad experiences to fade from memory.  On the other hand,
knfsd has never been the slightest bit of a problem.  Helpful
suggestion: don't run NFS client on your transaction processing unit.
It may well be solid, but who needs to find out experimentally?  Might
as well toss gamin, dbus and udev while you are at it, for a further
marginal reliability increase.  Oh, and alsa, no offense to the great
work there, but it just does not belong on a server.  Definitely do
not boot into X (I know I should not have to say that, but...)


I guess I am actually going to run evaluations on some mission critical
systems using the arrangement described.  I wish I could be more specific
about it, but I know of critical systems pushing massive data that in
fact rely on batteries just as I have described.  For completeness, I
will verify that pulling the UPS plug actually corrupts the data and
report my findings.  Not by pulling the plug of course, but by asking
the vendors.


I consider 1/year way too high a failure rate for anything that gets
onto a server I own, and then there must necessarily be systems in
place to limit the damage.  For me, that means replication, or perhaps
synchronously mirroring the whole stack which is technology I do not
trust yet on Linux, so we don't do that.  Yet.

So here is the tradeoff: do you take the huge performance boost you
get by plugging in the battery, and put the necessary backup systems
in place or do you accept a lower performing system that offers higher
theoretical reliability?  It depends on your application.  My
immediate application happens to be hacking kernels and taking diffs
which tends to suck rather badly on Linux.  Ramback will fix that, and
it will be in place on my workstation right here, I will give my
report.  (Bummer, I need to reboot because I don't feel like backporting
to 2.6.20, too bad about that 205 day uptime, but I have to close the
vmsplice hole anyway.)  So I will have, say, a 3 GB source code
partition running under ramback and it will act just like spinning
media because of my UPS, except 25 times faster.

Of course the reason I feel brave about this is, everything useful
on that partition gets uploaded to the internet sooner rather than
later.  Nonetheless, having to reinstall everything would cost me
hours, so I will certainly not do it if I think there is any
reasonable likelihood I might have to.


Right.  See ddraid.  It is in the pipeline, but everything takes time.
We also need to reroll NBD complete with deadlock fixes before I feel
good about that.

Regards,

Daniel
--
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
[ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 9, 11:46 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Grzegorz Kulewski, (Mon Mar 10, 12:51 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Mon Mar 10, 1:23 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Artur Skawina, (Mon Mar 10, 7:51 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Chris Snook, (Mon Mar 10, 11:49 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Rik van Riel, (Mon Mar 10, 12:01 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Lars Marowsky-Bree, (Mon Mar 10, 2:03 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Mon Mar 10, 8:50 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Mon Mar 10, 9:23 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Mon Mar 10, 9:28 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Mon Mar 10, 10:22 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Tue Mar 11, 4:14 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Lars Marowsky-Bree, (Tue Mar 11, 4:23 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Tue Mar 11, 4:50 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Artur Skawina, (Tue Mar 11, 6:32 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Artur Skawina, (Tue Mar 11, 7:31 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Chris Friesen, (Tue Mar 11, 10:26 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Tue Mar 11, 12:56 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Willy Tarreau, (Tue Mar 11, 1:53 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Lars Marowsky-Bree, (Tue Mar 11, 2:56 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Tue Mar 11, 4:02 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Tue Mar 11, 4:30 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Wed Mar 12, 1:17 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, tvrtko.ursulin, (Wed Mar 12, 5:01 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Mike Snitzer, (Wed Mar 12, 7:41 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Wed Mar 12, 10:27 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Wed Mar 12, 10:29 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Chris Friesen, (Wed Mar 12, 11:11 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Wed Mar 12, 3:56 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Wed Mar 12, 10:39 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Wed Mar 12, 10:45 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Wed Mar 12, 11:14 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Wed Mar 12, 11:17 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Wed Mar 12, 11:30 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Wed Mar 12, 11:50 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Thu Mar 13, 12:05 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 12:12 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 12:13 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 1:06 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Matthias Schniedermeyer, (Thu Mar 13, 2:15 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 2:16 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 2:49 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Ric Wheeler, (Thu Mar 13, 6:27 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 12:02 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Ric Wheeler, (Thu Mar 13, 12:12 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 12:14 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 12:32 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 12:38 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Thu Mar 13, 12:50 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 1:03 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Rik van Riel, (Thu Mar 13, 1:27 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Rik van Riel, (Thu Mar 13, 1:34 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 7:20 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 7:23 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Thu Mar 13, 10:22 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 10:42 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, John Stoffel, (Fri Mar 14, 7:00 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Jeff Moyer, (Fri Mar 14, 10:53 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Pavel Machek, (Sat Mar 15, 6:32 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Pavel Machek, (Sat Mar 15, 1:18 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 1:22 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Pavel Machek, (Sat Mar 15, 1:26 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Mike Snitzer, (Sat Mar 15, 1:40 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 1:51 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Willy Tarreau, (Sat Mar 15, 1:59 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 2:05 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 2:17 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 2:25 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Pavel Machek, (Sat Mar 15, 2:33 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 2:47 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 2:51 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Willy Tarreau, (Sat Mar 15, 2:54 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 3:00 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 3:33 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Bernd Eckenfels, (Sat Mar 15, 4:18 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Willy Tarreau, (Sat Mar 15, 4:22 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Krzysztof Halasa, (Sat Mar 15, 4:57 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 8:33 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Sat Mar 15, 10:24 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Sat Mar 15, 10:42 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Willy Tarreau, (Sat Mar 15, 11:56 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Theodore Tso, (Sun Mar 16, 12:04 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 16, 1:48 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 16, 2:57 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Krzysztof Halasa, (Sun Mar 16, 3:02 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Krzysztof Halasa, (Sun Mar 16, 3:12 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Krzysztof Halasa, (Sun Mar 16, 3:15 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 16, 3:36 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 16, 3:38 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Krzysztof Halasa, (Sun Mar 16, 4:08 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 16, 4:39 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 16, 4:43 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Sun Mar 16, 6:31 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 16, 7:42 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 16, 10:52 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Mon Mar 17, 12:14 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Mon Mar 17, 1:16 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Mon Mar 17, 1:25 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Ric Wheeler, (Mon Mar 17, 6:52 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Willy Tarreau, (Mon Mar 17, 10:30 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Mon Mar 17, 11:56 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Pavel Machek, (Sun Mar 23, 2:33 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 23, 1:44 pm)