login
Header Space

 
 

Re: [ANNOUNCE] Ramback: faster than a speeding bullet

Score:
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
To: Daniel Phillips <phillips@...>
Cc: Willy Tarreau <w@...>, Alan Cox <alan@...>, David Newall <davidn@...>, <linux-kernel@...>
Date: Saturday, March 15, 2008 - 7:22 pm

On Sat, 15 Mar 2008, Daniel Phillips wrote:


it will mean that the window is larger, but it will also mean that if 
something else goes wrong and that window is not available the data that 
was written out will be useable (recent data will be lost, but older data 
will still be available)

as for things that can go wrong

the UPS battery can go bad
you can have multiple power failures in a short time so your battery is not fully charged
capacitors in the UPS can go bad
capacitors in the power supply can go bad
capacitors on the motherboard can go bad
a kernel bug can crash the system
a bug in a device driver (say nvidia graphics driver) can crash the system
a card in the system can lock up the system bus
the system power supply can die
the system fans can die and cause the system to overheat
cooling in the room the system is in can fail and cause the system to overheat
airflow to the computer can get blocked and cause the system to overheat
some other component in the computer can short out and cause the system to loose power internally

I have had every single one of these things happen to me over the years. 
Some on personal equipment, some on work equipment. At work I recently had 
a series of disasters where capacitors in a 7 figure UPS blew up, and a 
few days later during a power outage when we were running on generator, a 
fuel company made a mistake while adding fuel to the generator and knocked 
it out.

Even if you spend millions on equipment and professionals to set it up and 
maintain it, you can still go down.

You may not care about it on your system (becouse you copy data elsewhere 
and don't change it rapidly), but most people do. with your current 
approach you are slightly better then a couple shell scripts from an 
availability point of view, you are no better in performance, but your 
failure mode is complete disaster.

comparing you to 'cp drive ramdisk' at startup and 'rsync ramdisk drive' 
periodicly and at shutdown you are faster at startup, close enough at 
shutdown as to be in the noise (either one could be faster, depending on 
the exact conditions)

you have a failback mode that when the UPS tells you it has failed you 
switch to write-through mode, that's some use (but only if you get 
everything flushed first)

another off-the-shelf option is that you could use DRDB between the 
ramdisk and the real drive, and when you loose power reconfigure to do 
syncronous updates instead of write-behind updates. that would still be 
far safer then ramback in it's current mode.


and when those users ask why this functionality isn't in the kernel they 
will read this thread and learn how many risks they are taking (in spite 
of you promising them that they are perfectly safe)

anyone who has run any significant number of systems will not believe your 
statement that hardware and software is reliable enough to be trusted like 
this. by continuing to make this claim you are going to be ignored by 
those people, and franky, they will distrust any of your work as a result.


but a straight ramdisk can be replicated or mirrored. there's no need to 
have ramback to do this.


they aren't arguing that the embedded solutions are more safe becouse they 
don't use linux. they are arguing that they are more safe becouse they 
have different enginnering then normal machines, and it's that engineering 
that makes them safer, not the software.

the reason why battery backed ram on a raid card is safer than a UPS on a 
general purpose machine is becouse the battery backed ram is static ram, 
while the ram in your system is dynamid ram. static ram only needs power 
to retain it's memory, dynamic ram needs a preocessor running to access 
the ram continuously to refresh it.

you see 'battery+ram' in both cases and argue that they are equally safe. 
that just isn't the case.

the raid card can be pulled from one machine and put into another, in some 
cases the ram can be pulled from one card and plugged into another. it can 
sit on a shelf unplugged form anything but the battery for several days. 
this means that unless something physicaly damages the ram and enough 
drives to fail the raid array, the data is safe.

EMC, Netapp, and the other enterprise vendors have special purpose 
hardware to implement this safety. how much special hardware they have 
varies by company and equipment, but they all have some.

David Lang
--
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
[ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Mon Mar 10, 2:46 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Wed Mar 12, 1:27 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Tue Mar 11, 1:22 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Chris Snook, (Mon Mar 10, 2:49 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Artur Skawina, (Mon Mar 10, 10:51 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Mon Mar 10, 11:50 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Wed Mar 12, 1:29 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Thu Mar 13, 1:39 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 2:14 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 3:14 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Willy Tarreau, (Sat Mar 15, 4:59 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 5:25 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 5:51 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 5:17 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Sun Mar 16, 1:42 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Krzysztof Halasa, (Sun Mar 16, 6:15 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 16, 6:38 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Krzysztof Halasa, (Sun Mar 16, 7:08 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 16, 7:43 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 16, 4:48 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Bernd Eckenfels, (Sat Mar 15, 7:18 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Willy Tarreau, (Sat Mar 15, 5:54 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 6:33 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Willy Tarreau, (Sat Mar 15, 7:22 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 11:33 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Krzysztof Halasa, (Sun Mar 16, 6:02 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Theodore Tso, (Sun Mar 16, 3:04 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Willy Tarreau, (Sun Mar 16, 2:56 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Krzysztof Halasa, (Sun Mar 16, 6:12 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Sun Mar 16, 1:24 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, , (Sat Mar 15, 7:22 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Krzysztof Halasa, (Sat Mar 15, 7:57 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 6:00 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 16, 5:57 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Sun Mar 16, 9:31 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 16, 10:42 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Mon Mar 17, 1:52 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Mon Mar 17, 3:14 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Mon Mar 17, 4:25 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Pavel Machek, (Sun Mar 23, 5:33 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 23, 4:44 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Mon Mar 17, 2:56 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Mon Mar 17, 4:16 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Willy Tarreau, (Mon Mar 17, 1:30 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Ric Wheeler, (Mon Mar 17, 9:52 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 16, 6:36 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sun Mar 16, 7:39 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Rik van Riel, (Thu Mar 13, 4:27 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 10:23 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, John Stoffel, (Fri Mar 14, 10:00 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Fri Mar 14, 1:22 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Fri Mar 14, 1:42 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Chris Friesen, (Wed Mar 12, 2:11 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Wed Mar 12, 6:56 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Thu Mar 13, 1:45 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 2:17 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 3:12 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 5:49 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 4:06 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 5:16 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Pavel Machek, (Sat Mar 15, 4:18 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 4:51 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 3:32 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Thu Mar 13, 3:50 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 4:03 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Pavel Machek, (Sat Mar 15, 4:26 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 5:05 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Mike Snitzer, (Sat Mar 15, 4:40 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Thu Mar 13, 2:30 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 2:50 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Pavel Machek, (Sat Mar 15, 9:32 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 4:22 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Pavel Machek, (Sat Mar 15, 5:33 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Sat Mar 15, 5:47 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, David Newall, (Thu Mar 13, 3:05 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 3:13 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Artur Skawina, (Tue Mar 11, 9:32 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Artur Skawina, (Tue Mar 11, 10:31 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Rik van Riel, (Mon Mar 10, 3:01 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Tue Mar 11, 12:28 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Grzegorz Kulewski, (Mon Mar 10, 3:51 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Mon Mar 10, 4:23 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Lars Marowsky-Bree, (Mon Mar 10, 5:03 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Tue Mar 11, 7:14 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Lars Marowsky-Bree, (Tue Mar 11, 7:23 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Tue Mar 11, 7:50 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Lars Marowsky-Bree, (Tue Mar 11, 5:56 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Ric Wheeler, (Thu Mar 13, 9:27 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 3:02 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Ric Wheeler, (Thu Mar 13, 3:12 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 3:38 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Tue Mar 11, 7:30 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Tue Mar 11, 7:02 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Matthias Schniedermeyer, (Thu Mar 13, 5:15 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Chris Friesen, (Tue Mar 11, 1:26 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Tue Mar 11, 3:56 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Willy Tarreau, (Tue Mar 11, 4:53 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Wed Mar 12, 4:17 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Rik van Riel, (Thu Mar 13, 4:34 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Thu Mar 13, 10:20 pm)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Mike Snitzer, (Wed Mar 12, 10:41 am)
Re: [ANNOUNCE] Ramback: faster than a speeding bullet, Daniel Phillips, (Tue Mar 11, 12:23 am)
speck-geostationary