Re: Error converting from 1.4.4.1 to 1.5.0?

Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
From: Linus Torvalds
Date: Wednesday, February 14, 2007 - 11:42 am

On Wed, 14 Feb 2007, Linus Torvalds wrote:

Side note: one reason why this is nice - even if you don't care about the 
corruption and can fix it other ways - is that the last time we had the 
one-bit corruption is also the reason why we now have the "-r" option to 
git-unpack-objects.

In other words, real-life corruption is not just a really nasty event, 
it's also a good way for *us* to verify that our recovery tools do as good 
a job as they possibly can. Maybe there are other things like that "-r" 
option where we could possibly do even better.

The git data structures are designed to be extremely robust, but there's 
nothing they can do about "corruption after the fact". The same way that a 
logging filesystem doesn't help if the disk itself starts getting read 
errors, the git data structures aren't going to guarantee that you can't 
lose data if you have actual disk or memory corruption going on. 

The things git can do is:

 - detection. The SHA1's should basically guarantee that you will never 
   ever have an _undetectable_ corruption anywhere (which is really really 
   easy with just about any other SCM)

 - make replication easy (so that once you've detected corruption, you 
   have mirrors you can trust).

 - and finally: in the absense of replication, we can do  our damndest to 
   try to figure out what the data was. But in many ways, the fact that we 
   are really really good at compressing data (people do love their small 
   repositories) also means that we have basically no redundancy anywhere, 
   because redundancy is what compression gets rid of (both delta- and 
   zlib compression do it - it's very fundamentally what any compression 
   is based on)

but it's always interesting to have real-life corruption cases to verify.

			Linus
-
To unsubscribe from this list: send the line "unsubscribe git" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
Error converting from 1.4.4.1 to 1.5.0?, Bill Lear, (Wed Feb 14, 9:12 am)
Re: Error converting from 1.4.4.1 to 1.5.0?, Bill Lear, (Wed Feb 14, 10:07 am)
Re: Error converting from 1.4.4.1 to 1.5.0?, Junio C Hamano, (Wed Feb 14, 10:15 am)
Re: Error converting from 1.4.4.1 to 1.5.0?, Bill Lear, (Wed Feb 14, 10:20 am)
Re: Error converting from 1.4.4.1 to 1.5.0?, Junio C Hamano, (Wed Feb 14, 10:45 am)
Re: Error converting from 1.4.4.1 to 1.5.0?, Linus Torvalds, (Wed Feb 14, 11:19 am)
Re: Error converting from 1.4.4.1 to 1.5.0?, Linus Torvalds, (Wed Feb 14, 11:42 am)
Re: Error converting from 1.4.4.1 to 1.5.0?, Bill Lear, (Wed Feb 14, 1:49 pm)
Re: Error converting from 1.4.4.1 to 1.5.0?, Bill Lear, (Wed Feb 14, 1:58 pm)
Re: Error converting from 1.4.4.1 to 1.5.0?, Junio C Hamano, (Wed Feb 14, 2:12 pm)
Re: Error converting from 1.4.4.1 to 1.5.0?, Bill Lear, (Wed Feb 14, 2:13 pm)
Re: Error converting from 1.4.4.1 to 1.5.0?, Nicolas Pitre, (Wed Feb 14, 2:14 pm)
Re: Error converting from 1.4.4.1 to 1.5.0?, Bill Lear, (Wed Feb 14, 2:18 pm)
Re: Error converting from 1.4.4.1 to 1.5.0?, Linus Torvalds, (Wed Feb 14, 2:19 pm)
Re: Error converting from 1.4.4.1 to 1.5.0?, Junio C Hamano, (Wed Feb 14, 2:32 pm)
Re: Error converting from 1.4.4.1 to 1.5.0?, Linus Torvalds, (Wed Feb 14, 2:35 pm)
Re: Error converting from 1.4.4.1 to 1.5.0?, Bill Lear, (Wed Feb 14, 2:40 pm)
Re: Error converting from 1.4.4.1 to 1.5.0?, Junio C Hamano, (Wed Feb 14, 2:47 pm)
Re: Error converting from 1.4.4.1 to 1.5.0?, Junio C Hamano, (Wed Feb 14, 2:52 pm)
Re: Error converting from 1.4.4.1 to 1.5.0?, Johannes Schindelin, (Wed Feb 14, 3:02 pm)
Re: Error converting from 1.4.4.1 to 1.5.0?, Johannes Schindelin, (Wed Feb 14, 3:04 pm)
Re: Error converting from 1.4.4.1 to 1.5.0?, Junio C Hamano, (Wed Feb 14, 3:13 pm)
Re: Error converting from 1.4.4.1 to 1.5.0?, Nicolas Pitre, (Wed Feb 14, 3:27 pm)
Re: Error converting from 1.4.4.1 to 1.5.0?, Johannes Schindelin, (Wed Feb 14, 3:32 pm)
Re: Error converting from 1.4.4.1 to 1.5.0?, Bill Lear, (Wed Feb 14, 3:41 pm)
Re: Error converting from 1.4.4.1 to 1.5.0?, Linus Torvalds, (Wed Feb 14, 4:03 pm)
Re: Error converting from 1.4.4.1 to 1.5.0?, Linus Torvalds, (Wed Feb 14, 4:24 pm)
Re: Error converting from 1.4.4.1 to 1.5.0?, Olivier Galibert, (Wed Feb 14, 5:54 pm)
OT: data destruction classics (was: Re: Error converting f ..., Simon 'corecode' Sch ..., (Wed Feb 14, 6:18 pm)
Re: Error converting from 1.4.4.1 to 1.5.0?, Johannes Schindelin, (Wed Feb 14, 6:36 pm)
Re: Error converting from 1.4.4.1 to 1.5.0?, Uwe , (Thu Feb 15, 1:40 am)
Re: OT: data destruction classics (was: Re: Error converti ..., Johannes Schindelin, (Thu Feb 15, 3:24 am)
Re: OT: data destruction classics (was: Re: Error converti ..., Michael K. Edwards, (Thu Feb 15, 6:13 am)