login
Login / Register
Header Space

 
 

Home » Mailing list archives » git » 2006 » February » 8

Handling large files with GIT

Score:
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
[view in full thread]
From: Martin Langhoff <martin.langhoff@...>
To: Git Mailing List <git@...>
Subject: Handling large files with GIT
Date: Wednesday, February 8, 2006 - 5:14 am

Roland Stigge recently pointed out a use case using very large files
where GIT has some serious limitations. He is one of several Debian
developers keeping their homedir under version control with SVN (blame
Joey Hess for this - http://www.kitenet.net/~joey/svnhome.html ).

SVN does reasonably well tracking his >1GB mbox file. Now, I don't
know if I like the idea of putting my own mbox file under version
control, but it looks like projects with large and slow-changing files
would be in trouble with GIT. Not literally trouble, but gross
inefficiencies.

The problems are two. At commit time, a full copy is stored in the
object database until git-repack && git-prune-packed are called. And
during the transfer over the git protocol we send the full object,
even if both ends have objects that are good candidates for a small
delta.

I'm not strong on either aspect of git (packfile format or git
protocol), and I don't personally deal with large files. So feel free
to ignore me for the time being. If it ever itches, you might get a
patch...

cheers,


martin
-
To unsubscribe from this list: send the line "unsubscribe git" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
Messages in current thread:
Handling large files with GIT, Martin Langhoff, (Wed Feb 8, 5:14 am)
Re: Handling large files with GIT, Johannes Schindelin, (Wed Feb 8, 7:54 am)
Re: Handling large files with GIT, Linus Torvalds, (Wed Feb 8, 12:34 pm)
Re: Handling large files with GIT, Linus Torvalds, (Wed Feb 8, 1:01 pm)
Re: Handling large files with GIT, Junio C Hamano, (Wed Feb 8, 4:11 pm)
Re: Handling large files with GIT, Florian Weimer, (Wed Feb 8, 5:20 pm)
Re: Handling large files with GIT, Martin Langhoff, (Wed Feb 8, 6:35 pm)
Re: Handling large files with GIT, Ben Clifford, (Sun Feb 12, 9:26 pm)
Re: Handling large files with GIT, Linus Torvalds, (Sun Feb 12, 11:42 pm)
Re: Handling large files with GIT, Linus Torvalds, (Mon Feb 13, 12:57 am)
Re: Handling large files with GIT, Linus Torvalds, (Mon Feb 13, 1:05 am)
Re: Handling large files with GIT, Ian Molton, (Mon Feb 13, 7:17 pm)
Re: Handling large files with GIT, Johannes Schindelin, (Tue Feb 14, 2:56 pm)
Re: Handling large files with GIT, Linus Torvalds, (Tue Feb 14, 3:52 pm)
Re: Handling large files with GIT, Sam Vilain, (Tue Feb 14, 5:21 pm)
Re: Handling large files with GIT, Linus Torvalds, (Tue Feb 14, 6:01 pm)
Re: Handling large files with GIT, Junio C Hamano, (Tue Feb 14, 6:30 pm)
Re: Handling large files with GIT, Linus Torvalds, (Tue Feb 14, 10:05 pm)
Re: Handling large files with GIT, Linus Torvalds, (Tue Feb 14, 10:18 pm)
Re: Handling large files with GIT, Linus Torvalds, (Tue Feb 14, 10:33 pm)
Re: Handling large files with GIT, Linus Torvalds, (Tue Feb 14, 11:58 pm)
Re: Handling large files with GIT, Fredrik Kuivinen, (Thu Feb 16, 4:32 pm)
Re: Handling large files with GIT, Junio C Hamano, (Wed Feb 15, 5:54 am)
Re: Handling large files with GIT, Linus Torvalds, (Wed Feb 15, 11:25 pm)
Re: Handling large files with GIT, Junio C Hamano, (Wed Feb 15, 11:29 pm)
Re: Handling large files with GIT, Linus Torvalds, (Wed Feb 15, 11:44 am)
Re: Handling large files with GIT, Linus Torvalds, (Wed Feb 15, 1:16 pm)
Re: Handling large files with GIT, Sam Vilain, (Tue Feb 14, 8:40 pm)
Re: Handling large files with GIT, Martin Langhoff, (Tue Feb 14, 10:07 pm)
Re: Handling large files with GIT, Junio C Hamano, (Tue Feb 14, 9:39 pm)
Re: Handling large files with GIT, Sam Vilain, (Wed Feb 15, 12:03 am)
Re: Handling large files with GIT, Martin Langhoff, (Mon Feb 13, 7:19 pm)
Re: Handling large files with GIT, Jeff Garzik, (Mon Feb 13, 1:55 am)
Re: Handling large files with GIT, Keith Packard, (Mon Feb 13, 2:07 am)
Re: Handling large files with GIT, Martin Langhoff, (Mon Feb 13, 8:07 pm)
Re: Handling large files with GIT, Linus Torvalds, (Mon Feb 13, 12:19 pm)
Re: Handling large files with GIT, Martin Langhoff, (Mon Feb 13, 12:40 am)
Re: Handling large files with GIT, Greg KH, (Thu Feb 9, 12:54 am)
Re: Handling large files with GIT, Martin Langhoff, (Thu Feb 9, 1:38 am)

Mail archive search
Enter your search terms.
Optionally limit your search to a specific mailing list.
advanced
Colocation donated by:
Who's online
There are currently 4 users and 1259 guests online.

Online users

Syndicate
Syndicate content
© 2007 KernelTrap.  |  Powered by Drupal.  |  Legal statement.
speck-geostationary