Re: support for large packs and 64-bit offsets

!MAILaRCHIVE_VOTE_RePLACE
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
To: Nicolas Pitre <nico@...>
Cc: Junio C Hamano <junkio@...>, <git@...>
Date: Monday, April 9, 2007 - 1:43 pm

Nicolas Pitre <nico@cam.org> wrote:

I take it you are working on it alone at this point?  I'd love
to get back into it, but I don't think I've got the cycles for at
least a couple of weeks.


Here's something we didn't think about, but that occurred to me today
when reading this series: If we move the SHA-1 table out of the index
and into the packfile (like we are planning) dumb commit-walkers
(http-fetch) will have problems.  Right now they download the
indexes of every available packfile to determine if they need to
download the corresponding packfile to obtain a needed object.

Moving the SHA-1 table from the index into the packfile will mean
the client cannot do this `optimization'.  Instead it will need to
perform a byte-range request for part of the packfile to decide
if it needs to fetch the remainder of that packfile; or it must
download the entire packfile.  Since not all HTTP servers support
byte-range requests the former may not always be viable and the
latter is obviously not a good idea.

-- 
Shawn.
-
To unsubscribe from this list: send the line "unsubscribe git" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
support for large packs and 64-bit offsets, Nicolas Pitre, (Mon Apr 9, 1:06 am)
Re: support for large packs and 64-bit offsets, Shawn O. Pearce, (Mon Apr 9, 1:19 pm)
Re: support for large packs and 64-bit offsets, Linus Torvalds, (Mon Apr 9, 2:02 pm)
Re: support for large packs and 64-bit offsets, Nicolas Pitre, (Mon Apr 9, 2:26 pm)
Re: support for large packs and 64-bit offsets, Nicolas Pitre, (Mon Apr 9, 3:46 pm)
Re: support for large packs and 64-bit offsets, Shawn O. Pearce, (Mon Apr 9, 2:34 pm)
Re: support for large packs and 64-bit offsets, Nicolas Pitre, (Mon Apr 9, 1:32 pm)
Re: support for large packs and 64-bit offsets, Shawn O. Pearce, (Mon Apr 9, 1:43 pm)
Re: support for large packs and 64-bit offsets, Junio C Hamano, (Mon Apr 9, 3:49 pm)
Re: support for large packs and 64-bit offsets, Shawn O. Pearce, (Mon Apr 9, 3:53 pm)
Re: support for large packs and 64-bit offsets, Junio C Hamano, (Mon Apr 9, 4:18 pm)
Re: support for large packs and 64-bit offsets, Nicolas Pitre, (Mon Apr 9, 4:02 pm)
[PATCH 01/10] get rid of num_packed_objects(), Nicolas Pitre, (Mon Apr 9, 1:06 am)
[PATCH 05/10] compute object CRC32 with index-pack, Nicolas Pitre, (Mon Apr 9, 1:06 am)