Re: git pack/unpack over bittorrent - works!

Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
From: Luke Kenneth Casson Leighton
Date: Friday, September 3, 2010 - 2:11 pm

On Fri, Sep 3, 2010 at 8:41 PM, Nicolas Pitre <nico@fluxnic.net> wrote:


ok - missed it.  let's go back... ah _ha_ - with this:

"Yep.  Instead of transferring packs, a BitTorrent-alike transfer should
be based on the transfer of _objects_.  Therefore you can make the
correspondance between file chunks in BitTorrent with objects in a Git
aware system.  So, when contacting a peer, you could negociate what is
the set of objects that the peer has that you don't, and vice versa.
Objects in Git are stable and immutable, and they all have a unique SHA1
signature.  And to optimize the negociation, the pack index content can
be used, first by exchanging the content of the first level
fan-out table and ignoring those entries that are equal.  This for each
peer."

ok, so, great!  it does actually seem that, despite us using different
terminologies, we're thinking along the same sort of lines.  i'm
marginally hampered by being unfamiliar with git, for which i
apologise.

so, when i mentioned extracting the objects from the index file of
"git pack-object", i was debating whether to then use that to
re-create the pack object (in some nebulous way) - that's sort-of the
same thing.  i was also debating whether to mention the idea of using
git pack-object to extract one and only one object ( there is likely a
more efficient way of doing that ).   but, yes: i was thinking of
making the vfs-layer expose individual objects, i just hadn't
mentioned it yet (and missed your earlier reply, nicolas, for which i
apologise).

btw the idea of parsing the fan-out table would not have occurred to
me in a miiiilllion years :)

 i'll take a look at that.  but whilst i'm doing that, the main
question i really need to know is: how do you get one single explicit
object out of git?

tia,

l.
--
To unsubscribe from this list: send the line "unsubscribe git" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Wed Sep 1, 7:36 am)
Re: git pack/unpack over bittorrent - works!, Nguyen Thai Ngoc Duy, (Wed Sep 1, 3:04 pm)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Thu Sep 2, 6:37 am)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Thu Sep 2, 6:53 am)
Re: git pack/unpack over bittorrent - works!, Ævar Arnfjörð Bjarmason, (Thu Sep 2, 7:08 am)
Re: git pack/unpack over bittorrent - works!, A Large Angry SCM, (Thu Sep 2, 8:33 am)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Thu Sep 2, 8:42 am)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Thu Sep 2, 8:51 am)
Re: git pack/unpack over bittorrent - works!, Jeff King, (Thu Sep 2, 8:58 am)
Re: git pack/unpack over bittorrent - works!, Nicolas Pitre, (Thu Sep 2, 9:41 am)
Re: git pack/unpack over bittorrent - works!, A Large Angry SCM, (Thu Sep 2, 9:58 am)
Re: git pack/unpack over bittorrent - works!, A Large Angry SCM, (Thu Sep 2, 10:06 am)
Re: git pack/unpack over bittorrent - works!, A Large Angry SCM, (Thu Sep 2, 10:09 am)
Re: git pack/unpack over bittorrent - works!, Nicolas Pitre, (Thu Sep 2, 10:21 am)
Re: git pack/unpack over bittorrent - works!, Nicolas Pitre, (Thu Sep 2, 10:31 am)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Thu Sep 2, 11:07 am)
Re: git pack/unpack over bittorrent - works!, Casey Dahlin, (Thu Sep 2, 11:23 am)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Thu Sep 2, 12:17 pm)
Re: git pack/unpack over bittorrent - works!, Shawn O. Pearce, (Thu Sep 2, 12:29 pm)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Thu Sep 2, 12:41 pm)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Thu Sep 2, 12:51 pm)
Re: git pack/unpack over bittorrent - works!, A Large Angry SCM, (Thu Sep 2, 12:52 pm)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Thu Sep 2, 1:06 pm)
Re: git pack/unpack over bittorrent - works!, Brandon Casey, (Thu Sep 2, 1:28 pm)
Re: git pack/unpack over bittorrent - works!, Jakub Narebski, (Thu Sep 2, 1:45 pm)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Thu Sep 2, 1:48 pm)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Thu Sep 2, 2:10 pm)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Thu Sep 2, 2:19 pm)
Re: git pack/unpack over bittorrent - works!, Nicolas Pitre, (Thu Sep 2, 4:09 pm)
Re: git pack/unpack over bittorrent - works!, Nicolas Pitre, (Thu Sep 2, 5:29 pm)
Re: git pack/unpack over bittorrent - works!, Nicolas Pitre, (Thu Sep 2, 5:36 pm)
Re: git pack/unpack over bittorrent - works!, Nguyen Thai Ngoc Duy, (Thu Sep 2, 7:48 pm)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Fri Sep 3, 3:23 am)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Fri Sep 3, 3:34 am)
Re: git pack/unpack over bittorrent - works!, Theodore Tso, (Fri Sep 3, 3:37 am)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Fri Sep 3, 3:54 am)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Fri Sep 3, 3:55 am)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Fri Sep 3, 4:04 am)
Re: git pack/unpack over bittorrent - works!, Junio C Hamano, (Fri Sep 3, 10:03 am)
Re: git pack/unpack over bittorrent - works!, Junio C Hamano, (Fri Sep 3, 10:12 am)
Re: git pack/unpack over bittorrent - works!, Ted Ts'o, (Fri Sep 3, 11:31 am)
Re: git pack/unpack over bittorrent - works!, Nicolas Pitre, (Fri Sep 3, 12:41 pm)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Fri Sep 3, 2:11 pm)
Re: git pack/unpack over bittorrent - works!, Nguyen Thai Ngoc Duy, (Fri Sep 3, 5:24 pm)
Re: git pack/unpack over bittorrent - works!, Nguyen Thai Ngoc Duy, (Fri Sep 3, 5:57 pm)
Re: git pack/unpack over bittorrent - works!, Artur Skawina, (Fri Sep 3, 6:52 pm)
Re: git pack/unpack over bittorrent - works!, Theodore Tso, (Fri Sep 3, 6:57 pm)
Re: git pack/unpack over bittorrent - works!, Nicolas Pitre, (Fri Sep 3, 9:39 pm)
Re: git pack/unpack over bittorrent - works!, Kyle Moffett, (Fri Sep 3, 10:23 pm)
Re: git pack/unpack over bittorrent - works!, Nicolas Pitre, (Fri Sep 3, 10:40 pm)
Re: git pack/unpack over bittorrent - works!, Artur Skawina, (Fri Sep 3, 10:42 pm)
Re: git pack/unpack over bittorrent - works!, Nicolas Pitre, (Fri Sep 3, 11:13 pm)
Re: git pack/unpack over bittorrent - works!, Theodore Tso, (Sat Sep 4, 4:46 am)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Sat Sep 4, 4:58 am)
Re: git pack/unpack over bittorrent - works!, Theodore Tso, (Sat Sep 4, 5:00 am)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Sat Sep 4, 5:33 am)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Sat Sep 4, 5:44 am)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Sat Sep 4, 6:14 am)
Re: git pack/unpack over bittorrent - works!, Artur Skawina, (Sat Sep 4, 6:42 am)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Sat Sep 4, 7:06 am)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Sat Sep 4, 7:50 am)
Re: git pack/unpack over bittorrent - works!, Artur Skawina, (Sat Sep 4, 10:23 am)
Re: git pack/unpack over bittorrent - works!, Ted Ts'o, (Sat Sep 4, 11:14 am)
Re: git pack/unpack over bittorrent - works!, Artur Skawina, (Sat Sep 4, 11:46 am)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Sat Sep 4, 1:00 pm)
Re: git pack/unpack over bittorrent - works!, Jakub Narebski, (Sat Sep 4, 1:20 pm)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Sat Sep 4, 1:47 pm)
Re: git pack/unpack over bittorrent - works!, Jakub Narebski, (Sat Sep 4, 2:16 pm)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Sat Sep 4, 2:24 pm)
Re: git pack/unpack over bittorrent - works!, Ted Ts'o, (Sat Sep 4, 3:41 pm)
Re: git pack/unpack over bittorrent - works!, Ted Ts'o, (Sat Sep 4, 3:47 pm)
Re: git pack/unpack over bittorrent - works!, Nicolas Pitre, (Sat Sep 4, 6:18 pm)
Re: git pack/unpack over bittorrent - works!, Nicolas Pitre, (Sat Sep 4, 6:32 pm)
Re: git pack/unpack over bittorrent - works!, Tomas Carnecky, (Sat Sep 4, 6:43 pm)
Re: git pack/unpack over bittorrent - works!, Nicolas Pitre, (Sat Sep 4, 7:16 pm)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Sun Sep 5, 10:16 am)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Sun Sep 5, 10:22 am)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Sun Sep 5, 10:25 am)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Sun Sep 5, 11:05 am)
Re: git pack/unpack over bittorrent - works!, Nicolas Pitre, (Sun Sep 5, 4:52 pm)
Re: git pack/unpack over bittorrent - works!, Nicolas Pitre, (Sun Sep 5, 5:05 pm)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Mon Sep 6, 6:23 am)
Re: git pack/unpack over bittorrent - works!, Nicolas Pitre, (Mon Sep 6, 9:51 am)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Mon Sep 6, 3:33 pm)
Re: git pack/unpack over bittorrent - works!, Junio C Hamano, (Mon Sep 6, 4:34 pm)
Re: git pack/unpack over bittorrent - works!, Nicolas Pitre, (Mon Sep 6, 4:57 pm)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Mon Sep 6, 5:17 pm)
Re: git pack/unpack over bittorrent - works!, Luke Kenneth Casson ..., (Mon Sep 6, 5:29 pm)