Re: [0/4] DST: Distributed storage.

!MAILaRCHIVE_VOTE_RePLACE
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
To: Mike Snitzer <snitzer@...>
Cc: lkml <linux-kernel@...>, <netdev@...>, <linux-fsdevel@...>
Date: Tuesday, December 4, 2007 - 12:00 pm

Hi Mike.

On Tue, Dec 04, 2007 at 10:25:29AM -0500, Mike Snitzer (snitzer@gmail.com) wrote:

In this case sync bit would only imply waiting until all pending
requests reached remote nodes. This is not implemented yet.
Order of the requests for given node is guaranteed by DST core,
it is possible to perform multiple requests in parallel for/from
different nodes.

In the more generic case it should wait until data has reached media,
i.e. perform flushing.
I did not implement that since actually no multiple-device system in
Linux supports barriers (please note, that in this discussion sync bit
actually means a barrier in the block layer).

Protocol changes are pretty trivial and are absolutely transparent for
the DST core - only remote targets (both userspace and kernelspace)
should be changed to invoke ->issue_flush_fn() callback when needed for
underlying device and do not process new requests until flush completed.
Thus barrier bit can be attached to data packets and can also be single
requests without data.

DST will continue to collect data, but will not send it to remote nodes
(actually it can send it, but data will not be processed and will stay
in the remote's receiving queue). This is a main concern about barrier -
should or not main node continue to process requests if previous ones
have not reached media yet, thus I have not yet implemented barriers.


-- 
	Evgeniy Polyakov
--
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
[0/4] DST: Distributed storage., Evgeniy Polyakov, (Tue Dec 4, 10:37 am)
Re: [0/4] DST: Distributed storage., Mike Snitzer, (Tue Dec 4, 11:25 am)
Re: [0/4] DST: Distributed storage., Christoph Hellwig, (Tue Dec 4, 12:56 pm)
Re: [0/4] DST: Distributed storage., Evgeniy Polyakov, (Tue Dec 4, 1:21 pm)
Re: [0/4] DST: Distributed storage., Evgeniy Polyakov, (Tue Dec 4, 12:00 pm)
[1/4] DST: Distributed storage documentation., Evgeniy Polyakov, (Tue Dec 4, 10:37 am)
[2/4] DST: Core distributed storage files., Evgeniy Polyakov, (Tue Dec 4, 10:37 am)
[3/4] DST: Network state machine., Evgeniy Polyakov, (Tue Dec 4, 10:37 am)
[4/4] DST: Algorithms used in distributed storage., Evgeniy Polyakov, (Tue Dec 4, 10:37 am)