Re: Btrfs v0.16 released

!MAILaRCHIVE_VOTE_RePLACE
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
To: Andi Kleen <andi@...>
Cc: Peter Zijlstra <peterz@...>, linux-btrfs <linux-btrfs@...>, linux-kernel <linux-kernel@...>, linux-fsdevel <linux-fsdevel@...>
Date: Friday, August 8, 2008 - 2:48 pm

On Thu, 2008-08-07 at 20:02 +0200, Andi Kleen wrote:

Most metadata is allocated in groups of 128k or 256k, and so most of the
writes are nicely sized.  The mirroring code has areas of the disk
dedicated to mirror other areas.  So we end up with something like this:

metadata chunk A (~1GB in size)
[ ......................... ]

mirror of chunk A (~1GB in size)
[ ......................... ]

So, the mirroring turns a single large write into two large writes.
Definitely not free, but always a fixed cost.

I started to make some numbers of this yesterday on single spindles and
discovered that my worker threads are not doing as good a job as they
should be of maintaining IO ordering.  I've been using an array with a
writeback cache for benchmarking lately and hadn't noticed.

I need to fix that, but here are some numbers on a single sata drive.
The drive can do about 100MB/s streaming reads/writes.  Btrfs
checksumming and inline data (tail packing) are both turned on.

Single process creating 30 kernel trees (2.6.27-rc2)

Btrfs defaults	36MB/s
Btrfs no mirror 50MB/s
Ext4 defaults   59.2MB/s (much better than ext3 here)

With /sys/block/sdb/queue/nr_requests at 8192 to hide my IO ordering
submission problems:

Btrfs defaults: 57MB/s
Btrfs no mirror: 61.51MB/s

-chris


--
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
Btrfs v0.16 released, Chris Mason, (Tue Aug 5, 3:01 pm)
Re: Btrfs v0.16 released, Peter Zijlstra, (Thu Aug 7, 5:08 am)
Re: Btrfs v0.16 released, Chris Mason, (Thu Aug 7, 6:34 am)
Re: Btrfs v0.16 released, , (Thu Aug 7, 11:07 am)
Re: Btrfs v0.16 released, Chris Friesen, (Thu Aug 7, 10:58 am)
Re: Btrfs v0.16 released, Peter Zijlstra, (Thu Aug 7, 5:14 am)
Re: Btrfs v0.16 released, Chris Mason, (Thu Aug 7, 6:39 am)
Re: Btrfs v0.16 released, Andi Kleen, (Thu Aug 7, 2:02 pm)
Re: Btrfs v0.16 released, Chris Mason, (Fri Aug 8, 2:48 pm)
Re: Btrfs v0.16 released, Chris Mason, (Thu Aug 14, 5:00 pm)
Re: Btrfs v0.16 released, Theodore Tso, (Thu Aug 14, 7:44 pm)
Re: Btrfs v0.16 released, Chris Mason, (Thu Aug 14, 9:10 pm)
Re: Btrfs v0.16 released, Chris Mason, (Fri Aug 15, 8:46 am)
Re: Btrfs v0.16 released, Theodore Tso, (Fri Aug 15, 9:45 am)
Re: Btrfs v0.16 released, Chris Mason, (Fri Aug 15, 1:52 pm)
Re: Btrfs v0.16 released, Theodore Tso, (Fri Aug 15, 3:59 pm)
Re: Btrfs v0.16 released, Chris Mason, (Fri Aug 15, 4:37 pm)
Re: Btrfs v0.16 released, Chris Mason, (Sat Aug 16, 2:10 pm)
Re: Btrfs v0.16 released, Theodore Tso, (Sat Aug 16, 3:27 pm)
Re: Btrfs v0.16 released, Andi Kleen, (Thu Aug 14, 5:17 pm)
Re: Btrfs v0.16 released, Chris Mason, (Thu Aug 14, 9:25 pm)
Re: Btrfs v0.16 released, Andi Kleen, (Thu Aug 14, 9:39 pm)
Re: Btrfs v0.16 released, Chris Mason, (Fri Aug 15, 9:00 am)
Re: Btrfs v0.16 released, Szabolcs Szakacsits, (Sat Aug 16, 3:26 pm)
Re: Btrfs v0.16 released, Chris Mason, (Mon Aug 18, 9:52 am)
Re: Btrfs v0.16 released, Szabolcs Szakacsits, (Mon Aug 18, 1:37 pm)
Re: Btrfs v0.16 released, Andi Kleen, (Fri Aug 8, 5:56 pm)
Re: Btrfs v0.16 released, Theodore Tso, (Fri Aug 8, 9:19 pm)
Re: Btrfs v0.16 released, Andi Kleen, (Fri Aug 8, 9:23 pm)
Re: Btrfs v0.16 released, Theodore Tso, (Fri Aug 8, 9:43 pm)