Re: tcp bw in 2.6

!MAILaRCHIVE_VOTE_RePLACE
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
To: John Heffner <jheffner@...>
Cc: <lm@...>, Herbert Xu <herbert@...>, <torvalds@...>, <davem@...>, <wscott@...>, <netdev@...>
Date: Tuesday, October 2, 2007 - 4:14 pm

> I think I'm still missing some basic data here (probably because this 

just got off the phone with Linus and he thinks it is the side that does
the accept is the problem side, i.e., if you are the server, you do the
accept, and you send the data, you'll go slow.  But as I'm writing this
I realize he's wrong, because it is the combination of accept & send.
accept & recv goes fast.

A trivial way to see the problem is to take two linux boxes, on each
apt-get install rsh-client rsh-server
set up your .rhosts,
and then do

	dd if=/dev/zero count=100000 | rsh OTHER_BOX dd of=/dev/null
	rsh OTHER_BOX dd if=/dev/zero count=100000 | dd of=/dev/null

See if you get balanced results.  For me, I get 45MB/sec one way, and
15-19MB/sec the other way.

I've tried the same test linux - linux and linux - hpux.  Same results.
The test setup I have is

	work:	2ghz x 2 Athlons, e1000, 2.6.18
	ia64:	900mhz Itanium, e1000, 2.6.12
	hp-ia64:900mhz Itanium, e1000, hpux 11
	glibc*: 1-2ghz athlons running various linux releases

all connected through a netgear 724T 10/100/1000 switch (a linksys showed
identical results).

I tested 

	work <-> hp-ia64
	work <-> ia64
	ia64 <-> hp-ia64

and in all cases, one direction worked fast and the other didn't.

It would be good if people tried the same simple test.  You have to
use rsh, ssh will slow things down way too much.

Alternatively, take your favorite test programs, such as John's,
and make a second pair that reverses the direction the data is 
sent.  So one pair is server sends, the other is server receives,
try both.  That's where we started, BitKeeper, my stripped down test,
and John's test all exhibit the same behavior.  And the rsh test
is just a really simple way to demonstrate it.

Wayne, Linus asked for tcp dumps from just one side, with the first 100
packets and then wait 10 seconds or so for the window to open up, and then
a snap shot of the another 100 packets.  Do that for both directions
and send them to the list.  Can you do that?  I want to get lunch, I'm
starving.
-- 
---
Larry McVoy                lm at bitmover.com           http://www.bitkeeper.com
-
To unsubscribe from this list: send the line "unsubscribe netdev" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
Re: tcp bw in 2.6, Larry McVoy, (Mon Oct 1, 8:59 pm)
Re: tcp bw in 2.6, Herbert Xu, (Tue Oct 2, 6:52 am)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 11:09 am)
Re: tcp bw in 2.6, Linus Torvalds, (Tue Oct 2, 3:27 pm)
Re: tcp bw in 2.6, Rick Jones, (Tue Oct 2, 3:53 pm)
Re: tcp bw in 2.6, David Miller, (Tue Oct 2, 4:33 pm)
Re: tcp bw in 2.6, Roland Dreier, (Tue Oct 2, 4:44 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 5:21 pm)
Re: tcp bw in 2.6, Pekka Pietikainen, (Wed Oct 3, 5:13 pm)
Re: tcp bw in 2.6, Larry McVoy, (Wed Oct 3, 5:23 pm)
Re: tcp bw in 2.6, Pekka Pietikainen, (Wed Oct 3, 5:50 pm)
Re: tcp bw in 2.6, John Heffner, (Tue Oct 2, 2:29 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 3:07 pm)
Re: tcp bw in 2.6, Linus Torvalds, (Tue Oct 2, 3:29 pm)
Re: tcp bw in 2.6, David Miller, (Tue Oct 2, 4:31 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 3:33 pm)
Re: tcp bw in 2.6, John Heffner, (Tue Oct 2, 3:53 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 4:14 pm)
Re: tcp bw in 2.6, Rick Jones, (Tue Oct 2, 4:40 pm)
Re: tcp bw in 2.6, Wayne Scott, (Tue Oct 2, 4:42 pm)
Re: tcp bw in 2.6, Linus Torvalds, (Tue Oct 2, 5:56 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 11:41 am)
Re: tcp bw in 2.6, Linus Torvalds, (Tue Oct 2, 12:34 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 12:48 pm)
Re: tcp bw in 2.6, David Miller, (Tue Oct 2, 5:16 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 5:26 pm)
Re: tcp bw in 2.6, David Miller, (Tue Oct 2, 5:47 pm)
Re: tcp bw in 2.6, Rick Jones, (Tue Oct 2, 6:17 pm)
Re: tcp bw in 2.6, David Miller, (Tue Oct 2, 6:32 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 6:36 pm)
Re: tcp bw in 2.6, Rick Jones, (Tue Oct 2, 6:59 pm)
Re: tcp bw in 2.6, David Miller, (Wed Oct 3, 4:02 am)
Re: tcp bw in 2.6, Ben Greear, (Tue Oct 2, 12:48 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 1:11 pm)
Re: tcp bw in 2.6, Ben Greear, (Tue Oct 2, 1:18 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 1:21 pm)
Re: tcp bw in 2.6, Stephen Hemminger, (Tue Oct 2, 1:54 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 2:35 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 12:25 pm)
Re: tcp bw in 2.6, Stephen Hemminger, (Tue Oct 2, 12:47 pm)
Re: tcp bw in 2.6, Daniel Schaffrath, (Mon Oct 15, 8:40 am)
Re: tcp bw in 2.6, Stephen Hemminger, (Mon Oct 15, 11:49 am)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 12:49 pm)
Re: tcp bw in 2.6, Stephen Hemminger, (Tue Oct 2, 1:10 pm)
Re: tcp bw in 2.6, Linus Torvalds, (Mon Oct 1, 10:14 pm)
Re: tcp bw in 2.6, Larry McVoy, (Mon Oct 1, 10:20 pm)
Re: tcp bw in 2.6, Rick Jones, (Tue Oct 2, 1:14 pm)
Re: tcp bw in 2.6, Bill Fink, (Wed Oct 3, 3:19 am)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 1:20 pm)
Re: tcp bw in 2.6, Rick Jones, (Tue Oct 2, 2:01 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 2:40 pm)
Re: tcp bw in 2.6, Rick Jones, (Tue Oct 2, 3:47 pm)
Re: tcp bw in 2.6, David Miller, (Tue Oct 2, 5:32 pm)
Re: tcp bw in 2.6, John Heffner, (Tue Oct 2, 11:06 am)
Re: tcp bw in 2.6, David Miller, (Mon Oct 1, 11:50 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 12:23 am)