Re: tcp bw in 2.6

!MAILaRCHIVE_VOTE_RePLACE
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
To: Larry McVoy <lm@...>
Cc: Linus Torvalds <torvalds@...>, <davem@...>, <wscott@...>, <netdev@...>
Date: Tuesday, October 2, 2007 - 1:14 pm

Larry McVoy wrote:

http://www.netperf.org/svn/netperf2/trunk/

:)

WRT the different speeds in each direction talking with HP-UX, perhaps there is 
an interaction between the Linux TCP stack (TSO perhaps) and HP-UX's ACK 
avoidance heuristics. If that is the case, tweaking tcp_deferred_ack_max with 
ndd on the HP-UX system might yield different results.

I don't recall if the igelan (broadcom) driver in HP-UX attempts to auto-tune 
the interrupt throttling.  I do believe the iether (intel) driver in HP-UX does. 
  That can be altered via lanadmin -X mumble... commands.

Later (although later than a 2.6.18 kernel IIRC) e1000 drivers do try to 
auto-tune the interrupt throttling and one can see oscilations when an e1000 
driver is talking to an e1000 driver.  I think that can only be changed via the 
InterruptThrotleRate e1000 module parameter in that era of kernel - not sure if 
the Intel folks have that available via ethtool on contemporary kernels now or not.

WRT the small program making a setsockopt(SO_*BUF) call going slower than the 
rsh, does rsh make the setsockopt() call, or does it bend itself to the will of 
the linux stack's autotuning?  What happens if your small program does not make 
  setsockopt(SO_*BUF) calls?

Other misc observations of variable value:

*) depending on the quantity of CPU around, and the type of test one is running, 
results can be better/worse depending on the CPU to which you bind the 
application.  Latency tends to be best when running on the same core as takes 
interrupts from the NIC, bulk transfer can be better when running on a different 
core, although generally better when a different core on the same chip.  These 
days the throughput stuff is more easily seen on 10G, but the netperf service 
demand changes are still visible on 1G.

*) agreement with the observation that the small recv calls suggest that the 
application is staying-up with the network.  I doubt that SO_&BUF settings would 
change that, but perhaps setting watermarks might (wild ass guess).  The 
watermarks will do nothing on HP-UX though (IIRC).

rick jones
-
To unsubscribe from this list: send the line "unsubscribe netdev" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
Re: tcp bw in 2.6, Larry McVoy, (Mon Oct 1, 8:59 pm)
Re: tcp bw in 2.6, Herbert Xu, (Tue Oct 2, 6:52 am)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 11:09 am)
Re: tcp bw in 2.6, Linus Torvalds, (Tue Oct 2, 3:27 pm)
Re: tcp bw in 2.6, Rick Jones, (Tue Oct 2, 3:53 pm)
Re: tcp bw in 2.6, David Miller, (Tue Oct 2, 4:33 pm)
Re: tcp bw in 2.6, Roland Dreier, (Tue Oct 2, 4:44 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 5:21 pm)
Re: tcp bw in 2.6, Pekka Pietikainen, (Wed Oct 3, 5:13 pm)
Re: tcp bw in 2.6, Larry McVoy, (Wed Oct 3, 5:23 pm)
Re: tcp bw in 2.6, Pekka Pietikainen, (Wed Oct 3, 5:50 pm)
Re: tcp bw in 2.6, John Heffner, (Tue Oct 2, 2:29 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 3:07 pm)
Re: tcp bw in 2.6, Linus Torvalds, (Tue Oct 2, 3:29 pm)
Re: tcp bw in 2.6, David Miller, (Tue Oct 2, 4:31 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 3:33 pm)
Re: tcp bw in 2.6, John Heffner, (Tue Oct 2, 3:53 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 4:14 pm)
Re: tcp bw in 2.6, Rick Jones, (Tue Oct 2, 4:40 pm)
Re: tcp bw in 2.6, Wayne Scott, (Tue Oct 2, 4:42 pm)
Re: tcp bw in 2.6, Linus Torvalds, (Tue Oct 2, 5:56 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 11:41 am)
Re: tcp bw in 2.6, Linus Torvalds, (Tue Oct 2, 12:34 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 12:48 pm)
Re: tcp bw in 2.6, David Miller, (Tue Oct 2, 5:16 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 5:26 pm)
Re: tcp bw in 2.6, David Miller, (Tue Oct 2, 5:47 pm)
Re: tcp bw in 2.6, Rick Jones, (Tue Oct 2, 6:17 pm)
Re: tcp bw in 2.6, David Miller, (Tue Oct 2, 6:32 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 6:36 pm)
Re: tcp bw in 2.6, Rick Jones, (Tue Oct 2, 6:59 pm)
Re: tcp bw in 2.6, David Miller, (Wed Oct 3, 4:02 am)
Re: tcp bw in 2.6, Ben Greear, (Tue Oct 2, 12:48 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 1:11 pm)
Re: tcp bw in 2.6, Ben Greear, (Tue Oct 2, 1:18 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 1:21 pm)
Re: tcp bw in 2.6, Stephen Hemminger, (Tue Oct 2, 1:54 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 2:35 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 12:25 pm)
Re: tcp bw in 2.6, Stephen Hemminger, (Tue Oct 2, 12:47 pm)
Re: tcp bw in 2.6, Daniel Schaffrath, (Mon Oct 15, 8:40 am)
Re: tcp bw in 2.6, Stephen Hemminger, (Mon Oct 15, 11:49 am)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 12:49 pm)
Re: tcp bw in 2.6, Stephen Hemminger, (Tue Oct 2, 1:10 pm)
Re: tcp bw in 2.6, Linus Torvalds, (Mon Oct 1, 10:14 pm)
Re: tcp bw in 2.6, Larry McVoy, (Mon Oct 1, 10:20 pm)
Re: tcp bw in 2.6, Rick Jones, (Tue Oct 2, 1:14 pm)
Re: tcp bw in 2.6, Bill Fink, (Wed Oct 3, 3:19 am)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 1:20 pm)
Re: tcp bw in 2.6, Rick Jones, (Tue Oct 2, 2:01 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 2:40 pm)
Re: tcp bw in 2.6, Rick Jones, (Tue Oct 2, 3:47 pm)
Re: tcp bw in 2.6, David Miller, (Tue Oct 2, 5:32 pm)
Re: tcp bw in 2.6, John Heffner, (Tue Oct 2, 11:06 am)
Re: tcp bw in 2.6, David Miller, (Mon Oct 1, 11:50 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 12:23 am)