Re: tcp bw in 2.6

!MAILaRCHIVE_VOTE_RePLACE
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
To: Rick Jones <rick.jones2@...>
Cc: Larry McVoy <lm@...>, Linus Torvalds <torvalds@...>, <davem@...>, <wscott@...>, <netdev@...>
Date: Wednesday, October 3, 2007 - 3:19 am

Tangential aside:

On Tue, 02 Oct 2007, Rick Jones wrote:


Interesting.  I was going to say that I've generally had the opposite
experience when it comes to bulk data transfers, which is what I would
expect due to CPU caching effects, but that perhaps it's motherboard/NIC/
driver dependent.  But in testing I just did I discovered it's even
MTU dependent (most of my normal testing is always with 9000-byte
jumbo frames).

With Myricom 10-GigE NICs, NIC interrupts on CPU 0 and nuttcp app
running on CPU 1 (both transmit and receive sides), and using 9000-byte
jumbo frames:

[root@lang2 ~]# nuttcp -w10m 192.168.88.16
10078.5000 MB /  10.02 sec = 8437.5396 Mbps 100 %TX 99 %RX

With Myricom 10-GigE NICs, and both NIC interrupts and nuttcp app
on CPU 0 (both transmit and receive sides), again using 9000-byte
jumbo frames:

[root@lang2 ~]# nuttcp -w10m 192.168.88.16
11817.8750 MB /  10.00 sec = 9909.7537 Mbps 100 %TX 74 %RX

Same tests repeated with standard 1500-byte Ethernet MTU:

With Myricom 10-GigE NICs, NIC interrupts on CPU 0 and nuttcp app
running on CPU 1 (both transmit and receive sides), and using
standard 1500-byte Ethernet MTU:

[root@lang2 ~]# nuttcp -M1460 -w10m 192.168.88.16
 5685.9375 MB /  10.00 sec = 4768.0951 Mbps 99 %TX 98 %RX

With Myricom 10-GigE NICs, and both NIC interrupts and nuttcp app
on CPU 0 (both transmit and receive sides), again using standard
1500-byte Ethernet MTU:

[root@lang2 ~]# nuttcp -M1460 -w10m 192.168.88.16
 4974.0625 MB /  10.03 sec = 4161.6015 Mbps 100 %TX 100 %RX

Now back to your regularly scheduled programming.  :-)

						-Bill
-
To unsubscribe from this list: send the line "unsubscribe netdev" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
Re: tcp bw in 2.6, Larry McVoy, (Mon Oct 1, 8:59 pm)
Re: tcp bw in 2.6, Herbert Xu, (Tue Oct 2, 6:52 am)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 11:09 am)
Re: tcp bw in 2.6, Linus Torvalds, (Tue Oct 2, 3:27 pm)
Re: tcp bw in 2.6, Rick Jones, (Tue Oct 2, 3:53 pm)
Re: tcp bw in 2.6, David Miller, (Tue Oct 2, 4:33 pm)
Re: tcp bw in 2.6, Roland Dreier, (Tue Oct 2, 4:44 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 5:21 pm)
Re: tcp bw in 2.6, Pekka Pietikainen, (Wed Oct 3, 5:13 pm)
Re: tcp bw in 2.6, Larry McVoy, (Wed Oct 3, 5:23 pm)
Re: tcp bw in 2.6, Pekka Pietikainen, (Wed Oct 3, 5:50 pm)
Re: tcp bw in 2.6, John Heffner, (Tue Oct 2, 2:29 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 3:07 pm)
Re: tcp bw in 2.6, Linus Torvalds, (Tue Oct 2, 3:29 pm)
Re: tcp bw in 2.6, David Miller, (Tue Oct 2, 4:31 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 3:33 pm)
Re: tcp bw in 2.6, John Heffner, (Tue Oct 2, 3:53 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 4:14 pm)
Re: tcp bw in 2.6, Rick Jones, (Tue Oct 2, 4:40 pm)
Re: tcp bw in 2.6, Wayne Scott, (Tue Oct 2, 4:42 pm)
Re: tcp bw in 2.6, Linus Torvalds, (Tue Oct 2, 5:56 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 11:41 am)
Re: tcp bw in 2.6, Linus Torvalds, (Tue Oct 2, 12:34 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 12:48 pm)
Re: tcp bw in 2.6, David Miller, (Tue Oct 2, 5:16 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 5:26 pm)
Re: tcp bw in 2.6, David Miller, (Tue Oct 2, 5:47 pm)
Re: tcp bw in 2.6, Rick Jones, (Tue Oct 2, 6:17 pm)
Re: tcp bw in 2.6, David Miller, (Tue Oct 2, 6:32 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 6:36 pm)
Re: tcp bw in 2.6, Rick Jones, (Tue Oct 2, 6:59 pm)
Re: tcp bw in 2.6, David Miller, (Wed Oct 3, 4:02 am)
Re: tcp bw in 2.6, Ben Greear, (Tue Oct 2, 12:48 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 1:11 pm)
Re: tcp bw in 2.6, Ben Greear, (Tue Oct 2, 1:18 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 1:21 pm)
Re: tcp bw in 2.6, Stephen Hemminger, (Tue Oct 2, 1:54 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 2:35 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 12:25 pm)
Re: tcp bw in 2.6, Stephen Hemminger, (Tue Oct 2, 12:47 pm)
Re: tcp bw in 2.6, Daniel Schaffrath, (Mon Oct 15, 8:40 am)
Re: tcp bw in 2.6, Stephen Hemminger, (Mon Oct 15, 11:49 am)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 12:49 pm)
Re: tcp bw in 2.6, Stephen Hemminger, (Tue Oct 2, 1:10 pm)
Re: tcp bw in 2.6, Linus Torvalds, (Mon Oct 1, 10:14 pm)
Re: tcp bw in 2.6, Larry McVoy, (Mon Oct 1, 10:20 pm)
Re: tcp bw in 2.6, Rick Jones, (Tue Oct 2, 1:14 pm)
Re: tcp bw in 2.6, Bill Fink, (Wed Oct 3, 3:19 am)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 1:20 pm)
Re: tcp bw in 2.6, Rick Jones, (Tue Oct 2, 2:01 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 2:40 pm)
Re: tcp bw in 2.6, Rick Jones, (Tue Oct 2, 3:47 pm)
Re: tcp bw in 2.6, David Miller, (Tue Oct 2, 5:32 pm)
Re: tcp bw in 2.6, John Heffner, (Tue Oct 2, 11:06 am)
Re: tcp bw in 2.6, David Miller, (Mon Oct 1, 11:50 pm)
Re: tcp bw in 2.6, Larry McVoy, (Tue Oct 2, 12:23 am)