Re: [PATCH v5] rfs: Receive Flow Steering

Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
From: Eric Dumazet
Date: Thursday, April 15, 2010 - 11:56 pm

Le jeudi 15 avril 2010 à 23:33 -0700, David Miller a écrit :

I read the patch and found no error.

I booted a test machine and performed some tests

I am a bit worried of a tbench regression I am looking at right now.

if RFS disabled , tbench 16   ->  4408.63 MB/sec 


# grep . /sys/class/net/lo/queues/rx-0/*
/sys/class/net/lo/queues/rx-0/rps_cpus:00000000
/sys/class/net/lo/queues/rx-0/rps_flow_cnt:8192
# cat /proc/sys/net/core/rps_sock_flow_entries
8192


echo ffff >/sys/class/net/lo/queues/rx-0/rps_cpus

tbench 16 -> 2336.32 MB/sec


-----------------------------------------------------------------------------------------------------------------------------------------------------
   PerfTop:   14561 irqs/sec  kernel:86.3% [1000Hz cycles],  (all, 16 CPUs)
-----------------------------------------------------------------------------------------------------------------------------------------------------

             samples  pcnt function                       DSO
             _______ _____ ______________________________ __________________________________________________________

             2664.00  5.1% copy_user_generic_string       /lib/modules/2.6.34-rc3-03375-ga4fbf84-dirty/build/vmlinux
             2323.00  4.4% acpi_os_read_port              /lib/modules/2.6.34-rc3-03375-ga4fbf84-dirty/build/vmlinux
             1641.00  3.1% _raw_spin_lock_irqsave         /lib/modules/2.6.34-rc3-03375-ga4fbf84-dirty/build/vmlinux
             1260.00  2.4% schedule                       /lib/modules/2.6.34-rc3-03375-ga4fbf84-dirty/build/vmlinux
             1159.00  2.2% _raw_spin_lock                 /lib/modules/2.6.34-rc3-03375-ga4fbf84-dirty/build/vmlinux
             1051.00  2.0% tcp_ack                        /lib/modules/2.6.34-rc3-03375-ga4fbf84-dirty/build/vmlinux
              991.00  1.9% tcp_sendmsg                    /lib/modules/2.6.34-rc3-03375-ga4fbf84-dirty/build/vmlinux
              922.00  1.8% tcp_recvmsg                    /lib/modules/2.6.34-rc3-03375-ga4fbf84-dirty/build/vmlinux
              821.00  1.6% child_run                      /usr/bin/tbench                                           
              766.00  1.5% all_string_sub                 /usr/bin/tbench                                           
              630.00  1.2% __switch_to                    /lib/modules/2.6.34-rc3-03375-ga4fbf84-dirty/build/vmlinux
              608.00  1.2% __GI_strchr                    /lib/tls/libc-2.3.4.so                                    
              606.00  1.2% ipt_do_table                   /lib/modules/2.6.34-rc3-03375-ga4fbf84-dirty/build/vmlinux
              600.00  1.1% __GI_strstr                    /lib/tls/libc-2.3.4.so                                    
              556.00  1.1% __netif_receive_skb            /lib/modules/2.6.34-rc3-03375-ga4fbf84-dirty/build/vmlinux
              504.00  1.0% tcp_transmit_skb               /lib/modules/2.6.34-rc3-03375-ga4fbf84-dirty/build/vmlinux
              502.00  1.0% tick_nohz_stop_sched_tick      /lib/modules/2.6.34-rc3-03375-ga4fbf84-dirty/build/vmlinux
              481.00  0.9% _raw_spin_unlock_irqrestore    /lib/modules/2.6.34-rc3-03375-ga4fbf84-dirty/build/vmlinux
              473.00  0.9% next_token                     /usr/bin/tbench                                           
              449.00  0.9% ip_rcv                         /lib/modules/2.6.34-rc3-03375-ga4fbf84-dirty/build/vmlinux
              423.00  0.8% call_function_single_interrupt /lib/modules/2.6.34-rc3-03375-ga4fbf84-dirty/build/vmlinux
              422.00  0.8% ia32_sysenter_target           /lib/modules/2.6.34-rc3-03375-ga4fbf84-dirty/build/vmlinux
              420.00  0.8% compat_sys_socketcall          /lib/modules/2.6.34-rc3-03375-ga4fbf84-dirty/build/vmlinux
              401.00  0.8% mod_timer                      /lib/modules/2.6.34-rc3-03375-ga4fbf84-dirty/build/vmlinux
              400.00  0.8% process_backlog                /lib/modules/2.6.34-rc3-03375-ga4fbf84-dirty/build/vmlinux
              399.00  0.8% ip_queue_xmit                  /lib/modules/2.6.34-rc3-03375-ga4fbf84-dirty/build/vmlinux
              387.00  0.7% select_task_rq_fair            /lib/modules/2.6.34-rc3-03375-ga4fbf84-dirty/build/vmlinux
              377.00  0.7% _raw_spin_lock_bh              /lib/modules/2.6.34-rc3-03375-ga4fbf84-dirty/build/vmlinux
              360.00  0.7% tcp_v4_rcv                     /lib/modules/2.6.34-rc3-03375-ga4fbf84-dirty/build/vmlinux

But if RFS is on, why activating rps_cpus change tbench ?



--
To unsubscribe from this list: send the line "unsubscribe netdev" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
[PATCH v5] rfs: Receive Flow Steering, Tom Herbert, (Thu Apr 15, 10:47 pm)
Re: [PATCH v5] rfs: Receive Flow Steering, David Miller, (Thu Apr 15, 11:33 pm)
Re: [PATCH v5] rfs: Receive Flow Steering, Eric Dumazet, (Thu Apr 15, 11:56 pm)
Re: [PATCH v5] rfs: Receive Flow Steering, Eric Dumazet, (Fri Apr 16, 12:18 am)
Re: [PATCH v5] rfs: Receive Flow Steering, David Miller, (Fri Apr 16, 12:26 am)
Re: [PATCH v5] rfs: Receive Flow Steering, Eric Dumazet, (Fri Apr 16, 12:48 am)
Re: [PATCH v5] rfs: Receive Flow Steering, Andi Kleen, (Fri Apr 16, 4:57 am)
Re: [PATCH v5] rfs: Receive Flow Steering, jamal, (Fri Apr 16, 6:32 am)
Re: [PATCH v5] rfs: Receive Flow Steering, Andi Kleen, (Fri Apr 16, 6:42 am)
Re: [PATCH v5] rfs: Receive Flow Steering, jamal, (Fri Apr 16, 7:05 am)
Re: [PATCH v5] rfs: Receive Flow Steering, Andi Kleen, (Fri Apr 16, 8:28 am)
Re: [PATCH v5] rfs: Receive Flow Steering, Tom Herbert, (Fri Apr 16, 8:35 am)
Re: [PATCH v5] rfs: Receive Flow Steering, Eric Dumazet, (Fri Apr 16, 11:15 am)
Re: [PATCH v5] rfs: Receive Flow Steering, Tom Herbert, (Fri Apr 16, 11:35 am)
Re: [PATCH v5] rfs: Receive Flow Steering, Eric Dumazet, (Fri Apr 16, 11:53 am)
Re: [PATCH v5] rfs: Receive Flow Steering, Eric Dumazet, (Fri Apr 16, 12:37 pm)
Re: [PATCH v5] rfs: Receive Flow Steering, Tom Herbert, (Fri Apr 16, 1:42 pm)
Re: [PATCH v5] rfs: Receive Flow Steering, Eric Dumazet, (Fri Apr 16, 2:12 pm)
Re: [PATCH v5] rfs: Receive Flow Steering, Eric Dumazet, (Fri Apr 16, 2:25 pm)
Re: [PATCH v5] rfs: Receive Flow Steering, David Miller, (Fri Apr 16, 3:49 pm)
Re: [PATCH v5] rfs: Receive Flow Steering, David Miller, (Fri Apr 16, 3:53 pm)
Re: [PATCH v5] rfs: Receive Flow Steering, David Miller, (Fri Apr 16, 3:57 pm)
Re: [PATCH v5] rfs: Receive Flow Steering, Tom Herbert, (Fri Apr 16, 5:22 pm)
Re: [PATCH v5] rfs: Receive Flow Steering, David Miller, (Fri Apr 16, 5:58 pm)
Re: [PATCH v5] rfs: Receive Flow Steering, Eric Dumazet, (Sat Apr 17, 9:10 am)
Re: [PATCH v5] rfs: Receive Flow Steering, Tom Herbert, (Sat Apr 17, 10:38 am)
Re: [PATCH v5] rfs: Receive Flow Steering, Changli Gao, (Sat Apr 17, 5:06 pm)
Re: [PATCH v5] rfs: Receive Flow Steering, Franco Fichtner, (Sun Apr 18, 4:06 am)
Re: [PATCH v5] rfs: Receive Flow Steering, David Miller, (Mon Apr 19, 1:09 pm)
Re: [PATCH v5] rfs: Receive Flow Steering, David Miller, (Mon Apr 19, 1:23 pm)
Re: [PATCH v5] rfs: Receive Flow Steering, Eric Dumazet, (Mon Apr 19, 1:32 pm)
Re: [PATCH v5] rfs: Receive Flow Steering, David Miller, (Mon Apr 19, 2:19 pm)
Re: [PATCH v5] rfs: Receive Flow Steering, Changli Gao, (Mon Apr 19, 4:38 pm)
Re: [PATCH v5] rfs: Receive Flow Steering, Eric Dumazet, (Mon Apr 19, 10:59 pm)
[PATCH net-next-2.6] rps: consistent rxhash, Eric Dumazet, (Tue Apr 20, 12:56 am)
Re: [PATCH net-next-2.6] rps: consistent rxhash, David Miller, (Tue Apr 20, 1:18 am)
Re: [PATCH net-next-2.6] rps: consistent rxhash, Franco Fichtner, (Tue Apr 20, 5:48 am)
Re: [PATCH net-next-2.6] rps: consistent rxhash, Eric Dumazet, (Tue Apr 20, 6:16 am)
Re: [PATCH net-next-2.6] rps: consistent rxhash, Franco Fichtner, (Tue Apr 20, 7:03 am)
Re: [PATCH net-next-2.6] rps: consistent rxhash, Eric Dumazet, (Tue Apr 20, 7:57 am)
Re: [PATCH v5] rfs: Receive Flow Steering, Tom Herbert, (Tue Apr 20, 8:04 am)
Re: [PATCH net-next-2.6] rps: consistent rxhash, Tom Herbert, (Tue Apr 20, 8:09 am)
Re: [PATCH v5] rfs: Receive Flow Steering, Eric Dumazet, (Tue Apr 20, 8:39 am)
Re: [PATCH net-next-2.6] rps: consistent rxhash, David Miller, (Tue Apr 20, 2:41 pm)
Re: [PATCH net-next-2.6] rps: consistent rxhash, Changli Gao, (Tue Apr 20, 4:35 pm)
Re: [PATCH net-next-2.6] rps: consistent rxhash, David Miller, (Tue Apr 20, 4:38 pm)
Re: [PATCH net-next-2.6] rps: consistent rxhash, Franco Fichtner, (Wed Apr 21, 2:29 am)
Re: [PATCH net-next-2.6] rps: consistent rxhash, Eric Dumazet, (Wed Apr 21, 2:39 am)
Re: [PATCH net-next-2.6] rps: consistent rxhash, Franco Fichtner, (Wed Apr 21, 4:06 am)
Re: [PATCH net-next-2.6] rps: consistent rxhash, Eric Dumazet, (Wed Apr 21, 4:16 am)
Re: [PATCH net-next-2.6] rps: consistent rxhash, Tom Herbert, (Wed Apr 21, 12:12 pm)
Re: [PATCH net-next-2.6] rps: consistent rxhash, David Miller, (Fri Apr 23, 1:44 pm)
Re: [PATCH v5] rfs: Receive Flow Steering, Eric Dumazet, (Mon Apr 26, 1:41 am)
Re: [PATCH v5] rfs: Receive Flow Steering, David Miller, (Tue Apr 27, 2:59 pm)
Re: [PATCH v5] rfs: Receive Flow Steering, Eric Dumazet, (Tue Apr 27, 3:08 pm)
Re: [PATCH v5] rfs: Receive Flow Steering, David Miller, (Tue Apr 27, 3:10 pm)
Re: [PATCH net-next-2.6] rps: consistent rxhash, David Miller, (Thu May 6, 1:06 am)
Re: [PATCH net-next-2.6] rps: consistent rxhash, Tom Herbert, (Thu May 6, 7:45 am)