On Mon, 16 Jun 2008 21:48:55 +0200, Eric Dumazet wrote
quoted text
> Denys Fedoryshchenko a e'crit :
> > Hi again
> > 
> > I moved from PCI Realtek 8169 to onboard PCI-Express e1000e, and situation
> > become worse. Strange? Yes.
> > 
> > Here is info
> > Load and error rate: 
> > 
> > MegaRouter-KARAM /sys # ifconfig eth1;sleep 10;ifconfig eth1
> > eth1      Link encap:Ethernet  HWaddr 00:19:D1:71:5F:33
> >           inet addr:192.168.20.10  Bcast:0.0.0.0  Mask:255.255.255.0
> >           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
> >           RX packets:91991642 errors:0 dropped:1803444 overruns:0 frame:0
> >           TX packets:91914611 errors:0 dropped:0 overruns:0 carrier:0
> >           collisions:0 txqueuelen:1000
> >           RX bytes:316112765 (301.4 MiB)  TX bytes:138303107 (131.8 MiB)
> >           Memory:90300000-90320000
> > 
> > eth1      Link encap:Ethernet  HWaddr 00:19:D1:71:5F:33
> >           inet addr:192.168.20.10  Bcast:0.0.0.0  Mask:255.255.255.0
> >           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
> >           RX packets:92812514 errors:0 dropped:1815490 overruns:0 frame:0
> >           TX packets:92734865 errors:0 dropped:0 overruns:0 carrier:0
> >           collisions:0 txqueuelen:1000
> >           RX bytes:739941322 (705.6 MiB)  TX bytes:560547138 (534.5 MiB)
> >           Memory:90300000-90320000
> > 
> > System load (there is no NAT, no shapers, just routing, around 600-700
routes):
quoted text
> > MegaRouter-KARAM /sys # mpstat 1
> > Linux 2.6.26-rc6-git2-build-0029 (MegaRouter-KARAM)     06/16/08
> > 
> > 22:36:36     CPU   %user   %nice    %sys %iowait    %irq   %soft  %steal  
> > %idle    intr/s
> > 22:36:37     all    0.00    0.00    0.00    0.00    0.00    1.49    0.00  
> > 98.51  19764.00
> > 22:36:38     all    0.00    0.00    0.50    0.00    0.00    0.50    0.00  
> > 99.01  19888.00
> > 22:36:39     all    0.00    0.00    0.00    0.00    0.00    0.50    0.00  
> > 99.50  19642.00
> > 22:36:40     all    0.00    0.00    0.00    0.00    1.01    9.05    0.00  
> > 89.95  19543.00
> > 
> > (system almost idle)
> > 
> > MegaRouter-KARAM /sys # ethtool -S eth1
> > NIC statistics:
> >      rx_packets: 109977509
> >      tx_packets: 109887692
> >      rx_bytes: 57656749138
> >      tx_bytes: 57536071746
> >      rx_broadcast: 6497
> >      tx_broadcast: 92
> >      rx_multicast: 48995
> >      tx_multicast: 1960
> >      rx_errors: 0
> >      tx_errors: 0
> >      tx_dropped: 0
> >      multicast: 48995
> >      collisions: 0
> >      rx_length_errors: 0
> >      rx_over_errors: 0
> >      rx_crc_errors: 0
> >      rx_frame_errors: 0
> >      rx_no_buffer_count: 1796
> >      rx_missed_errors: 2182679
> >      tx_aborted_errors: 0
> >      tx_carrier_errors: 0
> >      tx_fifo_errors: 0
> >      tx_heartbeat_errors: 0
> >      tx_window_errors: 0
> >      tx_abort_late_coll: 0
> >      tx_deferred_ok: 55617
> >      tx_single_coll_ok: 0
> >      tx_multi_coll_ok: 0
> >      tx_timeout_count: 0
> >      tx_restart_queue: 1626
> >      rx_long_length_errors: 0
> >      rx_short_length_errors: 0
> >      rx_align_errors: 0
> >      tx_tcp_seg_good: 0
> >      tx_tcp_seg_failed: 0
> >      rx_flow_control_xon: 55461
> >      rx_flow_control_xoff: 57329
> >      tx_flow_control_xon: 39114
> >      tx_flow_control_xoff: 48341
> >      rx_long_byte_count: 57656749138
> >      rx_csum_offload_good: 104097306
> >      rx_csum_offload_errors: 2209
> >      rx_header_split: 0
> >      alloc_rx_buff_failed: 0
> >      tx_smbus: 22
> >      rx_smbus: 2201
> >      dropped_smbus: 0
> >      rx_dma_failed: 0
> >      tx_dma_failed: 0
> > MegaRouter-KARAM /sys # ethtool -S eth1
> > NIC statistics:
> >      rx_packets: 110154571
> >      tx_packets: 110064459
> >      rx_bytes: 57753358981
> >      tx_bytes: 57632419451
> >      rx_broadcast: 6501
> >      tx_broadcast: 92
> >      rx_multicast: 49155
> >      tx_multicast: 1960
> >      rx_errors: 0
> >      tx_errors: 0
> >      tx_dropped: 0
> >      multicast: 49155
> >      collisions: 0
> >      rx_length_errors: 0
> >      rx_over_errors: 0
> >      rx_crc_errors: 0
> >      rx_frame_errors: 0
> >      rx_no_buffer_count: 1796
> >      rx_missed_errors: 2187703
> >      tx_aborted_errors: 0
> >      tx_carrier_errors: 0
> >      tx_fifo_errors: 0
> >      tx_heartbeat_errors: 0
> >      tx_window_errors: 0
> >      tx_abort_late_coll: 0
> >      tx_deferred_ok: 55772
> >      tx_single_coll_ok: 0
> >      tx_multi_coll_ok: 0
> >      tx_timeout_count: 0
> >      tx_restart_queue: 1628
> >      rx_long_length_errors: 0
> >      rx_short_length_errors: 0
> >      rx_align_errors: 0
> >      tx_tcp_seg_good: 0
> >      tx_tcp_seg_failed: 0
> >      rx_flow_control_xon: 55615
> >      rx_flow_control_xoff: 57488
> >      tx_flow_control_xon: 39209
> >      tx_flow_control_xoff: 48448
> >      rx_long_byte_count: 57753358981
> >      rx_csum_offload_good: 104264656
> >      rx_csum_offload_errors: 2210
> >      rx_header_split: 0
> >      alloc_rx_buff_failed: 0
> >      tx_smbus: 23
> >      rx_smbus: 2207
> >      dropped_smbus: 0
> >      rx_dma_failed: 0
> >      tx_dma_failed: 0
> > 
> > 
> >
> 
> What RX & TX rings look like on e1000e ?
> 
> ethtool -g eth1
> 
> Also, please post "cat /proc/interrupts"
> 
MegaRouter-KARAM ~ # ethtool -g eth1
Ring parameters for eth1:
Pre-set maximums:
RX:             4096
RX Mini:        0
RX Jumbo:       0
TX:             4096
Current hardware settings:
RX:             256
RX Mini:        0
RX Jumbo:       0
TX:             256

After i tried to set ethtool -G eth1 4096 system becomes extremely slow, what
is very strange for me. I had to soft-reboot it (over kexec).

MegaRouter-KARAM ~ # cat /proc/interrupts;sleep 10;cat /proc/interrupts
           CPU0       CPU1
  0:      86148          0   IO-APIC-edge      timer
  1:          2          0   IO-APIC-edge      i8042
  9:          0          0   IO-APIC-fasteoi   acpi
 12:          5          0   IO-APIC-edge      i8042
 16:          0          0   IO-APIC-fasteoi   uhci_hcd:usb3
 18:          0          0   IO-APIC-fasteoi   ehci_hcd:usb1, uhci_hcd:usb7
 19:          0          0   IO-APIC-fasteoi   uhci_hcd:usb6
 21:          0          0   IO-APIC-fasteoi   uhci_hcd:usb4
 23:        968          0   IO-APIC-fasteoi   ehci_hcd:usb2, uhci_hcd:usb5
217:          3    1460438   PCI-MSI-edge      eth1
NMI:      86087      85892   Non-maskable interrupts
LOC:          0      85892   Local timer interrupts
RES:         44         81   Rescheduling interrupts
CAL:         88         56   function call interrupts
TLB:         91         78   TLB shootdowns
TRM:          0          0   Thermal event interrupts
SPU:          0          0   Spurious interrupts
ERR:          0
MIS:          0
           CPU0       CPU1
  0:      96150          0   IO-APIC-edge      timer
  1:          2          0   IO-APIC-edge      i8042
  9:          0          0   IO-APIC-fasteoi   acpi
 12:          5          0   IO-APIC-edge      i8042
 16:          0          0   IO-APIC-fasteoi   uhci_hcd:usb3
 18:          0          0   IO-APIC-fasteoi   ehci_hcd:usb1, uhci_hcd:usb7
 19:          0          0   IO-APIC-fasteoi   uhci_hcd:usb6
 21:          0          0   IO-APIC-fasteoi   uhci_hcd:usb4
 23:        968          0   IO-APIC-fasteoi   ehci_hcd:usb2, uhci_hcd:usb5
217:          3    1646537   PCI-MSI-edge      eth1
NMI:      96088      95893   Non-maskable interrupts
LOC:          0      95893   Local timer interrupts
RES:         44         81   Rescheduling interrupts
CAL:         89         56   function call interrupts
TLB:         91         78   TLB shootdowns
TRM:          0          0   Thermal event interrupts
SPU:          0          0   Spurious interrupts
ERR:          0
MIS:          0


About NMI interrupts - nmi_watchdog=1, if i disable it, it doesn't change
anything.



--
Denys Fedoryshchenko
Technical Manager
Virtual ISP S.A.L.

--
To unsubscribe from this list: send the line "unsubscribe netdev" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html