bonding in 12.04 dropping packages (lag when using ssh)

I have server setup with bonding, here is my /etc/network/interface file:

<pre>
# This file describes the network interfaces available on your system
# and how to activate them. For more information, see interfaces(5).

# The loopback network interface
auto lo
iface lo inet loopback

# The primary network interface
auto eth0
iface eth0 inet manual
bond-master bond0

auto eth1
iface eth1 inet manual
bond-master bond0

auto eth2
iface eth2 inet manual
bond-master bond0

auto eth3
iface eth3 inet manual
bond-master bond0

auto bond0
iface bond0 inet static
 address 172.16.1.190
 netmask 255.255.0.0
 gateway 172.16.255.254
 bond-mode 4
 bond-miimon 100
 bond-lacp-rate 1
 bond-slaves none
</pre>

and here is a ifconfig output 2 of them with 5 sec interval:

first
<pre>
bond0 Link encap:Ethernet HWaddr 00:25:90:13:7c:d8
          inet addr:172.16.1.190 Bcast:172.16.255.255 Mask:255.255.0.0
          inet6 addr: fe80::225:90ff:fe13:7cd8/64 Scope:Link
          UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
          RX packets:336217 errors:0 dropped:225355 overruns:0 frame:0
          TX packets:32937 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:29564929 (29.5 MB) TX bytes:3129639 (3.1 MB)

eth0 Link encap:Ethernet HWaddr 00:25:90:13:7c:d8
          UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
          RX packets:112255 errors:0 dropped:0 overruns:0 frame:0
          TX packets:32667 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:10047985 (10.0 MB) TX bytes:3095079 (3.0 MB)
          Interrupt:16 Memory:fabe0000-fac00000

eth1 Link encap:Ethernet HWaddr 00:25:90:13:7c:d8
          UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
          RX packets:74667 errors:0 dropped:74667 overruns:0 frame:0
          TX packets:90 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:6506508 (6.5 MB) TX bytes:11520 (11.5 KB)
          Interrupt:16 Memory:face0000-fad00000

eth2 Link encap:Ethernet HWaddr 00:25:90:13:7c:d8
          UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
          RX packets:74648 errors:0 dropped:74648 overruns:0 frame:0
          TX packets:90 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:6505250 (6.5 MB) TX bytes:11520 (11.5 KB)
          Interrupt:18 Memory:faee0000-faf00000

eth3 Link encap:Ethernet HWaddr 00:25:90:13:7c:d8
          UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
          RX packets:74647 errors:0 dropped:74647 overruns:0 frame:0
          TX packets:90 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:6505186 (6.5 MB) TX bytes:11520 (11.5 KB)
          Interrupt:19 Memory:fafe0000-fb000000

lo Link encap:Local Loopback
          inet addr:127.0.0.1 Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING MTU:16436 Metric:1
          RX packets:12 errors:0 dropped:0 overruns:0 frame:0
          TX packets:12 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:1406 (1.4 KB) TX bytes:1406 (1.4 KB)
</pre>

and 5 seconds later

<pre>
bond0 Link encap:Ethernet HWaddr 00:25:90:13:7c:d8
          inet addr:172.16.1.190 Bcast:172.16.255.255 Mask:255.255.0.0
          inet6 addr: fe80::225:90ff:fe13:7cd8/64 Scope:Link
          UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
          RX packets:336715 errors:0 dropped:225677 overruns:0 frame:0
          TX packets:32998 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:29604818 (29.6 MB) TX bytes:3138046 (3.1 MB)

eth0 Link encap:Ethernet HWaddr 00:25:90:13:7c:d8
          UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
          RX packets:112432 errors:0 dropped:0 overruns:0 frame:0
          TX packets:32728 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:10062800 (10.0 MB) TX bytes:3103486 (3.1 MB)
          Interrupt:16 Memory:fabe0000-fac00000

eth1 Link encap:Ethernet HWaddr 00:25:90:13:7c:d8
          UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
          RX packets:74774 errors:0 dropped:74774 overruns:0 frame:0
          TX packets:90 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:6514866 (6.5 MB) TX bytes:11520 (11.5 KB)
          Interrupt:16 Memory:face0000-fad00000

eth2 Link encap:Ethernet HWaddr 00:25:90:13:7c:d8
          UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
          RX packets:74755 errors:0 dropped:74755 overruns:0 frame:0
          TX packets:90 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:6513608 (6.5 MB) TX bytes:11520 (11.5 KB)
          Interrupt:18 Memory:faee0000-faf00000

eth3 Link encap:Ethernet HWaddr 00:25:90:13:7c:d8
          UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
          RX packets:74754 errors:0 dropped:74754 overruns:0 frame:0
          TX packets:90 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:6513544 (6.5 MB) TX bytes:11520 (11.5 KB)
          Interrupt:19 Memory:fafe0000-fb000000

lo Link encap:Local Loopback
          inet addr:127.0.0.1 Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING MTU:16436 Metric:1
          RX packets:12 errors:0 dropped:0 overruns:0 frame:0
          TX packets:12 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:1406 (1.4 KB) TX bytes:1406 (1.4 KB)
</pre>

As you can see all the interfaces exept eth0 and lo have droped RX packages how can I fix this

Thanks

Hjalmar