Bug 1371682

Summary: lacp team fails when one of the slaves goes down
Product: Red Hat Enterprise Linux 7 Reporter: Amit Supugade <asupugad>
Component: libteamAssignee: Hangbin Liu <haliu>
Status: CLOSED NOTABUG QA Contact: Amit Supugade <asupugad>
Severity: medium Docs Contact:
Priority: medium    
Version: 7.3CC: asupugad, mleitner, sukulkar
Target Milestone: rc   
Target Release: ---   
Hardware: x86_64   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2016-09-13 06:21:43 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description Amit Supugade 2016-08-30 19:18:28 UTC
Description of problem:
lacp team fails when one of the slaves goes down

Version-Release number of selected component (if applicable):
libteam-1.25-2.el7.x86_64
teamd-1.25-2.el7.x86_64

How reproducible:
Always

Steps to Reproduce:
1. Setup port_channel on switch
2. 
teamd -d -t team0 -c '{ "runner" : { "name": "lacp" },  "link_watch" : { "name": "ethtool" } }'
teamdctl team0 port add enp7s0f0
teamdctl team0 port add enp7s0f1
ip link set team0 up
pkill dhclient; sleep 3; dhclient -v team0
ping -c 20 192.168.1.254
ip link set enp7s0f0 down
sleep 10
ping -c 20 192.168.1.254

Actual results:
team fails when one of the slaves goes down

Expected results:
team should be able to ping even when one of the slave goes down

Additional info:
LOG-
[root@sam failover]# teamd -d -t team0 -c '{ "runner" : { "name": "lacp" },  "link_watch" : { "name": "ethtool" } }'
[root@sam failover]# teamdctl team0 port add enp7s0f0
[root@sam failover]# teamdctl team0 port add enp7s0f1
[root@sam failover]# ip link set team0 up
[root@sam failover]# pkill dhclient; sleep 3; dhclient -v team0
Internet Systems Consortium DHCP Client 4.2.5
Copyright 2004-2013 Internet Systems Consortium.
All rights reserved.
For info, please visit https://www.isc.org/software/dhcp/

Listening on LPF/team0/00:90:fa:8a:5b:fa
Sending on   LPF/team0/00:90:fa:8a:5b:fa
Sending on   Socket/fallback
DHCPREQUEST on team0 to 255.255.255.255 port 67 (xid=0x2beffc5a)
DHCPREQUEST on team0 to 255.255.255.255 port 67 (xid=0x2beffc5a)
DHCPDISCOVER on team0 to 255.255.255.255 port 67 interval 8 (xid=0x3136281c)
DHCPREQUEST on team0 to 255.255.255.255 port 67 (xid=0x3136281c)
DHCPOFFER from 192.168.1.254
DHCPACK from 192.168.1.254 (xid=0x3136281c)
bound to 192.168.1.17 -- renewal in 34165 seconds.
[root@sam failover]# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN qlen 1
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: enp5s0f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
    link/ether e4:11:5b:dd:e6:6c brd ff:ff:ff:ff:ff:ff
    inet 10.19.15.26/24 brd 10.19.15.255 scope global dynamic enp5s0f0
       valid_lft 85961sec preferred_lft 85961sec
    inet6 2620:52:0:130b:e611:5bff:fedd:e66c/64 scope global noprefixroute dynamic 
       valid_lft 2591971sec preferred_lft 604771sec
    inet6 fe80::e611:5bff:fedd:e66c/64 scope link 
       valid_lft forever preferred_lft forever
3: enp5s0f1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN qlen 1000
    link/ether e4:11:5b:dd:e6:6d brd ff:ff:ff:ff:ff:ff
4: enp7s0f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master team0 state UP qlen 1000
    link/ether 00:90:fa:8a:5b:fa brd ff:ff:ff:ff:ff:ff
    inet6 fe80::290:faff:fe8a:5bfa/64 scope link 
       valid_lft forever preferred_lft forever
5: enp7s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master team0 state UP qlen 1000
    link/ether 00:90:fa:8a:5b:fa brd ff:ff:ff:ff:ff:ff
    inet6 fe80::290:faff:fe8a:5c02/64 scope link 
       valid_lft forever preferred_lft forever
11: team0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP qlen 1000
    link/ether 00:90:fa:8a:5b:fa brd ff:ff:ff:ff:ff:ff
    inet 192.168.1.17/24 brd 192.168.1.255 scope global dynamic team0
       valid_lft 86398sec preferred_lft 86398sec
    inet6 fe80::290:faff:fe8a:5bfa/64 scope link 
       valid_lft forever preferred_lft forever
[root@sam failover]# ping -c 20 192.168.1.254
PING 192.168.1.254 (192.168.1.254) 56(84) bytes of data.
64 bytes from 192.168.1.254: icmp_seq=1 ttl=64 time=1.51 ms
64 bytes from 192.168.1.254: icmp_seq=2 ttl=64 time=0.776 ms
64 bytes from 192.168.1.254: icmp_seq=3 ttl=64 time=0.816 ms
64 bytes from 192.168.1.254: icmp_seq=4 ttl=64 time=0.841 ms
64 bytes from 192.168.1.254: icmp_seq=5 ttl=64 time=0.800 ms
64 bytes from 192.168.1.254: icmp_seq=6 ttl=64 time=0.775 ms
64 bytes from 192.168.1.254: icmp_seq=7 ttl=64 time=0.751 ms
64 bytes from 192.168.1.254: icmp_seq=8 ttl=64 time=0.727 ms
64 bytes from 192.168.1.254: icmp_seq=9 ttl=64 time=0.759 ms
64 bytes from 192.168.1.254: icmp_seq=10 ttl=64 time=0.788 ms
64 bytes from 192.168.1.254: icmp_seq=11 ttl=64 time=0.770 ms
64 bytes from 192.168.1.254: icmp_seq=12 ttl=64 time=0.729 ms
64 bytes from 192.168.1.254: icmp_seq=13 ttl=64 time=0.783 ms
64 bytes from 192.168.1.254: icmp_seq=14 ttl=64 time=0.773 ms
64 bytes from 192.168.1.254: icmp_seq=15 ttl=64 time=0.830 ms
64 bytes from 192.168.1.254: icmp_seq=16 ttl=64 time=0.857 ms
64 bytes from 192.168.1.254: icmp_seq=17 ttl=64 time=0.783 ms
64 bytes from 192.168.1.254: icmp_seq=18 ttl=64 time=0.749 ms
64 bytes from 192.168.1.254: icmp_seq=19 ttl=64 time=0.826 ms
64 bytes from 192.168.1.254: icmp_seq=20 ttl=64 time=0.841 ms

--- 192.168.1.254 ping statistics ---
20 packets transmitted, 20 received, 0% packet loss, time 19006ms
rtt min/avg/max/mdev = 0.727/0.824/1.510/0.162 ms

[root@sam failover]# ip link set enp7s0f0 down
[root@sam failover]# sleep 10
[root@sam failover]# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN qlen 1
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: enp5s0f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
    link/ether e4:11:5b:dd:e6:6c brd ff:ff:ff:ff:ff:ff
    inet 10.19.15.26/24 brd 10.19.15.255 scope global dynamic enp5s0f0
       valid_lft 85916sec preferred_lft 85916sec
    inet6 2620:52:0:130b:e611:5bff:fedd:e66c/64 scope global noprefixroute dynamic 
       valid_lft 2591927sec preferred_lft 604727sec
    inet6 fe80::e611:5bff:fedd:e66c/64 scope link 
       valid_lft forever preferred_lft forever
3: enp5s0f1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN qlen 1000
    link/ether e4:11:5b:dd:e6:6d brd ff:ff:ff:ff:ff:ff
4: enp7s0f0: <BROADCAST,MULTICAST> mtu 1500 qdisc mq master team0 state DOWN qlen 1000
    link/ether 00:90:fa:8a:5b:fa brd ff:ff:ff:ff:ff:ff
5: enp7s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master team0 state UP qlen 1000
    link/ether 00:90:fa:8a:5b:fa brd ff:ff:ff:ff:ff:ff
    inet6 fe80::290:faff:fe8a:5c02/64 scope link 
       valid_lft forever preferred_lft forever
11: team0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP qlen 1000
    link/ether 00:90:fa:8a:5b:fa brd ff:ff:ff:ff:ff:ff
    inet 192.168.1.17/24 brd 192.168.1.255 scope global dynamic team0
       valid_lft 86354sec preferred_lft 86354sec
    inet6 fe80::290:faff:fe8a:5bfa/64 scope link 
       valid_lft forever preferred_lft forever
[root@sam failover]# ping -c 20 192.168.1.254
PING 192.168.1.254 (192.168.1.254) 56(84) bytes of data.
From 192.168.1.17 icmp_seq=1 Destination Host Unreachable
From 192.168.1.17 icmp_seq=2 Destination Host Unreachable
From 192.168.1.17 icmp_seq=3 Destination Host Unreachable
From 192.168.1.17 icmp_seq=4 Destination Host Unreachable
From 192.168.1.17 icmp_seq=5 Destination Host Unreachable
From 192.168.1.17 icmp_seq=6 Destination Host Unreachable
From 192.168.1.17 icmp_seq=7 Destination Host Unreachable
From 192.168.1.17 icmp_seq=8 Destination Host Unreachable
From 192.168.1.17 icmp_seq=9 Destination Host Unreachable
From 192.168.1.17 icmp_seq=10 Destination Host Unreachable
From 192.168.1.17 icmp_seq=11 Destination Host Unreachable
From 192.168.1.17 icmp_seq=12 Destination Host Unreachable
From 192.168.1.17 icmp_seq=13 Destination Host Unreachable
From 192.168.1.17 icmp_seq=14 Destination Host Unreachable
From 192.168.1.17 icmp_seq=15 Destination Host Unreachable
From 192.168.1.17 icmp_seq=16 Destination Host Unreachable
From 192.168.1.17 icmp_seq=17 Destination Host Unreachable
From 192.168.1.17 icmp_seq=18 Destination Host Unreachable
From 192.168.1.17 icmp_seq=19 Destination Host Unreachable
From 192.168.1.17 icmp_seq=20 Destination Host Unreachable

--- 192.168.1.254 ping statistics ---
20 packets transmitted, 0 received, +20 errors, 100% packet loss, time 19003ms

Comment 2 Hangbin Liu 2016-09-01 08:41:20 UTC
Hi Amit,

I can reproduce this issue on my side now. But after keep pinging remote. we can ping success after about 50s. e.g.

[root@wsfd-netdev50 ~]# sleep 10 ; ping 192.168.100.2
PING 192.168.100.2 (192.168.100.2) 56(84) bytes of data.
64 bytes from 192.168.100.2: icmp_seq=47 ttl=64 time=0.071 ms
64 bytes from 192.168.100.2: icmp_seq=48 ttl=64 time=0.047 ms
64 bytes from 192.168.100.2: icmp_seq=49 ttl=64 time=0.062 ms
64 bytes from 192.168.100.2: icmp_seq=50 ttl=64 time=0.063 ms
64 bytes from 192.168.100.2: icmp_seq=51 ttl=64 time=0.035 ms
64 bytes from 192.168.100.2: icmp_seq=52 ttl=64 time=0.084 ms
64 bytes from 192.168.100.2: icmp_seq=53 ttl=64 time=0.047 ms

Would you please check if it the same on your side? I will also try to find the root cause.

Thanks
Hangbin

Comment 3 Hangbin Liu 2016-09-01 09:07:11 UTC
Hi Amit,

What switch you used to config lacp. I use Juniper switch. After set lacp periodic to fast and this issue gone.

{master:0}[edit]
root@switch# set interfaces ae0 aggregated-ether-options lacp periodic fast
{master:0}[edit]
root@switch# commit

[root@wsfd-netdev50 ~]# ip link set p5p1 down; sleep 10 ; ping 192.168.100.2
PING 192.168.100.2 (192.168.100.2) 56(84) bytes of data.
64 bytes from 192.168.100.2: icmp_seq=1 ttl=64 time=0.067 ms
64 bytes from 192.168.100.2: icmp_seq=2 ttl=64 time=0.054 ms
64 bytes from 192.168.100.2: icmp_seq=3 ttl=64 time=0.092 ms
64 bytes from 192.168.100.2: icmp_seq=4 ttl=64 time=0.058 ms
64 bytes from 192.168.100.2: icmp_seq=5 ttl=64 time=0.069 ms

Thanks
Hangbin

Comment 4 Amit Supugade 2016-09-01 14:34:13 UTC
Hi Hangbin,
As you pointed out, It works fine on Juniper switch and On cisco switch, ping starts working after about 50s. Thanks!

Comment 5 Hangbin Liu 2016-09-02 02:24:53 UTC
(In reply to Amit Supugade from comment #4)
> Hi Hangbin,
> As you pointed out, It works fine on Juniper switch and On cisco switch,
> ping starts working after about 50s. Thanks!

Would you please set lacp periodic to fast and try again? As I tested in comment 3. We can ping success immediately after set one slave down, no need wait for 50s.

Thanks
Hangbin

Comment 6 Amit Supugade 2016-09-12 14:02:35 UTC
Hi Hangbin,
It works fine on both cisco and juniper switch when we set 'lacp rate fast'.
Below is the log. Thanks!

LOG-
[root@sam ~]# teamd -d -t team0 -c '{ "runner" : { "name": "lacp" },  "link_watch" : { "name": "ethtool" } }'
This program is not intended to be run as root.
[root@sam ~]# teamdctl team0 port add enp7s0f0
[root@sam ~]# teamdctl team0 port add enp7s0f1
[root@sam ~]# ip link set team0 up
[root@sam ~]# pkill dhclient; sleep 3; dhclient -v team0
Internet Systems Consortium DHCP Client 4.2.5
Copyright 2004-2013 Internet Systems Consortium.
All rights reserved.
For info, please visit https://www.isc.org/software/dhcp/

Listening on LPF/team0/00:90:fa:8a:5b:fa
Sending on   LPF/team0/00:90:fa:8a:5b:fa
Sending on   Socket/fallback
DHCPREQUEST on team0 to 255.255.255.255 port 67 (xid=0x4f333c52)
DHCPREQUEST on team0 to 255.255.255.255 port 67 (xid=0x4f333c52)
DHCPDISCOVER on team0 to 255.255.255.255 port 67 interval 3 (xid=0x49881fe1)
DHCPDISCOVER on team0 to 255.255.255.255 port 67 interval 3 (xid=0x49881fe1)
DHCPDISCOVER on team0 to 255.255.255.255 port 67 interval 8 (xid=0x49881fe1)
DHCPDISCOVER on team0 to 255.255.255.255 port 67 interval 10 (xid=0x49881fe1)
DHCPDISCOVER on team0 to 255.255.255.255 port 67 interval 14 (xid=0x49881fe1)
DHCPREQUEST on team0 to 255.255.255.255 port 67 (xid=0x49881fe1)
DHCPOFFER from 192.168.1.254
DHCPACK from 192.168.1.254 (xid=0x49881fe1)
bound to 192.168.1.17 -- renewal in 43073 seconds.
[root@sam ~]# ping -c 20 192.168.1.254
PING 192.168.1.254 (192.168.1.254) 56(84) bytes of data.
64 bytes from 192.168.1.254: icmp_seq=1 ttl=64 time=1.37 ms
64 bytes from 192.168.1.254: icmp_seq=2 ttl=64 time=0.683 ms
64 bytes from 192.168.1.254: icmp_seq=3 ttl=64 time=0.854 ms
64 bytes from 192.168.1.254: icmp_seq=4 ttl=64 time=0.696 ms
64 bytes from 192.168.1.254: icmp_seq=5 ttl=64 time=0.715 ms
64 bytes from 192.168.1.254: icmp_seq=6 ttl=64 time=0.746 ms
64 bytes from 192.168.1.254: icmp_seq=7 ttl=64 time=0.683 ms
64 bytes from 192.168.1.254: icmp_seq=8 ttl=64 time=0.680 ms
64 bytes from 192.168.1.254: icmp_seq=9 ttl=64 time=0.712 ms
64 bytes from 192.168.1.254: icmp_seq=10 ttl=64 time=0.682 ms
64 bytes from 192.168.1.254: icmp_seq=11 ttl=64 time=0.692 ms
64 bytes from 192.168.1.254: icmp_seq=12 ttl=64 time=0.714 ms
64 bytes from 192.168.1.254: icmp_seq=13 ttl=64 time=0.674 ms
64 bytes from 192.168.1.254: icmp_seq=14 ttl=64 time=0.670 ms
64 bytes from 192.168.1.254: icmp_seq=15 ttl=64 time=0.704 ms
64 bytes from 192.168.1.254: icmp_seq=16 ttl=64 time=0.694 ms
64 bytes from 192.168.1.254: icmp_seq=17 ttl=64 time=0.681 ms
64 bytes from 192.168.1.254: icmp_seq=18 ttl=64 time=0.662 ms
64 bytes from 192.168.1.254: icmp_seq=19 ttl=64 time=0.691 ms
64 bytes from 192.168.1.254: icmp_seq=20 ttl=64 time=0.645 ms

--- 192.168.1.254 ping statistics ---
20 packets transmitted, 20 received, 0% packet loss, time 19001ms
rtt min/avg/max/mdev = 0.645/0.732/1.378/0.157 ms
[root@sam ~]# ip link set enp7s0f0 down
[root@sam ~]# ping 192.168.1.254
PING 192.168.1.254 (192.168.1.254) 56(84) bytes of data.
64 bytes from 192.168.1.254: icmp_seq=1 ttl=64 time=0.858 ms
64 bytes from 192.168.1.254: icmp_seq=2 ttl=64 time=0.755 ms
64 bytes from 192.168.1.254: icmp_seq=3 ttl=64 time=0.748 ms
64 bytes from 192.168.1.254: icmp_seq=4 ttl=64 time=0.843 ms
64 bytes from 192.168.1.254: icmp_seq=5 ttl=64 time=0.832 ms
64 bytes from 192.168.1.254: icmp_seq=6 ttl=64 time=0.779 ms
64 bytes from 192.168.1.254: icmp_seq=7 ttl=64 time=0.882 ms
64 bytes from 192.168.1.254: icmp_seq=8 ttl=64 time=0.839 ms
64 bytes from 192.168.1.254: icmp_seq=9 ttl=64 time=0.811 ms
64 bytes from 192.168.1.254: icmp_seq=10 ttl=64 time=0.771 ms
64 bytes from 192.168.1.254: icmp_seq=11 ttl=64 time=0.746 ms
64 bytes from 192.168.1.254: icmp_seq=12 ttl=64 time=0.821 ms
64 bytes from 192.168.1.254: icmp_seq=13 ttl=64 time=0.897 ms
64 bytes from 192.168.1.254: icmp_seq=14 ttl=64 time=0.850 ms
64 bytes from 192.168.1.254: icmp_seq=15 ttl=64 time=0.685 ms
64 bytes from 192.168.1.254: icmp_seq=16 ttl=64 time=2.37 ms
64 bytes from 192.168.1.254: icmp_seq=17 ttl=64 time=0.849 ms
64 bytes from 192.168.1.254: icmp_seq=18 ttl=64 time=0.837 ms
64 bytes from 192.168.1.254: icmp_seq=19 ttl=64 time=0.797 ms
64 bytes from 192.168.1.254: icmp_seq=20 ttl=64 time=0.810 ms
64 bytes from 192.168.1.254: icmp_seq=21 ttl=64 time=0.802 ms
64 bytes from 192.168.1.254: icmp_seq=22 ttl=64 time=0.813 ms
64 bytes from 192.168.1.254: icmp_seq=23 ttl=64 time=0.775 ms
64 bytes from 192.168.1.254: icmp_seq=24 ttl=64 time=0.814 ms
64 bytes from 192.168.1.254: icmp_seq=25 ttl=64 time=0.817 ms
64 bytes from 192.168.1.254: icmp_seq=26 ttl=64 time=0.849 ms
64 bytes from 192.168.1.254: icmp_seq=27 ttl=64 time=0.800 ms
64 bytes from 192.168.1.254: icmp_seq=28 ttl=64 time=0.764 ms
64 bytes from 192.168.1.254: icmp_seq=29 ttl=64 time=0.812 ms
64 bytes from 192.168.1.254: icmp_seq=30 ttl=64 time=0.778 ms
64 bytes from 192.168.1.254: icmp_seq=31 ttl=64 time=0.801 ms
64 bytes from 192.168.1.254: icmp_seq=32 ttl=64 time=0.816 ms
64 bytes from 192.168.1.254: icmp_seq=33 ttl=64 time=0.859 ms
64 bytes from 192.168.1.254: icmp_seq=34 ttl=64 time=0.854 ms
64 bytes from 192.168.1.254: icmp_seq=35 ttl=64 time=0.848 ms
64 bytes from 192.168.1.254: icmp_seq=36 ttl=64 time=0.812 ms
64 bytes from 192.168.1.254: icmp_seq=37 ttl=64 time=0.853 ms
64 bytes from 192.168.1.254: icmp_seq=38 ttl=64 time=2.54 ms
64 bytes from 192.168.1.254: icmp_seq=39 ttl=64 time=0.840 ms
64 bytes from 192.168.1.254: icmp_seq=40 ttl=64 time=0.827 ms
64 bytes from 192.168.1.254: icmp_seq=41 ttl=64 time=0.862 ms
64 bytes from 192.168.1.254: icmp_seq=42 ttl=64 time=0.778 ms
64 bytes from 192.168.1.254: icmp_seq=43 ttl=64 time=0.823 ms
64 bytes from 192.168.1.254: icmp_seq=44 ttl=64 time=0.761 ms
64 bytes from 192.168.1.254: icmp_seq=45 ttl=64 time=0.787 ms
64 bytes from 192.168.1.254: icmp_seq=46 ttl=64 time=0.767 ms
64 bytes from 192.168.1.254: icmp_seq=47 ttl=64 time=0.789 ms
64 bytes from 192.168.1.254: icmp_seq=48 ttl=64 time=0.786 ms
64 bytes from 192.168.1.254: icmp_seq=49 ttl=64 time=0.769 ms
64 bytes from 192.168.1.254: icmp_seq=50 ttl=64 time=0.805 ms
64 bytes from 192.168.1.254: icmp_seq=51 ttl=64 time=0.793 ms
64 bytes from 192.168.1.254: icmp_seq=52 ttl=64 time=0.777 ms
64 bytes from 192.168.1.254: icmp_seq=53 ttl=64 time=0.803 ms
64 bytes from 192.168.1.254: icmp_seq=54 ttl=64 time=0.780 ms
64 bytes from 192.168.1.254: icmp_seq=55 ttl=64 time=0.787 ms
64 bytes from 192.168.1.254: icmp_seq=56 ttl=64 time=0.754 ms
64 bytes from 192.168.1.254: icmp_seq=57 ttl=64 time=0.788 ms
64 bytes from 192.168.1.254: icmp_seq=58 ttl=64 time=0.749 ms
64 bytes from 192.168.1.254: icmp_seq=59 ttl=64 time=0.759 ms
64 bytes from 192.168.1.254: icmp_seq=60 ttl=64 time=0.818 ms
64 bytes from 192.168.1.254: icmp_seq=61 ttl=64 time=0.781 ms
64 bytes from 192.168.1.254: icmp_seq=62 ttl=64 time=0.793 ms
64 bytes from 192.168.1.254: icmp_seq=63 ttl=64 time=0.823 ms
64 bytes from 192.168.1.254: icmp_seq=64 ttl=64 time=0.784 ms
64 bytes from 192.168.1.254: icmp_seq=65 ttl=64 time=0.786 ms
64 bytes from 192.168.1.254: icmp_seq=66 ttl=64 time=0.824 ms
64 bytes from 192.168.1.254: icmp_seq=67 ttl=64 time=0.809 ms
64 bytes from 192.168.1.254: icmp_seq=68 ttl=64 time=0.788 ms
64 bytes from 192.168.1.254: icmp_seq=69 ttl=64 time=0.697 ms
64 bytes from 192.168.1.254: icmp_seq=70 ttl=64 time=0.788 ms
64 bytes from 192.168.1.254: icmp_seq=71 ttl=64 time=0.782 ms
64 bytes from 192.168.1.254: icmp_seq=72 ttl=64 time=0.702 ms
64 bytes from 192.168.1.254: icmp_seq=73 ttl=64 time=0.984 ms
64 bytes from 192.168.1.254: icmp_seq=74 ttl=64 time=0.849 ms
64 bytes from 192.168.1.254: icmp_seq=75 ttl=64 time=0.799 ms
64 bytes from 192.168.1.254: icmp_seq=76 ttl=64 time=2.56 ms
64 bytes from 192.168.1.254: icmp_seq=77 ttl=64 time=0.821 ms
64 bytes from 192.168.1.254: icmp_seq=78 ttl=64 time=1.30 ms
64 bytes from 192.168.1.254: icmp_seq=79 ttl=64 time=0.893 ms
64 bytes from 192.168.1.254: icmp_seq=80 ttl=64 time=0.818 ms
64 bytes from 192.168.1.254: icmp_seq=81 ttl=64 time=0.884 ms
64 bytes from 192.168.1.254: icmp_seq=82 ttl=64 time=0.850 ms
64 bytes from 192.168.1.254: icmp_seq=83 ttl=64 time=1.81 ms
64 bytes from 192.168.1.254: icmp_seq=84 ttl=64 time=0.749 ms
64 bytes from 192.168.1.254: icmp_seq=85 ttl=64 time=0.952 ms
64 bytes from 192.168.1.254: icmp_seq=86 ttl=64 time=0.969 ms
64 bytes from 192.168.1.254: icmp_seq=87 ttl=64 time=0.837 ms
64 bytes from 192.168.1.254: icmp_seq=88 ttl=64 time=0.870 ms
64 bytes from 192.168.1.254: icmp_seq=89 ttl=64 time=0.865 ms
64 bytes from 192.168.1.254: icmp_seq=90 ttl=64 time=0.904 ms
64 bytes from 192.168.1.254: icmp_seq=91 ttl=64 time=1.01 ms
64 bytes from 192.168.1.254: icmp_seq=92 ttl=64 time=1.90 ms
64 bytes from 192.168.1.254: icmp_seq=93 ttl=64 time=0.945 ms
64 bytes from 192.168.1.254: icmp_seq=94 ttl=64 time=0.890 ms
64 bytes from 192.168.1.254: icmp_seq=95 ttl=64 time=0.759 ms
64 bytes from 192.168.1.254: icmp_seq=96 ttl=64 time=0.867 ms
64 bytes from 192.168.1.254: icmp_seq=97 ttl=64 time=0.828 ms
64 bytes from 192.168.1.254: icmp_seq=98 ttl=64 time=0.849 ms
64 bytes from 192.168.1.254: icmp_seq=99 ttl=64 time=0.738 ms
64 bytes from 192.168.1.254: icmp_seq=100 ttl=64 time=0.823 ms
64 bytes from 192.168.1.254: icmp_seq=101 ttl=64 time=0.780 ms
64 bytes from 192.168.1.254: icmp_seq=102 ttl=64 time=0.932 ms
^C64 bytes from 192.168.1.254: icmp_seq=103 ttl=64 time=0.834 ms
64 bytes from 192.168.1.254: icmp_seq=104 ttl=64 time=0.869 ms
^C
--- 192.168.1.254 ping statistics ---
104 packets transmitted, 104 received, 0% packet loss, time 103057ms
rtt min/avg/max/mdev = 0.685/0.891/2.560/0.320 ms
[root@sam ~]# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN qlen 1
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: enp7s0f0: <BROADCAST,MULTICAST> mtu 1500 qdisc mq master team0 state DOWN qlen 1000
    link/ether 00:90:fa:8a:5b:fa brd ff:ff:ff:ff:ff:ff
3: enp7s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master team0 state UP qlen 1000
    link/ether 00:90:fa:8a:5b:fa brd ff:ff:ff:ff:ff:ff
4: enp5s0f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
    link/ether e4:11:5b:dd:e6:6c brd ff:ff:ff:ff:ff:ff
    inet 10.19.15.26/24 brd 10.19.15.255 scope global dynamic enp5s0f0
       valid_lft 86243sec preferred_lft 86243sec
    inet6 2620:52:0:130b:e611:5bff:fedd:e66c/64 scope global noprefixroute dynamic 
       valid_lft 2591825sec preferred_lft 604625sec
    inet6 fe80::e611:5bff:fedd:e66c/64 scope link 
       valid_lft forever preferred_lft forever
5: enp5s0f1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN qlen 1000
    link/ether e4:11:5b:dd:e6:6d brd ff:ff:ff:ff:ff:ff
8: team0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP qlen 1000
    link/ether 00:90:fa:8a:5b:fa brd ff:ff:ff:ff:ff:ff
    inet 192.168.1.17/24 brd 192.168.1.255 scope global dynamic team0
       valid_lft 86167sec preferred_lft 86167sec
    inet6 fe80::290:faff:fe8a:5bfa/64 scope link 
       valid_lft forever preferred_lft forever
[root@sam ~]#

Comment 7 Hangbin Liu 2016-09-13 06:21:43 UTC
(In reply to Amit Supugade from comment #6)
> Hi Hangbin,
> It works fine on both cisco and juniper switch when we set 'lacp rate fast'.
> Below is the log. Thanks!

Cool, thanks. Then close this bug as NOTABUG.