Xenial: igb based interfaces show links down until ip created on it

Asked by squirL

Hi!
I have a lot of servers with different Intel NIC, based on igb or igbxe drivers. I tried to install Ubuntu 16.04 on servers and have met strange issue:
ethtool shows all links are down even if ones are up at the switch side. But when i set an ip address for interface with ifconfig, link automatically goes up.

When i configure interface via /etc/network/interfaces and reboot my server, interface goes up, but with big delay. This delay causes next problems:
- IP address sets up but default gateway setting doesn't applies.
- bond interface created with all slaves down
- bridge interfaces doesn't create at all

in dmesg it looks like:
   24.732124] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[ 24.732126] 8021q: adding VLAN 0 to HW filter on device eth0
[ 24.935858] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[ 24.935859] 8021q: adding VLAN 0 to HW filter on device eth1
[ 24.936114] bonding: lacp0 is being created...
[ 24.966332] IPv6: ADDRCONF(NETDEV_UP): lacp0: link is not ready
[ 24.966333] 8021q: adding VLAN 0 to HW filter on device lacp0
[ 25.051025] IPv6: ADDRCONF(NETDEV_UP): lacp0.20: link is not ready
[ 25.180483] cgroup: new mount options do not match the existing superblock, will be ignored
[ 25.622024] IPv6: ADDRCONF(NETDEV_UP): lacp0.10: link is not ready
[ 25.652135] lacp0: Setting MII monitoring interval to 100
[ 25.655977] lacp0: Setting LACP rate to fast (1)
[ 25.656374] IPv6: ADDRCONF(NETDEV_UP): lacp0: link is not ready
[ 25.656376] 8021q: adding VLAN 0 to HW filter on device lacp0
[ 25.656385] IPv6: ADDRCONF(NETDEV_UP): lacp0.10: link is not ready
[ 25.656416] IPv6: ADDRCONF(NETDEV_UP): lacp0.20: link is not ready
[ 25.914998] lacp0: Adding slave eth0
[ 26.119856] 8021q: adding VLAN 0 to HW filter on device eth0
[ 26.120423] lacp0: Enslaving eth0 as a backup interface with a down link
[ 26.120589] lacp0: Adding slave eth2
[ 26.280453] ip_tables: (C) 2000-2006 Netfilter Core Team
[ 26.323642] 8021q: adding VLAN 0 to HW filter on device eth2
[ 26.323947] lacp0: Enslaving eth2 as a backup interface with a down link
[ 28.165395] igb 0000:01:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[ 28.220901] lacp0: link status definitely up for interface eth0, 1000 Mbps full duplex
[ 28.220908] lacp0: now running without any active interface!
[ 28.221024] IPv6: ADDRCONF(NETDEV_CHANGE): lacp0: link becomes ready
[ 28.221748] IPv6: ADDRCONF(NETDEV_CHANGE): lacp0.10: link becomes ready
[ 28.222353] IPv6: ADDRCONF(NETDEV_CHANGE): lacp0.20: link becomes ready
[ 28.921450] igb 0000:07:00.0 eth2: igb: eth2 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[ 29.020999] lacp0: link status definitely up for interface eth2, 1000 Mbps full duplex

# ethtool -i eth0
driver: igb
version: 5.3.0-k
firmware-version: 2.0.0
expansion-rom-version:
bus-info: 0000:01:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: no

Ethernet adapter:
01:00.1 Ethernet controller: Intel Corporation 82575EB Gigabit Network Connection (rev 02)
        Subsystem: Oracle/SUN 82575EB Gigabit Network Connection
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 256 bytes
        Interrupt: pin B routed to IRQ 35
        Region 0: Memory at faee0000 (32-bit, non-prefetchable) [size=128K]
        Region 1: Memory at faec0000 (32-bit, non-prefetchable) [size=128K]
        Region 2: I/O ports at cc00 [size=32]
        Region 3: Memory at faebc000 (32-bit, non-prefetchable) [size=16K]
        Expansion ROM at fae80000 [disabled] [size=128K]
        Capabilities: [40] Power Management version 2
                Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
        Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
                Address: 0000000000000000 Data: 0000
        Capabilities: [60] MSI-X: Enable+ Count=10 Masked-
                Vector table: BAR=3 offset=00000000
                PBA: BAR=3 offset=00002000
        Capabilities: [a0] Express (v2) Endpoint, MSI 00
                DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
                        ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
                DevCtl: Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
                        RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
                LnkCap: Port #0, Speed 2.5GT/s, Width x2, ASPM L0s L1, Exit Latency L0s <4us, L1 <64us
                        ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp-
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk-
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x2, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, LTR-, OBFF Not Supported
                DevCtl2: Completion Timeout: 16ms to 55ms, TimeoutDis-, LTR-, OBFF Disabled
                LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
                         EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
        Capabilities: [100 v1] Advanced Error Reporting
                UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
                UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
                UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
                AERCap: First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
        Capabilities: [140 v1] Device Serial Number 00-21-28-ff-ff-8e-7a-e8
        Kernel driver in use: igb
        Kernel modules: igb

/etc/network/interfaces
auto lo
iface lo inet loopback

auto eth0
iface eth0 inet manual
bond-master lacp0

auto eth2
iface eth2 inet manual
bond-master lacp0

auto lacp0
iface lacp0 inet manual
bond-mode 4
bond-miimon 100
bond-lacp-rate 1
bond-slaves eth0 eth2

auto lacp0.20
iface lacp0.20 inet static
vlan-raw-device lacp0
address 10.0.0.5
netmask 255.255.255.0
gateway 10.0.0.1
dns-nameservers 10.0.0.2 10.0.0.3

auto lacp0.10
iface lacp0.10 inet manual
vlan-raw-device lacp0

auto br0
iface br0 inet manual
bridger_ports lacp0.10
bridge_maxwait 10
bridge_stp off

------
any suggestion?

Question information

Language:
English Edit question
Status:
Expired
For:
Ubuntu Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:
Revision history for this message
Launchpad Janitor (janitor) said :
#1

This question was expired because it remained in the 'Open' state without activity for the last 15 days.