unable to connect multiple nics

Asked by todd on 2017-03-20

I am using nova-lxd (deployed through conjure-up) on Ubuntu 16.04 ppc64le (after the deployment I updated nova-lxd from source to capture a config-drive fix). I can deploy single nic instances through openstack and nova cli just fine. However, when I attempt to deploy an instance connected to two networks, I am unable to bring up a new network interface to connect to the second network...I get the following error after adding the eth1 config and running eth1 up:

Cannot find device "eth1"
Error getting hardware address for "eth1": No such device

I see lines like the followin in dmesg:

[211992.226401] eth1: renamed from vethKH9XYD
[213534.170157] eth1: renamed from vethJQSWNT
[214691.911696] eth1: renamed from veth5ULLLR
[214750.991335] eth1: renamed from vethO27EMV
[215786.633686] eth1: renamed from veth91JN5S
[215816.666258] eth1: renamed from vethQJRL34
[219408.490574] eth1: renamed from vethXI9ED4

Additionally, while directly using LXD - I am able to add an additional device (eth1) in the default lxd profile (`lxc profile edit default`) on the nova-compute host and then launch (`lxc launch`). The new container will have two nics.

I am using the following versions:

lxd version: 2.0.9
nova-lxd version: 15.0.0ish (build from latest checkin on 17 March)
nova: 7.1.0
neutron: 4.1.1

I am using the following image:

https://cloud-images.ubuntu.com/xenial/current/xenial-server-cloudimg-ppc64el-root.tar.gz

Thank you for any help you can offer and I apologize if this question was asked to the wrong folks.

Question information

Language:
English Edit question
Status:
Answered
For:
Ubuntu nova-lxd Edit question
Assignee:
No assignee Edit question
Last query:
2017-03-20
Last reply:
2017-03-20

With 2 NICs, what is the output of:

sudo lshw -C network

Thanks

todd (togofish) said : #2

  *-network:0
       description: Ethernet controller
       product: NetXtreme II BCM57800 1/10 Gigabit Ethernet
       vendor: Broadcom Corporation
       physical id: 0
       bus info: pci@0001:01:00.0
       version: 10
       width: 64 bits
       clock: 33MHz
       capabilities: bus_master cap_list rom
       configuration: driver=bnx2x latency=0
       resources: iomemory:21000-20fff iomemory:21000-20fff iomemory:21000-20fff irq:493 memory:210000000000-2100007fffff memory:210000800000-210000ffffff memory:210004000000-21000400ffff memory:3fe080000000-3fe08003ffff
  *-network:1
       description: Ethernet controller
       product: NetXtreme II BCM57800 1/10 Gigabit Ethernet
       vendor: Broadcom Corporation
       physical id: 0.1
       bus info: pci@0001:01:00.1
       version: 10
       width: 64 bits
       clock: 33MHz
       capabilities: bus_master cap_list rom
       configuration: driver=bnx2x latency=0
       resources: iomemory:21000-20fff iomemory:21000-20fff iomemory:21000-20fff irq:494 memory:210001000000-2100017fffff memory:210001800000-210001ffffff memory:210004010000-21000401ffff memory:3fe080040000-3fe08007ffff
  *-network:2
       description: Ethernet controller
       product: NetXtreme II BCM57800 1/10 Gigabit Ethernet
       vendor: Broadcom Corporation
       physical id: 0.2
       bus info: pci@0001:01:00.2
       version: 10
       width: 64 bits
       clock: 33MHz
       capabilities: bus_master cap_list rom
       configuration: driver=bnx2x latency=0
       resources: iomemory:21000-20fff iomemory:21000-20fff iomemory:21000-20fff irq:494 memory:210002000000-2100027fffff memory:210002800000-210002ffffff memory:210004020000-21000402ffff memory:3fe080080000-3fe0800bffff
  *-network:3
       description: Ethernet controller
       product: NetXtreme II BCM57800 1/10 Gigabit Ethernet
       vendor: Broadcom Corporation
       physical id: 0.3
       bus info: pci@0001:01:00.3
       version: 10
       width: 64 bits
       clock: 33MHz
       capabilities: bus_master cap_list rom
       configuration: driver=bnx2x latency=0
       resources: iomemory:21000-20fff iomemory:21000-20fff iomemory:21000-20fff irq:502 memory:210003000000-2100037fffff memory:210003800000-210003ffffff memory:210004030000-21000403ffff memory:3fe0800c0000-3fe0800fffff
  *-network
       description: Infiniband controller
       product: MT27700 Family [ConnectX-4]
       vendor: Mellanox Technologies
       physical id: 0
       bus info: pci@0008:01:00.0
       version: 00
       width: 64 bits
       clock: 33MHz
       capabilities: bus_master cap_list
       configuration: driver=mlx5_core latency=0
       resources: iomemory:24000-23fff irq:473 memory:240000000000-24001fffffff
  *-network:0
       description: Ethernet controller
       product: NetXtreme BCM5719 Gigabit Ethernet PCIe
       vendor: Broadcom Corporation
       physical id: 0
       bus info: pci@0009:07:00.0
       version: 01
       width: 64 bits
       clock: 33MHz
       capabilities: bus_master cap_list
       configuration: driver=tg3 latency=0
       resources: iomemory:25000-24fff iomemory:25000-24fff iomemory:25000-24fff irq:461 memory:250000000000-25000000ffff memory:250000010000-25000001ffff memory:250000020000-25000002ffff
  *-network:1
       description: Ethernet controller
       product: NetXtreme BCM5719 Gigabit Ethernet PCIe
       vendor: Broadcom Corporation
       physical id: 0.1
       bus info: pci@0009:07:00.1
       version: 01
       width: 64 bits
       clock: 33MHz
       capabilities: bus_master cap_list
       configuration: driver=tg3 latency=0
       resources: iomemory:25000-24fff iomemory:25000-24fff iomemory:25000-24fff irq:462 memory:250000030000-25000003ffff memory:250000040000-25000004ffff memory:250000050000-25000005ffff
  *-network:0 DISABLED
       description: Ethernet interface
       physical id: 4
       logical name: gretap0
       capabilities: ethernet physical
       configuration: broadcast=yes multicast=yes
  *-network:1
       description: Ethernet interface
       physical id: 5
       logical name: eth0
       serial: fa:16:3e:2a:f9:42
       size: 10Gbit/s
       capabilities: ethernet physical
       configuration: autonegotiation=off broadcast=yes driver=veth driverversion=1.0 duplex=full ip=10.101.0.115 link=yes multicast=yes port=twisted pair speed=10Gbit/s

Seems to be called gretap0 and not eth1

Can you help with this problem?

Provide an answer of your own, or ask todd for more information if necessary.

To post a message you must log in.