Grizzly + Multinode with Quantum: VMs not getting IP

Asked by novelkumar

Hi,

I have the following setup of Grizzly:

Controller : eth0, eth1
Network: eth0,eth1,eth2
Compute: eth0,eth1,eth2

I am following https://github.com/mseknibilel/OpenStack-Grizzly-Install-Guide/blob/OVS_MultiNode/OpenStack_Grizzly_Install_Guide.rst and installed the setup without any errors or issues.

When i create a VM using command ' nova boot --image Ubuntu --flavor m1.small testnova ', its does not get an IP assigned.

Contoller node:

# ifconfig
eth0 Link encap:Ethernet HWaddr ac:16:2d:72:0c:98
          inet addr:192.168.124.81 Bcast:192.168.124.255 Mask:255.255.255.0
          inet6 addr: fe80::ae16:2dff:fe72:c98/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:222288 errors:0 dropped:0 overruns:0 frame:0
          TX packets:166563 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:34123177 (34.1 MB) TX bytes:26737964 (26.7 MB)
          Interrupt:32

eth1 Link encap:Ethernet HWaddr ac:16:2d:72:0c:99
          inet addr:10.1.62.1 Bcast:10.1.63.255 Mask:255.255.192.0
          inet6 addr: fe80::ae16:2dff:fe72:c99/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:49563 errors:0 dropped:0 overruns:0 frame:0
          TX packets:3750 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:11015119 (11.0 MB) TX bytes:760044 (760.0 KB)
          Interrupt:36

# route -n
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use Iface
0.0.0.0 10.1.0.10 0.0.0.0 UG 1 0 0 eth1
0.0.0.0 192.168.124.1 0.0.0.0 UG 2 0 0 eth0
10.1.0.0 0.0.0.0 255.255.192.0 U 0 0 0 eth1
192.168.124.0 0.0.0.0 255.255.255.0 U 0 0 0 eth0
root@controller:/var/log/nova#

# cat /etc/network/interfaces
# This file describes the network interfaces available on your system
# and how to activate them. For more information, see interfaces(5).

# The loopback network interface
auto lo
iface lo inet loopback

#Openstack Management Interface
auto eth0
iface eth0 inet static
address 192.168.124.81
netmask 255.255.255.0
post-up route add default gw 192.168.124.1 metric 2
pre-down route del default gw 192.168.124.1

# The primary network interface
auto eth1
iface eth1 inet static
address 10.1.62.1
netmask 255.255.192.0
post-up route add default gw 10.1.0.10 metric 1
pre-down route del default gw 10.1.0.10

Network Node:

~# ifconfig
eth0 Link encap:Ethernet HWaddr ac:16:2d:72:0f:48
          inet addr:192.168.124.82 Bcast:192.168.124.255 Mask:255.255.255.0
          inet6 addr: fe80::ae16:2dff:fe72:f48/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:52359 errors:0 dropped:0 overruns:0 frame:0
          TX packets:69016 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:7890567 (7.8 MB) TX bytes:9983446 (9.9 MB)
          Interrupt:32

eth1 Link encap:Ethernet HWaddr ac:16:2d:72:0f:49
          inet6 addr: fe80::ae16:2dff:fe72:f49/64 Scope:Link
          UP BROADCAST RUNNING PROMISC MULTICAST MTU:1500 Metric:1
          RX packets:18447 errors:0 dropped:22 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:4360262 (4.3 MB) TX bytes:492 (492.0 B)
          Interrupt:36

eth2 Link encap:Ethernet HWaddr ac:16:2d:72:0f:4a
          inet addr:10.20.20.52 Bcast:10.20.20.255 Mask:255.255.255.0
          inet6 addr: fe80::ae16:2dff:fe72:f4a/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:244 errors:0 dropped:0 overruns:0 frame:0
          TX packets:18 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:41266 (41.2 KB) TX bytes:1700 (1.7 KB)
          Interrupt:32

# route -n
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use Iface
0.0.0.0 192.168.124.1 0.0.0.0 UG 2 0 0 eth0
10.20.20.0 0.0.0.0 255.255.255.0 U 0 0 0 eth2
192.168.124.0 0.0.0.0 255.255.255.0 U 0 0 0 eth0

# cat /etc/network/interfaces
# This file describes the network interfaces available on your system
# and how to activate them. For more information, see interfaces(5).

# The loopback network interface
auto lo
iface lo inet loopback

#Openstack Management Interface
auto eth0
iface eth0 inet static
address 192.168.124.82
netmask 255.255.255.0
post-up route add default gw 192.168.124.1 metric 2
post-down route del default gw 192.168.124.1

#VM internet interface
#auto eth1
#iface eth1 inet static
#address 10.1.62.2
#netmask 255.255.192.0
#post-up route add default gw 10.1.0.10 metric 1
#post-down route del default gw 10.1.0.10

#VM data Network
auto eth2
iface eth2 inet static
address 10.20.20.52
netmask 255.255.255.0

auto eth1
iface eth1 inet manual
up ifconfig $IFACE 0.0.0.0 up
up ip link set $IFACE promisc on
down ip link set $IFACE promisc off
down ifconfig $IFACE down

# ovs-vsctl show
e67977d5-e1d3-41c5-b887-0d96fc3b6a2a
    Bridge br-int
        Port "qr-362ffad5-1e"
            tag: 1
            Interface "qr-362ffad5-1e"
                type: internal
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
        Port br-int
            Interface br-int
                type: internal
        Port "tap8742e677-f3"
            tag: 1
            Interface "tap8742e677-f3"
                type: internal
    Bridge br-ex
        Port br-ex
            Interface br-ex
                type: internal
        Port "eth1"
            Interface "eth1"
    Bridge br-tun
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port br-tun
            Interface br-tun
                type: internal
        Port "gre-2"
            Interface "gre-2"
                type: gre
                options: {in_key=flow, out_key=flow, remote_ip="10.20.20.53"}
        Port "gre-1"
            Interface "gre-1"
                type: gre
                options: {in_key=flow, out_key=flow, remote_ip="192.168.124.82"}
    ovs_version: "1.4.0+build0"

Compute Node:

# ifconfig
eth0 Link encap:Ethernet HWaddr ac:16:2d:71:4f:d8
          inet addr:192.168.124.83 Bcast:192.168.124.255 Mask:255.255.255.0
          inet6 addr: fe80::ae16:2dff:fe71:4fd8/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:16378 errors:0 dropped:0 overruns:0 frame:0
          TX packets:21042 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:3339611 (3.3 MB) TX bytes:3646942 (3.6 MB)
          Interrupt:32

eth1 Link encap:Ethernet HWaddr ac:16:2d:71:4f:d9
          inet addr:10.1.62.3 Bcast:10.1.63.255 Mask:255.255.192.0
          inet6 addr: fe80::ae16:2dff:fe71:4fd9/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:13104 errors:0 dropped:0 overruns:0 frame:0
          TX packets:551 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:2995567 (2.9 MB) TX bytes:80972 (80.9 KB)
          Interrupt:36

eth2 Link encap:Ethernet HWaddr ac:16:2d:71:4f:da
          inet addr:10.20.20.53 Bcast:10.20.20.255 Mask:255.255.255.0
          inet6 addr: fe80::ae16:2dff:fe71:4fda/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:160 errors:0 dropped:0 overruns:0 frame:0
          TX packets:11 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:27340 (27.3 KB) TX bytes:1036 (1.0 KB)
          Interrupt:32

~# route -n
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use Iface
0.0.0.0 10.1.0.10 0.0.0.0 UG 1 0 0 eth1
0.0.0.0 192.168.124.1 0.0.0.0 UG 2 0 0 eth0
10.1.0.0 0.0.0.0 255.255.192.0 U 0 0 0 eth1
10.20.20.0 0.0.0.0 255.255.255.0 U 0 0 0 eth2
192.168.124.0 0.0.0.0 255.255.255.0 U 0 0 0 eth0

# cat /etc/network/interfaces
# This file describes the network interfaces available on your system
# and how to activate them. For more information, see interfaces(5).

# The loopback network interface
auto lo
iface lo inet loopback

#Openstack Management Interface
auto eth0
iface eth0 inet static
address 192.168.124.83
netmask 255.255.255.0
post-up route add default gw 192.168.124.1 metric 2
pre-down route del default gw 192.168.124.1

# The primary network interface
auto eth1
iface eth1 inet static
address 10.1.62.3
netmask 255.255.192.0
post-up route add default gw 10.1.0.10 metric 1
pre-down route del default gw 10.1.0.10

auto eth2
iface eth2 inet static
address 10.20.20.53
netmask 255.255.255.0
post-up route add default gw 192.168.124.1 metric 2
pre-down route del default gw 192.168.124.1

# ovs-vsctl show
88e9142a-41e6-40df-b22d-57c8c92ea761
    Bridge br-int
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
        Port br-int
            Interface br-int
                type: internal
    Bridge br-tun
        Port "gre-1"
            Interface "gre-1"
                type: gre
                options: {in_key=flow, out_key=flow, remote_ip="192.168.124.82"}
        Port "gre-3"
            Interface "gre-3"
                type: gre
                options: {in_key=flow, out_key=flow, remote_ip="10.20.20.52"}
        Port br-tun
            Interface br-tun
                type: internal
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
    ovs_version: "1.4.0+build0"

The console log to VM shows :

done.
done.
Begin: Running /scripts/initbottom ... done.
[ 1.801532] EXT4fs (vda1): remounted. Opts: (null)
cloudinit startlocal running: Mon, 22 Apr 2013 12:47:38 +0000. up 2.95 seconds
no instance data found in startlocal
cloudinitnonet waiting 120 seconds for a network device.
cloudinitnonet gave up waiting for a network device.
ciinfo: lo : 1 127.0.0.1 255.0.0.0 .
route_info failed
 * Stopping Handle applying cloudconfig[74G[ OK ]
Waiting for network configuration...
Waiting up to 60 more seconds for network configuration...
Booting system without full network configuration...
 * Stopping Failsafe Boot Delay[74G[ OK ]
 * Starting System V initialisation compatibility[74G[ OK ]
Skipping profile in /etc/apparmor.d/disable: usr.sbin.rsyslogd
 * Starting AppArmor profiles [80G [74G[ OK ]
landscapeclient is not configured, please run landscapeconfig.
 * Stopping System V initialisation compatibility[74G[ OK ]
 * Starting System V runlevel compatibility[74G[ OK ]
 * Starting ACPI daemon[74G[ OK ]
 * Starting save kernel messages[74G[ OK ]
 * Starting regular background program processing daemon[74G[ OK ]
 * Starting deferred execution scheduler[74G[ OK ]
 * Starting CPU interrupts balancing daemon[74G[ OK ]
 * Starting automatic crash report generation[74G[ OK ]
 * Stopping save kernel messages[74G[ OK ]
 * Stopping System V runlevel compatibility[74G[ OK ]
 * Starting execute cloud user/final scripts[74G[ OK ]

Please help me to troubleshoot this issue...

--Novel

Question information

Language:
English Edit question
Status:
Solved
For:
OpenStack DevOps Edit question
Assignee:
No assignee Edit question
Solved by:
novelkumar
Solved:
Last query:
Last reply:
Revision history for this message
novelkumar (novel-kumar) said :
#1

Please ignore the question.. I am re-configuring the same setup with three node and 2 networks...