neutron

quantum network node cannot ping anything after bridges configured using ovs-vsctl

Asked by digitalwonk

Hi there,

I have been using the following resources for configuring openstack:

https://github.com/mseknibilel/OpenStack-Folsom-Install-guide/blob/master/OpenStack_Folsom_Install_Guide_WebVersion.rst
http://docs.openstack.org/trunk/openstack-network/admin/content/install_ubuntu.html

Here are the results in of my interfaces as it stands (ifconfig -a):

br-eth3 Link encap:Ethernet HWaddr d4:85:64:30:40:14
          BROADCAST MULTICAST MTU:1500 Metric:1
          RX packets:6 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:360 (360.0 B) TX bytes:0 (0.0 B)

br-ex Link encap:Ethernet HWaddr d4:85:64:30:40:10
          BROADCAST MULTICAST MTU:1500 Metric:1
          RX packets:164407 errors:0 dropped:10462 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:19379008 (19.3 MB) TX bytes:0 (0.0 B)

br-int Link encap:Ethernet HWaddr 02:91:ea:a3:39:4c
          BROADCAST MULTICAST MTU:1500 Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

eth0 Link encap:Ethernet HWaddr e4:11:5b:e6:56:ae
          inet addr:10.140.65.64 Bcast:10.140.65.255 Mask:255.255.255.0
          inet6 addr: fe80::e611:5bff:fee6:56ae/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:144732 errors:0 dropped:78210 overruns:0 frame:0
          TX packets:6759 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:24574621 (24.5 MB) TX bytes:842415 (842.4 KB)
          Memory:f5f60000-f5f80000

eth1 Link encap:Ethernet HWaddr d4:85:64:30:40:10
          inet addr:10.140.65.63 Bcast:10.140.65.255 Mask:255.255.255.0
          inet6 addr: fe80::d685:64ff:fe30:4010/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:281705 errors:0 dropped:67743 overruns:0 frame:0
          TX packets:9 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:37442048 (37.4 MB) TX bytes:594 (594.0 B)
          Interrupt:89

eth2 Link encap:Ethernet HWaddr e4:11:5b:e6:56:af
          BROADCAST MULTICAST MTU:1500 Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:10000
          RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
          Memory:f5fe0000-f6000000

eth3 Link encap:Ethernet HWaddr d4:85:64:30:40:14
          inet addr:192.168.65.64 Bcast:192.168.255.255 Mask:255.255.0.0
          inet6 addr: fe80::d685:64ff:fe30:4014/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:9000 Metric:1
          RX packets:3773 errors:0 dropped:0 overruns:0 frame:0
          TX packets:16 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:245491 (245.4 KB) TX bytes:1000 (1000.0 B)
          Interrupt:93

int-br-eth3 Link encap:Ethernet HWaddr a6:0a:f6:3f:bc:33
          inet6 addr: fe80::a40a:f6ff:fe3f:bc33/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:12 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:828 (828.0 B) TX bytes:468 (468.0 B)

lo Link encap:Local Loopback
          inet addr:127.0.0.1 Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING MTU:16436 Metric:1
          RX packets:72 errors:0 dropped:0 overruns:0 frame:0
          TX packets:72 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:5662 (5.6 KB) TX bytes:5662 (5.6 KB)

phy-br-eth3 Link encap:Ethernet HWaddr 42:1a:99:26:fe:4b
          inet6 addr: fe80::401a:99ff:fe26:fe4b/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:6 errors:0 dropped:0 overruns:0 frame:0
          TX packets:12 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:468 (468.0 B) TX bytes:828 (828.0 B)

Here are my current routes (route -n):

Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use Iface
0.0.0.0 10.140.65.1 0.0.0.0 UG 100 0 0 eth0
10.140.65.0 0.0.0.0 255.255.255.0 U 0 0 0 eth1
10.140.65.0 0.0.0.0 255.255.255.0 U 0 0 0 eth0
192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 eth3

And here's what is seen via 'ovs-vsctl show':

7b234c2e-965c-47f9-96de-f684682ff308
    Bridge "br-eth3"
        Port "eth3"
            Interface "eth3"
        Port "br-eth3"
            Interface "br-eth3"
                type: internal
        Port "phy-br-eth3"
            Interface "phy-br-eth3"
    Bridge br-int
        Port br-int
            Interface br-int
                type: internal
        Port "int-br-eth3"
            Interface "int-br-eth3"
    Bridge br-ex
        Port br-ex
            Interface br-ex
                type: internal
        Port "eth1"
            Interface "eth1"
    ovs_version: "1.4.0+build0"

After configuring my bridges and ports, I cannot ping the node controller, either on the 10.x network on eth0 or the 192.x network on br-eth3 on eth3. eth1 should be the external network.

Thank you,
Edwin

Question information

Language:
English Edit question
Status:
Solved
For:
neutron Edit question
Assignee:
No assignee Edit question
Solved by:
Aaron Rosen
Solved:
Last query:
Last reply:
Revision history for this message
Best Aaron Rosen (arosen) said : 		#1

From the output of ifconfig I see that you have the ip addresses on the interfaces these should be on the bridges. For example,

eth3 Link encap:Ethernet HWaddr d4:85:64:30:40:14
          inet addr:192.168.65.64 Bcast:192.168.255.255 Mask:255.255.0.0
Should be on:
br-eth3 Link encap:Ethernet HWaddr d4:85:64:30:40:14
          BROADCAST MULTICAST MTU:1500 Metric:1

If you run the following that should help correct this:

ifconfig eth3 0.0.0.0;
ifconfig br-eth3 192.168.65.64/16;
(Same with eth1)

I'm not sure if this is what is causing your issue but this is definitely an issue... let us know if you still have the same issue after making those changes.

Revision history for this message
digitalwonk (digitalwonk) said : 		#2

I set eth1 and eth3 to 0.0.0.0 and then set the IPs on br-eth3 and br-ex as per your instructions and now I can ping ips on the respective networks again.

Thank you!
Edwin

Revision history for this message
digitalwonk (digitalwonk) said : 		#3

Thanks Aaron Rosen, that solved my question.