OpenStack Compute (nova)

All in one setup with one NIC , can not ARP with Instance.

Asked by wonderzou

Hi All:
    i have struggled for several days, i still work it out.

the problem is that , i install all components on one machine, but i can not ping or ARP with instance from the management node.
here are the outputs of some information:

network node:

br100 Link encap:Ethernet HWaddr 00:1a:a0:37:f1:b8
          inet addr:10.145.4.228 Bcast:10.140.4.255 Mask:255.255.255.0
          inet6 addr: fe80::21a:a0ff:fe37:f1b8/64 Scope:Link
          UP BROADCAST RUNNING PROMISC MULTICAST MTU:1500 Metric:1
          RX packets:19232947 errors:0 dropped:0 overruns:0 frame:0
          TX packets:1547121 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:1899170621 (1.8 GB) TX bytes:337463858 (337.4 MB)

eth0 Link encap:Ethernet HWaddr 00:1a:a0:37:f1:b8
          inet6 addr: fe80::21a:a0ff:fe37:f1b8/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:19406487 errors:0 dropped:0 overruns:0 frame:0
          TX packets:1598705 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:2285933714 (2.2 GB) TX bytes:347280878 (347.2 MB)
          Interrupt:17

lo Link encap:Local Loopback
          inet addr:127.0.0.1 Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING MTU:16436 Metric:1
          RX packets:466065364 errors:0 dropped:0 overruns:0 frame:0
          TX packets:466065364 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:52332930574 (52.3 GB) TX bytes:52332930574 (52.3 GB)

virbr0 Link encap:Ethernet HWaddr fa:aa:f2:f9:83:0e
          inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:36213 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B) TX bytes:1690951 (1.6 MB)

vnet0 Link encap:Ethernet HWaddr fe:16:3e:75:cd:7a
          inet6 addr: fe80::fc16:3eff:fe75:cd7a/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:28757 errors:0 dropped:0 overruns:0 frame:0
          TX packets:10045979 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500
          RX bytes:2169394 (2.1 MB) TX bytes:891264366 (891.2 MB)

# Generated by iptables-save v1.4.10 on Mon Oct 17 13:05:15 2011
*nat
:PREROUTING ACCEPT [1249600:117989383]
:INPUT ACCEPT [7036:327494]
:OUTPUT ACCEPT [51997:9641255]
:POSTROUTING ACCEPT [323984:43428355]
:nova-compute-OUTPUT - [0:0]
:nova-compute-POSTROUTING - [0:0]
:nova-compute-PREROUTING - [0:0]
:nova-compute-floating-snat - [0:0]
:nova-compute-snat - [0:0]
:nova-postrouting-bottom - [0:0]
-A PREROUTING -j nova-compute-PREROUTING
-A PREROUTING -d 169.254.169.254/32 -p tcp -m tcp --dport 80 -j DNAT --to-destination 10.140.4.228:8773
-A OUTPUT -j nova-compute-OUTPUT
-A POSTROUTING -j nova-compute-POSTROUTING
-A POSTROUTING -s 192.168.122.0/24 ! -d 192.168.122.0/24 -p tcp -j MASQUERADE --to-ports 1024-65535
-A POSTROUTING -s 192.168.122.0/24 ! -d 192.168.122.0/24 -p udp -j MASQUERADE --to-ports 1024-65535
-A POSTROUTING -s 192.168.122.0/24 ! -d 192.168.122.0/24 -j MASQUERADE
-A POSTROUTING -j nova-postrouting-bottom
-A POSTROUTING -o eth0 -j MASQUERADE
-A nova-compute-snat -j nova-compute-floating-snat
-A nova-postrouting-bottom -j nova-compute-snat
COMMIT
# Completed on Mon Oct 17 13:05:15 2011
# Generated by iptables-save v1.4.10 on Mon Oct 17 13:05:15 2011
*mangle
:PREROUTING ACCEPT [473306768:52827038283]
:INPUT ACCEPT [466742346:52235352288]
:FORWARD ACCEPT [6155705:582111861]
:OUTPUT ACCEPT [466267757:51725574942]
:POSTROUTING ACCEPT [472491400:52309898448]
-A POSTROUTING -o virbr0 -p udp -m udp --dport 68 -j CHECKSUM --checksum-fill
COMMIT
# Completed on Mon Oct 17 13:05:15 2011
# Generated by iptables-save v1.4.10 on Mon Oct 17 13:05:15 2011
*filter
:INPUT ACCEPT [458026080:46425546056]
:FORWARD ACCEPT [4017746:456790617]
:OUTPUT ACCEPT [457726091:46145619750]
:nova-compute-FORWARD - [0:0]
:nova-compute-INPUT - [0:0]
:nova-compute-OUTPUT - [0:0]
:nova-compute-inst-14 - [0:0]
:nova-compute-local - [0:0]
:nova-compute-provider - [0:0]
:nova-compute-sg-fallback - [0:0]
:nova-filter-top - [0:0]
-A INPUT -j nova-compute-INPUT
-A INPUT -i virbr0 -p udp -m udp --dport 53 -j ACCEPT
-A INPUT -i virbr0 -p tcp -m tcp --dport 53 -j ACCEPT
-A INPUT -i virbr0 -p udp -m udp --dport 67 -j ACCEPT
-A INPUT -i virbr0 -p tcp -m tcp --dport 67 -j ACCEPT
-A FORWARD -j nova-filter-top
-A FORWARD -j nova-compute-FORWARD
-A FORWARD -d 192.168.122.0/24 -o virbr0 -m state --state RELATED,ESTABLISHED -j ACCEPT
-A FORWARD -s 192.168.122.0/24 -i virbr0 -j ACCEPT
-A FORWARD -i virbr0 -o virbr0 -j ACCEPT
-A FORWARD -o virbr0 -j REJECT --reject-with icmp-port-unreachable
-A FORWARD -i virbr0 -j REJECT --reject-with icmp-port-unreachable
-A OUTPUT -j nova-filter-top
-A OUTPUT -j nova-compute-OUTPUT
-A nova-compute-inst-14 -m state --state INVALID -j DROP
-A nova-compute-inst-14 -m state --state RELATED,ESTABLISHED -j ACCEPT
-A nova-compute-inst-14 -j nova-compute-provider
-A nova-compute-inst-14 -s 10.0.0.1/32 -p udp -m udp --sport 67 --dport 68 -j ACCEPT
-A nova-compute-inst-14 -s 10.0.0.0/28 -j ACCEPT
-A nova-compute-inst-14 -p tcp -m tcp --dport 22 -j ACCEPT
-A nova-compute-inst-14 -p icmp -j ACCEPT
-A nova-compute-inst-14 -j nova-compute-sg-fallback
-A nova-compute-local -d 10.0.0.5/32 -j nova-compute-inst-14
-A nova-compute-sg-fallback -j DROP
-A nova-filter-top -j nova-compute-local
COMMIT

here are the outputs from instance:

### ifconfig -a
eth0 Link encap:Ethernet HWaddr 02:16:3E:75:CD:7A
          inet addr:10.145.4.155 Bcast:10.140.4.255 Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:64 errors:0 dropped:0 overruns:0 frame:0
          TX packets:99 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:7924 (7.7 KiB) TX bytes:4986 (4.8 KiB)
          Interrupt:11 Base address:0x4000

lo Link encap:Local Loopback
          inet addr:127.0.0.1 Mask:255.0.0.0
          UP LOOPBACK RUNNING MTU:16436 Metric:1
          RX packets:32 errors:0 dropped:0 overruns:0 frame:0
          TX packets:32 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:2816 (2.7 KiB) TX bytes:2816 (2.7 KiB)

but i can not ping there each other.

also arp
root@tiger-desktop:/var/lib/nova/instances/instance-0000000e# arping -I br100 -c 3 10.145.4.155
ARPING 10.145.4.155 from 10.145.4.228 br100
Sent 3 probes (3 broadcast(s))
Received 0 response(s)

hope someone could give me some clue:)

thank you beforehand

Question information

Language:
English Edit question
Status:
Answered
For:
OpenStack Compute (nova) Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:
Revision history for this message
Ashokkumar c (ashokcse) said : 		#1

hi

first make sure your broadcast address is 10.140.4.255 or 10.145.4.255(i think it should be this).

I think this doc will help you http://docs.openstack.org/bexar/openstack-compute/admin/content/ch03s02.html

There are some example /etc/network/interfaces is given there, also read Comment by "Darren Birkett"

Revision history for this message
Max Schneider (henry2k) said : 		#2

Perhaps its the same bug i have actually, look at the mac of your vnet0 (fe:16:3e:75:cd:7a) and compare it to the address inside your vm (02:16:3E:75:CD:7A), instead of "02" there is a "fe" in front (took me quite a while to see this)...

My problem is that the DHCP answers to the "02" mac, but the bridge only knows the "fe" address and no ip is assigned, so no connection to vm... :(

Revision history for this message
Steven Dake (sdake) said : 		#3

Read:
http://lists.fedoraproject.org/pipermail/cloud/2011-December/001116.html

Can you help with this problem?

Provide an answer of your own, or ask wonderzou for more information if necessary.

To post a message you must log in.