Unable to use( ping or ssh ) the vm instances ... even after multiple attempts of clean openstack Installation

Asked by Kanthi Kiran N on 2011-04-18

************ Query *********************

I have been trying to setup proof of concept installation of OpenStack with no luck so far.
My installation is based on the openstack official guides. Its little confusing to chose
the installation method. I have tried both scripted and manual installation so far with
ttylinux image up and running but unable to ping or ssh it.

Today I have done a clean manual installation of Cactus release and again facing the
same issue.

I had a sucess with Openstack installation in VirtualBox as instructed in this link http://uksysadmin.wordpress.com/2011/02/17/running-openstack-under-virtualbox-a-complete-guide/

I am looking for a single server ( all services on same server ) setup with multiple projects
and users with OpenDashboard to work in sync to demonstrate OpenStack at my working place to be able to scale it with multiple nodes in future

Please guide me if i am missing anything in the setup

Also suggest me the best ways of configuring setup for POC

********** Installation Architecture **********

All In One - Currently all the services are running on a single hardware server.
using the following document

http://docs.openstack.org/cactus/openstack-compute/admin/content/

Used FlatDHCPManager

**********************************************************

********** Installation Procedure **********

Manual Installation as per the openstack official documentation

**********************************************************

********** Running Instances Procedure **********
**********************************************************

********** Ping and SSH **********
**********************************************************

********** nova.conf **********

--dhcpbridge_flagfile=/etc/nova/nova.conf
--dhcpbridge=/usr/bin/nova-dhcpbridge
--logdir=/var/log/nova
--state_path=/var/lib/nova
--lock_path=/var/lock/nova
--verbose
--s3_host=192.168.138.150
--rabbit_host=192.168.138.150
--cc_host=192.168.138.150
--ec2_url=http://192.168.138.150:8773/services/Cloud
--fixed_range=10.0.0.0/12
--network_size=8
--routing_source_ip=192.168.138.150
--sql_connection=mysql://root:nova@192.168.138.150/nova
--network_manager=nova.network.manager.FlatDHCPManager
--flat_network_dhcp_start=10.0.0.2
--flat_interface=eth1
--flat_injected=False
--public_interface=eth0

**********************************************************

********** ifconfig **********

root@openstack-manual:~# ifconfig
br100 Link encap:Ethernet HWaddr 00:05:5d:42:05:70
          inet addr:192.168.0.1 Bcast:192.168.0.127 Mask:255.255.255.128
          inet6 addr: fe80::218:8bff:fe8d:69fa/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:495822 errors:0 dropped:0 overruns:0 frame:0
          TX packets:189 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:401146574 (401.1 MB) TX bytes:9054 (9.0 KB)

eth0 Link encap:Ethernet HWaddr 00:05:5d:42:05:70
          inet addr:192.168.138.150 Bcast:192.168.138.255 Mask:255.255.255.0
          inet6 addr: fe80::205:5dff:fe42:570/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:425228 errors:0 dropped:0 overruns:0 frame:0
          TX packets:721472 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:600450491 (600.4 MB) TX bytes:427543412 (427.5 MB)
          Interrupt:17 Base address:0xcc00

eth1 Link encap:Ethernet HWaddr 00:18:8b:8d:69:fa
          inet6 addr: fe80::218:8bff:fe8d:69fa/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:495328 errors:1433 dropped:0 overruns:0 frame:1433
          TX packets:688 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:409705698 (409.7 MB) TX bytes:171344 (171.3 KB)
          Interrupt:17

lo Link encap:Local Loopback
          inet addr:127.0.0.1 Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING MTU:16436 Metric:1
          RX packets:1850756 errors:0 dropped:0 overruns:0 frame:0
          TX packets:1850756 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:568185003 (568.1 MB) TX bytes:568185003 (568.1 MB)

virbr0 Link encap:Ethernet HWaddr a2:23:55:5a:86:d9
          inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

vlan100 Link encap:Ethernet HWaddr 00:05:5d:42:05:70
          inet6 addr: fe80::205:5dff:fe42:570/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:495719 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B) TX bytes:410037554 (410.0 MB)

vnet0 Link encap:Ethernet HWaddr fe:16:3e:7b:3b:c2
          inet6 addr: fe80::fc16:3eff:fe7b:3bc2/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:252 errors:0 dropped:0 overruns:0 frame:0
          TX packets:353384 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500
          RX bytes:79680 (79.6 KB) TX bytes:292425458 (292.4 MB)

vnet1 Link encap:Ethernet HWaddr fe:16:3e:6a:52:d4
          inet6 addr: fe80::fc16:3eff:fe6a:52d4/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:33 errors:0 dropped:0 overruns:0 frame:0
          TX packets:41625 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500
          RX bytes:9162 (9.1 KB) TX bytes:35288362 (35.2 MB)

root@openstack-manual:~#

**********************************************************

*************** /etc/network/interfaces *****************************

# The loopback network interface

auto lo
iface lo inet loopback

# The primary network interface

auto eth0
iface eth0 inet static
        address 192.168.138.150
        netmask 255.255.255.0
        network 192.168.138.0
        broadcast 192.168.138.255
        gateway 192.168.138.111
        # dns-* options are implemented by the resolvconf package, if installed
        dns-nameservers 192.168.138.111
        dns-search rnd.local

# Networking for OpenStack Compute

auto br100

iface br100 inet dhcp
    bridge_ports eth1
    bridge_stp off
    bridge_maxwait 0
    bridge_fd 0

****************************************************************

********** iptables-save **********
root@openstack-manual:/var/log# iptables-save
# Generated by iptables-save v1.4.4 on Mon Apr 18 04:29:37 2011
*nat
:PREROUTING ACCEPT [214:30960]
:POSTROUTING ACCEPT [86:5544]
:OUTPUT ACCEPT [78:4680]
:nova-compute-OUTPUT - [0:0]
:nova-compute-POSTROUTING - [0:0]
:nova-compute-PREROUTING - [0:0]
:nova-compute-floating-snat - [0:0]
:nova-compute-snat - [0:0]
:nova-network-OUTPUT - [0:0]
:nova-network-POSTROUTING - [0:0]
:nova-network-PREROUTING - [0:0]
:nova-network-floating-snat - [0:0]
:nova-network-snat - [0:0]
:nova-postrouting-bottom - [0:0]
-A PREROUTING -j nova-compute-PREROUTING
-A PREROUTING -j nova-network-PREROUTING
-A PREROUTING -d 169.254.169.254/32 -p tcp -m tcp --dport 80 -j DNAT --to-destination 192.168.138.150:8773
-A POSTROUTING -j nova-compute-POSTROUTING
-A POSTROUTING -j nova-network-POSTROUTING
-A POSTROUTING -j nova-postrouting-bottom
-A POSTROUTING -s 192.168.122.0/24 ! -d 192.168.122.0/24 -p tcp -j MASQUERADE --to-ports 1024-65535
-A POSTROUTING -s 192.168.122.0/24 ! -d 192.168.122.0/24 -p udp -j MASQUERADE --to-ports 1024-65535
-A POSTROUTING -s 192.168.122.0/24 ! -d 192.168.122.0/24 -j MASQUERADE
-A OUTPUT -j nova-compute-OUTPUT
-A OUTPUT -j nova-network-OUTPUT
-A nova-compute-snat -j nova-compute-floating-snat
-A nova-network-POSTROUTING -s 10.0.0.0/12 -d 10.128.0.0/24 -j ACCEPT
-A nova-network-POSTROUTING -s 10.0.0.0/12 -d 10.0.0.0/12 -j ACCEPT
-A nova-network-PREROUTING -d 169.254.169.254/32 -p tcp -m tcp --dport 80 -j DNAT --to-destination 192.168.138.150:8773
-A nova-network-snat -j nova-network-floating-snat
-A nova-network-snat -s 10.0.0.0/12 -j SNAT --to-source 192.168.138.150
-A nova-postrouting-bottom -j nova-compute-snat
-A nova-postrouting-bottom -j nova-network-snat
COMMIT
# Completed on Mon Apr 18 04:29:37 2011
# Generated by iptables-save v1.4.4 on Mon Apr 18 04:29:37 2011
*filter
:INPUT ACCEPT [757440:64298993]
:FORWARD ACCEPT [0:0]
:OUTPUT ACCEPT [756114:66751153]
:nova-compute-FORWARD - [0:0]
:nova-compute-INPUT - [0:0]
:nova-compute-OUTPUT - [0:0]
:nova-compute-inst-7 - [0:0]
:nova-compute-local - [0:0]
:nova-compute-sg-fallback - [0:0]
:nova-filter-top - [0:0]
:nova-network-FORWARD - [0:0]
:nova-network-INPUT - [0:0]
:nova-network-OUTPUT - [0:0]
:nova-network-local - [0:0]
-A INPUT -j nova-compute-INPUT
-A INPUT -j nova-network-INPUT
-A INPUT -i virbr0 -p udp -m udp --dport 53 -j ACCEPT
-A INPUT -i virbr0 -p tcp -m tcp --dport 53 -j ACCEPT
-A INPUT -i virbr0 -p udp -m udp --dport 67 -j ACCEPT
-A INPUT -i virbr0 -p tcp -m tcp --dport 67 -j ACCEPT
-A FORWARD -j nova-filter-top
-A FORWARD -j nova-compute-FORWARD
-A FORWARD -j nova-network-FORWARD
-A FORWARD -d 192.168.122.0/24 -o virbr0 -m state --state RELATED,ESTABLISHED -j ACCEPT
-A FORWARD -s 192.168.122.0/24 -i virbr0 -j ACCEPT
-A FORWARD -i virbr0 -o virbr0 -j ACCEPT
-A FORWARD -o virbr0 -j REJECT --reject-with icmp-port-unreachable
-A FORWARD -i virbr0 -j REJECT --reject-with icmp-port-unreachable
-A OUTPUT -j nova-filter-top
-A OUTPUT -j nova-compute-OUTPUT
-A OUTPUT -j nova-network-OUTPUT
-A nova-compute-FORWARD -i br100 -j ACCEPT
-A nova-compute-FORWARD -o br100 -j ACCEPT
-A nova-compute-inst-7 -m state --state INVALID -j DROP
-A nova-compute-inst-7 -m state --state RELATED,ESTABLISHED -j ACCEPT
-A nova-compute-inst-7 -s 192.168.0.1/32 -p udp -m udp --sport 67 --dport 68 -j ACCEPT
-A nova-compute-inst-7 -s 192.168.0.0/25 -j ACCEPT
-A nova-compute-inst-7 -p icmp -j ACCEPT
-A nova-compute-inst-7 -p tcp -m tcp --dport 22 -j ACCEPT
-A nova-compute-inst-7 -j nova-compute-sg-fallback
-A nova-compute-local -d 192.168.0.7/32 -j nova-compute-inst-7
-A nova-compute-sg-fallback -j DROP
-A nova-filter-top -j nova-compute-local
-A nova-filter-top -j nova-network-local
COMMIT
# Completed on Mon Apr 18 04:29:37 2011
root@openstack-manual:/var/log#

**********************************************************

********** brctl show **********
root@openstack-manual:~# brctl show
bridge name bridge id STP enabled interfaces
br100 8000.00055d420570 no eth1
       vlan100
       vnet0
       vnet1
virbr0 8000.000000000000 yes
root@openstack-manual:~#

**********************************************************

********** Logs **********
nova-manage.log : http://paste.openstack.org/show/1210/

nova-network.log : http://paste.openstack.org/show/1213/

nova-compute.log : http://paste.openstack.org/show/1212/

nova-api.log : http://paste.openstack.org/show/1209/

qemu.log :
-----------------------------------------------------------------------------------------------------
root@openstack-manual:/var/log# cat /var/log/libvirt/qemu/instance-00000005.log
2011-04-18 03:37:33.734: starting up
LC_ALL=C PATH=/usr/local/sbin:/usr/local/bin:/usr/bin:/usr/sbin:/sbin:/bin QEMU_AUDIO_DRV=none /usr/bin/kvm -S -M pc-0.12 -enable-kvm -m 512 -smp 1,sockets=1,cores=1,threads=1 -name instance-00000005 -uuid 3a4ca375-282b-4237-43e8-97c3a7d98ed2 -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/instance-00000005.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=readline -rtc base=utc -boot c -kernel /var/lib/nova/instances/instance-00000005/kernel -initrd /var/lib/nova/instances/instance-00000005/ramdisk -append root=/dev/vda console=ttyS0 -drive file=/var/lib/nova/instances/instance-00000005/disk,if=none,id=drive-virtio-disk0,format=qcow2 -device virtio-blk-pci,bus=pci.0,addr=0x4,drive=drive-virtio-disk0,id=virtio-disk0 -device rtl8139,vlan=0,id=net0,mac=02:16:3e:7a:6a:e4,bus=pci.0,addr=0x3 -net tap,fd=18,vlan=0,name=hostnet0 -chardev file,id=charserial0,path=/var/lib/nova/instances/instance-00000005/console.log -device isa-serial,chardev=charserial0,id=serial0 -chardev pty,id=charserial1 -device isa-serial,chardev=charserial1,id=serial1 -usb -vnc 0.0.0.0:2 -k en-us -vga cirrus -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x5
char device redirected to /dev/pts/9
pci_add_option_rom: failed to find romfile "pxe-rtl8139.bin"
2011-04-18 03:42:27.098: shutting down
root@openstack-manual:/var/log#

-------------------------------------------------------------------------------------

**********************************************************

********** euca-get-console-output **********

http://paste.openstack.org/show/1208/

**********************************************************

************* Misc *************

------------------------------------------------------------------------------------------------------------------------------------------------
root@openstack-manual:~# euca-describe-images
IMAGE aki-6c7c0f60 mybucket/ttylinux-uec-amd64-12.1_2.6.35-22_1-vmlinuz.manifest.xml available public x86_64 kernel
IMAGE ami-4aafbf4b dub-bucket/maverick-server-uec-amd64.img.manifest.xml available public i386 machine aki-32ca7710
IMAGE ari-538468d0 mybucket/ttylinux-uec-amd64-12.1_2.6.35-22_1-initrd.manifest.xml available public x86_64 ramdisk
IMAGE ami-5abeaabd mybucket/ttylinux-uec-amd64-12.1_2.6.35-22_1.img.manifest.xml available public x86_64 machine aki-6c7c0f60 ari-538468d0
IMAGE aki-32ca7710 dub-bucket/maverick-server-uec-amd64-vmlinuz-virtual.manifest.xml available public i386 kernel
root@openstack-manual:~#

-------------------------------------------------------------------------------------------------------------------------------------------------
root@openstack-manual:~# euca-describe-instances
RESERVATION r-5e8pjgvl project1 default
INSTANCE i-00000003 ami-5abeaabd 192.168.0.5 192.168.0.5 running test (project1, openstack-manual)0 m1.tiny 2011-04-18T06:37:27Z nova
RESERVATION r-hz681ung project1 default
INSTANCE i-00000004 ami-5abeaabd 192.168.0.3 192.168.0.3 running test (project1, openstack-manual)0 m1.tiny 2011-04-18T07:12:26Z nova
root@openstack-manual:~#

---------------------------------------------------------------------------------------------------------------------------------------------------------

**************************************

Question information

Language:
English Edit question
Status:
Solved
For:
OpenStack Compute (nova) Edit question
Assignee:
No assignee Edit question
Solved by:
Vish Ishaya
Solved:
2011-04-19
Last query:
2011-04-19
Last reply:
2011-04-18
Kanthi Kiran N (nkanthikiran) said : #1

Also adding the below information:

root@openstack-manual:/var# ps aux | grep dnsmasq
root 13534 0.0 0.0 7620 916 pts/0 S+ 09:09 0:00 grep --color=auto dnsmasq
nobody 16537 0.0 0.0 22856 1016 ? S 02:21 0:00 dnsmasq --strict-order --bind-interfaces --conf-file= --domain=novalocal --pid-file=/var/lib/nova/networks/nova-br100.pid --listen-address=192.168.0.1 --except-interface=lo --dhcp-range=10.0.0.2,static,120s --dhcp-hostsfile=/var/lib/nova/networks/nova-br100.conf --dhcp-script=/usr/bin/nova-dhcpbridge --leasefile-ro
root 16538 0.0 0.0 22856 292 ? S 02:21 0:00 dnsmasq --strict-order --bind-interfaces --conf-file= --domain=novalocal --pid-file=/var/lib/nova/networks/nova-br100.pid --listen-address=192.168.0.1 --except-interface=lo --dhcp-range=10.0.0.2,static,120s --dhcp-hostsfile=/var/lib/nova/networks/nova-br100.conf --dhcp-script=/usr/bin/nova-dhcpbridge --leasefile-ro
root@openstack-manual:/var#

Best Vish Ishaya (vishvananda) said : #2

Looks like you are missing dhcp_listen_address.
Since you are trying to use the 192 address range, you need something like
--flat_network_dhcp_start=192.168.0.2

then:

killall dnsmasq
restart nova-network

and you should be good to go.

Vish

On Apr 18, 2011, at 6:12 AM, Kanthi Kiran N wrote:

> Question #153251 on OpenStack Compute (nova) changed:
> https://answers.launchpad.net/nova/+question/153251
>
> Kanthi Kiran N gave more information on the question:
> Also adding the below information:
>
> root@openstack-manual:/var# ps aux | grep dnsmasq
> root 13534 0.0 0.0 7620 916 pts/0 S+ 09:09 0:00 grep --color=auto dnsmasq
> nobody 16537 0.0 0.0 22856 1016 ? S 02:21 0:00 dnsmasq --strict-order --bind-interfaces --conf-file= --domain=novalocal --pid-file=/var/lib/nova/networks/nova-br100.pid --listen-address=192.168.0.1 --except-interface=lo --dhcp-range=10.0.0.2,static,120s --dhcp-hostsfile=/var/lib/nova/networks/nova-br100.conf --dhcp-script=/usr/bin/nova-dhcpbridge --leasefile-ro
> root 16538 0.0 0.0 22856 292 ? S 02:21 0:00 dnsmasq --strict-order --bind-interfaces --conf-file= --domain=novalocal --pid-file=/var/lib/nova/networks/nova-br100.pid --listen-address=192.168.0.1 --except-interface=lo --dhcp-range=10.0.0.2,static,120s --dhcp-hostsfile=/var/lib/nova/networks/nova-br100.conf --dhcp-script=/usr/bin/nova-dhcpbridge --leasefile-ro
> root@openstack-manual:/var#
>
> --
> You received this question notification because you are a member of Nova
> Core, which is an answer contact for OpenStack Compute (nova).

Kanthi Kiran N (nkanthikiran) said : #3

Hi Vish,

Thank You . This solved the issue. I would like to know to know if there are any comprehensive reference to understand the OpenStack Networking which would help to plan the setup at Enterprise Level.

I shall post my questions as a new Query.

Thank you once again.

Regards,
Kanthi

Kanthi Kiran N (nkanthikiran) said : #4

Thanks Vish Ishaya, that solved my question.