networking problems in running instances
Hi everyone, it's me again :) This time I have issues with networking of the instances. I'm running openstack in a two node configuration, there are three instances running in a node and one in the other node, here is the output of euca-describe-
euca-describe-
RESERVATION r-qgwxc38z proj1 default
INSTANCE i-00000002 ami-00000003 192.168.0.2 192.168.0.2 running None (proj1, openstack-
RESERVATION r-0w1f16dn proj1 default
INSTANCE i-00000004 ami-00000003 192.168.0.4 192.168.0.4 running None (proj1, eucalyptus) 0 m1.tiny 2011-05-
RESERVATION r-20qqjtse proj1 default
INSTANCE i-00000003 ami-00000003 192.168.0.3 192.168.0.3 running None (proj1, openstack-
here is the nova.conf of the cloud controller:
--dhcpbridge_
--dhcpbridge=
--logdir=
--state_
--lock_
--verbose
--s3_host=
--rabbit_
--cc_host=
--ec2_url=http://
--fixed_
--network_size=88
--network_
--routing_
--FAKE_
--image_
--glance_
--glance_port=9292
--sql_connectio
here is the nova.conf of the compute node:
--dhcpbridge_
--dhcpbridge=
--logdir=
--state_
--lock_
--verbose
--s3_host=
--rabbit_
--cc_host=
--ec2_url=http://
--fixed_
--network_size=18
--network_
--image_
--glance_
--glance_port=9292
--sql_connectio
here is the ifconfig output of the cloud controller:
br100 Link encap:Ethernet HWaddr bc:ae:c5:c1:d1:c3
inet addr:192.168.1.208 Bcast:192.168.1.255 Mask:255.255.255.0
inet6 addr: fe80::beae:
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:1304169 errors:0 dropped:0 overruns:0 frame:0
TX packets:1881333 errors:0 dropped:0 overruns:0 carrier:0
RX bytes:426295659 (426.2 MB) TX bytes:2294268253 (2.2 GB)
eth0 Link encap:Ethernet HWaddr bc:ae:c5:c1:d1:c3
inet6 addr: fe80::beae:
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:1313062 errors:0 dropped:0 overruns:0 frame:0
TX packets:1885918 errors:0 dropped:0 overruns:0 carrier:0
RX bytes:446334788 (446.3 MB) TX bytes:2294658231 (2.2 GB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:3758394 errors:0 dropped:0 overruns:0 frame:0
TX packets:3758394 errors:0 dropped:0 overruns:0 carrier:0
RX bytes:2802947135 (2.8 GB) TX bytes:2802947135 (2.8 GB)
virbr0 Link encap:Ethernet HWaddr 96:42:a5:d0:94:cd
inet addr:192.168.122.1 Bcast:192.
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
vnet0 Link encap:Ethernet HWaddr fe:16:3e:19:29:3d
inet6 addr: fe80::fc16:
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:893 errors:0 dropped:0 overruns:0 carrier:0
RX bytes:0 (0.0 B) TX bytes:61472 (61.4 KB)
vnet1 Link encap:Ethernet HWaddr fe:16:3e:1a:67:89
inet6 addr: fe80::fc16:
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:887 errors:0 dropped:0 overruns:0 carrier:0
RX bytes:0 (0.0 B) TX bytes:61112 (61.1 KB)
here is the output of ifconfig of the compute node:
br100 Link encap:Ethernet HWaddr 00:24:8c:88:a2:9d
inet addr:192.168.1.50 Bcast:192.168.1.255 Mask:255.255.255.0
inet6 addr: fe80::224:
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:1790111 errors:0 dropped:0 overruns:0 frame:0
TX packets:1063378 errors:0 dropped:0 overruns:0 carrier:0
RX bytes:2262867369 (2.2 GB) TX bytes:87105685 (87.1 MB)
eth0 Link encap:Ethernet HWaddr 00:24:8c:88:a2:9d
inet6 addr: fe80::224:
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:1791451 errors:0 dropped:0 overruns:0 frame:0
TX packets:1064105 errors:0 dropped:0 overruns:0 carrier:0
RX bytes:2288664158 (2.2 GB) TX bytes:87263526 (87.2 MB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:249538 errors:0 dropped:0 overruns:0 frame:0
TX packets:249538 errors:0 dropped:0 overruns:0 carrier:0
RX bytes:17466459 (17.4 MB) TX bytes:17466459 (17.4 MB)
virbr0 Link encap:Ethernet HWaddr 4a:c0:10:5a:06:2d
inet addr:192.168.122.1 Bcast:192.
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
vnet0 Link encap:Ethernet HWaddr fe:16:3e:72:84:da
inet6 addr: fe80::fc16:
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:8 errors:0 dropped:0 overruns:0 frame:0
TX packets:798 errors:0 dropped:0 overruns:0 carrier:0
RX bytes:1152 (1.1 KB) TX bytes:55528 (55.5 KB)
here is the output of nova-manage network list:
network netmask start address DNS
192.168.0.0/25 255.255.255.128 192.168.0.2 8.8.4.4
here is the output of console.log of instance 4 wich is similar to the log of the other instances:
Linux version 2.6.18-194.el5 (<email address hidden>) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-48)) #1 SMP Fri Apr 2 14:58:35 EDT 2010
BIOS-provided physical RAM map:
BIOS-e820: 0000000000010000 - 000000000009d400 (usable)
BIOS-e820: 000000000009d400 - 00000000000a0000 (reserved)
BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
BIOS-e820: 0000000000100000 - 000000001fffd000 (usable)
BIOS-e820: 000000001fffd000 - 0000000020000000 (reserved)
BIOS-e820: 00000000feffc000 - 00000000ff000000 (reserved)
BIOS-e820: 00000000fffc0000 - 0000000100000000 (reserved)
0MB HIGHMEM available.
511MB LOWMEM available.
found SMP MP-table at 000fdbc0
Memory for crash kernel (0x0 to 0x0) notwithin permissible range
disabling kdump
Using x86 segment limits to approximate NX protection
DMI 2.4 present.
kvm-clock: cpu 0, msr 0:73f9e1, boot clock
Using APIC driver default
ACPI: PM-Timer IO Port: 0xb008
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
Processor #0 6:2 APIC version 20
ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-23
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
Enabling APIC mode: Flat. Using 1 I/O APICs
ACPI: HPET id: 0x8086a201 base: 0xfed00000
Using ACPI (MADT) for SMP configuration information
Allocating PCI resources starting at 30000000 (gap: 20000000:deffc000)
TSC: Frequency read from the hypervisor
Detected 2700.000 MHz processor.
kvm-clock: cpu 0, msr 0:1404461, primary cpu clock
Built 1 zonelists. Total pages: 131069
Kernel command line: root=/dev/vda console=ttyS0
Enabling fast FPU save and restore... done.
Enabling unmasked SIMD FPU exception support... done.
Initializing CPU#0
CPU 0 irqstacks, hard=c0768000 soft=c0748000
PID hash table entries: 2048 (order: 11, 8192 bytes)
Console: colour VGA+ 80x25
Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
Memory: 512304k/524276k available (2178k kernel code, 11408k reserved, 907k data, 228k init, 0k highmem)
Checking if this processor honours the WP bit even in supervisor mode... Ok.
hpet0: at MMIO 0xfed00000 (virtual 0xe0800000), IRQs 2, 8, 0
hpet0: 3 64-bit timers, 100000000 Hz
Using HPET for base-timer
Calibrating delay loop (skipped), value calculated using timer frequency.. 5400.00 BogoMIPS (lpj=2700000)
Security Framework v1.0.0 initialized
SELinux: Initializing.
selinux_
Capability LSM initialized as secondary
Mount-cache hash table entries: 512
CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
CPU: L2 Cache: 512K (64 bytes/line)
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#0.
Checking 'hlt' instruction... OK.
SMP alternatives: switching to UP code
Freeing SMP alternatives: 14k freed
ACPI: Core revision 20060707
CPU0: AMD QEMU Virtual CPU version 0.13.91 stepping 03
Total of 1 processors activated (5400.00 BogoMIPS).
ENABLING IO-APIC IRQs
..TIMER: vector=0x31 apic1=0 pin1=2 apic2=-1 pin2=-1
Using local APIC timer interrupts.
WARNING calibrate_
Brought up 1 CPUs
checking if image is initramfs... it is
Freeing initrd memory: 2706k freed
NET: Registered protocol family 16
ACPI: bus type pci registered
PCI: PCI BIOS revision 2.10 entry at 0xffe77, last bus=0
PCI: Using configuration type 1
Setting up standard PCI resources
ACPI: Interpreter enabled
ACPI: Using IOAPIC for interrupt routing
ACPI: No dock devices found.
ACPI: PCI Root Bridge [PCI0] (0000:00)
PCI quirk: region b000-b03f claimed by PIIX4 ACPI
PCI quirk: region b100-b10f claimed by PIIX4 SMB
ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
Linux Plug and Play Support v0.97 (c) Adam Belay
pnp: PnP ACPI init
pnp: PnP ACPI: found 6 devices
usbcore: registered new driver usbfs
usbcore: registered new driver hub
PCI: Using ACPI for IRQ routing
PCI: If a device doesn't work, try "pci=routeirq". If it helps, post a report
NetLabel: Initializing
NetLabel: domain hash size = 128
NetLabel: protocols = UNLABELED CIPSOv4
NetLabel: unlabeled traffic allowed by default
NET: Registered protocol family 2
IP route cache hash table entries: 4096 (order: 2, 16384 bytes)
TCP established hash table entries: 16384 (order: 5, 131072 bytes)
TCP bind hash table entries: 8192 (order: 4, 65536 bytes)
TCP: Hash tables configured (established 16384 bind 8192)
TCP reno registered
apm: BIOS version 1.2 Flags 0x03 (Driver version 1.16ac)
apm: overridden by ACPI.
audit: initializing netlink socket (disabled)
type=2000 audit(130496404
Total HugeTLB memory allocated, 0
VFS: Disk quotas dquot_6.5.1
Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
Initializing Cryptographic API
alg: No test for crc32c (crc32c-generic)
ksign: Installing public key data
Loading keyring
- Added public key 285B5C47ED7A1E8E
- User ID: CentOS (Kernel Module GPG key)
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered (default)
Limiting direct PCI/PCI transfers.
PCI: PIIX3: Enabling Passive Release on 0000:00:01.0
Activating ISA DMA hang workarounds.
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
Real Time Clock Driver v1.12ac
Non-volatile memory driver v1.2
Linux agpgart interface v0.101 (c) Dave Jones
Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled
�serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
brd: module loaded
Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
PIIX3: IDE controller at PCI slot 0000:00:01.1
PIIX3: chipset revision 0
PIIX3: not 100% native mode: will probe irqs later
ide0: BM-DMA at 0xc000-0xc007, BIOS settings: hda:pio, hdb:pio
ide1: BM-DMA at 0xc008-0xc00f, BIOS settings: hdc:pio, hdd:pio
ide-floppy driver 0.99.newide
usbcore: registered new driver hiddev
usbcore: registered new driver usbhid
drivers/
PNP: PS/2 Controller [PNP0303:
serio: i8042 KBD port at 0x60,0x64 irq 1
serio: i8042 AUX port at 0x60,0x64 irq 12
mice: PS/2 mouse device common for all mice
md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27
md: bitmap version 4.39
TCP bic registered
Initializing IPsec netlink socket
NET: Registered protocol family 1
NET: Registered protocol family 17
Using IPI No-Shortcut mode
Time: kvm-clock clocksource has been installed.
ACPI: (supports S3 S4 S5)
Initalizing network drop monitor service
Freeing unused kernel memory: 228k freed
Write protecting the kernel read-only data: 409k
Red Hat nash version 5.1.19.6 starting
Mounting proc filesystem
Mounting sysfs filesystem
Creating /dev
Creating initial device nodes
Setting up hotplug.
input: AT Translated Set 2 keyboard as /class/input/input0
input: ImExPS/2 Generic Explorer Mouse as /class/input/input1
Creating block device nodes.
Loading ehci-hcd.ko module
Loading ohci-hcd.ko module
Loading uhci-hcd.ko module
USB Universal Host Controller Interface driver v3.0
ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11
ACPI: PCI Interrupt 0000:00:01.2[D] -> Link [LNKD] -> GSI 11 (level, high) -> IRQ 11
uhci_hcd 0000:00:01.2: UHCI Host Controller
uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1
uhci_hcd 0000:00:01.2: irq 11, io base 0x0000c020
usb usb1: configuration #1 chosen from 1 choice
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 2 ports detected
Loading jbd.ko module
Loading ext3.ko module
Loading scsi_mod.ko module
SCSI subsystem initialized
Loading sd_mod.ko module
Loading scsi_transport_
Loading sym53c8xx.ko module
Loading libata.ko module
Loading ata_piix.ko module
Loading dm-mem-cache.ko module
Loading dm-mod.ko module
device-mapper: uevent: version 1.0.3
device-mapper: ioctl: 4.11.5-ioctl (2007-12-12) initialised: <email address hidden>
Loading dm-log.ko module
Loading dm-region_hash.ko module
Loading dm-message.ko module
Loading dm-raid45.ko module
device-mapper: dm-raid45: initialized v0.2594l
Loading xen-platform-pci.ko module
Loading xen-vbd.ko module
insmod: error inserting '/lib/xen-vbd.ko': -1 No such device
Loading xen-balloon.ko module
xen_mem: Initialising balloon driver.
Loading xen-vnif.ko module
netfront: Initialising virtual ethernet driver.
insmod: error inserting '/lib/xen-vnif.ko': -1 No such device
Loading mptbase.ko module
Fusion MPT base driver 3.04.13rh
Copyright (c) 1999-2008 LSI Corporation
Loading mptscsih.ko module
Loading mptspi.ko module
Fusion MPT SPI Host driver 3.04.13rh
Loading scsi_transport_
Loading mptsas.ko module
Fusion MPT SAS Host driver 3.04.13rh
Loading virtio.ko module
Loading virtio_ring.ko module
Loading virtio_pci.ko module
ACPI: PCI Interrupt 0000:00:04.0[A] -> Link [LNKD] -> GSI 11 (level, high) -> IRQ 11
ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 10
ACPI: PCI Interrupt 0000:00:05.0[A] -> Link [LNKA] -> GSI 10 (level, high) -> IRQ 10
Loading virtio_blk.ko module
vda: unknown partition table
Loading virtio_net.ko module
Loading virtio_balloon.ko module
Loading ahci.ko module
Waiting for driver initialization.
TSC appears to be running slowly. Marking it as unstable
Scanning and configuring dmraid supported devices
Trying to resume from LABEL=SWAP-sda2
Unable to access resume device (LABEL=SWAP-sda2)
Creating root device.
Mounting root filesystem.
kjournald starting. Commit interval 5 seconds
EXT3-fs: mounted filesystem with ordered data mode.
Setting up other filesystems.
Setting up new root fs
no fstab.sys, mounting internal defaults
Switching to new root and running init.
unmounting old /dev
unmounting old /proc
unmounting old /sys
type=1404 audit(130496407
type=1403 audit(130496407
INIT: version 2.86 booting
Welcome to CentOS release 5.5 (Final)
Press 'I' to enter interactive startup.
Setting clock (localtime): Mon May 9 18:01:14 BST 2011 [ OK ]
Starting udev: [ OK ]
Loading default keymap (us): [ OK ]
Setting hostname Centos5-
No devices found
Setting up Logical Volume Management: [ OK ]
Checking filesystems
Checking all file systems.
[/sbin/fsck.ext3 (1) -- /] fsck.ext3 -a /dev/vda
/: Superblock last mount time is in the future. FIXED.
/: Superblock last write time is in the future. FIXED.
/: clean, 23914/397696 files, 220585/397600 blocks
[ OK ]
Remounting root filesystem in read-write mode: [ OK ]
Mounting local filesystems: [ OK ]
Enabling /etc/fstab swaps: [ OK ]
INIT: Entering runlevel: 3
Entering non-interactive startup
Starting mcstransd: [ OK ]
Bringing up loopback interface: [ OK ]
Bringing up interface eth0:
Determining IP information for eth0... done.
[ OK ]
Starting restorecond: [ OK ]
Starting system message bus: [ OK ]
Mounting other filesystems: [ OK ]
Starting HAL daemon: [ OK ]
Generating SSH1 RSA host key: [ OK ]
Generating SSH2 RSA host key: [ OK ]
Generating SSH2 DSA host key: [ OK ]
Starting sshd: [ OK ]
I can't access the instances using ssh or ping them, the only way to access them is using virt-manager inside the physical machine where the instance is running and opening a console. For example if I do that for instance 4 and execute ifconfig inside the console I can see the real IP of the instance which is 192.168.1.203 and not 192.168.0.4 as euca-describe-
Cheers
Diego
Question information
- Language:
- English Edit question
- Status:
- Solved
- Assignee:
- No assignee Edit question
- Solved by:
- Diego Lalo
- Solved:
- Last query:
- Last reply:
This question was reopened
- by Diego Lalo