OpenStack Multiple Node Configuration. Second Node Can't Ping Its Instances

Asked by Steven

I am currently trying to setup an OpenStack multi-node network. I have a two computers, compute1 and compute2.

Compute1: nova-network, nova-scheduler, and nova-compute
Compute2: nova-compute

The network is setup to run flatDHCP on a 192.168.0.* network.
I am able to get Compute1 to launch instances and ssh into them, but I cannot ssh into the instances from any other computer.
Also I am unable ssh into instances that are launched from Compute2.

Compute1: ifconfig

br100 Link encap:Ethernet HWaddr fe:16:3e:31:e6:b5
          inet addr:192.168.0.33 Bcast:192.168.0.39 Mask:255.255.255.248
          inet6 addr: fe80::b49e:82ff:fe61:f52d/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:7341 errors:0 dropped:0 overruns:0 frame:0
          TX packets:7526 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:1517824 (1.5 MB) TX bytes:1118721 (1.1 MB)

eth0 Link encap:Ethernet HWaddr 00:21:97:13:08:f4
          inet addr:192.168.0.2 Bcast:192.168.0.255 Mask:255.255.255.0
          inet6 addr: fe80::221:97ff:fe13:8f4/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:16237962 errors:0 dropped:0 overruns:0 frame:0
          TX packets:24821470 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:1234271649 (1.2 GB) TX bytes:34132269792 (34.1 GB)
          Interrupt:42 Base address:0x8000

lo Link encap:Local Loopback
          inet addr:127.0.0.1 Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING MTU:16436 Metric:1
          RX packets:63698149 errors:0 dropped:0 overruns:0 frame:0
          TX packets:63698149 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:5254017459 (5.2 GB) TX bytes:5254017459 (5.2 GB)

virbr0 Link encap:Ethernet HWaddr 6e:84:68:41:b7:8a
          inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

vnet0 Link encap:Ethernet HWaddr fe:16:3e:31:e6:b5
          inet6 addr: fe80::fc16:3eff:fe31:e6b5/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:12 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500
          RX bytes:0 (0.0 B) TX bytes:864 (864.0 B)

Compute1: nova.conf

--dhcpbridge_flagfile=/etc/nova/nova.conf
--dhcpbridge=/usr/bin/nova-dhcpbridge
--logdir=/var/log/nova
--state_path=/var/lib/nova
--lock_path=/var/lock/nova
--verbose
--sql_connection=mysql://root:password@192.168.0.2/nova
--s3_host=192.168.0.2
--rabbit-host=192.168.0.2
--cc_host=192.168.0.2
--ec2_url=http://192.168.0.2:8773/services/Cloud
--network_manager=nova.network.manager.FlatDHCPManager
--flat_network_dhcp_start=192.168.0.2
--fixed_range=192.168.0.0/24
--glance_host=192.168.0.2
--image_service=nova.image.glance.GlanceImageService

Compute2: ifconfig
-- Unlike Compute1, Compute2 did no automatically create br100.

eth0 Link encap:Ethernet HWaddr 00:24:8c:c9:06:a1
          inet addr:192.168.0.4 Bcast:192.168.0.255 Mask:255.255.255.0
          inet6 addr: fe80::224:8cff:fec9:6a1/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:30492 errors:0 dropped:0 overruns:0 frame:0
          TX packets:59678 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:3186697 (3.1 MB) TX bytes:5672036 (5.6 MB)
          Interrupt:28 Base address:0xc000

lo Link encap:Local Loopback
          inet addr:127.0.0.1 Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING MTU:16436 Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

virbr0 Link encap:Ethernet HWaddr 6a:46:56:5e:84:7c
          inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

Compute2: nova.conf

--dhcpbridge_flagfile=/etc/nova/nova.conf
--dhcpbridge=/usr/bin/nova-dhcpbridge
--logdir=/var/log/nova
--state_path=/var/lib/nova
--lock_path=/var/lock/nova
--verbose
--sql_connection=mysql://root:password@192.168.0.2/nova
--s3_host=192.168.0.2
--rabbit_host=192.168.0.2
--cc_host=192.168.0.2
--ec2_url=http://192.168.0.2:8773/services/Cloud
--network_manager=nova.network.manager.FlatDHCPManager
--network_host=192.168.0.2
--flat_network_dhcp_start=192.168.0.2
--fixed_range=192.168.0.0/24
--flat_interface=eth1
--public_interface=eth0
--flat_injected=false
--glance_host=192.168.0.2
--image_service=nova.image.glance.GlanceImageService

Compute2: Instance Console

[ 0.000000] Initializing cgroup subsys cpuset
[ 0.000000] Initializing cgroup subsys cpu
[ 0.000000] Linux version 2.6.35-22-virtual (buildd@yellow) (gcc version 4.4.5 (Ubuntu/Linaro 4.4.4-14ubuntu5) ) #35-Ubuntu SMP Sat Oct 16 23:19:29 UTC 2010 (Ubuntu 2.6.35-22.35-virtual 2.6.35.4)
[ 0.000000] Command line: root=/dev/vda console=ttyS0
[ 0.000000] BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: 0000000000000000 - 000000000009f000 (usable)
[ 0.000000] BIOS-e820: 000000000009f000 - 00000000000a0000 (reserved)
[ 0.000000] BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
[ 0.000000] BIOS-e820: 0000000000100000 - 000000007fffb000 (usable)
[ 0.000000] BIOS-e820: 000000007fffb000 - 0000000080000000 (reserved)
[ 0.000000] BIOS-e820: 00000000fffbc000 - 0000000100000000 (reserved)
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] DMI 2.4 present.
[ 0.000000] No AGP bridge found
[ 0.000000] last_pfn = 0x7fffb max_arch_pfn = 0x400000000
[ 0.000000] x86 PAT enabled: cpu 0, old 0x0, new 0x7010600070106
[ 0.000000] Scanning 1 areas for low memory corruption
[ 0.000000] modified physical RAM map:
[ 0.000000] modified: 0000000000000000 - 0000000000010000 (reserved)
[ 0.000000] modified: 0000000000010000 - 000000000009f000 (usable)
[ 0.000000] modified: 000000000009f000 - 00000000000a0000 (reserved)
[ 0.000000] modified: 00000000000f0000 - 0000000000100000 (reserved)
[ 0.000000] modified: 0000000000100000 - 000000007fffb000 (usable)
[ 0.000000] modified: 000000007fffb000 - 0000000080000000 (reserved)
[ 0.000000] modified: 00000000fffbc000 - 0000000100000000 (reserved)
[ 0.000000] found SMP MP-table at [ffff8800000f8980] f8980
[ 0.000000] init_memory_mapping: 0000000000000000-000000007fffb000
[ 0.000000] RAMDISK: 7fa53000 - 7fff0000
[ 0.000000] ACPI: RSDP 00000000000f8930 00014 (v00 BOCHS )
[ 0.000000] ACPI: RSDT 000000007fffde30 00034 (v01 BOCHS BXPCRSDT 00000001 BXPC 00000001)
[ 0.000000] ACPI: FACP 000000007ffffe70 00074 (v01 BOCHS BXPCFACP 00000001 BXPC 00000001)
[ 0.000000] ACPI: DSDT 000000007fffdfd0 01E22 (v01 BXPC BXDSDT 00000001 INTL 20090123)
[ 0.000000] ACPI: FACS 000000007ffffe00 00040
[ 0.000000] ACPI: SSDT 000000007fffdf90 00037 (v01 BOCHS BXPCSSDT 00000001 BXPC 00000001)
[ 0.000000] ACPI: APIC 000000007fffdeb0 00072 (v01 BOCHS BXPCAPIC 00000001 BXPC 00000001)
[ 0.000000] ACPI: HPET 000000007fffde70 00038 (v01 BOCHS BXPCHPET 00000001 BXPC 00000001)
[ 0.000000] No NUMA configuration found
[ 0.000000] Faking a node at 0000000000000000-000000007fffb000
[ 0.000000] Initmem setup node 0 0000000000000000-000000007fffb000
[ 0.000000] NODE_DATA [0000000001d1b080 - 0000000001d2007f]
[ 0.000000] kvm-clock: Using msrs 12 and 11
[ 0.000000] kvm-clock: cpu 0, msr 0:1b02901, boot clock
[ 0.000000] Zone PFN ranges:
[ 0.000000] DMA 0x00000010 -> 0x00001000
[ 0.000000] DMA32 0x00001000 -> 0x00100000
[ 0.000000] Normal empty
[ 0.000000] Movable zone start PFN for each node
[ 0.000000] early_node_map[2] active PFN ranges
[ 0.000000] 0: 0x00000010 -> 0x0000009f
[ 0.000000] 0: 0x00000100 -> 0x0007fffb
[ 0.000000] ACPI: PM-Timer IO Port: 0xb008
[ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[ 0.000000] ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
[ 0.000000] IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-23
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
[ 0.000000] Using ACPI (MADT) for SMP configuration information
[ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[ 0.000000] SMP: Allowing 1 CPUs, 0 hotplug CPUs
[ 0.000000] PM: Registered nosave memory: 000000000009f000 - 00000000000a0000
[ 0.000000] PM: Registered nosave memory: 00000000000a0000 - 00000000000f0000
[ 0.000000] PM: Registered nosave memory: 00000000000f0000 - 0000000000100000
[ 0.000000] Allocating PCI resources starting at 80000000 (gap: 80000000:7ffbc000)
[ 0.000000] Booting paravirtualized kernel on KVM
[ 0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:1 nr_node_ids:1
[ 0.000000] PERCPU: Embedded 30 pages/cpu @ffff880001e00000 s91520 r8192 d23168 u2097152
[ 0.000000] pcpu-alloc: s91520 r8192 d23168 u2097152 alloc=1*2097152
[ 0.000000] pcpu-alloc: [0] 0
[ 0.000000] kvm-clock: cpu 0, msr 0:1e15901, primary cpu clock
[ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 517002
[ 0.000000] Policy zone: DMA32
[ 0.000000] Kernel command line: root=/dev/vda console=ttyS0
[ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.000000] Checking aperture...
[ 0.000000] No AGP bridge found
[ 0.000000] Subtract (41 early reservations)
[ 0.000000] #1 [0001000000 - 0001d1a954] TEXT DATA BSS
[ 0.000000] #2 [007fa53000 - 007fff0000] RAMDISK
[ 0.000000] #3 [0001d1b000 - 0001d1b071] BRK
[ 0.000000] #4 [000009f000 - 00000f8980] BIOS reserved
[ 0.000000] #5 [00000f8980 - 00000f8990] MP-table mpf
[ 0.000000] #6 [00000f8a88 - 0000100000] BIOS reserved
[ 0.000000] #7 [00000f8990 - 00000f8a88] MP-table mpc
[ 0.000000] #8 [0000010000 - 0000012000] TRAMPOLINE
[ 0.000000] #9 [0000012000 - 0000016000] ACPI WAKEUP
[ 0.000000] #10 [0000016000 - 0000018000] PGTABLE
[ 0.000000] #11 [0001d1b080 - 0001d20080] NODE_DATA
[ 0.000000] #12 [0001d20080 - 0001d21080] BOOTMEM
[ 0.000000] #13 [0000018000 - 0000018180] BOOTMEM
[ 0.000000] #14 [0002522000 - 0002523000] BOOTMEM
[ 0.000000] #15 [0002523000 - 0002524000] BOOTMEM
[ 0.000000] #16 [0002600000 - 0004200000] MEMMAP 0
[ 0.000000] #17 [0001d21080 - 0001d39080] BOOTMEM
[ 0.000000] #18 [0001d39080 - 0001d51080] BOOTMEM
[ 0.000000] #19 [0001d52000 - 0001d53000] BOOTMEM
[ 0.000000] #20 [0001d1a980 - 0001d1a9c1] BOOTMEM
[ 0.000000] #21 [0001d1aa00 - 0001d1aa43] BOOTMEM
[ 0.000000] #22 [0001d1aa80 - 0001d1ac08] BOOTMEM
[ 0.000000] #23 [0001d1ac40 - 0001d1aca8] BOOTMEM
[ 0.000000] #24 [0001d1acc0 - 0001d1ad28] BOOTMEM
[ 0.000000] #25 [0001d1ad40 - 0001d1ada8] BOOTMEM
[ 0.000000] #26 [0001d1adc0 - 0001d1ae28] BOOTMEM
[ 0.000000] #27 [0001d1ae40 - 0001d1aea8] BOOTMEM
[ 0.000000] #28 [0001d1aec0 - 0001d1af28] BOOTMEM
[ 0.000000] #29 [0001d1af40 - 0001d1af60] BOOTMEM
[ 0.000000] #30 [0001d1af80 - 0001d1af9c] BOOTMEM
[ 0.000000] #31 [0001d1afc0 - 0001d1afdc] BOOTMEM
[ 0.000000] #32 [0001e00000 - 0001e1e000] BOOTMEM
[ 0.000000] #33 [0001d51080 - 0001d51088] BOOTMEM
[ 0.000000] #34 [0001d510c0 - 0001d510c8] BOOTMEM
[ 0.000000] #35 [0001d51100 - 0001d51104] BOOTMEM
[ 0.000000] #36 [0001d51140 - 0001d51148] BOOTMEM
[ 0.000000] #37 [0001d51180 - 0001d512d0] BOOTMEM
[ 0.000000] #38 [0001d51300 - 0001d51380] BOOTMEM
[ 0.000000] #39 [0001d51380 - 0001d51400] BOOTMEM
[ 0.000000] #40 [0001d53000 - 0001d5b000] BOOTMEM
[ 0.000000] Memory: 2048420k/2097132k available (5816k kernel code, 452k absent, 48260k reserved, 5366k data, 828k init)
[ 0.000000] SLUB: Genslabs=14, HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[ 0.000000] Hierarchical RCU implementation.
[ 0.000000] RCU dyntick-idle grace-period acceleration is enabled.
[ 0.000000] RCU-based detection of stalled CPUs is disabled.
[ 0.000000] Verbose stalled-CPUs detection is disabled.
[ 0.000000] NR_IRQS:4352 nr_irqs:256
[ 0.000000] Console: colour VGA+ 80x25
[ 0.000000] console [ttyS0] enabled
[ 0.000000] allocated 20971520 bytes of page_cgroup
[ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[ 0.000000] Detected 3008.686 MHz processor.
[ 0.060000] Calibrating delay loop (skipped) preset value.. 6017.37 BogoMIPS (lpj=30086860)
[ 0.060000] pid_max: default: 32768 minimum: 301
[ 0.060000] Security Framework initialized
[ 0.060000] AppArmor: AppArmor initialized
[ 0.060000] Yama: becoming mindful.
[ 0.060000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes)
[ 0.060000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[ 0.060000] Mount-cache hash table entries: 256
[ 0.060000] Initializing cgroup subsys ns
[ 0.060000] Initializing cgroup subsys cpuacct
[ 0.060000] Initializing cgroup subsys memory
[ 0.060000] Initializing cgroup subsys devices
[ 0.060000] Initializing cgroup subsys freezer
[ 0.060000] Initializing cgroup subsys net_cls
[ 0.060074] mce: CPU supports 10 MCE banks
[ 0.060532] Performance Events: AMD PMU driver.
[ 0.060924] ... version: 0
[ 0.061324] ... bit width: 48
[ 0.061687] ... generic registers: 4
[ 0.062016] ... value mask: 0000ffffffffffff
[ 0.062539] ... max period: 00007fffffffffff
[ 0.062972] ... fixed-purpose events: 0
[ 0.063381] ... event mask: 000000000000000f
[ 0.063991] SMP alternatives: switching to UP code
[ 0.094344] Freeing SMP alternatives: 24k freed
[ 0.094864] ACPI: Core revision 20100428
[ 0.097000] ftrace: converting mcount calls to 0f 1f 44 00 00
[ 0.097475] ftrace: allocating 23035 entries in 91 pages
[ 0.100135] Setting APIC routing to flat
[ 0.101517] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 0.102134] CPU0: AMD QEMU Virtual CPU version 0.12.3 stepping 03
[ 0.110000] Brought up 1 CPUs
[ 0.110000] Total of 1 processors activated (6017.37 BogoMIPS).
[ 0.110000] devtmpfs: initialized
[ 0.110000] regulator: core version 0.5
[ 0.110000] Time: 17:32:28 Date: 05/17/11
[ 0.110000] NET: Registered protocol family 16
[ 0.110000] ACPI: bus type pci registered
[ 0.110000] PCI: Using configuration type 1 for base access
[ 0.110000] bio: create slab <bio-0> at 0
[ 0.110163] ACPI: Interpreter enabled
[ 0.110587] ACPI: (supports S0 S3 S4 S5)
[ 0.111011] ACPI: Using IOAPIC for interrupt routing
[ 0.113322] ACPI: No dock devices found.
[ 0.113789] PCI: Ignoring host bridge windows from ACPI; if necessary, use "pci=use_crs" and report a bug
[ 0.114731] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[ 0.116428] pci 0000:00:01.3: quirk: [io 0xb000-0xb03f] claimed by PIIX4 ACPI
[ 0.117183] pci 0000:00:01.3: quirk: [io 0xb100-0xb10f] claimed by PIIX4 SMB
[ 0.125106] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
[ 0.125826] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
[ 0.126486] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
[ 0.127201] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
[ 0.127800] HEST: Table is not found!
[ 0.128438] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
[ 0.129257] vgaarb: loaded
[ 0.129717] SCSI subsystem initialized
[ 0.130250] usbcore: registered new interface driver usbfs
[ 0.130825] usbcore: registered new interface driver hub
[ 0.131704] usbcore: registered new device driver usb
[ 0.132723] ACPI: WMI: Mapper loaded
[ 0.133231] PCI: Using ACPI for IRQ routing
[ 0.133951] NetLabel: Initializing
[ 0.134331] NetLabel: domain hash size = 128
[ 0.134759] NetLabel: protocols = UNLABELED CIPSOv4
[ 0.135288] NetLabel: unlabeled traffic allowed by default
[ 0.135877] HPET: 3 timers in total, 0 timers will be used for per-cpu timer
[ 0.136636] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[ 0.137130] hpet0: 3 comparators, 64-bit 100.000000 MHz counter
[ 0.150037] Switching to clocksource kvm-clock
[ 0.161214] AppArmor: AppArmor Filesystem Enabled
[ 0.161874] pnp: PnP ACPI init
[ 0.162287] ACPI: bus type pnp registered
[ 0.163417] pnp: PnP ACPI: found 6 devices
[ 0.163800] ACPI: ACPI bus type pnp unregistered
[ 0.170091] NET: Registered protocol family 2
[ 0.170696] IP route cache hash table entries: 65536 (order: 7, 524288 bytes)
[ 0.172478] TCP established hash table entries: 262144 (order: 10, 4194304 bytes)
[ 0.177467] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[ 0.179254] TCP: Hash tables configured (established 262144 bind 65536)
[ 0.179936] TCP reno registered
[ 0.180300] UDP hash table entries: 1024 (order: 3, 32768 bytes)
[ 0.180899] UDP-Lite hash table entries: 1024 (order: 3, 32768 bytes)
[ 0.181698] NET: Registered protocol family 1
[ 0.182194] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
[ 0.182786] pci 0000:00:01.0: PIIX3: Enabling Passive Release
[ 0.183434] pci 0000:00:01.0: Activating ISA DMA hang workarounds
[ 0.184348] Scanning for low memory corruption every 60 seconds
[ 0.185060] audit: initializing netlink socket (disabled)
[ 0.185573] type=2000 audit(1305653548.180:1): initialized
[ 0.195578] Trying to unpack rootfs image as initramfs...
[ 0.232142] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[ 0.233886] VFS: Disk quotas dquot_6.5.2
[ 0.234305] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 0.240246] fuse init (API version 7.14)
[ 0.240712] msgmni has been set to 4000
[ 0.250316] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253)
[ 0.251010] io scheduler noop registered
[ 0.251373] io scheduler deadline registered (default)
[ 0.251874] io scheduler cfq registered
[ 0.252327] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[ 0.252866] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[ 0.253619] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[ 0.254298] ACPI: Power Button [PWRF]
[ 0.255481] ERST: Table is not found!
[ 0.255991] ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11
[ 0.256543] virtio-pci 0000:00:04.0: PCI INT A -> Link[LNKD] -> GSI 11 (level, high) -> IRQ 11
[ 0.257516] ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 10
[ 0.258059] virtio-pci 0000:00:05.0: PCI INT A -> Link[LNKA] -> GSI 10 (level, high) -> IRQ 10
[ 0.258996] ACPI: PCI Interrupt Link [LNKB] enabled at IRQ 10
[ 0.259527] virtio-pci 0000:00:06.0: PCI INT A -> Link[LNKB] -> GSI 10 (level, high) -> IRQ 10
[ 0.260509] Linux agpgart interface v0.103
[ 0.260914] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[ 0.261683] serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[ 0.262391] serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[ 0.263945] brd: module loaded
[ 0.264626] loop: module loaded
[ 0.265455] vda: unknown partition table
[ 0.281126] vdb: unknown partition table
[ 0.290189] scsi0 : ata_piix
[ 0.290586] scsi1 : ata_piix
[ 0.290886] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc000 irq 14
[ 0.291514] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc008 irq 15
[ 0.292376] Fixed MDIO Bus: probed
[ 0.292721] PPP generic driver version 2.4.2
[ 0.293187] tun: Universal TUN/TAP device driver, 1.6
[ 0.293660] tun: (C) 1999-2004 Max Krasnyansky <email address hidden>
[ 0.294328] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[ 0.294951] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[ 0.295627] uhci_hcd: USB Universal Host Controller Interface driver
[ 0.296264] uhci_hcd 0000:00:01.2: PCI INT D -> Link[LNKD] -> GSI 11 (level, high) -> IRQ 11
[ 0.297069] uhci_hcd 0000:00:01.2: UHCI Host Controller
[ 0.297588] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1
[ 0.298367] uhci_hcd 0000:00:01.2: irq 11, io base 0x0000c020
[ 0.299061] hub 1-0:1.0: USB hub found
[ 0.299503] hub 1-0:1.0: 2 ports detected
[ 0.300024] PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
[ 0.301363] serio: i8042 KBD port at 0x60,0x64 irq 1
[ 0.301918] serio: i8042 AUX port at 0x60,0x64 irq 12
[ 0.302469] mice: PS/2 mouse device common for all mice
[ 0.303158] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0
[ 0.303887] rtc0: alarms up to one day, 114 bytes nvram, hpet irqs
[ 0.304626] device-mapper: uevent: version 1.0.3
[ 0.305357] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
[ 0.320269] device-mapper: ioctl: 4.17.0-ioctl (2010-03-05) initialised: <email address hidden>
[ 0.321245] device-mapper: multipath: version 1.1.1 loaded
[ 0.321817] device-mapper: multipath round-robin: version 1.0.0 loaded
[ 0.327546] Freeing initrd memory: 5748k freed
[ 0.330621] cpuidle: using governor ladder
[ 0.331031] cpuidle: using governor menu
[ 0.331665] TCP cubic registered
[ 0.332074] NET: Registered protocol family 10
[ 0.332894] lo: Disabled Privacy Extensions
[ 0.333462] NET: Registered protocol family 17
[ 0.333970] powernow-k8: Processor cpuid 623 not supported
[ 0.334640] registered taskstats version 1
[ 0.335194] Magic number: 11:551:542
[ 0.335667] rtc_cmos 00:01: setting system clock to 2011-05-17 17:32:28 UTC (1305653548)
[ 0.336445] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
[ 0.337098] EDD information not available.
[ 0.470490] Freeing unused kernel memory: 828k freed
[ 0.473751] Write protecting the kernel read-only data: 10240k
[ 0.476278] Freeing unused kernel memory: 308k freed
[ 0.481092] Freeing unused kernel memory: 1620k freed
Used vda for root filesystem
pivot_root: Invalid argument

init started: BusyBox v1.17.2 (2010-10-17 16:10:18 MST)
stty: /dev/console

ttylinux 12.1
 > http://ttylinux.org/
 > hostname: ttylinux_host

load Kernel Module: acpiphp [ OK ]
load Kernel Module: e1000 [ OK ]
load Kernel Module: ne2k-pci [ OK ]
[ 0.763441] ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 11
load Kernel Module: 8139cp [ OK ]
load Kernel Module: pcnet32 [ OK ]
load Kernel Module: mii [ OK ]
load Kernel Module: ip_tables [ OK ]
file systems checked [ OK ]
mounting local file systems [ OK ]
setting up system clock [utc] Tue May 17 17:32:28 UTC 2011 [ OK ]
stty: /dev/console
stty: /dev/console
initializing random number generator [WATING][-11G.. [ OK ]
stty: /dev/console
startup klogd [ OK ]
startup syslogd [ OK ]
stty: /dev/console
stty: /dev/console
bringing up loopback interface lo [ OK ]
stty: /dev/console
udhcpc (v1.17.2) started
Sending discover...
Sending discover...
Sending discover...
No lease, forking to background
starting DHCP forEthernet interface eth0 [ OK ]
cloud-setup: checking http://169.254.169.254/2009-04-04/meta-data/instance-id
wget: can't connect to remote host (169.254.169.254): Network is unreachable
cloud-setup: failed 1/30: up 9.99. request failed
wget: can't connect to remote host (169.254.169.254): Network is unreachable
cloud-setup: failed 2/30: up 10.99. request failed
wget: can't connect to remote host (169.254.169.254): Network is unreachable
cloud-setup: failed 3/30: up 12.00. request failed
.....

That goes on for about 27 more times.

I read another post with similar problems with DHCP.
We've removed any other DHCP or DNS servers from the network to keep them from interfering.

Again, Compute1 launches and can ping/ssh its instances, but no one else ping/ssh them and Compute2 cannot ping/ssh any of the instances it launches.

Let me know if i've left out any information. Thanks ahead of time.

Question information

Language:
English Edit question
Status:
Solved
For:
OpenStack Compute (nova) Edit question
Assignee:
No assignee Edit question
Solved by:
Vish Ishaya
Solved:
Last query:
Last reply:
Revision history for this message
Best Vish Ishaya (vishvananda) said :
#1

It looks like you only have eth0 active so setting --flat_interface=eth1 will not work

Vish

On May 17, 2011, at 10:41 AM, Steven wrote:

> New question #157925 on OpenStack Compute (nova):
> https://answers.launchpad.net/nova/+question/157925
>
> I am currently trying to setup an OpenStack multi-node network. I have a two computers, compute1 and compute2.
>
> Compute1: nova-network, nova-scheduler, and nova-compute
> Compute2: nova-compute
>
> The network is setup to run flatDHCP on a 192.168.0.* network.
> I am able to get Compute1 to launch instances and ssh into them, but I cannot ssh into the instances from any other computer.
> Also I am unable ssh into instances that are launched from Compute2.
>
> Compute1: ifconfig
>
> br100 Link encap:Ethernet HWaddr fe:16:3e:31:e6:b5
> inet addr:192.168.0.33 Bcast:192.168.0.39 Mask:255.255.255.248
> inet6 addr: fe80::b49e:82ff:fe61:f52d/64 Scope:Link
> UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
> RX packets:7341 errors:0 dropped:0 overruns:0 frame:0
> TX packets:7526 errors:0 dropped:0 overruns:0 carrier:0
> collisions:0 txqueuelen:0
> RX bytes:1517824 (1.5 MB) TX bytes:1118721 (1.1 MB)
>
> eth0 Link encap:Ethernet HWaddr 00:21:97:13:08:f4
> inet addr:192.168.0.2 Bcast:192.168.0.255 Mask:255.255.255.0
> inet6 addr: fe80::221:97ff:fe13:8f4/64 Scope:Link
> UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
> RX packets:16237962 errors:0 dropped:0 overruns:0 frame:0
> TX packets:24821470 errors:0 dropped:0 overruns:0 carrier:0
> collisions:0 txqueuelen:1000
> RX bytes:1234271649 (1.2 GB) TX bytes:34132269792 (34.1 GB)
> Interrupt:42 Base address:0x8000
>
> lo Link encap:Local Loopback
> inet addr:127.0.0.1 Mask:255.0.0.0
> inet6 addr: ::1/128 Scope:Host
> UP LOOPBACK RUNNING MTU:16436 Metric:1
> RX packets:63698149 errors:0 dropped:0 overruns:0 frame:0
> TX packets:63698149 errors:0 dropped:0 overruns:0 carrier:0
> collisions:0 txqueuelen:0
> RX bytes:5254017459 (5.2 GB) TX bytes:5254017459 (5.2 GB)
>
> virbr0 Link encap:Ethernet HWaddr 6e:84:68:41:b7:8a
> inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0
> UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
> RX packets:0 errors:0 dropped:0 overruns:0 frame:0
> TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
> collisions:0 txqueuelen:0
> RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
>
> vnet0 Link encap:Ethernet HWaddr fe:16:3e:31:e6:b5
> inet6 addr: fe80::fc16:3eff:fe31:e6b5/64 Scope:Link
> UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
> RX packets:0 errors:0 dropped:0 overruns:0 frame:0
> TX packets:12 errors:0 dropped:0 overruns:0 carrier:0
> collisions:0 txqueuelen:500
> RX bytes:0 (0.0 B) TX bytes:864 (864.0 B)
>
> Compute1: nova.conf
>
> --dhcpbridge_flagfile=/etc/nova/nova.conf
> --dhcpbridge=/usr/bin/nova-dhcpbridge
> --logdir=/var/log/nova
> --state_path=/var/lib/nova
> --lock_path=/var/lock/nova
> --verbose
> --sql_connection=mysql://root:password@192.168.0.2/nova
> --s3_host=192.168.0.2
> --rabbit-host=192.168.0.2
> --cc_host=192.168.0.2
> --ec2_url=http://192.168.0.2:8773/services/Cloud
> --network_manager=nova.network.manager.FlatDHCPManager
> --flat_network_dhcp_start=192.168.0.2
> --fixed_range=192.168.0.0/24
> --glance_host=192.168.0.2
> --image_service=nova.image.glance.GlanceImageService
>
>
> Compute2: ifconfig
> -- Unlike Compute1, Compute2 did no automatically create br100.
>
> eth0 Link encap:Ethernet HWaddr 00:24:8c:c9:06:a1
> inet addr:192.168.0.4 Bcast:192.168.0.255 Mask:255.255.255.0
> inet6 addr: fe80::224:8cff:fec9:6a1/64 Scope:Link
> UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
> RX packets:30492 errors:0 dropped:0 overruns:0 frame:0
> TX packets:59678 errors:0 dropped:0 overruns:0 carrier:0
> collisions:0 txqueuelen:1000
> RX bytes:3186697 (3.1 MB) TX bytes:5672036 (5.6 MB)
> Interrupt:28 Base address:0xc000
>
> lo Link encap:Local Loopback
> inet addr:127.0.0.1 Mask:255.0.0.0
> inet6 addr: ::1/128 Scope:Host
> UP LOOPBACK RUNNING MTU:16436 Metric:1
> RX packets:0 errors:0 dropped:0 overruns:0 frame:0
> TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
> collisions:0 txqueuelen:0
> RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
>
> virbr0 Link encap:Ethernet HWaddr 6a:46:56:5e:84:7c
> inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0
> UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
> RX packets:0 errors:0 dropped:0 overruns:0 frame:0
> TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
> collisions:0 txqueuelen:0
> RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
>
> Compute2: nova.conf
>
> --dhcpbridge_flagfile=/etc/nova/nova.conf
> --dhcpbridge=/usr/bin/nova-dhcpbridge
> --logdir=/var/log/nova
> --state_path=/var/lib/nova
> --lock_path=/var/lock/nova
> --verbose
> --sql_connection=mysql://root:password@192.168.0.2/nova
> --s3_host=192.168.0.2
> --rabbit_host=192.168.0.2
> --cc_host=192.168.0.2
> --ec2_url=http://192.168.0.2:8773/services/Cloud
> --network_manager=nova.network.manager.FlatDHCPManager
> --network_host=192.168.0.2
> --flat_network_dhcp_start=192.168.0.2
> --fixed_range=192.168.0.0/24
> --flat_interface=eth1
> --public_interface=eth0
> --flat_injected=false
> --glance_host=192.168.0.2
> --image_service=nova.image.glance.GlanceImageService
>
> Compute2: Instance Console
>
> [ 0.000000] Initializing cgroup subsys cpuset
> [ 0.000000] Initializing cgroup subsys cpu
> [ 0.000000] Linux version 2.6.35-22-virtual (buildd@yellow) (gcc version 4.4.5 (Ubuntu/Linaro 4.4.4-14ubuntu5) ) #35-Ubuntu SMP Sat Oct 16 23:19:29 UTC 2010 (Ubuntu 2.6.35-22.35-virtual 2.6.35.4)
> [ 0.000000] Command line: root=/dev/vda console=ttyS0
> [ 0.000000] BIOS-provided physical RAM map:
> [ 0.000000] BIOS-e820: 0000000000000000 - 000000000009f000 (usable)
> [ 0.000000] BIOS-e820: 000000000009f000 - 00000000000a0000 (reserved)
> [ 0.000000] BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
> [ 0.000000] BIOS-e820: 0000000000100000 - 000000007fffb000 (usable)
> [ 0.000000] BIOS-e820: 000000007fffb000 - 0000000080000000 (reserved)
> [ 0.000000] BIOS-e820: 00000000fffbc000 - 0000000100000000 (reserved)
> [ 0.000000] NX (Execute Disable) protection: active
> [ 0.000000] DMI 2.4 present.
> [ 0.000000] No AGP bridge found
> [ 0.000000] last_pfn = 0x7fffb max_arch_pfn = 0x400000000
> [ 0.000000] x86 PAT enabled: cpu 0, old 0x0, new 0x7010600070106
> [ 0.000000] Scanning 1 areas for low memory corruption
> [ 0.000000] modified physical RAM map:
> [ 0.000000] modified: 0000000000000000 - 0000000000010000 (reserved)
> [ 0.000000] modified: 0000000000010000 - 000000000009f000 (usable)
> [ 0.000000] modified: 000000000009f000 - 00000000000a0000 (reserved)
> [ 0.000000] modified: 00000000000f0000 - 0000000000100000 (reserved)
> [ 0.000000] modified: 0000000000100000 - 000000007fffb000 (usable)
> [ 0.000000] modified: 000000007fffb000 - 0000000080000000 (reserved)
> [ 0.000000] modified: 00000000fffbc000 - 0000000100000000 (reserved)
> [ 0.000000] found SMP MP-table at [ffff8800000f8980] f8980
> [ 0.000000] init_memory_mapping: 0000000000000000-000000007fffb000
> [ 0.000000] RAMDISK: 7fa53000 - 7fff0000
> [ 0.000000] ACPI: RSDP 00000000000f8930 00014 (v00 BOCHS )
> [ 0.000000] ACPI: RSDT 000000007fffde30 00034 (v01 BOCHS BXPCRSDT 00000001 BXPC 00000001)
> [ 0.000000] ACPI: FACP 000000007ffffe70 00074 (v01 BOCHS BXPCFACP 00000001 BXPC 00000001)
> [ 0.000000] ACPI: DSDT 000000007fffdfd0 01E22 (v01 BXPC BXDSDT 00000001 INTL 20090123)
> [ 0.000000] ACPI: FACS 000000007ffffe00 00040
> [ 0.000000] ACPI: SSDT 000000007fffdf90 00037 (v01 BOCHS BXPCSSDT 00000001 BXPC 00000001)
> [ 0.000000] ACPI: APIC 000000007fffdeb0 00072 (v01 BOCHS BXPCAPIC 00000001 BXPC 00000001)
> [ 0.000000] ACPI: HPET 000000007fffde70 00038 (v01 BOCHS BXPCHPET 00000001 BXPC 00000001)
> [ 0.000000] No NUMA configuration found
> [ 0.000000] Faking a node at 0000000000000000-000000007fffb000
> [ 0.000000] Initmem setup node 0 0000000000000000-000000007fffb000
> [ 0.000000] NODE_DATA [0000000001d1b080 - 0000000001d2007f]
> [ 0.000000] kvm-clock: Using msrs 12 and 11
> [ 0.000000] kvm-clock: cpu 0, msr 0:1b02901, boot clock
> [ 0.000000] Zone PFN ranges:
> [ 0.000000] DMA 0x00000010 -> 0x00001000
> [ 0.000000] DMA32 0x00001000 -> 0x00100000
> [ 0.000000] Normal empty
> [ 0.000000] Movable zone start PFN for each node
> [ 0.000000] early_node_map[2] active PFN ranges
> [ 0.000000] 0: 0x00000010 -> 0x0000009f
> [ 0.000000] 0: 0x00000100 -> 0x0007fffb
> [ 0.000000] ACPI: PM-Timer IO Port: 0xb008
> [ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
> [ 0.000000] ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
> [ 0.000000] IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-23
> [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
> [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
> [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
> [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
> [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
> [ 0.000000] Using ACPI (MADT) for SMP configuration information
> [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
> [ 0.000000] SMP: Allowing 1 CPUs, 0 hotplug CPUs
> [ 0.000000] PM: Registered nosave memory: 000000000009f000 - 00000000000a0000
> [ 0.000000] PM: Registered nosave memory: 00000000000a0000 - 00000000000f0000
> [ 0.000000] PM: Registered nosave memory: 00000000000f0000 - 0000000000100000
> [ 0.000000] Allocating PCI resources starting at 80000000 (gap: 80000000:7ffbc000)
> [ 0.000000] Booting paravirtualized kernel on KVM
> [ 0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:1 nr_node_ids:1
> [ 0.000000] PERCPU: Embedded 30 pages/cpu @ffff880001e00000 s91520 r8192 d23168 u2097152
> [ 0.000000] pcpu-alloc: s91520 r8192 d23168 u2097152 alloc=1*2097152
> [ 0.000000] pcpu-alloc: [0] 0
> [ 0.000000] kvm-clock: cpu 0, msr 0:1e15901, primary cpu clock
> [ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 517002
> [ 0.000000] Policy zone: DMA32
> [ 0.000000] Kernel command line: root=/dev/vda console=ttyS0
> [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
> [ 0.000000] Checking aperture...
> [ 0.000000] No AGP bridge found
> [ 0.000000] Subtract (41 early reservations)
> [ 0.000000] #1 [0001000000 - 0001d1a954] TEXT DATA BSS
> [ 0.000000] #2 [007fa53000 - 007fff0000] RAMDISK
> [ 0.000000] #3 [0001d1b000 - 0001d1b071] BRK
> [ 0.000000] #4 [000009f000 - 00000f8980] BIOS reserved
> [ 0.000000] #5 [00000f8980 - 00000f8990] MP-table mpf
> [ 0.000000] #6 [00000f8a88 - 0000100000] BIOS reserved
> [ 0.000000] #7 [00000f8990 - 00000f8a88] MP-table mpc
> [ 0.000000] #8 [0000010000 - 0000012000] TRAMPOLINE
> [ 0.000000] #9 [0000012000 - 0000016000] ACPI WAKEUP
> [ 0.000000] #10 [0000016000 - 0000018000] PGTABLE
> [ 0.000000] #11 [0001d1b080 - 0001d20080] NODE_DATA
> [ 0.000000] #12 [0001d20080 - 0001d21080] BOOTMEM
> [ 0.000000] #13 [0000018000 - 0000018180] BOOTMEM
> [ 0.000000] #14 [0002522000 - 0002523000] BOOTMEM
> [ 0.000000] #15 [0002523000 - 0002524000] BOOTMEM
> [ 0.000000] #16 [0002600000 - 0004200000] MEMMAP 0
> [ 0.000000] #17 [0001d21080 - 0001d39080] BOOTMEM
> [ 0.000000] #18 [0001d39080 - 0001d51080] BOOTMEM
> [ 0.000000] #19 [0001d52000 - 0001d53000] BOOTMEM
> [ 0.000000] #20 [0001d1a980 - 0001d1a9c1] BOOTMEM
> [ 0.000000] #21 [0001d1aa00 - 0001d1aa43] BOOTMEM
> [ 0.000000] #22 [0001d1aa80 - 0001d1ac08] BOOTMEM
> [ 0.000000] #23 [0001d1ac40 - 0001d1aca8] BOOTMEM
> [ 0.000000] #24 [0001d1acc0 - 0001d1ad28] BOOTMEM
> [ 0.000000] #25 [0001d1ad40 - 0001d1ada8] BOOTMEM
> [ 0.000000] #26 [0001d1adc0 - 0001d1ae28] BOOTMEM
> [ 0.000000] #27 [0001d1ae40 - 0001d1aea8] BOOTMEM
> [ 0.000000] #28 [0001d1aec0 - 0001d1af28] BOOTMEM
> [ 0.000000] #29 [0001d1af40 - 0001d1af60] BOOTMEM
> [ 0.000000] #30 [0001d1af80 - 0001d1af9c] BOOTMEM
> [ 0.000000] #31 [0001d1afc0 - 0001d1afdc] BOOTMEM
> [ 0.000000] #32 [0001e00000 - 0001e1e000] BOOTMEM
> [ 0.000000] #33 [0001d51080 - 0001d51088] BOOTMEM
> [ 0.000000] #34 [0001d510c0 - 0001d510c8] BOOTMEM
> [ 0.000000] #35 [0001d51100 - 0001d51104] BOOTMEM
> [ 0.000000] #36 [0001d51140 - 0001d51148] BOOTMEM
> [ 0.000000] #37 [0001d51180 - 0001d512d0] BOOTMEM
> [ 0.000000] #38 [0001d51300 - 0001d51380] BOOTMEM
> [ 0.000000] #39 [0001d51380 - 0001d51400] BOOTMEM
> [ 0.000000] #40 [0001d53000 - 0001d5b000] BOOTMEM
> [ 0.000000] Memory: 2048420k/2097132k available (5816k kernel code, 452k absent, 48260k reserved, 5366k data, 828k init)
> [ 0.000000] SLUB: Genslabs=14, HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
> [ 0.000000] Hierarchical RCU implementation.
> [ 0.000000] RCU dyntick-idle grace-period acceleration is enabled.
> [ 0.000000] RCU-based detection of stalled CPUs is disabled.
> [ 0.000000] Verbose stalled-CPUs detection is disabled.
> [ 0.000000] NR_IRQS:4352 nr_irqs:256
> [ 0.000000] Console: colour VGA+ 80x25
> [ 0.000000] console [ttyS0] enabled
> [ 0.000000] allocated 20971520 bytes of page_cgroup
> [ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
> [ 0.000000] Detected 3008.686 MHz processor.
> [ 0.060000] Calibrating delay loop (skipped) preset value.. 6017.37 BogoMIPS (lpj=30086860)
> [ 0.060000] pid_max: default: 32768 minimum: 301
> [ 0.060000] Security Framework initialized
> [ 0.060000] AppArmor: AppArmor initialized
> [ 0.060000] Yama: becoming mindful.
> [ 0.060000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes)
> [ 0.060000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes)
> [ 0.060000] Mount-cache hash table entries: 256
> [ 0.060000] Initializing cgroup subsys ns
> [ 0.060000] Initializing cgroup subsys cpuacct
> [ 0.060000] Initializing cgroup subsys memory
> [ 0.060000] Initializing cgroup subsys devices
> [ 0.060000] Initializing cgroup subsys freezer
> [ 0.060000] Initializing cgroup subsys net_cls
> [ 0.060074] mce: CPU supports 10 MCE banks
> [ 0.060532] Performance Events: AMD PMU driver.
> [ 0.060924] ... version: 0
> [ 0.061324] ... bit width: 48
> [ 0.061687] ... generic registers: 4
> [ 0.062016] ... value mask: 0000ffffffffffff
> [ 0.062539] ... max period: 00007fffffffffff
> [ 0.062972] ... fixed-purpose events: 0
> [ 0.063381] ... event mask: 000000000000000f
> [ 0.063991] SMP alternatives: switching to UP code
> [ 0.094344] Freeing SMP alternatives: 24k freed
> [ 0.094864] ACPI: Core revision 20100428
> [ 0.097000] ftrace: converting mcount calls to 0f 1f 44 00 00
> [ 0.097475] ftrace: allocating 23035 entries in 91 pages
> [ 0.100135] Setting APIC routing to flat
> [ 0.101517] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
> [ 0.102134] CPU0: AMD QEMU Virtual CPU version 0.12.3 stepping 03
> [ 0.110000] Brought up 1 CPUs
> [ 0.110000] Total of 1 processors activated (6017.37 BogoMIPS).
> [ 0.110000] devtmpfs: initialized
> [ 0.110000] regulator: core version 0.5
> [ 0.110000] Time: 17:32:28 Date: 05/17/11
> [ 0.110000] NET: Registered protocol family 16
> [ 0.110000] ACPI: bus type pci registered
> [ 0.110000] PCI: Using configuration type 1 for base access
> [ 0.110000] bio: create slab <bio-0> at 0
> [ 0.110163] ACPI: Interpreter enabled
> [ 0.110587] ACPI: (supports S0 S3 S4 S5)
> [ 0.111011] ACPI: Using IOAPIC for interrupt routing
> [ 0.113322] ACPI: No dock devices found.
> [ 0.113789] PCI: Ignoring host bridge windows from ACPI; if necessary, use "pci=use_crs" and report a bug
> [ 0.114731] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
> [ 0.116428] pci 0000:00:01.3: quirk: [io 0xb000-0xb03f] claimed by PIIX4 ACPI
> [ 0.117183] pci 0000:00:01.3: quirk: [io 0xb100-0xb10f] claimed by PIIX4 SMB
> [ 0.125106] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
> [ 0.125826] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
> [ 0.126486] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
> [ 0.127201] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
> [ 0.127800] HEST: Table is not found!
> [ 0.128438] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
> [ 0.129257] vgaarb: loaded
> [ 0.129717] SCSI subsystem initialized
> [ 0.130250] usbcore: registered new interface driver usbfs
> [ 0.130825] usbcore: registered new interface driver hub
> [ 0.131704] usbcore: registered new device driver usb
> [ 0.132723] ACPI: WMI: Mapper loaded
> [ 0.133231] PCI: Using ACPI for IRQ routing
> [ 0.133951] NetLabel: Initializing
> [ 0.134331] NetLabel: domain hash size = 128
> [ 0.134759] NetLabel: protocols = UNLABELED CIPSOv4
> [ 0.135288] NetLabel: unlabeled traffic allowed by default
> [ 0.135877] HPET: 3 timers in total, 0 timers will be used for per-cpu timer
> [ 0.136636] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
> [ 0.137130] hpet0: 3 comparators, 64-bit 100.000000 MHz counter
> [ 0.150037] Switching to clocksource kvm-clock
> [ 0.161214] AppArmor: AppArmor Filesystem Enabled
> [ 0.161874] pnp: PnP ACPI init
> [ 0.162287] ACPI: bus type pnp registered
> [ 0.163417] pnp: PnP ACPI: found 6 devices
> [ 0.163800] ACPI: ACPI bus type pnp unregistered
> [ 0.170091] NET: Registered protocol family 2
> [ 0.170696] IP route cache hash table entries: 65536 (order: 7, 524288 bytes)
> [ 0.172478] TCP established hash table entries: 262144 (order: 10, 4194304 bytes)
> [ 0.177467] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
> [ 0.179254] TCP: Hash tables configured (established 262144 bind 65536)
> [ 0.179936] TCP reno registered
> [ 0.180300] UDP hash table entries: 1024 (order: 3, 32768 bytes)
> [ 0.180899] UDP-Lite hash table entries: 1024 (order: 3, 32768 bytes)
> [ 0.181698] NET: Registered protocol family 1
> [ 0.182194] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
> [ 0.182786] pci 0000:00:01.0: PIIX3: Enabling Passive Release
> [ 0.183434] pci 0000:00:01.0: Activating ISA DMA hang workarounds
> [ 0.184348] Scanning for low memory corruption every 60 seconds
> [ 0.185060] audit: initializing netlink socket (disabled)
> [ 0.185573] type=2000 audit(1305653548.180:1): initialized
> [ 0.195578] Trying to unpack rootfs image as initramfs...
> [ 0.232142] HugeTLB registered 2 MB page size, pre-allocated 0 pages
> [ 0.233886] VFS: Disk quotas dquot_6.5.2
> [ 0.234305] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
> [ 0.240246] fuse init (API version 7.14)
> [ 0.240712] msgmni has been set to 4000
> [ 0.250316] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253)
> [ 0.251010] io scheduler noop registered
> [ 0.251373] io scheduler deadline registered (default)
> [ 0.251874] io scheduler cfq registered
> [ 0.252327] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
> [ 0.252866] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
> [ 0.253619] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
> [ 0.254298] ACPI: Power Button [PWRF]
> [ 0.255481] ERST: Table is not found!
> [ 0.255991] ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11
> [ 0.256543] virtio-pci 0000:00:04.0: PCI INT A -> Link[LNKD] -> GSI 11 (level, high) -> IRQ 11
> [ 0.257516] ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 10
> [ 0.258059] virtio-pci 0000:00:05.0: PCI INT A -> Link[LNKA] -> GSI 10 (level, high) -> IRQ 10
> [ 0.258996] ACPI: PCI Interrupt Link [LNKB] enabled at IRQ 10
> [ 0.259527] virtio-pci 0000:00:06.0: PCI INT A -> Link[LNKB] -> GSI 10 (level, high) -> IRQ 10
> [ 0.260509] Linux agpgart interface v0.103
> [ 0.260914] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
> [ 0.261683] serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
> [ 0.262391] serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
> [ 0.263945] brd: module loaded
> [ 0.264626] loop: module loaded
> [ 0.265455] vda: unknown partition table
> [ 0.281126] vdb: unknown partition table
> [ 0.290189] scsi0 : ata_piix
> [ 0.290586] scsi1 : ata_piix
> [ 0.290886] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc000 irq 14
> [ 0.291514] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc008 irq 15
> [ 0.292376] Fixed MDIO Bus: probed
> [ 0.292721] PPP generic driver version 2.4.2
> [ 0.293187] tun: Universal TUN/TAP device driver, 1.6
> [ 0.293660] tun: (C) 1999-2004 Max Krasnyansky <email address hidden>
> [ 0.294328] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
> [ 0.294951] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
> [ 0.295627] uhci_hcd: USB Universal Host Controller Interface driver
> [ 0.296264] uhci_hcd 0000:00:01.2: PCI INT D -> Link[LNKD] -> GSI 11 (level, high) -> IRQ 11
> [ 0.297069] uhci_hcd 0000:00:01.2: UHCI Host Controller
> [ 0.297588] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1
> [ 0.298367] uhci_hcd 0000:00:01.2: irq 11, io base 0x0000c020
> [ 0.299061] hub 1-0:1.0: USB hub found
> [ 0.299503] hub 1-0:1.0: 2 ports detected
> [ 0.300024] PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
> [ 0.301363] serio: i8042 KBD port at 0x60,0x64 irq 1
> [ 0.301918] serio: i8042 AUX port at 0x60,0x64 irq 12
> [ 0.302469] mice: PS/2 mouse device common for all mice
> [ 0.303158] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0
> [ 0.303887] rtc0: alarms up to one day, 114 bytes nvram, hpet irqs
> [ 0.304626] device-mapper: uevent: version 1.0.3
> [ 0.305357] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
> [ 0.320269] device-mapper: ioctl: 4.17.0-ioctl (2010-03-05) initialised: <email address hidden>
> [ 0.321245] device-mapper: multipath: version 1.1.1 loaded
> [ 0.321817] device-mapper: multipath round-robin: version 1.0.0 loaded
> [ 0.327546] Freeing initrd memory: 5748k freed
> [ 0.330621] cpuidle: using governor ladder
> [ 0.331031] cpuidle: using governor menu
> [ 0.331665] TCP cubic registered
> [ 0.332074] NET: Registered protocol family 10
> [ 0.332894] lo: Disabled Privacy Extensions
> [ 0.333462] NET: Registered protocol family 17
> [ 0.333970] powernow-k8: Processor cpuid 623 not supported
> [ 0.334640] registered taskstats version 1
> [ 0.335194] Magic number: 11:551:542
> [ 0.335667] rtc_cmos 00:01: setting system clock to 2011-05-17 17:32:28 UTC (1305653548)
> [ 0.336445] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
> [ 0.337098] EDD information not available.
> [ 0.470490] Freeing unused kernel memory: 828k freed
> [ 0.473751] Write protecting the kernel read-only data: 10240k
> [ 0.476278] Freeing unused kernel memory: 308k freed
> [ 0.481092] Freeing unused kernel memory: 1620k freed
> Used vda for root filesystem
> pivot_root: Invalid argument
>
> init started: BusyBox v1.17.2 (2010-10-17 16:10:18 MST)
> stty: /dev/console
>
> ttylinux 12.1
>  > http://ttylinux.org/
>  > hostname: ttylinux_host
>
> load Kernel Module: acpiphp [ OK ]
> load Kernel Module: e1000 [ OK ]
> load Kernel Module: ne2k-pci [ OK ]
> [ 0.763441] ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 11
> load Kernel Module: 8139cp [ OK ]
> load Kernel Module: pcnet32 [ OK ]
> load Kernel Module: mii [ OK ]
> load Kernel Module: ip_tables [ OK ]
> file systems checked [ OK ]
> mounting local file systems [ OK ]
> setting up system clock [utc] Tue May 17 17:32:28 UTC 2011 [ OK ]
> stty: /dev/console
> stty: /dev/console
> initializing random number generator [WATING][-11G.. [ OK ]
> stty: /dev/console
> startup klogd [ OK ]
> startup syslogd [ OK ]
> stty: /dev/console
> stty: /dev/console
> bringing up loopback interface lo [ OK ]
> stty: /dev/console
> udhcpc (v1.17.2) started
> Sending discover...
> Sending discover...
> Sending discover...
> No lease, forking to background
> starting DHCP forEthernet interface eth0 [ OK ]
> cloud-setup: checking http://169.254.169.254/2009-04-04/meta-data/instance-id
> wget: can't connect to remote host (169.254.169.254): Network is unreachable
> cloud-setup: failed 1/30: up 9.99. request failed
> wget: can't connect to remote host (169.254.169.254): Network is unreachable
> cloud-setup: failed 2/30: up 10.99. request failed
> wget: can't connect to remote host (169.254.169.254): Network is unreachable
> cloud-setup: failed 3/30: up 12.00. request failed
> .....
>
> That goes on for about 27 more times.
>
> I read another post with similar problems with DHCP.
> We've removed any other DHCP or DNS servers from the network to keep them from interfering.
>
> Again, Compute1 launches and can ping/ssh its instances, but no one else ping/ssh them and Compute2 cannot ping/ssh any of the instances it launches.
>
> Let me know if i've left out any information. Thanks ahead of time.
>
>
> You received this question notification because you are a member of Nova
> Core, which is an answer contact for OpenStack Compute (nova).

Revision history for this message
Steven (steven-haddix) said :
#2

So on compute2, --flat_interface should be eth0?

Revision history for this message
Steven (steven-haddix) said :
#3

Problem Solved.

Compute1: added --flat_interface=eth1, --public_interface=eth0, --flat_injected=false to nova.conf

Compute2: Turned up eth1

Revision history for this message
Steven (steven-haddix) said :
#4

Thanks Vish Ishaya, that solved my question.