Creating zero sized instances on nova-compute node
I have two nodes, one running nova-api, nova-network, nova-volume, nova-
compute and glance, the second is just running nova-compute. The nodes
are running Ubuntu 11.04 server and I've installed from the
ppa.launchpad repository, additionally both nodes use the KVM
hypervisor, and kvm-ok returns that vitrualization (sp) is enabled in
their bios. On the master node, I can start instances and they run just
fine, but when a vm is scheduled on the second node, I receive the
following errors:
2011-07-11 08:53:38,013 INFO nova.virt.
2011-07-11 08:53:38,034 DEBUG nova.utils [-] Attempting to grab semaphore "00000001" for method "call_if_not_exists
"... from (pid=6846) inner /usr/lib/
2011-07-11 08:53:38,036 ERROR nova.exception [-] Uncaught exception
(nova.exception): TRACE: Traceback (most recent call last):
(nova.exception): TRACE: File "/usr/lib/
(nova.exception): TRACE: return f(*args, **kw)
(nova.exception): TRACE: File "/usr/lib/
(nova.exception): TRACE: block_device_
(nova.exception): TRACE: File "/usr/lib/
e_image
(nova.exception): TRACE: project=project)
(nova.exception): TRACE: File "/usr/lib/
_image
(nova.exception): TRACE: call_if_
(nova.exception): TRACE: File "/usr/lib/
(nova.exception): TRACE: retval = f(*args, **kwargs)
(nova.exception): TRACE: File "/usr/lib/
f_not_exists
(nova.exception): TRACE: fn(target=base, *args, **kwargs)
(nova.exception): TRACE: File "/usr/lib/
_image
(nova.exception): TRACE: images.
(nova.exception): TRACE: File "/usr/lib/
(nova.exception): TRACE: metadata = image_service.
(nova.exception): TRACE: File "/usr/lib/
(nova.exception): TRACE: image_meta, image_chunks = self.client.
(nova.exception): TRACE: File "/usr/lib/
(nova.exception): TRACE: res = self.do_
(nova.exception): TRACE: File "/usr/lib/
(nova.exception): TRACE: headers, params)
(nova.exception): TRACE: File "/usr/lib/
(nova.exception): TRACE: "server. Got error: %s" % e)
(nova.exception): TRACE: ClientConnectio
(nova.exception): TRACE:
2011-07-11 08:53:38,037 ERROR nova.compute.
he BIOS? Details: Unable to connect to server. Got error: [Errno 111] ECONNREFUSED
Looking in /var/lib/
are zero size.
The nodes have dual nics attached to a public 172.16.0.0/16 and a
private 10.0.0.0/8 netowrk and i was using
http://
/etc/nova/
# RabbitMQ
--rabbit_
# MySQL
--sql_connectio
# Networking
--network_
--vlan_
--public_
--network_
--routing_
--fixed_
--network_size=1024
--dhcpbridge_
--dhcpbridge=
# Virtualization
--libvirt_type=kvm
# Volumes
--iscsi_
--num_targets=100
# APIs
--auth_
--cc_host=
--ec2_url=http://
--s3_host=
--s3_dmz=
# Image service
--glance_
--image_
# Misc
--logdir=
--state_
--lock_
--verbose
# VNC Console
--vnc_enabled=true
--vncproxy_url=http://
--vnc_console_
Question information
- Language:
- English Edit question
- Status:
- Solved
- Assignee:
- No assignee Edit question
- Solved by:
- Vish Ishaya
- Solved:
- Last query:
- Last reply:
Revision history for this message
|
#1 |
the --glance_host and --glance_port flags were replaced with a single flag called
--glance_
try
--glance_
Vish
On Jul 11, 2011, at 6:31 PM, P Spencer Davis wrote:
> New question #164486 on OpenStack Compute (nova):
> https:/
>
>
> I have two nodes, one running nova-api, nova-network, nova-volume, nova-
> compute and glance, the second is just running nova-compute. The nodes
> are running Ubuntu 11.04 server and I've installed from the
> ppa.launchpad repository, additionally both nodes use the KVM
> hypervisor, and kvm-ok returns that vitrualization (sp) is enabled in
> their bios. On the master node, I can start instances and they run just
> fine, but when a vm is scheduled on the second node, I receive the
> following errors:
>
> 2011-07-11 08:53:38,013 INFO nova.virt.
> 2011-07-11 08:53:38,034 DEBUG nova.utils [-] Attempting to grab semaphore "00000001" for method "call_if_not_exists
> "... from (pid=6846) inner /usr/lib/
> 2011-07-11 08:53:38,036 ERROR nova.exception [-] Uncaught exception
> (nova.exception): TRACE: Traceback (most recent call last):
> (nova.exception): TRACE: File "/usr/lib/
> (nova.exception): TRACE: return f(*args, **kw)
> (nova.exception): TRACE: File "/usr/lib/
> (nova.exception): TRACE: block_device_
> (nova.exception): TRACE: File "/usr/lib/
> e_image
> (nova.exception): TRACE: project=project)
> (nova.exception): TRACE: File "/usr/lib/
> _image
> (nova.exception): TRACE: call_if_
> (nova.exception): TRACE: File "/usr/lib/
> (nova.exception): TRACE: retval = f(*args, **kwargs)
> (nova.exception): TRACE: File "/usr/lib/
> f_not_exists
> (nova.exception): TRACE: fn(target=base, *args, **kwargs)
> (nova.exception): TRACE: File "/usr/lib/
> _image
> (nova.exception): TRACE: images.
> (nova.exception): TRACE: File "/usr/lib/
> (nova.exception): TRACE: metadata = image_service.
> (nova.exception): TRACE: File "/usr/lib/
> (nova.exception): TRACE: image_meta, image_chunks = self.client.
> (nova.exception): TRACE: File "/usr/lib/
> (nova.exception): TRACE: res = self.do_
> (nova.exception): TRACE: File "/usr/lib/
> (nova.exception): TRACE: headers, params)
> (nova.exception): TRACE: File "/usr/lib/
> (nova.exception): TRACE: "server. Got error: %s" % e)
> (nova.exception): TRACE: ClientConnectio
> (nova.exception): TRACE:
> 2011-07-11 08:53:38,037 ERROR nova.compute.
> he BIOS? Details: Unable to connect to server. Got error: [Errno 111] ECONNREFUSED
>
> Looking in /var/lib/
> are zero size.
>
> The nodes have dual nics attached to a public 172.16.0.0/16 and a
> private 10.0.0.0/8 netowrk and i was using
> http://
>
> /etc/nova/
>
> # RabbitMQ
> --rabbit_
> # MySQL
> --sql_connectio
> # Networking
> --network_
> --vlan_
> --public_
> --network_
> --routing_
> --fixed_
> --network_size=1024
> --dhcpbridge_
> --dhcpbridge=
> # Virtualization
> --libvirt_type=kvm
> # Volumes
> --iscsi_
> --num_targets=100
> # APIs
> --auth_
> --cc_host=
> --ec2_url=http://
> --s3_host=
> --s3_dmz=
> # Image service
> --glance_
> --image_
> # Misc
> --logdir=
> --state_
> --lock_
> --verbose
> # VNC Console
> --vnc_enabled=true
> --vncproxy_url=http://
> --vnc_console_
>
> --
> You received this question notification because you are a member of Nova
> Core, which is an answer contact for OpenStack Compute (nova).
Revision history for this message
|
#2 |
The image seems to have copied, but vm creation is still failing with
this error in the compute node's nova-compute log
2011-07-12 08:00:56,485 DEBUG nova.rpc [-] received
{u'_context_
u'_context_
u'request_spec': {u'instance_
u'scheduling', u'availability_
u'instance_
u'reservation_id': u'r-e1he7r0i', u'user_id': u'cscloud',
u'display_
AAAAB3NzaC1yc2E
nova@dhcp-
u'metadata': {}, u'kernel_id': u'3', u'key_name': u'key-cscloud',
u'display_name': None, u'local_gb': 20, u'locked': False,
u'launch_time': u'2011-
1, u'image_ref': 4, u'architecture': None, u'os_type': None},
u'instance_type': {u'rxtx_quota': 0, u'deleted_at': None, u'name':
u'm1.small', u'deleted': False, u'created_at': None, u'updated_at':
None, u'memory_mb': 2048, u'vcpus': 1, u'rxtx_cap': 0, u'extra_specs':
{}, u'swap': 0, u'flavorid': 2, u'id': 5, u'local_gb': 20},
u'num_instances': 1, u'filter':
u'nova.
u'admin_password': None, u'injected_files': None,
u'availability_
u'_context_
u'cscloud', u'method': u'run_instance', u'_context_
u'_context_
process_data /usr/lib/
2011-07-12 08:00:56,485 DEBUG nova.rpc [-] unpacked context:
{'timestamp': u'2011-
'remote_address': u'172.16.1.13', 'project': u'base', 'is_admin':
True, 'user': u'cscloud', 'request_id': u'2PY8P4D06ZJCF
'read_deleted': False} from (pid=4065) _unpack_context
/usr/lib/
2011-07-12 08:00:56,558 AUDIT nova.compute.
[2PY8P4D06ZJCFA
2011-07-12 08:00:56,778 DEBUG nova.rpc [-] Making asynchronous call on
network ... from (pid=4065) multicall
/usr/lib/
2011-07-12 08:00:56,778 DEBUG nova.rpc [-] MSG_ID is
1fb1ac62b5794d3
/usr/lib/
2011-07-12 08:00:56,779 DEBUG nova.rpc [-] Creating new connection
from (pid=4065) create /usr/lib/
2011-07-12 08:00:57,383 DEBUG nova.compute.
network_info: |[[{u'injected': False, u'bridge': u'br_vlan1',
u'cidr_v6': None, u'cidr': u'192.168.1.0/24', u'id': 1}, {u'label':
u'vlan1', u'broadcast': u'192.168.1.255', u'ips': [{u'ip':
u'192.168.1.8', u'netmask': u'255.255.255.0', u'enabled': u'1'}],
u'mac': u'02:16:
u'gateway': u'192.168.1.7'}]]| from (pid=4065) _run_instance
/usr/lib/
2011-07-12 08:00:57,390 DEBUG nova.utils [-] Attempting to grab
semaphore "ensure_vlan" for method "ensure_vlan"... from (pid=4065)
inner /usr/lib/
2011-07-12 08:00:57,390 DEBUG nova.utils [-] Attempting to grab file
lock "ensure_vlan" for method "ensure_vlan"... from (pid=4065) inner
/usr/lib/
2011-07-12 08:00:57,391 DEBUG nova.utils [-] Running cmd (subprocess):
ip link show dev vlan1 from (pid=4065) execute
/usr/lib/
2011-07-12 08:00:57,399 DEBUG nova.utils [-] Attempting to grab
semaphore "ensure_bridge" for method "ensure_bridge"... from
(pid=4065) inner /usr/lib/
2011-07-12 08:00:57,400 DEBUG nova.utils [-] Attempting to grab file
lock "ensure_bridge" for method "ensure_bridge"... from (pid=4065)
inner /usr/lib/
2011-07-12 08:00:57,400 DEBUG nova.utils [-] Running cmd (subprocess):
ip link show dev br_vlan1 from (pid=4065) execute
/usr/lib/
2011-07-12 08:00:57,408 DEBUG nova.utils [-] Running cmd (subprocess):
sudo route -n from (pid=4065) execute
/usr/lib/
2011-07-12 08:00:57,421 DEBUG nova.utils [-] Running cmd (subprocess):
sudo ip addr show dev vlan1 scope global from (pid=4065) execute
/usr/lib/
2011-07-12 08:00:57,435 DEBUG nova.utils [-] Running cmd (subprocess):
sudo brctl addif br_vlan1 vlan1 from (pid=4065) execute
/usr/lib/
2011-07-12 08:00:57,448 DEBUG nova.utils [-] Result was 1 from
(pid=4065) execute /usr/lib/
2011-07-12 08:00:57,750 DEBUG nova.virt.
instance-00000016: starting toXML method from (pid=4065) to_xml
/usr/lib/
2011-07-12 08:00:57,829 DEBUG nova.virt.
instance-00000016: finished toXML method from (pid=4065) to_xml
/usr/lib/
2011-07-12 08:00:57,830 INFO nova [-] called setup_basic_
2011-07-12 08:00:57,830 INFO nova [-] ensuring static filters
2011-07-12 08:00:57,844 DEBUG nova.virt.
firewall: Setup Basic Filtering from (pid=4065) setup_basic_
/usr/lib/
2011-07-12 08:00:57,845 DEBUG nova.utils [-] Attempting to grab
semaphore "iptables" for method "_do_refresh_
from (pid=4065) inner /usr/lib/
2011-07-12 08:00:57,845 DEBUG nova.utils [-] Attempting to grab file
lock "iptables" for method "_do_refresh_
(pid=4065) inner /usr/lib/
2011-07-12 08:00:57,849 DEBUG nova.utils [-] Attempting to grab
semaphore "iptables" for method "apply"... from (pid=4065) inner
/usr/lib/
2011-07-12 08:00:57,849 DEBUG nova.utils [-] Attempting to grab file
lock "iptables" for method "apply"... from (pid=4065) inner
/usr/lib/
2011-07-12 08:00:57,849 DEBUG nova.utils [-] Running cmd (subprocess):
sudo iptables-save -t filter from (pid=4065) execute
/usr/lib/
2011-07-12 08:00:57,864 DEBUG nova.utils [-] Running cmd (subprocess):
sudo iptables-restore from (pid=4065) execute
/usr/lib/
2011-07-12 08:00:57,879 DEBUG nova.utils [-] Running cmd (subprocess):
sudo iptables-save -t nat from (pid=4065) execute
/usr/lib/
2011-07-12 08:00:57,894 DEBUG nova.utils [-] Running cmd (subprocess):
sudo iptables-restore from (pid=4065) execute
/usr/lib/
2011-07-12 08:00:57,927 DEBUG nova.virt.
security group rule:
<nova.db.
0x42a9350> from (pid=4065) instance_rules
/usr/lib/
2011-07-12 08:00:57,928 DEBUG nova.virt.
security group rule:
<nova.db.
0x40a9fd0> from (pid=4065) instance_rules
/usr/lib/
2011-07-12 08:00:57,928 DEBUG nova.utils [-] Attempting to grab
semaphore "iptables" for method "apply"... from (pid=4065) inner
/usr/lib/
2011-07-12 08:00:57,928 DEBUG nova.utils [-] Attempting to grab file
lock "iptables" for method "apply"... from (pid=4065) inner
/usr/lib/
2011-07-12 08:00:57,929 DEBUG nova.utils [-] Running cmd (subprocess):
sudo iptables-save -t filter from (pid=4065) execute
/usr/lib/
2011-07-12 08:00:57,944 DEBUG nova.utils [-] Running cmd (subprocess):
sudo iptables-restore from (pid=4065) execute
/usr/lib/
2011-07-12 08:00:57,959 DEBUG nova.utils [-] Running cmd (subprocess):
sudo iptables-save -t nat from (pid=4065) execute
/usr/lib/
2011-07-12 08:00:57,973 DEBUG nova.utils [-] Running cmd (subprocess):
sudo iptables-restore from (pid=4065) execute
/usr/lib/
2011-07-12 08:00:57,989 DEBUG nova.utils [-] Running cmd (subprocess):
mkdir -p /var/lib/
execute /usr/lib/
2011-07-12 08:00:57,998 INFO nova.virt.
instance-00000016: Creating image
2011-07-12 08:00:58,018 DEBUG nova.utils [-] Attempting to grab
semaphore "00000003" for method "call_if_
(pid=4065) inner /usr/lib/
2011-07-12 08:00:58,018 DEBUG nova.utils [-] Running cmd (subprocess):
cp /var/lib/
/var/lib/
execute /usr/lib/
2011-07-12 08:00:58,042 DEBUG nova.utils [-] Attempting to grab
semaphore "1b6453892473a4
"call_if_
/usr/lib/
2011-07-12 08:00:58,042 DEBUG nova.utils [-] Running cmd (subprocess):
qemu-img create -f qcow2 -o
cluster_
/var/lib/
/usr/lib/
2011-07-12 08:00:58,195 DEBUG nova.utils [-] Attempting to grab
semaphore "local_20" for method "call_if_
(pid=4065) inner /usr/lib/
2011-07-12 08:00:58,196 DEBUG nova.utils [-] Running cmd (subprocess):
truncate /var/lib/
execute /usr/lib/
2011-07-12 08:00:58,217 DEBUG nova.utils [-] Running cmd (subprocess):
qemu-img create -f qcow2 -o
cluster_
/var/lib/
execute /usr/lib/
2011-07-12 08:00:58,355 INFO nova.virt.
instance-00000016: injecting key into image 4
2011-07-12 08:00:58,356 DEBUG nova.utils [-] Running cmd (subprocess):
sudo qemu-nbd -c /dev/nbd15
/var/lib/
/usr/lib/
2011-07-12 08:00:59,390 DEBUG nova.utils [-] Running cmd (subprocess):
sudo tune2fs -c 0 -i 0 /dev/nbd15 from (pid=4065) execute
/usr/lib/
2011-07-12 08:00:59,422 DEBUG nova.utils [-] Result was 1 from
(pid=4065) execute /usr/lib/
2011-07-12 08:00:59,422 DEBUG nova.utils [-] Running cmd (subprocess):
sudo qemu-nbd -d /dev/nbd15 from (pid=4065) execute
/usr/lib/
2011-07-12 08:00:59,448 WARNING nova.virt.
instance-00000016: ignoring error injecting data into image 4
(Unexpected error while running command.
Command: sudo tune2fs -c 0 -i 0 /dev/nbd15
Exit code: 1
Stdout: 'tune2fs 1.41.14 (22-Dec-2010)\n'
Stderr: "tune2fs: Invalid argument while trying to open
/dev/nbd15\
2011-07-12 08:01:31,461 ERROR nova.exception [-] Uncaught exception
(nova.exception): TRACE: Traceback (most recent call last):
(nova.exception): TRACE: File
"/usr/lib/
(nova.exception): TRACE: return f(*args, **kw)
(nova.exception): TRACE: File
"/usr/lib/
591, in spawn
(nova.exception): TRACE: domain = self._create_
(nova.exception): TRACE: File
"/usr/lib/
1087, in _create_new_domain
(nova.exception): TRACE: domain.
(nova.exception): TRACE: File
"/usr/lib/
createWithFlags
(nova.exception): TRACE: if ret == -1: raise libvirtError
('virDomainCrea
(nova.exception): TRACE: libvirtError: internal error process exited
while connecting to monitor: char device redirected to /dev/pts/1
(nova.exception): TRACE: qemu: could not load kernel
'/var/lib/
ioctl for device
(nova.exception): TRACE:
(nova.exception): TRACE:
2011-07-12 08:01:31,463 ERROR nova.compute.
failed to spawn. Is virtualization enabled in the BIOS? Details:
internal error process exited while connecting to monitor: char device
redirected to /dev/pts/1
qemu: could not load kernel
'/var/lib/
ioctl for device
(nova.compute.
(nova.compute.
"/usr/lib/
_run_instance
(nova.compute.
network_info, bd_mapping)
(nova.compute.
"/usr/lib/
(nova.compute.
(nova.compute.
while connecting to monitor: char device redirected to /dev/pts/1
(nova.compute.
'/var/lib/
ioctl for device
(nova.compute.
(nova.compute.
2011-07-12 08:01:31,864 INFO nova.compute.
'instance-00000016' in DB but no VM. State=5, so setting state to
shutoff.
2011-07-12 08:02:31,868 INFO nova.compute.
2011-07-12 08:02:31,906 INFO nova.compute.
'instance-00000016' in DB but no VM. State=5, so setting state to
shutoff.
On Tue, Jul 12, 2011 at 1:11 AM, Vish Ishaya
<email address hidden> wrote:
> Your question #164486 on OpenStack Compute (nova) changed:
> https:/
>
> Status: Open => Answered
>
> Vish Ishaya proposed the following answer:
> the --glance_host and --glance_port flags were replaced with a single flag called
> --glance_
>
> try
> --glance_
>
> Vish
>
>
> On Jul 11, 2011, at 6:31 PM, P Spencer Davis wrote:
>
>> New question #164486 on OpenStack Compute (nova):
>> https:/
>>
>>
>> I have two nodes, one running nova-api, nova-network, nova-volume, nova-
>> compute and glance, the second is just running nova-compute. The nodes
>> are running Ubuntu 11.04 server and I've installed from the
>> ppa.launchpad repository, additionally both nodes use the KVM
>> hypervisor, and kvm-ok returns that vitrualization (sp) is enabled in
>> their bios. On the master node, I can start instances and they run just
>> fine, but when a vm is scheduled on the second node, I receive the
>> following errors:
>>
>> 2011-07-11 08:53:38,013 INFO nova.virt.
>> 2011-07-11 08:53:38,034 DEBUG nova.utils [-] Attempting to grab semaphore "00000001" for method "call_if_not_exists
>> "... from (pid=6846) inner /usr/lib/
>> 2011-07-11 08:53:38,036 ERROR nova.exception [-] Uncaught exception
>> (nova.exception): TRACE: Traceback (most recent call last):
>> (nova.exception): TRACE: File "/usr/lib/
>> (nova.exception): TRACE: return f(*args, **kw)
>> (nova.exception): TRACE: File "/usr/lib/
>> (nova.exception): TRACE: block_device_
>> (nova.exception): TRACE: File "/usr/lib/
>> e_image
>> (nova.exception): TRACE: project=project)
>> (nova.exception): TRACE: File "/usr/lib/
>> _image
>> (nova.exception): TRACE: call_if_
>> (nova.exception): TRACE: File "/usr/lib/
>> (nova.exception): TRACE: retval = f(*args, **kwargs)
>> (nova.exception): TRACE: File "/usr/lib/
>> f_not_exists
>> (nova.exception): TRACE: fn(target=base, *args, **kwargs)
>> (nova.exception): TRACE: File "/usr/lib/
>> _image
>> (nova.exception): TRACE: images.
>> (nova.exception): TRACE: File "/usr/lib/
>> (nova.exception): TRACE: metadata = image_service.
>> (nova.exception): TRACE: File "/usr/lib/
>> (nova.exception): TRACE: image_meta, image_chunks = self.client.
>> (nova.exception): TRACE: File "/usr/lib/
>> (nova.exception): TRACE: res = self.do_
>> (nova.exception): TRACE: File "/usr/lib/
>> (nova.exception): TRACE: headers, params)
>> (nova.exception): TRACE: File "/usr/lib/
>> (nova.exception): TRACE: "server. Got error: %s" % e)
>> (nova.exception): TRACE: ClientConnectio
>> (nova.exception): TRACE:
>> 2011-07-11 08:53:38,037 ERROR nova.compute.
>> he BIOS? Details: Unable to connect to server. Got error: [Errno 111] ECONNREFUSED
>>
>> Looking in /var/lib/
>> are zero size.
>>
>> The nodes have dual nics attached to a public 172.16.0.0/16 and a
>> private 10.0.0.0/8 netowrk and i was using
>> http://
>>
>> /etc/nova/
>>
>> # RabbitMQ
>> --rabbit_
>> # MySQL
>> --sql_connectio
>> # Networking
>> --network_
>> --vlan_
>> --public_
>> --network_
>> --routing_
>> --fixed_
>> --network_size=1024
>> --dhcpbridge_
>> --dhcpbridge=
>> # Virtualization
>> --libvirt_type=kvm
>> # Volumes
>> --iscsi_
>> --num_targets=100
>> # APIs
>> --auth_
>> --cc_host=
>> --ec2_url=http://
>> --s3_host=
>> --s3_dmz=
>> # Image service
>> --glance_
>> --image_
>> # Misc
>> --logdir=
>> --state_
>> --lock_
>> --verbose
>> # VNC Console
>> --vnc_enabled=true
>> --vncproxy_url=http://
>> --vnc_console_
>>
>> --
>> You received this question notification because you are a member of Nova
>> Core, which is an answer contact for OpenStack Compute (nova).
>
> --
> If this answers your question, please go to the following page to let us
> know that it is solved:
> https:/
>
> If you still need help, you can reply to this email or go to the
> following page to enter your feedback:
> https:/
>
> You received this question notification because you asked the question.
>
Revision history for this message
|
#3 |
Scratch that, I deleted the files in /var/lib/
Thank you!
On Tue, Jul 12, 2011 at 8:11 AM, P Spencer Davis
<email address hidden> wrote:
> Your question #164486 on OpenStack Compute (nova) changed:
> https:/
>
> Status: Answered => Open
>
> You are still having a problem:
> The image seems to have copied, but vm creation is still failing with
> this error in the compute node's nova-compute log
>
> 2011-07-12 08:00:56,485 DEBUG nova.rpc [-] received
> {u'_context_
> u'_context_
> u'request_spec': {u'instance_
> u'scheduling', u'availability_
> u'instance_
> u'reservation_id': u'r-e1he7r0i', u'user_id': u'cscloud',
> u'display_
> AAAAB3NzaC1yc2E
> nova@dhcp-
> u'metadata': {}, u'kernel_id': u'3', u'key_name': u'key-cscloud',
> u'display_name': None, u'local_gb': 20, u'locked': False,
> u'launch_time': u'2011-
> 1, u'image_ref': 4, u'architecture': None, u'os_type': None},
> u'instance_type': {u'rxtx_quota': 0, u'deleted_at': None, u'name':
> u'm1.small', u'deleted': False, u'created_at': None, u'updated_at':
> None, u'memory_mb': 2048, u'vcpus': 1, u'rxtx_cap': 0, u'extra_specs':
> {}, u'swap': 0, u'flavorid': 2, u'id': 5, u'local_gb': 20},
> u'num_instances': 1, u'filter':
> u'nova.
> u'admin_password': None, u'injected_files': None,
> u'availability_
> u'_context_
> u'cscloud', u'method': u'run_instance', u'_context_
> u'_context_
> process_data /usr/lib/
> 2011-07-12 08:00:56,485 DEBUG nova.rpc [-] unpacked context:
> {'timestamp': u'2011-
> 'remote_address': u'172.16.1.13', 'project': u'base', 'is_admin':
> True, 'user': u'cscloud', 'request_id': u'2PY8P4D06ZJCF
> 'read_deleted': False} from (pid=4065) _unpack_context
> /usr/lib/
> 2011-07-12 08:00:56,558 AUDIT nova.compute.
> [2PY8P4D06ZJCFA
> 2011-07-12 08:00:56,778 DEBUG nova.rpc [-] Making asynchronous call on
> network ... from (pid=4065) multicall
> /usr/lib/
> 2011-07-12 08:00:56,778 DEBUG nova.rpc [-] MSG_ID is
> 1fb1ac62b5794d3
> /usr/lib/
> 2011-07-12 08:00:56,779 DEBUG nova.rpc [-] Creating new connection
> from (pid=4065) create /usr/lib/
> 2011-07-12 08:00:57,383 DEBUG nova.compute.
> network_info: |[[{u'injected': False, u'bridge': u'br_vlan1',
> u'cidr_v6': None, u'cidr': u'192.168.1.0/24', u'id': 1}, {u'label':
> u'vlan1', u'broadcast': u'192.168.1.255', u'ips': [{u'ip':
> u'192.168.1.8', u'netmask': u'255.255.255.0', u'enabled': u'1'}],
> u'mac': u'02:16:
> u'gateway': u'192.168.1.7'}]]| from (pid=4065) _run_instance
> /usr/lib/
> 2011-07-12 08:00:57,390 DEBUG nova.utils [-] Attempting to grab
> semaphore "ensure_vlan" for method "ensure_vlan"... from (pid=4065)
> inner /usr/lib/
> 2011-07-12 08:00:57,390 DEBUG nova.utils [-] Attempting to grab file
> lock "ensure_vlan" for method "ensure_vlan"... from (pid=4065) inner
> /usr/lib/
> 2011-07-12 08:00:57,391 DEBUG nova.utils [-] Running cmd (subprocess):
> ip link show dev vlan1 from (pid=4065) execute
> /usr/lib/
> 2011-07-12 08:00:57,399 DEBUG nova.utils [-] Attempting to grab
> semaphore "ensure_bridge" for method "ensure_bridge"... from
> (pid=4065) inner /usr/lib/
> 2011-07-12 08:00:57,400 DEBUG nova.utils [-] Attempting to grab file
> lock "ensure_bridge" for method "ensure_bridge"... from (pid=4065)
> inner /usr/lib/
> 2011-07-12 08:00:57,400 DEBUG nova.utils [-] Running cmd (subprocess):
> ip link show dev br_vlan1 from (pid=4065) execute
> /usr/lib/
> 2011-07-12 08:00:57,408 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo route -n from (pid=4065) execute
> /usr/lib/
> 2011-07-12 08:00:57,421 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo ip addr show dev vlan1 scope global from (pid=4065) execute
> /usr/lib/
> 2011-07-12 08:00:57,435 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo brctl addif br_vlan1 vlan1 from (pid=4065) execute
> /usr/lib/
> 2011-07-12 08:00:57,448 DEBUG nova.utils [-] Result was 1 from
> (pid=4065) execute /usr/lib/
> 2011-07-12 08:00:57,750 DEBUG nova.virt.
> instance-00000016: starting toXML method from (pid=4065) to_xml
> /usr/lib/
> 2011-07-12 08:00:57,829 DEBUG nova.virt.
> instance-00000016: finished toXML method from (pid=4065) to_xml
> /usr/lib/
> 2011-07-12 08:00:57,830 INFO nova [-] called setup_basic_
> 2011-07-12 08:00:57,830 INFO nova [-] ensuring static filters
> 2011-07-12 08:00:57,844 DEBUG nova.virt.
> firewall: Setup Basic Filtering from (pid=4065) setup_basic_
> /usr/lib/
> 2011-07-12 08:00:57,845 DEBUG nova.utils [-] Attempting to grab
> semaphore "iptables" for method "_do_refresh_
> from (pid=4065) inner /usr/lib/
> 2011-07-12 08:00:57,845 DEBUG nova.utils [-] Attempting to grab file
> lock "iptables" for method "_do_refresh_
> (pid=4065) inner /usr/lib/
> 2011-07-12 08:00:57,849 DEBUG nova.utils [-] Attempting to grab
> semaphore "iptables" for method "apply"... from (pid=4065) inner
> /usr/lib/
> 2011-07-12 08:00:57,849 DEBUG nova.utils [-] Attempting to grab file
> lock "iptables" for method "apply"... from (pid=4065) inner
> /usr/lib/
> 2011-07-12 08:00:57,849 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo iptables-save -t filter from (pid=4065) execute
> /usr/lib/
> 2011-07-12 08:00:57,864 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo iptables-restore from (pid=4065) execute
> /usr/lib/
> 2011-07-12 08:00:57,879 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo iptables-save -t nat from (pid=4065) execute
> /usr/lib/
> 2011-07-12 08:00:57,894 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo iptables-restore from (pid=4065) execute
> /usr/lib/
> 2011-07-12 08:00:57,927 DEBUG nova.virt.
> security group rule:
> <nova.db.
> 0x42a9350> from (pid=4065) instance_rules
> /usr/lib/
> 2011-07-12 08:00:57,928 DEBUG nova.virt.
> security group rule:
> <nova.db.
> 0x40a9fd0> from (pid=4065) instance_rules
> /usr/lib/
> 2011-07-12 08:00:57,928 DEBUG nova.utils [-] Attempting to grab
> semaphore "iptables" for method "apply"... from (pid=4065) inner
> /usr/lib/
> 2011-07-12 08:00:57,928 DEBUG nova.utils [-] Attempting to grab file
> lock "iptables" for method "apply"... from (pid=4065) inner
> /usr/lib/
> 2011-07-12 08:00:57,929 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo iptables-save -t filter from (pid=4065) execute
> /usr/lib/
> 2011-07-12 08:00:57,944 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo iptables-restore from (pid=4065) execute
> /usr/lib/
> 2011-07-12 08:00:57,959 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo iptables-save -t nat from (pid=4065) execute
> /usr/lib/
> 2011-07-12 08:00:57,973 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo iptables-restore from (pid=4065) execute
> /usr/lib/
> 2011-07-12 08:00:57,989 DEBUG nova.utils [-] Running cmd (subprocess):
> mkdir -p /var/lib/
> execute /usr/lib/
> 2011-07-12 08:00:57,998 INFO nova.virt.
> instance-00000016: Creating image
> 2011-07-12 08:00:58,018 DEBUG nova.utils [-] Attempting to grab
> semaphore "00000003" for method "call_if_
> (pid=4065) inner /usr/lib/
> 2011-07-12 08:00:58,018 DEBUG nova.utils [-] Running cmd (subprocess):
> cp /var/lib/
> /var/lib/
> execute /usr/lib/
> 2011-07-12 08:00:58,042 DEBUG nova.utils [-] Attempting to grab
> semaphore "1b6453892473a4
> "call_if_
> /usr/lib/
> 2011-07-12 08:00:58,042 DEBUG nova.utils [-] Running cmd (subprocess):
> qemu-img create -f qcow2 -o
> cluster_
> /var/lib/
> /usr/lib/
> 2011-07-12 08:00:58,195 DEBUG nova.utils [-] Attempting to grab
> semaphore "local_20" for method "call_if_
> (pid=4065) inner /usr/lib/
> 2011-07-12 08:00:58,196 DEBUG nova.utils [-] Running cmd (subprocess):
> truncate /var/lib/
> execute /usr/lib/
> 2011-07-12 08:00:58,217 DEBUG nova.utils [-] Running cmd (subprocess):
> qemu-img create -f qcow2 -o
> cluster_
> /var/lib/
> execute /usr/lib/
> 2011-07-12 08:00:58,355 INFO nova.virt.
> instance-00000016: injecting key into image 4
> 2011-07-12 08:00:58,356 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo qemu-nbd -c /dev/nbd15
> /var/lib/
> /usr/lib/
> 2011-07-12 08:00:59,390 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo tune2fs -c 0 -i 0 /dev/nbd15 from (pid=4065) execute
> /usr/lib/
> 2011-07-12 08:00:59,422 DEBUG nova.utils [-] Result was 1 from
> (pid=4065) execute /usr/lib/
> 2011-07-12 08:00:59,422 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo qemu-nbd -d /dev/nbd15 from (pid=4065) execute
> /usr/lib/
> 2011-07-12 08:00:59,448 WARNING nova.virt.
> instance-00000016: ignoring error injecting data into image 4
> (Unexpected error while running command.
> Command: sudo tune2fs -c 0 -i 0 /dev/nbd15
> Exit code: 1
> Stdout: 'tune2fs 1.41.14 (22-Dec-2010)\n'
> Stderr: "tune2fs: Invalid argument while trying to open
> /dev/nbd15\
> 2011-07-12 08:01:31,461 ERROR nova.exception [-] Uncaught exception
> (nova.exception): TRACE: Traceback (most recent call last):
> (nova.exception): TRACE: File
> "/usr/lib/
> (nova.exception): TRACE: return f(*args, **kw)
> (nova.exception): TRACE: File
> "/usr/lib/
> 591, in spawn
> (nova.exception): TRACE: domain = self._create_
> (nova.exception): TRACE: File
> "/usr/lib/
> 1087, in _create_new_domain
> (nova.exception): TRACE: domain.
> (nova.exception): TRACE: File
> "/usr/lib/
> createWithFlags
> (nova.exception): TRACE: if ret == -1: raise libvirtError
> ('virDomainCrea
> (nova.exception): TRACE: libvirtError: internal error process exited
> while connecting to monitor: char device redirected to /dev/pts/1
> (nova.exception): TRACE: qemu: could not load kernel
> '/var/lib/
> ioctl for device
> (nova.exception): TRACE:
> (nova.exception): TRACE:
> 2011-07-12 08:01:31,463 ERROR nova.compute.
> failed to spawn. Is virtualization enabled in the BIOS? Details:
> internal error process exited while connecting to monitor: char device
> redirected to /dev/pts/1
> qemu: could not load kernel
> '/var/lib/
> ioctl for device
> (nova.compute.
> (nova.compute.
> "/usr/lib/
> _run_instance
> (nova.compute.
> network_info, bd_mapping)
> (nova.compute.
> "/usr/lib/
> (nova.compute.
> (nova.compute.
> while connecting to monitor: char device redirected to /dev/pts/1
> (nova.compute.
> '/var/lib/
> ioctl for device
> (nova.compute.
> (nova.compute.
> 2011-07-12 08:01:31,864 INFO nova.compute.
> 'instance-00000016' in DB but no VM. State=5, so setting state to
> shutoff.
> 2011-07-12 08:02:31,868 INFO nova.compute.
> 2011-07-12 08:02:31,906 INFO nova.compute.
> 'instance-00000016' in DB but no VM. State=5, so setting state to
> shutoff.
>
>
> On Tue, Jul 12, 2011 at 1:11 AM, Vish Ishaya
> <email address hidden> wrote:
>> Your question #164486 on OpenStack Compute (nova) changed:
>> https:/
>>
>> Status: Open => Answered
>>
>> Vish Ishaya proposed the following answer:
>> the --glance_host and --glance_port flags were replaced with a single flag called
>> --glance_
>>
>> try
>> --glance_
>>
>> Vish
>>
>>
>> On Jul 11, 2011, at 6:31 PM, P Spencer Davis wrote:
>>
>>> New question #164486 on OpenStack Compute (nova):
>>> https:/
>>>
>>>
>>> I have two nodes, one running nova-api, nova-network, nova-volume, nova-
>>> compute and glance, the second is just running nova-compute. The nodes
>>> are running Ubuntu 11.04 server and I've installed from the
>>> ppa.launchpad repository, additionally both nodes use the KVM
>>> hypervisor, and kvm-ok returns that vitrualization (sp) is enabled in
>>> their bios. On the master node, I can start instances and they run just
>>> fine, but when a vm is scheduled on the second node, I receive the
>>> following errors:
>>>
>>> 2011-07-11 08:53:38,013 INFO nova.virt.
>>> 2011-07-11 08:53:38,034 DEBUG nova.utils [-] Attempting to grab semaphore "00000001" for method "call_if_not_exists
>>> "... from (pid=6846) inner /usr/lib/
>>> 2011-07-11 08:53:38,036 ERROR nova.exception [-] Uncaught exception
>>> (nova.exception): TRACE: Traceback (most recent call last):
>>> (nova.exception): TRACE: File "/usr/lib/
>>> (nova.exception): TRACE: return f(*args, **kw)
>>> (nova.exception): TRACE: File "/usr/lib/
>>> (nova.exception): TRACE: block_device_
>>> (nova.exception): TRACE: File "/usr/lib/
>>> e_image
>>> (nova.exception): TRACE: project=project)
>>> (nova.exception): TRACE: File "/usr/lib/
>>> _image
>>> (nova.exception): TRACE: call_if_
>>> (nova.exception): TRACE: File "/usr/lib/
>>> (nova.exception): TRACE: retval = f(*args, **kwargs)
>>> (nova.exception): TRACE: File "/usr/lib/
>>> f_not_exists
>>> (nova.exception): TRACE: fn(target=base, *args, **kwargs)
>>> (nova.exception): TRACE: File "/usr/lib/
>>> _image
>>> (nova.exception): TRACE: images.
>>> (nova.exception): TRACE: File "/usr/lib/
>>> (nova.exception): TRACE: metadata = image_service.
>>> (nova.exception): TRACE: File "/usr/lib/
>>> (nova.exception): TRACE: image_meta, image_chunks = self.client.
>>> (nova.exception): TRACE: File "/usr/lib/
>>> (nova.exception): TRACE: res = self.do_
>>> (nova.exception): TRACE: File "/usr/lib/
>>> (nova.exception): TRACE: headers, params)
>>> (nova.exception): TRACE: File "/usr/lib/
>>> (nova.exception): TRACE: "server. Got error: %s" % e)
>>> (nova.exception): TRACE: ClientConnectio
>>> (nova.exception): TRACE:
>>> 2011-07-11 08:53:38,037 ERROR nova.compute.
>>> he BIOS? Details: Unable to connect to server. Got error: [Errno 111] ECONNREFUSED
>>>
>>> Looking in /var/lib/
>>> are zero size.
>>>
>>> The nodes have dual nics attached to a public 172.16.0.0/16 and a
>>> private 10.0.0.0/8 netowrk and i was using
>>> http://
>>>
>>> /etc/nova/
>>>
>>> # RabbitMQ
>>> --rabbit_
>>> # MySQL
>>> --sql_connectio
>>> # Networking
>>> --network_
>>> --vlan_
>>> --public_
>>> --network_
>>> --routing_
>>> --fixed_
>>> --network_size=1024
>>> --dhcpbridge_
>>> --dhcpbridge=
>>> # Virtualization
>>> --libvirt_type=kvm
>>> # Volumes
>>> --iscsi_
>>> --num_targets=100
>>> # APIs
>>> --auth_
>>> --cc_host=
>>> --ec2_url=http://
>>> --s3_host=
>>> --s3_dmz=
>>> # Image service
>>> --glance_
>>> --image_
>>> # Misc
>>> --logdir=
>>> --state_
>>> --lock_
>>> --verbose
>>> # VNC Console
>>> --vnc_enabled=true
>>> --vncproxy_url=http://
>>> --vnc_console_
>>>
>>> --
>>> You received this question notification because you are a member of Nova
>>> Core, which is an answer contact for OpenStack Compute (nova).
>>
>> --
>> If this answers your question, please go to the following page to let us
>> know that it is solved:
>> https:/
>>
>> If you still need help, you can reply to this email or go to the
>> following page to enter your feedback:
>> https:/
>>
>> You received this question notification because you asked the question.
>>
>
> --
> You received this question notification because you asked the question.
>
Revision history for this message
|
#5 |
Thanks Vish Ishaya, that solved my question.