OpenStack Compute (nova)

Problem VM state change and launch of VM

Asked by KAABACHE Nassim

I had already launch some VM but now I m dealing with an issue.
Everytime I want to launch, there s a an error.
If I change the state unpause to my VM, the same.

the only one error in log is in nova-compute :

 13-05-31 18:04:14 10172 ERROR nova.openstack.common.rpc.amqp [-] Exception during message handling
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 276, in _process_data
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp rval = self.proxy.dispatch(ctxt, version, method, **args)
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 145, in dispatch
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp return getattr(proxyobj, method)(ctxt, **kwargs)
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 117, in wrapped
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp temp_level, payload)
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp self.gen.next()
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 92, in wrapped
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp return f(*args, **kw)
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 176, in decorated_function
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp pass
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp self.gen.next()
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 162, in decorated_function
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs)
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 197, in decorated_function
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp kwargs['instance']['uuid'], e, sys.exc_info())
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp self.gen.next()
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 191, in decorated_function
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs)
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1820, in unpause_instance
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp self.driver.unpause(instance)
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 117, in wrapped
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp temp_level, payload)
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp self.gen.next()
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 92, in wrapped
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp return f(*args, **kw)
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 980, in unpause
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp dom.resume()
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 187, in doit
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp result = proxy_call(self._autowrap, f, *args, **kwargs)
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 147, in proxy_call
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp rv = execute(f,*args,**kwargs)
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 76, in tworker
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp rv = meth(*args,**kwargs)
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/libvirt.py", line 1210, in resume
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp if ret == -1: raise libvirtError ('virDomainResume() failed', dom=self)
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp libvirtError: Requested operation is not valid: domain is not running
2013-05-31 18:04:14 10172 TRACE nova.openstack.common.rpc.amqp

have you any idea of the problem ?
thanks
nassim

Question information

Language:
English Edit question
Status:
Solved
For:
OpenStack Compute (nova) Edit question
Assignee:
No assignee Edit question
Solved by:
KAABACHE Nassim
Solved:
Last query:
Last reply:
Revision history for this message
wingwj (wingwj) said : 		#1

Hi nassim,

Based on your nova-log, it looks like the vm you want to unpause is not in a right state on libvirt, so an exception was returned.

I test it on my environment, no error occured.
You can execute "virsh list" on the compute node before unpause vms to check, the right state should be "paused".

Plz try it again~

P.S. What's your nova-version? I can't match the code with "Grizzly"...

Thanks!
wingwj

Revision history for this message
KAABACHE Nassim (nassim-kaabache) said : 		#2

Hi wingwj,

Thank you for your help,

The virsh list is empty, in sudo or root mode.

I use Folsom 2012.2.2, my network is not connected to internet so I can't really upgrade it.

Nassim

Revision history for this message
KAABACHE Nassim (nassim-kaabache) said : 		#3

When I use sudo virsh list --all I have one instance (38) that is in state closed

Revision history for this message
KAABACHE Nassim (nassim-kaabache) said : 		#4

and here the message from nova-compute.log when I try to launch a VM :
2013-06-03 11:49:22 10172 ERROR nova.openstack.common.rpc.amqp [-] Exception during message handling
2013-06-03 11:49:22 10172 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):
2013-06-03 11:49:22 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 276, in _process_data
2013-06-03 11:49:22 10172 TRACE nova.openstack.common.rpc.amqp rval = self.proxy.dispatch(ctxt, version, method, **args)
2013-06-03 11:49:22 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 145, in dispatch
2013-06-03 11:49:22 10172 TRACE nova.openstack.common.rpc.amqp return getattr(proxyobj, method)(ctxt, **kwargs)
2013-06-03 11:49:22 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 117, in wrapped
2013-06-03 11:49:22 10172 TRACE nova.openstack.common.rpc.amqp temp_level, payload)
2013-06-03 11:49:22 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
2013-06-03 11:49:22 10172 TRACE nova.openstack.common.rpc.amqp self.gen.next()
2013-06-03 11:49:22 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 92, in wrapped
2013-06-03 11:49:22 10172 TRACE nova.openstack.common.rpc.amqp return f(*args, **kw)
2013-06-03 11:49:22 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 383, in refresh_instance_security_rules
2013-06-03 11:49:22 10172 TRACE nova.openstack.common.rpc.amqp return self.driver.refresh_instance_security_rules(instance)
2013-06-03 11:49:22 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2232, in refresh_instance_security_rules
2013-06-03 11:49:22 10172 TRACE nova.openstack.common.rpc.amqp self.firewall_driver.refresh_instance_security_rules(instance)
2013-06-03 11:49:22 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/virt/firewall.py", line 430, in refresh_instance_security_rules
2013-06-03 11:49:22 10172 TRACE nova.openstack.common.rpc.amqp self.do_refresh_instance_rules(instance)
2013-06-03 11:49:22 10172 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/virt/firewall.py", line 447, in do_refresh_instance_rules
2013-06-03 11:49:22 10172 TRACE nova.openstack.common.rpc.amqp network_info = self.network_infos[instance['id']]
2013-06-03 11:49:22 10172 TRACE nova.openstack.common.rpc.amqp KeyError: 64

Revision history for this message
KAABACHE Nassim (nassim-kaabache) said : 		#5

I think the error is there :

2013-06-03 14:36:50 ERROR nova.compute.manager [req-197ab448-caa5-4d35-8cee-1c917573a21b 55f66ff645984c4cb4d724cbd1ef514c 203dee818fc24272b02801513194fcb1] [instance: a16b83bc-d293-4475-a0ff-57d0e0047530] Build error: ['Traceback (most recent call last):\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 496, in _run_instance\n injected_files, admin_password)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 749, in _spawn\n block_device_info)\n', ' File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 117, in wrapped\n temp_level, payload)\n', ' File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n self.gen.next()\n', ' File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 92, in wrapped\n return f(*args, **kw)\n', ' File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1086, in spawn\n block_device_info=block_device_info)\n', ' File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1863, in to_xml\n rescue, block_device_info)\n', ' File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1723, in get_guest_config\n guest.cpu = self.get_guest_cpu_config()\n', ' File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1548, in get_guest_cpu_config\n raise exception.Invalid(msg)\n', 'Invalid: A CPU model name should not be set when a host CPU model is requested\n']

Revision history for this message
KAABACHE Nassim (nassim-kaabache) said : 		#6

Sorry for that spam, I just had a different problem that I thought it was the same thing, I solved the problem of new VM but I always cannot unpaused a old VM(I can with new one), it s not a real problem so I guess we can close the topic ?

Revision history for this message
wingwj (wingwj) said : 		#7

Hi Nassim,

Sorry for the later reply..

I think your old vm may be abnormal on libvirt due to some reasons(power down?).
Happy to see your environment returns to normal~ :-)

Revision history for this message
KAABACHE Nassim (nassim-kaabache) said : 		#8

thank you wingwj