Create instance fails with nova.rpc.amqp ImageNotAuthorized: Not authorized for image
Week ago (or so) did an update to latest available Ubuntu packages (at that time), today did update to todays packages. I was unable to update keystone, so I have deleted keystone DB and recreated all users. I then updated user and tenant ID's in nova and glance DBs for correct user ID mapping. It might be that I might have forgot some place but I am unable to find any references to old ID's and Nova region (RegionOne changed to nova).
Now I am unable to start new instances due to image authentication issue (euca-****, glance and nova commands works perfectly so no general Keystone authentication problems). No errors on master node. Computing node does report the following traceback:
2012-04-11 15:25:00 TRACE nova.rpc.amqp Traceback (most recent call last):
2012-04-11 15:25:00 TRACE nova.rpc.amqp File "/usr/lib/
2012-04-11 15:25:00 TRACE nova.rpc.amqp rval = node_func(
2012-04-11 15:25:00 TRACE nova.rpc.amqp File "/usr/lib/
2012-04-11 15:25:00 TRACE nova.rpc.amqp return f(*args, **kw)
2012-04-11 15:25:00 TRACE nova.rpc.amqp File "/usr/lib/
2012-04-11 15:25:00 TRACE nova.rpc.amqp sys.exc_info())
2012-04-11 15:25:00 TRACE nova.rpc.amqp File "/usr/lib/
2012-04-11 15:25:00 TRACE nova.rpc.amqp self.gen.next()
2012-04-11 15:25:00 TRACE nova.rpc.amqp File "/usr/lib/
2012-04-11 15:25:00 TRACE nova.rpc.amqp return function(self, context, instance_uuid, *args, **kwargs)
2012-04-11 15:25:00 TRACE nova.rpc.amqp File "/usr/lib/
2012-04-11 15:25:00 TRACE nova.rpc.amqp do_run_instance()
2012-04-11 15:25:00 TRACE nova.rpc.amqp File "/usr/lib/
2012-04-11 15:25:00 TRACE nova.rpc.amqp retval = f(*args, **kwargs)
2012-04-11 15:25:00 TRACE nova.rpc.amqp File "/usr/lib/
2012-04-11 15:25:00 TRACE nova.rpc.amqp self._run_
2012-04-11 15:25:00 TRACE nova.rpc.amqp File "/usr/lib/
2012-04-11 15:25:00 TRACE nova.rpc.amqp self._set_
2012-04-11 15:25:00 TRACE nova.rpc.amqp File "/usr/lib/
2012-04-11 15:25:00 TRACE nova.rpc.amqp self.gen.next()
2012-04-11 15:25:00 TRACE nova.rpc.amqp File "/usr/lib/
2012-04-11 15:25:00 TRACE nova.rpc.amqp image_meta = self._check_
2012-04-11 15:25:00 TRACE nova.rpc.amqp File "/usr/lib/
2012-04-11 15:25:00 TRACE nova.rpc.amqp image_meta = _get_image_
2012-04-11 15:25:00 TRACE nova.rpc.amqp File "/usr/lib/
2012-04-11 15:25:00 TRACE nova.rpc.amqp return image_service.
2012-04-11 15:25:00 TRACE nova.rpc.amqp File "/usr/lib/
2012-04-11 15:25:00 TRACE nova.rpc.amqp _reraise_
2012-04-11 15:25:00 TRACE nova.rpc.amqp File "/usr/lib/
2012-04-11 15:25:00 TRACE nova.rpc.amqp image_id)
2012-04-11 15:25:00 TRACE nova.rpc.amqp File "/usr/lib/
2012-04-11 15:25:00 TRACE nova.rpc.amqp return getattr(client, name)(*args, **kwargs)
2012-04-11 15:25:00 TRACE nova.rpc.amqp File "/usr/lib/
2012-04-11 15:25:00 TRACE nova.rpc.amqp res = self.do_
2012-04-11 15:25:00 TRACE nova.rpc.amqp File "/usr/lib/
2012-04-11 15:25:00 TRACE nova.rpc.amqp return func(self, *args, **kwargs)
2012-04-11 15:25:00 TRACE nova.rpc.amqp File "/usr/lib/
2012-04-11 15:25:00 TRACE nova.rpc.amqp headers=headers)
2012-04-11 15:25:00 TRACE nova.rpc.amqp File "/usr/lib/
2012-04-11 15:25:00 TRACE nova.rpc.amqp return func(self, method, url, body, headers)
2012-04-11 15:25:00 TRACE nova.rpc.amqp File "/usr/lib/
2012-04-11 15:25:00 TRACE nova.rpc.amqp raise exception.
2012-04-11 15:25:00 TRACE nova.rpc.amqp ImageNotAuthorized: Not authorized for image 33096949-
2012-04-11 15:25:00 TRACE nova.rpc.amqp
Image exists and can be retrieved (I have inserted a copy of the image via "glance add" ):
root@stack102:
33096949-
384b6942-
root@stack102:
I have traced issue down to the folowing: glance rejects request to get image due to authentication token is not passed to Glance.
I have checked and it seems to be valid behaviour:
curl http://
curl -H "X-Auth-
But actual instance start also does NOT have authentication token, although it is provided to compute node. ACSII TCP dump on the compute node when starting an instance:
http://
Glance reports in logs something like:
2012-04-11 14:17:49 4066 DEBUG [glance.
2012-04-11 14:17:49 4066 DEBUG [glance.
2012-04-11 14:17:49 4066 DEBUG [keystone.
2012-04-11 14:17:49 4066 DEBUG [keystone.
2012-04-11 14:17:49 4066 WARNING [keystone.
2012-04-11 14:17:49 4066 INFO [keystone.
Question information
- Language:
- English Edit question
- Status:
- Solved
- Assignee:
- No assignee Edit question
- Solved by:
- Elvinas Piliponis
- Solved:
- Last query:
- Last reply: