Sahara

Error while accessing Savanna Tab in Horizon/Openstack UI

Asked by sagar shimpi

Hi team

I am using -
Redhat 6.4 64-bit
RDO -> rdo-release-grizzly-3.noarch

I installed RDO grizzly on my desktop and I am able to login to the dashboard. Also I am able to create Vm's and login into the VM's.

I tried to install Savanna following guidelines given on - https://savanna.readthedocs.org/en/latest/userdoc/installation.guide.html

I completed the steps given in - "To install into a virtual environment"
I am able to see the "SAVANNA" tab in Openstack dashboard, but when I click the savanna tab I am getting error saying "Something went wrong!"

Following are my logs -
------------------------------
tail -f /var/log/keystone/keystone.log

2013-09-20 17:22:08 WARNING [keystone.common.wsgi] Authorization failed. The request you have made requires authentication. from 172.26.35.81
2013-09-20 17:22:57 WARNING [keystone.common.wsgi] Authorization failed. The request you have made requires authentication. from 172.26.35.81
2013-09-20 17:23:46 WARNING [keystone.common.wsgi] Authorization failed. The request you have made requires authentication. from 172.26.35.81
2013-09-20 17:24:35 WARNING [keystone.common.wsgi] Authorization failed. The request you have made requires authentication. from 172.26.35.81
2013-09-20 17:26:19 WARNING [keystone.common.wsgi] Authorization failed. The request you have made requires authentication. from 172.26.35.81
2013-09-20 17:27:08 WARNING [keystone.common.wsgi] Authorization failed. The request you have made requires authentication. from 172.26.35.81
2013-09-20 17:27:57 WARNING [keystone.common.wsgi] Authorization failed. The request you have made requires authentication. from 172.26.35.81
2013-09-20 17:28:46 WARNING [keystone.common.wsgi] Authorization failed. The request you have made requires authentication. from 172.26.35.81
2013-09-20 17:29:35 WARNING [keystone.common.wsgi] Authorization failed. The request you have made requires authentication. from 172.26.35.81
2013-09-20 17:30:42 WARNING [keystone.common.wsgi] Authorization failed. The request you have made requires authentication. from 127.0.0.1
2013-09-20 17:31:19 WARNING [keystone.common.wsgi] Authorization failed. The request you have made requires authentication. from 172.26.35.81

------------------------------
tail -f /var/log/savanna.log

2013-09-20 17:32:03.721 31415 DEBUG keystoneclient.middleware.auth_token [-] Authenticating user token __call__ /root/savanna-venv/lib/python2.6/site-packages/keystoneclient/middleware/auth_token.py:445
2013-09-20 17:32:03.721 31415 DEBUG keystoneclient.middleware.auth_token [-] Removing headers from request environment: X-Identity-Status,X-Domain-Id,X-Domain-Name,X-Project-Id,X-Project-Name,X-Project-Domain-Id,X-Project-Domain-Name,X-User-Id,X-User-Name,X-User-Domain-Id,X-User-Domain-Name,X-Roles,X-Service-Catalog,X-User,X-Tenant-Id,X-Tenant-Name,X-Tenant,X-Role _remove_auth_headers /root/savanna-venv/lib/python2.6/site-packages/keystoneclient/middleware/auth_token.py:503
2013-09-20 17:32:03.767 31415 WARNING keystoneclient.middleware.auth_token [-] Unexpected response from keystone service: {u'error': {u'message': u'The request you have made requires authentication.', u'code': 401, u'title': u'Not Authorized'}}
2013-09-20 17:32:03.767 31415 DEBUG keystoneclient.middleware.auth_token [-] Token validation failure. _validate_user_token /root/savanna-venv/lib/python2.6/site-packages/keystoneclient/middleware/auth_token.py:704
2013-09-20 17:32:03.767 31415 TRACE keystoneclient.middleware.auth_token Traceback (most recent call last):
2013-09-20 17:32:03.767 31415 TRACE keystoneclient.middleware.auth_token File "/root/savanna-venv/lib/python2.6/site-packages/keystoneclient/middleware/auth_token.py", line 699, in _validate_user_token
2013-09-20 17:32:03.767 31415 TRACE keystoneclient.middleware.auth_token data = self.verify_uuid_token(user_token, retry)
2013-09-20 17:32:03.767 31415 TRACE keystoneclient.middleware.auth_token File "/root/savanna-venv/lib/python2.6/site-packages/keystoneclient/middleware/auth_token.py", line 995, in verify_uuid_token
2013-09-20 17:32:03.767 31415 TRACE keystoneclient.middleware.auth_token headers = {'X-Auth-Token': self.get_admin_token()}
2013-09-20 17:32:03.767 31415 TRACE keystoneclient.middleware.auth_token File "/root/savanna-venv/lib/python2.6/site-packages/keystoneclient/middleware/auth_token.py", line 554, in get_admin_token
2013-09-20 17:32:03.767 31415 TRACE keystoneclient.middleware.auth_token self.admin_token_expiry) = self._request_admin_token()
2013-09-20 17:32:03.767 31415 TRACE keystoneclient.middleware.auth_token File "/root/savanna-venv/lib/python2.6/site-packages/keystoneclient/middleware/auth_token.py", line 674, in _request_admin_token
2013-09-20 17:32:03.767 31415 TRACE keystoneclient.middleware.auth_token raise ServiceError('invalid json response')
2013-09-20 17:32:03.767 31415 TRACE keystoneclient.middleware.auth_token ServiceError: invalid json response
2013-09-20 17:32:03.767 31415 TRACE keystoneclient.middleware.auth_token
2013-09-20 17:32:03.768 31415 DEBUG keystoneclient.middleware.auth_token [-] Marking token bc895966e9bab6912fdb7befb4e99590 as unauthorized in memcache _cache_store_invalid /root/savanna-venv/lib/python2.6/site-packages/keystoneclient/middleware/auth_token.py:965
2013-09-20 17:32:03.768 31415 WARNING keystoneclient.middleware.auth_token [-] Authorization failed for token bc895966e9bab6912fdb7befb4e99590
2013-09-20 17:32:03.769 31415 INFO keystoneclient.middleware.auth_token [-] Invalid user token - rejecting request
------------------------------

[root@openstack ]# cat /root/savanna-venv/etc/savanna.conf
[DEFAULT]

# REST API config
port=8386

# Address and credentials that will be used to check auth tokens
os_auth_host=172.26.35.81
os_auth_port=35357
os_admin_username=admin
os_admin_password=openstack
os_admin_tenant_name=admin

# When set to false, Savanna uses only internal IP of VMs.
# When set to true, Savanna expects OpenStack to auto-
# assign floating IPs to cluster nodes. Internal IPs will
# be used for inter-cluster communication, while floating
# ones will be used by Savanna to configure nodes. Also
# floating IPs will be exposed in service URLs.
#use_floating_ips=True

# The suffix of the node's FQDN. In nova-network that is
# dhcp_domain config parameter (string value)
#node_domain=novalocal

# List of plugins to be loaded. Savanna preserves the order of
# the list when returning it. (list value)
plugins=vanilla,hdp

[plugin:vanilla]
plugin_class=savanna.plugins.vanilla.plugin:VanillaProvider

[plugin:hdp]
plugin_class=savanna.plugins.hdp.ambariplugin:AmbariPlugin

[database]

# URL for sqlalchemy database (string value)
connection=sqlite:////tmp/savanna-server.db

------------------------------

[root@openstack]# cat /root/keystonerc_admin
export OS_USERNAME=admin
export OS_TENANT_NAME=admin
export OS_PASSWORD=openstack
export OS_AUTH_URL=http://172.26.35.81:35357/v2.0/
export PS1='[\u@\h \W(keystone_admin)]\$ '
[root@openstack ]#
-------------------------------------------------------------------------------------------

Can you please guide me where it is gng wrong ?

Question information

Language:
English Edit question
Status:
Solved
For:
Sahara Edit question
Assignee:
No assignee Edit question
Solved by:
Matthew Farrellee
Solved:
Last query:
Last reply:
Revision history for this message
Andrew Lazarev (alazarev) said : 		#1

Savanna currently doesn't support PKI as token format. Could you check token_format property in /etc/keystone/keystone.conf file? It should be UUID.

Revision history for this message
sagar shimpi (sshimpi) said : 		#2

Hi Andrew,

I tried changing value in - /etc/keystone/keystone.conf from -

token_format = PKI
to
token_format = UUID

But no luck. Problem still exist.

Following are the logs -

2013-09-20 22:13:27.696 31415 DEBUG keystoneclient.middleware.auth_token [-] Authenticating user token __call__ /root/savanna-venv/lib/python2.6/site-packages/keystoneclient/middleware/auth_token.py:445
2013-09-20 22:13:27.696 31415 DEBUG keystoneclient.middleware.auth_token [-] Removing headers from request environment: X-Identity-Status,X-Domain-Id,X-Domain-Name,X-Project-Id,X-Project-Name,X-Project-Domain-Id,X-Project-Domain-Name,X-User-Id,X-User-Name,X-User-Domain-Id,X-User-Domain-Name,X-Roles,X-Service-Catalog,X-User,X-Tenant-Id,X-Tenant-Name,X-Tenant,X-Role _remove_auth_headers /root/savanna-venv/lib/python2.6/site-packages/keystoneclient/middleware/auth_token.py:503
2013-09-20 22:13:27.743 31415 WARNING keystoneclient.middleware.auth_token [-] Unexpected response from keystone service: {u'error': {u'message': u'The request you have made requires authentication.', u'code': 401, u'title': u'Not Authorized'}}
2013-09-20 22:13:27.743 31415 DEBUG keystoneclient.middleware.auth_token [-] Token validation failure. _validate_user_token /root/savanna-venv/lib/python2.6/site-packages/keystoneclient/middleware/auth_token.py:704
2013-09-20 22:13:27.743 31415 TRACE keystoneclient.middleware.auth_token Traceback (most recent call last):
2013-09-20 22:13:27.743 31415 TRACE keystoneclient.middleware.auth_token File "/root/savanna-venv/lib/python2.6/site-packages/keystoneclient/middleware/auth_token.py", line 699, in _validate_user_token
2013-09-20 22:13:27.743 31415 TRACE keystoneclient.middleware.auth_token data = self.verify_uuid_token(user_token, retry)
2013-09-20 22:13:27.743 31415 TRACE keystoneclient.middleware.auth_token File "/root/savanna-venv/lib/python2.6/site-packages/keystoneclient/middleware/auth_token.py", line 995, in verify_uuid_token
2013-09-20 22:13:27.743 31415 TRACE keystoneclient.middleware.auth_token headers = {'X-Auth-Token': self.get_admin_token()}
2013-09-20 22:13:27.743 31415 TRACE keystoneclient.middleware.auth_token File "/root/savanna-venv/lib/python2.6/site-packages/keystoneclient/middleware/auth_token.py", line 554, in get_admin_token
2013-09-20 22:13:27.743 31415 TRACE keystoneclient.middleware.auth_token self.admin_token_expiry) = self._request_admin_token()
2013-09-20 22:13:27.743 31415 TRACE keystoneclient.middleware.auth_token File "/root/savanna-venv/lib/python2.6/site-packages/keystoneclient/middleware/auth_token.py", line 674, in _request_admin_token
2013-09-20 22:13:27.743 31415 TRACE keystoneclient.middleware.auth_token raise ServiceError('invalid json response')
2013-09-20 22:13:27.743 31415 TRACE keystoneclient.middleware.auth_token ServiceError: invalid json response
2013-09-20 22:13:27.743 31415 TRACE keystoneclient.middleware.auth_token
2013-09-20 22:13:27.744 31415 DEBUG keystoneclient.middleware.auth_token [-] Marking token 9025cf18244835d398aeddd85e8990c8 as unauthorized in memcache _cache_store_invalid /root/savanna-venv/lib/python2.6/site-packages/keystoneclient/middleware/auth_token.py:965
2013-09-20 22:13:27.744 31415 WARNING keystoneclient.middleware.auth_token [-] Authorization failed for token 9025cf18244835d398aeddd85e8990c8
2013-09-20 22:13:27.744 31415 INFO keystoneclient.middleware.auth_token [-] Invalid user token - rejecting request

Revision history for this message
Best Matthew Farrellee (mattf) said : 		#3

Sagar,

Try using these RPMs,

http://repos.fedorapeople.org/repos/openstack/openstack-havana/epel-6/openstack-savanna-0.3-0.1.a274.gabf778f.el6.noarch.rpm

http://repos.fedorapeople.org/repos/openstack/openstack-havana/epel-6/python-django-savanna-0.3-0.1.a10.g87e1e22.el6.noarch.rpm

And the new RDO instructions,

https://savanna.readthedocs.org/en/latest/userdoc/installation.guide.html

instead.

I typically,

 . yum install <those RPMs above>

 . sed -i -e "s/#os_admin_password=nova/os_admin_password=$OS_PASSWORD/" /etc/savanna/savanna.conf

 . sed -i -e "s/'settings',/'settings', 'savanna',/" -e "s/'openstack_dashboard',/'openstack_dashboard', 'savannadashboard',/" /usr/share/openstack-dashboard/openstack_dashboard/settings.py

Revision history for this message
sagar shimpi (sshimpi) said : 		#4

Hi Matthew,

Thanks for the reply. It worked. I have two further question -

1. Will the Auth_Token will change every time i reboot the machine ?

2. As off now i am using "savanna-0.2-vanilla-1.1.2-ubuntu-12.10.qcow2" for hadoop template. Can you let me know the procedure of creating new customize hadoop template from strach?

Revision history for this message
sagar shimpi (sshimpi) said : 		#5

Just to add 1 more this to 2 point -

I wish to create "centos-hadoop-image" for hadoop.

Revision history for this message
ruhe (ruhe) said : 		#6

You can use https://github.com/stackforge/savanna-image-elements to build custom images.

At this moment it supports Ubuntu and Fedora images.
You can add CentOS support yourself or wait until we do it. I hope CentOS images will be supported in release 0.3.

Revision history for this message
Matthew Farrellee (mattf) said : 		#7

sagar, just so you know, it'll help the savanna community if you open a new question for followup questions -- who's going to look at "error while accessing savanna tab" for an answer about image building or centos.

if by auth_token you mean the os_admin_password, no it will not.

Revision history for this message
sagar shimpi (sshimpi) said : 		#8

Thanks Matthew Farrellee, that solved my question.

Revision history for this message
gws (gzsgwsgwl) said : 		#9

for provisioning hadoop cluster ,we export auth_token= "xxxxx", but some times later,it will expire.how i should do to fix the problem other than repeatly getting new token?

Revision history for this message
Dmitry Mescheryakov (dmitrymex) said : 		#10

This is controlled by the keystone configuration, specifically by 'expiration' in keystone.conf:
http://docs.openstack.org/trunk/openstack-compute/install/yum/content/keystone-conf-file.html

Revision history for this message
gws (gzsgwsgwl) said : 		#11

thanks,i know this default expire time is 24 hours,but what i am not sure is changing this value will reuslt in some undefine effects to other openstack component.

so, is it will?