OpenStack Object Storage (swift)

Internal Server Error 500+503 / Object-Store - Essex

Asked by Tatenda Mupaso

Okay so I'm currently having a problem with swift after installing it. I'm testing in a VMWare environment right now and I made a separate VM specifically for running Swift. Installed and configured and I went through the installation with no problem, ( swift-account, swift-object, swift-container, proxy, remakerings etc etc.)

First problem I noticed is when I did:

#sudo service swift-object restart
stop: Unknown instance: [OK]
start: Job failed to start

That was my first uh oh moment. Then I ran a swift test after restarting everything,
I tried to ignore the problem but it seemed to only get worse when I added swift to my Keystone Identity service (including endpoint), everything went downhill from there..

root@ubuntu:# swift -V 2.0 -A http://172.16.0.1:5000/v2.0/ -U cookbook:demo -K openstack stat
Auth GET failed: http://172.16.0.1:5000/v2.0/tokens 500 Internal Server Error

Here are some of the things you might find helpful in helping me
***********************************************************************************************************************
remake rings bash

root@ubuntu:/home/swift# leafpad /usr/local/bin/remakerings
root@ubuntu:/home/swift# sudo /usr/local/bin/remakerings
Device z1-127.0.0.1:6010/sdb1_"" with 1.0 weight got id 0
Device z2-127.0.0.1:6020/sdb2_"" with 1.0 weight got id 1
Device z3-127.0.0.1:6030/sdb3_"" with 1.0 weight got id 2
Device z4-127.0.0.1:6040/sdb4_"" with 1.0 weight got id 3
Reassigned 262144 (100.00%) partitions. Balance is now 0.00.
Device z1-127.0.0.1:6011/sdb1_"" with 1.0 weight got id 0
Device z2-127.0.0.1:6021/sdb2_"" with 1.0 weight got id 1
Device z3-127.0.0.1:6031/sdb3_"" with 1.0 weight got id 2
Device z4-127.0.0.1:6041/sdb4_"" with 1.0 weight got id 3
Reassigned 262144 (100.00%) partitions. Balance is now 0.00.
Device z1-127.0.0.1:6012/sdb1_"" with 1.0 weight got id 0
Device z2-127.0.0.1:6022/sdb2_"" with 1.0 weight got id 1
Device z3-127.0.0.1:6032/sdb3_"" with 1.0 weight got id 2
Device z4-127.0.0.1:6042/sdb4_"" with 1.0 weight got id 3
Reassigned 262144 (100.00%) partitions. Balance is now 0.00.

***********************************************************************************************************************
authtoken

root@ubuntu:/home/swift# curl -v -H 'X-Storage-User: test:tester' -H 'X-Storage-Pass: testing' http://127.0.0.1:8080/auth/v1.0
* About to connect() to 127.0.0.1 port 8080 (#0)
* Trying 127.0.0.1... connected
> GET /auth/v1.0 HTTP/1.1
> User-Agent: curl/7.22.0 (x86_64-pc-linux-gnu) libcurl/7.22.0 OpenSSL/1.0.1 zlib/1.2.3.4 libidn/1.23 librtmp/2.3
> Host: 127.0.0.1:8080
> Accept: */*
> X-Storage-User: test:tester
> X-Storage-Pass: testing
>
< HTTP/1.1 200 OK
< X-Storage-Url: http://127.0.0.1:8080/v1/AUTH_test
< X-Storage-Token: AUTH_tk38b27e0f2e4c474d9d2709cd31ec01d4
< X-Auth-Token: AUTH_tk38b27e0f2e4c474d9d2709cd31ec01d4
< Content-Length: 0
< Date: Tue, 20 Nov 2012 16:31:25 GMT
<
* Connection #0 to host 127.0.0.1 left intact
* Closing connection #0
root@ubuntu:/home/swift# curl -v -H 'X-Auth-Token: AUTH_tk38b27e0f2e4c474d9d2709cd31ec01d4' http://127.0.0.1:8080/v1/AUTH_test
* About to connect() to 127.0.0.1 port 8080 (#0)
* Trying 127.0.0.1... connected
> GET /v1/AUTH_test HTTP/1.1
> User-Agent: curl/7.22.0 (x86_64-pc-linux-gnu) libcurl/7.22.0 OpenSSL/1.0.1 zlib/1.2.3.4 libidn/1.23 librtmp/2.3
> Host: 127.0.0.1:8080
> Accept: */*
> X-Auth-Token: AUTH_tk38b27e0f2e4c474d9d2709cd31ec01d4
>
< HTTP/1.1 503 Internal Server Error
< Content-Type: text/html; charset=UTF-8
< Content-Length: 0
< Date: Tue, 20 Nov 2012 16:32:56 GMT
<
* Connection #0 to host 127.0.0.1 left intact
* Closing connection #0

********************************************************************************************************
    CONFIG FILES
*********************************************************************************************************
object-server.conf

[DEFAULT]
bind_ip = 0.0.0.0
workers = 2

[pipeline:main]
pipeline = object-server

[app:object-server]
use = egg:swift#object

[object-replicator]

[object-updater]

[object-auditor]
***********************************************************************************************************
/etc/swift/object-server/1.conf (1-4)

[DEFAULT]
devices = /srv/1/node
mount_check = false
bind_port = 6010
user = swift
log_facility = LOG_LOCAL2

[pipeline]
pipeline = object-server

[app:object-server]
use = egg:swift#object

[object-replicator]
vm_test_mode = yes

[object-updater]

[object-auditor]
**************************************************************************************************************
/etc/swift/account-server/1.conf (1-4)

[DEFAULT]
devices = /srv/1/node
mount_check = false
bind_port = 6012
user = swift
log_facility = LOG_LOCAL2

[pipeline:main]
pipeline = account-server

[account-replicator]
vm_test_mode = yes

[account-auditor]

[account-reaper]
**************************************************************************************************************
/etc/swift/container-server/1.conf (1-4)

[DEFAULT]
devices = /src/1/node
mount_check = false
bind_port = 6011
user = swift
log_facility = LOG_LOCAL2

[pipeline:main]
pipeline = container-server

[app:container-server]
use = egg:swift#container

[account-replicator]
vm_test_mode = yes

[account-updater]

[account-auditor]

[account-sync]

**************************************************************************************************************
/etc/swift/proxy-server.conf

[DEFAULT]
bind_port = 443
cert_file = /etc/swift/cert.crt
key_file = /etc/swift/cert.key
user = swift
log_facility = LOG_LOGICAL1

[pipeline:main]
pipeline = catch_errors healthcheck cache authtoken keystone proxy-server

[app:proxy-server]
use = egg:swift#proxy
account_autocreate = true

[filter:healthcheck]
use = egg:swift#healthcheck

[filter:cache]
use = egg:swift#memcache

[filter:keystone]
paste.filter_factory = keystone.middleware.auth_token:filter_factory
operator_roles = Member, admin

[filter:authtoken]
paste.filter_factory = keystone.middleware.auth_token:filter_factory
service_port = 5000
service_host = 172.16.0.1
auth_port = 35357
auth_host = 172.16.0.1
auth_protocol = http
auth_token = ADMIN
admin_token = ADMIN
admin_tenant_name = service
admin_user = swift
admin_password = swift
cache = swift.cache

[filter:catch_errors]
use = egg:swift#catch_errors

[filter:swift3]
use = egg:swift#swift3
**************************************************************************************************************

Everything had been going smooth until the swift test, I don't know if I misconfigured anything

Question information

Language:
English Edit question
Status:
Solved
For:
OpenStack Object Storage (swift) Edit question
Assignee:
No assignee Edit question
Solved by:
Tatenda Mupaso
Solved:
Last query:
Last reply:
Revision history for this message
Tatenda Mupaso (tatenda-mupaso) said : 		#1

Nevermind, solved. Config files had a couple of typos and i fixed everything. I have ran into another problem. I'll make another post

Revision history for this message
Craig (warburton-craig) said : 		#2

Hi - Could you confirm what errors you found in your config files? I am encountering the same issue but all of my config files seem ok.

Thanks.

Revision history for this message
Tatenda Mupaso (tatenda-mupaso) said : 		#3

Hi Craig, Sorry I am only seeing your email now. But I went back and REALLY scrutinized every configuration line in my config files and they were typo's. All Syntax errors on my part. I know it's a pain but I had to learn the hard way. I have moved onto Folsom now though, haven't gotten to the same problem now, because this was back when I was testing in Essex. Hopefully this helps. Let me know.