OpenStack Object Storage (Swift)

endless file uploading

Asked by Anton on 2012-07-27

Hello,
files don`t uploading in object-storage

root@EX5-1 /etc/swift # swift -A http://78.46.112.83:8080/auth/v1.0 -U system:root -K testpass upload xxx account.ring.gz
^CTraceback (most recent call last):
  File "/usr/bin/swift", line 1972, in <module>
    error_queue)
  File "/usr/bin/swift", line 1831, in st_upload
    thread.join(0.01)
  File "/usr/lib/python2.7/threading.py", line 674, in join
    self.__block.wait(delay)
  File "/usr/lib/python2.7/threading.py", line 262, in wait
    _sleep(delay)
KeyboardInterrupt
^Z
[8]+ Stopped swift -A http://78.46.112.83:8080/auth/v1.0 -U system:root -K testpass upload xxx account.ring.gz
root@EX5-1 /etc/swift #

And same formpost http://78.46.112.83/ (you can try)

Accounts and containers successfull creating.

Help me :(

Question information

Language:
English Edit question
Status:
Solved
For:
OpenStack Object Storage (swift) Edit question
Assignee:
No assignee Edit question
Solved by:
Anton
Solved:
2012-07-30
Last query:
2012-07-30
Last reply:
Anton (hettbox) said : #1

root@EX5-1 /etc/swift # swift-ring-builder account.builder
account.builder, build version 3
4096 partitions, 3 replicas, 3 zones, 3 devices, 0.00 balance
The minimum number of hours before a partition can be reassigned is 1
Devices: id zone ip address port name weight partitions balance meta
             0 1 5.9.60.245 6002 md3 100.00 4096 0.00
             1 2 5.9.60.243 6002 md3 100.00 4096 0.00
             2 3 5.9.60.242 6002 md3 100.00 4096 0.00
root@EX5-1 /etc/swift # swift-ring-builder container.builder
container.builder, build version 3
4096 partitions, 3 replicas, 3 zones, 3 devices, 0.00 balance
The minimum number of hours before a partition can be reassigned is 1
Devices: id zone ip address port name weight partitions balance meta
             0 1 5.9.60.245 6001 md3 100.00 4096 0.00
             1 2 5.9.60.243 6001 md3 100.00 4096 0.00
             2 3 5.9.60.242 6001 md3 100.00 4096 0.00
root@EX5-1 /etc/swift # swift-ring-builder object.builder
object.builder, build version 3
4096 partitions, 2 replicas, 3 zones, 3 devices, 0.02 balance
The minimum number of hours before a partition can be reassigned is 1
Devices: id zone ip address port name weight partitions balance meta
             0 1 5.9.60.245 6000 md3 100.00 2730 -0.02
             1 2 5.9.60.243 6000 md3 100.00 2731 0.01
             2 3 5.9.60.242 6000 md3 100.00 2731 0.01

Anton (hettbox) said : #2

Object-server log

Jul 27 11:54:38 Ubuntu-1204-precise-64-minimal container-server 46.4.52.146 - - [27/Jul/2012:09:54:38 +0000] "PUT /md3/773/AUTH_system/xxx" 202 - "tx3cffb15a74624b2a85db7d8b4a4e18c5" "-" "-" 0.0376
Jul 27 11:54:38 Ubuntu-1204-precise-64-minimal account-server 5.9.60.245 - - [27/Jul/2012:09:54:38 +0000] "PUT /md3/554/AUTH_system/xxx" 201 - "tx3cffb15a74624b2a85db7d8b4a4e18c5" "-" "-" 0.0036 ""
Jul 27 11:54:41 Ubuntu-1204-precise-64-minimal swift 46.4.52.146 - - [27/Jul/2012:09:54:41 +0000] "HEAD /md3/239420/AUTH_system/xxx/account.ring.gz" 404 - "-" "tx88ad6c1fd7a14a2298ea1601df0969f4" "-" 0.0002
Jul 27 11:54:41 Ubuntu-1204-precise-64-minimal container-server 46.4.52.146 - - [27/Jul/2012:09:54:41 +0000] "PUT /md3/773/AUTH_system/xxx" 202 - "txacb0112e7f7849fd908f28539f1335b5" "-" "-" 0.0417
Jul 27 11:54:41 Ubuntu-1204-precise-64-minimal account-server 5.9.60.245 - - [27/Jul/2012:09:54:41 +0000] "PUT /md3/554/AUTH_system/xxx" 201 - "txacb0112e7f7849fd908f28539f1335b5" "-" "-" 0.0037 ""
Jul 27 11:54:41 Ubuntu-1204-precise-64-minimal swift 46.4.52.146 - - [27/Jul/2012:09:54:41 +0000] "HEAD /md3/239420/AUTH_system/xxx/account.ring.gz" 404 - "-" "txdb9cc912bdcd462fb48b887522ea4bbb" "-" 0.0002
Jul 27 11:54:41 Ubuntu-1204-precise-64-minimal container-server 46.4.52.146 - - [27/Jul/2012:09:54:41 +0000] "HEAD /md3/773/AUTH_system/xxx" 204 - "tx27e4ef79d51c411faa5aef4f2d9916ff" "-" "-" 0.0014

Anton (hettbox) said : #3

proxy-server log

Jul 27 11:47:10 Ubuntu-1204-precise-64-minimal swift 94.251.80.150 94.251.80.150 27/Jul/2012/09/47/10 POST /v1/AUTH_system/guest/5012639a3967d/ HTTP/1.0 %5B0%5D http%3A//78.46.112.83/ Opera/9.80%20%28Windows%20NT%206.1%3B%20WOW64%3B%20U%3B%20ru%29%20Presto/2.10.289%20Version/12.00%20FormPOST - - - - - - -
Jul 27 11:47:16 Ubuntu-1204-precise-64-minimal swift 94.251.80.150 94.251.80.150 27/Jul/2012/09/47/16 POST /v1/AUTH_system/guest/501263a04aa40/ HTTP/1.0 %5B0%5D http%3A//78.46.112.83/ Opera/9.80%20%28Windows%20NT%206.1%3B%20WOW64%3B%20U%3B%20ru%29%20Presto/2.10.289%20Version/12.00%20FormPOST - - - - - - -
Jul 27 12:00:26 Ubuntu-1204-precise-64-minimal swift 94.251.80.150 94.251.80.150 27/Jul/2012/10/00/26 POST /v1/AUTH_system/guest/501266b696d7c/ HTTP/1.0 %5B0%5D http%3A//78.46.112.83/ Opera/9.80%20%28Windows%20NT%206.1%3B%20WOW64%3B%20U%3B%20ru%29%20Presto/2.10.289%20Version/12.00%20FormPOST - - - - - - -
Jul 27 12:00:26 Ubuntu-1204-precise-64-minimal swift - - 27/Jul/2012/10/00/26 HEAD /v1/AUTH_system HTTP/1.0 204 - FormPost - - - - tx0c20ee603e714afcaf7dc0bb2f09e7f7 - 0.0049 -

Anton (hettbox) said : #4

 30 06:05:49 Ubuntu-1204-precise-64-minimal object-server 78.46.112.83 - - [30/Jul/2012:04:05:49 +0000] "HEAD /md3/253023/AUTH_system/xxx/container.builder" 404 - "-" "txb66d26f2802d4bf38627233b0d68fca6" "-" 0.0004
Jul 30 06:13:48 Ubuntu-1204-precise-64-minimal object-server 78.46.112.83 - - [30/Jul/2012:04:13:48 +0000] "PUT /md3/253023/AUTH_system/xxx/container.builder" 499 - "-" "tx38776b02e92a46e9a940e31666b454b5" "-" 479.1971
Jul 30 06:13:48 Ubuntu-1204-precise-64-minimal object-server ERROR __call__ error with PUT /md3/221914/AUTH_system/guest/5012754dd3ac6/17%20The%20Terminator%20Decoup ling%20%28HD%29.m4v_snapshot_11.51_%5B2012.05.14_22.22.59%5D.jpg : #012Traceback (most recent call last):#012 File "/usr/lib/python2.7/dist-packages/swift/obj/serve r.py", line 810, in __call__#012 res = getattr(self, req.method)(req)#012 File "/usr/lib/python2.7/dist-packages/swift/obj/server.py", line 562, in PUT#012 fo r chunk in iter(lambda: reader(self.network_chunk_size), ''):#012 File "/usr/lib/python2.7/dist-packages/swift/obj/server.py", line 562, in <lambda>#012 for chun k in iter(lambda: reader(self.network_chunk_size), ''):#012 File "/usr/lib/python2.7/dist-packages/eventlet/wsgi.py", line 147, in read#012 return self._chunked_ read(self.rfile, length)#012 File "/usr/lib/python2.7/dist-packages/eventlet/wsgi.py", line 137, in _chunked_read#012 self.chunk_length = int(rfile.readline().sp lit(";", 1)[0], 16)#012ValueError: invalid literal for int() with base 16: '' (txn: txf8fb3c7a19324a529654bb396da5dc2a)
Jul 30 06:13:48 Ubuntu-1204-precise-64-minimal object-server 78.46.112.83 - - [30/Jul/2012:04:13:48 +0000] "PUT /md3/221914/AUTH_system/guest/5012754dd3ac6/17%20The% 20Terminator%20Decoupling%20%28HD%29.m4v_snapshot_11.51_%5B2012.05.14_22.22.59%5D.jpg" 500 799 "-" "txf8fb3c7a19324a529654bb396da5dc2a" "-" 234666.6600
Jul 30 06:13:48 Ubuntu-1204-precise-64-minimal object-server STDOUT: Traceback (most recent call last): (txn: txf8fb3c7a19324a529654bb396da5dc2a)
Jul 30 06:13:48 Ubuntu-1204-precise-64-minimal object-server STDOUT: File "/usr/lib/python2.7/dist-packages/eventlet/greenpool.py", line 80, in _spawn_n_impl (txn: t xf8fb3c7a19324a529654bb396da5dc2a)
Jul 30 06:13:48 Ubuntu-1204-precise-64-minimal object-server STDOUT: func(*args, **kwargs) (txn: txf8fb3c7a19324a529654bb396da5dc2a)
Jul 30 06:13:48 Ubuntu-1204-precise-64-minimal object-server STDOUT: File "/usr/lib/python2.7/dist-packages/eventlet/wsgi.py", line 514, in process_request (txn: txf 8fb3c7a19324a529654bb396da5dc2a)
Jul 30 06:13:48 Ubuntu-1204-precise-64-minimal object-server STDOUT: proto = self.protocol(socket, address, self) (txn: txf8fb3c7a19324a529654bb396da5dc2a)
Jul 30 06:13:48 Ubuntu-1204-precise-64-minimal object-server STDOUT: File "/usr/lib/python2.7/SocketServer.py", line 638, in __init__ (txn: txf8fb3c7a19324a529654bb3 96da5dc2a)
Jul 30 06:13:48 Ubuntu-1204-precise-64-minimal object-server STDOUT: self.handle() (txn: txf8fb3c7a19324a529654bb396da5dc2a)
Jul 30 06:13:48 Ubuntu-1204-precise-64-minimal object-server STDOUT: File "/usr/lib/python2.7/BaseHTTPServer.py", line 340, in handle (txn: txf8fb3c7a19324a529654bb3 96da5dc2a)
Jul 30 06:13:48 Ubuntu-1204-precise-64-minimal object-server STDOUT: self.handle_one_request() (txn: txf8fb3c7a19324a529654bb396da5dc2a)
Jul 30 06:13:48 Ubuntu-1204-precise-64-minimal object-server STDOUT: File "/usr/lib/python2.7/dist-packages/eventlet/wsgi.py", line 232, in handle_one_request (txn: txf8fb3c7a19324a529654bb396da5dc2a)
Jul 30 06:13:48 Ubuntu-1204-precise-64-minimal object-server STDOUT: self.handle_one_response() (txn: txf8fb3c7a19324a529654bb396da5dc2a)
Jul 30 06:13:48 Ubuntu-1204-precise-64-minimal object-server STDOUT: File "/usr/lib/python2.7/dist-packages/eventlet/wsgi.py", line 380, in handle_one_response (txn: txf8fb3c7a19324a529654bb396da5dc2a)
Jul 30 06:13:48 Ubuntu-1204-precise-64-minimal object-server STDOUT: while self.environ['eventlet.input'].read(MINIMUM_CHUNK_SIZE): (txn: txf8fb3c7a19324a529654bb396 da5dc2a)
Jul 30 06:13:48 Ubuntu-1204-precise-64-minimal object-server STDOUT: File "/usr/lib/python2.7/dist-packages/eventlet/wsgi.py", line 147, in read (txn: txf8fb3c7a1932 4a529654bb396da5dc2a)
Jul 30 06:13:48 Ubuntu-1204-precise-64-minimal object-server STDOUT: return self._chunked_read(self.rfile, length) (txn: txf8fb3c7a19324a529654bb396da5dc2a)
Jul 30 06:13:48 Ubuntu-1204-precise-64-minimal object-server STDOUT: File "/usr/lib/python2.7/dist-packages/eventlet/wsgi.py", line 137, in _chunked_read (txn: txf8f b3c7a19324a529654bb396da5dc2a)
Jul 30 06:13:48 Ubuntu-1204-precise-64-minimal object-server STDOUT: self.chunk_length = int(rfile.readline().split(";", 1)[0], 16) (txn: txf8fb3c7a19324a529654bb396 da5dc2a)
Jul 30 06:13:48 Ubuntu-1204-precise-64-minimal object-server STDOUT: ValueError: invalid literal for int() with base 16: '' (txn: txf8fb3c7a19324a529654bb396da5dc2a)

Anton (hettbox) said : #5

I making ring for accounts and containers for 3 replicas, objects - 2 replicas, this configuration not working!!!
I recreate all rings with param 2 replicas and all succesfull working!