OpenStack Object Storage (swift)

How does Swift store a big file to its storage

Asked by Chau Pham

Hi everybody,

I have a big media file, for example 5GB.
and there are some storage in Swift and the biggest storage is not exceed 5GB. total of those storage may greater than 5GB.

How does Swift separate the media file and store it in separate storage?

Please help me.

Thank you.

Question information

Language:
English Edit question
Status:
Solved
For:
OpenStack Object Storage (swift) Edit question
Assignee:
No assignee Edit question
Solved by:
John Dickinson
Solved:
Last query:
Last reply:
Revision history for this message
Best John Dickinson (notmyname) said : 		#1

Swift has a feature for handling >5GB files.

1) Split your file into chunks that are less that 5GB each (this is currently the responsibility of the client)

2) Upload each chunk, concurrently if desired

3) Create a manifest file that ties together all of the chunks. When accessing the manifest object, all of the component parts are streamed serially to the client

http://swift.openstack.org/overview_large_objects.html

Revision history for this message
Chau Pham (chaupv79) said : 		#2

Thank John for your quick answer,

I will make an example that follow your suggestion

Revision history for this message
Chau Pham (chaupv79) said : 		#3

Thanks John Dickinson, that solved my question.