append support

asked 2012-07-26 11:09:14 -0600

Any plans for supporting appends to blobs? Our users are uploading files in pieces and right now we need to buffer it locally, and once the file is finished, upload into swift. we would like to upload into swift directly, bit by bit.

I know something like this is possible (uploading multiple blobs and having a manifest to combine hem all) but this assumes the multiple blobs are a certain, predetermined size. we want to append arbitrarily sized chunks.

edit retag flag offensive close merge delete

2 answers

Sort by ยป oldest newest most voted
0

answered 2012-07-26 14:11:45 -0600

notmyname gravatar image

The way to do this is with different segments tied together with a manifest file. There is no requirement in swift that the segments be the same size.

edit flag offensive delete link more
0

answered 2012-08-29 21:58:58 -0600

But this will lead to the "many small writes" problem, i.e. overpopulated containers. Which in turn leads to a question: What solution has less risk: server side append or container sharding?

edit flag offensive delete link more

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

Stats

Asked: 2012-07-26 11:09:14 -0600

Seen: 12 times

Last updated: Aug 29 '12