Ask Your Question
0

How many objects per container?

asked 2011-05-26 09:52:09 -0500

jasper-capel gravatar image

I'm currently evaluating swift for object storage, to replace our MogileFS storage system, which is currently hosting approximately 75 million objects and growing rapidly. I can of course split these out over multiple containers, and scale the amount of container servers (which we will probably do). But I was wondering if anyone had some real world experiences as to when the amount of objects in a single container becomes a performance bottleneck (if I understand the architecture correctly, hosting the database for a single container is not sharded across multiple container servers).

edit retag flag offensive close merge delete

5 answers

Sort by ยป oldest newest most voted
0

answered 2011-06-16 09:11:57 -0500

jasper-capel gravatar image

I'm now sizing for a maximum of 1 million objects per container, but would still be interested in some real world numbers.

edit flag offensive delete link more
0

answered 2011-06-20 06:56:10 -0500

jasper-capel gravatar image

Thanks!

edit flag offensive delete link more
0

answered 2011-06-20 06:56:20 -0500

jasper-capel gravatar image

Thanks gholt, that solved my question.

edit flag offensive delete link more
0

answered 2011-06-11 09:19:24 -0500

This question was expired because it remained in the 'Open' state without activity for the last 15 days.

edit flag offensive delete link more
0

answered 2011-06-18 00:46:45 -0500

gholt gravatar image

This depends greatly on the performance of the hardware and what services are colocated on that hardware. For instance, a rather standard machine with a standard hard drive running all services can handle, at load, about 30 puts per second (up to 70 puts per second with low load) per container up to around 10 million objects. We usually recommend trying to keep containers under 10 million objects.

However, we've also tested using an array of SSDs (container servers use up all the IOPS you can give them) and we were at about 400 puts per second on a 1 billion object container. Of course, the server was doing nothing else but that one container at the time.

So, as you can see, the performance can vary quite a bit, but 10 million objects per container is usually a pretty good target.

edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

Stats

Asked: 2011-05-26 09:52:09 -0500

Seen: 387 times

Last updated: Jun 20 '11