Ask Your Question
1

object-auditor process consume disk I/O

asked 2011-12-07 13:58:20 -0500

mhy19 gravatar image

hello! my swift is 1 proxy node + 5 zones(one storage node each zone, each storage node has 2T disk space), siwft1.4.3

on my storage node, the disk IO speed I got with the help of "time dd if=/dev/zero of=/srv/node/sda3/test bs=1M count=2000" is about 120MB/s; But, once the object-auditor process of storage nodes is on, the IO speed will decrease violently, because the object-auditor has been always reading disk and generating read IO speed about 10MB/s. This case makes the whole speed of swift very slow. Once I stop the object-auditor process, the speed of swift becomes very quick.

I knew that object-auditor process's function is to ensure the integrity of objects/container/account, but is it neccessary to keep it always on? Perhaps there is something wrong of my configure. So I need some advice and help, Thanks!

edit retag flag offensive close merge delete

3 answers

Sort by ยป oldest newest most voted
1

answered 2011-12-07 16:40:37 -0500

david-goetz gravatar image

You can slow down the object auditor by setting the following configuration fields in the object-auditor section of your object-server.conf file:

files_per_second = 20 bytes_per_second = 10000000

The above values are the defaults. You can see this in the docs here: http://swift.openstack.org/deployment_guide.html#object-server-configuration (http://swift.openstack.org/deployment...)

It is important to have the auditor running to check for data corruption but using the fields above you should be able to set it to a speed that won't affect performance of the cluster too much.

Another another important audit check to run is described here: http://swift.openstack.org/admin_guide.html#object-auditor (http://swift.openstack.org/admin_guid...)

The zero byte check can be run at a much faster speed and causes less load because it only looks at zero byte files and doesn't read through the entire files for an md5 for verification of the file's etag. The zero byte file is much more common problem. We run it after we have system failures on a object-server.

edit flag offensive delete link more
0

answered 2011-12-08 07:46:44 -0500

mhy19 gravatar image

Thanks David, I have changed "bytes_per_second = 3000000" and tested the speed of swift. This change indeed can accelerate its performance.

edit flag offensive delete link more
0

answered 2011-12-08 07:43:16 -0500

mhy19 gravatar image

Thanks David Goetz, that solved my question.

edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

Stats

Asked: 2011-12-07 13:58:20 -0500

Seen: 127 times

Last updated: Dec 08 '11