Ask Your Question

Howto Multiserver Stats

asked 2010-11-04 00:13:39 -0500

twkiel gravatar image

Proxy and auth are on their own machine, so obviously SAIO stats example wont work out.

Is the best option for this to ship logs from the proxy over to one of the storage (account/object/container) servers and then run the stats jobs there?

edit retag flag offensive close merge delete

2 answers

Sort by ยป oldest newest most voted

answered 2010-11-05 17:14:22 -0500

twkiel gravatar image

I re-read the SAIO stats page and I realized I was confusing it. After that, ( finished off the setup.

edit flag offensive delete link more

answered 2010-11-04 01:19:39 -0500

notmyname gravatar image

The stats system puts files in to the swift cluster itself and the processing piece pulls from the swift cluster. Therefore all logs are available to every machine in the cluster (every machine that has network access to the storage servers).

The 3 phases of the stats system are: 1) generate logs (done by the proxy servers and swift-account-stats-logger) 2) upload logs to swift (done by swift-log-uploader) 3) process logs (done by swift-log-processor

This means you can have designated log processing machines or use any of your existing machines. Designated machines, of course, will have less impact on standard operations. The stats system is CPU and memory hungry.

edit flag offensive delete link more

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower


Asked: 2010-11-04 00:13:39 -0500

Seen: 104 times

Last updated: Nov 05 '10