Tips for scaling out RabbitMQ

asked 2014-07-28 16:47:53 -0500

rooter gravatar image

updated 2014-07-28 16:48:05 -0500

I'm looking for tips on how to maximize the performance and reliability of large OpenStack deployments based on RabbitMQ.

Firstly, how to maximize the performance of a single rabbitmq-server deployment?

Secondly, how to best scale large private clouds with multiple rabbitmq-servers running in a cluster (for scale and HA)? Which one do you prefer, drbd or mirrored-queues, why?

edit retag flag offensive close merge delete

1 answer

Sort by ยป oldest newest most voted

answered 2014-07-29 10:48:37 -0500

mpetason gravatar image

Fuel has been used to deploy large environments with RabbitMQ in Highly Available configurations. There is good documentation through this link:

It should at least be a starting point. The setup ends up being a RabbitMQ cluster with a VIP in front of it. There is a bit more to it, but that is the idea. Mirroring queues with a VIP. There were recent changes that actually setup the controller nodes to point back to themselves first, since the queues are mirroring, so you would places messages on the queue locally first then select the next in order if the process isn't running local.

edit flag offensive delete link more


Gotcha. A the bottom there are a bunch of links to further reading. The blog itself doesn't have a ton of info it's more about the supplemental info at the bottom. I've read through a bit of RabbitMQ in action as well, which is a little bit helpful. My best advise, set up something based on HA then beat it up as much as you can.

mpetason gravatar imagempetason ( 2014-07-29 12:32:12 -0500 )edit

Feel free to download Fuel. Set it up as HA with 3+ controllers. You could do this on virtualbox. Poke around at the configurations as a starting point. It will give you an idea of how we configure it. Your use case might not match the configuration. That's basically what it comes down to for any suggestion with OpenStack - Use Case.

mpetason gravatar imagempetason ( 2014-07-29 19:02:20 -0500 )edit

Get to know Ask OpenStack

Resources for moderators

Question Tools



Asked: 2014-07-28 16:47:53 -0500

Seen: 1,482 times

Last updated: Jul 29 '14