hardware limits

asked 2016-01-05 02:48:46 -0600

vblando gravatar image

Given that I have a fairly fast controller (dual 8core, 128GB mem, 2x10GBase-T) is there a limit on how many compute nodes it can handle?

edit retag flag offensive close merge delete

1 answer

Sort by ยป oldest newest most voted

answered 2016-01-05 03:16:59 -0600

Prateek K gravatar image

updated 2016-01-10 23:10:58 -0600

There is no term like limits in the entire openstack installation about the limit to the compute nodes as When it comes to availability in openstack every compute node runs a major service known as nova-compute and neutron-openvswitch-agent.

Now these two services connect to controller via RabbitMQ which is an AMQP broker ( Again it has no limits to the number of connections)

So practically its like the more resources you have the more load your controller can handle. In my experience I was able to add 15 physical compute nodes and for testing I created a fake kind of mechanism and was able to add around 180 compute nodes to controller.

OK... if you are intrested in making fake compute nodes then do the following. There are actually 2 ways of doing it :

Method 1-

  1. Take a physical machine and install docker on it.

  2. Create a lxc container and install nova-compute service on it.

  3. Configure the compute node service running inside the container.
  4. Make sure you do the networking in such a way that you are able to ping the controller from the container.
  5. Start the container.
  6. The service should come up and there should be a compute node added to the controller.
  7. Create as many clones of the container as you want .
  8. So if you have 9 clones then you have 9 fake compute nodes running for testing purpose.

Method 2- This method requires prior knowledge of AMQP server and Messaging application which you are using in openstack environment. In 90% of cases is RabbitMQ. Also you need to have basic knowledge of python as you have to write a small script.

  1. Bring down the nova-compute service running on a compute node.
  2. Once its down, see which exchanges are present on the RabbitMQ server running on the controller.
  3. Bring up the compute node and try to capture the messages that go from compute node to the controller via AMQP server.
  4. To capture messages you need to create a consumer script on the exchange which is getting used for the compute to send messages to the controller.
  5. The messages will be in oslo messaging format and they would be actually in the form of nested python dictionaries.
  6. Once you have all the messages create another python script, and using that script send the messages captured earlier.
  7. When these messages come the controller thinks that a compute node is added to the system.
  8. Create threads of this python script.
  9. Each thread corresponds to a Fake compute node.

Method 2 is somewhat complicated but it would consume the least number of resources as there are no services involved. Just a piece of code along with threading.

You can use any of the methods listed to create a Fake compute node. The agenda of this experiment is just to test how much compute nodes controller in your environment can handle. you wont be able to launch instances or do the networking.

edit flag offensive delete link more


can you explain further the "fake kind of mechanism" you're talking about? 180 compute nodes is impressive. Right now on production, I have 4 compute nodes.

vblando gravatar imagevblando ( 2016-01-09 23:04:38 -0600 )edit

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower


Asked: 2016-01-05 02:48:46 -0600

Seen: 108 times

Last updated: Jan 10 '16