How to scale Openstack sahara cluster - Bigdata

asked 2018-02-04 22:20:17 -0600

Radhakrishnan Rk gravatar image


I am running sahara service in my openstack POC infrastructure. How should I scale in and scale out my hadoop cluster size. I am using apache vannila plugin for deploying hadoop cluster. Can anyone help me to scale my cluster.

Best Regards,

Radhakrishnan Rk

edit retag flag offensive close merge delete

1 answer

Sort by ยป oldest newest most voted

answered 2018-02-06 05:59:48 -0600

The Sahara documentation has a paragraph about scaling via the GUI:

The CLI has a command dataprocessing cluster scale

Of course, you can also use the API:

Disclaimer: I am by no means an expert in big data or Sahara.

edit flag offensive delete link more


Thank for the information. I have checked the doc. I am not sure will it add or remove the cluster nodes by proper service decommission. If it tries to decommission a node manager or data node of a hadoop cluster. It should backup all the data and stop the daemon gracefully. Let me check here.

Radhakrishnan Rk gravatar imageRadhakrishnan Rk ( 2018-02-06 07:34:18 -0600 )edit

Some more info here: It doesn't specifically mention data backup, but "Decommissioning a Data Node may take some time because Hadoop rearranges data replicas around the Cluster" sounds good.

Bernd Bausch gravatar imageBernd Bausch ( 2018-02-07 02:17:30 -0600 )edit

Thank you for the information.

Radhakrishnan Rk gravatar imageRadhakrishnan Rk ( 2018-02-17 23:59:31 -0600 )edit

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower


Asked: 2018-02-04 22:20:17 -0600

Seen: 216 times

Last updated: Feb 06 '18