Ask Your Question
2

How to scale Openstack sahara cluster - Bigdata

asked 2018-02-04 22:20:17 -0500

Radhakrishnan Rk gravatar image

Hello,

I am running sahara service in my openstack POC infrastructure. How should I scale in and scale out my hadoop cluster size. I am using apache vannila plugin for deploying hadoop cluster. Can anyone help me to scale my cluster.

Best Regards,

Radhakrishnan Rk

edit retag flag offensive close merge delete

1 answer

Sort by ยป oldest newest most voted
1

answered 2018-02-06 05:59:48 -0500

The Sahara documentation has a paragraph about scaling via the GUI: https://docs.openstack.org/sahara/lat....

The CLI has a command dataprocessing cluster scalehttps://docs.openstack.org/python-sah....

Of course, you can also use the API: https://developer.openstack.org/api-r....

Disclaimer: I am by no means an expert in big data or Sahara.

edit flag offensive delete link more

Comments

Thank for the information. I have checked the doc. I am not sure will it add or remove the cluster nodes by proper service decommission. If it tries to decommission a node manager or data node of a hadoop cluster. It should backup all the data and stop the daemon gracefully. Let me check here.

Radhakrishnan Rk gravatar imageRadhakrishnan Rk ( 2018-02-06 07:34:18 -0500 )edit

Some more info here: https://docs.openstack.org/sahara/oca.... It doesn't specifically mention data backup, but "Decommissioning a Data Node may take some time because Hadoop rearranges data replicas around the Cluster" sounds good.

Bernd Bausch gravatar imageBernd Bausch ( 2018-02-07 02:17:30 -0500 )edit

Thank you for the information.

Radhakrishnan Rk gravatar imageRadhakrishnan Rk ( 2018-02-17 23:59:31 -0500 )edit

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

Stats

Asked: 2018-02-04 22:20:17 -0500

Seen: 158 times

Last updated: Feb 06 '18