2014-02-11 04:33:23 -0500 answered a question Cluster creation state in Starting only Hi Jonathan Maron , Thanks for the response. When I tried to start ambari server on VM ,it shows error" :Unable to detect the system user for Ambari Server.Please run 'ambari-server setup ' command to create user" As I mentioned , the VM instances do not have internet connection to the outside world ( I need to configure proxy and all ) . Is there a workaround for this ? Can I download manually and create repo or something ? will the configuration of the cluster proceed if I do this ? How can I know what other packages has to be installed ? 2014-02-11 04:33:22 -0500 answered a question Cluster creation state in Starting only Hi Jonathan Maron , Thanks for the response. When I tried to start ambari server on VM ,it shows error" :Unable to detect the system user for Ambari Server.Please run 'ambari-server setup ' command to create user" As I mentioned , the VM instances do not have internet connection to the outside world ( I need to configure proxy and all ) . Is there a workaround for this ? Can I download manually and create repo or something ? will the configuration of the cluster proceed if I do this ? How can I know what other packages has to be installed ? 2014-02-10 13:29:33 -0500 answered a question Cluster creation state in Starting only Hi Andrew Lazarev, I found out that the image is supposed to have jdk installed but i could not find it in annaconda.program.log. I was able to find all the required packages that are installed in the log (like hadoop-libhdfs , hadoop-native, hadoop-pipes, hadoop-sbin ,hadoop-lzo, hadoop-lzo-native ,mysql-server,httpd etc from the list provided in http://savanna.readthedocs.org/en/latest/userdoc/hdp_plugin.html (http://savanna.readthedocs.org/en/lat...) ) Can you please clarify is jdk pre-installed on the HDP vm image ? Right now the VM instances dont have internet connection to the outside world ( I need to configure proxy and all ) ,can I continue with this image ? Could this be causing the problem ? 2014-02-10 05:18:05 -0500 answered a question Cluster creation state in Starting only Hi Andrew Lazarev , Sorry for the confusion . I think I have posted this in another thread as well. I am quite new to this and so little confused . Thanks for the support and helping me with the progress. 2014-02-10 05:14:04 -0500 answered a question Cluster creation state in Starting only Hi Andrew Lazarev, As per your suggestion, I used VM image centos-6_64-hdp-1.3.qcow2 from [link : http://savanna.readthedocs.org/en/latest/userdoc/hdp_plugin.html] (http://savanna.readthedocs.org/en/lat...) . The VM instances are in ACTIVE state, I can ping and SSH into them .But the cluster is in 'configuring' state from one day. I used centos-6_64-hdp-1.3.qcow2 image . The savanna logs is as follows: savanna.plugins.hdp.versions.1_3_2.versionhandler [-] Waiting to connect to ambari server ... 2014-02-10 04:24:21.703 19754 INFO savanna.plugins.hdp.versions.1_3_2.versionhandler [-] Waiting to connect to ambari server ... 2014-02-10 04:24:26.707 19754 INFO urllib3.connectionpool [-] Starting new HTTP connection (1): 172.16.8.28 2014-02-10 04:24:26.708 19754 INFO urllib3.connectionpool [-] Starting new HTTP connection (1): 172.16.8.28 2014-02-10 04:24:26.709 19754 INFO savanna.plugins.hdp.versions.1_3_2.versionhandler [-] Waiting to connect to ambari server ... 2014-02-10 04:24:26.709 19754 INFO savanna.plugins.hdp.versions.1_3_2.versionhandler [-] Waiting to connect to ambari server ... I found this information from https://bugs.launchpad.net/savanna/+bug/1259836 (https://bugs.launchpad.net/savanna/+b...) that the latest HDP vm image should resolve this issue .But I am still facing this problem. What could be the problem ? please help. 2014-02-10 05:11:53 -0500 answered a question can not start cluster Hi Andrew Lazarev, As per your suggestion, I used VM image centos-6_64-hdp-1.3.qcow2 from [link : http://savanna.readthedocs.org/en/latest/userdoc/hdp_plugin.html] (http://savanna.readthedocs.org/en/lat...) . The VM instances are in ACTIVE state, I can ping and SSH into them .But the cluster is in 'configuring' state from one day. I used centos-6_64-hdp-1.3.qcow2 image . The savanna logs is as follows: savanna.plugins.hdp.versions.1_3_2.versionhandler [-] Waiting to connect to ambari server ... 2014-02-10 04:24:21.703 19754 INFO savanna.plugins.hdp.versions.1_3_2.versionhandler [-] Waiting to connect to ambari server ... 2014-02-10 04:24:26.707 19754 INFO urllib3.connectionpool [-] Starting new HTTP connection (1): 172.16.8.28 2014-02-10 04:24:26.708 19754 INFO urllib3.connectionpool [-] Starting new HTTP connection (1): 172.16.8.28 2014-02-10 04:24:26.709 19754 INFO savanna.plugins.hdp.versions.1_3_2.versionhandler [-] Waiting to connect to ambari server ... 2014-02-10 04:24:26.709 19754 INFO savanna.plugins.hdp.versions.1_3_2.versionhandler [-] Waiting to connect to ambari server ... I found this information from https://bugs.launchpad.net/savanna/+bug/1259836 (https://bugs.launchpad.net/savanna/+b...) that the latest HDP vm image should resolve this issue .But I am still facing this problem. What could be the problem ? please help. 2014-02-07 06:04:22 -0500 answered a question can not start cluster Hi Andrew Lazarev, 1.The trace is as follows: 2014-02-05 14:15:24.518 19770 WARNING savanna.service.instances [-] Can't start cluster 'ostf-test-savanna-cluster' (reason: node ostf-test-savanna-cluster-ostf-test-worker-node-tt-dn-001 has error status) 2014-02-05 14:15:24.586 19770 INFO savanna.service.instances [-] Cluster status has been changed: id=3d244250-d9cb-4a32-bbc5-91159416b960, New status=Error 2014-02-05 14:15:24.586 19770 INFO savanna.service.instances [-] Cluster 'ostf-test-savanna-cluster' creation rollback (reason: node ostf-test-savanna-cluster-ostf-test-worker-node-tt-dn-001 has error status) 2014-02-05 14:15:24.618 19770 INFO urllib3.connectionpool [-] Starting new HTTP connection (1): 172.16.8.13 2014-02-05 14:15:24.913 19770 INFO urllib3.connectionpool [-] Starting new HTTP connection (1): 172.16.8.13 2014-02-05 14:15:25.214 19770 ERROR savanna.context [-] Thread 'cluster-creating-3d244250-d9cb-4a32-bbc5-91159416b960' fails with exception: 'node ostf-test-savanna-cluster-ostf-test-worker-node-tt-dn-001 has error status' 2014-02-05 14:15:25.214 19770 TRACE savanna.context Traceback (most recent call last): 2014-02-05 14:15:25.214 19770 TRACE savanna.context File "/usr/lib/python2.6/site-packages/savanna/context.py", line 120, in _wrapper 2014-02-05 14:15:25.214 19770 TRACE savanna.context func(args, *kwargs) 2014-02-05 14:15:25.214 19770 TRACE savanna.context File "/usr/lib/python2.6/site-packages/savanna/service/api.py", line 153, in _provision_cluster 2014-02-05 14:15:25.214 19770 TRACE savanna.context i.create_cluster(cluster) 2014-02-05 14:15:25.214 19770 TRACE savanna.context File "/usr/lib/python2.6/site-packages/savanna/service/instances.py", line 75, in create_cluster 2014-02-05 14:15:25.214 19770 TRACE savanna.context _rollback_cluster_creation(cluster, ex) 2014-02-05 14:15:25.214 19770 TRACE savanna.context File "/usr/lib/python2.6/site-packages/savanna/openstack/common/excutils.py", line 70, in __exit__ 2014-02-05 14:15:25.214 19770 TRACE savanna.context six.reraise(self.type_, self.value, self.tb) 2014-02-05 14:15:25.214 19770 TRACE savanna.context File "/usr/lib/python2.6/site-packages/savanna/service/instances.py", line 51, in create_cluster 2014-02-05 14:15:25.214 19770 TRACE savanna.context _await_active(cluster, instances) 2014-02-05 14:15:25.214 19770 TRACE savanna.context File "/usr/lib/python2.6/site-packages/savanna/service/instances.py", line 342, in _await_active 2014-02-05 14:15:25.214 19770 TRACE savanna.context if _check_if_active(instance): 2014-02-05 14:15:25.214 19770 TRACE savanna.context File "/usr/lib/python2.6/site-packages/savanna/service/instances.py", line 355, in _check_if_active 2014-02-05 14:15:25.214 19770 TRACE savanna.context raise RuntimeError("node %s has error status" % server.name) 2014-02-05 14:15:25.214 19770 TRACE savanna.context RuntimeError: node ostf-test-savanna-cluster-ostf-test-worker-node-tt-dn-001 has error status 2014-02-05 14:15:25.214 19770 TRACE savanna.context 2014-02-05 14:15:38.165 19770 INFO savanna.service.api [-] Cluster status has been changed: id=3d244250-d9cb-4a32-bbc5-91159416b960, New status=Deleting 2014-02-05 14:18:17.791 19770 INFO urllib3.connectionpool [-] Starting new HTTP connection (1): 10.30.0.3 2014-02-07 04:26:21.673 19770 INFO urllib3.connectionpool [-] Starting new HTTP connection (1): 172.16.8.13 2014-02-07 04:26:22.106 19770 INFO savanna.service.api [-] Cluster status has been changed: id=2da3e9b5-b19c-48f1-820f-472350a897e9, New status=Validating 2014-02-07 04:26:22.215 ... 2014-02-07 05:02:46 -0500 answered a question can not start cluster Hi gws, I am having a similar situation, I am using Mirantis Fuel 4.0, I used image[centos-6-64-hdp-vanilla.qcow2 ] from [link : http://savanna.readthedocs.org/en/latest/userdoc/hdp_plugin.html] (http://savanna.readthedocs.org/en/lat...) . The inastances are up and I can SSH and ping them but the cluster turns into erroe state . Savanna logs have something like ' failed execution chown $USER:$USER /etc/hadoop ,RuntimeError : node newcluster_vanilla_worker-001 has error status '. Do you have any idea about this? I am stuck with this for quite some time :(.Since I am using Fuel installer, it is supposed to take care of all configuration after ti launch cluster using a registered image.Any help is appreciated. Thanks. 2014-02-05 08:41:58 -0500 answered a question Cluster creation state in Starting only Hi, Thanks Andrew Lazarev, I tried with centos-6-64-hdp-vanilla.qcow2 image as well , but I am not able to launch cluster yet. The instances are terminating after ERROR status. savanna log has error ' RuntimeError : node newcluster_vanilla_worker-001 has error status '. what does this mean ?Am I missing something ? I will download centos-6_64-hdp-1.3.qcow2 image again and try it out. I will let you know the results. Thanks for the support . 2014-02-05 04:41:39 -0500 answered a question Cluster creation state in Starting only Hi , Sorry, I think I messed up the details. When I used the image http://savanna-files.mirantis.com/savanna-0.2-vanilla-1.1.2 (http://savanna-files.mirantis.com/sav...) image , the instances are active and I can SSh into them but the cluster turns into 'ERROR' state. Savanna/api-log has the following: >error during command execution "sudo chown -R $USER:$USER /opt/oozie/conf" >Return code 1 >chown: cannot access ' /opt/oozie/conf': No such file or directory and at the ending of the logs I can see the following error : >cluster creating fails with exception :'NoneType'object has no attribute 'name' 2.I tried with the image centos-6_64-hdp-1.3.qcow2(link http://docs.openstack.org/developer/savanna/userdoc/hdp_plugin.html (http://docs.openstack.org/developer/s...) ) . For this image, the instances are active but I can not ssh into them.The console of any instance says ' Booting from Hard Disk ..' and the cluster remains in ' WAITING State '. The log file ends with ' INFO urllib3.connectionpool [-] Starting new HTTP connection (1):172.16.8.13' ( The IP is public Ip of controller node) What could be the problem ? Am I using wrong images or am I missing some steps ?? Please help me out. (I am using Fuel v 4.0.) 2014-02-05 04:26:07 -0500 answered a question Cluster creation state in Starting only And the console of any instance says ' Booting from Hard Disk ..' 2014-02-05 03:38:53 -0500 answered a question Cluster creation state in Starting only Hi , Thanks for the response. I am using Fuel 4.0 (latest) installer. I tried with the image centos-6_64-hdp-1.3.qcow2(link http://docs.openstack.org/developer/savanna/userdoc/hdp_plugin.html (http://docs.openstack.org/developer/s...) ) . For this image, the instances are active, I can SSh into them but the cluster remains in 'Waiting state'. Is there something wrong with the steps? ( I followed http://savanna.readthedocs.org/en/latest/horizon/dashboard.user.guide.html (http://savanna.readthedocs.org/en/lat...) , and while registering image , I gave username as 'root' as per the link) Savanna/api-log has the following error during command execution "sudo chown -R $USER:$USER /opt/oozie/conf" Return code 1 chown: cannot access ' /opt/oozie/conf': No such file or directory and at the ending of the logs I can see the following error : cluster creating fails with exception :'NoneType'object has no attribute 'name' What could be the problem ? 2014-02-04 13:55:31 -0500 answered a question Cluster creation state in Starting only Hi, I have a similar problem. I am able to launch the instances ,but the cluster is in ERROR State. I can SSH into instances,and I acn login into the instances through Open stack console.But the cluster is in ERROR state. What could be the problem ? I used http://savanna-files.mirantis.com/savanna-0.2-vanilla-1.1.2 (http://savanna-files.mirantis.com/sav...) image . Please help me out.