Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

Sahara Cluster Fails - Failed to create trust

Hi,

Below is the error I see in the Sahara-engine logs, when trying to launch a Sahara-vanilla-271 cluster

Openstack version - Liberty Sahara installed in virtual environment. Appreciate if anybody else has come across this issue.

root@controller:~# /root/sahara-venv/bin/python sahara-venv/bin/sahara-engine --config-file sahara-venv/etc/sahara.conf 2018-06-21 15:29:55.883 28787 INFO sahara.utils.rpc [-] Notifications disabled 2018-06-21 15:29:56.584 28787 INFO sahara.plugins.base [-] Plugin hdp loaded sahara.plugins.hdp.ambariplugin:AmbariPlugin 2018-06-21 15:29:56.584 28787 INFO sahara.plugins.base [-] Plugin vanilla loaded sahara.plugins.vanilla.plugin:VanillaProvider 2018-06-21 15:29:56.585 28787 INFO sahara.plugins.base [-] Plugin cdh loaded sahara.plugins.cdh.plugin:CDHPluginProvider 2018-06-21 15:29:56.585 28787 INFO sahara.plugins.base [-] Plugin spark loaded sahara.plugins.spark.plugin:SparkProvider 2018-06-21 15:29:56.585 28787 INFO sahara.main [-] Sahara engine started 2018-06-21 15:29:56.585 28787 INFO keystonemiddleware.auth_token [-] Starting Keystone auth_token middleware 2018-06-21 15:29:56.587 28787 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release. 2018-06-21 15:29:56.589 28787 INFO keystonemiddleware.auth_token [-] Using /tmp/keystone-signing-KJRpiI as cache directory for signing certificate 2018-06-21 15:29:56.589 28787 INFO oslo_service.periodic_task [-] Skipping periodic task check_for_zombie_proxy_users because its interval is negative 2018-06-21 15:29:56.595 28787 INFO sahara.main [-] Driver heat successfully loaded 2018-06-21 15:29:56.598 28787 INFO sahara.main [-] Driver ssh successfully loaded 2018-06-21 15:30:26.104 28787 WARNING sahara.context [-] Arguments dropped when creating context: {u'project_name': u'service', u'user_name': u'sahara'} 2018-06-21 15:30:26.679 28787 WARNING oslo_messaging.server [-] Possible hang: wait is waiting for stop to complete 2018-06-21 15:30:27.387 28787 ERROR sahara.service.trusts [req-0bd98b81-b083-440a-a846-aed173eb556c 71b95d25439743169779a32ea4e17ee2 8ca3e3ea84a34bf99301676cec07e502 - - -] [instance: none, cluster: b4c9bc70-b6ae-451a-92f7-54a6da6b67f9] Unable to create trust (reason: The request you have made requires authentication. (HTTP 401) (Request-ID: req-167c483f-4d38-40f7-879b-748184ad62a5)) 2018-06-21 15:30:27.458 28787 ERROR sahara.service.ops [req-0bd98b81-b083-440a-a846-aed173eb556c 71b95d25439743169779a32ea4e17ee2 8ca3e3ea84a34bf99301676cec07e502 - - -] [instance: none, cluster: b4c9bc70-b6ae-451a-92f7-54a6da6b67f9] Error during operating on cluster (reason: Failed to create trust Error ID: 87a0562d-aea5-4f04-a977-5afa1edfcbbd) 2018-06-21 15:30:27.458 28787 ERROR sahara.service.ops [instance: none, cluster: b4c9bc70-b6ae-451a-92f7-54a6da6b67f9] Traceback (most recent call last): 2018-06-21 15:30:27.458 28787 ERROR sahara.service.ops [instance: none, cluster: b4c9bc70-b6ae-451a-92f7-54a6da6b67f9] File "/root/sahara-venv/local/lib/python2.7/site-packages/sahara/service/ops.py", line 164, in wrapper 2018-06-21 15:30:27.458 28787 ERROR sahara.service.ops [instance: none, cluster: b4c9bc70-b6ae-451a-92f7-54a6da6b67f9] f(cluster_id, args, *kwds) 2018-06-21 15:30:27.458 28787 ERROR sahara.service.ops [instance: none, cluster: b4c9bc70-b6ae-451a-92f7-54a6da6b67f9] File "/root/sahara-venv/local/lib/python2.7/site-packages/sahara/service/ops.py", line 247, in _provision_cluster 2018-06-21 15:30:27.458 28787 ERROR sahara.service.ops [instance: none, cluster: b4c9bc70-b6ae-451a-92f7-54a6da6b67f9] ctx, cluster, plugin = _prepare_provisioning(cluster_id) 2018-06-21 15:30:27.458 28787 ERROR sahara.service.ops [instance: none, cluster: b4c9bc70-b6ae-451a-92f7-54a6da6b67f9] File "/root/sahara-venv/local/lib/python2.7/site-packages/sahara/service/ops.py", line 227, in _prepare_provisioning 2018-06-21 15:30:27.458 28787 ERROR sahara.service.ops [instance: none, cluster: b4c9bc70-b6ae-451a-92f7-54a6da6b67f9] expires=not cluster.is_transient) 2018-06-21 15:30:27.458 28787 ERROR sahara.service.ops [instance: none, cluster: b4c9bc70-b6ae-451a-92f7-54a6da6b67f9] File "/root/sahara-venv/local/lib/python2.7/site-packages/sahara/service/trusts.py", line 104, in create_trust_for_cluster 2018-06-21 15:30:27.458 28787 ERROR sahara.service.ops [instance: none, cluster: b4c9bc70-b6ae-451a-92f7-54a6da6b67f9] expires=expires) 2018-06-21 15:30:27.458 28787 ERROR sahara.service.ops [instance: none, cluster: b4c9bc70-b6ae-451a-92f7-54a6da6b67f9] File "/root/sahara-venv/local/lib/python2.7/site-packages/sahara/service/trusts.py", line 84, in create_trust 2018-06-21 15:30:27.458 28787 ERROR sahara.service.ops [instance: none, cluster: b4c9bc70-b6ae-451a-92f7-54a6da6b67f9] raise ex.CreationFailed(_('Failed to create trust')) 2018-06-21 15:30:27.458 28787 ERROR sahara.service.ops [instance: none, cluster: b4c9bc70-b6ae-451a-92f7-54a6da6b67f9] CreationFailed: Failed to create trust 2018-06-21 15:30:27.458 28787 ERROR sahara.service.ops [instance: none, cluster: b4c9bc70-b6ae-451a-92f7-54a6da6b67f9] Error ID: 87a0562d-aea5-4f04-a977-5afa1edfcbbd 2018-06-21 15:30:27.458 28787 ERROR sahara.service.ops [instance: none, cluster: b4c9bc70-b6ae-451a-92f7-54a6da6b67f9] 2018-06-21 15:30:27.989 28787 INFO sahara.utils.cluster [req-0bd98b81-b083-440a-a846-aed173eb556c 71b95d25439743169779a32ea4e17ee2 8ca3e3ea84a34bf99301676cec07e502 - - -] [instance: none, cluster: b4c9bc70-b6ae-451a-92f7-54a6da6b67f9] Cluster status has been changed. New status=Error 2018-06-21 15:31:25.252 28787 WARNING sahara.context [-] Arguments dropped when creating context: {u'project_name': u'service', u'user_name': u'sahara'} 2018-06-21 15:31:25.616 28787 WARNING sahara.service.heat.heat_engine [req-9046c19d-fd2d-4fcf-bdd2-89a89542d15c 71b95d25439743169779a32ea4e17ee2 8ca3e3ea84a34bf99301676cec07e502 - - -] [instance: none, cluster: 934e1edb-94d9-4b62-be0d-cfed1dddd7d7] Did not find stack for cluster. Trying to delete cluster manually. 2018-06-21 15:31:25.759 28787 WARNING sahara.context [-] Arguments dropped when creating context: {u'project_name': u'service', u'user_name': u'sahara'} 2018-06-21 15:31:26.126 28787 WARNING sahara.service.heat.heat_engine [req-6cabd69e-6901-4ea4-bdf5-4e2fa6c945c9 71b95d25439743169779a32ea4e17ee2 8ca3e3ea84a34bf99301676cec07e502 - - -] [instance: none, cluster: b4c9bc70-b6ae-451a-92f7-54a6da6b67f9] Did not find stack for cluster. Trying to delete cluster manually.