Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

service is currently unavailable

Hi support team,

I am facing an issue while trying to connect to compute unit.

ERROR (ClientException): The server is currently unavailable. Please try again at a later time.

The Keystone service is temporarily unavailable.

(HTTP 503) (Request-ID: req-9034590d-f5a9-4f6d-bcc1-de7705ab3487)

Below are the logs from placement: AH01630: client denied by server configuration: /usr/bin/placement-api AH01630: client denied by server configuration: /usr/bin/placement-api AH01630: client denied by server configuration: /usr/bin/placement-api AH01630: client denied by server configuration: /usr/bin/placement-api AH01630: client denied by server configuration: /usr/bin/placement-api AH01630: client denied by server configuration: /usr/bin/placement-api AH01630: client denied by server configuration: /usr/bin/placement-api AH01630: client denied by server configuration: /usr/bin/placement-api

from nova-api.log 2020-04-05 21:18:24.145 12418 CRITICAL keystonemiddleware.auth_token [-] Unable to validate token: Unable to establish connection to http://127.0.0.1:35357: HTTPConnectionPool(host='127.0.0.1', port=35357): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.httpconnection object="" at="" 0x7efd0e86ced0="">: Failed to establish a new connection: [Errno 111] ECONNREFUSED',)): ConnectFailure: Unable to establish connection to http://127.0.0.1:35357: HTTPConnectionPool(host='127.0.0.1', port=35357): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.httpconnection object="" at="" 0x7efd0e86ced0="">: Failed to establish a new connection: [Errno 111] ECONNREFUSED',)) 2020-04-05 21:18:24.147 12418 INFO nova.osapi_compute.wsgi.server [-] 10.0.0.11 "GET /v2.1 HTTP/1.1" status: 503 len: 498 time: 0.0113709 2020-04-05 21:22:11.455 12418 CRITICAL keystonemiddleware.auth_token [-] Unable to validate token: Unable to establish connection to http://127.0.0.1:35357: HTTPConnectionPool(host='127.0.0.1', port=35357): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.httpconnection object="" at="" 0x7efd0e86cdd0="">: Failed to establish a new connection: [Errno 111] ECONNREFUSED',)): ConnectFailure: Unable to establish connection to http://127.0.0.1:35357: HTTPConnectionPool(host='127.0.0.1', port=35357): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.httpconnection object="" at="" 0x7efd0e86cdd0="">: Failed to establish a new connection: [Errno 111] ECONNREFUSED',)) 2020-04-05 21:22:11.457 12418 INFO nova.osapi_compute.wsgi.server [-] 10.0.0.11 "GET /v2.1 HTTP/1.1" status: 503 len: 498 time: 0.0055711 [root@controller nova]#

nova-compute.log

<html><head> <title>403 Forbidden</title> </head><body>

Forbidden

You don't have permission to access /resource_providers/d5e4da42-f91b-4bdb-9a9e-313068d318fd/allocations on this server.

</body></html> : ResourceProviderAllocationRetrievalFailed: Failed to retrieve allocations for resource provider d5e4da42-f91b-4bdb-9a9e-313068d318fd: 2020-04-05 23:10:36.071 9955 WARNING keystoneauth.discover [req-c51c9b73-2303-4b0b-9478-cce3f8b8accf - - - - -] Failed to contact the endpoint at http://controller:8778 for discovery. Fallback to using that endpoint as the base url.: Forbidden: Forbidden (HTTP 403) 2020-04-05 23:10:36.075 9955 ERROR nova.scheduler.client.report [req-c51c9b73-2303-4b0b-9478-cce3f8b8accf - - - - -] [None] Failed to retrieve resource provider tree from placement API for UUID d5e4da42-f91b-4bdb-9a9e-313068d318fd. Got 403: <html><head> <title>403 Forbidden</title> </head><body>

Forbidden

You don't have permission to access /resource_providers on this server.

</body></html> . 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager [req-c51c9b73-2303-4b0b-9478-cce3f8b8accf - - - - -] Error updating resources for node compute.: ResourceProviderRetrievalFailed: Failed to get resource provider with UUID d5e4da42-f91b-4bdb-9a9e-313068d318fd 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager Traceback (most recent call last): 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 8673, in _update_available_resource_for_node 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager startup=startup) 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 887, in update_available_resource 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager self._update_available_resource(context, resources, startup=startup) 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 328, in inner 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager return f(args, *kwargs) 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 972, in _update_available_resource 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager self._update(context, cn, startup=startup) 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 1237, in _update 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager self._update_to_placement(context, compute_node, startup) 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/retrying.py", line 68, in wrapped_f 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager return Retrying(dargs, *dkw).call(f, args, *kw) 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/retrying.py", line 223, in call 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager return attempt.get(self._wrap_exception) 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/retrying.py", line 261, in get 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager six.reraise(self.value[0], self.value[1], self.value[2]) 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/retrying.py", line 217, in call 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager attempt = Attempt(fn(args, *kwargs), attempt_number, False) 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 1151, in _update_to_placement 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager context, compute_node.uuid, name=compute_node.hypervisor_hostname) 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/scheduler/client/report.py", line 858, in get_provider_tree_and_ensure_root 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager parent_provider_uuid=parent_provider_uuid) 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/scheduler/client/report.py", line 640, in _ensure_resource_provider 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager rps_to_refresh = self.get_providers_in_tree(context, uuid) 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/scheduler/client/report.py", line 503, in get_providers_in_tree 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager raise exception.ResourceProviderRetrievalFailed(uuid=uuid) 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager ResourceProviderRetrievalFailed: Failed to get resource provider with UUID d5e4da42-f91b-4bdb-9a9e-313068d318fd 2020-04-05 23:10:36.076 9955 ERROR nova.compute.manager [root@compute nova]#