Ask Your Question

nova list - ERROR: HTTPConnectionPool(host='openstackcloud1', port=35357): Max retries exceeded with url: /v2.0/tokens (Caused by <class 'socket.error'>: [Errno 111] Connection refused)

asked 2014-01-02 13:43:18 -0500

antonnoble gravatar image

updated 2014-01-03 09:51:52 -0500

Not sure how to troubleshoot this.... Nova was working...then it blew up.... Its been a couple weeks since I've looked at the problem, but I think this happend after I installed the nova-api-metadata package....I have since removed it, but nothing with nova is working.

root@openstackcloud1:~# nova list
ERROR: HTTPConnectionPool(host='openstackcloud1', port=35357): Max retries exceeded with url: /v2.0/tokens (Caused by <class 'socket.error'>: [Errno 111] Connection refused)

Any pointers would be extremely helpful... I'm using Ubuntu 12.04.03 and OpenStack Havana. My keystone, cinder, heat, and horizon services are working fine.

|                id                |   name   |      type      |        description        |
| 1d8c950f65a342c8b400529a531e03ed |  cinder  |    volumev2    |  Cinder Volume Service V2 |
| 4cf047e43a834388b1e6fc5e4292cd29 |  cinder  |     volume     |   Cinder Volume Service   |
| f7c043e5b305456384d6002a191e7aed |  glance  |     image      |    Glance Image Service   |
| f17ff36eded547a799e5a71c1d95ec9f |   heat   | orchestration  |   Heat Orchestration API  |
| c81aede2173e4e71b82618e04d351331 | heat-cfn | cloudformation |  Heat CloudFormation API  |
| 1e9dc6ce38404fb290a2e6d75c6b4b9d | keystone |    identity    | Keystone Identity Service |
| 3a44e89c99d54af18d8741e6e1e2c652 |   nova   |    compute     |    Nova Compute Service   |

root@openstackcloud1:~# keystone endpoint-list
|                id                |   region  |                  publicurl                   |                 internalurl                  |                   adminurl                   |            service_id            |
| 1f40acb0c58249dabdb07ad1674b1d53 | regionOne | http://openstackcloud1:8776/v2/%(tenant_id)s | http://openstackcloud1:8776/v2/%(tenant_id)s | http://openstackcloud1:8776/v2/%(tenant_id)s | 1d8c950f65a342c8b400529a531e03ed |
| 488535d7ab72474ca8310bb3684e024d | regionOne | http://openstackcloud1:8774/v2/%(tenant_id)s | http://openstackcloud1:8774/v2/%(tenant_id)s | http://openstackcloud1:8774/v2/%(tenant_id)s | 3a44e89c99d54af18d8741e6e1e2c652 |
| 5c96f322cc994c37b22ff7e8f10b0b07 | regionOne |       http://openstackcloud1:5000/v2.0       |       http://openstackcloud1:5000/v2.0       |      http://openstackcloud1:35357/v2.0       | 1e9dc6ce38404fb290a2e6d75c6b4b9d |
| 6c6f23b9c64a4c71abc875f3f4b4d494 | regionOne |         http://openstackcloud1:9292          |         http://openstackcloud1:9292          |         http://openstackcloud1:9292          | f7c043e5b305456384d6002a191e7aed |
| d99c5ab966cd4850baea5cfb3d4b15c4 | regionOne |        http://openstackcloud1:8000/v1        |        http://openstackcloud1:8000/v1        |        http://openstackcloud1:8000/v1        | c81aede2173e4e71b82618e04d351331 |
| dd252e79ea8b47c08f86943343b3f0b4 | regionOne | http://openstackcloud1:8004/v1/%(tenant_id)s | http://openstackcloud1:8004/v1/%(tenant_id)s | http://openstackcloud1:8004/v1/%(tenant_id)s | f17ff36eded547a799e5a71c1d95ec9f |
| f649dd9c49aa4bdd90838b5ee596a8f5 | regionOne | http://openstackcloud1:8776/v1/%(tenant_id)s | http://openstackcloud1:8776/v1/%(tenant_id)s | http://openstackcloud1:8776/v1/%(tenant_id)s | 4cf047e43a834388b1e6fc5e4292cd29 |

Debug for nova list

INFO (connectionpool:202) Starting new HTTP connection (1): openstackcloud1
DEBUG (shell:740) HTTPConnectionPool(host='openstackcloud1', port=8774): Max retries exceeded with url: /v2/728de3699e104a9b8a9f2ef8b15c84c7/servers/detail (Caused by <class 'socket.error'>: [Errno 111] Connection refused)
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/novaclient/", line 737, in main
    OpenStackComputeShell().main(map(strutils.safe_decode, sys.argv[1:]))
  File "/usr/lib/python2.7/dist-packages/novaclient/", line 673, in main
    args.func(self.cs, args)
  File "/usr/lib/python2.7/dist-packages/novaclient/v1_1/", line 1129, in do_list
    servers = cs.servers.list(search_opts=search_opts)
  File "/usr/lib/python2.7/dist-packages/novaclient/v1_1/", line 404, in list
    return self._list("/servers%s%s" % (detail, query_string), "servers")
  File "/usr/lib/python2.7/dist-packages/novaclient/", line 61, in _list
    _resp, body = self.api.client.get(url)
  File "/usr/lib/python2.7/dist-packages/novaclient/", line 229, in get
    return self._cs_request(url, 'GET', **kwargs)
  File "/usr/lib/python2.7/dist-packages/novaclient/", line 213, in _cs_request
  File "/usr/lib/python2.7/dist-packages/novaclient/", line 195, in _time_request
    resp, body = self.request(url, method, **kwargs)
  File "/usr/lib/python2.7/dist-packages/novaclient/", line 166, in request
  File ...
edit retag flag offensive close merge delete


Check the logs to see what causes the socket.error exception. You may want to search also on this site for the error messages as I suspect similar issues have been solved before.

smaffulli gravatar imagesmaffulli ( 2014-01-02 14:31:25 -0500 )edit

1. Check your keystone process is running 2. Did you make any configuration changes in nova.conf ? Please check. Revert back if any. If not do let me know. I can provide you working nova.conf with your changes. 3. Hope you host name is resolvable. 4. telnet openstackcloud1 35357 5. Try nova --debug list I suspect the 2nd point as issue in your case. Please check all these and revert.

dheeru gravatar imagedheeru ( 2014-01-03 09:23:49 -0500 )edit

1. Keystone is running 2. (This I will need to verify when I get to my desk) 3. Yes the hostname is resolvable on my network 4. I am able to telnet into 35357 5. Debug results now in my original question

antonnoble gravatar imageantonnoble ( 2014-01-03 09:44:12 -0500 )edit

I didn't copy the entire curl string from my --debug because it was quite long

antonnoble gravatar imageantonnoble ( 2014-01-03 09:45:30 -0500 )edit

Posted my nova.conf on my question.

antonnoble gravatar imageantonnoble ( 2014-01-03 09:52:38 -0500 )edit

what is the out put of 'nova list' and 'nova service-list' ? Can you do telnet openstackcloud1 8774 ? or check the command lsof -i:8774. What does it display ?

dheeru gravatar imagedheeru ( 2014-01-03 10:59:41 -0500 )edit

nova list output is in my original question. nova service-list has the same error showing max retries exceeded with url : /2/uuid connection refused. No I can not telnet to port 8774. Which I assume nova service is listening on that port?

antonnoble gravatar imageantonnoble ( 2014-01-03 12:26:53 -0500 )edit

lsof -i:8774 returns nothing at all

antonnoble gravatar imageantonnoble ( 2014-01-03 12:27:18 -0500 )edit

Make the question more readable by adding useful information there instead of adding comments. It looks like you cannot reach host openstackcloud1 on port 8774: start making sure that the networking is fine (no iptables rules for example)

smaffulli gravatar imagesmaffulli ( 2014-01-03 16:44:35 -0500 )edit

I presume this is multi node installation. Can you check compute services on all the compute boxes. Looks like they are down. You can try to do 'telnet <compute-host-name> 8774'. You need to run the lsof -i:8774 on compute boxes.

dheeru gravatar imagedheeru ( 2014-01-03 19:11:40 -0500 )edit

I'm using vSphere for my hypervisor. The compute node operation is currently sitting on the same server as my keystone service. There are multiple vSphere hosts that this compute node connects to via the vSphere cluster. I think multi node would be considered if I had multi vSphere clusters.

antonnoble gravatar imageantonnoble ( 2014-01-06 07:44:52 -0500 )edit

Earlier you said that you can't do telent openstackcloud1 8774. Also lsof -i:8774 did not return anything for you. This itself indicates the nova-api is not running. Can you check that on controller? Hope openstackcloud1 is resolvable. In general all this indicates that either servies are not reachable or services itself are not running. Please check

dheeru gravatar imagedheeru ( 2014-01-06 08:03:38 -0500 )edit

Rebooted server and everything appears to be working now...

antonnoble gravatar imageantonnoble ( 2014-01-06 13:03:02 -0500 )edit

when installing the nova-api-metadata you uninstall the nova-api for some reason and visa-versa

mrtigi gravatar imagemrtigi ( 2014-03-03 06:58:05 -0500 )edit

3 answers

Sort by ยป oldest newest most voted

answered 2014-01-06 12:59:03 -0500

antonnoble gravatar image

Apparently I somehow removed my nova-api service.... I reinstalled it and now nova list works. However, now horizon isn't working....

edit flag offensive delete link more


Thanks for sharing the solution. Evaluate if the trouble with Horizon is a different question.

smaffulli gravatar imagesmaffulli ( 2014-01-06 16:19:12 -0500 )edit

I just needed to restart the the controller which happened to have horizon compute and keystone on it

antonnoble gravatar imageantonnoble ( 2014-01-06 20:22:26 -0500 )edit

Had the same problem while following the installation guidelines for nova-network, nova-api suddenly stopped working (same error as above) when I set up the networking. I also had to re-install nova-api to get it to work again.

nwidell gravatar imagenwidell ( 2014-02-07 02:10:22 -0500 )edit

Which one is that controller?

Spike gravatar imageSpike ( 2014-08-03 20:53:18 -0500 )edit

answered 2014-07-23 08:53:23 -0500

Vanathu chinnappan gravatar image

updated 2014-07-23 09:34:47 -0500

ERROR: HTTPConnectionPool(host='controller', port=8774): Max retries exceeded with url: /v2/5b39f021275541c68d6c16f7dd85ac3f/images/detail (Caused by <class 'socket.erro<="" p="">

edit flag offensive delete link more

answered 2016-09-13 12:21:43 -0500

fifi gravatar image

reinstall openstack-dashboard : sudo apt-get install -y openstack-dashboard

edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower


Asked: 2014-01-02 13:43:18 -0500

Seen: 13,680 times

Last updated: Sep 13 '16