Ask Your Question
1

Nova instance creation 500 error

asked 2014-11-20 16:17:39 -0500

AmitA gravatar image

updated 2014-11-22 05:51:49 -0500

9lives gravatar image

HI all-

So Ive gotten up to the point where I am to launch an instance (3 node setup - controller, network, compute) and I am getting this error below. Ive been searching (mailing list, ask openstack, google) for the past two days for any explanations or ways to fix and Im at wits end - especially since this is the most generic error ever. Would anyone have ideas where to look for this? Thank you very much!

# nova --debug boot --flavor m1.tiny --image cirros-0.3.3-x86_64 --nic net-id=4b27737a-a063-4b6e-b21a-8cffab8e3dc5 --security-group default --key-name demo-key demo1


REQ: curl -i 'http://controller:8774/v2/0e272c64703d408fab77665fabc6e7e6/servers' -X POST -H "Accept: 
application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Project-Id: demo" 
-H "X-Auth-Token: {SHA1}0a6884f08c3d40df8fe484658d7a6bfb9702d2c0" -d '{"server": {"name": "demo1", "imageRef": 
"c7590319-8719-4612-b959-8bffd405da3a", "key_name": "demo-key", "flavorRef": "1", "max_count": 1, "min_count": 1, 
"networks": [{"uuid": "4b27737a-a063-4b6e-b21a-8cffab8e3dc5"}], "security_groups": [{"name": "default"}]}}'
INFO (connectionpool:187) Starting new HTTP connection (1): controller

DEBUG (connectionpool:357) "POST /v2/0e272c64703d408fab77665fabc6e7e6/servers HTTP/1.1" 500 128

RESP: [500] {'date': 'Wed, 19 Nov 2014 22:29:41 GMT', 'content-length': '128', 'content-type': 'application/json; charset=UTF-8', 'x-compute-request-id': 'req-07dfa570-0364-4ffd-ade7-ed84ed86abc7'}

RESP BODY: {"computeFault": {"message": "The server has either erred or is incapable of performing the requested operation.", "code": 500}}

DEBUG (shell:803) The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-07dfa570-0364-4ffd-ade7-ed84ed86abc7)

Traceback (most recent call last):

  File "/usr/lib/python2.7/site-packages/novaclient/shell.py", line 800, in main
    OpenStackComputeShell().main(argv)
  File "/usr/lib/python2.7/site-packages/novaclient/shell.py", line 730, in main
    args.func(self.cs, args)
  File "/usr/lib/python2.7/site-packages/novaclient/v1_1/shell.py", line 470, in do_boot
    server = cs.servers.create(*boot_args, **boot_kwargs)
  File "/usr/lib/python2.7/site-packages/novaclient/v1_1/servers.py", line 902, in create
    **boot_kwargs)
  File "/usr/lib/python2.7/site-packages/novaclient/v1_1/servers.py", line 554, in _boot
    return_raw=return_raw, **kwargs)
  File "/usr/lib/python2.7/site-packages/novaclient/base.py", line 100, in _create
    _resp, body = self.api.client.post(url, body=body)
  File "/usr/lib/python2.7/site-packages/novaclient/client.py", line 490, in post
    return self._cs_request(url, 'POST', **kwargs)
  File "/usr/lib/python2.7/site-packages/novaclient/client.py", line 465, in _cs_request
    resp, body = self._time_request(url, method, **kwargs)
  File "/usr/lib/python2.7/site-packages/novaclient/client.py", line 439, in _time_request
    resp, body = self.request(url, method, **kwargs)
  File "/usr/lib/python2.7/site-packages/novaclient/client.py", line 433, in request
    raise exceptions.from_response(resp, body, url, method)


ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-07dfa570-0364-4ffd-ade7-ed84ed86abc7)
ERROR (ClientException): The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-07dfa570-0364-4ffd-ade7-ed84ed86abc7)

This is the error that shows up in nova-api.log:

2014-11-20 17:58:55.935 9225 TRACE nova.api.openstack MessagingTimeout: Timed out waiting for a reply to message ID 47e5a92644d94d1d898fd0a4c80604ac

**UPDATE: So I notice this in the nova-compute log on compute node:

2014-11-19 12:15:08.879 ...
(more)
edit retag flag offensive close merge delete

Comments

Make sure you configure ntp on all nodes and let compute & network nodes point to controller node in /etc/ntp.conf

Is nova service-list showing all the nova services with status enabled?

teju gravatar imageteju ( 2014-11-20 22:59:04 -0500 )edit

6 answers

Sort by ยป oldest newest most voted
0

answered 2014-11-21 00:13:50 -0500

Ram.Meena gravatar image

Hi,

In above comment 'Teju' is right, you should make sure that there is no time lag between your openstack nodes, all the nodes should be synced with a central server time using the 'ntp' server.

You should setup the 'debug' mode true in nova configuration file then check the 'nova api' and 'nova compute' logs carefully to find out any possible error. Also make sure that 'RabbitMq' server is able to communicate between your 'controller' and 'compute' node successfully.

Also duly verify that you have setup the nova compute correctly following the openstack installation documents.

edit flag offensive delete link more

Comments

HI thanks. NTP is running and looks fine on all three nodes. Nova is already in debug and verbose modes. I will again go over the installation document (3rd time :-) ) and see if I can see if notice anything wrong

AmitA gravatar imageAmitA ( 2014-11-21 12:06:02 -0500 )edit
0

answered 2015-01-08 05:37:40 -0500

sherkyoung gravatar image

Having the same question.I also have checked all *.conf profiles.And all commands like "nova service-list" but "nova boot --flavor..... "have their output.I really don't know how to deal it .Did you have solved it ?Thx:-)

edit flag offensive delete link more
0

answered 2015-02-26 21:02:27 -0500

ravjanga gravatar image

Hello Amit,

Were you able to solve this issue? If yes, can you please the steps you followed. I am encountering the same, but couldnt figure the issue. Tried looking everywhere with debugs turned on. Please let me know if you found the solution.

Thanks.

edit flag offensive delete link more
0

answered 2014-11-22 00:42:17 -0500

yatin gravatar image

Hi,

You have three node setup, make sure you are not using default 'guest' user to access AMQP Server that is RabbitMQ in your case. This is because 'guest' user is not allowed to communicate to the rabbitmq-server remotely. You should create a new rabbitmq user using: sudo rabbitmqctl add_user <rabbit_user_name> <rabbit_user_password> first check vhost: sudo rabbitmqctl list_vhosts then set permission for the user: replace '/' with the vhost you have from above command sudo rabbitmqctl set_permissions -p / <username> "" "." ".*" //this is not required if you want to set only default permissions

If you want 'guest' user to allow remote access then you have to make changes in your rabbitmq.config use rabbitmq documentation to do the same: https://www.rabbitmq.com/configure.html

Then in your nova network node and compute node change the nova.conf accordingly: that is rabbit_userid = <rabbit_user_name> rabbit_password = <rabbit_user_password> rabbit_host = <rabbit_host> restart nova-compute and nova-network

edit flag offensive delete link more
0

answered 2014-11-21 00:51:37 -0500

Are you able to see compute service in "nova-manage service list"

First try and and also check nova-compute.log on compute node.

edit flag offensive delete link more

Comments

Hi yes it shows up running fine...

AmitA gravatar imageAmitA ( 2014-11-21 12:13:28 -0500 )edit
0

answered 2014-12-06 13:45:59 -0500

Ilya gravatar image

Having the same issue on controller node but no errors on other nodes.

edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

2 followers

Stats

Asked: 2014-11-20 16:17:39 -0500

Seen: 6,101 times

Last updated: Jan 08 '15