Ask Your Question
1

What causes "The server has either erred or is incapable of performing the requested operation." when using nova delete to remove servers? [closed]

asked 2013-11-16 15:39:45 -0500

AlanObject gravatar image

updated 2013-11-18 15:38:40 -0500

I am having trouble bringing up servers, so I end up with a list that looks like this:

root@xxx:~# nova list
+--------------------------------------+----------+--------+------------+-------------+----------+
| ID                                   | Name     | Status | Task State | Power State | Networks |
+--------------------------------------+----------+--------+------------+-------------+----------+
| edfde014-e489-413d-93e9-ab861a2dfbdd | precise1 | ERROR  | None       | NOSTATE     |          |
| 9dad0e43-cb2c-4863-8765-ee4af5d6704d | precise2 | ERROR  | None       | NOSTATE     |          |
+--------------------------------------+----------+--------+------------+-------------+----------+

Attempting to delete the servers doesn't work, it looks like this:

root@xxx:~# nova delete precise1
The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-86e8e658-a18e-47ee-9447-b953d9497882)
ERROR: Unable to delete any of the specified servers.
root@xxx:~# nova list
+--------------------------------------+----------+--------+------------+-------------+----------+
| ID                                   | Name     | Status | Task State | Power State | Networks |
+--------------------------------------+----------+--------+------------+-------------+----------+
| edfde014-e489-413d-93e9-ab861a2dfbdd | precise1 | ERROR  | deleting   | NOSTATE     |          |
| 9dad0e43-cb2c-4863-8765-ee4af5d6704d | precise2 | ERROR  | None       | NOSTATE     |          |
+--------------------------------------+----------+--------+------------+-------------+----------+
root@xxx:~#

Then the server stays there forever. I fixed a problem with glance although my new servers still don't work, at least I can delete them. So how do I purge the data base of these two?

UPDATE:

When the nova delete command attempts to execute the nova-compute.log does not get any new entries. However the nova-api.log gets an extensive traceback starting with:

2013-11-18 12:53:53.789 19195 WARNING nova.compute.api [req-c75bf3b4-33b0-4523-8a18-6f00c36ffbb9 de2b62ce53764cd1979f0b39b87acc16 3405c884d51f4332a046c57ddfffc828] [instance: edfde014-e489-413d-93e9-ab861a2dfbdd] instance's host xxx is down, deleting from database
2013-11-18 12:54:53.862 19195 ERROR nova.api.openstack [req-c75bf3b4-33b0-4523-8a18-6f00c36ffbb9 de2b62ce53764cd1979f0b39b87acc16 3405c884d51f4332a046c57ddfffc828] Caught error: Timeout while waiting on RPC response - topic: "network.xxx", RPC method: "deallocate_for_instance" info: "<unknown>"
2013-11-18 12:54:53.862 19195 TRACE nova.api.openstack Traceback (most recent call last):

((omitted lots of calls))

2013-11-18 12:54:53.862 19195 TRACE nova.api.openstack     exc.info, real_topic, msg.get('method'))
2013-11-18 12:54:53.862 19195 TRACE nova.api.openstack Timeout: Timeout while waiting on RPC response - topic: "network.xxx", RPC method: "deallocate_for_instance" info: "<unknown>"
2013-11-18 12:54:53.862 19195 TRACE nova.api.openstack 
2013-11-18 12:54:53.865 19195 INFO nova.api.openstack [req-c75bf3b4-33b0-4523-8a18-6f00c36ffbb9 de2b62ce53764cd1979f0b39b87acc16 3405c884d51f4332a046c57ddfffc828] http://xxx:8774/v2/3405c884d51f4332a046c57ddfffc828/servers/edfde014-e489-413d-93e9-ab861a2dfbdd returned with HTTP 500
2013-11-18 12:54:53.865 19195 INFO nova.osapi_compute.wsgi.server [req-c75bf3b4-33b0-4523-8a18-6f00c36ffbb9 de2b62ce53764cd1979f0b39b87acc16 3405c884d51f4332a046c57ddfffc828] 65.49.79.26 "DELETE /v2/3405c884d51f4332a046c57ddfffc828/servers/edfde014-e489-413d-93e9-ab861a2dfbdd HTTP/1.1" status: 500 len: 335 time: 60.2047951

So at the end of the day it seems like my compute node isn't responding -- is that right? I found a utility I think is deprecated that shows this:

nova-manage service list
Binary           Host                                 Zone             Status     State Updated_At
nova-consoleauth hv-v-xxx                            internal         enabled    :-)   2013-11-18 21:01:07
nova-cert        hv-v-xxx                            internal         enabled    :-)   2013-11-18 21:01:07
nova-scheduler   hv-v-xxx                            internal         enabled    :-)   2013-11-18 21:01:07
nova-conductor   hv-v-xxx                            internal         enabled    :-)   2013-11-18 21:01:08
nova-compute     hv-v-xxx                            nova             enabled    XXX   2013-11-11 21:49:07
nova-network     hv-v-xxx                            internal         enabled    XXX   2013-11-11 21:49:08

Would that XXX state have anything to do with it?

edit retag flag offensive reopen merge delete

Closed for the following reason the question is answered, right answer was accepted by koolhead17
close date 2014-08-10 17:22:24.760938

Comments

Do you see anything in the logs (`/var/log/nova/compute.log`, probably) when you try to delete the instances?

larsks gravatar imagelarsks ( 2013-11-16 18:30:17 -0500 )edit

I assume you mean nova-compute.log -- I'll run a trial and edit the question with the results.

AlanObject gravatar imageAlanObject ( 2013-11-18 14:54:25 -0500 )edit

3 answers

Sort by ยป oldest newest most voted
1

answered 2013-11-20 19:47:06 -0500

AlanObject gravatar image

updated 2013-11-20 19:48:21 -0500

I finally found a solution:

# nova reset-state --active 9dad0e43-cb2c-4863-8765-ee4af5d6704d
# nova delete 9dad0e43-cb2c-4863-8765-ee4af5d6704d

it works! -- nova list now shows nothing in the table. Note the --active command line parameter. The nova delete doesn't seem to work unless the server is in "active" state.

edit flag offensive delete link more
1

answered 2013-11-19 00:45:59 -0500

dheeru gravatar image

Due to some exception condition your nova is not able to fulfil your request. Surely there must be a exception in /var/log/nova/nova-api.log and nova-compute.log. Just look at the log file and it may give hint why the server is failing to handle your request.

edit flag offensive delete link more
0

answered 2013-11-19 03:29:35 -0500

Anand TS gravatar image

Try to run the debug command #/usr/bin/nova-compute --config-file /etc/nova/nova.conf #/usr/bin/nova-network --config-file /etc/nova/nova.conf

hope this help in your situation.

Regards, Anand

edit flag offensive delete link more

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

Stats

Asked: 2013-11-16 15:39:45 -0500

Seen: 6,685 times

Last updated: Nov 20 '13