Ask Your Question
1

Cannot reboot instance (after host powered off unexpectedly)

asked 2013-07-16 08:46:25 -0500

sangwei gravatar image

updated 2013-07-16 23:44:56 -0500

Jobin gravatar image

My compute.log looks like this after this happened:

2013-07-16 21:33:42.217 3036 WARNING nova.compute.manager [-] Found 6 in the database and 5 on the hypervisor.
2013-07-16 21:35:51.493 WARNING nova.compute.manager [req-2488e082-5e86-45db-8400-e1ef338a3332 17a60e7264a748f3afedf8409ffb5953 1ba7d34f416d4fb98271bd77dd06fa6f] [instance: 7a1ff50d-3016-4038-8be9-884ffd9c6d91] trying to reboot a non-running instance: (state: 4 expected: 1)
2013-07-16 21:35:52.064 ERROR nova.compute.manager [req-2488e082-5e86-45db-8400-e1ef338a3332 17a60e7264a748f3afedf8409ffb5953 1ba7d34f416d4fb98271bd77dd06fa6f] [instance: 7a1ff50d-3016-4038-8be9-884ffd9c6d91] Cannot reboot instance: 'NoneType' object has no attribute 'rfind'

2013-07-16 21:43:44.122 3036 WARNING nova.compute.manager [-] Found 6 in the database and 5 on the hypervisor.

2013-07-16 21:43:44.491 3036 WARNING nova.compute.manager [-] [instance: 7a1ff50d-3016-4038-8be9-884ffd9c6d91] Instance shutdown by itself. Calling the stop API.

Need help to recover from this...

edit retag flag offensive close merge delete

Comments

You seem to have more than 1 VM on the host, are all VM's down or is a single VM not able to reboot?

Jobin gravatar imageJobin ( 2013-07-16 09:03:33 -0500 )edit

Jobin, other 5 VMs are able to boot, only 1 had this problem.

sangwei gravatar imagesangwei ( 2013-07-16 20:11:34 -0500 )edit

2 answers

Sort by ยป oldest newest most voted
2

answered 2013-07-16 09:02:09 -0500

Jobin gravatar image

updated 2013-07-16 09:09:41 -0500

The database seems to be unaware that the VM is no more running and hence needs to be synchronised.

First synchronize the database using nova-manage db sync and then reboot the instance. Refer this if you need help for rebooting an instance using nova or you could even use the GUI client: horizon, if you have it installed on your system.

edit flag offensive delete link more

Comments

Thanks! I used "nove start 7a1ff50d-3016-4038-8be9-884ffd9c6d91" on the host command line, and it looked like everything is OK now.

sangwei gravatar imagesangwei ( 2013-07-16 20:14:14 -0500 )edit

@sangwei: If this answer is what helped you, please feel free to upvote/accept it. :)

Jobin gravatar imageJobin ( 2013-07-16 23:33:06 -0500 )edit

not work.... anyone there help me for this problem

rajcoumar gravatar imagerajcoumar ( 2014-05-06 10:09:42 -0500 )edit
0

answered 2014-08-14 14:39:30 -0500

jeffsilverman gravatar image

Not work either. The link to http://docs.openstack.org/cli/quick-start/content/nova_client.html (http://docs.openstack.org/cli/quick-s...) is broken (404). Here is the process I went through:

root@controller1-prod.controller1-prod:/var/log/nova# nova list
+--------------------------------------+------------------+--------+------------+-------------+----------+
| ID                                   | Name             | Status | Task State | Power State | Networks |
+--------------------------------------+------------------+--------+------------+-------------+----------+
| 36901c8c-9ebd-457e-94b6-87b6a576a5e2 | jeffs_instance_1 | ERROR  | deleting   | NOSTATE     |          |
| cac14b65-1f06-4ccd-a6ea-8f6157558d7e | jeffs_instance_2 | ERROR  | deleting   | NOSTATE     |          |
| fc977cf5-3ca4-439f-8257-4d684a4935d0 | jeffs_instance_2 | ERROR  | deleting   | NOSTATE     |          |
| c42beb26-2adc-4b83-b2ff-1b8484d7251c | jeffs_instance_4 | ERROR  | deleting   | NOSTATE     |          |
| e099bd10-048d-4220-84da-327e429df060 | jeffs_instance_5 | ACTIVE | -          | Running     |          |
+--------------------------------------+------------------+--------+------------+-------------+----------+




    root@controller1-prod.controller1-prod:/var/log/nova# root@controller1-prod.controller1-prod:/var/log/nova# date
    Thu Aug 14 12:34:06 PDT 2014
    root@controller1-prod.controller1-prod:/var/log/nova# fgrep  "Found 4 in the database" *
    ...
    compute.log:2014-08-14 12:32:54.370 4538 WARNING nova.compute.manager [-] Found 4 in the database and 0 on the hypervisor.
    root@controller1-prod.controller1-prod:/var/log/nova# 
root@controller1-prod.controller1-prod:/var/log/nova# nova get-vnc-console jeffs_instance_5 novnc
+-------+---------------------------------------------------------------------------------------------------------+
| Type  | Url                                                                                                     |
+-------+---------------------------------------------------------------------------------------------------------+
| novnc | http://controller1-prod.sea.opencandy.com:6000/vnc_auto.html?token=5f3169a3-3ab4-44c9-aede-99fc14dcac05 |
+-------+---------------------------------------------------------------------------------------------------------+
root@controller1-prod.controller1-prod:/var/log/nova#

However, that link doesn't work. netstat -pant shows nothing is listening on port 6000. I assume that the warning about the 4 in the database and 0 on the hypervisor is related to my novnc console problem.

Jeff

edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

Stats

Asked: 2013-07-16 08:46:25 -0500

Seen: 3,898 times

Last updated: Aug 14 '14