instance cannot be deleted from the hypervisor
I installed OpenStack Kilo on Ubuntu 14.04. However the compute nodes are in down state and restarting nova-compute does not help.
I then looked into nova compute log, and found the following messages appearing every time before the compute node went down:
2016-09-11 20:04:45.626 6275 INFO nova.compute.manager [req-BLABLA] [instance: INSTANCE_ID] Terminating instance
2016-09-11 20:04:45.630 6275 INFO nova.virt.libvirt.driver [-] [instance: INSTANCE_ID] Instance destroyed successfully.
The same message repeated for the SAME INSTANCE_ID every time when I restarted nova-compute (just 30 minutes later after restarting nova-compute, the node went down and there was no other message showing up), which means that instance didn't get destroyed as reported. However virsh list
returns nothing. And there is no instances in /var/lib/nova/instances/
. It seems that the instances have been deleted from both nova database and the hypervisor, but why does nova keeps terminating an instance that doesn't exist? Where does nova get the instance id?
BTW, I already set running_deleted_instance_action=reap
in nova.conf
, but it seems not work.
This problem seems to be related to an unresolved bug report in https://bugs.launchpad.net/nova/+bug/1520396