Heat stack stuck on DELETE_IN_PROGRESS

asked 2014-12-17 10:45:45 -0600

dt.turner gravatar image

updated 2014-12-17 10:47:24 -0600

Running Icehouse 2014.2.1 along with the version of Heat included in this release.

I'm testing a stack which spins up an ephermal instance, attaches secondary volume and assigns a floating IP.

This works fine. The problem is on delete. It would appear that I'm hitting a race condition that is mentioned on bugs.launchpad for this release: https://bugs.launchpad.net/heat/+bug/1298350 (https://bugs.launchpad.net/heat/+bug/...) . The stack resource list has shown a "DELETE_IN_PROGRESS" status for the volume attachment and floatingip resources for 3 days now.

Shouldn't there be a timeout for deletion attempts that eventually put the stack in a "delete failed" status?

How do I force this deletion attempt to fail so that I can clean out the stack and apply the recommended patches?


edit retag flag offensive close merge delete

3 answers

Sort by ยป oldest newest most voted

answered 2017-05-19 04:18:31 -0600

cshen gravatar image

In our case, we found out that two nova instances in the stack have been already deleted. but in the horizon they're showing 'Delete In Progress', which blocked the deletion of the stack.

Our fix is to mark those 2 resources as 'Delete Complete' in heat db.

Example like this:

so update status from 'IN_PROGRESS' TO 'COMPLETE'.

MariaDB [heat]> update resource set status='COMPLETE' where uuid='xxxxxxxxxxxxxxxxxxxx';

Query OK, 1 row affected (0.00 sec)

Rows matched: 1  Changed: 1  Warnings: 0
edit flag offensive delete link more

answered 2014-12-17 22:03:15 -0600

niraj8241 gravatar image

You can try marking the status of stack as DELETED in heat database. And run the task again

edit flag offensive delete link more

answered 2014-12-17 20:01:49 -0600

dt.turner gravatar image

I ended up deleting the vm instance spun up by my heat template, then submitted another stack-delete request. After a few seconds heat-stack no longer showed the stack. Not really an "answer", but it cleared the stack and associated resources.

edit flag offensive delete link more

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower


Asked: 2014-12-17 10:45:45 -0600

Seen: 8,369 times

Last updated: Dec 17 '14