Ask Your Question
1

While deleting Volumes, "error_deleting" occures

asked 2015-08-11 09:14:16 -0500

dm07c3 gravatar image

Hi there,

Sometimes I got the problem that I cannot delete Volumes correctly. The deletion ends in a "error_deleting" state. Either reset-state or force-delete via cinder works for me. The log says

2015-08-06 11:40:25.923 11029 ERROR oslo_messaging.rpc.dispatcher [req-285f0bdf-d14c-49b0-a786-54b6ea30ba7e 8fdcc99b5e0644eb8b6167afecc23d09 d11dc9b9b5d444f3b2608be3bae30197 - - -] Exception during message handling: Unexpected error while running command.
Command: None
Exit code: -
Stdout: u"Unexpected error while running command.\nCommand: sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1} devices { ignore_suspended_devices = 1} -f kvm00-vg/volume-ff930b12-3fa6-49c1-85cb-f67e936b35fc\nExit code: 5\nStdout: u''\nStderr: u'  Logical volume kvm00-vg/volume-ff930b12-3fa6-49c1-85cb-f67e936b35fc is used by another device.\\n'"
Stderr: None
2015-08-06 11:40:25.923 11029 TRACE oslo_messaging.rpc.dispatcher Traceback (most recent call last):
2015-08-06 11:40:25.923 11029 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply
2015-08-06 11:40:25.923 11029 TRACE oslo_messaging.rpc.dispatcher     executor_callback))
2015-08-06 11:40:25.923 11029 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch
2015-08-06 11:40:25.923 11029 TRACE oslo_messaging.rpc.dispatcher     executor_callback)
2015-08-06 11:40:25.923 11029 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 130, in _do_dispatch
2015-08-06 11:40:25.923 11029 TRACE oslo_messaging.rpc.dispatcher     result = func(ctxt, **new_args)
2015-08-06 11:40:25.923 11029 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/osprofiler/profiler.py", line 105, in wrapper
2015-08-06 11:40:25.923 11029 TRACE oslo_messaging.rpc.dispatcher     return f(*args, **kwargs)
2015-08-06 11:40:25.923 11029 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 138, in lvo_inner1
2015-08-06 11:40:25.923 11029 TRACE oslo_messaging.rpc.dispatcher     return lvo_inner2(inst, context, volume_id, **kwargs)
2015-08-06 11:40:25.923 11029 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py", line 445, in inner
2015-08-06 11:40:25.923 11029 TRACE oslo_messaging.rpc.dispatcher     return f(*args, **kwargs)
2015-08-06 11:40:25.923 11029 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 137, in lvo_inner2
2015-08-06 11:40:25.923 11029 TRACE oslo_messaging.rpc.dispatcher     return f(*_args, **_kwargs)
2015-08-06 11:40:25.923 11029 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 562, in delete_volume
2015-08-06 11:40:25.923 11029 TRACE oslo_messaging.rpc.dispatcher     'error_deleting')
2015-08-06 11:40:25.923 11029 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-08-06 11:40:25.923 11029 TRACE oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2015-08-06 11:40:25.923 11029 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 548, in delete_volume
2015-08-06 11:40:25.923 11029 TRACE oslo_messaging.rpc.dispatcher     self.driver.delete_volume(volume_ref)
2015-08-06 11:40:25.923 11029 TRACE oslo_messaging.rpc ...
(more)
edit retag flag offensive close merge delete

3 answers

Sort by ยป oldest newest most voted
0

answered 2015-08-12 23:05:29 -0500

sunnyarora gravatar image

As a workaround for error_deleting -> you can refer this solution for now.

edit flag offensive delete link more

Comments

The poster already mentioned they're using this workaround. I believe they're trying to understand why this happens to begin with.

thingee gravatar imagethingee ( 2015-08-20 17:21:10 -0500 )edit
0

answered 2017-09-21 09:03:59 -0500

cshen gravatar image

We had a similar problem that we're using LVM as images_types in hypervisor.

When deleting a VM, we got this kind of error in the log.

2017-09-21 12:32:11.135 6824 ERROR nova.compute.manager [instance: 30474d39-a8d1-48c1-94d9-c3b155731d32] Command: sudo nova-rootwrap /etc/nova/rootwrap.conf lvremove -f /dev/nova/30474d39-a8d1-48c1-94d9-c3b155731d32_disk.eph0 2017-09-21 12:32:11.135 6824 ERROR nova.compute.manager [instance: 30474d39-a8d1-48c1-94d9-c3b155731d32] Exit code: 5 2017-09-21 12:32:11.135 6824 ERROR nova.compute.manager [instance: 30474d39-a8d1-48c1-94d9-c3b155731d32] Stdout: u'' 2017-09-21 12:32:11.135 6824 ERROR nova.compute.manager [instance: 30474d39-a8d1-48c1-94d9-c3b155731d32] Stderr: u' Logical volume nova/30474d39-a8d1-48c1-94d9-c3b155731d32_disk.eph0 is used by another device.\n') 2017-09-21 12:32:11.135 6824 ERROR nova.compute.manager [instance: 30474d39-a8d1-48c1-94d9-c3b155731d32]

The logical volume seems to be used by another device.

fuser doesn't show any process.

In the end, we found out that inside of VM, the user has created a VG on the disk.

The dmsetup tree --ls showed the volume group.

vg01-docker (252:42) -nova-991d63cf--6730--4ab3--a424--8920400a51cb_disk.eph0 (252:35) - (8:16)

Had to run 'dmsetup remove vg01-docker'.

After that, the VM can be deleted without problem.

edit flag offensive delete link more
0

answered 2017-10-03 06:00:24 -0500

Deepa gravatar image

You can go to admin-->volumes-->> update error_deleting volume to error state and try to delete the volume ...Most of the times you will be able to remove from admin.. else you need to manually update mysql database and remove it

edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

2 followers

Stats

Asked: 2015-08-11 09:14:16 -0500

Seen: 1,799 times

Last updated: Oct 03 '17