Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

asked 2013-12-30 12:28:49 -0500

mili gravatar image

Cinder LVM Issue

Hi,

When I create a volume the status of the newly created volume is Error. The volume gets created but not useable as error status. I can also successfully delete the volume.

Topology: Havana, ubuntu 12.0.4 I have a MD3600 Dell San, It is directly connected to a ubuntu server(block1) which has cinder installed. the drives from the SAN are mounted to the block1. The issue looks like a race condition to me, There is bug reported https://bugs.launchpad.net/cinder/+bug/1223469 I checked my lvm.sh and I have the break in the loop.

Please help me on what I should do to fix this.

If this is not the best approach to use my san as my storage or you think i can use a better solution to provide storage for vms please advise.

Cheers cinder.conf

RabbitMQ Configuration

rpc_backend = cinder.openstack.common.rpc.impl_kombu rabbit_host = controller rabbit_port = 5672 rabbit_userid = guest rabbit_password = ***

Glance Configuration

glance_host = controller

rootwrap_config = /etc/cinder/rootwrap.conf api_paste_confg = /etc/cinder/api-paste.ini iscsi_helper = tgtadm service_host = controller enabled_backends=lvmdriver-1,lvmdriver-2,lvmdriver-3 [lvmdriver-1] volume_group=cinder-volumes1 volume_driver=cinder.volume.drivers.lvm.LVMISCSIDriver volume_backend_name=LVM_iSCSI [lvmdriver-2] volume_group=cinder-volumes2 volume_driver=cinder.volume.drivers.lvm.LVMISCSIDriver volume_backend_name=LVM_iSCSI [lvmdriver-3] volume_group=cinder-volumes3 volume_driver=cinder.volume.drivers.lvm.LVMISCSIDriver volume_backend_name=LVM_iSCSI_b verbose = True auth_strategy = keystone state_path = /var/lib/cinder lock_path = /var/lock/cinder volumes_dir = /var/lib/cinder/volumes

[database]

The SQLAlchemy connection string used to connect to the

database (string value)

connection = mysql://cinder:***@controller/cinder

Cinder-Volume LOG: 2013-12-30 17:57:43.335 4760 WARNING cinder.quota [req-a15eb7b8-15d5-48ec-8b09-ae9236de90a4 d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Deprecated: Default quota for resource: volumes is set by the default quota flag: quota_volumes, it is now deprecated. Please use the the default quota class for default quota. 2013-12-30 17:58:46.312 4760 WARNING cinder.taskflow.utils [-] Activating 5 rollbacks due to <cinder.taskflow.utils.flowfailure object="" at="" 0x2d90c50="">. 2013-12-30 17:58:46.340 4760 ERROR cinder.volume.flows.create_volume [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Unexpected build error: 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume Traceback (most recent call last): 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/taskflow/patterns/linear_flow.py", line 172, in run_it 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume result = runner(context, args, *kwargs) 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/taskflow/utils.py", line 260, in __call__ 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume self.result = self.task(args, *kwargs) 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/volume/flows/create_volume/__init__.py", line 1520, in __call__ 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume model_update = self.driver.create_export(context, volume_ref) 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 585, in create_export 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume return self._create_export(context, volume) 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 616, in _create_export 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume volume_path, chap_auth) 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 437, in _create_tgtadm_target 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume old_name=old_name) 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/brick/iscsi/iscsi.py", line 155, in create_iscsi_target 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume fileutils.ensure_tree(self.volumes_dir) 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/fileutils.py", line 38, in ensure_tree 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume os.makedirs(path) 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/os.py", line 157, in makedirs 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume mkdir(name, mode) 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume OSError: [Errno 13] Permission denied: '/usr/lib/python2.7/dist-packages/volumes' 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume 2013-12-30 17:58:46.341 4760 ERROR cinder.openstack.common.rpc.amqp [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Exception during message handling 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp Traceback (most recent call last): 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/rpc/amqp.py", line 441, in _process_data 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp *args) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/rpc/dispatcher.py", line 148, in dispatch 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp return getattr(proxyobj, method)(ctxt, *kwargs) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 808, in wrapper 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp return func(self, args, *kwargs) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 257, in create_volume 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp flow.run(context.elevated()) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/decorators.py", line 105, in wrapper 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp return f(self, args, *kwargs) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/patterns/linear_flow.py", line 232, in run 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp run_it(r) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/patterns/linear_flow.py", line 212, in run_it 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp self.rollback(context, cause) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__ 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp self.gen.next() 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/patterns/linear_flow.py", line 172, in run_it 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp result = runner(context, args, *kwargs) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/utils.py", line 260, in __call__ 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp self.result = self.task(args, *kwargs) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/flows/create_volume/__init__.py", line 1520, in __call__ 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp model_update = self.driver.create_export(context, volume_ref) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 585, in create_export 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp return self._create_export(context, volume) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 616, in _create_export 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp volume_path, chap_auth) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 437, in _create_tgtadm_target 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp old_name=old_name) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/brick/iscsi/iscsi.py", line 155, in create_iscsi_target 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp fileutils.ensure_tree(self.volumes_dir) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/fileutils.py", line 38, in ensure_tree 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp os.makedirs(path) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/os.py", line 157, in makedirs 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp mkdir(name, mode) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp OSError: [Errno 13] Permission denied: '/usr/lib/python2.7/dist-packages/volumes' 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp 2013-12-30 17:58:46.468 4760 ERROR cinder.brick.local_dev.lvm [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Error creating Volume 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm Traceback (most recent call last): 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm File "/usr/lib/python2.7/dist-packages/cinder/brick/local_dev/lvm.py", line 370, in create_volume 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm run_as_root=True) 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 142, in execute 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm return processutils.execute(cmd, *kwargs) 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/processutils.py", line 173, in execute 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm cmd=' '.join(cmd)) 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm ProcessExecutionError: Unexpected error while running command. 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvcreate -n volume-31e52489-e039-4edc-8e0e-08a4e89d0702 cinder-volumes1 -L 1g 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm Exit code: 5 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm Stdout: '' 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm Stderr: ' Logical volume "volume-31e52489-e039-4edc-8e0e-08a4e89d0702" already exists in volume group "cinder-volumes1"\n' 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm 2013-12-30 17:58:46.469 4760 ERROR cinder.brick.local_dev.lvm [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Cmd :sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvcreate -n volume-31e52489-e039-4edc-8e0e-08a4e89d0702 cinder-volumes1 -L 1g 2013-12-30 17:58:46.469 4760 ERROR cinder.brick.local_dev.lvm [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] StdOut : 2013-12-30 17:58:46.469 4760 ERROR cinder.brick.local_dev.lvm [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] StdErr : Logical volume "volume-31e52489-e039-4edc-8e0e-08a4e89d0702" already exists in volume group "cinder-volumes1"

2013-12-30 17:58:46.470 4760 WARNING cinder.taskflow.utils [-] Activating 5 rollbacks due to <cinder.taskflow.utils.flowfailure object="" at="" 0x36768d0="">. 2013-12-30 17:58:46.499 4760 ERROR cinder.volume.flows.create_volume [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Unexpected build error: 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume Traceback (most recent call last): 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/taskflow/patterns/linear_flow.py", line 172, in run_it 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume result = runner(context, args, *kwargs) 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/taskflow/utils.py", line 260, in __call__ 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume self.result = self.task(args, *kwargs) 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/volume/flows/create_volume/__init__.py", line 1499, in __call__ 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume *volume_spec) 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/volume/flows/create_volume/__init__.py", line 1470, in _create_raw_volume 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume return self.driver.create_volume(volume_ref) 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 165, in create_volume 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume mirror_count) 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 154, in _create_volume 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume vg_ref.create_volume(name, size, lvm_type, mirror_count) 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/brick/local_dev/lvm.py", line 370, in create_volume 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume run_as_root=True) 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 142, in execute 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume return processutils.execute(cmd, *kwargs) 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/processutils.py", line 173, in execute 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume cmd=' '.join(cmd)) 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume ProcessExecutionError: Unexpected error while running command. 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvcreate -n volume-31e52489-e039-4edc-8e0e-08a4e89d0702 cinder-volumes1 -L 1g 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume Exit code: 5 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume Stdout: '' 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume Stderr: ' Logical volume "volume-31e52489-e039-4edc-8e0e-08a4e89d0702" already exists in volume group "cinder-volumes1"\n' 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume 2013-12-30 17:58:46.500 4760 ERROR cinder.openstack.common.rpc.amqp [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Exception during message handling 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp Traceback (most recent call last): 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/rpc/amqp.py", line 441, in _process_data 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp *args) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/rpc/dispatcher.py", line 148, in dispatch 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp return getattr(proxyobj, method)(ctxt, *kwargs) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 808, in wrapper 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp return func(self, *args, *kwargs) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 257, in create_volume 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp flow.run(context.elevated()) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/decorators.py", line 105, in wrapper 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp return f(self, args, *kwargs) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/patterns/linear_flow.py", line 232, in run 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp run_it(r) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/patterns/linear_flow.py", line 212, in run_it 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp self.rollback(context, cause) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__ 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp self.gen.next() 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/patterns/linear_flow.py", line 172, in run_it 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp result = runner(context, args, *kwargs) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/utils.py", line 260, in __call__ 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp self.result = self.task(args, *kwargs) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/flows/create_volume/__init__.py", line 1499, in __call__ 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp *volume_spec) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/flows/create_volume/__init__.py", line 1470, in _create_raw_volume 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp return self.driver.create_volume(volume_ref) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 165, in create_volume 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp mirror_count) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 154, in _create_volume 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp vg_ref.create_volume(name, size, lvm_type, mirror_count) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/brick/local_dev/lvm.py", line 370, in create_volume 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp run_as_root=True) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 142, in execute 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp return processutils.execute(cmd, *kwargs) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/processutils.py", line 173, in execute 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp cmd=' '.join(cmd)) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp ProcessExecutionError: Unexpected error while running command. 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvcreate -n volume-31e52489-e039-4edc-8e0e-08a4e89d0702 cinder-volumes1 -L 1g 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp Exit code: 5 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp Stdout: '' 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp Stderr: ' Logical volume "volume-31e52489-e039-4edc-8e0e-08a4e89d0702" already exists in volume group "cinder-volumes1"\n' 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp 2013-12-30 17:58:46.629 4760 ERROR cinder.brick.local_dev.lvm [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Error creating Volume 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm Traceback (most recent call last): 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm File "/usr/lib/python2.7/dist-packages/cinder/brick/local_dev/lvm.py", line 370, in create_volume 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm run_as_root=True) 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 142, in execute 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm return processutils.execute(cmd, **kwargs) 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/processutils.py", line 173, in execute 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm cmd=' '.join(cmd)) 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm ProcessExecutionError: Unexpected error while running command. 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvcreate -n volume-31e52489-e039-4edc-8e0e-08a4e89d0702 cinder-volumes1 -L 1g 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm Exit code: 5 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm Stdout: '' 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm Stderr: ' Logical volume "volume-31e52489-e039-4edc-8e0e-08a4e89d0702" already exists in volume group "cinder-volumes1"\n' 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm 2013-12-30 17:58:46.629 4760 ERROR cinder.brick.local_dev.lvm [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Cmd :sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvcreate -n volume-31e52489-e039-4edc-8e0e-08a4e89d0702 cinder-volumes1 -L 1g 2013-12-30 17:58:46.630 4760 ERROR cinder.brick.local_dev.lvm [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] StdOut : 2013-12-30 17:58:46.630 4760 ERROR cinder.brick.local_dev.lvm [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] StdErr : Logical volume "volume-31e52489-e039-4edc-8e0e-08a4e89d0702" already exists in volume group "cinder-volumes1"

2013-12-30 17:58:46.631 4760 WARNING cinder.taskflow.utils [-] Activating 5 rollbacks due to <cinder.taskflow.utils.flowfailure object="" at="" 0x2d3eb90="">. 2013-12-30 17:58:46.655 4760 ERROR cinder.volume.flows.create_volume [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Unexpected build error: 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume Traceback (most recent call last): 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/taskflow/patterns/linear_flow.py", line 172, in run_it 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume result = runner(context, args, *kwargs) 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/taskflow/utils.py", line 260, in __call__ 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume self.result = self.task(args, *kwargs) 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/volume/flows/create_volume/__init__.py", line 1499, in __call__ 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume *volume_spec) 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/volume/flows/create_volume/__init__.py", line 1470, in _create_raw_volume 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume return self.driver.create_volume(volume_ref) 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 165, in create_volume 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume mirror_count) 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 154, in _create_volume 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume vg_ref.create_volume(name, size, lvm_type, mirror_count) 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/brick/local_dev/lvm.py", line 370, in create_volume 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume run_as_root=True) 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 142, in execute 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume return processutils.execute(cmd, *kwargs) 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/processutils.py", line 173, in execute 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume cmd=' '.join(cmd)) 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume ProcessExecutionError: Unexpected error while running command. 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvcreate -n volume-31e52489-e039-4edc-8e0e-08a4e89d0702 cinder-volumes1 -L 1g 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume Exit code: 5 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume Stdout: '' 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume Stderr: ' Logical volume "volume-31e52489-e039-4edc-8e0e-08a4e89d0702" already exists in volume group "cinder-volumes1"\n' 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume 2013-12-30 17:58:46.657 4760 ERROR cinder.openstack.common.rpc.amqp [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Exception during message handling 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp Traceback (most recent call last): 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/rpc/amqp.py", line 441, in _process_data 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp *args) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/rpc/dispatcher.py", line 148, in dispatch 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp return getattr(proxyobj, method)(ctxt, *kwargs) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 808, in wrapper 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp return func(self, *args, *kwargs) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 257, in create_volume 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp flow.run(context.elevated()) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/decorators.py", line 105, in wrapper 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp return f(self, args, *kwargs) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/patterns/linear_flow.py", line 232, in run 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp run_it(r) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/patterns/linear_flow.py", line 212, in run_it 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp self.rollback(context, cause) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__ 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp self.gen.next() 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/patterns/linear_flow.py", line 172, in run_it 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp result = runner(context, args, *kwargs) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/utils.py", line 260, in __call__ 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp self.result = self.task(args, *kwargs) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/flows/create_volume/__init__.py", line 1499, in __call__ 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp *volume_spec) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/flows/create_volume/__init__.py", line 1470, in _create_raw_volume 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp return self.driver.create_volume(volume_ref) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 165, in create_volume 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp mirror_count) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 154, in _create_volume 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp vg_ref.create_volume(name, size, lvm_type, mirror_count) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/brick/local_dev/lvm.py", line 370, in create_volume 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp run_as_root=True) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 142, in execute 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp return processutils.execute(cmd, *kwargs) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/processutils.py", line 173, in execute 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp cmd=' '.join(cmd)) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp ProcessExecutionError: Unexpected error while running command. 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvcreate -n volume-31e52489-e039-4edc-8e0e-08a4e89d0702 cinder-volumes1 -L 1g 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp Exit code: 5 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp Stdout: '' 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp Stderr: ' Logical volume "volume-31e52489-e039-4edc-8e0e-08a4e89d0702" already exists in volume group "cinder-volumes1"\n' 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp root@block1:~# cat /var/log/cinder/cinder-volume.log 2013-12-30 17:57:43.334 4760 WARNING cinder.quota [req-a15eb7b8-15d5-48ec-8b09-ae9236de90a4 d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Deprecated: Default quota for resource: gigabytes is set by the default quota flag: quota_gigabytes, it is now deprecated. Please use the the default quota class for default quota. 2013-12-30 17:57:43.334 4760 WARNING cinder.quota [req-a15eb7b8-15d5-48ec-8b09-ae9236de90a4 d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Deprecated: Default quota for resource: gigabytes_LVM is set by the default quota flag: quota_gigabytes_LVM, it is now deprecated. Please use the the default quota class for default quota. 2013-12-30 17:57:43.335 4760 WARNING cinder.quota [req-a15eb7b8-15d5-48ec-8b09-ae9236de90a4 d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Deprecated: Default quota for resource: volumes_LVM is set by the default quota flag: quota_volumes_LVM, it is now deprecated. Please use the the default quota class for default quota. 2013-12-30 17:57:43.335 4760 WARNING cinder.quota [req-a15eb7b8-15d5-48ec-8b09-ae9236de90a4 d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Deprecated: Default quota for resource: volumes is set by the default quota flag: quota_volumes, it is now deprecated. Please use the the default quota class for default quota. 2013-12-30 17:58:46.312 4760 WARNING cinder.taskflow.utils [-] Activating 5 rollbacks due to <cinder.taskflow.utils.flowfailure object="" at="" 0x2d90c50="">. 2013-12-30 17:58:46.340 4760 ERROR cinder.volume.flows.create_volume [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Unexpected build error: 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume Traceback (most recent call last): 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/taskflow/patterns/linear_flow.py", line 172, in run_it 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume result = runner(context, *args, *kwargs) 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/taskflow/utils.py", line 260, in __call__ 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume self.result = self.task(args, *kwargs) 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/volume/flows/create_volume/__init__.py", line 1520, in __call__ 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume model_update = self.driver.create_export(context, volume_ref) 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 585, in create_export 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume return self._create_export(context, volume) 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 616, in _create_export 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume volume_path, chap_auth) 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 437, in _create_tgtadm_target 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume old_name=old_name) 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/brick/iscsi/iscsi.py", line 155, in create_iscsi_target 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume fileutils.ensure_tree(self.volumes_dir) 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/fileutils.py", line 38, in ensure_tree 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume os.makedirs(path) 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/os.py", line 157, in makedirs 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume mkdir(name, mode) 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume OSError: [Errno 13] Permission denied: '/usr/lib/python2.7/dist-packages/volumes' 2013-12-30 17:58:46.340 4760 TRACE cinder.volume.flows.create_volume 2013-12-30 17:58:46.341 4760 ERROR cinder.openstack.common.rpc.amqp [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Exception during message handling 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp Traceback (most recent call last): 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/rpc/amqp.py", line 441, in _process_data 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp *args) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/rpc/dispatcher.py", line 148, in dispatch 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp return getattr(proxyobj, method)(ctxt, *kwargs) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 808, in wrapper 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp return func(self, args, *kwargs) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 257, in create_volume 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp flow.run(context.elevated()) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/decorators.py", line 105, in wrapper 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp return f(self, args, *kwargs) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/patterns/linear_flow.py", line 232, in run 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp run_it(r) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/patterns/linear_flow.py", line 212, in run_it 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp self.rollback(context, cause) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__ 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp self.gen.next() 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/patterns/linear_flow.py", line 172, in run_it 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp result = runner(context, args, *kwargs) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/utils.py", line 260, in __call__ 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp self.result = self.task(args, *kwargs) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/flows/create_volume/__init__.py", line 1520, in __call__ 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp model_update = self.driver.create_export(context, volume_ref) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 585, in create_export 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp return self._create_export(context, volume) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 616, in _create_export 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp volume_path, chap_auth) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 437, in _create_tgtadm_target 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp old_name=old_name) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/brick/iscsi/iscsi.py", line 155, in create_iscsi_target 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp fileutils.ensure_tree(self.volumes_dir) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/fileutils.py", line 38, in ensure_tree 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp os.makedirs(path) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/os.py", line 157, in makedirs 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp mkdir(name, mode) 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp OSError: [Errno 13] Permission denied: '/usr/lib/python2.7/dist-packages/volumes' 2013-12-30 17:58:46.341 4760 TRACE cinder.openstack.common.rpc.amqp 2013-12-30 17:58:46.468 4760 ERROR cinder.brick.local_dev.lvm [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Error creating Volume 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm Traceback (most recent call last): 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm File "/usr/lib/python2.7/dist-packages/cinder/brick/local_dev/lvm.py", line 370, in create_volume 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm run_as_root=True) 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 142, in execute 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm return processutils.execute(cmd, *kwargs) 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/processutils.py", line 173, in execute 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm cmd=' '.join(cmd)) 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm ProcessExecutionError: Unexpected error while running command. 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvcreate -n volume-31e52489-e039-4edc-8e0e-08a4e89d0702 cinder-volumes1 -L 1g 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm Exit code: 5 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm Stdout: '' 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm Stderr: ' Logical volume "volume-31e52489-e039-4edc-8e0e-08a4e89d0702" already exists in volume group "cinder-volumes1"\n' 2013-12-30 17:58:46.468 4760 TRACE cinder.brick.local_dev.lvm 2013-12-30 17:58:46.469 4760 ERROR cinder.brick.local_dev.lvm [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Cmd :sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvcreate -n volume-31e52489-e039-4edc-8e0e-08a4e89d0702 cinder-volumes1 -L 1g 2013-12-30 17:58:46.469 4760 ERROR cinder.brick.local_dev.lvm [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] StdOut : 2013-12-30 17:58:46.469 4760 ERROR cinder.brick.local_dev.lvm [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] StdErr : Logical volume "volume-31e52489-e039-4edc-8e0e-08a4e89d0702" already exists in volume group "cinder-volumes1"

2013-12-30 17:58:46.470 4760 WARNING cinder.taskflow.utils [-] Activating 5 rollbacks due to <cinder.taskflow.utils.flowfailure object="" at="" 0x36768d0="">. 2013-12-30 17:58:46.499 4760 ERROR cinder.volume.flows.create_volume [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Unexpected build error: 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume Traceback (most recent call last): 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/taskflow/patterns/linear_flow.py", line 172, in run_it 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume result = runner(context, args, *kwargs) 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/taskflow/utils.py", line 260, in __call__ 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume self.result = self.task(args, *kwargs) 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/volume/flows/create_volume/__init__.py", line 1499, in __call__ 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume *volume_spec) 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/volume/flows/create_volume/__init__.py", line 1470, in _create_raw_volume 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume return self.driver.create_volume(volume_ref) 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 165, in create_volume 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume mirror_count) 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 154, in _create_volume 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume vg_ref.create_volume(name, size, lvm_type, mirror_count) 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/brick/local_dev/lvm.py", line 370, in create_volume 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume run_as_root=True) 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 142, in execute 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume return processutils.execute(cmd, *kwargs) 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/processutils.py", line 173, in execute 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume cmd=' '.join(cmd)) 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume ProcessExecutionError: Unexpected error while running command. 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvcreate -n volume-31e52489-e039-4edc-8e0e-08a4e89d0702 cinder-volumes1 -L 1g 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume Exit code: 5 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume Stdout: '' 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume Stderr: ' Logical volume "volume-31e52489-e039-4edc-8e0e-08a4e89d0702" already exists in volume group "cinder-volumes1"\n' 2013-12-30 17:58:46.499 4760 TRACE cinder.volume.flows.create_volume 2013-12-30 17:58:46.500 4760 ERROR cinder.openstack.common.rpc.amqp [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Exception during message handling 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp Traceback (most recent call last): 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/rpc/amqp.py", line 441, in _process_data 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp *args) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/rpc/dispatcher.py", line 148, in dispatch 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp return getattr(proxyobj, method)(ctxt, *kwargs) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 808, in wrapper 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp return func(self, *args, *kwargs) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 257, in create_volume 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp flow.run(context.elevated()) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/decorators.py", line 105, in wrapper 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp return f(self, args, *kwargs) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/patterns/linear_flow.py", line 232, in run 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp run_it(r) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/patterns/linear_flow.py", line 212, in run_it 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp self.rollback(context, cause) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__ 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp self.gen.next() 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/patterns/linear_flow.py", line 172, in run_it 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp result = runner(context, args, *kwargs) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/utils.py", line 260, in __call__ 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp self.result = self.task(args, *kwargs) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/flows/create_volume/__init__.py", line 1499, in __call__ 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp *volume_spec) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/flows/create_volume/__init__.py", line 1470, in _create_raw_volume 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp return self.driver.create_volume(volume_ref) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 165, in create_volume 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp mirror_count) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 154, in _create_volume 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp vg_ref.create_volume(name, size, lvm_type, mirror_count) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/brick/local_dev/lvm.py", line 370, in create_volume 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp run_as_root=True) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 142, in execute 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp return processutils.execute(cmd, *kwargs) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/processutils.py", line 173, in execute 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp cmd=' '.join(cmd)) 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp ProcessExecutionError: Unexpected error while running command. 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvcreate -n volume-31e52489-e039-4edc-8e0e-08a4e89d0702 cinder-volumes1 -L 1g 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp Exit code: 5 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp Stdout: '' 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp Stderr: ' Logical volume "volume-31e52489-e039-4edc-8e0e-08a4e89d0702" already exists in volume group "cinder-volumes1"\n' 2013-12-30 17:58:46.500 4760 TRACE cinder.openstack.common.rpc.amqp 2013-12-30 17:58:46.629 4760 ERROR cinder.brick.local_dev.lvm [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Error creating Volume 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm Traceback (most recent call last): 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm File "/usr/lib/python2.7/dist-packages/cinder/brick/local_dev/lvm.py", line 370, in create_volume 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm run_as_root=True) 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 142, in execute 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm return processutils.execute(cmd, **kwargs) 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/processutils.py", line 173, in execute 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm cmd=' '.join(cmd)) 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm ProcessExecutionError: Unexpected error while running command. 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvcreate -n volume-31e52489-e039-4edc-8e0e-08a4e89d0702 cinder-volumes1 -L 1g 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm Exit code: 5 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm Stdout: '' 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm Stderr: ' Logical volume "volume-31e52489-e039-4edc-8e0e-08a4e89d0702" already exists in volume group "cinder-volumes1"\n' 2013-12-30 17:58:46.629 4760 TRACE cinder.brick.local_dev.lvm 2013-12-30 17:58:46.629 4760 ERROR cinder.brick.local_dev.lvm [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Cmd :sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvcreate -n volume-31e52489-e039-4edc-8e0e-08a4e89d0702 cinder-volumes1 -L 1g 2013-12-30 17:58:46.630 4760 ERROR cinder.brick.local_dev.lvm [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] StdOut : 2013-12-30 17:58:46.630 4760 ERROR cinder.brick.local_dev.lvm [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] StdErr : Logical volume "volume-31e52489-e039-4edc-8e0e-08a4e89d0702" already exists in volume group "cinder-volumes1"

2013-12-30 17:58:46.631 4760 WARNING cinder.taskflow.utils [-] Activating 5 rollbacks due to <cinder.taskflow.utils.flowfailure object="" at="" 0x2d3eb90="">. 2013-12-30 17:58:46.655 4760 ERROR cinder.volume.flows.create_volume [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Unexpected build error: 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume Traceback (most recent call last): 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/taskflow/patterns/linear_flow.py", line 172, in run_it 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume result = runner(context, args, *kwargs) 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/taskflow/utils.py", line 260, in __call__ 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume self.result = self.task(args, *kwargs) 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/volume/flows/create_volume/__init__.py", line 1499, in __call__ 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume *volume_spec) 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/volume/flows/create_volume/__init__.py", line 1470, in _create_raw_volume 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume return self.driver.create_volume(volume_ref) 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 165, in create_volume 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume mirror_count) 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 154, in _create_volume 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume vg_ref.create_volume(name, size, lvm_type, mirror_count) 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/brick/local_dev/lvm.py", line 370, in create_volume 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume run_as_root=True) 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 142, in execute 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume return processutils.execute(cmd, *kwargs) 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/processutils.py", line 173, in execute 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume cmd=' '.join(cmd)) 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume ProcessExecutionError: Unexpected error while running command. 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvcreate -n volume-31e52489-e039-4edc-8e0e-08a4e89d0702 cinder-volumes1 -L 1g 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume Exit code: 5 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume Stdout: '' 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume Stderr: ' Logical volume "volume-31e52489-e039-4edc-8e0e-08a4e89d0702" already exists in volume group "cinder-volumes1"\n' 2013-12-30 17:58:46.655 4760 TRACE cinder.volume.flows.create_volume 2013-12-30 17:58:46.657 4760 ERROR cinder.openstack.common.rpc.amqp [req-8a0cb45e-c402-4bf6-8f42-4589d7ccf72a d501dfde00d945a0938cfdb77eb6db1b ee779790a60f4594ad423310c232fff2] Exception during message handling 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp Traceback (most recent call last): 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/rpc/amqp.py", line 441, in _process_data 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp *args) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/rpc/dispatcher.py", line 148, in dispatch 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp return getattr(proxyobj, method)(ctxt, *kwargs) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 808, in wrapper 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp return func(self, *args, *kwargs) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 257, in create_volume 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp flow.run(context.elevated()) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/decorators.py", line 105, in wrapper 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp return f(self, args, *kwargs) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/patterns/linear_flow.py", line 232, in run 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp run_it(r) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/patterns/linear_flow.py", line 212, in run_it 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp self.rollback(context, cause) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__ 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp self.gen.next() 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/patterns/linear_flow.py", line 172, in run_it 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp result = runner(context, args, *kwargs) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/taskflow/utils.py", line 260, in __call__ 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp self.result = self.task(args, *kwargs) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/flows/create_volume/__init__.py", line 1499, in __call__ 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp *volume_spec) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/flows/create_volume/__init__.py", line 1470, in _create_raw_volume 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp return self.driver.create_volume(volume_ref) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 165, in create_volume 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp mirror_count) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 154, in _create_volume 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp vg_ref.create_volume(name, size, lvm_type, mirror_count) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/brick/local_dev/lvm.py", line 370, in create_volume 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp run_as_root=True) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 142, in execute 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp return processutils.execute(cmd, **kwargs) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/processutils.py", line 173, in execute 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp cmd=' '.join(cmd)) 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp ProcessExecutionError: Unexpected error while running command. 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvcreate -n volume-31e52489-e039-4edc-8e0e-08a4e89d0702 cinder-volumes1 -L 1g 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp Exit code: 5 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp Stdout: '' 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp Stderr: ' Logical volume "volume-31e52489-e039-4edc-8e0e-08a4e89d0702" already exists in volume group "cinder-volumes1"\n' 2013-12-30 17:58:46.657 4760 TRACE cinder.openstack.common.rpc.amqp