Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

cinder: fail to attach volume in kilo

Hi openstack community,

I have installed openstack using the kilo distribution on CentOS 7.For that I'm using a single server and created VMs using KVM.(Storage node lies in a separate VM) I just followed the exact steps given in the yum guide for kilo. But when I try to attach the volumes to a cirros instance, volumes move to "attaching" status and after a while it turns again to "available" status.

My IP addresses controller node : 192.168.122.1 compute : 192.168.122.22 storage : 192.168.122.104

These are the logs when I try to attach the volume. COMPUTE NODE - /var/log/nova/nova-compute.log

d7658629-42a7-48d5-9386-977c86078dff] Attaching volume f1345e85-14d6-4966-b3b4-9028a39a7b99 to /dev/vdb
2015-07-20 10:15:19.546 12517 WARNING nova.virt.libvirt.volume [req-21a67cf6-181e-482d-85fc-4fd400b95919 b0a5e1d791754991b9ae680b508d5cf6 100087f85a07421ab32cb5146f0475b1 - - -] ISCSI volume not yet found at: vdb. Will rescan & retry.  Try number: 0
2015-07-20 10:15:20.606 12517 WARNING nova.virt.libvirt.volume [req-21a67cf6-181e-482d-85fc-4fd400b95919 b0a5e1d791754991b9ae680b508d5cf6 100087f85a07421ab32cb5146f0475b1 - - -] ISCSI volume not yet found at: vdb. Will rescan & retry.  Try number: 1
2015-07-20 10:15:24.684 12517 WARNING nova.virt.libvirt.volume [req-21a67cf6-181e-482d-85fc-4fd400b95919 b0a5e1d791754991b9ae680b508d5cf6 100087f85a07421ab32cb5146f0475b1 - - -] ISCSI volume not yet found at: vdb. Will rescan & retry.  Try number: 2
2015-07-20 10:15:31.847 12517 INFO nova.compute.resource_tracker [req-827fdefc-be0e-4496-88e6-9962e6476455 - - - - -] Auditing locally available compute resources for node compute.openstack
2015-07-20 10:15:32.000 12517 INFO nova.compute.resource_tracker [req-827fdefc-be0e-4496-88e6-9962e6476455 - - - - -] Total usable vcpus: 1, total allocated vcpus: 0
2015-07-20 10:15:32.000 12517 INFO nova.compute.resource_tracker [req-827fdefc-be0e-4496-88e6-9962e6476455 - - - - -] Final resource view: name=compute.openstack phys_ram=1840MB used_ram=2560MB phys_disk=17GB used_disk=11GB total_vcpus=1 used_vcpus=0 pci_stats=<nova.pci.stats.PciDeviceStats object at 0x4a26c10>
2015-07-20 10:15:32.038 12517 INFO nova.scheduler.client.report [req-827fdefc-be0e-4496-88e6-9962e6476455 - - - - -] Compute_service record updated for ('compute.openstack', 'compute.openstack')
2015-07-20 10:15:32.038 12517 INFO nova.compute.resource_tracker [req-827fdefc-be0e-4496-88e6-9962e6476455 - - - - -] Compute_service record updated for compute.openstack:compute.openstack
2015-07-20 10:15:33.769 12517 WARNING nova.virt.libvirt.volume [req-21a67cf6-181e-482d-85fc-4fd400b95919 b0a5e1d791754991b9ae680b508d5cf6 100087f85a07421ab32cb5146f0475b1 - - -] ISCSI volume not yet found at: vdb. Will rescan & retry.  Try number: 3
2015-07-20 10:15:49.838 12517 WARNING nova.virt.libvirt.volume [req-21a67cf6-181e-482d-85fc-4fd400b95919 b0a5e1d791754991b9ae680b508d5cf6 100087f85a07421ab32cb5146f0475b1 - - -] ISCSI volume not yet found at: vdb. Will rescan & retry.  Try number: 4
2015-07-20 10:16:14.925 12517 ERROR nova.virt.block_device [req-21a67cf6-181e-482d-85fc-4fd400b95919 b0a5e1d791754991b9ae680b508d5cf6 100087f85a07421ab32cb5146f0475b1 - - -] [instance: d7658629-42a7-48d5-9386-977c86078dff] Driver failed to attach volume f1345e85-14d6-4966-b3b4-9028a39a7b99 at /dev/vdb
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff] Traceback (most recent call last):
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/nova/virt/block_device.py", line 253, in attach
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff]     device_type=self['device_type'], encryption=encryption)
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 1037, in attach_volume
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff]     self._connect_volume(connection_info, disk_info)
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 988, in _connect_volume
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff]     driver.connect_volume(connection_info, disk_info)
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 445, in inner
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff]     return f(*args, **kwargs)
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/volume.py", line 450, in connect_volume
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff]     % (host_device))
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff] NovaException: iSCSI device not found at /dev/disk/by-path/ip-192.168.122.104:3260-iscsi-iqn.2010-10.org.openstack:volume-f1345e85-14d6-4966-b3b4-9028a39a7b99-lun-0
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff] 
2015-07-20 10:16:15.437 12517 ERROR nova.compute.manager [req-21a67cf6-181e-482d-85fc-4fd400b95919 b0a5e1d791754991b9ae680b508d5cf6 100087f85a07421ab32cb5146f0475b1 - - -] [instance: d7658629-42a7-48d5-9386-977c86078dff] Failed to attach f1345e85-14d6-4966-b3b4-9028a39a7b99 at /dev/vdb
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff] Traceback (most recent call last):
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 4778, in _attach_volume
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]     do_check_attach=False, do_driver_attach=True)
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/nova/virt/block_device.py", line 49, in wrapped
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]     ret_val = method(obj, context, *args, **kwargs)
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/nova/virt/block_device.py", line 262, in attach
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]     connector)
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]     six.reraise(self.type_, self.value, self.tb)
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/nova/virt/block_device.py", line 253, in attach
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]     device_type=self['device_type'], encryption=encryption)
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 1037, in attach_volume
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]     self._connect_volume(connection_info, disk_info)
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 988, in _connect_volume
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]     driver.connect_volume(connection_info, disk_info)
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 445, in inner
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]     return f(*args, **kwargs)
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/volume.py", line 450, in connect_volume
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]     % (host_device))
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff] NovaException: iSCSI device not found at /dev/disk/by-path/ip-192.168.122.104:3260-iscsi-iqn.2010-10.org.openstack:volume-f1345e85-14d6-4966-b3b4-9028a39a7b99-lun-0
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff] 
2015-07-20 10:16:15.617 12517 INFO nova.scheduler.client.report [req-21a67cf6-181e-482d-85fc-4fd400b95919 b0a5e1d791754991b9ae680b508d5cf6 100087f85a07421ab32cb5146f0475b1 - - -] Compute_service record updated for ('compute.openstack', 'compute.openstack')
2015-07-20 10:16:15.619 12517 ERROR oslo_messaging.rpc.dispatcher [req-21a67cf6-181e-482d-85fc-4fd400b95919 b0a5e1d791754991b9ae680b508d5cf6 100087f85a07421ab32cb5146f0475b1 - - -] Exception during message handling: iSCSI device not found at /dev/disk/by-path/ip-192.168.122.104:3260-iscsi-iqn.2010-10.org.openstack:volume-f1345e85-14d6-4966-b3b4-9028a39a7b99-lun-0
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher Traceback (most recent call last):
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     executor_callback))
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     executor_callback)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 130, in _do_dispatch
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     result = func(ctxt, **new_args)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 6584, in attach_volume
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     bdm=bdm)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 443, in decorated_function
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/exception.py", line 88, in wrapped
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     payload)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/exception.py", line 71, in wrapped
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     return f(self, context, *args, **kw)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 327, in decorated_function
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     LOG.warning(msg, e, instance_uuid=instance_uuid)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 298, in decorated_function
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 355, in decorated_function
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     kwargs['instance'], e, sys.exc_info())
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 343, in decorated_function
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 4768, in attach_volume
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     do_attach_volume(context, instance, driver_bdm)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 445, in inner
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     return f(*args, **kwargs)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 4766, in do_attach_volume
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     bdm.destroy()
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 4763, in do_attach_volume
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     return self._attach_volume(context, instance, driver_bdm)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 4786, in _attach_volume
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     self.volume_api.unreserve_volume(context, bdm.volume_id)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 4778, in _attach_volume
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     do_check_attach=False, do_driver_attach=True)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/virt/block_device.py", line 49, in wrapped
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     ret_val = method(obj, context, *args, **kwargs)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/virt/block_device.py", line 262, in attach
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     connector)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/virt/block_device.py", line 253, in attach
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     device_type=self['device_type'], encryption=encryption)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 1037, in attach_volume
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     self._connect_volume(connection_info, disk_info)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 988, in _connect_volume
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     driver.connect_volume(connection_info, disk_info)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 445, in inner
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     return f(*args, **kwargs)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/volume.py", line 450, in connect_volume
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     % (host_device))
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher NovaException: iSCSI device not found at /dev/disk/by-path/ip-192.168.122.104:3260-iscsi-iqn.2010-10.org.openstack:volume-f1345e85-14d6-4966-b3b4-9028a39a7b99-lun-0
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher

I tried changing the iscsi InitiatorName in both the storage node(InitiatorName=iqn.2015-06.com.openstack:access01) and compute node(InitiatorName=iqn.2015-06.com.openstack:access01). But it did not resolve the problem.

I can't understand why it keep asking the same iqn.2010-10.org.openstack: eventhough I have set a different one. Then I tried changing the InitiatorName to iqn.2010-10.org.openstack: but still the same.

This is the log when restarted the cinder scheduler service in controller node

 Jul 20 11:01:15 controller.openstack cinder-scheduler[2929]: /usr/lib/python2.7/site-packages/novaclient/v1_1/__init__.py:30: UserWarning: Module novaclient.v1_1 is deprecated (taken as a basis for novaclient.v2). The preferable way to get client class or object you can find in novaclient.client module.
    Jul 20 11:01:15 controller.openstack cinder-scheduler[2929]: warnings.warn("Module novaclient.v1_1 is deprecated (taken as a basis for "
    Jul 20 11:01:15 controller.openstack cinder-scheduler[2929]: 2015-07-20 11:01:15.717 2929 INFO cinder.service [-] Starting cinder-scheduler node (version 2015.1.0)
    Jul 20 11:01:15 controller.openstack cinder-scheduler[2929]: 2015-07-20 11:01:15.728 2929 INFO oslo_messaging._drivers.impl_rabbit [req-7a111e8d-da95-4225-b226-d555adc4b0e3 - - - - -] Connecting to AMQP server on controller.openstack:5672
    Jul 20 11:01:23 controller.openstack cinder-scheduler[2929]: 2015-07-20 11:01:23.739 2929 INFO oslo_messaging._drivers.impl_rabbit [req-7a111e8d-da95-4225-b226-d555adc4b0e3 - - - - -] Connected to AMQP server on controller.openstack:5672
    Jul 20 11:01:23 controller.openstack cinder-scheduler[2929]: /usr/lib/python2.7/site-packages/amqp/channel.py:616: VDeprecationWarning: The auto_delete flag for exchanges has been deprecated and will be removed
    Jul 20 11:01:23 controller.openstack cinder-scheduler[2929]: from py-amqp v1.5.0.
    Jul 20 11:01:23 controller.openstack cinder-scheduler[2929]: warn(VDeprecationWarning(EXCHANGE_AUTODELETE_DEPRECATED))

In compute node /var/log/messages

iscsid: conn 0 login rejected: initiator failed authorization with target
Jul 20 10:19:17 compute iscsid: Kernel reported iSCSI connection 1:0 error (1020 - ISCSI_ERR_TCP_CONN_CLOSE: TCP connection closed) state (1)

In compute node when searched for the iscsi devices it displays the two volumes I have created run in compute node to start the discovery.

#iscsiadm -m discovery -t st -p 192.168.122.104
192.168.122.104:3260,1 iqn.2010-10.org.openstack:volume-3937654f-e400-4954-b367-406436b2c89b
192.168.122.104:3260,1 iqn.2010-10.org.openstack:volume-f1345e85-14d6-4966-b3b4-9028a39a7b99

But fails to login displaying the error as above in /var/log/messages

Any suggestions are most welcome.Thanks alot in advance.

cinder: fail to attach volume in kilo

Hi openstack community,

I have installed openstack using the kilo distribution on CentOS 7.For that I'm using a single server and created VMs using KVM.(Storage node lies in a separate VM) I just followed the exact steps given in the yum guide for kilo. But when I try to attach the volumes to a cirros instance, volumes move to "attaching" status and after a while it turns again to "available" status.

My IP addresses controller node : 192.168.122.1 compute : 192.168.122.22 storage : 192.168.122.104

These are the logs when I try to attach the volume. COMPUTE NODE - /var/log/nova/nova-compute.log

d7658629-42a7-48d5-9386-977c86078dff] Attaching volume f1345e85-14d6-4966-b3b4-9028a39a7b99 to /dev/vdb
2015-07-20 10:15:19.546 12517 WARNING nova.virt.libvirt.volume [req-21a67cf6-181e-482d-85fc-4fd400b95919 b0a5e1d791754991b9ae680b508d5cf6 100087f85a07421ab32cb5146f0475b1 - - -] ISCSI volume not yet found at: vdb. Will rescan & retry.  Try number: 0
2015-07-20 10:15:20.606 12517 WARNING nova.virt.libvirt.volume [req-21a67cf6-181e-482d-85fc-4fd400b95919 b0a5e1d791754991b9ae680b508d5cf6 100087f85a07421ab32cb5146f0475b1 - - -] ISCSI volume not yet found at: vdb. Will rescan & retry.  Try number: 1
2015-07-20 10:15:24.684 12517 WARNING nova.virt.libvirt.volume [req-21a67cf6-181e-482d-85fc-4fd400b95919 b0a5e1d791754991b9ae680b508d5cf6 100087f85a07421ab32cb5146f0475b1 - - -] ISCSI volume not yet found at: vdb. Will rescan & retry.  Try number: 2
2015-07-20 10:15:31.847 12517 INFO nova.compute.resource_tracker [req-827fdefc-be0e-4496-88e6-9962e6476455 - - - - -] Auditing locally available compute resources for node compute.openstack
2015-07-20 10:15:32.000 12517 INFO nova.compute.resource_tracker [req-827fdefc-be0e-4496-88e6-9962e6476455 - - - - -] Total usable vcpus: 1, total allocated vcpus: 0
2015-07-20 10:15:32.000 12517 INFO nova.compute.resource_tracker [req-827fdefc-be0e-4496-88e6-9962e6476455 - - - - -] Final resource view: name=compute.openstack phys_ram=1840MB used_ram=2560MB phys_disk=17GB used_disk=11GB total_vcpus=1 used_vcpus=0 pci_stats=<nova.pci.stats.PciDeviceStats object at 0x4a26c10>
2015-07-20 10:15:32.038 12517 INFO nova.scheduler.client.report [req-827fdefc-be0e-4496-88e6-9962e6476455 - - - - -] Compute_service record updated for ('compute.openstack', 'compute.openstack')
2015-07-20 10:15:32.038 12517 INFO nova.compute.resource_tracker [req-827fdefc-be0e-4496-88e6-9962e6476455 - - - - -] Compute_service record updated for compute.openstack:compute.openstack
2015-07-20 10:15:33.769 12517 WARNING nova.virt.libvirt.volume [req-21a67cf6-181e-482d-85fc-4fd400b95919 b0a5e1d791754991b9ae680b508d5cf6 100087f85a07421ab32cb5146f0475b1 - - -] ISCSI volume not yet found at: vdb. Will rescan & retry.  Try number: 3
2015-07-20 10:15:49.838 12517 WARNING nova.virt.libvirt.volume [req-21a67cf6-181e-482d-85fc-4fd400b95919 b0a5e1d791754991b9ae680b508d5cf6 100087f85a07421ab32cb5146f0475b1 - - -] ISCSI volume not yet found at: vdb. Will rescan & retry.  Try number: 4
2015-07-20 10:16:14.925 12517 ERROR nova.virt.block_device [req-21a67cf6-181e-482d-85fc-4fd400b95919 b0a5e1d791754991b9ae680b508d5cf6 100087f85a07421ab32cb5146f0475b1 - - -] [instance: d7658629-42a7-48d5-9386-977c86078dff] Driver failed to attach volume f1345e85-14d6-4966-b3b4-9028a39a7b99 at /dev/vdb
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff] Traceback (most recent call last):
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/nova/virt/block_device.py", line 253, in attach
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff]     device_type=self['device_type'], encryption=encryption)
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 1037, in attach_volume
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff]     self._connect_volume(connection_info, disk_info)
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 988, in _connect_volume
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff]     driver.connect_volume(connection_info, disk_info)
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 445, in inner
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff]     return f(*args, **kwargs)
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/volume.py", line 450, in connect_volume
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff]     % (host_device))
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff] NovaException: iSCSI device not found at /dev/disk/by-path/ip-192.168.122.104:3260-iscsi-iqn.2010-10.org.openstack:volume-f1345e85-14d6-4966-b3b4-9028a39a7b99-lun-0
2015-07-20 10:16:14.925 12517 TRACE nova.virt.block_device [instance: d7658629-42a7-48d5-9386-977c86078dff] 
2015-07-20 10:16:15.437 12517 ERROR nova.compute.manager [req-21a67cf6-181e-482d-85fc-4fd400b95919 b0a5e1d791754991b9ae680b508d5cf6 100087f85a07421ab32cb5146f0475b1 - - -] [instance: d7658629-42a7-48d5-9386-977c86078dff] Failed to attach f1345e85-14d6-4966-b3b4-9028a39a7b99 at /dev/vdb
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff] Traceback (most recent call last):
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 4778, in _attach_volume
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]     do_check_attach=False, do_driver_attach=True)
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/nova/virt/block_device.py", line 49, in wrapped
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]     ret_val = method(obj, context, *args, **kwargs)
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/nova/virt/block_device.py", line 262, in attach
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]     connector)
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]     six.reraise(self.type_, self.value, self.tb)
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/nova/virt/block_device.py", line 253, in attach
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]     device_type=self['device_type'], encryption=encryption)
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 1037, in attach_volume
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]     self._connect_volume(connection_info, disk_info)
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 988, in _connect_volume
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]     driver.connect_volume(connection_info, disk_info)
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 445, in inner
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]     return f(*args, **kwargs)
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/volume.py", line 450, in connect_volume
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff]     % (host_device))
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff] NovaException: iSCSI device not found at /dev/disk/by-path/ip-192.168.122.104:3260-iscsi-iqn.2010-10.org.openstack:volume-f1345e85-14d6-4966-b3b4-9028a39a7b99-lun-0
2015-07-20 10:16:15.437 12517 TRACE nova.compute.manager [instance: d7658629-42a7-48d5-9386-977c86078dff] 
2015-07-20 10:16:15.617 12517 INFO nova.scheduler.client.report [req-21a67cf6-181e-482d-85fc-4fd400b95919 b0a5e1d791754991b9ae680b508d5cf6 100087f85a07421ab32cb5146f0475b1 - - -] Compute_service record updated for ('compute.openstack', 'compute.openstack')
2015-07-20 10:16:15.619 12517 ERROR oslo_messaging.rpc.dispatcher [req-21a67cf6-181e-482d-85fc-4fd400b95919 b0a5e1d791754991b9ae680b508d5cf6 100087f85a07421ab32cb5146f0475b1 - - -] Exception during message handling: iSCSI device not found at /dev/disk/by-path/ip-192.168.122.104:3260-iscsi-iqn.2010-10.org.openstack:volume-f1345e85-14d6-4966-b3b4-9028a39a7b99-lun-0
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher Traceback (most recent call last):
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     executor_callback))
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     executor_callback)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 130, in _do_dispatch
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     result = func(ctxt, **new_args)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 6584, in attach_volume
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     bdm=bdm)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 443, in decorated_function
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/exception.py", line 88, in wrapped
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     payload)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/exception.py", line 71, in wrapped
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     return f(self, context, *args, **kw)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 327, in decorated_function
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     LOG.warning(msg, e, instance_uuid=instance_uuid)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 298, in decorated_function
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 355, in decorated_function
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     kwargs['instance'], e, sys.exc_info())
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 343, in decorated_function
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 4768, in attach_volume
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     do_attach_volume(context, instance, driver_bdm)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 445, in inner
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     return f(*args, **kwargs)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 4766, in do_attach_volume
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     bdm.destroy()
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 4763, in do_attach_volume
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     return self._attach_volume(context, instance, driver_bdm)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 4786, in _attach_volume
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     self.volume_api.unreserve_volume(context, bdm.volume_id)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 4778, in _attach_volume
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     do_check_attach=False, do_driver_attach=True)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/virt/block_device.py", line 49, in wrapped
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     ret_val = method(obj, context, *args, **kwargs)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/virt/block_device.py", line 262, in attach
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     connector)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/virt/block_device.py", line 253, in attach
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     device_type=self['device_type'], encryption=encryption)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 1037, in attach_volume
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     self._connect_volume(connection_info, disk_info)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 988, in _connect_volume
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     driver.connect_volume(connection_info, disk_info)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 445, in inner
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     return f(*args, **kwargs)
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/volume.py", line 450, in connect_volume
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher     % (host_device))
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher NovaException: iSCSI device not found at /dev/disk/by-path/ip-192.168.122.104:3260-iscsi-iqn.2010-10.org.openstack:volume-f1345e85-14d6-4966-b3b4-9028a39a7b99-lun-0
2015-07-20 10:16:15.619 12517 TRACE oslo_messaging.rpc.dispatcher

I tried changing the iscsi InitiatorName in both the storage node(InitiatorName=iqn.2015-06.com.openstack:access01) and compute node(InitiatorName=iqn.2015-06.com.openstack:access01). But it did not resolve the problem.

I can't understand why it keep asking the same iqn.2010-10.org.openstack: eventhough I have set a different one. Then I tried changing the InitiatorName to iqn.2010-10.org.openstack: but still the same.

This is the log when restarted the cinder scheduler service in controller node

 Jul 20 11:01:15 controller.openstack cinder-scheduler[2929]: /usr/lib/python2.7/site-packages/novaclient/v1_1/__init__.py:30: UserWarning: Module novaclient.v1_1 is deprecated (taken as a basis for novaclient.v2). The preferable way to get client class or object you can find in novaclient.client module.
    Jul 20 11:01:15 controller.openstack cinder-scheduler[2929]: warnings.warn("Module novaclient.v1_1 is deprecated (taken as a basis for "
    Jul 20 11:01:15 controller.openstack cinder-scheduler[2929]: 2015-07-20 11:01:15.717 2929 INFO cinder.service [-] Starting cinder-scheduler node (version 2015.1.0)
    Jul 20 11:01:15 controller.openstack cinder-scheduler[2929]: 2015-07-20 11:01:15.728 2929 INFO oslo_messaging._drivers.impl_rabbit [req-7a111e8d-da95-4225-b226-d555adc4b0e3 - - - - -] Connecting to AMQP server on controller.openstack:5672
    Jul 20 11:01:23 controller.openstack cinder-scheduler[2929]: 2015-07-20 11:01:23.739 2929 INFO oslo_messaging._drivers.impl_rabbit [req-7a111e8d-da95-4225-b226-d555adc4b0e3 - - - - -] Connected to AMQP server on controller.openstack:5672
    Jul 20 11:01:23 controller.openstack cinder-scheduler[2929]: /usr/lib/python2.7/site-packages/amqp/channel.py:616: VDeprecationWarning: The auto_delete flag for exchanges has been deprecated and will be removed
    Jul 20 11:01:23 controller.openstack cinder-scheduler[2929]: from py-amqp v1.5.0.
    Jul 20 11:01:23 controller.openstack cinder-scheduler[2929]: warn(VDeprecationWarning(EXCHANGE_AUTODELETE_DEPRECATED))

In compute node /var/log/messages

iscsid: conn 0 login rejected: initiator failed authorization with target
Jul 20 10:19:17 compute iscsid: Kernel reported iSCSI connection 1:0 error (1020 - ISCSI_ERR_TCP_CONN_CLOSE: TCP connection closed) state (1)

In compute node when searched for the iscsi devices it displays the two volumes I have created run in compute node to start the discovery.

#iscsiadm -m discovery -t st -p 192.168.122.104
192.168.122.104:3260,1 iqn.2010-10.org.openstack:volume-3937654f-e400-4954-b367-406436b2c89b
192.168.122.104:3260,1 iqn.2010-10.org.openstack:volume-f1345e85-14d6-4966-b3b4-9028a39a7b99

But fails to login displaying the error as above in /var/log/messages

Any suggestions are most welcome.Thanks alot in advance.