Unable to create volume in Openstack-Ocata version
Unable to create volume in Openstack-Ocata version. We do have dell Equal-logic storage back-end and it was working fine. All of a sudden not able to create volume and volume is erroring out .Can see cinder-volume service status as running with below messages.
Nov 17 11:52:19 FGSUSDUCTR01 cinder-volume[2338]: cb(args, *kw) Nov 17 11:52:19 FGSUSDUCTR01 cinder-volume[2338]: File "/usr/lib/python2.7/dist-packages/eventlet/semaphore.py", line 145, in _do_acquire Nov 17 11:52:19 FGSUSDUCTR01 cinder-volume[2338]: waiter.switch() Nov 17 11:52:19 FGSUSDUCTR01 cinder-volume[2338]: File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 214, in main Nov 17 11:52:19 FGSUSDUCTR01 cinder-volume[2338]: result = function(args, *kwargs) Nov 17 11:52:19 FGSUSDUCTR01 cinder-volume[2338]: File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/dell_emc/ps.py", line 185, in _ssh_execute Nov 17 11:52:19 FGSUSDUCTR01 cinder-volume[2338]: self._get_output(chan) Nov 17 11:52:19 FGSUSDUCTR01 cinder-volume[2338]: File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/dell_emc/ps.py", line 163, in _get_output Nov 17 11:52:19 FGSUSDUCTR01 cinder-volume[2338]: raise exception.VolumeBackendAPIException(data=msg)
Nov 17 11:52:19 FGSUSDUCTR01 cinder-volume[2338]: VolumeBackendAPIException: Bad or unexpected response from the storage volume backend API: The PS array has closed the connection. <<<<<<<<<<<
I am able to manually create luns at back end level ,also refreshed iscsi connections.
Any help is highly appreciated
Have you updated any packages on the backend side? We use Ceph as a backend, and when we upgraded our Ceph servers, the clients couldn't create new volumes etc. As soon as we also updated the client side to the same ceph version everything worked again.
no we didn't do any changes on back end or on our openstack set up
Could it be a permission problem? Is user cinder allowed to create connections to the backend etc.? Any logs/error messages from the backend side?