Unable to create volume in Openstack-Ocata version

asked 2017-11-17 05:57:31 -0600

Deepa gravatar image

updated 2017-11-20 03:28:31 -0600

Unable to create volume in Openstack-Ocata version. We do have dell Equal-logic storage back-end and it was working fine. All of a sudden not able to create volume and volume is erroring out .Can see cinder-volume service status as running with below messages.

Nov 17 11:52:19 FGSUSDUCTR01 cinder-volume[2338]: cb(args, *kw) Nov 17 11:52:19 FGSUSDUCTR01 cinder-volume[2338]: File "/usr/lib/python2.7/dist-packages/eventlet/semaphore.py", line 145, in _do_acquire Nov 17 11:52:19 FGSUSDUCTR01 cinder-volume[2338]: waiter.switch() Nov 17 11:52:19 FGSUSDUCTR01 cinder-volume[2338]: File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 214, in main Nov 17 11:52:19 FGSUSDUCTR01 cinder-volume[2338]: result = function(args, *kwargs) Nov 17 11:52:19 FGSUSDUCTR01 cinder-volume[2338]: File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/dell_emc/ps.py", line 185, in _ssh_execute Nov 17 11:52:19 FGSUSDUCTR01 cinder-volume[2338]: self._get_output(chan) Nov 17 11:52:19 FGSUSDUCTR01 cinder-volume[2338]: File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/dell_emc/ps.py", line 163, in _get_output Nov 17 11:52:19 FGSUSDUCTR01 cinder-volume[2338]: raise exception.VolumeBackendAPIException(data=msg)

Nov 17 11:52:19 FGSUSDUCTR01 cinder-volume[2338]: VolumeBackendAPIException: Bad or unexpected response from the storage volume backend API: The PS array has closed the connection. <<<<<<<<<<<

I am able to manually create luns at back end level ,also refreshed iscsi connections.

Any help is highly appreciated

edit retag flag offensive close merge delete

Comments

Have you updated any packages on the backend side? We use Ceph as a backend, and when we upgraded our Ceph servers, the clients couldn't create new volumes etc. As soon as we also updated the client side to the same ceph version everything worked again.

eblock gravatar imageeblock ( 2017-11-20 04:28:38 -0600 )edit

no we didn't do any changes on back end or on our openstack set up

Deepa gravatar imageDeepa ( 2017-11-20 05:30:05 -0600 )edit

Could it be a permission problem? Is user cinder allowed to create connections to the backend etc.? Any logs/error messages from the backend side?

eblock gravatar imageeblock ( 2017-11-21 04:58:55 -0600 )edit

It was a bug and a driver issue , fix released in latest version of driver file for equallogic and also increased time out value in cinder.conf

Deepa gravatar imageDeepa ( 2017-12-07 00:01:40 -0600 )edit