Error contacting glance server when performing snapshot

asked 2017-06-14 13:44:48 -0600

jtuttle.iai gravatar image

Having an intermittent issue when performing snapshots on some compute nodes. Success of a snapshot is sporadic and if it fails, the snapshot stays stuck in queued state in horizon. I have verified there is enough space on the host to store the image. nova-compute.log shows the following output during the failure.

 2017-06-14 18:01:07.995 32101 ERROR nova.image.glance [req-b828bb2c-0e52-49b9-b63f-1d33198eb040 b8a6df054f05455881a56ceadaca6eb9 a376f42ff4624b6ea64f545265cf3c71 - - -] Error contacting glance server 'http://192.168.0.2:9292' for 'update', done trying.
2017-06-14 18:01:07.995 32101 ERROR nova.image.glance Traceback (most recent call last):
2017-06-14 18:01:07.995 32101 ERROR nova.image.glance   File "/usr/lib/python2.7/dist-packages/nova/image/glance.py", line 250, in call
2017-06-14 18:01:07.995 32101 ERROR nova.image.glance     result = getattr(client.images, method)(args, *kwargs)
2017-06-14 18:01:07.995 32101 ERROR nova.image.glance   File "/usr/lib/python2.7/dist-packages/glanceclient/v1/images.py", line 365, in update
2017-06-14 18:01:07.995 32101 ERROR nova.image.glance     resp, body = self.client.put(url, headers=hdrs, data=image_data)
2017-06-14 18:01:07.995 32101 ERROR nova.image.glance   File "/usr/lib/python2.7/dist-packages/glanceclient/common/http.py", line 281, in put
2017-06-14 18:01:07.995 32101 ERROR nova.image.glance     return self._request('PUT', url, *kwargs)
2017-06-14 18:01:07.995 32101 ERROR nova.image.glance   File "/usr/lib/python2.7/dist-packages/glanceclient/common/http.py", line 256, in _request
2017-06-14 18:01:07.995 32101 ERROR nova.image.glance     raise exc.CommunicationError(message=message)
2017-06-14 18:01:07.995 32101 ERROR nova.image.glance CommunicationError: Error finding address for http://192.168.0.2:9292/v1/images/7ffa33dc-1656-425b-8ca6-29479689827d: [Errno 32] Broken pipe
2017-06-14 18:01:07.995 32101 ERROR nova.image.glance
2017-06-14 18:01:12.123 32101 ERROR nova.compute.manager [req-b828bb2c-0e52-49b9-b63f-1d33198eb040 b8a6df054f05455881a56ceadaca6eb9 a376f42ff4624b6ea64f545265cf3c71 - - -] [instance: 02c07250-d066-49ee-9f40-facf412262ec] Error while trying to clean up image 7ffa33dc-1656-425b-8ca6-29479689827d
2017-06-14 18:01:12.123 32101 ERROR nova.compute.manager [instance: 02c07250-d066-49ee-9f40-facf412262ec] Traceback (most recent call last):
2017-06-14 18:01:12.123 32101 ERROR nova.compute.manager [instance: 02c07250-d066-49ee-9f40-facf412262ec]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 431, in decorated_function
2017-06-14 18:01:12.123 32101 ERROR nova.compute.manager [instance: 02c07250-d066-49ee-9f40-facf412262ec]     self.image_api.delete(context, image_id)
2017-06-14 18:01:12.123 32101 ERROR nova.compute.manager [instance: 02c07250-d066-49ee-9f40-facf412262ec]   File "/usr/lib/python2.7/dist-packages/nova/image/api.py", line 141, in delete
2017-06-14 18:01:12.123 32101 ERROR nova.compute.manager [instance: 02c07250-d066-49ee-9f40-facf412262ec]     return session.delete(context, image_id)
2017-06-14 18:01:12.123 32101 ERROR nova.compute.manager [instance: 02c07250-d066-49ee-9f40-facf412262ec]   File "/usr/lib/python2.7/dist-packages/nova/image/glance.py", line 499, in delete
2017-06-14 18:01:12.123 32101 ERROR nova.compute.manager [instance: 02c07250-d066-49ee-9f40-facf412262ec]     self._client.call(context, 1, 'delete', image_id)
2017-06-14 18:01:12.123 32101 ERROR nova.compute.manager [instance: 02c07250-d066-49ee-9f40-facf412262ec]   File "/usr/lib/python2.7/dist-packages/nova/image/glance.py", line 250, in call
2017-06-14 18:01:12.123 32101 ...
(more)
edit retag flag offensive close merge delete