Failed to store image Store Exception invalid literal for int() with base 16: ''

asked 2017-09-25 23:34:33 -0600

masber gravatar image

Hi,

not sure why my openstack fails when I try to upload a large image (~700GB).

ERROR

openstack image create --disk-format raw --container-format bare --public --file /root/storage/rstudioimage.raw rstudio-image --property hw_cpu_policy=dedicated
Error finding address for http://10.1.0.5:9292/v2/images/a2efbca2-75ca-4e79-99b5-4fee2744c7b5/file: [Errno 32] Broken pipe

GLANCE LOGS

2017-09-26 01:30:30.023 22 WARNING glance_store._drivers.rbd [req-1c94cf84-47fa-4873-8ce5-028438335c98 - - - - -] since image size is zero we will be doing resize-before-write for each chunk which will be considerably slower than normal
2017-09-26 01:33:25.959 22 ERROR glance_store._drivers.rbd [req-1c94cf84-47fa-4873-8ce5-028438335c98 - - - - -] Failed to store image a2efbca2-75ca-4e79-99b5-4fee2744c7b5 Store Exception invalid literal for int() with base 16: ''
2017-09-26 01:33:26.372 22 ERROR glance.api.v2.image_data [req-1c94cf84-47fa-4873-8ce5-028438335c98 - - - - -] Failed to upload image data due to HTTP error
2017-09-26 01:33:26.412 22 INFO eventlet.wsgi.server [req-1c94cf84-47fa-4873-8ce5-028438335c98 - - - - -] Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/eventlet/wsgi.py", line 512, in handle_one_response
    write(b''.join(towrite))
  File "/usr/lib/python2.7/site-packages/eventlet/wsgi.py", line 453, in write
    wfile.flush()
  File "/usr/lib64/python2.7/socket.py", line 303, in flush
    self._sock.sendall(view[write_offset:write_offset+buffer_size])
  File "/usr/lib/python2.7/site-packages/eventlet/greenio/base.py", line 385, in sendall
    tail = self.send(data, flags)
  File "/usr/lib/python2.7/site-packages/eventlet/greenio/base.py", line 379, in send
    return self._send_loop(self.fd.send, data, flags)
  File "/usr/lib/python2.7/site-packages/eventlet/greenio/base.py", line 366, in _send_loop
    return send_method(data, *args)
error: [Errno 32] Broken pipe

IMAGE DETAILS

qemu-img info storage/rstudioimage.raw
image: storage/rstudioimage.raw
file format: raw
virtual size: 700G (751619276800 bytes)
disk size: 700G

Any thoughts?

edit retag flag offensive close merge delete

Comments

If using kolla, there was a bug uploading an image from public endpoint when using ssl. It was fixed in master and present in pike. Bug was timeouts in haproxy https://review.openstack.org/#/c/475988/

Eduardo Gonzalez gravatar imageEduardo Gonzalez ( 2017-09-26 04:22:21 -0600 )edit

Eduardo, I used kolla (kolla-ansible) 5.0.1 to install pike. I don't think I have that bug, because in my haproxy.cfg appear in the glance_api_external section two timeouts, as in https://review.openstack.org/#/c/4759..., and still have this error.

sacha-m gravatar imagesacha-m ( 2018-01-23 23:28:21 -0600 )edit