Ask Your Question
1

Glance - Client disconnected before sending all data to backend

asked 2014-04-01 10:26:04 -0500

updated 2014-04-02 04:28:06 -0500

Hi all,

I have a problem uploading a disk image on glance... I have a 64GB vmdk file, perfectly working on an ESXi host. I would like to insert it in glance in order to start VMs directly from that disk.

The problem is that the upload process starts correctly but then, after a while, it fails.

This is the command I used:

glance image-create --name=WIN-IMG --disk-format=vmdk --container-format=bare --is-public=true --file /mnt/openstack/WIN-IMG-flat.vmdk

The problem is that I could see a new entry in the filesystem_store_datadir but when it reaches the 32GB file size an error sistematically occours:

Request returned failure status. 400 Bad Request Client disconnected before sending all data to backend (HTTP 400)

In glance logs files I could not see anything interesting. I could say that this error only happens with this image file (i uploaded other image files although no one of them so big)

An additional question I would like to ask is if there is a mechanism to directly put the vmdk file in glance... I mean, I already have the vmdk file in the same nfs store that realizes the glance filesystem_store_datadir. Is it possible to stop the image-create command in order to rename it as the new entry hash (and let glance think that it uploaded it correctly?).

Thanks in advance, Antonio

edit retag flag offensive close merge delete

2 answers

Sort by ยป oldest newest most voted
0

answered 2014-04-01 10:31:28 -0500

SamYaple gravatar image

updated 2014-04-01 10:32:37 -0500

To address your first part, can you run glance --debug image-create --name=WIN-IMG --disk-format=vmdk --container-format=bare --is-public=true --file /mnt/openstack/WIN-IMG-flat.vmdk

Youll probably want to dump that out to a file as it may have alot of output. Near where it crashes it should have alot more verbosity about _why_ it crashed aside from just HTTP 400

You can also enable DEBUG=True in you're glance.conf for more verbosity in your glance logs. (Warning: It is alot!)

Also check your glance-api.conf file for an entry with image_size_cap= The default should be 1TB but it may have been overwriten.

Bonus Answer: Yes, you can manually push in that VMDK, but it requires database hacking and is typically not recommended. It is very easy to not get every detail right in every table.

That being said I did it once. Just once. I would not recommend doing it. It was tedious.

edit flag offensive delete link more

Comments

Thanks for your reply.

I run the command with --debug option:

  • this is the command I run and the corresponding output (http://paste.openstack.org/show/74802/)
  • here the glance-api.log file (http://paste.openstack.org/show/74803/)

I could not find any useful information about why it crashed... Could you find anything to dig on?

I double checked the image_size_cap property and it is commented, so I think glance should use the default value (1TB).

Thanks in advance for your help, Antonio

Antonio G. gravatar imageAntonio G. ( 2014-04-02 03:46:22 -0500 )edit

I do not see anything useful in the output or log either. It looks like you (your client) is actually breaking the connection. I am trying to duplicate it now.

SamYaple gravatar imageSamYaple ( 2014-04-02 08:18:50 -0500 )edit

A few additional questions, can you post your conf files for glance? Does this always happen on exactly 32GB? Can you upload a different image that is larger/smaller?

SamYaple gravatar imageSamYaple ( 2014-04-02 08:37:16 -0500 )edit

Ok, thanks for the answer.

Could you please tell me how to tweak the database in order to manually insert the vmdk... I never tried it before...

In your knowledge, does glance search or control something on the disk file or it simply copy it from the source path to the glance filesystem_store_datadir? Because we already had copied an almost identical (in size and format) file with success. Thanks, Antonio

Antonio G. gravatar imageAntonio G. ( 2014-04-02 08:37:45 -0500 )edit

Here my conf files (glance-api.conf, glance-api-paste.ini, glance-registry.conf, glance-registry-paste.ini):

  • http://paste.openstack.org/show/74837/
  • http://paste.openstack.org/show/74843/
  • http://paste.openstack.org/show/74844/
  • http://paste.openstack.org/show/74845/

I don't know if it always happens specifically on 32GB, i never checked it because when it fails glance delete the uploaded file. Yes, I could perfectly upload the sample cirros image (and other images).

Antonio G. gravatar imageAntonio G. ( 2014-04-02 08:54:23 -0500 )edit
0

answered 2015-03-10 17:51:31 -0500

I think I am hitting the same issue. Maybe glance resteart will help because it may be auth timeout issue.

  • https://bugzilla.redhat.com/show_bug.cgi?id=1133566 (https://bugzilla.redhat.com/show_bug....)
  • https://bugs.launchpad.net/glance-store/+bug/1361197 (https://bugs.launchpad.net/glance-sto...)
  • https://bugs.launchpad.net/nova/+bug/1240355 (https://bugs.launchpad.net/nova/+bug/...)
edit flag offensive delete link more

Comments

It is being resolved in

  • https://bugzilla.redhat.com/show_bug.cgi?id=1200075
  • https://bugs.launchpad.net/glance/+bug/1402354
Jaroslav Henner gravatar imageJaroslav Henner ( 2015-03-11 06:37:37 -0500 )edit

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

Stats

Asked: 2014-04-01 10:26:04 -0500

Seen: 1,276 times

Last updated: Mar 10 '15