horizon dashboard issue downloading large files from swift

asked 2014-04-02 01:22:02 -0500

hisham gravatar image

Hi all,

I have an issue with the openstack dashboard when downloading large files from swift.

The file in question is 2.8GB, which uploads fine.

When I try to download it, the apache2 process on the dashboard consumes all of the memory and then causes the dashboard to return an internal error occured.

When looking at the logs it returns a Memory error indicating it ran out of memory.

I couldnt find anything on google regarding this, is it a known issue, or is it something with the session cache? smaller files work fine.


edit retag flag offensive close merge delete

2 answers

Sort by ยป oldest newest most voted

answered 2014-04-02 16:13:30 -0500

SamYaple gravatar image

I am able to reproduce this, however I would not call it a bug. It is functioning as designed (feel free to question the design and improve upon it).

Horizon uses Apache to request the file from Swift. Apache stores this incoming file into RAM as a buffer. Once Apache has finished downloading the file, it feeds it to you and dumps the file from memory.

edit flag offensive delete link more


my controller is a vm so I added 4GB of RAM and I dont get the memory error anymore. but now I get an IOerror failed to write data linking back to wsgi.py for openstack-dashboard. Is the only method for large files to use the swift client?

hisham gravatar imagehisham ( 2014-04-02 17:15:17 -0500 )edit

Personally, I have never used Horizon for this. So I don't know _exactly_ what it is doing. If you think this is a bug ( and it may be) you would probably be better off filing a bug. That is where you'd get the best help for tracking down that issue. I am unsure if Apache is flushing the file to you local VM disk at all to cause that error.

SamYaple gravatar imageSamYaple ( 2014-04-02 18:45:17 -0500 )edit

answered 2016-07-05 07:27:59 -0500

amotoki gravatar image

Horizon bug on this is https://bugs.launchpad.net/horizon/+b.... It is not a design. It is a bug. Django StreamingHttpRequest should be used for such a large request instead of HttpRequest. It was fixed in Kilo or later in Horizon.

edit flag offensive delete link more

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower


Asked: 2014-04-02 01:22:02 -0500

Seen: 408 times

Last updated: Apr 02 '14