Ask Your Question
0

horizon dashboard issue downloading large files from swift

asked 2014-04-02 01:22:02 -0500

hisham gravatar image

Hi all,

I have an issue with the openstack dashboard when downloading large files from swift.

The file in question is 2.8GB, which uploads fine.

When I try to download it, the apache2 process on the dashboard consumes all of the memory and then causes the dashboard to return an internal error occured.

When looking at the logs it returns a Memory error indicating it ran out of memory.

I couldnt find anything on google regarding this, is it a known issue, or is it something with the session cache? smaller files work fine.

thanks

edit retag flag offensive close merge delete

2 answers

Sort by ยป oldest newest most voted
0

answered 2016-07-05 07:27:59 -0500

amotoki gravatar image

Horizon bug on this is https://bugs.launchpad.net/horizon/+b.... It is not a design. It is a bug. Django StreamingHttpRequest should be used for such a large request instead of HttpRequest. It was fixed in Kilo or later in Horizon.

edit flag offensive delete link more
1

answered 2014-04-02 16:13:30 -0500

SamYaple gravatar image

I am able to reproduce this, however I would not call it a bug. It is functioning as designed (feel free to question the design and improve upon it).

Horizon uses Apache to request the file from Swift. Apache stores this incoming file into RAM as a buffer. Once Apache has finished downloading the file, it feeds it to you and dumps the file from memory.

edit flag offensive delete link more

Comments

my controller is a vm so I added 4GB of RAM and I dont get the memory error anymore. but now I get an IOerror failed to write data linking back to wsgi.py for openstack-dashboard. Is the only method for large files to use the swift client?

hisham gravatar imagehisham ( 2014-04-02 17:15:17 -0500 )edit
1

Personally, I have never used Horizon for this. So I don't know _exactly_ what it is doing. If you think this is a bug ( and it may be) you would probably be better off filing a bug. That is where you'd get the best help for tracking down that issue. I am unsure if Apache is flushing the file to you local VM disk at all to cause that error.

SamYaple gravatar imageSamYaple ( 2014-04-02 18:45:17 -0500 )edit

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

Stats

Asked: 2014-04-02 01:22:02 -0500

Seen: 339 times

Last updated: Apr 02 '14