Ask Your Question
0

IceHouse - no valid host was found - RamFilter

asked 2014-12-29 06:51:22 -0500

azriel gravatar image

updated 2014-12-29 09:21:44 -0500

Hi,

I'm using Openstack IceHouse on top of one physical machine (all in one) for quite a while now, and today for some reason I couldn't deploy anymore instances. I'm getting an error on nova scheduler of ram filter returned 0 hosts, which according to my hyper-visor there is still plenty more.

2014-12-29 14:48:21.622 3657 INFO nova.scheduler.filter_scheduler [req-3ff6eea6-f528-4094-be75-3237607d4d51 a0236c9ed453408aa9806b3ae1e2c80e 2750049295984353a978bbabcc8136ec] Attempting to build 1 instance(s) uuids: [u'a40966d5-ebc6-488e-bdc4-3db87bfbe253']
2014-12-29 14:48:21.629 3657 WARNING nova.scheduler.host_manager [req-3ff6eea6-f528-4094-be75-3237607d4d51 a0236c9ed453408aa9806b3ae1e2c80e 2750049295984353a978bbabcc8136ec] Host has more disk space than database expected (-37gb > -1089gb)
2014-12-29 14:48:21.639 3657 INFO nova.filters [req-3ff6eea6-f528-4094-be75-3237607d4d51 a0236c9ed453408aa9806b3ae1e2c80e 2750049295984353a978bbabcc8136ec] Filter RamFilter returned 0 hosts
2014-12-29 14:48:21.639 3657 WARNING nova.scheduler.driver [req-3ff6eea6-f528-4094-be75-3237607d4d51 a0236c9ed453408aa9806b3ae1e2c80e 2750049295984353a978bbabcc8136ec] [instance: a40966d5-ebc6-488e-bdc4-3db87bfbe253] Setting instance to ERROR state.

According to Horizon -> Admin panel - > system panel -> hyper-visors, it seems like i'm over-committing already.. but I definitely don't have that amount of instance that's consuming that amount of resource, and top on the hyper-visors shows a different image.

root@controller:~#  nova host-describe controller
+------------+----------------------------------+-----+-----------+---------+
| HOST       | PROJECT                          | cpu | memory_mb | disk_gb |
+------------+----------------------------------+-----+-----------+---------+
| controller | (total)                          | 24  | 64382     | 211     |
| controller | (used_now)                       | 38  | 94736     | 1300    |
| controller | (used_max)                       | 11  | 22528     | 160     |
| controller | 2078ed30be9d4052868422fd8c069b9d | 3   | 6144      | 60      |
| controller | 57bf30be07be41a5920539bab8661329 | 2   | 4096      | 20      |
| controller | 2750049295984353a978bbabcc8136ec | 6   | 12288     | 80      |
+------------+----------------------------------+-----+-----------+---------+
edit retag flag offensive close merge delete

2 answers

Sort by ยป oldest newest most voted
0

answered 2014-12-29 11:05:36 -0500

azriel gravatar image

I've restarted all of my services and the issue is solved.

edit flag offensive delete link more
0

answered 2014-12-29 07:34:46 -0500

bishoy gravatar image

in nova.conf remove ramfilter from scheduler_default_filters if it's there. Also comment this if it's not commented ram_allocation_ratio.

edit flag offensive delete link more

Comments

I've searched for this values, they don't exist in nova.conf (I've installed it manually) checking ram used according to horizon it's 92GB used, but according to free it's 42GB. disk space according to horizon it's 1.3TB according to df -h only 100G are in use.

azriel gravatar imageazriel ( 2014-12-29 07:43:38 -0500 )edit

even if free is showing that there are a lot of ram available you can't launch more instances if you launched large flavor instances which eat ram in math. I mean like 50GB ram for each instance even if it's not used the scheduler will not launch more. nova describe command will show what I mean

bishoy gravatar imagebishoy ( 2014-12-29 08:05:44 -0500 )edit

which command are you referring to? and it still seems odd, like instances that were deleted were never deleted and are still consuming resources... on my current node I don't have many instances. very little with very little amount of resources. no way it consumed all.

azriel gravatar imageazriel ( 2014-12-29 08:49:16 -0500 )edit

nova host-describe <"compute host">, could do #virsh list --all?

bishoy gravatar imagebishoy ( 2014-12-29 09:16:28 -0500 )edit

Please see the output of it at the original thread. If I sum all my current installed machines on open-stack it won't get to these numbers...

azriel gravatar imageazriel ( 2014-12-29 09:20:45 -0500 )edit

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

Stats

Asked: 2014-12-29 06:51:22 -0500

Seen: 752 times

Last updated: Dec 29 '14