IceHouse - no valid host was found - RamFilter
Hi,
I'm using Openstack IceHouse on top of one physical machine (all in one) for quite a while now, and today for some reason I couldn't deploy anymore instances. I'm getting an error on nova scheduler of ram filter returned 0 hosts, which according to my hyper-visor there is still plenty more.
2014-12-29 14:48:21.622 3657 INFO nova.scheduler.filter_scheduler [req-3ff6eea6-f528-4094-be75-3237607d4d51 a0236c9ed453408aa9806b3ae1e2c80e 2750049295984353a978bbabcc8136ec] Attempting to build 1 instance(s) uuids: [u'a40966d5-ebc6-488e-bdc4-3db87bfbe253']
2014-12-29 14:48:21.629 3657 WARNING nova.scheduler.host_manager [req-3ff6eea6-f528-4094-be75-3237607d4d51 a0236c9ed453408aa9806b3ae1e2c80e 2750049295984353a978bbabcc8136ec] Host has more disk space than database expected (-37gb > -1089gb)
2014-12-29 14:48:21.639 3657 INFO nova.filters [req-3ff6eea6-f528-4094-be75-3237607d4d51 a0236c9ed453408aa9806b3ae1e2c80e 2750049295984353a978bbabcc8136ec] Filter RamFilter returned 0 hosts
2014-12-29 14:48:21.639 3657 WARNING nova.scheduler.driver [req-3ff6eea6-f528-4094-be75-3237607d4d51 a0236c9ed453408aa9806b3ae1e2c80e 2750049295984353a978bbabcc8136ec] [instance: a40966d5-ebc6-488e-bdc4-3db87bfbe253] Setting instance to ERROR state.
According to Horizon -> Admin panel - > system panel -> hyper-visors, it seems like i'm over-committing already.. but I definitely don't have that amount of instance that's consuming that amount of resource, and top on the hyper-visors shows a different image.
root@controller:~# nova host-describe controller
+------------+----------------------------------+-----+-----------+---------+
| HOST | PROJECT | cpu | memory_mb | disk_gb |
+------------+----------------------------------+-----+-----------+---------+
| controller | (total) | 24 | 64382 | 211 |
| controller | (used_now) | 38 | 94736 | 1300 |
| controller | (used_max) | 11 | 22528 | 160 |
| controller | 2078ed30be9d4052868422fd8c069b9d | 3 | 6144 | 60 |
| controller | 57bf30be07be41a5920539bab8661329 | 2 | 4096 | 20 |
| controller | 2750049295984353a978bbabcc8136ec | 6 | 12288 | 80 |
+------------+----------------------------------+-----+-----------+---------+