Ask Your Question
0

No valid host was found. There are not enough hosts available. Code 500

asked 2019-10-13 21:05:21 -0600

NazMan gravatar image

Hi,

I have installed the RDO Openstack "Rocky" release using packstack. There are 4 nodes. Node1 is used for controller, network, Cinder storage and Nova-Compute. Other 3 nodes are dedicated for nova-compute only. I am using Cinder block storage with ISCSI back end. The block storage is the local disk on the controller node.

The setup seems working OK. I can launch the instances with the following 3 default falvor.

+--------------------------------------+-----------+-------+------+-----------+-------+-----------+
| ID                                   | Name      |   RAM | Disk | Ephemeral | VCPUs | Is Public |
+--------------------------------------+-----------+-------+------+-----------+-------+-----------+
| 1                                    | m1.tiny   |   512 |    1 |         0 |     1 | True      |
| 2                                    | m1.small  |  2048 |   20 |         0 |     1 | True      |
| 3                                    | m1.medium |  4096 |   40 |         0 |     2 | True      |

However, when I try to launch an instance with the following flavor it is failing to to launch the instance. 

| 4                                    | m1.large  |  8192 |   80 |         0 |     4 | True      |
| 5                                    | m1.xlarge | 16384 |  160 |         0 |     8 | True      |

I am getting the following error:

> Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/nova/conductor/manager.py", line 1255, in schedule_and_build_instances instance_uuids, return_alternates=True) File "/usr/lib/python2.7/site-packages/nova/conductor/manager.py", line 768, in _schedule_instances return_alternates=return_alternates) File "/usr/lib/python2.7/site-packages/nova/scheduler/client/__init__.py", line 50, in select_destinations instance_uuids, return_objects, return_alternates) File "/usr/lib/python2.7/site-packages/nova/scheduler/client/__init__.py", line 35, in __run_method return getattr(self.instance, __name)(args, kwargs) File "/usr/lib/python2.7/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations instance_uuids, return_objects, return_alternates) File "/usr/lib/python2.7/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations return cctxt.call(ctxt, 'select_destinations', msg_args) File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line 179, in call retry=self.retry) File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 133, in _send retry=retry) File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 584, in send call_monitor_timeout, retry=retry) File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 575, in _send raise result NoValidHost_Remote: No valid host was found. There are not enough hosts available. Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 226, in inner return func(args, kwargs) File "/usr/lib/python2.7/site-packages/nova/scheduler/manager.py", line 169, in select_destinations allocation_request_version, return_alternates) File "/usr/lib/python2.7/site-packages/nova/scheduler/filter_scheduler.py", line 91, in select_destinations allocation_request_version, return_alternates) File "/usr/lib/python2.7/site-packages/nova/scheduler/filter_scheduler.py", line 256, in _schedule claimed_instance_uuids) File "/usr/lib/python2.7/site-packages/nova/scheduler/filter_scheduler.py", line 293, in _ensure_sufficient_hosts raise exception.NoValidHost(reason=reason) NoValidHost: No valid host was found. There are not enough hosts available. >

I can see there are many people reported the same error. However I couldn't find a solution which works for me. Any help will be much appreciated.

Thanks, NazMan

edit retag flag offensive close merge delete

Comments

I guess you have not enough space on the compute hosts. How much RAM do they have? Is there enough space for instances' ephemeral storage?

For details, you should look into the placement and nova-scheduler logs.

Bernd Bausch gravatar imageBernd Bausch ( 2019-10-14 00:59:37 -0600 )edit
add a comment

1 answer

Sort by » oldest newest most voted
0

answered 2019-10-14 19:51:19 -0600

NazMan gravatar image

Thanks Bernd,

I don't thinks resource is an issue here. I have got 4 bare-metal host running with the following spec.

[root@osp-node1 ~(keystone_admin)]# openstack hypervisor list --long
+----+---------------------+-----------------+----------------+-------+------------+-------+----------------+-----------+
| ID | Hypervisor Hostname | Hypervisor Type | Host IP        | State | vCPUs Used | vCPUs | Memory MB Used | Memory MB |
+----+---------------------+-----------------+----------------+-------+------------+-------+----------------+-----------+
|  1 | osp-node1           | QEMU            | 10.233.210.111 | up    |          2 |    24 |           4608 |    163805 |
|  2 | osp-node3           | QEMU            | 10.233.210.113 | up    |          2 |    24 |           4608 |     73717 |
|  3 | osp-node4           | QEMU            | 10.233.210.114 | up    |          2 |    24 |           4608 |     73717 |
|  4 | osp-node2           | QEMU            | 10.233.210.112 | up    |          2 |    24 |           4608 |    131037 |
+----+---------------------+-----------------+----------------+-------+------------+-------+----------------+-----------+
[root@osp-node1 ~(keystone_admin)]# nova hypervisor-stats
+----------------------+--------+
| Property             | Value  |
+----------------------+--------+
| count                | 4      |
| current_workload     | 0      |
| disk_available_least | 196    |
| free_disk_gb         | 196    |
| free_ram_mb          | 423844 |
| local_gb             | 196    |
| local_gb_used        | 0      |
| memory_mb            | 442276 |
| memory_mb_used       | 18432  |
| running_vms          | 4      |
| vcpus                | 96     |
| vcpus_used           | 8      |
+----------------------+--------+

And the cider volume size below:

[root@osp-node1 ~(keystone_admin)]# lsblk | grep cinder
│ ├─cinder--volumes-cinder--volumes--pool_tmeta                          253:5    0    84M  0 lvm  
│ │ └─cinder--volumes-cinder--volumes--pool-tpool                        253:7    0   2.6T  0 lvm  
│ │   ├─cinder--volumes-cinder--volumes--pool                            253:8    0   2.6T  0 lvm  
│ │   ├─cinder--volumes-volume--24682587--8b1d--44cd--ac6a--50e426762788 253:9    0    40G  0 lvm  
│ │   ├─cinder--volumes-volume--0fdc4e07--b05f--4fc2--8b4e--81a019d4f975 253:10   0    40G  0 lvm  
│ │   ├─cinder--volumes-volume--0c690e55--0a42--494d--805b--bd80eadc16b3 253:11   0    40G  0 lvm  
│ │   └─cinder--volumes-volume--3ef7791b--cec0--4faf--980a--deb4fbe1c8c3 253:12   0    40G  0 lvm  
│ └─cinder--volumes-cinder--volumes--pool_tdata                          253:6    0   2.6T  0 lvm  
│   └─cinder--volumes-cinder--volumes--pool-tpool                        253:7    0   2.6T  0 lvm  
│     ├─cinder--volumes-cinder--volumes--pool                            253:8    0   2.6T  0 lvm  
│     ├─cinder--volumes-volume--24682587--8b1d--44cd--ac6a--50e426762788 253:9    0    40G  0 lvm  
│     ├─cinder--volumes-volume--0fdc4e07--b05f--4fc2--8b4e--81a019d4f975 253:10   0    40G  0 lvm  
│     ├─cinder--volumes-volume--0c690e55--0a42--494d--805b--bd80eadc16b3 253:11   0    40G  0 lvm  
│     └─cinder--volumes-volume--3ef7791b--cec0--4faf--980a--deb4fbe1c8c3 253:12   0    40G  0 lvm  
[root@osp-node1 ~(keystone_admin)]#
edit flag offensive delete link more

Comments

I got the issue fixed. To fix the issue I had to commented out the enabled_filters from nova.conf file

NazMan gravatar imageNazMan ( 2019-10-14 23:12:28 -0600 )edit

Hello NaZMan @ I need your help..could you please elaborate what exactly you have done to resolve this error. I am also facing the same error.. have done any service reboot after commenting enabled_filters in nova.conf file.?

GautamSheladiya gravatar imageGautamSheladiya ( 2020-02-20 13:09:08 -0600 )edit
add a comment

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

subscribe to rss feed

Stats

Asked: 2019-10-13 21:05:21 -0600

Seen: 168 times

Last updated: Oct 14 '19

Related questions

"No valid host was found." error during booting of a instance

Kilo: error creating instance "no valid host was found"

NoValidHost: No valid host was found [closed]

Openstack Pike: how to re-create the cell_v0 db? (another variation of the dreaded "NoValidHost" error)

DevStack: No valid host was found when launching instance

failed to launch instance: No valid Host was found.

replace compute node

[nova-conductor] NoValidHost: No valid host was found.

Devstack - Can't create instances?

Determining which filter eliminated a host?