Ask Your Question
0

Launching instances fails with "Error from last host message"

asked 2014-02-20 19:12:34 -0500

vahidhashemian gravatar image

Hi,

This issue has been bugging me for a while and doesn't let me launch any instances. I have not been able to find a solution, so I was hoping someone can shed some light on what is causing it and how to resolve it.

This is what I see in nova scheduler log when launching instances fail and with the error 'Error: Failed to launch instance "ins3": Please try again later [Error: No valid host was found. ].' in Horizon:

2014-02-20 08:39:51.372 ERROR nova.scheduler.filter_scheduler [req-a1174b19-5501-4a89-b01d-f59490bf0081 admin demo] [instance: 71ebbc90-e492-49f7-807e-d3f0c9c82851] Error from last host: devstackready02 (node devstackready02): [u'Traceback (most recent call last):\n', u' File "/opt/stack/nova/nova/compute/manager.py", line 1070, in _build_instance\n set_access_ip=set_access_ip)\n', u' File "/opt/stack/nova/nova/compute/manager.py", line 357, in decorated_function\n return function(self, context, args, *kwargs)\n', u' File "/opt/stack/nova/nova/compute/manager.py", line 1478, in _spawn\n LOG.exception(_(\'Instance failed to spawn\'), instance=instance)\n', u' File "/opt/stack/nova/nova/openstack/common/excutils.py", line 68, in __exit__\n six.reraise(self.type_, self.value, self.tb)\n', u' File "/opt/stack/nova/nova/compute/manager.py", line 1475, in _spawn\n block_device_info)\n', u' File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 2208, in spawn\n admin_pass=admin_password)\n', u' File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 2573, in _create_image\n content=files, extra_md=extra_md, network_info=network_info)\n', u' File "/opt/stack/nova/nova/api/metadata/base.py", line 163, in __init__\n ec2utils.get_ip_info_for_instance_from_nw_info(network_info)\n', u' File "/opt/stack/nova/nova/api/ec2/ec2utils.py", line 147, in get_ip_info_for_instance_from_nw_info\n fixed_ips = nw_info.fixed_ips()\n', u' File "/opt/stack/nova/nova/network/model.py", line 366, in _sync_wrapper\n self.wait()\n', u' File "/opt/stack/nova/nova/network/model.py", line 398, in wait\n self[:] = self._gt.wait()\n', u' File "/usr/local/lib/python2.7/dist-packages/eventlet/greenthread.py", line 168, in wait\n return self._exit_event.wait()\n', u' File "/usr/local/lib/python2.7/dist-packages/eventlet/event.py", line 116, in wait\n return hubs.get_hub().switch()\n', u' File "/usr/local/lib/python2.7/dist-packages/eventlet/hubs/hub.py", line 187, in switch\n return self.greenlet.switch()\n', u' File "/usr/local/lib/python2.7/dist-packages/eventlet/greenthread.py", line 194, in main\n result = function(args, *kwargs)\n', u' File "/opt/stack/nova/nova/compute/manager.py", line 1256, in _allocate_network_async\n dhcp_options=dhcp_options)\n', u' File "/opt/stack/nova/nova/network/api.py", line 94, in wrapped\n return func(self, context, args, *kwargs)\n', u' File "/opt/stack/nova/nova/network/api.py", line 48, in wrapper\n res = f(self, context, args, *kwargs)\n', u' File "/opt/stack/nova/nova/network/api.py", line 302, in allocate_for_instance\n nw_info = self.network_rpcapi.allocate_for_instance(context, **args)\n', u' File "/opt/stack/nova/nova/network/rpcapi.py", line ... (more)

edit retag flag offensive close merge delete

4 answers

Sort by ยป oldest newest most voted
0

answered 2014-02-24 15:46:38 -0500

vahidhashemian gravatar image

Hi Liang Chen,

No problem. I appreciate the time you spent on this.

edit flag offensive delete link more
0

answered 2014-02-21 02:02:27 -0500

hs-chen gravatar image

hi,Vahid Hashemian The node host physical disk space is greater than database.In your db of vm instance table disk_available_least 18G free_disk_gb 8G disk_available_least is a value calculated from the local_gb and the virtual size of all images. free_disk_gb is a value calculated from the local_gb and the real size of all images, disk_available_least must less than free_disk_gb. There is a periodic task that records the resources in the DB.

Please delete all of your instance or modify db directly.

edit flag offensive delete link more
0

answered 2014-02-21 18:15:38 -0500

vahidhashemian gravatar image

Hi Liang Chen,

Thank you for your response. I removed all the errored instances and in the database table "compute_nodes" I see these values: - vcpus: 8 - memory_mb: 12017 - local_gb: 34 - vcpus_used: 0 - memory_mb_used: 512 - local_gb_used: 0 - disk available_least: 18 - free_ram_mb: 11505 - free_disk_gb: 34

This tells me from resources point of view things are looking good. But still launching instances fails with the same error above. I don't see the warning about disk. So the issue is not directly related to resource numbers in the database.

Can you think of anything else causing the main error message above?

Thanks again.

edit flag offensive delete link more
0

answered 2014-02-24 06:28:43 -0500

hs-chen gravatar image

Hi,Vahid Hashemian I'm very sorry i'm not see the error carefully in your logs.I have never found this problem(OSError in amqpdriver.py) on my multiple environments. I tried to reproduce your problem, but unfortunately, did not find anything.

I hope someone else will pay attention and solve it. Good luck.

edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

Stats

Asked: 2014-02-20 19:12:34 -0500

Seen: 201 times

Last updated: Feb 24 '14