Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

Openstack liberty Testlab(Under VirtualBox) fail to launch instance...

Hi !!!

I have a trouble with my openstack installation. When i try to launch i received a error and it isn`t works...

I think its a network problem but im not sure...

I try to deploy a openstack configuration with 4 nodes under VirtualBox Vm's with a Controller Node, Storage Node (Switch & Cinder), Compute Node and Network Node.

The comunication between host's (almost ping) its ok and all services in Controller Node works; keystone,nova, neutron, glance, cinder and swift are listenning and in verifyng commands execution reflects the other nodes services properly...

I want to deploy network configuration with 'gre' and 'ovs' over a NAT interface in my VirtualBox Network Node but im not sure that its working ok.

The Network Node has three interfaces; Management, Tunnel Network and External Network (In NAT mode) and my etc/network/interfaces look like this:

This file describes the network interfaces available on your system
and how to activate them. For more information, see interfaces(5).

The loopback network interface
auto lo
iface lo inet loopback

The primary network interface
auto eth0
iface eth0 inet static
address 172.22.6.98
netmask 255.255.255.0

The Tunnel network interface
auto eth1
iface eth1 inet static
address 10.0.0.1
netmask 255.255.255.0

The External network interface
auto eth2
iface eth2 inet manual
up ifconfig $IFACE up
up ip link set $IFACE promisc on
down ip link set $IFACE promisc off
down ifconfig $IFACE down

auto br-ex
iface br-ex inet static
address 10.0.5.15
netmask 255.255.255.0
gateway 10.0.5.2
dns-nameservers 8.8.8.8

Route Table:

Destino         Pasarela        Genmask         Indic M├ętric Ref    Uso Interfaz
0.0.0.0         10.0.5.2        0.0.0.0         UG    0      0        0 br-ex
10.0.0.0        0.0.0.0         255.255.255.0   U     0      0        0 eth1
10.0.5.0        0.0.0.0         255.255.255.0   U     0      0        0 br-ex
172.22.6.0      0.0.0.0         255.255.255.0   U     0      0        0 eth0

ovs-vsctl show

846c5e57-f645-483d-b738-41d58ee23ff7
    Bridge br-ex
        Port phy-br-ex
            Interface phy-br-ex
                type: patch
                options: {peer=int-br-ex}
        Port br-ex
            Interface br-ex
                type: internal
        Port "eth2"
            Interface "eth2"
        Port "qg-d53d23d4-5f"
            Interface "qg-d53d23d4-5f"
                type: internal
    Bridge br-int
        fail_mode: secure
        Port int-br-ex
            Interface int-br-ex
                type: patch
                options: {peer=phy-br-ex}
        Port br-int
            Interface br-int
                type: internal
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
        Port "tap9dc4dfca-7f"
            tag: 1
            Interface "tap9dc4dfca-7f"
                type: internal
        Port "qr-465c978f-4b"
            tag: 1
            Interface "qr-465c978f-4b"
                type: internal
    Bridge br-tun
        fail_mode: secure
        Port br-tun
            Interface br-tun
                type: internal
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port "gre-0a000005"
            Interface "gre-0a000005"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="10.0.0.1", out_key=flow, remote_ip="10.0.0.5"}
    ovs_version: "2.4.0"

I could reach without problem to the internet and to the others nodes...

I have two Neutron networks, the first (ext-net) to reach external network and the second for my project/tenant (cloud-network):

root@OSControllerNode:/var/log/nova# neutron net-list
+--------------------------------------+---------------+-----------------------------------------------------+
| id                                   | name          | subnets                                             |
+--------------------------------------+---------------+-----------------------------------------------------+
 1d58d9f3-e820-4dc9-b762-532d01d1e0e2 | cloud-network | ac7caad1-19cb-4797-b956-f6ecbc31ce63 192.168.5.0/24 

 313dd1ed-0c1f-4595-8f22-272b8d8b8bd7 | ext-net       | fe377c05-eee8-4b60-8fdb-24e3e67e7a1d 10.0.5.0/24    |
+--------------------------------------+---------------+-----------------------------------------------------++--------------------------

root@OSControllerNode:/var/log/nova# neutron subnet-list
------------+--------------+----------------+--------------------------------------------------+
| id                                   | name         | cidr           | allocation_pools                                 |
+--------------------------------------+--------------+----------------+--------------------------------------------------+
| ac7caad1-19cb-4797-b956-f6ecbc31ce63 | cloud-subnet | 192.168.5.0/24 | {"start": "192.168.5.2", "end": "192.168.5.254"} |
| fe377c05-eee8-4b60-8fdb-24e3e67e7a1d | ext-subnet   | 10.0.5.0/24    | {"start": "10.0.5.150", "end": "10.0.5.200"}     |
+--------------------------------------+--------------+----------------+--------------------------------------------------+

But when i want to launch a instance it fails, and my nova-compute.log reflect this log..

2016-02-17 13:58:50.917 9136 INFO nova.compute.manager [req-70037378-e7fe-4a5b-879e-147b5f2a3ada 0b31a8f3a9bd411694d98632cf98ca4c 182137b70dec4694af9d078d06d94963 - - -] [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] Starting instance$
2016-02-17 13:58:51.079 9136 INFO nova.compute.claims [req-70037378-e7fe-4a5b-879e-147b5f2a3ada 0b31a8f3a9bd411694d98632cf98ca4c 182137b70dec4694af9d078d06d94963 - - -] [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] Attempting claim: $
2016-02-17 13:58:51.080 9136 INFO nova.compute.claims [req-70037378-e7fe-4a5b-879e-147b5f2a3ada 0b31a8f3a9bd411694d98632cf98ca4c 182137b70dec4694af9d078d06d94963 - - -] [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] Total memory: 3948$
2016-02-17 13:58:51.080 9136 INFO nova.compute.claims [req-70037378-e7fe-4a5b-879e-147b5f2a3ada 0b31a8f3a9bd411694d98632cf98ca4c 182137b70dec4694af9d078d06d94963 - - -] [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] memory limit: 5922$
2016-02-17 13:58:51.081 9136 INFO nova.compute.claims [req-70037378-e7fe-4a5b-879e-147b5f2a3ada 0b31a8f3a9bd411694d98632cf98ca4c 182137b70dec4694af9d078d06d94963 - - -] [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] Total disk: 143 GB$
2016-02-17 13:58:51.081 9136 INFO nova.compute.claims [req-70037378-e7fe-4a5b-879e-147b5f2a3ada 0b31a8f3a9bd411694d98632cf98ca4c 182137b70dec4694af9d078d06d94963 - - -] [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] disk limit: 143.00$
2016-02-17 13:58:51.107 9136 INFO nova.compute.claims [req-70037378-e7fe-4a5b-879e-147b5f2a3ada 0b31a8f3a9bd411694d98632cf98ca4c 182137b70dec4694af9d078d06d94963 - - -] [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] Claim successful
2016-02-17 13:58:51.856 9136 INFO nova.virt.libvirt.driver [req-70037378-e7fe-4a5b-879e-147b5f2a3ada 0b31a8f3a9bd411694d98632cf98ca4c 182137b70dec4694af9d078d06d94963 - - -] [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] Creating image
2016-02-17 13:59:33.509 9136 INFO nova.compute.resource_tracker [req-278befd8-cd9b-43de-aa74-c4805b80e893 - - - - -] Auditing locally available compute resources for node OSComputeNode
2016-02-17 13:59:33.632 9136 INFO nova.compute.resource_tracker [req-278befd8-cd9b-43de-aa74-c4805b80e893 - - - - -] Total usable vcpus: 2, total allocated vcpus: 0
2016-02-17 13:59:33.632 9136 INFO nova.compute.resource_tracker [req-278befd8-cd9b-43de-aa74-c4805b80e893 - - - - -] Final resource view: name=OSComputeNode phys_ram=3948MB used_ram=1024MB phys_disk=143GB used_disk=1GB total_vcpus=2 use$
2016-02-17 13:59:33.744 9136 INFO nova.compute.resource_tracker [req-278befd8-cd9b-43de-aa74-c4805b80e893 - - - - -] Compute_service record updated for OSComputeNode:OSComputeNode
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager [-] Instance failed network setup after 1 attempt(s)
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager Traceback (most recent call last):
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1564, in _allocate_network_async
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager     dhcp_options=dhcp_options)
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 49, in wrapped
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager     return func(self, context, *args, **kwargs)
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager   File "/usr/lib/python2.7/dist-packages/nova/network/base_api.py", line 77, in wrapper
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager     res = f(self, context, *args, **kwargs)
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 281, in allocate_for_instance
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager     nw_info = self.network_rpcapi.allocate_for_instance(context, **args)
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager   File "/usr/lib/python2.7/dist-packages/nova/network/rpcapi.py", line 155, in allocate_for_instance
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager     macs=jsonutils.to_primitive(macs))
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 158, in call
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager     retry=self.retry)
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager   File "/usr/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 90, in _send
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager     timeout=timeout, retry=retry)
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager   File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 431, in send
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager     retry=retry)
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager   File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 420, in _send
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager     result = self._waiter.wait(msg_id, timeout)
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager   File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 318, in wait
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager     message = self.waiters.get(msg_id, timeout=timeout)
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager   File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 223, in get
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager     'to message ID %s' % msg_id)
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager MessagingTimeout: Timed out waiting for a reply to message ID 8201a374e4774e028a2fe65312e433c6
2016-02-17 13:59:51.664 9136 ERROR nova.compute.manager
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [req-70037378-e7fe-4a5b-879e-147b5f2a3ada 0b31a8f3a9bd411694d98632cf98ca4c 182137b70dec4694af9d078d06d94963 - - -] [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] Instance failed $
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] Traceback (most recent call last):
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2155, in _build_resources
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     yield resources
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2009, in _build_and_run_instance
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     block_device_info=block_device_info)
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2512, in spawn
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     write_to_disk=True)
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 4383, in _get_guest_xml
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     network_info_str = str(network_info)
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/network/model.py", line 515, in __str__
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     return self._sync_wrapper(fn, *args, **kwargs)
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/network/model.py", line 498, in _sync_wrapper
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     self.wait()
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/network/model.py", line 530, in wait
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     self[:] = self._gt.wait()
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 175, in wait
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     return self._exit_event.wait()
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/eventlet/event.py", line 121, in wait
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     return hubs.get_hub().switch()
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/eventlet/hubs/hub.py", line 294, in switch
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     return self.greenlet.switch()
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 214, in main
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     result = function(*args, **kwargs)
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1581, in _allocate_network_async
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     six.reraise(*exc_info)
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1564, in _allocate_network_async
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     dhcp_options=dhcp_options)
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 49, in wrapped
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     return func(self, context, *args, **kwargs)
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/network/base_api.py", line 77, in wrapper
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     res = f(self, context, *args, **kwargs)
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 281, in allocate_for_instance
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     nw_info = self.network_rpcapi.allocate_for_instance(context, **args)
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/network/rpcapi.py", line 155, in allocate_for_instance
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     macs=jsonutils.to_primitive(macs))
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 158, in call
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     retry=self.retry)
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 90, in _send
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     timeout=timeout, retry=retry)
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 431, in send
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     retry=retry)
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 420, in _send
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     result = self._waiter.wait(msg_id, timeout)
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 318, in wait
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     message = self.waiters.get(msg_id, timeout=timeout)
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 223, in get
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     'to message ID %s' % msg_id)
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] MessagingTimeout: Timed out waiting for a reply to message ID 8201a374e4774e028a2fe65312e433c6
2016-02-17 13:59:51.668 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]
2016-02-17 13:59:51.672 9136 INFO nova.compute.manager [req-70037378-e7fe-4a5b-879e-147b5f2a3ada 0b31a8f3a9bd411694d98632cf98ca4c 182137b70dec4694af9d078d06d94963 - - -] [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] Terminating insta$
2016-02-17 13:59:51.677 9136 INFO nova.virt.libvirt.driver [-] [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] During wait destroy, instance disappeared.
2016-02-17 13:59:51.677 9136 INFO nova.virt.libvirt.firewall [req-70037378-e7fe-4a5b-879e-147b5f2a3ada 0b31a8f3a9bd411694d98632cf98ca4c 182137b70dec4694af9d078d06d94963 - - -] [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] Attempted t$
2016-02-17 13:59:51.689 9136 INFO nova.virt.libvirt.driver [req-70037378-e7fe-4a5b-879e-147b5f2a3ada 0b31a8f3a9bd411694d98632cf98ca4c 182137b70dec4694af9d078d06d94963 - - -] [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] Deleting inst$
2016-02-17 13:59:51.690 9136 INFO nova.virt.libvirt.driver [req-70037378-e7fe-4a5b-879e-147b5f2a3ada 0b31a8f3a9bd411694d98632cf98ca4c 182137b70dec4694af9d078d06d94963 - - -] [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] Deletion of /$
2016-02-17 14:00:34.518 9136 INFO nova.compute.resource_tracker [req-278befd8-cd9b-43de-aa74-c4805b80e893 - - - - -] Auditing locally available compute resources for node OSComputeNode
2016-02-17 14:00:34.636 9136 INFO nova.compute.resource_tracker [req-278befd8-cd9b-43de-aa74-c4805b80e893 - - - - -] Total usable vcpus: 2, total allocated vcpus: 0
2016-02-17 14:00:34.636 9136 INFO nova.compute.resource_tracker [req-278befd8-cd9b-43de-aa74-c4805b80e893 - - - - -] Final resource view: name=OSComputeNode phys_ram=3948MB used_ram=1024MB phys_disk=143GB used_disk=1GB total_vcpus=2 use$
2016-02-17 14:00:34.685 9136 INFO nova.compute.resource_tracker [req-278befd8-cd9b-43de-aa74-c4805b80e893 - - - - -] Compute_service record updated for OSComputeNode:OSComputeNode
2016-02-17 14:00:51.848 9136 ERROR nova.compute.manager [req-70037378-e7fe-4a5b-879e-147b5f2a3ada 0b31a8f3a9bd411694d98632cf98ca4c 182137b70dec4694af9d078d06d94963 - - -] [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] Failed to deallo$
2016-02-17 14:00:52.038 9136 ERROR nova.compute.manager [req-70037378-e7fe-4a5b-879e-147b5f2a3ada 0b31a8f3a9bd411694d98632cf98ca4c 182137b70dec4694af9d078d06d94963 - - -] [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] Build of instanc$
2016-02-17 14:00:52.038 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] Traceback (most recent call last):
2016-02-17 14:00:52.038 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1905, in _do_build_and_run_instance
2016-02-17 14:00:52.038 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     filter_properties)
2016-02-17 14:00:52.038 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2025, in _build_and_run_instance
2016-02-17 14:00:52.038 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     'create.error', fault=e)
2016-02-17 14:00:52.038 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 195, in __exit__
2016-02-17 14:00:52.038 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     six.reraise(self.type_, self.value, self.tb)
2016-02-17 14:00:52.038 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2009, in _build_and_run_instance
2016-02-17 14:00:52.038 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     block_device_info=block_device_info)
2016-02-17 14:00:52.038 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/contextlib.py", line 35, in __exit__
2016-02-17 14:00:52.038 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     self.gen.throw(type, value, traceback)
2016-02-17 14:00:52.038 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2179, in _build_resources
2016-02-17 14:00:52.038 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     instance_uuid=instance.uuid, reason=msg)
2016-02-17 14:00:52.038 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] BuildAbortException: Build of instance 9c8a8e65-becd-464d-9a12-92fb46453a00 aborted: Could not clean up failed build, not reschedul$
2016-02-17 14:00:52.038 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [req-70037378-e7fe-4a5b-879e-147b5f2a3ada 0b31a8f3a9bd411694d98632cf98ca4c 182137b70dec4694af9d078d06d94963 - - -] [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] Failed to deallo$
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] Traceback (most recent call last):
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2184, in _cleanup_allocated_networks
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     self._deallocate_network(context, instance, requested_networks)
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1810, in _deallocate_network
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     context, instance, requested_networks=requested_networks)
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 49, in wrapped
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     return func(self, context, *args, **kwargs)
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 297, in deallocate_for_instance
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     requested_networks=requested_networks)
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/network/rpcapi.py", line 175, in deallocate_for_instance
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     return cctxt.call(ctxt, 'deallocate_for_instance', **kwargs)
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 403, in call
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     return self.prepare().call(ctxt, method, **kwargs)
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 158, in call
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     retry=self.retry)
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 90, in _send
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     timeout=timeout, retry=retry)
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 431, in send
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     retry=retry)
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 420, in _send
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     result = self._waiter.wait(msg_id, timeout)
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 318, in wait
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     message = self.waiters.get(msg_id, timeout=timeout)
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 223, in get
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     'to message ID %s' % msg_id)
2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] MessagingTimeout: Timed out waiting for a reply to message ID 621304add66d4af2bc5365222730e5f1

2016-02-17 14:01:52.061 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [req-278befd8-cd9b-43de-aa74-c4805b80e893 - - - - -] [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] An error occurred while refreshing the network cache.
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] Traceback (most recent call last):
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 5553, in _heal_instance_info_cache
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     self.network_api.get_instance_nw_info(context, instance)
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 49, in wrapped
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     return func(self, context, *args, **kwargs)
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 373, in get_instance_nw_info
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     **kwargs)
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/network/base_api.py", line 244, in get_instance_nw_info
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     result = self._get_instance_nw_info(context, instance, **kwargs)
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 382, in _get_instance_nw_info
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     nw_info = self.network_rpcapi.get_instance_nw_info(context, **args)
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/nova/network/rpcapi.py", line 201, in get_instance_nw_info
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     host=host, project_id=project_id)
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 158, in call
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     retry=self.retry)
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 90, in _send
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     timeout=timeout, retry=retry)
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 431, in send
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     retry=retry)
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 420, in _send
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     result = self._waiter.wait(msg_id, timeout)
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 318, in wait
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     message = self.waiters.get(msg_id, timeout=timeout)
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]   File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 223, in get
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]     'to message ID %s' % msg_id)
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00] MessagingTimeout: Timed out waiting for a reply to message ID 6c741ef3e77c4b20bd22944aa1c5341b
2016-02-17 14:02:31.556 9136 ERROR nova.compute.manager [instance: 9c8a8e65-becd-464d-9a12-92fb46453a00]

Whatever you want please ask me; some log, any screenshot, configuration file or ...

I need to find a solution

Regards

Gary