Revision history [back]

click to hide/show revision 1
initial version

NeutronClientException when booting instances

I get errors when trying to create/boot instances. The instance goes into an ERROR state. If I log in to the hypervisor where the instance is trying to be created and look at the /var/log/nova/nova-compute.log log file, I see the trace that is attached below.

The main issue seems to come from a problem with Neutron, see NeutronClientException: 404 Not Found in the trace below.

I'm trying to figure out the best steps to debug this further. Please answer if you have any idea. More information can also be provided.

2013-12-09 15:22:56.745 31508 AUDIT nova.compute.manager [req-60c35c7a-dc7a-43ce-86a2-4948d8aaf304 ea08504867304a46a54adff2a5687128 1a470b4681b74b0182601efc257175ac] [instance: 4b585137-aa20-43f4-802d-d3a12013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2063, in spawn
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     admin_pass=admin_password)
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2441, in _create_image
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     net = netutils.get_injected_network_template(network_info)
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/nova/virt/netutils.py", line 74, in get_injected_network_template
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     if not (network_info and template):
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/nova/network/model.py", line 379, in __len__
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     return self._sync_wrapper(fn, *args, **kwargs)
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/nova/network/model.py", line 366, in _sync_wrapper
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     self.wait()
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/nova/network/model.py", line 398, in wait
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     self[:] = self._gt.wait()
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 168, in wait
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     return self._exit_event.wait()
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/eventlet/event.py", line 120, in wait
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     current.throw(*self._exc)
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 194, in main
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     result = function(*args, **kwargs)
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1228, in _allocate_network_async
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     dhcp_options=dhcp_options)
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 49, in wrapper
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     res = f(self, context, *args, **kwargs)
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/nova/network/neutronv2/api.py", line 276, in allocate_for_instance
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     **search_opts).get('security_groups')
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 108, in with_params
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     ret = self.function(instance, *args, **kwargs)
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 466, in list_security_groups
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     retrieve_all, **_params)
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1197, in list
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     for r in self._pagination(collection, path, **params):
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1210, in _pagination
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     res = self.get(path, params=params)
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1183, in get
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     headers=headers, params=params)
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1168, in retry_request
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     headers=headers, params=params)
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1111, in do_request
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     self._handle_fault_response(status_code, replybody)
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1081, in _handle_fault_response
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     exception_handler_v20(status_code, des_error_body)
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 88, in exception_handler_v20
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     message=message)
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba] NeutronClientException: 404 Not Found
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba] 
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba] The resource could not be found.
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba] 
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]    
2013-12-09 15:23:00.787 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba] 
2013-12-09 15:23:01.181 31508 AUDIT nova.compute.manager [req-60c35c7a-dc7a-43ce-86a2-4948d8aaf304 ea08504867304a46a54adff2a5687128 1a470b4681b74b0182601efc257175ac] [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba] Terminating instance
2013-12-09 15:23:03.235 31508 ERROR nova.virt.libvirt.driver [-] [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba] During wait destroy, instance disappeared.
2013-12-09 15:23:03.596 31508 INFO nova.virt.libvirt.driver [req-60c35c7a-dc7a-43ce-86a2-4948d8aaf304 ea08504867304a46a54adff2a5687128 1a470b4681b74b0182601efc257175ac] [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba] Deleting instance files /var/lib/nova/instances/4b585137-aa20-43f4-802d-d3a1f8ca2dba
2013-12-09 15:23:03.597 31508 INFO nova.virt.libvirt.driver [req-60c35c7a-dc7a-43ce-86a2-4948d8aaf304 ea08504867304a46a54adff2a5687128 1a470b4681b74b0182601efc257175ac] [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba] Deletion of /var/lib/nova/instances/4b585137-aa20-43f4-802d-d3a1f8ca2dba complete
2013-12-09 15:23:04.810 31508 ERROR nova.compute.manager [req-60c35c7a-dc7a-43ce-86a2-4948d8aaf304 ea08504867304a46a54adff2a5687128 1a470b4681b74b0182601efc257175ac] [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba] Error: 404 Not Found

The resource could not be found.


2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba] Traceback (most recent call last):
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1037, in _build_instance
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     set_access_ip=set_access_ip)
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1410, in _spawn
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     LOG.exception(_('Instance failed to spawn'), instance=instance)
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1407, in _spawn
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     block_device_info)
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2063, in spawn
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     admin_pass=admin_password)
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2441, in _create_image
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     net = netutils.get_injected_network_template(network_info)
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/nova/virt/netutils.py", line 74, in get_injected_network_template
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     if not (network_info and template):
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/nova/network/model.py", line 379, in __len__
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     return self._sync_wrapper(fn, *args, **kwargs)
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/nova/network/model.py", line 366, in _sync_wrapper
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     self.wait()
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/nova/network/model.py", line 398, in wait
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     self[:] = self._gt.wait()
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 168, in wait
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     return self._exit_event.wait()
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/eventlet/event.py", line 120, in wait
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     current.throw(*self._exc)
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 194, in main
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     result = function(*args, **kwargs)
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1228, in _allocate_network_async
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     dhcp_options=dhcp_options)
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 49, in wrapper
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     res = f(self, context, *args, **kwargs)
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/nova/network/neutronv2/api.py", line 276, in allocate_for_instance
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     **search_opts).get('security_groups')
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 108, in with_params
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     ret = self.function(instance, *args, **kwargs)
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 466, in list_security_groups
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     retrieve_all, **_params)
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1197, in list
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     for r in self._pagination(collection, path, **params):
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1210, in _pagination
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     res = self.get(path, params=params)
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1183, in get
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     headers=headers, params=params)
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1168, in retry_request
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     headers=headers, params=params)
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1111, in do_request
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     self._handle_fault_response(status_code, replybody)
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1081, in _handle_fault_response
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     exception_handler_v20(status_code, des_error_body)
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]   File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 88, in exception_handler_v20
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]     message=message)
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba] NeutronClientException: 404 Not Found
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba] 
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba] The resource could not be found.
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba] 
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]    
2013-12-09 15:23:04.810 31508 TRACE nova.compute.manager [instance: 4b585137-aa20-43f4-802d-d3a1f8ca2dba]