Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

I have found few more logs from the compute node

2016-09-02 06:48:08.027 4418 INFO nova.compute.manager [req-5002d099-1043-4bb1-a7db-7bcd9cade4cf 116af8b9592f48e68b7e992c7784c39c 513056986b69432880c9fa829983b46d - - -] [instance: 92c2fd37-8ea2-46a5-ac4a-bf6b2a82f5e6] instance snapshotting

2016-09-02 06:48:08.952 4418 INFO nova.scheduler.client.report [req-5002d099-1043-4bb1-a7db-7bcd9cade4cf 116af8b9592f48e68b7e992c7784c39c 513056986b69432880c9fa829983b46d - - -] Compute_service record updated for ('dalp-mpaascompute002.imi.local', 'dalp-mpaascompute002.imi.local')

2016-09-02 06:48:08.953 4418 ERROR oslo_messaging.rpc.dispatcher [req-5002d099-1043-4bb1-a7db-7bcd9cade4cf 116af8b9592f48e68b7e992c7784c39c 513056986b69432880c9fa829983b46d - - -] Exception during message handling: id

2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher Traceback (most recent call last): 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher executor_callback)) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher executor_callback) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 130, in _do_dispatch 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher result = func(ctxt, *new_args) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 6933, in snapshot_instance 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher return self.manager.snapshot_instance(ctxt, image_id, instance) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/exception.py", line 88, in wrapped 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher payload) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__ 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/exception.py", line 71, in wrapped 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher return f(self, context, *args, *kw) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 333, in decorated_function 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher LOG.warning(msg, e, instance_uuid=instance_uuid) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__ 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 304, in decorated_function 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher return function(self, context, args, *kwargs) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 361, in decorated_function 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher kwargs['instance'], e, sys.exc_info()) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__ 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 349, in decorated_function 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher return function(self, context, args, *kwargs) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 409, in decorated_function 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher instance=instance) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__ 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 399, in decorated_function 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher args, *kwargs) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 3291, in snapshot_instance 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher task_states.IMAGE_SNAPSHOT) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 3321, in _snapshot_instance 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher update_task_state) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 1332, in snapshot 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher context, self._image_api, base_image_ref, instance) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/utils.py", line 204, in get_image_metadata 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher image = image_api.get(context, image_id_or_uri) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/image/api.py", line 93, in get 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher show_deleted=show_deleted) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/image/glance.py", line 309, in show 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher include_locations=include_locations) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/image/glance.py", line 483, in _translate_from_glance 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher include_locations=include_locations) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/image/glance.py", line 545, in _extract_attributes 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher queued = getattr(image, 'status') == 'queued' 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/glanceclient/openstack/common/apiclient/base.py", line 491, in __getattr__ 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher self.get() 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/glanceclient/openstack/common/apiclient/base.py", line 509, in get 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher new = self.manager.get(self.id) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/glanceclient/openstack/common/apiclient/base.py", line 494, in __getattr__ 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher raise AttributeError(k) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher AttributeError: id 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher 2016-09-02 06:48:13.076 4418 INFO nova.virt.libvirt.imagecache [req-28dd5062-49be-4c08-a8b3-903c401c10d7 - - - - -] image c65c84e1-3e03-472a-8ef5-fb43bb91705a at (/var/lib/nova/instances/_base/5175ffa320e467ec973a26cadcc72bbe36cd1e42): checking 2016-09-02 06:48:13.077 4418 INFO nova.virt.libvirt.imagecache [req-28dd5062-49be-4c08-a8b3-903c401c10d7 - - - - -] image c65c84e1-3e03-472a-8ef5-fb43bb91705a at (/var/lib/nova/instances/_base/5175ffa320e467ec973a26cadcc72bbe36cd1e42): in use: on this node 1 local, 0 on other nodes sharing this instance storage 2016-09-02 06:48:13.177 4418 INFO nova.virt.libvirt.imagecache [req-28dd5062-49be-4c08-a8b3-903c401c10d7 - - - - -] image 9722a9aa-d8c2-4dfa-8e2f-57a5a2124a2d at (/var/lib/nova/instances/_base/16fa1b33ff0ca8ac24ae87dd7417fe02fab23ba7): checking 2016-09-02 06:48:13.178 4418 INFO nova.virt.libvirt.imagecache [req-28dd5062-49be-4c08-a8b3-903c401c10d7 - - - - -] image 9722a9aa-d8c2-4dfa-8e2f-57a5a2124a2d at (/var/lib/nova/instances/_base/16fa1b33ff0ca8ac24ae87dd7417fe02fab23ba7): in use: on this node 1 local, 0 on other nodes sharing this instance storage 2016-09-02 06:48:13.271 4418 INFO nova.virt.libvirt.imagecache [req-28dd5062-49be-4c08-a8b3-903c401c10d7 - - - - -] image b4b5c4f2-83b1-4a87-9eec-f0513dc678b9 at (/var/lib/nova/instances/_base/ee06a476e1a4a4457b6b5cbdbcdf1fe993d5ec52): checking 2016-09-02 06:48:13.272 4418 INFO nova.virt.libvirt.imagecache [req-28dd5062-49be-4c08-a8b3-903c401c10d7 - - - - -] image b4b5c4f2-83b1-4a87-9eec-f0513dc678b9 at (/var/lib/nova/instances/_base/ee06a476e1a4a4457b6b5cbdbcdf1fe993d5ec52): in use: on this node 1 local, 0 on other nodes sharing this instance storage 2016-09-02 06:48:13.366 4418 INFO nova.virt.libvirt.imagecache [req-28dd5062-49be-4c08-a8b3-903c401c10d7 - - - - -] image 469138d2-68fc-4ca5-8950-4359125c884f at (/var/lib/nova/instances/_base/fa7d829a825c0d2d63203ceba23cb3001d1a2341): checking 2016-09-02 06:48:13.367 4418 INFO nova.virt.libvirt.imagecache [req-28dd5062-49be-4c08-a8b3-903c401c10d7 - - - - -] image 469138d2-68fc-4ca5-8950-4359125c884f at (/var/lib/nova/instances/_base/fa7d829a825c0d2d63203ceba23cb3001d1a2341): in use: on this node 1 local, 0 on other nodes sharing this instance storage 2016-09-02 06:48:13.609 4418 WARNING nova.virt.libvirt.imagecache [req-28dd5062-49be-4c08-a8b3-903c401c10d7 - - - - -] Unknown base file: /var/lib/nova/instances/_base/b0d7fe216a3a56677c74cdb6c3677b2c9e7e8744 2016-09-02 06:48:13.610 4418 INFO nova.virt.libvirt.imagecache [req-28dd5062-49be-4c08-a8b3-903c401c10d7 - - - - -] Active base files: /var/lib/nova/instances/_base/5175ffa320e467ec973a26cadcc72bbe36cd1e42 /var/lib/nova/instances/_base/16fa1b33ff0ca8ac24ae87dd7417fe02fab23ba7 /var/lib/nova/instances/_base/ee06a476e1a4a4457b6b5cbdbcdf1fe993d5ec52 /var/lib/nova/instances/_base/fa7d829a825c0d2d63203ceba23cb3001d1a2341

2016-09-02 06:48:13.610 4418 INFO nova.virt.libvirt.imagecache [req-28dd5062-49be-4c08-a8b3-903c401c10d7 - - - - -] Removable base files: /var/lib/nova/instances/_base/b0d7fe216a3a56677c74cdb6c3677b2c9e7e8744 2016-09-02 06:48:13.611 4418 INFO nova.virt.libvirt.imagecache [req-28dd5062-49be-4c08-a8b3-903c401c10d7 - - - - -] Base or swap file too young to remove: /var/lib/nova/instances/_base/b0d7fe216a3a56677c74cdb6c3677b2c9e7e8744

I have found few more logs from the compute node

2016-09-02 06:48:08.027 4418 INFO nova.compute.manager [req-5002d099-1043-4bb1-a7db-7bcd9cade4cf 116af8b9592f48e68b7e992c7784c39c 513056986b69432880c9fa829983b46d - - -] [instance: 92c2fd37-8ea2-46a5-ac4a-bf6b2a82f5e6] instance snapshotting

2016-09-02 06:48:08.952 4418 INFO nova.scheduler.client.report [req-5002d099-1043-4bb1-a7db-7bcd9cade4cf 116af8b9592f48e68b7e992c7784c39c 513056986b69432880c9fa829983b46d - - -] Compute_service record updated for ('dalp-mpaascompute002.imi.local', 'dalp-mpaascompute002.imi.local')

2016-09-02 06:48:08.953 4418 ERROR oslo_messaging.rpc.dispatcher [req-5002d099-1043-4bb1-a7db-7bcd9cade4cf 116af8b9592f48e68b7e992c7784c39c 513056986b69432880c9fa829983b46d - - -] Exception during message handling: id

2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher Traceback (most recent call last): 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher executor_callback)) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher executor_callback) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 130, in _do_dispatch 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher result = func(ctxt, *new_args) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 6933, in snapshot_instance 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher return self.manager.snapshot_instance(ctxt, image_id, instance) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/exception.py", line 88, in wrapped 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher payload) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__ 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/exception.py", line 71, in wrapped 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher return f(self, context, *args, *kw) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 333, in decorated_function 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher LOG.warning(msg, e, instance_uuid=instance_uuid) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__ 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 304, in decorated_function 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher return function(self, context, args, *kwargs) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 361, in decorated_function 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher kwargs['instance'], e, sys.exc_info()) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__ 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 349, in decorated_function 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher return function(self, context, args, *kwargs) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 409, in decorated_function 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher instance=instance) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__ 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 399, in decorated_function 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher args, *kwargs) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 3291, in snapshot_instance 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher task_states.IMAGE_SNAPSHOT) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 3321, in _snapshot_instance 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher update_task_state) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 1332, in snapshot 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher context, self._image_api, base_image_ref, instance) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/utils.py", line 204, in get_image_metadata 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher image = image_api.get(context, image_id_or_uri) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/image/api.py", line 93, in get 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher show_deleted=show_deleted) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/image/glance.py", line 309, in show 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher include_locations=include_locations) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/image/glance.py", line 483, in _translate_from_glance 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher include_locations=include_locations) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/image/glance.py", line 545, in _extract_attributes 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher queued = getattr(image, 'status') == 'queued' 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/glanceclient/openstack/common/apiclient/base.py", line 491, in __getattr__ 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher self.get() 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/glanceclient/openstack/common/apiclient/base.py", line 509, in get 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher new = self.manager.get(self.id) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/glanceclient/openstack/common/apiclient/base.py", line 494, in __getattr__ 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher raise AttributeError(k) 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher AttributeError: id 2016-09-02 06:48:08.953 4418 TRACE oslo_messaging.rpc.dispatcher 2016-09-02 06:48:13.076 4418 INFO nova.virt.libvirt.imagecache [req-28dd5062-49be-4c08-a8b3-903c401c10d7 - - - - -] image c65c84e1-3e03-472a-8ef5-fb43bb91705a at (/var/lib/nova/instances/_base/5175ffa320e467ec973a26cadcc72bbe36cd1e42): checking 2016-09-02 06:48:13.077 4418 INFO nova.virt.libvirt.imagecache [req-28dd5062-49be-4c08-a8b3-903c401c10d7 - - - - -] image c65c84e1-3e03-472a-8ef5-fb43bb91705a at (/var/lib/nova/instances/_base/5175ffa320e467ec973a26cadcc72bbe36cd1e42): in use: on this node 1 local, 0 on other nodes sharing this instance storage 2016-09-02 06:48:13.177 4418 INFO nova.virt.libvirt.imagecache [req-28dd5062-49be-4c08-a8b3-903c401c10d7 - - - - -] image 9722a9aa-d8c2-4dfa-8e2f-57a5a2124a2d at (/var/lib/nova/instances/_base/16fa1b33ff0ca8ac24ae87dd7417fe02fab23ba7): checking 2016-09-02 06:48:13.178 4418 INFO nova.virt.libvirt.imagecache [req-28dd5062-49be-4c08-a8b3-903c401c10d7 - - - - -] image 9722a9aa-d8c2-4dfa-8e2f-57a5a2124a2d at (/var/lib/nova/instances/_base/16fa1b33ff0ca8ac24ae87dd7417fe02fab23ba7): in use: on this node 1 local, 0 on other nodes sharing this instance storage 2016-09-02 06:48:13.271 4418 INFO nova.virt.libvirt.imagecache [req-28dd5062-49be-4c08-a8b3-903c401c10d7 - - - - -] image b4b5c4f2-83b1-4a87-9eec-f0513dc678b9 at (/var/lib/nova/instances/_base/ee06a476e1a4a4457b6b5cbdbcdf1fe993d5ec52): checking 2016-09-02 06:48:13.272 4418 INFO nova.virt.libvirt.imagecache [req-28dd5062-49be-4c08-a8b3-903c401c10d7 - - - - -] image b4b5c4f2-83b1-4a87-9eec-f0513dc678b9 at (/var/lib/nova/instances/_base/ee06a476e1a4a4457b6b5cbdbcdf1fe993d5ec52): in use: on this node 1 local, 0 on other nodes sharing this instance storage 2016-09-02 06:48:13.366 4418 INFO nova.virt.libvirt.imagecache [req-28dd5062-49be-4c08-a8b3-903c401c10d7 - - - - -] image 469138d2-68fc-4ca5-8950-4359125c884f at (/var/lib/nova/instances/_base/fa7d829a825c0d2d63203ceba23cb3001d1a2341): checking 2016-09-02 06:48:13.367 4418 INFO nova.virt.libvirt.imagecache [req-28dd5062-49be-4c08-a8b3-903c401c10d7 - - - - -] image 469138d2-68fc-4ca5-8950-4359125c884f at (/var/lib/nova/instances/_base/fa7d829a825c0d2d63203ceba23cb3001d1a2341): in use: on this node 1 local, 0 on other nodes sharing this instance storage 2016-09-02 06:48:13.609 4418 WARNING nova.virt.libvirt.imagecache [req-28dd5062-49be-4c08-a8b3-903c401c10d7 - - - - -] Unknown base file: /var/lib/nova/instances/_base/b0d7fe216a3a56677c74cdb6c3677b2c9e7e8744 2016-09-02 06:48:13.610 4418 INFO nova.virt.libvirt.imagecache [req-28dd5062-49be-4c08-a8b3-903c401c10d7 - - - - -] Active base files: /var/lib/nova/instances/_base/5175ffa320e467ec973a26cadcc72bbe36cd1e42 /var/lib/nova/instances/_base/16fa1b33ff0ca8ac24ae87dd7417fe02fab23ba7 /var/lib/nova/instances/_base/ee06a476e1a4a4457b6b5cbdbcdf1fe993d5ec52 /var/lib/nova/instances/_base/fa7d829a825c0d2d63203ceba23cb3001d1a2341

2016-09-02 06:48:13.610 4418 INFO nova.virt.libvirt.imagecache [req-28dd5062-49be-4c08-a8b3-903c401c10d7 - - - - -] Removable base files: /var/lib/nova/instances/_base/b0d7fe216a3a56677c74cdb6c3677b2c9e7e8744 2016-09-02 06:48:13.611 4418 INFO nova.virt.libvirt.imagecache [req-28dd5062-49be-4c08-a8b3-903c401c10d7 - - - - -] Base or swap file too young to remove: /var/lib/nova/instances/_base/b0d7fe216a3a56677c74cdb6c3677b2c9e7e8744

==================================================== Finally issue resolved issue once after downgrading the "python-urllib3" package and its dependency "python-requests"

python-urllib3 was in python-urllib3-1.15 i have downgraded to

python-requests-2.7.0-6.el7.noarch python-urllib3-1.10.4-1.20150503gita91975b.el7.noarc

Then all started working