Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

My cinder config file and part of logs

node1 config file: cinder-api cinder-scheduler cinder-volume are running with same config file cinder.conf [DEFAULT] logdir = /var/log/cinder state_path = /var/lib/cinder lock_path = /var/lib/cinder/tmp gpfs_volumes_dir = /gpfs/volumes/volumes/node1 iscsi_helper = tgtadm sql_connection = mysql://cinder:cinder@192.168.0.201/cinder rpc_backend = cinder.openstack.common.rpc.impl_qpid rootwrap_config = /etc/cinder/rootwrap.conf auth_uri = http://192.168.0.201:5000 auth_strategy = keystone qpid_hostname = localhost api_paste_config = /etc/cinder/api-paste.ini volume_name_template = volume-%s volume_group = cinder-volumes verbose = True debug = True volume_driver = cinder.volume.drivers.gpfs.GpfsDriver scheduler_default_filters = RetryFilter,AvailabilityZoneFilter,CapabilitiesFilter storage_availability_zone = test:dev188

[keystone_authtoken] admin_tenant_name = service admin_user = cinder admin_password = cinder auth_host = 192.168.0.201 auth_port = 35357 auth_protocol = http signing_dirname = /tmp/keystone-signing-cinder

================================================================ dev202 : cinder-volume run on it cinder.conf

[DEFAULT] logdir = /var/log/cinder state_path = /var/lib/cinder lock_path = /var/lib/cinder/tmp gpfs_volumes_dir = /gpfs/volumes/volumes/dev202 iscsi_helper = tgtadm sql_connection = mysql://cinder:cinder@192.168.0.201/cinder rpc_backend = cinder.openstack.common.rpc.impl_qpid rootwrap_config = /etc/cinder/rootwrap.conf auth_uri = http://192.168.0.201:5000 auth_strategy = keystone qpid_hostname = 192.168.0.201 api_paste_config = /etc/cinder/api-paste.ini volume_name_template = volume-%s volume_group = cinder-volumes verbose = True debug = True volume_driver = cinder.volume.drivers.gpfs.GpfsDriver scheduler_default_filters = RetryFilter,AvailabilityZoneFilter,CapabilitiesFilter storage_availability_zone = test:dev202

[keystone_authtoken] admin_tenant_name = service admin_user = cinder admin_password = cinder auth_host = 192.168.0.201 auth_port = 35357 auth_protocol = http

====================================================================

node1 : kill -9 cinder-volume /var/log/cinder/volume.log

2013-05-23 21:39:57 INFO [cinder.service] Caught SIGTERM, stopping children 2013-05-23 21:39:57 INFO [cinder.service] Waiting on 1 children to exit 2013-05-23 21:39:57 INFO [cinder.service] Caught SIGTERM, exiting 2013-05-23 21:39:57 DEBUG [qpid.messaging.io.ops] SENT[2638c68]: MessageCancel(destination='0', id=serial(25)) 2013-05-23 21:39:57 DEBUG [qpid.messaging.io.ops] SENT[2638c68]: QueueDelete(queue='cinder-volume', id=serial(26), sync=True) 2013-05-23 21:39:57 DEBUG [qpid.messaging.io.ops] SENT[2638c68]: ConnectionClose(reply_code=200) 2013-05-23 21:39:57 DEBUG [qpid.messaging.io.raw] SENT[2638c68]: '\x0f\x01\x00\x14\x00\x01\x00\x00\x00\x00\x00\x00\x04\x08\x01\x00\x01\x00\x010\x0f\x01\x00 \x00\x01\x00\x00\x00\x00\x00\x00\x08\x02\x01\x01\x01\x00\rcinder-volume\x0f\x00\x00\x12\x00\x00\x00\x00\x00\x00\x00\x00\x01\x0b\x01\x00\x00\xc8' 2013-05-23 21:39:57 DEBUG [qpid.messaging.io.raw] READ[2638c68]: '\x0f\x00\x00\x1a\x00\x00\x00\x00\x00\x00\x00\x00\x02\n\x01\x00\x00\x08\x00\x00\x00\x00\x00\x00\x00\x1a\x0f\x00\x00\x10\x00\x00\x00\x00\x00\x00\x00\x00\x01\x0c\x00\x00' 2013-05-23 21:39:57 DEBUG [qpid.messaging.io.ops] RCVD[2638c68]: SessionCompleted(commands=[0-26]) 2013-05-23 21:39:57 DEBUG [qpid.messaging.io.ops] RCVD[2638c68]: ConnectionCloseOk() 2013-05-23 21:39:57 INFO [cinder.service] Child 332 exited with status 1

============================================================= scheduler.log after node1 kill cinder-volume

2013-05-23 22:29:36 DEBUG [qpid.messaging] RCVD[3dff8c0]: Message({u'_context_roles': [u'admin'], u'_context_request_id': u'req-23a28132-0658-4392-a0fe-128beb54f0da', u'_context_quota_class': None, u'_context_auth_token': None, u'args': {u'service_name': u'volume', u'host': u'dev202', u'capabilities': {u'QoS_support': False, u'volume_backend_name': u'GPFS', u'free_capacity_gb': 45.0, u'driver_version': u'1.0', u'total_capacity_gb': 50.0, u'reserved_percentage': 0, u'vendor_name': u'IBM', u'storage_protocol': u'file'}}, u'_context_tenant': None, u'_unique_id': u'a6ac60baf6394f649950b5c23cf657de', u'_context_timestamp': u'2013-05-24T03:29:33.537222', u'_context_is_admin': True, u'version': u'1.0', u'_context_project_id': None, u'_context_user': None, u'_context_read_deleted': u'no', u'_context_user_id': None, u'method': u'update_service_capabilities', u'_context_remote_address': None}) 2013-05-23 22:29:36 DEBUG [qpid.messaging.io.ops] SENT[3df9758]: ConnectionHeartbeat() 2013-05-23 22:29:36 DEBUG [qpid.messaging] RETR[3dff8c0]: Message({u'_context_roles': [u'admin'], u'_context_request_id': u'req-23a28132-0658-4392-a0fe-128beb54f0da', u'_context_quota_class': None, u'_context_auth_token': None, u'args': {u'service_name': u'volume', u'host': u'dev202', u'capabilities': {u'QoS_support': False, u'volume_backend_name': u'GPFS', u'free_capacity_gb': 45.0, u'driver_version': u'1.0', u'total_capacity_gb': 50.0, u'reserved_percentage': 0, u'vendor_name': u'IBM', u'storage_protocol': u'file'}}, u'_context_tenant': None, u'_unique_id': u'a6ac60baf6394f649950b5c23cf657de', u'_context_timestamp': u'2013-05-24T03:29:33.537222', u'_context_is_admin': True, u'version': u'1.0', u'_context_project_id': None, u'_context_user': None, u'_context_read_deleted': u'no', u'_context_user_id': None, u'method': u'update_service_capabilities', u'_context_remote_address': None}) 2013-05-23 22:29:36 DEBUG [qpid.messaging.io.ops] SENT[3df9758]: MessageFlow(destination='2', unit=0, value=1L, id=serial(120)) 2013-05-23 22:29:36 DEBUG [cinder.openstack.common.rpc.amqp] received {u'_context_roles': [u'admin'], u'_context_request_id': u'req-23a28132-0658-4392-a0fe-128beb54f0da', u'_context_quota_class': None, u'_unique_id': u'a6ac60baf6394f649950b5c23cf657de', u'_context_read_deleted': u'no', u'args': {u'service_name': u'volume', u'host': u'dev202', u'capabilities': {u'QoS_support': False, u'volume_backend_name': u'GPFS', u'free_capacity_gb': 45.0, u'driver_version': u'1.0', u'total_capacity_gb': 50.0, u'reserved_percentage': 0, u'vendor_name': u'IBM', u'storage_protocol': u'file'}}, u'_context_tenant': None, u'_context_auth_token': '<sanitized>', u'_context_is_admin': True, u'version': u'1.0', u'_context_project_id': None, u'_context_timestamp': u'2013-05-24T03:29:33.537222', u'_context_user': None, u'_context_user_id': None, u'method': u'update_service_capabilities', u'_context_remote_address': None} 2013-05-23 22:29:36 DEBUG [cinder.openstack.common.rpc.amqp] unpacked context: {'user_id': None, 'roles': [u'admin'], 'timestamp': u'2013-05-24T03:29:33.537222', 'auth_token': '<sanitized>', 'remote_address': None, 'quota_class': None, 'is_admin': True, 'user': None, 'request_id': u'req-23a28132-0658-4392-a0fe-128beb54f0da', 'project_id': None, 'read_deleted': u'no', 'tenant': None} 2013-05-23 22:29:36 DEBUG [qpid.messaging.io.ops] SENT[3df9758]: SessionCompleted(commands=[0-102]) 2013-05-23 22:29:36 DEBUG [qpid.messaging.io.raw] SENT[3df9758]: '\x0f\x00\x00\x10\x00\x00\x00\x00\x00\x00\x00\x00\x01\n\x00\x00\x0f\x01\x00\x19\x00\x01\x00\x00\x00\x00\x00\x00\x04\n\x01\x00\x07\x00\x012\x00\x00\x00\x00\x01\x0f\x00\x00\x1a\x00\x00\x00\x00\x00\x00\x00\x00\x02\n\x01\x00\x00\x08\x00\x00\x00\x00\x00\x00\x00f' 2013-05-23 22:29:36 DEBUG [cinder.scheduler.host_manager] Received volume service update from dev202.