Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

cinder-volume is down

Hello everybody. I'm following the newton documentation with 3 nodes. Currently I have compute, controller and storage nodes up and running on Ubuntu 16.04. But for some reason I can't get storage node up, it's showing down from the controller node. Below is my configuration:

From controller node:

root@chi2-lab-hv-04:~/OpenStack# openstack volume service list +------------------+--------------------+------+---------+-------+----------------------------+ | Binary | Host | Zone | Status | State | Updated At | +------------------+--------------------+------+---------+-------+----------------------------+ | cinder-volume | chi2-lab-hv-02@lvm | nova | enabled | down | 2016-11-17T19:10:11.000000 | | cinder-scheduler | chi2-lab-hv-04 | nova | enabled | up | 2016-11-23T02:25:29.000000 | +------------------+--------------------+------+---------+-------+----------------------------+

[DEFAULT] rootwrap_config = /etc/cinder/rootwrap.conf api_paste_confg = /etc/cinder/api-paste.ini iscsi_helper = tgtadm volume_name_template = volume-%s volume_group = cinder-volumes verbose = True auth_strategy = keystone state_path = /var/lib/cinder lock_path = /var/lock/cinder volumes_dir = /var/lib/cinder/volumes transport_url = rabbit://openstack:password@controller my_ip = 10.144.220.251

[database] connection = mysql+pymysql://cinder:password@controller/cinder

[keystone_authtoken] auth_uri = http://controller:5000 auth_url = http://controller:35357 memcached_servers = controller:11211 auth_type = password project_domain_name = default user_domain_name = default project_name = service username = cinder password = password

[oslo_concurrency] lock_path = /var/lib/cinder/tmp

From storage node:

[DEFAULT] rootwrap_config = /etc/cinder/rootwrap.conf api_paste_confg = /etc/cinder/api-paste.ini iscsi_helper = tgtadm volume_name_template = volume-%s volume_group = cinder-volumes verbose = True auth_strategy = keystone state_path = /var/lib/cinder

lock_path = /var/lock/cinder

volumes_dir = /var/lib/cinder/volumes transport_url = rabbit://openstack:password@controller auth_strategy = keystone my_ip = 10.144.220.253 enabled_backends = lvm glance_api_servers = http://controller:9292

[database] connection = mysql+pymysql://cinder:password@controller/cinder

[keystone_authtoken] auth_uri = http://controller:5000 auth_url = http://controller:35357 memcached_servers = controller:11211 auth_type = password project_domain_name = default user_domain_name = default project_name = service username = cinder password = password

[lvm] volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver volume_group = cinder-volumes iscsi_protocol = iscsi iscsi_helper = tgtadm

[oslo_concurrency] lock_path = /var/lib/cinder/tmp

Error message log from storage node:

2016-11-22 20:35:55.609 32421 INFO cinder.rpc [req-95c25581-020a-439e-b339-109eaf7caff4 - - - - -] Automatically selected cinder-scheduler objects version 1.11 as minimum service version. 2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume [req-95c25581-020a-439e-b339-109eaf7caff4 - - - - -] Volume service chi2-lab-hv-02@lvm failed to start. 2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume Traceback (most recent call last): 2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/cinder/cmd/volume.py", line 81, in main 2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume binary='cinder-volume') 2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/cinder/service.py", line 268, in create 2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume service_name=service_name) 2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/cinder/service.py", line 150, in __init__ 2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume args, *kwargs) 2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 235, in __init__ 2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume args, *kwargs) 2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/cinder/manager.py", line 156, in __init__ 2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume self.scheduler_rpcapi = scheduler_rpcapi.SchedulerAPI() 2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/cinder/rpc.py", line 188, in __init__ 2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume serializer = base.CinderObjectSerializer(obj_version_cap) 2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/cinder/objects/base.py", line 412, in __init__ 2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume raise exception.CappedVersionUnknown(version=version_cap) 2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume CappedVersionUnknown: Unrecoverable Error: Versioned Objects in DB are capped to unknown version 1.11. 2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume 2016-11-22 20:35:55.614 32421 ERROR cinder.cmd.volume [req-95c25581-020a-439e-b339-109eaf7caff4 - - - - -] No volume service(s) started successfully, terminating.

Thank you,

Regards.

cinder-volume is down

Hello everybody. I'm following the newton documentation with 3 nodes. Currently I have compute, controller and storage nodes up and running on Ubuntu 16.04. But for some reason I can't get storage node up, it's showing down from the controller node. Below is my configuration:

From controller node:

root@chi2-lab-hv-04:~/OpenStack# openstack volume service list
+------------------+--------------------+------+---------+-------+----------------------------+
| Binary           | Host               | Zone | Status  | State | Updated At                 |
+------------------+--------------------+------+---------+-------+----------------------------+
| cinder-volume    | chi2-lab-hv-02@lvm | nova | enabled | down  | 2016-11-17T19:10:11.000000 |
| cinder-scheduler | chi2-lab-hv-04     | nova | enabled | up    | 2016-11-23T02:25:29.000000 |
+------------------+--------------------+------+---------+-------+----------------------------+

+------------------+--------------------+------+---------+-------+----------------------------+ [DEFAULT] rootwrap_config = /etc/cinder/rootwrap.conf api_paste_confg = /etc/cinder/api-paste.ini iscsi_helper = tgtadm volume_name_template = volume-%s volume_group = cinder-volumes verbose = True auth_strategy = keystone state_path = /var/lib/cinder lock_path = /var/lock/cinder volumes_dir = /var/lib/cinder/volumes transport_url = rabbit://openstack:password@controller my_ip = 10.144.220.251

10.144.220.251 [database] connection = mysql+pymysql://cinder:password@controller/cinder

mysql+pymysql://cinder:password@controller/cinder [keystone_authtoken] auth_uri = http://controller:5000 auth_url = http://controller:35357 memcached_servers = controller:11211 auth_type = password project_domain_name = default user_domain_name = default project_name = service username = cinder password = password

password [oslo_concurrency] lock_path = /var/lib/cinder/tmp

/var/lib/cinder/tmp

From storage node:

[DEFAULT]
rootwrap_config = /etc/cinder/rootwrap.conf
api_paste_confg = /etc/cinder/api-paste.ini
iscsi_helper = tgtadm
volume_name_template = volume-%s
volume_group = cinder-volumes
verbose = True
auth_strategy = keystone
state_path = /var/lib/cinder

lock_path = /var/lock/cinder

/var/lib/cinder #lock_path = /var/lock/cinder volumes_dir = /var/lib/cinder/volumes transport_url = rabbit://openstack:password@controller auth_strategy = keystone my_ip = 10.144.220.253 enabled_backends = lvm glance_api_servers = http://controller:9292

http://controller:9292 [database] connection = mysql+pymysql://cinder:password@controller/cinder

mysql+pymysql://cinder:password@controller/cinder [keystone_authtoken] auth_uri = http://controller:5000 auth_url = http://controller:35357 memcached_servers = controller:11211 auth_type = password project_domain_name = default user_domain_name = default project_name = service username = cinder password = password

password [lvm] volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver volume_group = cinder-volumes iscsi_protocol = iscsi iscsi_helper = tgtadm

tgtadm [oslo_concurrency] lock_path = /var/lib/cinder/tmp

/var/lib/cinder/tmp

Error message log from storage node:

2016-11-22 20:35:55.609 32421 INFO cinder.rpc [req-95c25581-020a-439e-b339-109eaf7caff4 - - - - -] Automatically selected cinder-scheduler objects version 1.11 as minimum service version.
2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume [req-95c25581-020a-439e-b339-109eaf7caff4 - - - - -] Volume service chi2-lab-hv-02@lvm failed to start.
2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume Traceback (most recent call last):
2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume   File "/usr/lib/python2.7/dist-packages/cinder/cmd/volume.py", line 81, in main
2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume     binary='cinder-volume')
2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume   File "/usr/lib/python2.7/dist-packages/cinder/service.py", line 268, in create
2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume     service_name=service_name)
2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume   File "/usr/lib/python2.7/dist-packages/cinder/service.py", line 150, in __init__
2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume     args, *kwargs)
*args, **kwargs)
2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume   File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 235, in __init__
2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume     args, *kwargs)
*args, **kwargs)
2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume   File "/usr/lib/python2.7/dist-packages/cinder/manager.py", line 156, in __init__
2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume     self.scheduler_rpcapi = scheduler_rpcapi.SchedulerAPI()
2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume   File "/usr/lib/python2.7/dist-packages/cinder/rpc.py", line 188, in __init__
2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume     serializer = base.CinderObjectSerializer(obj_version_cap)
2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume   File "/usr/lib/python2.7/dist-packages/cinder/objects/base.py", line 412, in __init__
2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume     raise exception.CappedVersionUnknown(version=version_cap)
2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume CappedVersionUnknown: Unrecoverable Error: Versioned Objects in DB are capped to unknown version 1.11.
2016-11-22 20:35:55.610 32421 ERROR cinder.cmd.volume
2016-11-22 20:35:55.614 32421 ERROR cinder.cmd.volume [req-95c25581-020a-439e-b339-109eaf7caff4 - - - - -] No volume service(s) started successfully, terminating.

terminating.

Thank you,

Regards.