Ask Your Question
2

why is the cinder-volume service down ?

asked 2014-07-05 04:53:25 -0500

dachary gravatar image

updated 2014-07-05 04:55:07 -0500

In a Havana cluster the cinder-volume daemon runs on a host, does not display any error in /var/log/cinder/cinder-volume.log. However, the service appears as down:

$ cinder-manage service list | grep bm0009
cinder-volume bm0009 bm0009 enabled XXX 2014-07-05 08:49:01

why is that ?

edit retag flag offensive close merge delete

3 answers

Sort by ยป oldest newest most voted
7

answered 2014-07-05 05:05:47 -0500

dachary gravatar image

It can happen when one of the host is not running NTP and their time difference is two large. Installing ntp on each of them is likely to fix the problem:

 apt-get install ntp

The status of a service is based on the last time the cinder-volume daemon updated the matching entry in the service tables of the cinder database (see https://github.com/openstack/cinder/b... for the actual code). If the time difference between the host running cinder-manage service list and the host running the cinder volume daemon is greater than 60 seconds (or the value set with the service_down_time configuration option http://docs.openstack.org/havana/conf... ).

edit flag offensive delete link more

Comments

This worked for me ( I use chronyd as time server), also make sure time is synchronized on both controller and cinder.

Tomek gravatar imageTomek ( 2015-12-06 01:23:40 -0500 )edit
0

answered 2016-11-18 08:34:47 -0500

Mutty Putty gravatar image

Hi everyone,

           I got the same error, "cinder volume is down". if I restart service, it is showing up for few second then again goes to down state.

here is my cinder-volume.log

2016-11-18 19:00:26.629 2245 CRITICAL cinder [req-8c979f13-7cc1-4e02-81ec-0ae8dc16e097 - - - - -] AttributeError: 'NoneType' object has no attribute 'cleanup'

2016-11-18 19:00:26.629 2245 ERROR cinder Traceback (most recent call last):

2016-11-18 19:00:26.629 2245 ERROR cinder File "/usr/bin/cinder-volume", line 10, in <module>

2016-11-18 19:00:26.629 2245 ERROR cinder sys.exit(main())

2016-11-18 19:00:26.629 2245 ERROR cinder File "/usr/lib/python2.7/dist-packages/cinder/cmd/volume.py", line 109, in main

2016-11-18 19:00:26.629 2245 ERROR cinder launcher.launch_service(server)

2016-11-18 19:00:26.629 2245 ERROR cinder File "/usr/lib/python2.7/dist-packages/oslo_service/service.py", line 520, in launch_service

2016-11-18 19:00:26.629 2245 ERROR cinder self._start_child(wrap)

2016-11-18 19:00:26.629 2245 ERROR cinder File "/usr/lib/python2.7/dist-packages/oslo_service/service.py", line 494, in _start_child

2016-11-18 19:00:26.629 2245 ERROR cinder self.launcher.wait() 2016-11-18 19:00:26.629 2245 ERROR cinder File "/usr/lib/python2.7/dist-packages/oslo_service/service.py", line 236, in wait 2016-11-18 19:00:26.629 2245 ERROR cinder self.services.wait() 2016-11-18 19:00:26.629 2245 ERROR cinder File "/usr/lib/python2.7/dist-packages/oslo_service/service.py", line 687, in wait 2016-11-18 19:00:26.629 2245 ERROR cinder service.wait()

2016-11-18 19:00:26.629 2245 ERROR cinder File "/usr/lib/python2.7/dist-packages/cinder/service.py", line 419, in wait

2016-11-18 19:00:26.629 2245 ERROR cinder self.rpcserver.wait()

2016-11-18 19:00:26.629 2245 ERROR cinder File "/usr/lib/python2.7/dist-packages/oslo_messaging/server.py", line 268, in wrapper

2016-11-18 19:00:26.629 2245 ERROR cinder log_after, timeout_timer)

2016-11-18 19:00:26.629 2245 ERROR cinder File "/usr/lib/python2.7/dist-packages/oslo_messaging/server.py", line 188, in run_once

2016-11-18 19:00:26.629 2245 ERROR cinder post_fn = fn()

2016-11-18 19:00:26.629 2245 ERROR cinder File "/usr/lib/python2.7/dist-packages/oslo_messaging/server.py", line 267, in <lambda>

2016-11-18 19:00:26.629 2245 ERROR cinder states[state].run_once(lambda: fn(self, args, *kwargs),

2016-11-18 19:00:26.629 2245 ERROR cinder File "/usr/lib/python2.7/dist-packages/oslo_messaging/server.py", line 452, in wait

2016-11-18 19:00:26.629 2245 ERROR cinder self.listener.cleanup()

2016-11-18 19:00:26.629 2245 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'

2016-11-18 19:00:26.629 2245 ERROR cinder

2016-11-18 19:00:26.636 2230 INFO oslo_service.service [req-8c979f13-7cc1-4e02-81ec-0ae8dc16e097 - - - - -] Caught SIGTERM, stopping children

2016-11-18 19:00:26.642 2230 INFO oslo_service.service [req-8c979f13-7cc1-4e02-81ec-0ae8dc16e097 - - - - -] Waiting on 1 children to exit

2016-11-18 19:00:26.651 2230 INFO oslo_service.service [req-8c979f13-7cc1-4e02-81ec-0ae8dc16e097 - - - - -] Child 2245 killed by signal 15

2016-11-18 19:00:28.207 3310 WARNING oslo_reports.guru_meditation_report [-] Guru meditation now registers

SIGUSR1 and SIGUSR2 by default for ... (more)

edit flag offensive delete link more
0

answered 2014-11-10 02:18:07 -0500

danielkwon gravatar image

As for me, it was caused by rabbitmq configuration. check the /var/log/cinder/cinder-volume.log on storage node.

edit flag offensive delete link more

Comments

What did you do to fix the rabbitmq issue?

MrZog gravatar imageMrZog ( 2015-03-05 12:37:50 -0500 )edit

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

Stats

Asked: 2014-07-05 04:53:25 -0500

Seen: 10,432 times

Last updated: Nov 18 '16