hi all,

We have a two-node setup through packstack.

Since today we added the second nova node with cinder-volume. If we add a volume, the status keeps hanging @ creating

Output from scheduler.log:

2014-01-27 14:44:56.457 4562 ERROR root [-] Unexpected exception occurred 61 time(s)... retrying. 2014-01-27 14:44:56.457 4562 TRACE root Traceback (most recent call last): 2014-01-27 14:44:56.457 4562 TRACE root File "/usr/lib/python2.6/site-packages/cinder/openstack/common/excutils.py", line 62, in inner_func 2014-01-27 14:44:56.457 4562 TRACE root return infunc(args, *kwargs) 2014-01-27 14:44:56.457 4562 TRACE root File "/usr/lib/python2.6/site-packages/cinder/openstack/common/rpc/impl_qpid.py", line 632, in _consumer_thread 2014-01-27 14:44:56.457 4562 TRACE root self.consume() 2014-01-27 14:44:56.457 4562 TRACE root File "/usr/lib/python2.6/site-packages/cinder/openstack/common/rpc/impl_qpid.py", line 623, in consume 2014-01-27 14:44:56.457 4562 TRACE root it.next() 2014-01-27 14:44:56.457 4562 TRACE root File "/usr/lib/python2.6/site-packages/cinder/openstack/common/rpc/impl_qpid.py", line 540, in iterconsume 2014-01-27 14:44:56.457 4562 TRACE root yield self.ensure(_error_callback, _consume) 2014-01-27 14:44:56.457 4562 TRACE root File "/usr/lib/python2.6/site-packages/cinder/openstack/common/rpc/impl_qpid.py", line 480, in ensure 2014-01-27 14:44:56.457 4562 TRACE root return method(args, *kwargs) 2014-01-27 14:44:56.457 4562 TRACE root File "/usr/lib/python2.6/site-packages/cinder/openstack/common/rpc/impl_qpid.py", line 531, in _consume 2014-01-27 14:44:56.457 4562 TRACE root nxt_receiver = self.session.next_receiver(timeout=timeout) 2014-01-27 14:44:56.457 4562 TRACE root File "<string>", line 6, in next_receiver 2014-01-27 14:44:56.457 4562 TRACE root File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 660, in next_receiver 2014-01-27 14:44:56.457 4562 TRACE root if self._ecwait(lambda: self.incoming, timeout): 2014-01-27 14:44:56.457 4562 TRACE root File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 50, in _ecwait 2014-01-27 14:44:56.457 4562 TRACE root result = self._ewait(lambda: self.closed or predicate(), timeout) 2014-01-27 14:44:56.457 4562 TRACE root File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 567, in _ewait 2014-01-27 14:44:56.457 4562 TRACE root self.check_error() 2014-01-27 14:44:56.457 4562 TRACE root File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 556, in check_error 2014-01-27 14:44:56.457 4562 TRACE root raise self.error 2014-01-27 14:44:56.457 4562 TRACE root SessionError: Queue cinder-volume has been deleted. (qpid/broker/Queue.cpp:1414)(408) 2014-01-27 14:44:56.457 4562 TRACE root

Possibly a rabbitmq problem ?