Ask Your Question
0

Rabbitmq errors: no exchange 'reply_bf8ddab13a254547974842e6a27f9099' in vhost '/'"

asked 2016-03-08 05:53:57 -0600

hannuvisti gravatar image

Hi all,

I am running openstack Juno. Recently I have had severe problems with it, as rabbitmq fills the log with error messages like:

=ERROR REPORT==== 8-Mar-2016::11:17:16 ===
connection <0.8110.9>, channel 1 - soft error:
{amqp_error,not_found,
            "no exchange 'reply_bf8ddab13a254547974842e6a27f9099' in vhost '/'",
            'exchange.declare'}

=ERROR REPORT==== 8-Mar-2016::11:17:16 ===
connection <0.8122.9>, channel 1 - soft error:
{amqp_error,not_found,
            "no exchange 'reply_bf8ddab13a254547974842e6a27f9099' in vhost '/'",
            'exchange.declare'}

=ERROR REPORT==== 8-Mar-2016::11:17:16 ===
connection <0.8131.9>, channel 1 - soft error:
{amqp_error,not_found,
            "no exchange 'reply_bf8ddab13a254547974842e6a27f9099' in vhost '/'",
            'exchange.declare'}

and so forth. About 50MB of these get generated in about 5 minutes, then Rabbitmq just hangs and needs to be restarted. When I do the restart, my Openstack cluster actually works fine. Apparently something is wrong somewhere, but how do I find the broken component? Openstack logs do not reveal anything specific, just dropped MQ connections. 

nova-manage service list

shows everything up and running up to the point when rabbitmq dies.

Any ideas where to look? What is this "vhost '/'"?

Hannu

edit retag flag offensive close merge delete
add a comment

2 answers

Sort by » oldest newest most voted
1

answered 2016-06-29 08:30:51 -0600

jckreddy gravatar image 
There is bug similar to the issue hope you find some info here 


https://bugs.launchpad.net/oslo.messaging/+bug/1477914
edit flag offensive delete link more
add a comment
1

answered 2016-06-27 01:22:46 -0600

kevin_zhu gravatar image

I came across the similar issue as you, see --->

when execute 'heat stack-list' and by investigating the log of Heat api we saw the error message like below "Unexpected error occurred serving API: Timed out waiting for a reply to message ID 7daf49ca17cd4070bcfa1041890f84ae" ---->

#

2016-06-22 14:14:33.868 15417 DEBUG heat.common.serializers [req-d8ee1b0a-6568-4482-a177-e8b76356d375 - 69a1bf21012b4311b01d3f998ca95934-0c61356e-f17d-4b8d-ac33-64279d0] JSON response : {"explanation": "The server has ei ther erred or is incapable of performing the requested operation.", "code": 500, "error": {"message": "Timed out waiting for a reply to message ID 39cea53fd8de46b2a8332c32e047df59", "traceback": "Traceback (most recent c all last):\n File \"/usr/lib/python2.7/site-packages/heat/api/middleware/fault.py\", line 156, in process_request\n return req.get_response(self.application)\n File \"/usr/lib/python2.7/site-packages/webob/request.p y\", line 1296, in send\n application, catch_exc_info=False)\n File \"/usr/lib/python2.7/site-packages/webob/request.py\", line 1260, in call_application\n app_iter = application(self.environ, start_response)\n F ile \"/usr/lib/python2.7/site-packages/webob/dec.py\", line 130, in __call__\n resp = self.call_func(req, args, *self.kwargs)\n File \"/usr/lib/python2.7/site-packages/webob/dec.py\", line 195, in call_func\n re turn self.func(req, args, *kwargs)\n File \"/usr/lib/python2.7/site-packages/heat/common/wsgi.py\", line 390, in __call__\n response = req.get_response(self.application)\n File \"/usr/lib/python2.7/site-packages/w ebob/request.py\", line 1296, in send\n application, catch_exc_info=False)\n File \"/usr/lib/python2.7/site-packages/webob/request.py\", line 1260, in call_application\n app_iter = application(self.environ, start_ response)\n File \"/usr/lib/python2.7/site-packages/webob/dec.py\", line 130, in __call__\n resp = self.call_func(req, args, *self.kwargs)\n File \"/usr/lib/python2.7/site-packages/webob/dec.py\", line 195, in cal l_func\n return self.func(req, args, *kwargs)\n File \"/usr/lib/python2.7/site-packages/heat/common/wsgi.py\", line 390, in __call__\n response = req.get_response(self.application)\n File \"/usr/lib/python2.7/s ite-packages/webob/request.py\", line 1296, in send\n application, catch_exc_info=False)\n File \"/usr/lib/python2.7/site-packages/webob/request.py\", line 1260, in call_application\n app_iter = application(self.e nviron, start_response)\n File \"/usr/lib/python2.7/site-packages/webob/dec.py\", line 130, in __call__\n resp = self.call_func(req, args, *self.kwargs)\n File \"/usr/lib/python2.7/site-packages/webob/dec.py\", li ne 195, in call_func\n return self.func(req, args, *kwargs)\n File \"/usr/lib/python2.7/site-packages/osprofiler/web.py\", line 99, in __call__\n return request.get_response(self.application)\n File \"/usr/lib/ python2.7/site-packages/webob/request.py\", line 1296, in send\n application, catch_exc_info=False)\n File \"/usr/lib/python2.7/site-packages/webob/request.py\", line 1260, in call_application\n app_iter = applica tion(self.environ, start_response)\n File \"/usr/lib/python2.7/site-packages/webob/dec.py\", line 130, in __call__\n resp = self.call_func(req, args, *self.kwargs)\n File \"/usr/lib/python2.7/site-packages/webob/d ec ... (more)

edit flag offensive delete link more
add a comment

Get to know Ask OpenStack

Resources for moderators

Question Tools

3 followers

subscribe to rss feed

Stats

Asked: 2016-03-08 05:53:57 -0600

Seen: 3,285 times

Last updated: Jun 29 '16

Related questions

Juno Controller reboot result nova compute state down

ml2 plugin with linuxbridge and vlans

how to install juno on redhat6.5 with packstack

load balancer as a service for all protocols

“settings.DATABASES is improperly configured” error performing syncdb with django 1.6.8 [closed]

nova-compute cannot make vm due to keystone auth failure.

Floating IPs not reacheables

HEAT grub commands for CentOS 7 Nova Instance

Unable to get DHCP lease in Juno

OpenStack Juno using RDO fails installation: AMQP server closed the connection