Rabbitmq errors: no exchange 'reply_bf8ddab13a254547974842e6a27f9099' in vhost '/'"

asked 2016-03-08 05:53:57 -0500

hannuvisti
51 ●4 ●6 ●10

Hi all,

I am running openstack Juno. Recently I have had severe problems with it, as rabbitmq fills the log with error messages like:

=ERROR REPORT==== 8-Mar-2016::11:17:16 ===
connection <0.8110.9>, channel 1 - soft error:
{amqp_error,not_found,
            "no exchange 'reply_bf8ddab13a254547974842e6a27f9099' in vhost '/'",
            'exchange.declare'}

=ERROR REPORT==== 8-Mar-2016::11:17:16 ===
connection <0.8122.9>, channel 1 - soft error:
{amqp_error,not_found,
            "no exchange 'reply_bf8ddab13a254547974842e6a27f9099' in vhost '/'",
            'exchange.declare'}

=ERROR REPORT==== 8-Mar-2016::11:17:16 ===
connection <0.8131.9>, channel 1 - soft error:
{amqp_error,not_found,
            "no exchange 'reply_bf8ddab13a254547974842e6a27f9099' in vhost '/'",
            'exchange.declare'}

and so forth. About 50MB of these get generated in about 5 minutes, then Rabbitmq just hangs and needs to be restarted. When I do the restart, my Openstack cluster actually works fine. Apparently something is wrong somewhere, but how do I find the broken component? Openstack logs do not reveal anything specific, just dropped MQ connections.

nova-manage service list

shows everything up and running up to the point when rabbitmq dies.

Any ideas where to look? What is this "vhost '/'"?

Hannu

edit retag flag offensive close merge delete

add a comment

2 answers

Sort by » oldest newest most voted

answered 2016-06-29 08:30:51 -0500

jckreddy
386 ●5 ●15 ●29

There is bug similar to the issue hope you find some info here 


https://bugs.launchpad.net/oslo.messaging/+bug/1477914

edit flag offensive delete link

add a comment

answered 2016-06-27 01:22:46 -0500

kevin_zhu
65 ●9 ●14 ●20

I came across the similar issue as you, see --->

when execute 'heat stack-list' and by investigating the log of Heat api we saw the error message like below "Unexpected error occurred serving API: Timed out waiting for a reply to message ID 7daf49ca17cd4070bcfa1041890f84ae" ---->

#

2016-06-22 14:14:33.868 15417 DEBUG heat.common.serializers [req-d8ee1b0a-6568-4482-a177-e8b76356d375 - 69a1bf21012b4311b01d3f998ca95934-0c61356e-f17d-4b8d-ac33-64279d0] JSON response : {"explanation": "The server has ei ther erred or is incapable of performing the requested operation.", "code": 500, "error": {"message": "Timed out waiting for a reply to message ID 39cea53fd8de46b2a8332c32e047df59", "traceback": "Traceback (most recent c all last):\n File \"/usr/lib/python2.7/site-packages/heat/api/middleware/fault.py\", line 156, in process_request\n return req.get_response(self.application)\n File \"/usr/lib/python2.7/site-packages/webob/request.p y\", line 1296, in send\n application, catch_exc_info=False)\n File \"/usr/lib/python2.7/site-packages/webob/request.py\", line 1260, in call_application\n app_iter = application(self.environ, start_response)\n F ile \"/usr/lib/python2.7/site-packages/webob/dec.py\", line 130, in __call__\n resp = self.call_func(req, args, *self.kwargs)\n File \"/usr/lib/python2.7/site-packages/webob/dec.py\", line 195, in call_func\n re turn self.func(req, args, *kwargs)\n File \"/usr/lib/python2.7/site-packages/heat/common/wsgi.py\", line 390, in __call__\n response = req.get_response(self.application)\n File \"/usr/lib/python2.7/site-packages/w ebob/request.py\", line 1296, in send\n application, catch_exc_info=False)\n File \"/usr/lib/python2.7/site-packages/webob/request.py\", line 1260, in call_application\n app_iter = application(self.environ, start_ response)\n File \"/usr/lib/python2.7/site-packages/webob/dec.py\", line 130, in __call__\n resp = self.call_func(req, args, *self.kwargs)\n File \"/usr/lib/python2.7/site-packages/webob/dec.py\", line 195, in cal l_func\n return self.func(req, args, *kwargs)\n File \"/usr/lib/python2.7/site-packages/heat/common/wsgi.py\", line 390, in __call__\n response = req.get_response(self.application)\n File \"/usr/lib/python2.7/s ite-packages/webob/request.py\", line 1296, in send\n application, catch_exc_info=False)\n File \"/usr/lib/python2.7/site-packages/webob/request.py\", line 1260, in call_application\n app_iter = application(self.e nviron, start_response)\n File \"/usr/lib/python2.7/site-packages/webob/dec.py\", line 130, in __call__\n resp = self.call_func(req, args, *self.kwargs)\n File \"/usr/lib/python2.7/site-packages/webob/dec.py\", li ne 195, in call_func\n return self.func(req, args, *kwargs)\n File \"/usr/lib/python2.7/site-packages/osprofiler/web.py\", line 99, in __call__\n return request.get_response(self.application)\n File \"/usr/lib/ python2.7/site-packages/webob/request.py\", line 1296, in send\n application, catch_exc_info=False)\n File \"/usr/lib/python2.7/site-packages/webob/request.py\", line 1260, in call_application\n app_iter = applica tion(self.environ, start_response)\n File \"/usr/lib/python2.7/site-packages/webob/dec.py\", line 130, in __call__\n resp = self.call_func(req, args, *self.kwargs)\n File \"/usr/lib/python2.7/site-packages/webob/d ec ... (more)

edit flag offensive delete link

add a comment

Rabbitmq errors: no exchange 'reply_bf8ddab13a254547974842e6a27f9099' in vhost '/'"

2 answers

#

Your Answer

Get to know Ask OpenStack

Question Tools

Stats

Related questions

Feedback About This Page

OpenStack

Community

Documentation

Branding & Legal

Rabbitmq errors: no exchange 'reply_bf8ddab13a254547974842e6a27f9099' in vhost '/'" edit

2 answers

#

Your Answer

Get to know Ask OpenStack

Question Tools

Stats

Related questions

Feedback About This Page

OpenStack

Community

Documentation

Branding & Legal

Rabbitmq errors: no exchange 'reply_bf8ddab13a254547974842e6a27f9099' in vhost '/'"