Ask Your Question
2

RabbitMQ: Number of connections

asked 2015-01-08 06:57:46 -0500

mathias gravatar image

Hi, I was just looking at my RabbitMQ and noted an number of connections that seemed unusual to me:

root@amqp01:~# rabbitmqctl list_connections
Listing connections ...
openstack       10.0.10.103     35057   running
openstack       10.0.10.103     35058   running
openstack       10.0.10.103     35059   running
openstack       10.0.10.103     35060   running
openstack       10.0.10.103     35061   running
openstack       10.0.10.103     35062   running
openstack       10.0.10.104     44562   running
openstack       10.0.10.104     44563   running
openstack       10.0.10.200     57400   running
openstack       10.0.10.200     57401   running
openstack       10.0.10.200     57402   running
openstack       10.0.10.200     57403   running
openstack       10.0.10.200     57404   running
openstack       10.0.10.200     57405   running
openstack       10.0.10.200     57406   running
openstack       10.0.10.200     57407   running
openstack       10.0.10.200     57408   running
openstack       10.0.10.200     57409   running
openstack       10.0.10.200     57410   running
openstack       10.0.10.200     57411   running
openstack       10.0.10.200     57412   running
openstack       10.0.10.200     57413   running
openstack       10.0.10.200     57414   running
openstack       192.168.11.10   57087   running
openstack       192.168.11.10   57088   running
openstack       192.168.11.10   57089   running
openstack       192.168.11.10   57090   running
openstack       192.168.11.10   57091   running
openstack       192.168.11.10   57092   running
openstack       192.168.11.10   57093   running
openstack       192.168.11.10   57094   running
openstack       192.168.11.10   57095   running
openstack       192.168.11.10   57096   running
openstack       192.168.11.11   56637   running
openstack       192.168.11.11   56638   running
openstack       192.168.11.11   56639   running
openstack       192.168.11.11   56640   running
openstack       192.168.11.11   56641   running
openstack       192.168.11.11   56642   running
openstack       192.168.11.11   56643   running
openstack       192.168.11.11   56644   running
openstack       192.168.11.11   56645   running
...done.
root@amqp01:~#

10.0.10.103: nova api node 10.0.10.104: neutron api node 10.0.10.200: neuton network noe 192.168.11.10: kvm00 192.168.1.11: kvm01

The number of existing connections as well as the lack of any connection from 10.0.10.101 (Keystone) made me suspicious. I have no working environment I can use to compare, so please give some advice. I am also having other problems with rabbitmq atm and I was thinking this might bring me on the right tack.

edit retag flag offensive close merge delete

Comments

The number of connections is constantly growing over time. Looks like every couple of hours or every hour they double.

mathias gravatar imagemathias ( 2015-01-09 06:42:41 -0500 )edit

3 answers

Sort by ยป oldest newest most voted
2

answered 2015-01-10 12:40:34 -0500

Actually this looks fairly normal. I have see in our environment upwards of 800+ connections.

To confirm if indeed these connections are growing and not being closed properly you could run the following command to get a count and run it over the course of a few days to see if the number is increasing or just rising and falling back:

rabbitmqctl list_connections|wc -l

Also the lack of Keystone connections can be explained by the fact that keystone only talks to RabbitMQ if you have enabled notifications. Otherwise unlike the other OpenStack components, Keystone does not rely on messages.

There is a known issue with RabbitMQ and OpenStack services with regards to keepalives:

https://bugs.launchpad.net/nova/+bug/...

This has caused issues with services especially when connections are severed by networking type timeouts.

edit flag offensive delete link more

Comments

The number of connections constantly grew over the past 6 hours. No decreases, it always goes up.

mathias gravatar imagemathias ( 2015-01-12 11:01:41 -0500 )edit
0

answered 2015-01-12 04:17:16 -0500

mathias gravatar image

Today, I found rabbitmq with 436 connections - I only run 1x nova api, 2x nova compute, 1x neutron-api, 1x neutron network. I just restarted everything and began collecting the data you requested just a minute ago.

Regarding the bug: The bug only seems to be valid when there is a firewall between rabbitmq and the other services, right? In my case, there is no firewall sitting in between.

edit flag offensive delete link more

Comments

Please guys, OpenStack is quite useless without a working RabbitMQ :( I monitored the number of connections since yesterday night: http://78.47.11.231/Screenshot%20from... They more than doubled within a bit more than 12 hours from 60 to 140.

mathias gravatar imagemathias ( 2015-01-14 01:56:57 -0500 )edit
0

answered 2018-02-19 03:39:56 -0500

Deepa gravatar image

Was this issue resolved ?If yes can you tell us how Rabbitmq message count increase was fixed

edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

Stats

Asked: 2015-01-08 06:57:46 -0500

Seen: 1,243 times

Last updated: Feb 19 '18