Revision history [back]

click to hide/show revision 1
initial version

ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.106:5672 is unreachable: [Errno 111] ECONNREFUSED.

Network quota was not available from horizon ; tried checking neutron server on controller which says

"MainPID=0 Id=neutron-server.service ActiveState=failed" due to amqp error

[root@workstation1 neutron(keystone_admin)]# systemctl status rabbitmq-server.service -l ● rabbitmq-server.service - RabbitMQ brokera Loaded: loaded (/usr/lib/systemd/system/rabbitmq-server.service; enabled; vendor preset: disabled) Active: failed (Result: timeout) since Thu 2016-02-04 01:27:40 EST; 53min ago Process: 1223 ExecStart=/usr/lib/rabbitmq/bin/rabbitmq-server (code=killed, signal=TERM) Main PID: 1223 (code=killed, signal=TERM)

Feb 04 01:26:09 workstation1.skt.com systemd[1]: Starting RabbitMQ broker... Feb 04 01:26:14 workstation1.skt.com systemd[1]: rabbitmq-server.service: Got notification message from PID 1251, but reception only permitted for main PID 1223 Feb 04 01:26:39 workstation1.skt.com systemd[1]: rabbitmq-server.service: Got notification message from PID 1801, but reception only permitted for main PID 1223 Feb 04 01:26:39 workstation1.skt.com systemd[1]: rabbitmq-server.service: Got notification message from PID 1805, but reception only permitted for main PID 1223 Feb 04 01:27:40 workstation1.skt.com systemd[1]: rabbitmq-server.service start operation timed out. Terminating. Feb 04 01:27:40 workstation1.skt.com systemd[1]: Failed to start RabbitMQ broker. Feb 04 01:27:40 workstation1.skt.com systemd[1]: Unit rabbitmq-server.service entered failed state. Feb 04 01:27:40 workstation1.skt.com systemd[1]: rabbitmq-server.service failed.

[root@workstation1 neutron(keystone_admin)]# rabbitmqctl status Status of node rabbit@workstation1 ... Error: unable to connect to node rabbit@workstation1: nodedown

DIAGNOSTICS

attempted to contact: [rabbit@workstation1]

rabbit@workstation1: * connected to epmd (port 4369) on workstation1 * epmd reports: node 'rabbit' not running at all no other nodes on workstation1

[root@workstation1 neutron(keystone_admin)]# ping workstation1 ping: unknown host workstation1

suspect DNS issue ; edited the /etc/hosts file to point the ip to correct hostname and restarted rabbitmq and then neutron which resolved the issue.

http://waradedipak.blogspot.co.uk/

[root@workstation1 neutron(keystone_admin)]# systemctl status rabbitmq-server.service ● rabbitmq-server.service - RabbitMQ broker Loaded: loaded (/usr/lib/systemd/system/rabbitmq-server.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2016-02-04 02:22:10 EST; 1min 2s ago Main PID: 7594 (beam) CGroup: /system.slice/rabbitmq-server.service ├─7594 /usr/lib64/erlang/erts-5.10.4/bin/beam -W w -K true -A30 -P 1048576 -- -root /usr/lib64/erlang -progname erl -- -home /var/lib/rabbitmq -- -pa /usr/lib/rabbitmq/lib/rab... ├─7680 inet_gethost 4 └─7681 inet_gethost 4

Feb 04 02:22:02 workstation1.skt.com systemd[1]: Starting RabbitMQ broker... Feb 04 02:22:09 workstation1.skt.com rabbitmq-server[7594]: RabbitMQ 3.3.5. Copyright (C) 2007-2014 GoPivotal, Inc. Feb 04 02:22:09 workstation1.skt.com rabbitmq-server[7594]: ## ## Licensed under the MPL. See http://www.rabbitmq.com/ Feb 04 02:22:09 workstation1.skt.com rabbitmq-server[7594]: ## ## Feb 04 02:22:09 workstation1.skt.com rabbitmq-server[7594]: ########## Logs: /var/log/rabbitmq/rabbit@workstation1.log Feb 04 02:22:09 workstation1.skt.com rabbitmq-server[7594]: ###### ## /var/log/rabbitmq/rabbit@workstation1-sasl.log Feb 04 02:22:09 workstation1.skt.com rabbitmq-server[7594]: ########## Feb 04 02:22:10 workstation1.skt.com systemd[1]: Started RabbitMQ broker. Feb 04 02:22:10 workstation1.skt.com rabbitmq-server[7594]: Starting broker... completed with 0 plugins.

ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.106:5672 is unreachable: [Errno 111] ECONNREFUSED.

Network quota was not available from horizon ; tried checking neutron server on controller which says

"MainPID=0 "MainPID=0 Id=neutron-server.service ActiveState=failed" ActiveState=failed" due to amqp error

[root@workstation1 neutron(keystone_admin)]# systemctl status rabbitmq-server.service -l
● rabbitmq-server.service - RabbitMQ brokera
   Loaded: loaded (/usr/lib/systemd/system/rabbitmq-server.service; enabled; vendor preset: disabled)
   Active: failed (Result: timeout) since Thu 2016-02-04 01:27:40 EST; 53min ago
  Process: 1223 ExecStart=/usr/lib/rabbitmq/bin/rabbitmq-server (code=killed, signal=TERM)
 Main PID: 1223 (code=killed, signal=TERM)

signal=TERM) Feb 04 01:26:09 workstation1.skt.com systemd[1]: Starting RabbitMQ broker... Feb 04 01:26:14 workstation1.skt.com systemd[1]: rabbitmq-server.service: Got notification message from PID 1251, but reception only permitted for main PID 1223 Feb 04 01:26:39 workstation1.skt.com systemd[1]: rabbitmq-server.service: Got notification message from PID 1801, but reception only permitted for main PID 1223 Feb 04 01:26:39 workstation1.skt.com systemd[1]: rabbitmq-server.service: Got notification message from PID 1805, but reception only permitted for main PID 1223 Feb 04 01:27:40 workstation1.skt.com systemd[1]: rabbitmq-server.service start operation timed out. Terminating. Feb 04 01:27:40 workstation1.skt.com systemd[1]: Failed to start RabbitMQ broker. Feb 04 01:27:40 workstation1.skt.com systemd[1]: Unit rabbitmq-server.service entered failed state. Feb 04 01:27:40 workstation1.skt.com systemd[1]: rabbitmq-server.service failed.

failed. [root@workstation1 neutron(keystone_admin)]# rabbitmqctl status Status of node rabbit@workstation1 ... Error: unable to connect to node rabbit@workstation1: nodedown

DIAGNOSTICS

nodedown DIAGNOSTICS =========== attempted to contact: [rabbit@workstation1]

[rabbit@workstation1] rabbit@workstation1: * connected to epmd (port 4369) on workstation1 * epmd reports: node 'rabbit' not running at all no other nodes on workstation1

workstation1 [root@workstation1 neutron(keystone_admin)]# ping workstation1 ping: unknown host workstation1

workstation1

suspect DNS issue ; edited the /etc/hosts file to point the ip to correct hostname and restarted rabbitmq and then neutron which resolved the issue.

http://waradedipak.blogspot.co.uk/

[root@workstation1 neutron(keystone_admin)]# systemctl  status  rabbitmq-server.service
● rabbitmq-server.service - RabbitMQ broker
   Loaded: loaded (/usr/lib/systemd/system/rabbitmq-server.service; enabled; vendor preset: disabled)
   Active: active (running) since Thu 2016-02-04 02:22:10 EST; 1min 2s ago
 Main PID: 7594 (beam)
   CGroup: /system.slice/rabbitmq-server.service
           ├─7594 /usr/lib64/erlang/erts-5.10.4/bin/beam -W w -K true -A30 -P 1048576 -- -root /usr/lib64/erlang -progname erl -- -home /var/lib/rabbitmq -- -pa /usr/lib/rabbitmq/lib/rab...
           ├─7680 inet_gethost 4
           └─7681 inet_gethost 4

4 Feb 04 02:22:02 workstation1.skt.com systemd[1]: Starting RabbitMQ broker... Feb 04 02:22:09 workstation1.skt.com rabbitmq-server[7594]: RabbitMQ 3.3.5. Copyright (C) 2007-2014 GoPivotal, Inc. Feb 04 02:22:09 workstation1.skt.com rabbitmq-server[7594]: ## ## Licensed under the MPL. See http://www.rabbitmq.com/ Feb 04 02:22:09 workstation1.skt.com rabbitmq-server[7594]: ## ## Feb 04 02:22:09 workstation1.skt.com rabbitmq-server[7594]: ########## Logs: /var/log/rabbitmq/rabbit@workstation1.log Feb 04 02:22:09 workstation1.skt.com rabbitmq-server[7594]: ###### ## /var/log/rabbitmq/rabbit@workstation1-sasl.log Feb 04 02:22:09 workstation1.skt.com rabbitmq-server[7594]: ########## Feb 04 02:22:10 workstation1.skt.com systemd[1]: Started RabbitMQ broker. Feb 04 02:22:10 workstation1.skt.com rabbitmq-server[7594]: Starting broker... completed with 0 plugins.

plugins.