Authorization Failed: [Errno 111] Connection refused
Hello,
I am using ubuntu 13.04 with openstack grizzly version. my openstack was working fine and i was able to commnicate to my vm instances from external network and vice versa, but suddenly due to some issue i started facing problem. I am getting "[Errno 111] Connection refused" error, I have faced this same issue many times in past and i use to reinstall from scratch, but after sometime again i will end up in same problem. This happens every time not only for me all my peers also facing the same issue on their lab setup. This behavior make me think like after some time the database is getting corrupted or something similar to this . i would really appreciate if someone can help me to narrow down the root cause ?
Thanks in advance.
root@ubuntu150:/var# keystone --debug user-list
REQ: curl -i http://10.19.11.150:5000/v2.0/tokens -X POST -H "Content-Type: application/json" -H "User-Agent: python-keystoneclient"
REQ BODY: {"auth": {"tenantName": "admin", "passwordCredentials": {"username": "admin", "password": "admin_pass"}}}
Authorization Failed: [Errno 111] Connection refused
root@ubuntu150:~# quantum net-list
[Errno 111] Connection refused
root@ubuntu150:~# keystone user-list
Authorization Failed: [Errno 111] Connection refused
root@ubuntu150:~# quantum subnet-list
[Errno 111] Connection refused
root@ubuntu150:/var# tail -n 30 /var/log/keystone/keystone.log
2013-05-28 23:40:48 WARNING [keystone.common.wsgi] You are not authorized to perform the requested action: admin_required
2013-05-29 02:08:20 WARNING [keystone.common.wsgi] You are not authorized to perform the requested action: admin_required
root@ubuntu150:/var# cat /var/log/nova/nova-* | grep -i error
2013-05-28 18:29:37.251 ERROR nova.openstack.common.rpc.common [req-46d05539-0ed3-4104-a72f-c77359c657c7 None None] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
2013-05-28 18:29:38.254 ERROR nova.openstack.common.rpc.common [req-46d05539-0ed3-4104-a72f-c77359c657c7 None None] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 3 seconds.
2013-05-28 18:29:41.259 ERROR nova.openstack.common.rpc.common [req-46d05539-0ed3-4104-a72f-c77359c657c7 None None] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 5 seconds.
2013-05-28 18:29:46.263 ERROR nova.openstack.common.rpc.common [req-46d05539-0ed3-4104-a72f-c77359c657c7 None None] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 7 seconds.
2013-05-28 18:29:53.267 ERROR nova.openstack.common.rpc.common [req-46d05539-0ed3-4104-a72f-c77359c657c7 None None] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 9 seconds.
2013-05-28 18:30:02.273 ERROR nova.openstack.common.rpc.common [req-46d05539-0ed3-4104-a72f-c77359c657c7 None None] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 11 seconds.
2013-05-28 20:54:54.073 ERROR nova.openstack.common.rpc.common [req-f9508f02-6770-458b-a3ba-29aa6577efff None None] AMQP server on 10.19.11.150:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
2013-05-28 20:54:55.075 ERROR nova.openstack.common.rpc.common [req-f9508f02-6770-458b-a3ba-29aa6577efff None None] AMQP server on 10.19.11.150:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 3 seconds ...
regarding the iptables, i a using the ubuntu 13.04 amd 64 server default installation and i don't see any iptables rules in it.
FYI, This happened when i was installing keystone on a fresh OS , This happens when the source file is not loaded or the parameters in source files are incorrect or has been changed on the OS.
My source file was having the following entries -:
export OS_TENANT_NAME=admin export OS_USERNAME=admin