Ask Your Question
0

Keystone verifying operations HTTP 500 in app.py

asked 2016-03-18 16:24:46 -0600

Nogginboink gravatar image

I am attempting to install a three-node highly available OpenStack cluster on the Liberty release. I'm on Ubuntu Server 14.04LTS.

The documentation for this process leaves a lot to be desired, and I've spent the entire week scraping together documentation, installing, testing, and troubleshooting. I did manage to get three nodes installed with corosync and Pacemaker, then I added HAProxy, and got the mariaDB Galera server running.

I created the keystone database, and using the authtoken I made it as far as creating the keystone database, installing Apache, creating the keystone service, creating the keystone endpoints, and creating the starter users, projects, and roles.

I'm now at the "verify operation" step, where I'm supposed to request a token by passing all of the OS_ variables on the command line.

When I enter this command, I get back, "An unexpected error prevented the server from fulfilling your request. (HTTP 500) (Request-ID: req-<GUID>)"

I added the --debug directive hoping that I'd get a usable error message that would tell me what boneheaded mistake I'd just made, but the stack trace looks like something is failing deep in the bowels of OpenStack code. Can anyone suggest how to troubleshoot further?

Stack trace:

Making authentication request to http://vsscopenstackcontroller:35357/v3/auth/tokens
"POST /v3/auth/tokens HTTP/1.1" 500 143
Request returned failure status: 500
An unexpected error prevented the server from fulfilling your request. (HTTP 500) (Request-ID: req-e39d4d4f-f01c-47ab-82c8-956b1dbc6fc0)
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/cliff/app.py", line 367, in run_subcommand
    self.prepare_to_run_command(cmd)
  File "/usr/lib/python2.7/dist-packages/openstackclient/shell.py", line 340, in prepare_to_run_command
    self.client_manager.auth_ref
  File "/usr/lib/python2.7/dist-packages/openstackclient/common/clientmanager.py", line 189, in auth_ref
    self._auth_ref = self.auth.get_auth_ref(self.session)
  File "/usr/lib/python2.7/dist-packages/keystoneclient/auth/identity/generic/base.py", line 186, in get_auth_ref
    return self._plugin.get_auth_ref(session, **kwargs)
  File "/usr/lib/python2.7/dist-packages/keystoneclient/auth/identity/v3/base.py", line 190, in get_auth_ref
    authenticated=False, log=False, **rkwargs)
  File "/usr/lib/python2.7/dist-packages/keystoneclient/session.py", line 501, in post
    return self.request(url, 'POST', **kwargs)
  File "/usr/lib/python2.7/dist-packages/openstackclient/common/session.py", line 40, in request
    resp = super(TimingSession, self).request(url, method, **kwargs)
  File "/usr/lib/python2.7/dist-packages/keystoneclient/utils.py", line 337, in inner
    return func(*args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/keystoneclient/session.py", line 401, in request
    raise exceptions.from_response(resp, method, url)
InternalServerError: An unexpected error prevented the server from fulfilling your request. (HTTP 500) (Request-ID: req-e39d4d4f-f01c-47ab-82c8-956b1dbc6fc0)
clean_up IssueToken: An unexpected error prevented the server from fulfilling your request. (HTTP 500) (Request-ID: req-e39d4d4f-f01c-47ab-82c8-956b1dbc6fc0)
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/openstackclient/shell.py", line 108, in run
    ret_val = super(OpenStackShell, self).run(argv)
  File "/usr/lib/python2.7/dist-packages/cliff/app.py", line 255, in run
    result = self.run_subcommand(remainder)
  File "/usr/lib/python2.7 ...
(more)
edit retag flag offensive close merge delete

Comments

Are you working behind any proxy, if so please add exception for your host.

mkrish004c gravatar imagemkrish004c ( 2016-03-18 23:45:37 -0600 )edit

Ahhh... I am behind a proxy. I thought I had set the environment variable no_proxy correctly. Is there another place I need to add the exception? I'll know for sure when I return to the office on Monday.

Nogginboink gravatar imageNogginboink ( 2016-03-19 07:59:04 -0600 )edit

how do you connect your Keystone API, via HA proxy VIP or keystone IP? check whether the port is listening on the HA proxy node please

mkrish004c gravatar imagemkrish004c ( 2016-03-21 09:19:04 -0600 )edit

Please tell how to add exception if one is working behind proxy.I am suffering from the same issue

aditi_89 gravatar imageaditi_89 ( 2016-06-09 06:24:21 -0600 )edit

@aditi_89, did you try with no_proxy env variable ?

mkrish004c gravatar imagemkrish004c ( 2016-09-09 16:10:35 -0600 )edit

2 answers

Sort by ยป oldest newest most voted
0

answered 2017-05-04 21:51:25 -0600

Kounavi gravatar image

updated 2017-05-04 21:57:43 -0600

@Nogginboink I was facing the exact same issue with CentOS 7 using the Liberty release! Check that your memcached service is not dead. If you have setup everything per Liberty tutorial chances are the memcached service is dead because it "clings to IPv6" and cannot bind to a local TCP port when not using IPv6.
Removing the "::1" value from OPTIONS in /etc/syconfig/memcached and restarting both the httpd and the memcached service worked like a charm! :)

P.S.: Why does the consortium drops EOL guides for english but leaves the rest for the other languages is beyond my grasp. If you want access to it check a copy from the Internet archive:
https://web-beta.archive.org/web/20160730173940/http://docs.openstack.org:80/liberty/install-guide-rdo/nova-compute-install.html (https://web-beta.archive.org/web/2016...)

edit flag offensive delete link more
0

answered 2016-03-19 12:57:05 -0600

can you try sourcing a bash script that sets this variables and see if your problem persists?

unset OS_SERVICE_TOKEN
export OS_USERNAME=admin
export OS_PASSWORD=password
export OS_AUTH_URL=http://your_keystone_ip:5000/v2.0
export PS1='[\u@\h \W(keystone_admin)]\$ '

export OS_TENANT_NAME=admin
export OS_REGION_NAME=RegionOne
edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

Stats

Asked: 2016-03-18 16:24:46 -0600

Seen: 631 times

Last updated: May 04 '17