Ask Your Question

bgyako's profile - activity

2016-09-28 14:34:41 -0500 received badge  Notable Question (source)
2016-09-28 14:34:41 -0500 received badge  Popular Question (source)
2016-09-28 14:34:41 -0500 received badge  Famous Question (source)
2015-07-16 04:42:11 -0500 received badge  Famous Question (source)
2015-05-12 08:17:27 -0500 marked best answer Horizon (Dashboard) extremely slow

Hi Guys,

I am running open stack Grizzly, having an issue with Dashboard running extremely slow. I found the issue with tokens not properly being deleted, and cleaned the Keystone DB and everything started working properly. The issue came back once we started creating multiple instances. We have close to 80 instances running as an experiment, and dashboard takes 2 minutes to load between pages. I do not see any errors in the logs and functionality seems to be working just very slow. Any help would be greatly appreciated in pin pointing the problem.

2015-05-12 08:16:33 -0500 received badge  Good Question (source)
2015-03-18 12:20:07 -0500 received badge  Famous Question (source)
2015-03-03 21:42:56 -0500 received badge  Famous Question (source)
2015-01-20 14:07:11 -0500 received badge  Famous Question (source)
2014-12-28 03:24:51 -0500 received badge  Notable Question (source)
2014-12-28 03:24:51 -0500 received badge  Famous Question (source)
2014-12-26 19:05:37 -0500 received badge  Popular Question (source)
2014-12-26 04:56:37 -0500 received badge  Notable Question (source)
2014-12-25 21:37:36 -0500 received badge  Popular Question (source)
2014-12-24 13:36:59 -0500 asked a question Unable to login using launch pad

Any one else receiving below error when logging in with launch pad

Error: OpenID https://login.launchpad.net/ is invalid

2014-12-24 12:14:28 -0500 asked a question creating multiple instances

Hi Guys, Having weird problem I suspect is related to HAproxy.

My set up:
Running IceHouse and Ubuntu 14.04
2 Haproxy servers doing the load balancing.
2 controllers.
3 mariaDB servers clustered.

Everything is working properly except when I try to create multiple instances at once. If I create 1, 2 , or 3 instances at one time everything works perfect, but creating 5 or more keeps throwing DB lock errors.

My HaProxy Config:

global
        chroot  /var/lib/haproxy
        user haproxy
        group haproxy
        daemon
        log 10.1.0.4 local0
        stats socket /var/lib/haproxy/stats
        pidfile /var/run/haproxy.pid
        maxconn 5000
        tune.bufsize 32000

defaults
        log     global
        mode    http
        option  httplog
        option  dontlognull
        option  redispatch
        contimeout 5000
        clitimeout 50000
        srvtimeout 50000
        errorfile 400 /etc/haproxy/errors/400.http
        errorfile 403 /etc/haproxy/errors/403.http
        errorfile 408 /etc/haproxy/errors/408.http
        errorfile 500 /etc/haproxy/errors/500.http
        errorfile 502 /etc/haproxy/errors/502.http
        errorfile 503 /etc/haproxy/errors/503.http
        errorfile 504 /etc/haproxy/errors/504.http

listen galera   10.1.0.2:3306
        balance source
        mode    tcp
        option  tcpka
        option  mysql-check user haproxy
        server  cwtrdb001 10.1.0.7:3306 check weight 1
        server  cwtrdb002 10.1.0.8:3306 check weight 1
        server  cwtrdb003 10.1.0.16:3306 check weight 1
2014-12-17 22:20:56 -0500 received badge  Famous Question (source)
2014-12-12 00:23:18 -0500 received badge  Famous Question (source)
2014-11-27 07:08:47 -0500 received badge  Famous Question (source)
2014-11-19 06:03:35 -0500 received badge  Notable Question (source)
2014-11-18 12:51:52 -0500 answered a question Can not retrieve instance data
2014-11-18 12:49:46 -0500 received badge  Supporter (source)
2014-11-18 12:47:55 -0500 commented answer nova list on one tenant does not work.

Not to familiar with all the haproxy settings, weird thing is it worked fine until one project added a bunch of instances. Need to get more familiar with haproxy. What is the rule of thumb on how many global maxconn and tune.bufsize be set to?

2014-11-18 12:47:39 -0500 received badge  Popular Question (source)
2014-11-18 12:37:20 -0500 answered a question nova list on one tenant does not work.

Issue resolved:

Since all requests are going through HAproxy needed to add tune.bufsize parameter of haproxy. I set the value to 32K not sure if it should be smaller or larger will look into it.

2014-11-18 12:30:00 -0500 commented question nova list on one tenant does not work.

that works fine, does not help with nova list. I also have HAproxy in front of the clustered controllers, wondering if something got messed up.

2014-11-18 12:15:36 -0500 commented question nova list on one tenant does not work.

Added info above. Found error on second controller.

2014-11-18 10:39:07 -0500 asked a question nova list on one tenant does not work.

When I try nova list on one specific tenant receive below error. Nothing shows up in nova.logs , other tenants work fine and other commands work fine on all tenants including this one. Have no idea where to start.

Additional Information: I have 2 controllers that are clustered and haproxy in front of controllers. Found error on the other controllerr in nova-api.logs. Listed error below.

Using Icehouse and ubuntu 14.04

nova --debug list :

New session created for: (http://10.1.0.2:8774)
INFO (connectionpool:258) Starting new HTTP connection (1): 10.1.0.2
DEBUG (connectionpool:375) Setting read timeout to 600.0
DEBUG (connectionpool:415) "GET /v2/3bc42bbacbd341ccaaadf718f7484fe2/servers/detail HTTP/1.1" 500 128
RESP: [500] CaseInsensitiveDict({'date': 'Tue, 18 Nov 2014 16:36:55 GMT', 'content-length': '128', 'content-type': 'application/json; charset=UTF-8', 'x-compute-request-id': 'req-980a4a03-36e2-4212-b20c-8b05bda355f2'})
RESP BODY: {"computeFault": {"message": "The server has either erred or is incapable of performing the requested operation.", "code": 500}}

DEBUG (shell:777) The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-980a4a03-36e2-4212-b20c-8b05bda355f2)
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/novaclient/shell.py", line 774, in main
    OpenStackComputeShell().main(map(strutils.safe_decode, sys.argv[1:]))
  File "/usr/lib/python2.7/dist-packages/novaclient/shell.py", line 710, in main
    args.func(self.cs, args)
  File "/usr/lib/python2.7/dist-packages/novaclient/v1_1/shell.py", line 1138, in do_list
    search_opts=search_opts)
  File "/usr/lib/python2.7/dist-packages/novaclient/v1_1/servers.py", line 583, in list
    return self._list("/servers%s%s" % (detail, query_string), "servers")
  File "/usr/lib/python2.7/dist-packages/novaclient/base.py", line 64, in _list
    _resp, body = self.api.client.get(url)
  File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 283, in get
    return self._cs_request(url, 'GET', **kwargs)
  File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 260, in _cs_request
    **kwargs)
  File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 242, in _time_request
    resp, body = self.request(url, method, **kwargs)
  File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 236, in request
    raise exceptions.from_response(resp, body, url, method)
ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-980a4a03-36e2-4212-b20c-8b05bda355f2)
ERROR: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-980a4a03-36e2-4212-b20c-8b05bda355f2)

Nova-api.log:

2014-11-18 13:14:27.400 12147 ERROR nova.api.openstack [req-d9bb8b91-7405-4618-8b15-0db91b8afe7b f07d2a17b4324da6a6b13d470bcc84dd 3bc42bbacbd341ccaaadf718f7484fe2] Caught error: <html><body><h1>400 Bad request</h1>
Your browser sent an invalid request.
</body></html>

2014-11-18 13:14:27.400 12147 TRACE nova.api.openstack Traceback (most recent call last):
2014-11-18 13:14:27.400 12147 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/__init__.py", line 125, in __call__
2014-11-18 13:14:27.400 12147 TRACE nova.api.openstack     return req.get_response(self.application)
2014-11-18 13:14:27.400 12147 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1320, in ...
(more)
2014-11-14 13:17:20 -0500 received badge  Notable Question (source)
2014-11-14 13:16:49 -0500 received badge  Notable Question (source)
2014-10-28 09:44:11 -0500 received badge  Popular Question (source)
2014-10-27 18:43:43 -0500 commented answer Can not retrieve instance data

These do not apply to my issue. It appears it is only impacting 1 project. In addition, if I run command that retrieves information for all projects that will fail as well. Any nova or keystone command that does not pull specific information for this 1 project works.

2014-10-27 18:39:27 -0500 commented answer instance reboot failure when using ceph

I did not install cinder-volume on compute. I am using ceph for back ground storage, why would I need cinder-volume?