kolla-ansible redeploy single service on single node (gnocchi_metricd failure)

asked 2018-04-23 10:05:23 -0600

theque42 gravatar image

I've got a multinode cloud recently deployed with queens, with each compute/ctrl/neutron/storage serviced by two separate nodes. I've had to use the git-repo for kolla-ansible (stable/queens), since it always fails on db-issues otherwise)

It looks to be working now, but for some reason the gnocchi_metricd container is repetitively failing on ONE controller node.

2018-04-23 16:56:06,644 [220] ERROR    cotyledon._utils: Unhandled exception
Traceback (most recent call last):
  File "/var/lib/kolla/venv/lib/python2.7/site-packages/cotyledon/_utils.py", line 95, in exit_on_exception
    yield
  File "/var/lib/kolla/venv/lib/python2.7/site-packages/cotyledon/_service.py", line 139, in _run
    self.run()
  File "/var/lib/kolla/venv/lib/python2.7/site-packages/gnocchi/cli/metricd.py", line 76, in run
    self._configure()
  File "/var/lib/kolla/venv/lib/python2.7/site-packages/tenacity/__init__.py", line 214, in wrapped_f
    return self.call(f, *args, **kw)
  File "/var/lib/kolla/venv/lib/python2.7/site-packages/tenacity/__init__.py", line 295, in call
    start_time=start_time)
  File "/var/lib/kolla/venv/lib/python2.7/site-packages/tenacity/__init__.py", line 252, in iter
    return fut.result()
  File "/var/lib/kolla/venv/lib/python2.7/site-packages/concurrent/futures/_base.py", line 455, in result
    return self.__get_result()
  File "/var/lib/kolla/venv/lib/python2.7/site-packages/tenacity/__init__.py", line 298, in call
    result = fn(*args, **kwargs)
  File "/var/lib/kolla/venv/lib/python2.7/site-packages/gnocchi/cli/metricd.py", line 161, in _configure
    six.moves.range(self.incoming.NUM_SACKS))
  File "/var/lib/kolla/venv/lib/python2.7/site-packages/gnocchi/incoming/__init__.py", line 53, in NUM_SACKS
    raise SackDetectionError(e)

I've been trying to figure out what the difference is, in configuration of the two containers on CTRL-1 and CTRL-2, but I cant find anything except IP-addressing.

So...I would like to do something like

kolla-ansible -i multinode ReDeploy --only gnocchi_metricd

How can I do that?

Somewhat related to that, I've also been looking for how I would go about adding a new Openstack component, to my existing deployment. So if I deploy without, say for instance tacker, and then want to add tacker in afterwards, how? The references at https://docs.openstack.org/kolla-ansi... arent super clear since they say things like, run: "kolla-ansible deploy", but without any references to "-i multinode", and no description of what happens with all the already existing services?

Will a normal "kolla-ansible -i multinode deploy" ignore existing containers?

edit retag flag offensive close merge delete

Comments

Hello,

Did you find the answer to your question? i am also looking for the same information.

Vikrant_Aggarwal gravatar imageVikrant_Aggarwal ( 2018-05-12 20:44:01 -0600 )edit