Ask Your Question
0

WARNING horizon.tables.actions Action (u'scheduled deletion of instance', u'external-testing') Failed for Instance could not be found. (HTTP 404) [closed]

asked 2017-02-27 19:59:36 -0500

bcollins gravatar image

after upgrade from newton to ocata i am not able to power on instances, create instances or delete instances....

2017-02-28 00:43:25,837 7853 WARNING horizon.tables.actions Action (u'scheduled deletion of instance', u'external-testing') Failed for Instance 23a8a1d2-bfe9-432d-ab14-b9d89c352345 could not be found. (HTTP 404) (Request-ID: req-918cee88-4c06-4737-aadd-a1e507431f7e).

No idea but will start debugging to add more.

edit retag flag offensive reopen merge delete

Closed for the following reason question is off-topic or not relevant by bcollins
close date 2017-02-28 18:01:04.921218

Comments

Have you run nova-manage cell_v2 discover_host? This only happens on horizon or also with CLI?

Eduardo Gonzalez gravatar imageEduardo Gonzalez ( 2017-02-28 01:48:43 -0500 )edit

i dropped cell0 and api db and reran packstack. it should have done this for me. but since you say thing i will look at the cells and go through that method.

bcollins gravatar imagebcollins ( 2017-02-28 08:18:01 -0500 )edit

2017-02-28 10:22:09.299 5975 ERROR nova.api.openstack.extensions AccessRefused: (0, 0): (403) ACCESS_REFUSED - Login was refused using authentication mechanism AMQPLAIN. For details see the broker logfile.

need to see how to update this

bcollins gravatar imagebcollins ( 2017-02-28 09:27:05 -0500 )edit
add a comment

1 answer

Sort by ยป oldest newest most voted
0

answered 2017-02-28 14:48:47 -0500

bcollins gravatar image

updated 2017-02-28 17:46:41 -0500

*cell mapping had guest:guest *

==> /var/log/nova/nova-conductor.log <==
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server [req-08aa3070-7af1-40d7-9d47-418535dfaae7 - - - - -] Exception during message handling
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 155, in _process_incoming
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 222, in dispatch
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 192, in _do_dispatch
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/conductor/manager.py", line 961, in schedule_and_build_instances
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server     limits=host['limits'])
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/compute/rpcapi.py", line 1083, in build_and_run_instance
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server     limits=limits)
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line 147, in cast
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server     self.transport._send(self.target, msg_ctxt, msg, retry=self.retry)
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 97, in _send
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server     timeout=timeout, retry=retry)
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 458, in send
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server     retry=retry)
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 419, in _send
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server     with self._get_connection(rpc_common.PURPOSE_SEND) as conn:
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 374, in _get_connection
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server     purpose=purpose)
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/common.py", line 399, in __init__
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server     self.connection = connection_pool.get()
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/pool.py", line 107, in get
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server     return self.create ...
(more)
edit flag offensive delete link more

Comments

1

Don't know if this is the issue, but nova ocata uses transport_url option in default section to connect with rabbitmq, any rabbitmq config out of that option is ignored. Probably the map was created with default transport_url localhost guest:guest

Eduardo Gonzalez gravatar imageEduardo Gonzalez ( 2017-03-01 03:40:13 -0500 )edit

that is exactly what happened!!! lol i searched and searched for this guest entry and found it in the db under nova_api.cell_mappings

bcollins gravatar imagebcollins ( 2017-03-01 07:55:52 -0500 )edit

or simply use nova-manage cell_v2 list_cells --verbose (will output db mappings and rabbit connection for each cell)

Eduardo Gonzalez gravatar imageEduardo Gonzalez ( 2017-03-01 08:30:31 -0500 )edit
add a comment

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

subscribe to rss feed

Stats

Asked: 2017-02-27 19:59:36 -0500

Seen: 250 times

Last updated: Feb 28 '17

Related questions

ocata to pike upgrade

Upgrade from ocata to pike in centos7???

Is there a fix for the oslo errors in nova-scheduler.log?

Creation of service project in keystone fails with error 'The request you have made requires authentication. (HTTP 401)'

Neutron doesn't know what lbaas is

OpenStack API versions and release content

Updating nova resulted in opensatck server error.

Openstack Upgrade HAVANA -> ICEHOUSE RDO

Dashboard cannot access identity tab

Unable to launch nova-scheduler and nova-conductor services