Ask Your Question
0

WARNING horizon.tables.actions Action (u'scheduled deletion of instance', u'external-testing') Failed for Instance could not be found. (HTTP 404) [closed]

asked 2017-02-27 19:59:36 -0600

bcollins gravatar image

after upgrade from newton to ocata i am not able to power on instances, create instances or delete instances....

2017-02-28 00:43:25,837 7853 WARNING horizon.tables.actions Action (u'scheduled deletion of instance', u'external-testing') Failed for Instance 23a8a1d2-bfe9-432d-ab14-b9d89c352345 could not be found. (HTTP 404) (Request-ID: req-918cee88-4c06-4737-aadd-a1e507431f7e).

No idea but will start debugging to add more.

edit retag flag offensive reopen merge delete

Closed for the following reason question is off-topic or not relevant by bcollins
close date 2017-02-28 18:01:04.921218

Comments

Have you run nova-manage cell_v2 discover_host? This only happens on horizon or also with CLI?

Eduardo Gonzalez gravatar imageEduardo Gonzalez ( 2017-02-28 01:48:43 -0600 )edit

i dropped cell0 and api db and reran packstack. it should have done this for me. but since you say thing i will look at the cells and go through that method.

bcollins gravatar imagebcollins ( 2017-02-28 08:18:01 -0600 )edit

2017-02-28 10:22:09.299 5975 ERROR nova.api.openstack.extensions AccessRefused: (0, 0): (403) ACCESS_REFUSED - Login was refused using authentication mechanism AMQPLAIN. For details see the broker logfile.

need to see how to update this

bcollins gravatar imagebcollins ( 2017-02-28 09:27:05 -0600 )edit
add a comment

1 answer

Sort by ยป oldest newest most voted
0

answered 2017-02-28 14:48:47 -0600

bcollins gravatar image

updated 2017-02-28 17:46:41 -0600

*cell mapping had guest:guest *

==> /var/log/nova/nova-conductor.log <==
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server [req-08aa3070-7af1-40d7-9d47-418535dfaae7 - - - - -] Exception during message handling
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 155, in _process_incoming
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 222, in dispatch
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 192, in _do_dispatch
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/conductor/manager.py", line 961, in schedule_and_build_instances
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server     limits=host['limits'])
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/compute/rpcapi.py", line 1083, in build_and_run_instance
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server     limits=limits)
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line 147, in cast
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server     self.transport._send(self.target, msg_ctxt, msg, retry=self.retry)
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 97, in _send
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server     timeout=timeout, retry=retry)
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 458, in send
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server     retry=retry)
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 419, in _send
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server     with self._get_connection(rpc_common.PURPOSE_SEND) as conn:
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 374, in _get_connection
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server     purpose=purpose)
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/common.py", line 399, in __init__
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server     self.connection = connection_pool.get()
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/pool.py", line 107, in get
2017-02-28 15:44:52.455 10903 ERROR oslo_messaging.rpc.server     return self.create ...
(more)
edit flag offensive delete link more

Comments

1

Don't know if this is the issue, but nova ocata uses transport_url option in default section to connect with rabbitmq, any rabbitmq config out of that option is ignored. Probably the map was created with default transport_url localhost guest:guest

Eduardo Gonzalez gravatar imageEduardo Gonzalez ( 2017-03-01 03:40:13 -0600 )edit

that is exactly what happened!!! lol i searched and searched for this guest entry and found it in the db under nova_api.cell_mappings

bcollins gravatar imagebcollins ( 2017-03-01 07:55:52 -0600 )edit

or simply use nova-manage cell_v2 list_cells --verbose (will output db mappings and rabbit connection for each cell)

Eduardo Gonzalez gravatar imageEduardo Gonzalez ( 2017-03-01 08:30:31 -0600 )edit
add a comment

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

subscribe to rss feed

Stats

Asked: 2017-02-27 19:59:36 -0600

Seen: 190 times

Last updated: Feb 28 '17

Related questions

Unable to launch instances

ocata to pike upgrade

nova hypervisor-stats negative values

where does nova.conf comes in for nova services?

AggregateImagePropertiesIsolation returns hosts that shouldn't be applicable

VM creation fail : No vaild host was found

Unable to log into Horizon in Ocata. Previous solution doesn't work

Build of instance re-shceduled: Image could not be found - but the image exists and is active

Volume creation with size more than 20GB is failing in OCATA

Error executing Gnocchi on Devstack Ocata