Ask Your Question
1

Failed instance launch

asked 2018-11-18 15:46:10 -0500

acaseng gravatar image

I have just installed Queens on ubuntu 16.04, but I get an error state on creating an instance. I did attempt to see if the compute nodes are communicating with the placement api and it looks like they are not. Not sure what to do at this point any help would be appreciated.

ubuntu@radosgw3:~$ sudo nova-status upgrade check Option "enable" from group "cells" is deprecated for removal (Cells v1 is being replaced with Cells v2.). Its value may be silently ignored in the future. +-------------------------------------------------------------------+ | Upgrade Check Results | +-------------------------------------------------------------------+ | Check: Cells v2 | | Result: Success | | Details: None | +-------------------------------------------------------------------+ | Check: Placement API | | Result: Success | | Details: None | +-------------------------------------------------------------------+ | Check: Resource Providers | | Result: Warning | | Details: There are no compute resource providers in the Placement | | service but there are 3 compute nodes in the deployment. | | This means no compute nodes are reporting into the | | Placement service and need to be upgraded and/or fixed. | | See | | https://docs.openstack.org/nova/latest/user/placement.html (https://docs.openstack.org/nova/lates...) | | for more details. | +-------------------------------------------------------------------+ | Check: Ironic Flavor Migration | | Result: Success | | Details: None | +-------------------------------------------------------------------+ | Check: API Service Version | | Result: Success | | Details: None | +-------------------------------------------------------------------+

When I attempt to launch and instance I get the following:

Traceback (most recent call last):

File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 226, in inner return func(args, *kwargs)

File "/usr/lib/python2.7/dist-packages/nova/scheduler/manager.py", line 139, in select_destinations raise exception.NoValidHost(reason="")

NoValidHost: No valid host was found. 2018-11-18 16:16:41.361 1295752 ERROR nova.conductor.manager Traceback (most recent call last): 2018-11-18 16:16:41.361 1295752 ERROR nova.conductor.manager File "/usr/lib/python2.7/dist-packages/nova/conductor/manager.py", line 1120, in schedule_and_build_instances 2018-11-18 16:16:41.361 1295752 ERROR nova.conductor.manager instance_uuids, return_alternates=True) 2018-11-18 16:16:41.361 1295752 ERROR nova.conductor.manager File "/usr/lib/python2.7/dist-packages/nova/conductor/manager.py", line 717, in _schedule_instances 2018-11-18 16:16:41.361 1295752 ERROR nova.conductor.manager return_alternates=return_alternates) 2018-11-18 16:16:41.361 1295752 ERROR nova.conductor.manager File "/usr/lib/python2.7/dist-packages/nova/scheduler/utils.py", li ne 787, in wrapped 2018-11-18 16:16:41.361 1295752 ERROR nova.conductor.manager return func(args, *kwargs) 2018-11-18 16:16:41.361 1295752 ERROR nova.conductor.manager File "/usr/lib/python2.7/dist-packages/nova/scheduler/client/__init __.py", line 53, in select_destinations 2018-11-18 16:16:41.361 1295752 ERROR nova.conductor.manager instance_uuids, return_objects, return_alternates) 2018-11-18 16:16:41.361 1295752 ERROR nova.conductor.manager File "/usr/lib/python2.7/dist-packages/nova/scheduler/client/__init __.py", line 37, in __run_method 2018-11-18 16:16:41.361 1295752 ERROR nova.conductor.manager return getattr(self.instance, __name)(args, *kwargs) 2018-11-18 16:16:41.361 1295752 ERROR nova.conductor.manager File "/usr/lib/python2.7/dist-packages/nova/scheduler/client/query. py", line 42, in select_destinations 2018-11-18 16:16:41.361 1295752 ERROR nova.conductor.manager instance_uuids, return_objects, return_alternates) 2018-11-18 16:16:41.361 1295752 ERROR nova.conductor.manager File "/usr/lib ... (more)

edit retag flag offensive close merge delete

Comments

Are your compute nodes up and running? Run a systemctl status nova-compute on the node and see if it's even running. Most times it isn't and you need to resolve whatever is preventing it from running.

reynoni gravatar imagereynoni ( 2018-11-19 06:51:36 -0500 )edit

2 answers

Sort by ยป oldest newest most voted
2

answered 2018-11-19 07:14:07 -0500

acaseng gravatar image

Thank you for reaching out. But I do not see anything in the rabbit logs. I do not see anything in my nova-compute logs except resource tracking information. All my nova-compute services are active. I did try a tcpdump when I restarted the nova-compute services to see if they are communicating to the placement-api and I do not see that any communication. Is the dependency for resource providers to be known dependent on the compute nodes registering with the placement-api?

My logs for nova-placement are as follows:

2018-11-19 07:54:08.236 1306767 WARNING oslo_config.cfg [-] Option "firewall_driver" from group "DEFAULT" is deprecated for removal (nova-network is deprecated, as are any related configuration options.). Its value may be silently ignored in the future. 2018-11-19 07:54:08.243 1306767 WARNING oslo_config.cfg [-] Option "use_neutron" from group "DEFAULT" is deprecated for removal (nova-network is deprecated, as are any related configuration options.). Its value may be silently ignored in the future. 2018-11-19 07:54:08.257 1306767 WARNING oslo_config.cfg [-] Option "url" from group "neutron" is deprecated for removal (Endpoint lookup uses the service catalog via common keystoneauth1 Adapter configuration options. In the current release, "url" will override this behavior, but will be ignored and/or removed in a future release. To achieve the same result, use the endpoint_override option instead.). Its value may be silently ignored in the future. 2018-11-19 07:54:08.269 1306767 WARNING oslo_config.cfg [-] Option "enable" from group "cells" is deprecated for removal (Cells v1 is being replaced with Cells v2.). Its value may be silently ignored in the future. 2018-11-19 07:54:08.288 1306767 WARNING keystonemiddleware.auth_token [-] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. 2018-11-19 07:54:08.293 1306767 WARNING keystonemiddleware.auth_token [-] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint 2018-11-19 07:54:09.422 1306767 INFO nova.api.openstack.placement.requestlog [req-8716d635-619e-4354a0fa-203c51ce43e4 ed991fcebfaf499c8d099cdbe3c37d17 8e69897ae2b840628cff48b229554b5e - default default] 10.0.4.33 "GET /allocation_candidates?limit=1000&resources=DISK_GB%3A1%2CMEMORY_MB%3A512%2CVCPU%3A1" status: 200 len: 53 microversion: 1.17

My logs for rabbit are as follows:

=INFO REPORT==== 19-Nov-2018::07:54:03 === accepting AMQP connection <0.24054.7> (10.0.4.33:42482 -> 10.0.4.32:5672)

=INFO REPORT==== 19-Nov-2018::07:54:03 === Connection <0.24054.7> (10.0.4.33:42482 -> 10.0.4.32:5672) has a client-provided name: nova-api:1295664:b588e4c1-4c05-4a8c-8ee0-ca255791185e

=INFO REPORT==== 19-Nov-2018::07:54:03 === connection <0.24054.7> (10.0.4.33:42482 -> 10.0.4.32:5672 - nova-api:1295664:b588e4c1-4c05-4a8c-8ee0-ca255791185e): user 'openstack' authenticated and granted access to vhost '/'

=INFO REPORT==== 19-Nov-2018::07:54:03 === accepting AMQP connection <0.24065.7> (10.0.4.33:42488 -> 10.0.4.32:5672)

=INFO REPORT==== 19-Nov-2018::07:54:03 === Connection <0.24065.7> (10.0.4.33:42488 -> 10.0.4.32:5672) has a client-provided name: nova-conductor:1295742:15741d03-7b1a-4ae5-b3a9-e76a4a6f32a9 ... (more)

edit flag offensive delete link more

Comments

Did you run su -s /bin/sh -c "nova-manage cell_v2 discover_hosts --verbose" nova on the controller node to discover the compute nodes and add them to the database?

reynoni gravatar imagereynoni ( 2018-11-19 07:25:24 -0500 )edit

I did run that based on the documentation. My three compute nodes are in the DB. I am still confused on why the compute node will not register to the placement api. I did see a former post with the same issue about DNS lookup but my forward and reverse are correct in DNS.

acaseng gravatar imageacaseng ( 2018-11-19 07:39:55 -0500 )edit

Is there a way to a manually register the compute node to the placement-api?

acaseng gravatar imageacaseng ( 2018-11-19 07:41:16 -0500 )edit

So when you run nova-manage cell_v2 list_hosts on the controller node, your compute nodes show up? but when you run openstack compute service list they do not show up?

reynoni gravatar imagereynoni ( 2018-11-19 08:43:05 -0500 )edit
0

answered 2018-11-19 01:18:56 -0500

updated 2018-11-21 05:33:30 -0500

check the connectivity between the compute nodes you have, and check the rabbitmq-server logs, because if rabbit-mq fails during the vm's starting stage it will fail,if rabbit-mq is the problem restart the rabbit-mq service. if you changed the hostname, try to reset the rabbit-mq credentials. Or maybe The compute and controller nodes had FQDNs configured for their hostnames. The contents of /etc/hostname, and the value returned by hostname were FQDNs.If you have no data in tables,, dropping all the SQL tables for Nova, nova_api, and nova_cell0, and again sync the database and restart the service

sync commands

su -s /bin/sh -c "nova-manage api_db sync" nova

su -s /bin/sh -c "nova-manage db sync" nova

Verify nova cell0 and cell1 are registered correctly:

nova-manage cell_v2 list_cells image descriptionin Nova database there is a table compute node will there,in that table change mapped column's value from 0 to 1

In nova api-database host mapping table will there,you can manually map your hosts in that table

edit flag offensive delete link more

Comments

Thanks so much for giving more suggestions. I looked in my compute_node table in the nova database and all three nodes are listed with mapped set to 1. My host_mappings table is populated in the nova_api DB. I fixed a DNS issues but still no luck.

acaseng gravatar imageacaseng ( 2018-11-19 14:33:23 -0500 )edit

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

Stats

Asked: 2018-11-18 15:46:10 -0500

Seen: 259 times

Last updated: Nov 21 '18