Inconsistencies/issues "openstack compute service list"

asked 2018-03-21 14:25:53 -0500

molldk gravatar image

Hi,

I'm attempting a new install of OpenStack Queen on CentOS 7. Keystone and glance is all installed and working, however I experience problems with nova. I have followed the install guide on controller as well as a compute node. I specifically have issues with the nova-api, which throws errors when attempting to list services.

For example; some attempts give the following output:

~$ openstack compute service list
+----+------------------+---------------------+----------+---------+-------+----------------------------+
| ID | Binary           | Host                | Zone     | Status  | State | Updated At                 |
+----+------------------+---------------------+----------+---------+-------+----------------------------+
|  5 | nova-consoleauth | nocosvisor01        | internal | enabled | up    | 2018-03-21T18:56:12.000000 |
|  6 | nova-scheduler   | nocosvisor01        | internal | enabled | up    | 2018-03-21T18:56:08.000000 |
|  7 | nova-conductor   | nocosvisor01        | internal | enabled | up    | 2018-03-21T18:56:15.000000 |
|  8 | nova-compute     | nocosvisor03        | nova     | enabled | up    | 2018-03-21T18:56:10.000000 |
|  9 | nova-console     | nocosvisor01        | internal | enabled | up    | 2018-03-21T18:56:11.000000 |
+----+------------------+---------------------+----------+---------+-------+----------------------------+

While other attempts imediately followed, without any change in server, give this output:

~$ openstack compute service list
Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'sqlalchemy.exc.ProgrammingError'> (HTTP 500) (Request-ID: req-a038895b-29ed-4079-9b1e-c4b18868df47)

The nova-api.log contains this:

2018-03-21 19:56:28.255 3519 ERROR nova.api.openstack.wsgi ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table 'nova_api.services' doesn't exist") [SQL: u'SELECT services.created_at AS services_created_at, services.updated_at AS services_updated_at, services.deleted_at AS services_deleted_at, services.deleted AS services_deleted, services.id AS services_id, services.uuid AS services_uuid, services.host AS services_host, services.`binary` AS services_binary, services.topic AS services_topic, services.report_count AS services_report_count, services.disabled AS services_disabled, services.disabled_reason AS services_disabled_reason, services.last_seen_up AS services_last_seen_up, services.forced_down AS services_forced_down, services.version AS services_version \nFROM services \nWHERE services.deleted = %(deleted_1)s'] [parameters: {u'deleted_1': 0}] (Background on this error at: http://sqlalche.me/e/f405)
2018-03-21 19:56:28.255 3519 ERROR nova.api.openstack.wsgi 
2018-03-21 19:56:28.256 3519 INFO nova.api.openstack.wsgi [req-a038895b-29ed-4079-9b1e-c4b18868df47 4b4d1fcefc9948b8aa3c904f2fd7bbf6 ec66dbed6fbb40bb8db52aebc9b9b5b0 - default default] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'sqlalchemy.exc.ProgrammingError'>
2018-03-21 19:56:28.257 3519 INFO nova.osapi_compute.wsgi.server [req-a038895b-29ed-4079-9b1e-c4b18868df47 4b4d1fcefc9948b8aa3c904f2fd7bbf6 ec66dbed6fbb40bb8db52aebc9b9b5b0 - default default] 10.131.192.49 "GET /v2.1/os-services HTTP/1.1" status: 500 len: 638 time: 0.1877520

Is it correct that the table services should be in the "nova_api" database? I can't find the table through mysql client, however the tables seems to be created by "nova-manage db sync". I can find the services table in the "nova" database however. I'm a bit clueless as where to continue the search from here on.

nocosvisor01 is my controller and nocosvisor03 is compute. Passwords in config has been substituted. I have ran api_db sync, cell_v2 map_cell0 and db sync commands after every change in nova.conf.

Thank you, appreciate your advices.

root@nocosvisor01:~# nova-manage cell_v2 list_cells
+-------+--------------------------------------+--------------------------------------+---------------------------------------------------+
+-------+--------------------------------------+--------------------------------------+---------------------------------------------------+
|  Name |                 UUID                 |            Transport URL             |                Database Connection                |
| cell0 | 00000000-0000-0000-0000-000000000000 |                none:/                | mysql+pymysql://nova:****@nocosvisor01/nova_cell0 |
| cell1 | 71501ee3-12f2-4520-bcf9-40d160f295b7 | rabbit://openstack:****@nocosvisor01 |    mysql+pymysql://nova:****@nocosvisor01/nova    |
+-------+--------------------------------------+--------------------------------------+---------------------------------------------------+

My nova.conf:

[DEFAULT]
enabled_apis=osapi_compute ...
(more)
edit retag flag offensive close merge delete

Comments

hi @molldk - Thanks for such a detailed question! Are you still running into this problem? If so, do you have any other solutions that you've tried or logs you can provide? I'll run them past the community to see if anyone can help.

mary_grace gravatar imagemary_grace ( 2018-06-26 00:06:48 -0500 )edit