Ask Your Question
1

compute node down, db error

asked 2016-05-25 14:14:37 -0500

cloverandgrape gravatar image

updated 2016-06-01 13:36:36 -0500

smaffulli gravatar image

I am trying to hook in a new compute node, but it is stuck in the "Down" state.

This error is showing up in the conductor logs -- any thoughts?

==> ./nova-conductor.log <==
2016-05-25 12:08:32.364 1582 ERROR oslo_db.sqlalchemy.exc_filters [req-61230b63-1b37-496d-896d-dd9308860d21 - - - - -] DBAPIError exception wrapped from (pymysql.err.InternalError) (1241, u'Operand should contain 1 column(s)') [SQL: u'SELECT migrations.created_at AS migrations_created_at, migrations.updated_at AS migrations_updated_at, migrations.deleted_at AS migrations_deleted_at, migrations.deleted AS migrations_deleted, migrations.id AS migrations_id, migrations.source_compute AS migrations_source_compute, migrations.dest_compute AS migrations_dest_compute, migrations.source_node AS migrations_source_node, migrations.dest_node AS migrations_dest_node, migrations.dest_host AS migrations_dest_host, migrations.old_instance_type_id AS migrations_old_instance_type_id, migrations.new_instance_type_id AS migrations_new_instance_type_id, migrations.instance_uuid AS migrations_instance_uuid, migrations.status AS migrations_status, migrations.migration_type AS migrations_migration_type, migrations.hidden AS migrations_hidden \nFROM migrations \nWHERE migrations.deleted = %s AND migrations.status = %s AND migrations.source_compute = %s AND migrations.migration_type = %s'] [parameters: (0, [u'accepted', u'done'], u'os-kvm-compute02', u'evacuation')]
2016-05-25 12:08:32.364 1582 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
2016-05-25 12:08:32.364 1582 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
2016-05-25 12:08:32.364 1582 ERROR oslo_db.sqlalchemy.exc_filters     context)
2016-05-25 12:08:32.364 1582 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
2016-05-25 12:08:32.364 1582 ERROR oslo_db.sqlalchemy.exc_filters     cursor.execute(statement, parameters)
2016-05-25 12:08:32.364 1582 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 132, in execute
2016-05-25 12:08:32.364 1582 ERROR oslo_db.sqlalchemy.exc_filters     result = self._query(query)
2016-05-25 12:08:32.364 1582 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 271, in _query
2016-05-25 12:08:32.364 1582 ERROR oslo_db.sqlalchemy.exc_filters     conn.query(q)
2016-05-25 12:08:32.364 1582 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 726, in query
2016-05-25 12:08:32.364 1582 ERROR oslo_db.sqlalchemy.exc_filters     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
2016-05-25 12:08:32.364 1582 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 861, in _read_query_result
2016-05-25 12:08:32.364 1582 ERROR oslo_db.sqlalchemy.exc_filters     result.read()
2016-05-25 12:08:32.364 1582 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1064, in read
2016-05-25 12:08:32.364 1582 ERROR oslo_db.sqlalchemy.exc_filters     first_packet = self.connection._read_packet()
2016-05-25 12:08:32.364 1582 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 826, in _read_packet
2016-05-25 12:08:32.364 1582 ERROR oslo_db.sqlalchemy.exc_filters     packet.check_error()
2016-05-25 12:08:32.364 1582 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 370, in check_error
2016-05-25 12:08:32.364 1582 ERROR oslo_db.sqlalchemy.exc_filters     raise_mysql_exception(self._data)
2016-05-25 12:08:32.364 ...
(more)
edit retag flag offensive close merge delete

Comments

1

Check the database connection info at nova.conf

Eduardo Gonzalez gravatar imageEduardo Gonzalez ( 2016-05-26 01:05:50 -0500 )edit

This happened to me today as well, adding a new Liberty node to an existing setup. Hopefully someone can resolve! nova.conf looks correct, same as all of my nodes.

Endarfrost gravatar imageEndarfrost ( 2016-05-30 18:42:50 -0500 )edit

After further inspection of both this log, and my own logs, I've noticed there's a "u" character before some of the variables, where it looks quite out of place. note here [SQL: u' SELECT ... as well as here [parameters: (0, ['accepted', u'done'], u'os-kvm-compute02', u'evacuation')

Endarfrost gravatar imageEndarfrost ( 2016-05-31 12:46:11 -0500 )edit

I have the same problem!

igoshin-r gravatar imageigoshin-r ( 2016-06-01 09:05:21 -0500 )edit

But with the old version NOVA-COMPUTE is no such problem

igoshin-r gravatar imageigoshin-r ( 2016-06-01 09:07:06 -0500 )edit

2 answers

Sort by ยป oldest newest most voted
1

answered 2016-06-01 15:39:56 -0500

cloverandgrape gravatar image

The issue was that I had a different point release of nova-compute on my controller and the new node.

edit flag offensive delete link more

Comments

thats the ticket.

ggolin gravatar imageggolin ( 2016-09-23 10:48:01 -0500 )edit
2

answered 2016-06-01 13:52:56 -0500

Endarfrost gravatar image

I ended up fixing it, my versions were incorrect. I had installed 2:12.03 on the new compute node, and have 2:12.01 versions on my controller node. By upgrading my controller, and existing nodes, it solved my issues.

edit flag offensive delete link more

Comments

I have encountered the same problem, My Controller Nova is 2:12.0.0 & My new compute node is 2:12.0.3 ...I need your help in downgrading my new compute node's version to same as controller's or the other existing compute nodes (2:12.0.1)

ajithpathiyil gravatar imageajithpathiyil ( 2016-06-22 04:47:29 -0500 )edit

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

3 followers

Stats

Asked: 2016-05-25 14:14:37 -0500

Seen: 1,025 times

Last updated: Jun 01 '16