Error on live migration

asked 2018-10-09 10:51:59 -0600

Ed365 gravatar image

Hi,

Have set up a test lab environment for OpenStack Queens. Installed on 3 physical servers using MaaS and JuJu. Using ceph for storage. I have 2x nova compute nodes.

Installation has gone fine, and I can stand up VMs on both nova nodes. However, if I try to live migrate, I get the following error:

emcs@maasjuju:~/osbundle$ openstack server migrate  ac92b7c2-aa5d-4d8b-9f22-709b81c7fefd  --shared-migration --live new-elf
Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'MigrationError_Remote'> (HTTP 500) (Request-ID: req-439233bc-193b-4c70-9fb6-1636306ce000)

Looking at the nova-os-api logs, I see the following:

2018-10-09 15:27:42.274 391052 INFO nova.osapi_compute.wsgi.server [req-b5e0d129-2246-4dc5-8063-3cd8d673ac87 09c56d2eef9f4f82b65676723041831a 007b8f410b2a4f93a35fcc15c256b86d - 108629306a1c411b8e7b152ee645e5b2 108629306a1c411b8e7b152ee645e5b2] 192.168.10.32 "GET /v2/007b8f410b2a4f93a35fcc15c256b86d HTTP/1.1" status: 404 len: 382 time: 0.0772069
2018-10-09 15:27:42.282 391052 INFO nova.osapi_compute.wsgi.server [req-f3243e9f-faa4-447f-ace6-b40ab8629daf 09c56d2eef9f4f82b65676723041831a 007b8f410b2a4f93a35fcc15c256b86d - 108629306a1c411b8e7b152ee645e5b2 108629306a1c411b8e7b152ee645e5b2] 192.168.10.32 "GET /v2/ HTTP/1.1" status: 200 len: 641 time: 0.0045211
2018-10-09 15:27:42.802 391052 INFO nova.osapi_compute.wsgi.server [req-6b829d7c-3cf3-434d-ae84-64c745f299a8 09c56d2eef9f4f82b65676723041831a 007b8f410b2a4f93a35fcc15c256b86d - 108629306a1c411b8e7b152ee645e5b2 108629306a1c411b8e7b152ee645e5b2] 192.168.10.32 "GET /v2/007b8f410b2a4f93a35fcc15c256b86d/servers/ac92b7c2-aa5d-4d8b-9f22-709b81c7fefd HTTP/1.1" status: 200 len: 4436 time: 0.3028529
2018-10-09 15:27:42.936 391052 INFO nova.osapi_compute.wsgi.server [req-f1697291-38a2-4d04-a0c7-6e8ac45ae2d8 09c56d2eef9f4f82b65676723041831a 007b8f410b2a4f93a35fcc15c256b86d - 108629306a1c411b8e7b152ee645e5b2 108629306a1c411b8e7b152ee645e5b2] 192.168.10.32 "POST /v2/007b8f410b2a4f93a35fcc15c256b86d/servers/ac92b7c2-aa5d-4d8b-9f22-709b81c7fefd/action HTTP/1.1" status: 202 len: 267 time: 0.1284850
2018-10-09 15:27:53.009 391054 INFO nova.osapi_compute.wsgi.server [req-2a9c1850-acac-4a01-96e4-e52cc30b0dd2 09c56d2eef9f4f82b65676723041831a 007b8f410b2a4f93a35fcc15c256b86d - 108629306a1c411b8e7b152ee645e5b2 108629306a1c411b8e7b152ee645e5b2] 192.168.10.32 "GET /v2/007b8f410b2a4f93a35fcc15c256b86d/servers/ac92b7c2-aa5d-4d8b-9f22-709b81c7fefd HTTP/1.1" status: 200 len: 1871 time: 0.3795161
2018-10-09 15:27:55.093 391054 ERROR nova.api.openstack.wsgi [req-439233bc-193b-4c70-9fb6-1636306ce000 09c56d2eef9f4f82b65676723041831a 007b8f410b2a4f93a35fcc15c256b86d - 108629306a1c411b8e7b152ee645e5b2 108629306a1c411b8e7b152ee645e5b2] Unexpected exception in API method: MigrationError_Remote: Migration error: no such option keystone_authtoken in group [DEFAULT]
Traceback (most recent call last):

  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming
    res = self.dispatcher.dispatch(message)

  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 265, in dispatch
    return self._do_dispatch(endpoint, method, ctxt, args)

  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 194, in _do_dispatch
    result = func(ctxt, **new_args)

  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 226, in inner
    return func(*args, **kwargs)

  File "/usr/lib/python2.7/dist-packages/nova/conductor/manager.py", line 86, in wrapper
    return fn(self, context, *args, **kwargs)

  File "/usr/lib/python2.7/dist-packages/nova/compute/utils.py", line 1141, in decorated_function
    return function(self, context, *args, **kwargs)

  File "/usr/lib/python2.7/dist-packages/nova/conductor/manager.py", line 281, in migrate_server
    block_migration, disk_over_commit, request_spec)

  File "/usr/lib/python2.7/dist-packages/nova/conductor/manager.py", line 454, in _live_migrate
    raise exception.MigrationError(reason=six.text_type(ex))

MigrationError: Migration error: no such option keystone_authtoken in group [DEFAULT]
2018-10-09 15:27:55.093 391054 ERROR nova.api.openstack.wsgi Traceback (most recent call last):
2018-10-09 15:27:55.093 391054 ERROR nova.api.openstack.wsgi   File ...
(more)
edit retag flag offensive close merge delete