Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

live migration failed with error http 400

Hi All,

I deployed openstack based on icehouse and having a problem with live migration, instance status stays at "Migrating" forever and I get the following error:

#root@control:~# nova live-migration 3e52960e-659c-44f6-85bc-dbd5fc3ba66e compute1 ERROR: Live migration of instance 3e52960e-659c-44f6-85bc-dbd5fc3ba66e to host compute1 failed (HTTP 400) (Request-ID: req-49dd8597-1462-440a-a964-593a93bcc477)

Background: Ubuntu 14.04 LTS 4 nodes, control/network, and 3 compute nodes. libvirt0 1.2.2-0ubuntu13.1 KVM as hypervisor on physical HW Shared storage is used and mounted at /var/lib/nova/instances Steps followed to enable live migration is located here: http://docs.openstack.org/admin-guide-cloud/content/section_configuring-compute-migrations.html

Error in nova-api: 2014-06-21 20:18:41.713 25566 ERROR nova.api.openstack.compute.contrib.admin_actions [req-49dd8597-1462-440a-a964-593a93bcc477 856beebcd4f9480390dc185626212481 cd30d2f85a114cb2b1fc6a699475f603] Live migration of instance 3e52960e-659c-44f6-85bc-dbd5fc3ba66e to host compute1 failed 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions Traceback (most recent call last): 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/contrib/admin_actions.py", line 338, in _migrate_live 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions disk_over_commit, host) 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 218, in _wrapped 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions return fn(self, context, instance, args, *kwargs) 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 172, in inner 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions return f(self, context, instance, args, *kw) 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 3019, in live_migrate 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions disk_over_commit=disk_over_commit) 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions File "/usr/lib/python2.7/dist-packages/nova/conductor/api.py", line 387, in live_migrate_instance 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions block_migration, disk_over_commit, None) 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions File "/usr/lib/python2.7/dist-packages/nova/conductor/rpcapi.py", line 476, in migrate_server 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions reservations=reservations) 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/client.py", line 150, in call 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions wait_for_reply=True, timeout=timeout) 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions File "/usr/lib/python2.7/dist-packages/oslo/messaging/transport.py", line 90, in _send 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions timeout=timeout) 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 412, in send 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions return self._send(target, ctxt, message, wait_for_reply, timeout) 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 403, in _send 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions result = self._waiter.wait(msg_id, timeout) 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 267, in wait 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions reply, ending = self._poll_connection(msg_id, timeout) 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 217, in _poll_connection 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions % msg_id) 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions MessagingTimeout: Timed out waiting for a reply to message ID e27b729b5321406e8dd63db68d9628b3 2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions

Thank you in advance for your help

Raouf

live migration failed with error http 400

Hi All,

I deployed openstack based on icehouse and having a problem with live migration, instance status stays at "Migrating" forever and I get the following error:

#root@control:~#

**#root@control:~# nova live-migration 3e52960e-659c-44f6-85bc-dbd5fc3ba66e compute1
ERROR: Live migration of instance 3e52960e-659c-44f6-85bc-dbd5fc3ba66e to host compute1 failed (HTTP 400) (Request-ID: req-49dd8597-1462-440a-a964-593a93bcc477)

req-49dd8597-1462-440a-a964-593a93bcc477)**

Background: Ubuntu 14.04 LTS 4 nodes, control/network, and 3 compute nodes. libvirt0 1.2.2-0ubuntu13.1 KVM as hypervisor on physical HW Shared storage is used and mounted at /var/lib/nova/instances Steps followed to enable live migration is located here: http://docs.openstack.org/admin-guide-cloud/content/section_configuring-compute-migrations.html

Error in nova-api: nova-api:

2014-06-21 20:18:41.713 25566 ERROR nova.api.openstack.compute.contrib.admin_actions [req-49dd8597-1462-440a-a964-593a93bcc477 856beebcd4f9480390dc185626212481 cd30d2f85a114cb2b1fc6a699475f603] Live migration of instance 3e52960e-659c-44f6-85bc-dbd5fc3ba66e to host compute1 failed
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions Traceback (most recent call last):
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/contrib/admin_actions.py", line 338, in _migrate_live
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions     disk_over_commit, host)
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 218, in _wrapped
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions     return fn(self, context, instance, args, *kwargs)
*args, **kwargs)
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 172, in inner
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions     return f(self, context, instance, args, *kw)
*args, **kw)
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 3019, in live_migrate
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions     disk_over_commit=disk_over_commit)
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions   File "/usr/lib/python2.7/dist-packages/nova/conductor/api.py", line 387, in live_migrate_instance
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions     block_migration, disk_over_commit, None)
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions   File "/usr/lib/python2.7/dist-packages/nova/conductor/rpcapi.py", line 476, in migrate_server
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions     reservations=reservations)
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/client.py", line 150, in call
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions     wait_for_reply=True, timeout=timeout)
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions   File "/usr/lib/python2.7/dist-packages/oslo/messaging/transport.py", line 90, in _send
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions     timeout=timeout)
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 412, in send
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions     return self._send(target, ctxt, message, wait_for_reply, timeout)
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 403, in _send
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions     result = self._waiter.wait(msg_id, timeout)
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 267, in wait
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions     reply, ending = self._poll_connection(msg_id, timeout)
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 217, in _poll_connection
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions     % msg_id)
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions MessagingTimeout: Timed out waiting for a reply to message ID e27b729b5321406e8dd63db68d9628b3
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions

nova.api.openstack.compute.contrib.admin_actions

Thank you in advance for your help

Raouf

live migration failed with error http 400

Hi All,

I deployed openstack based on icehouse and having a problem with live migration, instance status stays at "Migrating" forever and I get the following error:

**#root@control:~# nova live-migration 3e52960e-659c-44f6-85bc-dbd5fc3ba66e compute1
ERROR: Live migration of instance 3e52960e-659c-44f6-85bc-dbd5fc3ba66e to host compute1 failed (HTTP 400) (Request-ID: req-49dd8597-1462-440a-a964-593a93bcc477)**

Background: Ubuntu 14.04 LTS 4 nodes, control/network, and 3 compute nodes. libvirt0 1.2.2-0ubuntu13.1 KVM as hypervisor on physical HW Shared storage is used and mounted at /var/lib/nova/instances Steps followed to enable live migration is located here: http://docs.openstack.org/admin-guide-cloud/content/section_configuring-compute-migrations.html

Error in nova-api:

2014-06-21 20:18:41.713 25566 ERROR nova.api.openstack.compute.contrib.admin_actions [req-49dd8597-1462-440a-a964-593a93bcc477 856beebcd4f9480390dc185626212481 cd30d2f85a114cb2b1fc6a699475f603] Live migration of instance 3e52960e-659c-44f6-85bc-dbd5fc3ba66e to host compute1 failed
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions Traceback (most recent call last):
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/contrib/admin_actions.py", line 338, in _migrate_live
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions     disk_over_commit, host)
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 218, in _wrapped
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions     return fn(self, context, instance, *args, **kwargs)
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 172, in inner
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions     return f(self, context, instance, *args, **kw)
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 3019, in live_migrate
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions     disk_over_commit=disk_over_commit)
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions   File "/usr/lib/python2.7/dist-packages/nova/conductor/api.py", line 387, in live_migrate_instance
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions     block_migration, disk_over_commit, None)
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions   File "/usr/lib/python2.7/dist-packages/nova/conductor/rpcapi.py", line 476, in migrate_server
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions     reservations=reservations)
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/client.py", line 150, in call
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions     wait_for_reply=True, timeout=timeout)
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions   File "/usr/lib/python2.7/dist-packages/oslo/messaging/transport.py", line 90, in _send
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions     timeout=timeout)
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 412, in send
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions     return self._send(target, ctxt, message, wait_for_reply, timeout)
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 403, in _send
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions     result = self._waiter.wait(msg_id, timeout)
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 267, in wait
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions     reply, ending = self._poll_connection(msg_id, timeout)
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 217, in _poll_connection
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions     % msg_id)
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions MessagingTimeout: Timed out waiting for a reply to message ID e27b729b5321406e8dd63db68d9628b3
2014-06-21 20:18:41.713 25566 TRACE nova.api.openstack.compute.contrib.admin_actions

Thank you in advance for your help

Raouf