Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

OpenStack Liberty with CEPH , Create Instance failed

Dears,

Setup - Redhat Openstack Liberty with CEPH (ceph version 0.94.7) in a 3 Compute node setup on RHEL 7.2 OS.

I am getting below errors in nova-compute log when I create a instance using Image from glance (integrated with CEPH), any help will be highly appreciated.

[root@anb-srv-cloud ~(keystone_admin)]# glance image-list +--------------------------------------+---------+ | ID | Name | +--------------------------------------+---------+ | 8d112d9f-df07-43b4-89c6-7ccadafe9c73 | rhel7.2 | +--------------------------------------+---------+ [root@anb-srv-cloud ~(keystone_admin)]# ceph df GLOBAL: SIZE AVAIL RAW USED %RAW USED 102350M 82328M 20021M 19.56 POOLS: NAME ID USED %USED MAX AVAIL OBJECTS rbd 0 0 0 119G 0 .rgw.root 1 848 0 119G 3 .rgw.control 2 0 0 119G 8 .rgw 3 0 0 119G 0 .rgw.gc 4 0 0 119G 32 .users.uid 5 0 0 119G 0 volumes 6 0 0 119G 0 images 7 10240M 10.00 119G 1283 backups 8 0 0 119G 0 vms 9 0 0 119G 0 [root@anb-srv-cloud ~(keystone_admin)]#

Error in nova-compute log

2016-07-18 08:45:49.287 2278 INFO nova.virt.libvirt.driver [req-812c1785-2b5c-4558-a308-10285a1e836d c5c84ff0b7274842b3e52d731a0686e6 41e76a2adf6a42e9b7f0d685bdf4a1f1 - - -] [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] Creating image 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [req-812c1785-2b5c-4558-a308-10285a1e836d c5c84ff0b7274842b3e52d731a0686e6 41e76a2adf6a42e9b7f0d685bdf4a1f1 - - -] [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] Instance failed to spawn 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] Traceback (most recent call last): 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2180, in _build_resources 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] yield resources 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2033, in _build_and_run_instance 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] block_device_info=block_device_info) 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2581, in spawn 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] admin_pass=admin_password) 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3007, in _create_image 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] instance, size, fallback_from_host) 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 6483, in _try_fetch_image_cache 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] size=size) 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/imagebackend.py", line 238, in cache 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] if not self.check_image_exists() or not os.path.exists(base): 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/imagebackend.py", line 808, in check_image_exists 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] return self.driver.exists(self.rbd_name) 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/storage/rbd_utils.py", line 272, in exists 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] read_only=True): 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/storage/rbd_utils.py", line 56, in __init__ 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] client, ioctx = driver._connect_to_rados(pool) 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/storage/rbd_utils.py", line 123, in _connect_to_rados 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] client.connect() 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] File "/usr/lib/python2.7/site-packages/rados.py", line 429, in connect 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] raise make_ex(ret, "error connecting to the cluster") 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] Error: error connecting to the cluster: errno ENOTSUP 2016-07-18 08:45:49.313 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] 2016-07-18 08:45:49.700 2278 INFO nova.compute.manager [req-812c1785-2b5c-4558-a308-10285a1e836d c5c84ff0b7274842b3e52d731a0686e6 41e76a2adf6a42e9b7f0d685bdf4a1f1 - - -] [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] Terminating instance 2016-07-18 08:45:49.705 2278 INFO nova.virt.libvirt.driver [-] [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] During wait destroy, instance disappeared. 2016-07-18 08:45:49.730 2278 ERROR nova.compute.manager [req-812c1785-2b5c-4558-a308-10285a1e836d c5c84ff0b7274842b3e52d731a0686e6 41e76a2adf6a42e9b7f0d685bdf4a1f1 - - -] [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] Build of instance 7c17c22b-af7c-4959-b02c-97aca79879ef aborted: Could not clean up failed build, not rescheduling 2016-07-18 08:45:49.730 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] Traceback (most recent call last): 2016-07-18 08:45:49.730 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1905, in _do_build_and_run_instance 2016-07-18 08:45:49.730 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] filter_properties) 2016-07-18 08:45:49.730 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2049, in _build_and_run_instance 2016-07-18 08:45:49.730 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] 'create.error', fault=e) 2016-07-18 08:45:49.730 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 204, in __exit__ 2016-07-18 08:45:49.730 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] six.reraise(self.type_, self.value, self.tb) 2016-07-18 08:45:49.730 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2033, in _build_and_run_instance 2016-07-18 08:45:49.730 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] block_device_info=block_device_info) 2016-07-18 08:45:49.730 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] File "/usr/lib64/python2.7/contextlib.py", line 35, in __exit__ 2016-07-18 08:45:49.730 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] self.gen.throw(type, value, traceback) 2016-07-18 08:45:49.730 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2204, in _build_resources 2016-07-18 08:45:49.730 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] instance_uuid=instance.uuid, reason=msg) 2016-07-18 08:45:49.730 2278 ERROR nova.compute.manager [instance: 7c17c22b-af7c-4959-b02c-97aca79879ef] BuildAbortException: Build of instance 7c17c22b-af7c-4959-b02c-97aca79879ef aborted: Could not clean up failed build, not rescheduling

Sincere Regards, Aneesh Mohan