Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

Host has more disk space than database expected

Hi,

I am creating and launching instance via HOT file (using execute image) . Here I am facing Host has more disk space than database expected and HTTP exception thrown: Instance could not be found issues. please find the details below.

Could you please help .. Thanks.

glance image-list +--------------------------------------+-----------------+-------------+------------------+-------------+--------+ | ID | Name | Disk Format | Container Format | Size | Status | +--------------------------------------+-----------------+-------------+------------------+-------------+--------+ | be893b06-0cea-4f39-a9e8-c510e8e7dbec | test | qcow2 | bare | 1820589568 | active | | 75e291a4-2c96-418a-bf30-37a70e08f29a | test2 | qcow2 | bare | 720896 | active | | 3b8fa3e3-b5ab-4e1a-a964-95a6901d5b1a | execute | qcow2 | bare | 13171163136 | active | +--------------------------------------+-----------------+-------------+------------------+-------------+--------+

nova hypervisor-list +----+---------------------+-------+---------+ | ID | Hypervisor hostname | State | Status | +----+---------------------+-------+---------+ | 1 | controller | up | enabled | | 2 | node0-5 | up | enabled | | 3 | node0-7 | up | enabled | | 4 | node0-9 | up | enabled | | 5 | node0-11 | up | enabled | | 6 | node0-13 | up | enabled | | 7 | node0-15 | up | enabled | | 8 | node0-17 | up | enabled | | 9 | node0-19 | up | enabled | | 10 | node0-21 | up | enabled | | 11 | node0-23 | up | enabled | +----+---------------------+-------+---------+

neutron agent-list +--------------------------------------+--------------------+-------------+-------+----------------+---------------------------+ | id | agent_type | host | alive | admin_state_up | binary | +--------------------------------------+--------------------+-------------+-------+----------------+---------------------------+ | 101392f1-9a80-4aa9-abeb-94d300c9d7d3 | DHCP agent | network | :-) | True | neutron-dhcp-agent | | 11299fa6-1e86-4910-a750-5d9df700d411 | Open vSwitch agent | node0-17 | :-) | True | neutron-openvswitch-agent | | 3314610d-e914-49e8-93b9-c06fa2fc318c | Open vSwitch agent | controller | :-) | True | neutron-openvswitch-agent | | 42153cd0-f64d-4f9c-a15c-00e3f4587e7b | L3 agent | network | :-) | True | neutron-l3-agent | | 46325b01-97c5-4eb6-9ca3-5486997a9df8 | Open vSwitch agent | node0-13 | :-) | True | neutron-openvswitch-agent | | 7a56784c-d8b5-4108-a543-23b6625e677d | Open vSwitch agent | node0-21 | :-) | True | neutron-openvswitch-agent | | 7af98535-0b46-452a-a539-5d7fc41fb0ef | Open vSwitch agent | node0-9 | :-) | True | neutron-openvswitch-agent | | 7b8a4484-8b35-4ad7-9f59-9d4d710c214c | Open vSwitch agent | node0-7 | :-) | True | neutron-openvswitch-agent | | a9f197b2-74e9-466e-a7e3-c4a4ff426601 | Open vSwitch agent | node0-23 | :-) | True | neutron-openvswitch-agent | | b577e390-6042-4ab8-80bf-fb56d59cac85 | Open vSwitch agent | node0-19 | :-) | True | neutron-openvswitch-agent | | c89721ef-d7c4-49a3-99ea-6a520d2bbbb7 | Open vSwitch agent | node0-15 | :-) | True | neutron-openvswitch-agent | | c90a20ad-f8f6-4f92-8228-1fb690584ce4 | Open vSwitch agent | node0-5 | :-) | True | neutron-openvswitch-agent | | da2665db-745f-451a-a769-daa827354586 | Open vSwitch agent | network | :-) | True | neutron-openvswitch-agent | | e6c106b6-e2db-4e33-9de7-b5ed4a583c55 | Metadata agent | network | :-) | True | neutron-metadata-agent | | f3d8d59d-1815-422c-a6a9-36d501c8465c | Open vSwitch agent | node0-11 | :-) | True | neutron-openvswitch-agent | +--------------------------------------+--------------------+-------------+-------+----------------+---------------------------+

/var/log/nova/nova-api.log

2016-09-15 08:46:20.304 26264 INFO nova.api.openstack.wsgi [req-9df02999-8c95-4593-a1c1-e37b4982961f None] HTTP exception thrown: Instance could not be found 2016-09-15 08:46:20.305 26264 INFO nova.osapi_compute.wsgi.server [req-9df02999-8c95-4593-a1c1-e37b4982961f None] 10.50.41.100 "GET /v2/508f068670a74efcbc621494535ace5d/servers/56ca6b63-87bb-41fb-a1b7-848dc54368a1 HTTP/1.1" status: 404 len: 267 time: 0.0311298 2016-09-15 08:46:20.311 26262 INFO nova.osapi_compute.wsgi.server [req-886669f2-2b44-4e8b-b657-3b2eda5b9c18 None] 10.50.41.100 "GET /v2/508f068670a74efcbc621494535ace5d/servers/detail?project_id=508f068670a74efcbc621494535ace5d HTTP/1.1" status: 200 len: 6357 time: 0.0647380 2016-09-15 08:46:20.425 26260 INFO nova.api.openstack.wsgi [req-9d5973e0-21c7-4bd0-84ef-7281aabbf20a None] HTTP exception thrown: Instance could not be found 2016-09-15 08:46:20.426 26260 INFO nova.osapi_compute.wsgi.server [req-9d5973e0-21c7-4bd0-84ef-7281aabbf20a None] 10.50.41.100 "GET /v2/508f068670a74efcbc621494535ace5d/servers/ef182996-bcc1-4ca5-a773-1c8f0f9ce8ab HTTP/1.1" status: 404 l

/var/log/nova/nova-conductor.log

2016-09-15 08:46:17.569 26068 ERROR nova.scheduler.utils [req-212e7d29-0cd5-4c13-941e-902f1e679bd9 None] [instance: 56ca6b63-87bb-41fb-a1b7-848dc54368a1] Error from last host: node0-21 (node node0-21): [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 56ca6b63-87bb-41fb-a1b7-848dc54368a1 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n \n'] 2016-09-15 08:46:17.570 26068 WARNING nova.scheduler.driver [req-212e7d29-0cd5-4c13-941e-902f1e679bd9 None] [instance: 56ca6b63-87bb-41fb-a1b7-848dc54368a1] NoValidHost exception with message: 'No valid host was found. Exceeded max scheduling attempts 3 for instance 56ca6b63-87bb-41fb-a1b7-848dc54368a1. Last exception: [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 56ca6b63-87bb-41fb-a1b7-848dc54368a1 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n \n']' 2016-09-15 08:46:17.570 26068 WARNING nova.scheduler.driver [req-212e7d29-0cd5-4c13-941e-902f1e679bd9 None] [instance: 56ca6b63-87bb-41fb-a1b7-848dc54368a1] Setting instance to ERROR state. 2016-09-15 08:46:18.208 26077 ERROR nova.scheduler.utils [req-62f20b8d-d1dd-4c7c-9636-53f4e7792328 None] [instance: ef182996-bcc1-4ca5-a773-1c8f0f9ce8ab] Error from last host: node0-15 (node node0-15): [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance ef182996-bcc1-4ca5-a773-1c8f0f9ce8ab was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n \n'] 2016-09-15 08:46:18.209 26077 WARNING nova.scheduler.driver [req-62f20b8d-d1dd-4c7c-9636-53f4e7792328 None] [instance: ef182996-bcc1-4ca5-a773-1c8f0f9ce8ab] NoValidHost exception with message: 'No valid host was found. Exceeded max scheduling attempts 3 for instance ef182996-bcc1-4ca5-a773-1c8f0f9ce8ab. Last exception: [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance ef182996-bcc1-4ca5-a773-1c8f0f9ce8ab was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n \n']' 2016-09-15 08:46:18.209 26077 WARNING nova.scheduler.driver [req-62f20b8d-d1dd-4c7c-9636-53f4e7792328 None] [instance: ef182996-bcc1-4ca5-a773-1c8f0f9ce8ab] Setting instance to ERROR state. 2016-09-15 08:46:55.454 26069 ERROR nova.scheduler.utils [req-a07f7941-2949-4514-a005-0f09469b2034 None] [instance: 828e5aff-d392-45cf-9c27-7c85817fadb2] Error from last host: node0-11 (node node0-11): [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 828e5aff-d392-45cf-9c27-7c85817fadb2 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n \n'] 2016-09-15 08:46:56.580 26077 ERROR nova.scheduler.utils [req-a07f7941-2949-4514-a005-0f09469b2034 None] [instance: 828e5aff-d392-45cf-9c27-7c85817fadb2] Error from last host: node0-21 (node node0-21): [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 828e5aff-d392-45cf-9c27-7c85817fadb2 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n \n'] 2016-09-15 08:46:57.551 26069 ERROR nova.scheduler.utils [req-196c449f-e947-4c9f-a4e9-94fa178b9bb2 None] [instance: 491596bc-e006-434f-a9fa-ca66b8843d74] Error from last host: node0-11 (node node0-11): [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 491596bc-e006-434f-a9fa-ca66b8843d74 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n \n'] 2016-09-15 08:46:57.757 26069 ERROR nova.scheduler.utils [req-a07f7941-2949-4514-a005-0f09469b2034 None] [instance: 828e5aff-d392-45cf-9c27-7c85817fadb2] Error from last host: node0-15 (node node0-15): [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 828e5aff-d392-45cf-9c27-7c85817fadb2 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n \n'] 2016-09-15 08:46:57.757 26069 WARNING nova.scheduler.driver [req-a07f7941-2949-4514-a005-0f09469b2034 None] [instance: 828e5aff-d392-45cf-9c27-7c85817fadb2] NoValidHost exception with message: 'No valid host was found. Exceeded max scheduling attempts 3 for instance 828e5aff-d392-45cf-9c27-7c85817fadb2. Last exception: [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 828e5aff-d392-45cf-9c27-7c85817fadb2 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n \n']' 2016-09-15 08:46:57.757 26069 WARNING nova.scheduler.driver [req-a07f7941-2949-4514-a005-0f09469b2034 None] [instance: 828e5aff-d392-45cf-9c27-7c85817fadb2] Setting instance to ERROR state. 2016-09-15 08:46:58.660 26075 ERROR nova.scheduler.utils [req-196c449f-e947-4c9f-a4e9-94fa178b9bb2 None] [instance: 491596bc-e006-434f-a9fa-ca66b8843d74] Error from last host: node0-21 (node node0-21): [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 491596bc-e006-434f-a9fa-ca66b8843d74 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n \n'] 2016-09-15 08:46:59.907 26073 ERROR nova.scheduler.utils [req-196c449f-e947-4c9f-a4e9-94fa178b9bb2 None] [instance: 491596bc-e006-434f-a9fa-ca66b8843d74] Error from last host: node0-23 (node node0-23): [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 491596bc-e006-434f-a9fa-ca66b8843d74 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n \n'] 2016-09-15 08:46:59.907 26073 WARNING nova.scheduler.driver [req-196c449f-e947-4c9f-a4e9-94fa178b9bb2 None] [instance: 491596bc-e006-434f-a9fa-ca66b8843d74] NoValidHost exception with message: 'No valid host was found. Exceeded max scheduling attempts 3 for instance 491596bc-e006-434f-a9fa-ca66b8843d74. Last exception: [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 491596bc-e006-434f-a9fa-ca66b8843d74 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n \n']' 2016-09-15 08:46:59.907 26073 WARNING nova.scheduler.driver [req-196c449f-e947-4c9f-a4e9-94fa178b9bb2 None] [instance: 491596bc-e006-434f-a9fa-ca66b8843d74] Setting instance to ERROR state.

var/log/nova/nova-scheduler.log 016-09-15 08:45:51.445 25964 WARNING nova.scheduler.host_manager [req-3fe50d1f-16b0-41ba-8975-e7c8c39819d4 None] Host has more disk space than database expected (984gb > 792gb) 2016-09-15 08:45:52.608 25964 WARNING nova.scheduler.host_manager [req-3fe50d1f-16b0-41ba-8975-e7c8c39819d4 None] Host has more disk space than database expected (984gb > 792gb) 2016-09-15 08:45:53.055 25964 WARNING nova.scheduler.host_manager [req-b923f9a9-28c0-4977-b5d2-520f0245643c None] Host has more disk space than database expected (984gb > 792gb) 2016-09-15 08:46:15.342 25964 WARNING nova.scheduler.host_manager [req-212e7d29-0cd5-4c13-941e-902f1e679bd9 None] Host has more disk space than database expected (984gb > 792gb) 2016-09-15 08:46:16.489 25964 WARNING nova.scheduler.host_manager [req-212e7d29-0cd5-4c13-941e-902f1e679bd9 None] Host has more disk space than database expected (984gb > 792gb) 2016-09-15 08:46:57.590 25964 WARNING nova.scheduler.host_manager [req-196c449f-e947-4c9f-a4e9-94fa178b9bb2 None] Host has more disk space than database expected (984gb > 792gb)

Host Can not launch instance due to "Host has more disk space than database expectedexpected"

Hi,

I am creating and launching instance via HOT file (using execute image) . Here I am facing Host has more disk space than database expected and HTTP exception thrown: Instance could not be found issues. please find the details below.

Could you please help .. Thanks.

glance image-list image-list +--------------------------------------+-----------------+-------------+------------------+-------------+--------+ | ID | Name | Disk Format | Container Format | Size | Status | +--------------------------------------+-----------------+-------------+------------------+-------------+--------+ | be893b06-0cea-4f39-a9e8-c510e8e7dbec | test | qcow2 | bare | 1820589568 | active | | 75e291a4-2c96-418a-bf30-37a70e08f29a | test2 | qcow2 | bare | 720896 | active | | 3b8fa3e3-b5ab-4e1a-a964-95a6901d5b1a | execute | qcow2 | bare | 13171163136 | active | +--------------------------------------+-----------------+-------------+------------------+-------------+--------+

nova hypervisor-list hypervisor-list +----+---------------------+-------+---------+ | ID | Hypervisor hostname | State | Status | +----+---------------------+-------+---------+ | 1 | controller | up | enabled | | 2 | node0-5 | up | enabled | | 3 | node0-7 | up | enabled | | 4 | node0-9 | up | enabled | | 5 | node0-11 | up | enabled | | 6 | node0-13 | up | enabled | | 7 | node0-15 | up | enabled | | 8 | node0-17 | up | enabled | | 9 | node0-19 | up | enabled | | 10 | node0-21 | up | enabled | | 11 | node0-23 | up | enabled | +----+---------------------+-------+---------+

neutron agent-list agent-list +--------------------------------------+--------------------+-------------+-------+----------------+---------------------------+ | id | agent_type | host | alive | admin_state_up | binary | +--------------------------------------+--------------------+-------------+-------+----------------+---------------------------+ | 101392f1-9a80-4aa9-abeb-94d300c9d7d3 | DHCP agent | network | :-) | True | neutron-dhcp-agent | | 11299fa6-1e86-4910-a750-5d9df700d411 | Open vSwitch agent | node0-17 | :-) | True | neutron-openvswitch-agent | | 3314610d-e914-49e8-93b9-c06fa2fc318c | Open vSwitch agent | controller | :-) | True | neutron-openvswitch-agent | | 42153cd0-f64d-4f9c-a15c-00e3f4587e7b | L3 agent | network | :-) | True | neutron-l3-agent | | 46325b01-97c5-4eb6-9ca3-5486997a9df8 | Open vSwitch agent | node0-13 | :-) | True | neutron-openvswitch-agent | | 7a56784c-d8b5-4108-a543-23b6625e677d | Open vSwitch agent | node0-21 | :-) | True | neutron-openvswitch-agent | | 7af98535-0b46-452a-a539-5d7fc41fb0ef | Open vSwitch agent | node0-9 | :-) | True | neutron-openvswitch-agent | | 7b8a4484-8b35-4ad7-9f59-9d4d710c214c | Open vSwitch agent | node0-7 | :-) | True | neutron-openvswitch-agent | | a9f197b2-74e9-466e-a7e3-c4a4ff426601 | Open vSwitch agent | node0-23 | :-) | True | neutron-openvswitch-agent | | b577e390-6042-4ab8-80bf-fb56d59cac85 | Open vSwitch agent | node0-19 | :-) | True | neutron-openvswitch-agent | | c89721ef-d7c4-49a3-99ea-6a520d2bbbb7 | Open vSwitch agent | node0-15 | :-) | True | neutron-openvswitch-agent | | c90a20ad-f8f6-4f92-8228-1fb690584ce4 | Open vSwitch agent | node0-5 | :-) | True | neutron-openvswitch-agent | | da2665db-745f-451a-a769-daa827354586 | Open vSwitch agent | network | :-) | True | neutron-openvswitch-agent | | e6c106b6-e2db-4e33-9de7-b5ed4a583c55 | Metadata agent | network | :-) | True | neutron-metadata-agent | | f3d8d59d-1815-422c-a6a9-36d501c8465c | Open vSwitch agent | node0-11 | :-) | True | neutron-openvswitch-agent | +--------------------------------------+--------------------+-------------+-------+----------------+---------------------------+

/var/log/nova/nova-api.log

2016-09-15 08:46:20.304 26264 INFO nova.api.openstack.wsgi [req-9df02999-8c95-4593-a1c1-e37b4982961f None] HTTP exception thrown: Instance could not be found 2016-09-15 08:46:20.305 26264 INFO nova.osapi_compute.wsgi.server [req-9df02999-8c95-4593-a1c1-e37b4982961f None] 10.50.41.100 "GET /v2/508f068670a74efcbc621494535ace5d/servers/56ca6b63-87bb-41fb-a1b7-848dc54368a1 HTTP/1.1" status: 404 len: 267 time: 0.0311298 2016-09-15 08:46:20.311 26262 INFO nova.osapi_compute.wsgi.server [req-886669f2-2b44-4e8b-b657-3b2eda5b9c18 None] 10.50.41.100 "GET /v2/508f068670a74efcbc621494535ace5d/servers/detail?project_id=508f068670a74efcbc621494535ace5d HTTP/1.1" status: 200 len: 6357 time: 0.0647380 2016-09-15 08:46:20.425 26260 INFO nova.api.openstack.wsgi [req-9d5973e0-21c7-4bd0-84ef-7281aabbf20a None] HTTP exception thrown: Instance could not be found 2016-09-15 08:46:20.426 26260 INFO nova.osapi_compute.wsgi.server [req-9d5973e0-21c7-4bd0-84ef-7281aabbf20a None] 10.50.41.100 "GET /v2/508f068670a74efcbc621494535ace5d/servers/ef182996-bcc1-4ca5-a773-1c8f0f9ce8ab HTTP/1.1" status: 404 l

/var/log/nova/nova-conductor.log

2016-09-15 08:46:17.569 26068 ERROR nova.scheduler.utils [req-212e7d29-0cd5-4c13-941e-902f1e679bd9 None] [instance: 56ca6b63-87bb-41fb-a1b7-848dc54368a1] Error from last host: node0-21 (node node0-21): [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 56ca6b63-87bb-41fb-a1b7-848dc54368a1 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n \n'] 2016-09-15 08:46:17.570 26068 WARNING nova.scheduler.driver [req-212e7d29-0cd5-4c13-941e-902f1e679bd9 None] [instance: 56ca6b63-87bb-41fb-a1b7-848dc54368a1] NoValidHost exception with message: 'No valid host was found. Exceeded max scheduling attempts 3 for instance 56ca6b63-87bb-41fb-a1b7-848dc54368a1. Last exception: [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 56ca6b63-87bb-41fb-a1b7-848dc54368a1 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n \n']' 2016-09-15 08:46:17.570 26068 WARNING nova.scheduler.driver [req-212e7d29-0cd5-4c13-941e-902f1e679bd9 None] [instance: 56ca6b63-87bb-41fb-a1b7-848dc54368a1] Setting instance to ERROR state. 2016-09-15 08:46:18.208 26077 ERROR nova.scheduler.utils [req-62f20b8d-d1dd-4c7c-9636-53f4e7792328 None] [instance: ef182996-bcc1-4ca5-a773-1c8f0f9ce8ab] Error from last host: node0-15 (node node0-15): [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance ef182996-bcc1-4ca5-a773-1c8f0f9ce8ab was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n \n'] 2016-09-15 08:46:18.209 26077 WARNING nova.scheduler.driver [req-62f20b8d-d1dd-4c7c-9636-53f4e7792328 None] [instance: ef182996-bcc1-4ca5-a773-1c8f0f9ce8ab] NoValidHost exception with message: 'No valid host was found. Exceeded max scheduling attempts 3 for instance ef182996-bcc1-4ca5-a773-1c8f0f9ce8ab. Last exception: [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance ef182996-bcc1-4ca5-a773-1c8f0f9ce8ab was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n \n']' 2016-09-15 08:46:18.209 26077 WARNING nova.scheduler.driver [req-62f20b8d-d1dd-4c7c-9636-53f4e7792328 None] [instance: ef182996-bcc1-4ca5-a773-1c8f0f9ce8ab] Setting instance to ERROR state. 2016-09-15 08:46:55.454 26069 ERROR nova.scheduler.utils [req-a07f7941-2949-4514-a005-0f09469b2034 None] [instance: 828e5aff-d392-45cf-9c27-7c85817fadb2] Error from last host: node0-11 (node node0-11): [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 828e5aff-d392-45cf-9c27-7c85817fadb2 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n \n'] 2016-09-15 08:46:56.580 26077 ERROR nova.scheduler.utils [req-a07f7941-2949-4514-a005-0f09469b2034 None] [instance: 828e5aff-d392-45cf-9c27-7c85817fadb2] Error from last host: node0-21 (node node0-21): [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 828e5aff-d392-45cf-9c27-7c85817fadb2 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n \n'] 2016-09-15 08:46:57.551 26069 ERROR nova.scheduler.utils [req-196c449f-e947-4c9f-a4e9-94fa178b9bb2 None] [instance: 491596bc-e006-434f-a9fa-ca66b8843d74] Error from last host: node0-11 (node node0-11): [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 491596bc-e006-434f-a9fa-ca66b8843d74 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n \n'] 2016-09-15 08:46:57.757 26069 ERROR nova.scheduler.utils [req-a07f7941-2949-4514-a005-0f09469b2034 None] [instance: 828e5aff-d392-45cf-9c27-7c85817fadb2] Error from last host: node0-15 (node node0-15): [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 828e5aff-d392-45cf-9c27-7c85817fadb2 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n \n'] 2016-09-15 08:46:57.757 26069 WARNING nova.scheduler.driver [req-a07f7941-2949-4514-a005-0f09469b2034 None] [instance: 828e5aff-d392-45cf-9c27-7c85817fadb2] NoValidHost exception with message: 'No valid host was found. Exceeded max scheduling attempts 3 for instance 828e5aff-d392-45cf-9c27-7c85817fadb2. Last exception: [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 828e5aff-d392-45cf-9c27-7c85817fadb2 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n \n']' 2016-09-15 08:46:57.757 26069 WARNING nova.scheduler.driver [req-a07f7941-2949-4514-a005-0f09469b2034 None] [instance: 828e5aff-d392-45cf-9c27-7c85817fadb2] Setting instance to ERROR state. 2016-09-15 08:46:58.660 26075 ERROR nova.scheduler.utils [req-196c449f-e947-4c9f-a4e9-94fa178b9bb2 None] [instance: 491596bc-e006-434f-a9fa-ca66b8843d74] Error from last host: node0-21 (node node0-21): [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 491596bc-e006-434f-a9fa-ca66b8843d74 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n \n'] 2016-09-15 08:46:59.907 26073 ERROR nova.scheduler.utils [req-196c449f-e947-4c9f-a4e9-94fa178b9bb2 None] [instance: 491596bc-e006-434f-a9fa-ca66b8843d74] Error from last host: node0-23 (node node0-23): [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 491596bc-e006-434f-a9fa-ca66b8843d74 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n \n'] 2016-09-15 08:46:59.907 26073 WARNING nova.scheduler.driver [req-196c449f-e947-4c9f-a4e9-94fa178b9bb2 None] [instance: 491596bc-e006-434f-a9fa-ca66b8843d74] NoValidHost exception with message: 'No valid host was found. Exceeded max scheduling attempts 3 for instance 491596bc-e006-434f-a9fa-ca66b8843d74. Last exception: [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 491596bc-e006-434f-a9fa-ca66b8843d74 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n \n']' 2016-09-15 08:46:59.907 26073 WARNING nova.scheduler.driver [req-196c449f-e947-4c9f-a4e9-94fa178b9bb2 None] [instance: 491596bc-e006-434f-a9fa-ca66b8843d74] Setting instance to ERROR state.

var/log/nova/nova-scheduler.log var/log/nova/nova-scheduler.log

016-09-15 08:45:51.445 25964 WARNING nova.scheduler.host_manager [req-3fe50d1f-16b0-41ba-8975-e7c8c39819d4 None] Host has more disk space than database expected (984gb > 792gb) 2016-09-15 08:45:52.608 25964 WARNING nova.scheduler.host_manager [req-3fe50d1f-16b0-41ba-8975-e7c8c39819d4 None] Host has more disk space than database expected (984gb > 792gb) 2016-09-15 08:45:53.055 25964 WARNING nova.scheduler.host_manager [req-b923f9a9-28c0-4977-b5d2-520f0245643c None] Host has more disk space than database expected (984gb > 792gb) 2016-09-15 08:46:15.342 25964 WARNING nova.scheduler.host_manager [req-212e7d29-0cd5-4c13-941e-902f1e679bd9 None] Host has more disk space than database expected (984gb > 792gb) 2016-09-15 08:46:16.489 25964 WARNING nova.scheduler.host_manager [req-212e7d29-0cd5-4c13-941e-902f1e679bd9 None] Host has more disk space than database expected (984gb > 792gb) 2016-09-15 08:46:57.590 25964 WARNING nova.scheduler.host_manager [req-196c449f-e947-4c9f-a4e9-94fa178b9bb2 None] Host has more disk space than database expected (984gb > 792gb)

nova flavor-list +--------------------------------------+---------------------------------+-----------+------+-----------+------+-------+-------------+-----------+ | ID | Name | Memory_MB | Disk | Ephemeral | Swap | VCPUs | RXTX_Factor | Is_Public | +--------------------------------------+---------------------------------+-----------+------+-----------+------+-------+-------------+-----------+ | 6146f51c-9289-4592-b655-95805630c486 | Flavor_PL-uqds5fgxokog | 32768 | 0 | 0 | | 8 | 1.0 | False | | 70c52fae-f36a-4ea4-8a6b-c20e28022368 | Flavor_SC-2kdeloahkxhh | 32768 | 250 | 0 | | 8 | 1.0 | False |

Heat Template file:

SC_disksize: {type: number, default: 400, label: SC disksize in GB, description: Only change value on Ericsson recommendation}

Heat Environment file:

SC_vcpus: 8^M SC_vram: 32768^M SC_disksize: 250^M ^M PL_vcpus: 8^M PL_vram: 32768

Controller node file system and disk space details

df -h Filesystem Size Used Avail Use% Mounted on /dev/mapper/rhel_controller-root 50G 2.5G 48G 5% / devtmpfs 32G 0 32G 0% /dev tmpfs 32G 0 32G 0% /dev/shm tmpfs 32G 249M 32G 1% /run tmpfs 32G 0 32G 0% /sys/fs/cgroup /dev/sda1 497M 134M 364M 27% /boot /dev/mapper/rhel_controller-home 1.1T 14G 1.1T 2% /home tmpfs 32G 249M 32G 1% /run/netns 19X.16X.X.3:/home/shared 1.1T 55G 988G 6% /var/lib/nova 19X.16X.X.1:/gstorage 1.1T 14G 1.1T 2% /var/lib/cinder/mnt/068ade2c77bcbaa7909e39cb828608da

Compute nodes file system and disk space details

df -h Filesystem Size Used Avail Use% Mounted on /dev/mapper/rhel_node0--x-root 6.3G 1.6G 4.7G 25% / devtmpfs 32G 0 32G 0% /dev tmpfs 32G 0 32G 0% /dev/shm tmpfs 32G 257M 32G 1% /run tmpfs 32G 0 32G 0% /sys/fs/cgroup /dev/sda1 497M 107M 391M 22% /boot 19X.16X.X.3:/home/shared 1.1T 55G 988G 6% /var/lib/nova tmpfs 32G 257M 32G 1% /run/netns

+--------------------------------------+---------------------------------+-----------+------+-----------+------+-------+-------------+-----------+

click to hide/show revision 3
No.3 Revision

Can not launch instance due to "Host Host has more disk space than database expected"expected

Hi,

I am creating and launching instance via HOT file (using execute image) . Here I am facing Host has more disk space than database expected and HTTP exception thrown: Instance could not be found issues. please find the details below.

Could you please help .. Thanks.

glance image-list

**glance image-list**
+--------------------------------------+-----------------+-------------+------------------+-------------+--------+
| ID                                   | Name            | Disk Format | Container Format | Size        | Status |
+--------------------------------------+-----------------+-------------+------------------+-------------+--------+
| be893b06-0cea-4f39-a9e8-c510e8e7dbec | test            | qcow2       | bare             | 1820589568  | active |
| 75e291a4-2c96-418a-bf30-37a70e08f29a | test2           | qcow2       | bare             | 720896      | active |
| 3b8fa3e3-b5ab-4e1a-a964-95a6901d5b1a | execute         | qcow2       | bare             | 13171163136 | active |
+--------------------------------------+-----------------+-------------+------------------+-------------+--------++--------------------------------------+-----------------+-------------+------------------+-------------+--------+

-

nova hypervisor-list

**nova hypervisor-list**
+----+---------------------+-------+---------+
| ID | Hypervisor hostname | State | Status  |
+----+---------------------+-------+---------+
| 1  | controller          | up    | enabled |
| 2  | node0-5             | up    | enabled |
| 3  | node0-7             | up    | enabled |
| 4  | node0-9             | up    | enabled |
| 5  | node0-11            | up    | enabled |
| 6  | node0-13            | up    | enabled |
| 7  | node0-15            | up    | enabled |
| 8  | node0-17            | up    | enabled |
| 9  | node0-19            | up    | enabled |
| 10 | node0-21            | up    | enabled |
| 11 | node0-23            | up    | enabled |
+----+---------------------+-------+---------++----+---------------------+-------+---------+

-

neutron agent-list

**neutron agent-list**
+--------------------------------------+--------------------+-------------+-------+----------------+---------------------------+
| id                                   | agent_type         | host        | alive | admin_state_up | binary                    |
+--------------------------------------+--------------------+-------------+-------+----------------+---------------------------+
| 101392f1-9a80-4aa9-abeb-94d300c9d7d3 | DHCP agent         | network     | :-)   | True           | neutron-dhcp-agent        |
| 11299fa6-1e86-4910-a750-5d9df700d411 | Open vSwitch agent | node0-17    | :-)   | True           | neutron-openvswitch-agent |
| 3314610d-e914-49e8-93b9-c06fa2fc318c | Open vSwitch agent | controller  | :-)   | True           | neutron-openvswitch-agent |
| 42153cd0-f64d-4f9c-a15c-00e3f4587e7b | L3 agent           | network     | :-)   | True           | neutron-l3-agent          |
| 46325b01-97c5-4eb6-9ca3-5486997a9df8 | Open vSwitch agent | node0-13    | :-)   | True           | neutron-openvswitch-agent |
| 7a56784c-d8b5-4108-a543-23b6625e677d | Open vSwitch agent | node0-21    | :-)   | True           | neutron-openvswitch-agent |
| 7af98535-0b46-452a-a539-5d7fc41fb0ef | Open vSwitch agent | node0-9     | :-)   | True           | neutron-openvswitch-agent |
| 7b8a4484-8b35-4ad7-9f59-9d4d710c214c | Open vSwitch agent | node0-7     | :-)   | True           | neutron-openvswitch-agent |
| a9f197b2-74e9-466e-a7e3-c4a4ff426601 | Open vSwitch agent | node0-23    | :-)   | True           | neutron-openvswitch-agent |
| b577e390-6042-4ab8-80bf-fb56d59cac85 | Open vSwitch agent | node0-19    | :-)   | True           | neutron-openvswitch-agent |
| c89721ef-d7c4-49a3-99ea-6a520d2bbbb7 | Open vSwitch agent | node0-15    | :-)   | True           | neutron-openvswitch-agent |
| c90a20ad-f8f6-4f92-8228-1fb690584ce4 | Open vSwitch agent | node0-5     | :-)   | True           | neutron-openvswitch-agent |
| da2665db-745f-451a-a769-daa827354586 | Open vSwitch agent | network     | :-)   | True           | neutron-openvswitch-agent |
| e6c106b6-e2db-4e33-9de7-b5ed4a583c55 | Metadata agent     | network     | :-)   | True           | neutron-metadata-agent    |
| f3d8d59d-1815-422c-a6a9-36d501c8465c | Open vSwitch agent | node0-11    | :-)   | True           | neutron-openvswitch-agent |
+--------------------------------------+--------------------+-------------+-------+----------------+---------------------------++--------------------------------------+--------------------+-------------+-------+----------------+---------------------------+

-

/var/log/nova/nova-api.log

**/var/log/nova/nova-api.log**

2016-09-15 08:46:20.304 26264 INFO nova.api.openstack.wsgi [req-9df02999-8c95-4593-a1c1-e37b4982961f None] HTTP exception thrown: Instance could not be found
2016-09-15 08:46:20.305 26264 INFO nova.osapi_compute.wsgi.server [req-9df02999-8c95-4593-a1c1-e37b4982961f None] 10.50.41.100 "GET /v2/508f068670a74efcbc621494535ace5d/servers/56ca6b63-87bb-41fb-a1b7-848dc54368a1 HTTP/1.1" status: 404 len: 267 time: 0.0311298
2016-09-15 08:46:20.311 26262 INFO nova.osapi_compute.wsgi.server [req-886669f2-2b44-4e8b-b657-3b2eda5b9c18 None] 10.50.41.100 "GET /v2/508f068670a74efcbc621494535ace5d/servers/detail?project_id=508f068670a74efcbc621494535ace5d HTTP/1.1" status: 200 len: 6357 time: 0.0647380
2016-09-15 08:46:20.425 26260 INFO nova.api.openstack.wsgi [req-9d5973e0-21c7-4bd0-84ef-7281aabbf20a None] HTTP exception thrown: Instance could not be found
2016-09-15 08:46:20.426 26260 INFO nova.osapi_compute.wsgi.server [req-9d5973e0-21c7-4bd0-84ef-7281aabbf20a None] 10.50.41.100 "GET /v2/508f068670a74efcbc621494535ace5d/servers/ef182996-bcc1-4ca5-a773-1c8f0f9ce8ab HTTP/1.1" status: 404 ll

-

/var/log/nova/nova-conductor.log

**/var/log/nova/nova-conductor.log**

2016-09-15 08:46:17.569 26068 ERROR nova.scheduler.utils [req-212e7d29-0cd5-4c13-941e-902f1e679bd9 None] [instance: 56ca6b63-87bb-41fb-a1b7-848dc54368a1] Error from last host: node0-21 (node node0-21): [u'Traceback (most recent call last):\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n    filter_properties)\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n    instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 56ca6b63-87bb-41fb-a1b7-848dc54368a1 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n   \n']
2016-09-15 08:46:17.570 26068 WARNING nova.scheduler.driver [req-212e7d29-0cd5-4c13-941e-902f1e679bd9 None] [instance: 56ca6b63-87bb-41fb-a1b7-848dc54368a1] NoValidHost exception with message: 'No valid host was found. Exceeded max scheduling attempts 3 for instance 56ca6b63-87bb-41fb-a1b7-848dc54368a1. Last exception: [u'Traceback (most recent call last):\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n    filter_properties)\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n    instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 56ca6b63-87bb-41fb-a1b7-848dc54368a1 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n   \n']'
2016-09-15 08:46:17.570 26068 WARNING nova.scheduler.driver [req-212e7d29-0cd5-4c13-941e-902f1e679bd9 None] [instance: 56ca6b63-87bb-41fb-a1b7-848dc54368a1] Setting instance to ERROR state.
2016-09-15 08:46:18.208 26077 ERROR nova.scheduler.utils [req-62f20b8d-d1dd-4c7c-9636-53f4e7792328 None] [instance: ef182996-bcc1-4ca5-a773-1c8f0f9ce8ab] Error from last host: node0-15 (node node0-15): [u'Traceback (most recent call last):\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n    filter_properties)\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n    instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance ef182996-bcc1-4ca5-a773-1c8f0f9ce8ab was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n   \n']
2016-09-15 08:46:18.209 26077 WARNING nova.scheduler.driver [req-62f20b8d-d1dd-4c7c-9636-53f4e7792328 None] [instance: ef182996-bcc1-4ca5-a773-1c8f0f9ce8ab] NoValidHost exception with message: 'No valid host was found. Exceeded max scheduling attempts 3 for instance ef182996-bcc1-4ca5-a773-1c8f0f9ce8ab. Last exception: [u'Traceback (most recent call last):\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n    filter_properties)\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n    instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance ef182996-bcc1-4ca5-a773-1c8f0f9ce8ab was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n   \n']'
2016-09-15 08:46:18.209 26077 WARNING nova.scheduler.driver [req-62f20b8d-d1dd-4c7c-9636-53f4e7792328 None] [instance: ef182996-bcc1-4ca5-a773-1c8f0f9ce8ab] Setting instance to ERROR state.
2016-09-15 08:46:55.454 26069 ERROR nova.scheduler.utils [req-a07f7941-2949-4514-a005-0f09469b2034 None] [instance: 828e5aff-d392-45cf-9c27-7c85817fadb2] Error from last host: node0-11 (node node0-11): [u'Traceback (most recent call last):\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n    filter_properties)\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n    instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 828e5aff-d392-45cf-9c27-7c85817fadb2 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n   \n']
2016-09-15 08:46:56.580 26077 ERROR nova.scheduler.utils [req-a07f7941-2949-4514-a005-0f09469b2034 None] [instance: 828e5aff-d392-45cf-9c27-7c85817fadb2] Error from last host: node0-21 (node node0-21): [u'Traceback (most recent call last):\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n    filter_properties)\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n    instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 828e5aff-d392-45cf-9c27-7c85817fadb2 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n   \n']
2016-09-15 08:46:57.551 26069 ERROR nova.scheduler.utils [req-196c449f-e947-4c9f-a4e9-94fa178b9bb2 None] [instance: 491596bc-e006-434f-a9fa-ca66b8843d74] Error from last host: node0-11 (node node0-11): [u'Traceback (most recent call last):\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n    filter_properties)\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n    instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 491596bc-e006-434f-a9fa-ca66b8843d74 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n   \n']
2016-09-15 08:46:57.757 26069 ERROR nova.scheduler.utils [req-a07f7941-2949-4514-a005-0f09469b2034 None] [instance: 828e5aff-d392-45cf-9c27-7c85817fadb2] Error from last host: node0-15 (node node0-15): [u'Traceback (most recent call last):\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n    filter_properties)\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n    instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 828e5aff-d392-45cf-9c27-7c85817fadb2 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n   \n']
2016-09-15 08:46:57.757 26069 WARNING nova.scheduler.driver [req-a07f7941-2949-4514-a005-0f09469b2034 None] [instance: 828e5aff-d392-45cf-9c27-7c85817fadb2] NoValidHost exception with message: 'No valid host was found. Exceeded max scheduling attempts 3 for instance 828e5aff-d392-45cf-9c27-7c85817fadb2. Last exception: [u'Traceback (most recent call last):\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n    filter_properties)\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n    instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 828e5aff-d392-45cf-9c27-7c85817fadb2 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n   \n']'
2016-09-15 08:46:57.757 26069 WARNING nova.scheduler.driver [req-a07f7941-2949-4514-a005-0f09469b2034 None] [instance: 828e5aff-d392-45cf-9c27-7c85817fadb2] Setting instance to ERROR state.
2016-09-15 08:46:58.660 26075 ERROR nova.scheduler.utils [req-196c449f-e947-4c9f-a4e9-94fa178b9bb2 None] [instance: 491596bc-e006-434f-a9fa-ca66b8843d74] Error from last host: node0-21 (node node0-21): [u'Traceback (most recent call last):\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n    filter_properties)\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n    instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 491596bc-e006-434f-a9fa-ca66b8843d74 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n   \n']
2016-09-15 08:46:59.907 26073 ERROR nova.scheduler.utils [req-196c449f-e947-4c9f-a4e9-94fa178b9bb2 None] [instance: 491596bc-e006-434f-a9fa-ca66b8843d74] Error from last host: node0-23 (node node0-23): [u'Traceback (most recent call last):\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n    filter_properties)\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n    instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 491596bc-e006-434f-a9fa-ca66b8843d74 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n   \n']
2016-09-15 08:46:59.907 26073 WARNING nova.scheduler.driver [req-196c449f-e947-4c9f-a4e9-94fa178b9bb2 None] [instance: 491596bc-e006-434f-a9fa-ca66b8843d74] NoValidHost exception with message: 'No valid host was found. Exceeded max scheduling attempts 3 for instance 491596bc-e006-434f-a9fa-ca66b8843d74. Last exception: [u'Traceback (most recent call last):\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2030, in _do_build_and_run_instance\n    filter_properties)\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2161, in _build_and_run_instance\n    instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance 491596bc-e006-434f-a9fa-ca66b8843d74 was re-scheduled: 404 Not Found\n\nThe resource could not be found.\n\n   \n']'
2016-09-15 08:46:59.907 26073 WARNING nova.scheduler.driver [req-196c449f-e947-4c9f-a4e9-94fa178b9bb2 None] [instance: 491596bc-e006-434f-a9fa-ca66b8843d74] Setting instance to ERROR state.state.

-

var/log/nova/nova-scheduler.log

**var/log/nova/nova-scheduler.log** 

016-09-15 08:45:51.445 25964 WARNING nova.scheduler.host_manager [req-3fe50d1f-16b0-41ba-8975-e7c8c39819d4 None] Host has more disk space than database expected (984gb > 792gb)
2016-09-15 08:45:52.608 25964 WARNING nova.scheduler.host_manager [req-3fe50d1f-16b0-41ba-8975-e7c8c39819d4 None] Host has more disk space than database expected (984gb > 792gb)
2016-09-15 08:45:53.055 25964 WARNING nova.scheduler.host_manager [req-b923f9a9-28c0-4977-b5d2-520f0245643c None] Host has more disk space than database expected (984gb > 792gb)
2016-09-15 08:46:15.342 25964 WARNING nova.scheduler.host_manager [req-212e7d29-0cd5-4c13-941e-902f1e679bd9 None] Host has more disk space than database expected (984gb > 792gb)
2016-09-15 08:46:16.489 25964 WARNING nova.scheduler.host_manager [req-212e7d29-0cd5-4c13-941e-902f1e679bd9 None] Host has more disk space than database expected (984gb > 792gb)
2016-09-15 08:46:57.590 25964 WARNING nova.scheduler.host_manager [req-196c449f-e947-4c9f-a4e9-94fa178b9bb2 None] Host has more disk space than database expected (984gb > 792gb)792gb)

-

nova flavor-list

**nova flavor-list**
+--------------------------------------+---------------------------------+-----------+------+-----------+------+-------+-------------+-----------+
| ID                                   | Name                            | Memory_MB | Disk | Ephemeral | Swap | VCPUs | RXTX_Factor | Is_Public |
+--------------------------------------+---------------------------------+-----------+------+-----------+------+-------+-------------+-----------+
| 6146f51c-9289-4592-b655-95805630c486 | Flavor_PL-uqds5fgxokog | 32768     | 0    | 0         |      | 8     | 1.0         | False     |
| 70c52fae-f36a-4ea4-8a6b-c20e28022368 | Flavor_SC-2kdeloahkxhh | 32768     | 250  | 0         |      | 8     | 1.0         | False     |

|

Heat Template file:

SC_disksize: {type: number, default: 400, label: SC disksize in GB, description: Only change value on Ericsson recommendation}

Heat recommendation} **Heat Environment file:

file:** SC_vcpus: 8^M SC_vram: 32768^M SC_disksize: 250^M ^M PL_vcpus: 8^M PL_vram: 3276832768

-

Controller

**Controller node file system and disk space details

details** df -h Filesystem Size Used Avail Use% Mounted on /dev/mapper/rhel_controller-root 50G 2.5G 48G 5% / devtmpfs 32G 0 32G 0% /dev tmpfs 32G 0 32G 0% /dev/shm tmpfs 32G 249M 32G 1% /run tmpfs 32G 0 32G 0% /sys/fs/cgroup /dev/sda1 497M 134M 364M 27% /boot /dev/mapper/rhel_controller-home 1.1T 14G 1.1T 2% /home tmpfs 32G 249M 32G 1% /run/netns 19X.16X.X.3:/home/shared 1.1T 55G 988G 6% /var/lib/nova 19X.16X.X.1:/gstorage 1.1T 14G 1.1T 2% /var/lib/cinder/mnt/068ade2c77bcbaa7909e39cb828608da/var/lib/cinder/mnt/068ade2c77bcbaa7909e39cb828608da

-

Compute

**Compute nodes file system and disk space details

details** df -h Filesystem Size Used Avail Use% Mounted on /dev/mapper/rhel_node0--x-root 6.3G 1.6G 4.7G 25% / devtmpfs 32G 0 32G 0% /dev tmpfs 32G 0 32G 0% /dev/shm tmpfs 32G 257M 32G 1% /run tmpfs 32G 0 32G 0% /sys/fs/cgroup /dev/sda1 497M 107M 391M 22% /boot 19X.16X.X.3:/home/shared 1.1T 55G 988G 6% /var/lib/nova tmpfs 32G 257M 32G 1% /run/netns

+--------------------------------------+---------------------------------+-----------+------+-----------+------+-------+-------------+-----------+

/run/netns +--------------------------------------+---------------------------------+-----------+------+-----------+------+-------+-------------+-----------+