Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

Mitaka : Instance in error state due to Failed to notify nova on events

Hi,

When launching cirros instance, the compute is waiting for vif plugging callback from the controller. Unfortunately neutron controller is not able to send the event and then compute remove the instance (timeout).

This is a fresh install of Mitaka (no upgrade from older version) No issue with Kilo on the same environment (3-nodes).

Any help would be highly appreciated

Thanks & Regards,

Michel

Controller : VM - CentOs 7 Compute : G8 CentOs 7

SELinux : permissive on both nodes Firewalld disabled on both nodes

From controller neutron server.log

2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova [-] Failed to notify nova on events: [{'status': 'completed', 'tag': u'6a99763c-8814-4659-9ae5-d4db6c50f7eb', 'name': 'network-vif-plugged', 'server_uuid': u'433be2f0-91a2-4a23-a9ee-e118c228ab62'}]

2016-08-12 14:51:22.370 3068 INFO neutron.wsgi [req-3a96bcca-05c2-4955-9972-4c47bead52ee 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] 10.0.0.40 - - [12/Aug/2016 14:51:22] "GET /v2.0/networks/bf33523d-589c-40d9-b465-b0c5dfd708ae HTTP/1.1" 200 877 0.076181
2016-08-12 14:51:22.528 3068 INFO neutron.wsgi [req-a7152096-9516-4e25-b203-4b7391c30992 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] 10.0.0.40 - - [12/Aug/2016 14:51:22] "GET /v2.0/networks.json?id=bf33523d-589c-40d9-b465-b0c5dfd708ae HTTP/1.1" 200 880 0.074319
2016-08-12 14:51:22.539 3068 INFO neutron.wsgi [req-7e755bc6-cca2-483b-9888-7b89c2e6ec8e 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] 10.0.0.40 - - [12/Aug/2016 14:51:22] "GET /v2.0/quotas/9004b5f9eb7a40b4906d7e197abf6903.json HTTP/1.1" 200 385 0.007345
2016-08-12 14:51:22.604 3068 INFO neutron.wsgi [req-1a3fd2e2-3169-45cf-9e72-1b000aea6803 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] 10.0.0.40 - - [12/Aug/2016 14:51:22] "GET /v2.0/ports.json?fields=id&tenant_id=9004b5f9eb7a40b4906d7e197abf6903 HTTP/1.1" 200 369 0.061353
2016-08-12 14:51:23.311 3068 INFO neutron.wsgi [req-8831b616-2a4d-41f7-a8f9-72f863822bf7 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] 10.0.0.40 - - [12/Aug/2016 14:51:23] "GET /v2.0/ports.json?device_id=433be2f0-91a2-4a23-a9ee-e118c228ab62 HTTP/1.1" 200 226 0.070872
2016-08-12 14:51:23.993 3068 INFO neutron.wsgi [req-5564fca4-13fc-4821-9c27-2fe58a181062 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] 10.0.0.200 - - [12/Aug/2016 14:51:23] "GET /v2.0/extensions.json HTTP/1.1" 200 6007 0.005699
2016-08-12 14:51:24.128 3068 INFO neutron.wsgi [req-bfd0e2da-3ae0-4927-8202-1547ba63c891 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] 10.0.0.200 - - [12/Aug/2016 14:51:24] "GET /v2.0/networks.json?id=bf33523d-589c-40d9-b465-b0c5dfd708ae HTTP/1.1" 200 880 0.127760
2016-08-12 14:51:24.240 3068 INFO neutron.wsgi [req-28ed606c-e091-4b7e-b1cd-8bbf72da51da 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] 10.0.0.200 - - [12/Aug/2016 14:51:24] "GET /v2.0/security-groups.json?tenant_id=9004b5f9eb7a40b4906d7e197abf6903 HTTP/1.1" 200 2532 0.099570
2016-08-12 14:51:25.451 3068 INFO neutron.wsgi [req-1b74a43d-9d85-43cd-a13f-d72d3f116296 1a2e4525db5448d8a9985df7b79090c9 273f07c1bcad4ae5a8c607286cccc37a - - -] 10.0.0.200 - - [12/Aug/2016 14:51:25] "POST /v2.0/ports.json HTTP/1.1" 201 1071 0.877761
2016-08-12 14:51:25.536 3068 INFO neutron.wsgi [req-23a0aa5a-a7c1-4d27-b8ab-8a3f884f542c 1a2e4525db5448d8a9985df7b79090c9 273f07c1bcad4ae5a8c607286cccc37a - - -] 10.0.0.200 - - [12/Aug/2016 14:51:25] "GET /v2.0/ports.json?tenant_id=9004b5f9eb7a40b4906d7e197abf6903&device_id=433be2f0-91a2-4a23-a9ee-e118c228ab62 HTTP/1.1" 200 1069 0.049650
2016-08-12 14:51:25.559 3068 INFO neutron.wsgi [req-4bd3bc97-5a1e-41c8-a648-39fca9118c7a 1a2e4525db5448d8a9985df7b79090c9 273f07c1bcad4ae5a8c607286cccc37a - - -] 10.0.0.200 - - [12/Aug/2016 14:51:25] "GET /v2.0/floatingips.json?fixed_ip_address=212.166.53.190&port_id=6a99763c-8814-4659-9ae5-d4db6c50f7eb HTTP/1.1" 200 232 0.018209
2016-08-12 14:51:25.634 3068 INFO neutron.wsgi [req-9f6c8ecd-2d60-441d-b5bb-dc952005f52a 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] 10.0.0.200 - - [12/Aug/2016 14:51:25] "GET /v2.0/subnets.json?id=34f4e7ab-490c-4926-a566-6f835e20afb3 HTTP/1.1" 200 789 0.069712
2016-08-12 14:51:25.695 3068 INFO neutron.wsgi [req-7076e104-73f6-4635-8da9-bb1aed1b6deb 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] 10.0.0.200 - - [12/Aug/2016 14:51:25] "GET /v2.0/ports.json?network_id=bf33523d-589c-40d9-b465-b0c5dfd708ae&device_owner=network%3Adhcp HTTP/1.1" 200 1077 0.056292
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova [-] Failed to notify nova on events: [{'status': 'completed', 'tag': u'6a99763c-8814-4659-9ae5-d4db6c50f7eb', 'name': 'network-vif-plugged', 'server_uuid': u'433be2f0-91a2-4a23-a9ee-e118c228ab62'}]
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova Traceback (most recent call last):
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova   File "/usr/lib/python2.7/site-packages/neutron/notifiers/nova.py", line 212, in send_events
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova     batched_events)
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova   File "/usr/lib/python2.7/site-packages/novaclient/v2/contrib/server_external_events.py", line 39, in create
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova     return_raw=True)
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova   File "/usr/lib/python2.7/site-packages/novaclient/base.py", line 345, in _create
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova     resp, body = self.api.client.post(url, body=body)
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova   File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 179, in post
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova     return self.request(url, 'POST', **kwargs)
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova   File "/usr/lib/python2.7/site-packages/novaclient/client.py", line 89, in request
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova     **kwargs)
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova   File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 331, in request
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova     resp = super(LegacyJsonAdapter, self).request(*args, **kwargs)
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova   File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 98, in request
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova     return self.session.request(url, method, **kwargs)
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova   File "/usr/lib/python2.7/site-packages/positional/__init__.py", line 94, in inner
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova     return func(*args, **kwargs)
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova   File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 370, in request
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova     auth_headers = self.get_auth_headers(auth)
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova   File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 624, in get_auth_headers
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova     return auth.get_headers(self, **kwargs)
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova   File "/usr/lib/python2.7/site-packages/keystoneauth1/plugin.py", line 84, in get_headers
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova     token = self.get_token(session)
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova   File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 90, in get_token
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova     return self.get_access(session).auth_token
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova   File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 136, in get_access
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova     self.auth_ref = self.get_auth_ref(session)
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova   File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/generic/base.py", line 181, in get_auth_ref
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova     return self._plugin.get_auth_ref(session, **kwargs)
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova   File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/v3/base.py", line 167, in get_auth_ref
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova     authenticated=False, log=False, **rkwargs)
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova   File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 572, in post
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova     return self.request(url, 'POST', **kwargs)
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova   File "/usr/lib/python2.7/site-packages/positional/__init__.py", line 94, in inner
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova     return func(*args, **kwargs)
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova   File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 467, in request
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova     raise exceptions.from_response(resp, method, url)
2016-08-12 14:51:30.067 3070 ERROR neutron.notifiers.nova Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-86479d66-b412-4fa6-bff9-6023ba9594f3)

From controller keystone.log

2016-08-12 14:51:30.064 17857 WARNING keystone.common.wsgi [req-86479d66-b412-4fa6-bff9-6023ba9594f3 - - - - -] Authorization failed. The request you have made requires authentication. from 10.0.0.40

2016-08-12 14:51:21.246 17855 INFO keystone.common.wsgi [req-05d46a6e-2308-4cf5-939f-b11b5595ef68 - - - - -] GET http://controller:35357/v3/
2016-08-12 14:51:21.266 17857 INFO keystone.common.wsgi [req-32f14594-778a-4a37-b752-288038094773 - - - - -] POST http://controller:35357/v3/auth/tokens
2016-08-12 14:51:21.421 17857 INFO keystone.token.providers.fernet.utils [req-32f14594-778a-4a37-b752-288038094773 - - - - -] Loaded 2 encryption keys (max_active_keys=3) from: /etc/keystone/fernet-keys/
2016-08-12 14:51:21.597 17854 INFO keystone.common.wsgi [req-3c7c1209-e5ad-4fa7-9eb3-74da3fafdf77 - - - - -] POST http://controller:35357/v3/auth/tokens
2016-08-12 14:51:21.755 17854 INFO keystone.token.providers.fernet.utils [req-3c7c1209-e5ad-4fa7-9eb3-74da3fafdf77 - - - - -] Loaded 2 encryption keys (max_active_keys=3) from: /etc/keystone/fernet-keys/
2016-08-12 14:51:21.771 17853 INFO keystone.token.providers.fernet.utils [req-eaac9fea-0e31-4fd0-b6e7-484f05e40f98 - - - - -] Loaded 2 encryption keys (max_active_keys=3) from: /etc/keystone/fernet-keys/
2016-08-12 14:51:21.871 17853 INFO keystone.common.wsgi [req-eaac9fea-0e31-4fd0-b6e7-484f05e40f98 3710a4eaec2942bb9a8a7a4ab4b74997 273f07c1bcad4ae5a8c607286cccc37a - 3e526b5df4984ec29b64edca30349269 3e526b5df4984ec29b64edca30349269] GET http://controller:35357/v3/auth/tokens
2016-08-12 14:51:21.873 17853 INFO keystone.token.providers.fernet.utils [req-eaac9fea-0e31-4fd0-b6e7-484f05e40f98 3710a4eaec2942bb9a8a7a4ab4b74997 273f07c1bcad4ae5a8c607286cccc37a - 3e526b5df4984ec29b64edca30349269 3e526b5df4984ec29b64edca30349269] Loaded 2 encryption keys (max_active_keys=3) from: /etc/keystone/fernet-keys/
2016-08-12 14:51:22.084 17853 INFO keystone.token.providers.fernet.utils [req-eaac9fea-0e31-4fd0-b6e7-484f05e40f98 3710a4eaec2942bb9a8a7a4ab4b74997 273f07c1bcad4ae5a8c607286cccc37a - 3e526b5df4984ec29b64edca30349269 3e526b5df4984ec29b64edca30349269] Loaded 2 encryption keys (max_active_keys=3) from: /etc/keystone/fernet-keys/
2016-08-12 14:51:24.251 17856 INFO keystone.common.wsgi [req-30e9c3b5-e2c9-472b-bda9-e53355dea25c - - - - -] POST http://controller:35357/v3/auth/tokens
2016-08-12 14:51:24.562 17856 INFO keystone.token.providers.fernet.utils [req-30e9c3b5-e2c9-472b-bda9-e53355dea25c - - - - -] Loaded 2 encryption keys (max_active_keys=3) from: /etc/keystone/fernet-keys/
2016-08-12 14:51:24.579 17855 INFO keystone.token.providers.fernet.utils [req-e7588ce7-e7f6-4b4a-ad98-f526e846d109 - - - - -] Loaded 2 encryption keys (max_active_keys=3) from: /etc/keystone/fernet-keys/
2016-08-12 14:51:24.677 17855 INFO keystone.common.wsgi [req-e7588ce7-e7f6-4b4a-ad98-f526e846d109 1a2e4525db5448d8a9985df7b79090c9 273f07c1bcad4ae5a8c607286cccc37a - 3e526b5df4984ec29b64edca30349269 3e526b5df4984ec29b64edca30349269] GET http://controller:35357/v3/auth/tokens
2016-08-12 14:51:24.678 17855 INFO keystone.token.providers.fernet.utils [req-e7588ce7-e7f6-4b4a-ad98-f526e846d109 1a2e4525db5448d8a9985df7b79090c9 273f07c1bcad4ae5a8c607286cccc37a - 3e526b5df4984ec29b64edca30349269 3e526b5df4984ec29b64edca30349269] Loaded 2 encryption keys (max_active_keys=3) from: /etc/keystone/fernet-keys/
2016-08-12 14:51:24.772 17855 INFO keystone.token.providers.fernet.utils [req-e7588ce7-e7f6-4b4a-ad98-f526e846d109 1a2e4525db5448d8a9985df7b79090c9 273f07c1bcad4ae5a8c607286cccc37a - 3e526b5df4984ec29b64edca30349269 3e526b5df4984ec29b64edca30349269] Loaded 2 encryption keys (max_active_keys=3) from: /etc/keystone/fernet-keys/
2016-08-12 14:51:30.054 17857 INFO keystone.common.wsgi [req-86479d66-b412-4fa6-bff9-6023ba9594f3 - - - - -] POST http://controller:35357/v3/auth/tokens
2016-08-12 14:51:30.064 17857 WARNING keystone.common.wsgi [req-86479d66-b412-4fa6-bff9-6023ba9594f3 - - - - -] Authorization failed. The request you have made requires authentication. from 10.0.0.40

From compute nova-compute.log :

2016-08-12 14:56:26.294 5653 WARNING nova.virt.libvirt.driver [req-b6dff8d5-4feb-4ea3-8e67-da9f04f7ab48 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] [instance: 433be2f0-91a2-4a23-a9ee-e118c228ab62] Timeout waiting for vif plugging callback f\ or instance 433be2f0-91a2-4a23-a9ee-e118c228ab62

2016-08-12 14:51:23.609 5653 INFO nova.compute.claims [req-b6dff8d5-4feb-4ea3-8e67-da9f04f7ab48 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] [instance: 433be2f0-91a2-4a23-a9ee-e118c228ab62] Attempting claim: memory 64 MB, disk 1 GB, vcpus 1 \
CPU
2016-08-12 14:51:23.610 5653 INFO nova.compute.claims [req-b6dff8d5-4feb-4ea3-8e67-da9f04f7ab48 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] [instance: 433be2f0-91a2-4a23-a9ee-e118c228ab62] Total memory: 128734 MB, used: 512.00 MB
2016-08-12 14:51:23.611 5653 INFO nova.compute.claims [req-b6dff8d5-4feb-4ea3-8e67-da9f04f7ab48 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] [instance: 433be2f0-91a2-4a23-a9ee-e118c228ab62] memory limit: 193101.00 MB, free: 192589.00 MB
2016-08-12 14:51:23.612 5653 INFO nova.compute.claims [req-b6dff8d5-4feb-4ea3-8e67-da9f04f7ab48 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] [instance: 433be2f0-91a2-4a23-a9ee-e118c228ab62] Total disk: 1399 GB, used: 0.00 GB
2016-08-12 14:51:23.612 5653 INFO nova.compute.claims [req-b6dff8d5-4feb-4ea3-8e67-da9f04f7ab48 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] [instance: 433be2f0-91a2-4a23-a9ee-e118c228ab62] disk limit: 1399.00 GB, free: 1399.00 GB
2016-08-12 14:51:23.613 5653 INFO nova.compute.claims [req-b6dff8d5-4feb-4ea3-8e67-da9f04f7ab48 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] [instance: 433be2f0-91a2-4a23-a9ee-e118c228ab62] Total vcpu: 24 VCPU, used: 0.00 VCPU
2016-08-12 14:51:23.613 5653 INFO nova.compute.claims [req-b6dff8d5-4feb-4ea3-8e67-da9f04f7ab48 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] [instance: 433be2f0-91a2-4a23-a9ee-e118c228ab62] vcpu limit not specified, defaulting to unlimited
2016-08-12 14:51:23.647 5653 INFO nova.compute.claims [req-b6dff8d5-4feb-4ea3-8e67-da9f04f7ab48 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] [instance: 433be2f0-91a2-4a23-a9ee-e118c228ab62] Claim successful
2016-08-12 14:51:23.976 5653 WARNING nova.virt.osinfo [req-b6dff8d5-4feb-4ea3-8e67-da9f04f7ab48 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] Cannot find OS information - Reason: (No configuration information found for operating system Empty)
2016-08-12 14:51:24.035 5653 WARNING nova.virt.osinfo [req-b6dff8d5-4feb-4ea3-8e67-da9f04f7ab48 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] Cannot find OS information - Reason: (No configuration information found for operating system Empty)
2016-08-12 14:51:24.537 5653 WARNING nova.virt.osinfo [req-b6dff8d5-4feb-4ea3-8e67-da9f04f7ab48 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] Cannot find OS information - Reason: (No configuration information found for operating system Empty)
2016-08-12 14:51:24.539 5653 INFO nova.virt.libvirt.driver [req-b6dff8d5-4feb-4ea3-8e67-da9f04f7ab48 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] [instance: 433be2f0-91a2-4a23-a9ee-e118c228ab62] Creating image
2016-08-12 14:51:25.776 5653 WARNING nova.virt.osinfo [req-b6dff8d5-4feb-4ea3-8e67-da9f04f7ab48 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] Cannot find OS information - Reason: (No configuration information found for operating system Empty)
2016-08-12 14:51:26.295 5653 INFO nova.compute.manager [req-ac94c35a-c5b0-4319-93c8-4a239d9da48b - - - - -] [instance: 433be2f0-91a2-4a23-a9ee-e118c228ab62] VM Started (Lifecycle Event)
2016-08-12 14:51:26.375 5653 INFO nova.compute.manager [req-ac94c35a-c5b0-4319-93c8-4a239d9da48b - - - - -] [instance: 433be2f0-91a2-4a23-a9ee-e118c228ab62] VM Paused (Lifecycle Event)
2016-08-12 14:51:26.528 5653 INFO nova.compute.manager [req-ac94c35a-c5b0-4319-93c8-4a239d9da48b - - - - -] [instance: 433be2f0-91a2-4a23-a9ee-e118c228ab62] During sync_power_state the instance has a pending task (spawning). Skip.
2016-08-12 14:52:22.876 5653 INFO nova.compute.resource_tracker [req-156811b1-3503-411d-b5c4-61eb2b448148 - - - - -] Auditing locally available compute resources for node compute1
2016-08-12 14:52:23.961 5653 INFO nova.compute.resource_tracker [req-156811b1-3503-411d-b5c4-61eb2b448148 - - - - -] Total usable vcpus: 24, total allocated vcpus: 1
2016-08-12 14:52:23.961 5653 INFO nova.compute.resource_tracker [req-156811b1-3503-411d-b5c4-61eb2b448148 - - - - -] Final resource view: name=compute1 phys_ram=128734MB used_ram=576MB phys_disk=1399GB used_disk=1GB total_vcpus=24 used_vcpus=1 pci_stats=[]
2016-08-12 14:52:24.010 5653 INFO nova.compute.resource_tracker [req-156811b1-3503-411d-b5c4-61eb2b448148 - - - - -] Compute_service record updated for compute1:compute1
2016-08-12 14:53:23.879 5653 INFO nova.compute.resource_tracker [req-156811b1-3503-411d-b5c4-61eb2b448148 - - - - -] Auditing locally available compute resources for node compute1
2016-08-12 14:53:24.992 5653 INFO nova.compute.resource_tracker [req-156811b1-3503-411d-b5c4-61eb2b448148 - - - - -] Total usable vcpus: 24, total allocated vcpus: 1
2016-08-12 14:53:24.993 5653 INFO nova.compute.resource_tracker [req-156811b1-3503-411d-b5c4-61eb2b448148 - - - - -] Final resource view: name=compute1 phys_ram=128734MB used_ram=576MB phys_disk=1399GB used_disk=1GB total_vcpus=24 used_vcpus=1 pci_stats=[]
2016-08-12 14:53:25.039 5653 INFO nova.compute.resource_tracker [req-156811b1-3503-411d-b5c4-61eb2b448148 - - - - -] Compute_service record updated for compute1:compute1
2016-08-12 14:54:23.880 5653 INFO nova.compute.resource_tracker [req-156811b1-3503-411d-b5c4-61eb2b448148 - - - - -] Auditing locally available compute resources for node compute1
2016-08-12 14:54:24.969 5653 INFO nova.compute.resource_tracker [req-156811b1-3503-411d-b5c4-61eb2b448148 - - - - -] Total usable vcpus: 24, total allocated vcpus: 1
2016-08-12 14:54:24.970 5653 INFO nova.compute.resource_tracker [req-156811b1-3503-411d-b5c4-61eb2b448148 - - - - -] Final resource view: name=compute1 phys_ram=128734MB used_ram=576MB phys_disk=1399GB used_disk=1GB total_vcpus=24 used_vcpus=1 pci_stats=[]
2016-08-12 14:54:25.015 5653 INFO nova.compute.resource_tracker [req-156811b1-3503-411d-b5c4-61eb2b448148 - - - - -] Compute_service record updated for compute1:compute1
2016-08-12 14:55:25.882 5653 INFO nova.compute.resource_tracker [req-156811b1-3503-411d-b5c4-61eb2b448148 - - - - -] Auditing locally available compute resources for node compute1
2016-08-12 14:55:26.993 5653 INFO nova.compute.resource_tracker [req-156811b1-3503-411d-b5c4-61eb2b448148 - - - - -] Total usable vcpus: 24, total allocated vcpus: 1
2016-08-12 14:55:26.994 5653 INFO nova.compute.resource_tracker [req-156811b1-3503-411d-b5c4-61eb2b448148 - - - - -] Final resource view: name=compute1 phys_ram=128734MB used_ram=576MB phys_disk=1399GB used_disk=1GB total_vcpus=24 used_vcpus=1 pci_stats=[]
2016-08-12 14:55:27.041 5653 INFO nova.compute.resource_tracker [req-156811b1-3503-411d-b5c4-61eb2b448148 - - - - -] Compute_service record updated for compute1:compute1
2016-08-12 14:56:26.294 5653 WARNING nova.virt.libvirt.driver [req-b6dff8d5-4feb-4ea3-8e67-da9f04f7ab48 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] [instance: 433be2f0-91a2-4a23-a9ee-e118c228ab62] Timeout waiting for vif plugging callback f\
or instance 433be2f0-91a2-4a23-a9ee-e118c228ab62
2016-08-12 14:56:26.539 5653 INFO nova.virt.libvirt.driver [req-b6dff8d5-4feb-4ea3-8e67-da9f04f7ab48 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] [instance: 433be2f0-91a2-4a23-a9ee-e118c228ab62] Deleting instance files /var/lib/nova/instance\
s/433be2f0-91a2-4a23-a9ee-e118c228ab62_del
2016-08-12 14:56:26.541 5653 INFO nova.virt.libvirt.driver [req-b6dff8d5-4feb-4ea3-8e67-da9f04f7ab48 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] [instance: 433be2f0-91a2-4a23-a9ee-e118c228ab62] Deletion of /var/lib/nova/instances/433be2f0-9\
1a2-4a23-a9ee-e118c228ab62_del complete
2016-08-12 14:56:26.716 5653 ERROR nova.compute.manager [req-b6dff8d5-4feb-4ea3-8e67-da9f04f7ab48 40ea01e3ad834163b400129f6dae4b15 9004b5f9eb7a40b4906d7e197abf6903 - - -] [instance: 433be2f0-91a2-4a23-a9ee-e118c228ab62] Instance failed to spawn

Instance creation debug :

[root@controller openstack]# openstack --debug server create --flavor 0  --image 31682baf-b55c-47ef-b773-9c8f462006d1  --nic net-id=bf33523d-589c-40d9-b465-b0c5dfd708ae --security-group default --key-name mykey provider-instance
START with options: ['--debug', 'server', 'create', '--flavor', '0', '--image', '31682baf-b55c-47ef-b773-9c8f462006d1', '--nic', 'net-id=bf33523d-589c-40d9-b465-b0c5dfd708ae', '--security-group', 'default', '--key-name', 'mykey', 'provider-instance']
options: Namespace(access_token_endpoint='', auth_type='', auth_url='http://controller:35357/v3', cacert='', client_id='', client_secret='***', cloud='', debug=True, default_domain='default', deferred_help=False, domain_id='', domain_name='', endpoint='', identity_provider='', identity_provider_url='', insecure=None, interface='', log_file=None, os_compute_api_version='', os_data_processing_api_version='1.1', os_data_processing_url='', os_dns_api_version='2', os_identity_api_version='3', os_image_api_version='2', os_network_api_version='', os_object_api_version='', os_orchestration_api_version='1', os_project_id=None, os_project_name=None, os_volume_api_version='', password='***', profile=None, project_domain_id='', project_domain_name='default', project_id='', project_name='admin', protocol='', region_name='', scope='', service_provider_endpoint='', timing=False, token='***', trust_id='', url='', user_domain_id='', user_domain_name='default', user_id='', username='admin', verbose_level=3, verify=None)
defaults: {u'auth_type': 'password', u'compute_api_version': u'2', 'key': None, u'database_api_version': u'1.0', 'api_timeout': None, u'baremetal_api_version': u'1', u'image_api_version': u'2', 'cacert': None, u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', u'orchestration_api_version': u'1', u'interface': None, u'network_api_version': u'2', u'image_format': u'qcow2', u'key_manager_api_version': u'v1', u'metering_api_version': u'2', 'verify': True, u'identity_api_version': u'2.0', u'volume_api_version': u'2', 'cert': None, u'secgroup_source': u'neutron', u'container_api_version': u'1', u'dns_api_version': u'2', u'object_store_api_version': u'1', u'disable_vendor_agent': {}}
cloud cfg: {'auth_type': 'password', u'compute_api_version': u'2', 'key': None, u'database_api_version': u'1.0', 'data_processing_api_version': '1.1', u'network_api_version': u'2', u'image_format': u'qcow2', u'image_api_version': '2', 'verify': True, u'dns_api_version': '2', u'object_store_api_version': u'1', 'verbose_level': 3, 'region_name': '', 'api_timeout': None, u'baremetal_api_version': u'1', 'auth': {'username': 'admin', 'project_name': 'admin', 'user_domain_name': 'default', 'auth_url': 'http://controller:35357/v3', 'password': '***', 'project_domain_name': 'default'}, 'default_domain': 'default', u'container_api_version': u'1', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', u'orchestration_api_version': '1', 'timing': False, 'cacert': None, u'key_manager_api_version': u'v1', u'metering_api_version': u'2', 'deferred_help': False, u'identity_api_version': '3', u'volume_api_version': u'2', 'cert': None, u'secgroup_source': u'neutron', 'debug': True, u'interface': None, u'disable_vendor_agent': {}}
compute API version 2, cmd group openstack.compute.v2
network API version 2, cmd group openstack.network.v2
image API version 2, cmd group openstack.image.v2
volume API version 2, cmd group openstack.volume.v2
identity API version 3, cmd group openstack.identity.v3
object_store API version 1, cmd group openstack.object_store.v1
dns API version 2, cmd group openstack.dns.v2
data_processing API version 1.1, cmd group openstack.data_processing.v1
orchestration API version 1, cmd group openstack.orchestration.v1
command: server create -> openstackclient.compute.v2.server.CreateServer
Auth plugin password selected
auth_type: password
Using auth plugin: password
Using parameters {'username': 'admin', 'project_name': 'admin', 'auth_url': 'http://controller:35357/v3', 'user_domain_name': 'default', 'password': '***', 'project_domain_name': 'default'}
Get auth_ref
REQ: curl -g -i -X GET http://controller:35357/v3 -H "Accept: application/json" -H "User-Agent: python-openstackclient keystoneauth1/2.4.1 python-requests/2.10.0 CPython/2.7.5"
Starting new HTTP connection (1): controller
"GET /v3 HTTP/1.1" 200 250
RESP: [200] Date: Fri, 12 Aug 2016 13:16:02 GMT Server: Apache/2.4.6 (CentOS) mod_wsgi/3.4 Python/2.7.5 Vary: X-Auth-Token x-openstack-request-id: req-4aa845ad-4e5f-4a22-81f6-d23e83469c88 Content-Length: 250 Keep-Alive: timeout=5, max=100 Connection: Keep-Alive Content-Type: application/json 
RESP BODY: {"version": {"status": "stable", "updated": "2016-04-04T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v3+json"}], "id": "v3.6", "links": [{"href": "http://controller:35357/v3/", "rel": "self"}]}}

Making authentication request to http://controller:35357/v3/auth/tokens
"POST /v3/auth/tokens HTTP/1.1" 201 2838
run(Namespace(availability_zone=None, block_device_mapping=[], columns=[], config_drive=False, file=[], flavor='0', formatter='table', hint=[], image='31682baf-b55c-47ef-b773-9c8f462006d1', key_name='mykey', max=1, max_width=0, min=1, nic=['net-id=bf33523d-589c-40d9-b465-b0c5dfd708ae'], noindent=False, prefix='', property=None, security_group=['default'], server_name='provider-instance', user_data=None, variables=[], volume=None, wait=False))
Instantiating compute client for VAPI Version Major: 2, Minor: 0
Instantiating volume client: <class 'cinderclient.v2.client.Client'>
Making authentication request to http://controller:35357/v3/auth/tokens
"POST /v3/auth/tokens HTTP/1.1" 201 2838
REQ: curl -g -i -X GET http://controller:8774/v2.1/9004b5f9eb7a40b4906d7e197abf6903/images/31682baf-b55c-47ef-b773-9c8f462006d1 -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}d1918e0d0fe43f19c60f755d7dfb2fbc8b9a1761"
Starting new HTTP connection (1): controller
"GET /v2.1/9004b5f9eb7a40b4906d7e197abf6903/images/31682baf-b55c-47ef-b773-9c8f462006d1 HTTP/1.1" 200 677
RESP: [200] Content-Length: 677 Content-Type: application/json X-Openstack-Nova-Api-Version: 2.1 Vary: X-OpenStack-Nova-API-Version X-Compute-Request-Id: req-36483ed5-d9ee-4e48-a73b-b0d2541b8f22 Date: Fri, 12 Aug 2016 13:16:03 GMT Connection: keep-alive 
RESP BODY: {"image": {"status": "ACTIVE", "updated": "2016-08-12T07:18:05Z", "links": [{"href": "http://controller:8774/v2.1/9004b5f9eb7a40b4906d7e197abf6903/images/31682baf-b55c-47ef-b773-9c8f462006d1", "rel": "self"}, {"href": "http://controller:8774/9004b5f9eb7a40b4906d7e197abf6903/images/31682baf-b55c-47ef-b773-9c8f462006d1", "rel": "bookmark"}, {"href": "http://10.0.0.40:9292/images/31682baf-b55c-47ef-b773-9c8f462006d1", "type": "application/vnd.openstack.image", "rel": "alternate"}], "id": "31682baf-b55c-47ef-b773-9c8f462006d1", "OS-EXT-IMG-SIZE:size": 13287936, "name": "cirros", "created": "2016-08-12T07:18:04Z", "minDisk": 0, "progress": 100, "minRam": 0, "metadata": {}}}

REQ: curl -g -i -X GET http://controller:8774/v2.1/9004b5f9eb7a40b4906d7e197abf6903/flavors/0 -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}d1918e0d0fe43f19c60f755d7dfb2fbc8b9a1761"
"GET /v2.1/9004b5f9eb7a40b4906d7e197abf6903/flavors/0 HTTP/1.1" 200 419
RESP: [200] Content-Length: 419 Content-Type: application/json X-Openstack-Nova-Api-Version: 2.1 Vary: X-OpenStack-Nova-API-Version X-Compute-Request-Id: req-918cd14f-ccea-4987-9e29-400cccd91b36 Date: Fri, 12 Aug 2016 13:16:03 GMT Connection: keep-alive 
RESP BODY: {"flavor": {"name": "m1.nano", "links": [{"href": "http://controller:8774/v2.1/9004b5f9eb7a40b4906d7e197abf6903/flavors/0", "rel": "self"}, {"href": "http://controller:8774/9004b5f9eb7a40b4906d7e197abf6903/flavors/0", "rel": "bookmark"}], "ram": 64, "OS-FLV-DISABLED:disabled": false, "vcpus": 1, "swap": "", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "0"}}

Network endpoint in service catalog
Connection: <openstack.connection.Connection object at 0x3850f90>
Network client initialized using OpenStack SDK: <openstack.network.v2._proxy.Proxy object at 0x3901a10>
REQ: curl -g -i -X GET http://controller:9696/v2.0/networks/bf33523d-589c-40d9-b465-b0c5dfd708ae -H "User-Agent: openstacksdk/0.8.3 keystoneauth1/2.4.1 python-requests/2.10.0 CPython/2.7.5" -H "X-Auth-Token: {SHA1}d1918e0d0fe43f19c60f755d7dfb2fbc8b9a1761"
Starting new HTTP connection (1): controller
"GET /v2.0/networks/bf33523d-589c-40d9-b465-b0c5dfd708ae HTTP/1.1" 200 663
RESP: [200] Content-Type: application/json; charset=UTF-8 Content-Length: 663 X-Openstack-Request-Id: req-669ca3f4-97a3-4958-a14f-400bb9439185 Date: Fri, 12 Aug 2016 13:16:03 GMT Connection: keep-alive 
RESP BODY: {"network": {"provider:physical_network": "provider", "ipv6_address_scope": null, "port_security_enabled": true, "mtu": 1500, "id": "bf33523d-589c-40d9-b465-b0c5dfd708ae", "router:external": true, "availability_zone_hints": [], "availability_zones": ["nova"], "ipv4_address_scope": null, "shared": true, "status": "ACTIVE", "subnets": ["34f4e7ab-490c-4926-a566-6f835e20afb3"], "description": "", "tags": [], "updated_at": "2016-08-11T07:09:41", "is_default": false, "provider:segmentation_id": null, "name": "provider", "admin_state_up": true, "tenant_id": "9004b5f9eb7a40b4906d7e197abf6903", "created_at": "2016-08-11T07:09:41", "provider:network_type": "flat"}}

boot_args: ['provider-instance', <Image: cirros>, <Flavor: m1.nano>]
boot_kwargs: {'files': {}, 'userdata': None, 'availability_zone': None, 'nics': [{'port-id': '', 'net-id': u'bf33523d-589c-40d9-b465-b0c5dfd708ae', 'v4-fixed-ip': '', 'v6-fixed-ip': ''}], 'block_device_mapping': {}, 'max_count': 1, 'meta': None, 'key_name': 'mykey', 'min_count': 1, 'scheduler_hints': {}, 'reservation_id': None, 'security_groups': ['default'], 'config_drive': None}
REQ: curl -g -i -X POST http://controller:8774/v2.1/9004b5f9eb7a40b4906d7e197abf6903/servers -H "User-Agent: python-novaclient" -H "Content-Type: application/json" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}d1918e0d0fe43f19c60f755d7dfb2fbc8b9a1761" -d '{"server": {"name": "provider-instance", "imageRef": "31682baf-b55c-47ef-b773-9c8f462006d1", "key_name": "mykey", "flavorRef": "0", "max_count": 1, "min_count": 1, "networks": [{"uuid": "bf33523d-589c-40d9-b465-b0c5dfd708ae"}], "security_groups": [{"name": "default"}]}}'
"POST /v2.1/9004b5f9eb7a40b4906d7e197abf6903/servers HTTP/1.1" 202 438
RESP: [202] Content-Length: 438 Location: http://controller:8774/v2.1/9004b5f9eb7a40b4906d7e197abf6903/servers/ed8b9ca1-967c-4a0f-859e-1d33a207e5c4 Content-Type: application/json X-Openstack-Nova-Api-Version: 2.1 Vary: X-OpenStack-Nova-API-Version X-Compute-Request-Id: req-35a7fb86-e9da-4a73-a7a0-59b60866180e Date: Fri, 12 Aug 2016 13:16:03 GMT Connection: keep-alive 
RESP BODY: {"server": {"security_groups": [{"name": "default"}], "OS-DCF:diskConfig": "MANUAL", "id": "ed8b9ca1-967c-4a0f-859e-1d33a207e5c4", "links": [{"href": "http://controller:8774/v2.1/9004b5f9eb7a40b4906d7e197abf6903/servers/ed8b9ca1-967c-4a0f-859e-1d33a207e5c4", "rel": "self"}, {"href": "http://controller:8774/9004b5f9eb7a40b4906d7e197abf6903/servers/ed8b9ca1-967c-4a0f-859e-1d33a207e5c4", "rel": "bookmark"}], "adminPass": "byJ9CBASr39C"}}

REQ: curl -g -i -X GET http://controller:8774/v2.1/9004b5f9eb7a40b4906d7e197abf6903/servers/ed8b9ca1-967c-4a0f-859e-1d33a207e5c4 -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}d1918e0d0fe43f19c60f755d7dfb2fbc8b9a1761"
"GET /v2.1/9004b5f9eb7a40b4906d7e197abf6903/servers/ed8b9ca1-967c-4a0f-859e-1d33a207e5c4 HTTP/1.1" 200 1429
RESP: [200] Content-Length: 1429 Content-Type: application/json X-Openstack-Nova-Api-Version: 2.1 Vary: X-OpenStack-Nova-API-Version X-Compute-Request-Id: req-9b1d2ef8-6530-4f36-bfe6-e2e6f8f91fbb Date: Fri, 12 Aug 2016 13:16:04 GMT Connection: keep-alive 
RESP BODY: {"server": {"status": "BUILD", "updated": "2016-08-12T13:16:04Z", "hostId": "", "OS-EXT-SRV-ATTR:host": null, "addresses": {}, "links": [{"href": "http://controller:8774/v2.1/9004b5f9eb7a40b4906d7e197abf6903/servers/ed8b9ca1-967c-4a0f-859e-1d33a207e5c4", "rel": "self"}, {"href": "http://controller:8774/9004b5f9eb7a40b4906d7e197abf6903/servers/ed8b9ca1-967c-4a0f-859e-1d33a207e5c4", "rel": "bookmark"}], "key_name": "mykey", "image": {"id": "31682baf-b55c-47ef-b773-9c8f462006d1", "links": [{"href": "http://controller:8774/9004b5f9eb7a40b4906d7e197abf6903/images/31682baf-b55c-47ef-b773-9c8f462006d1", "rel": "bookmark"}]}, "OS-EXT-STS:task_state": "scheduling", "OS-EXT-STS:vm_state": "building", "OS-EXT-SRV-ATTR:instance_name": "instance-0000000c", "OS-SRV-USG:launched_at": null, "OS-EXT-SRV-ATTR:hypervisor_hostname": null, "flavor": {"id": "0", "links": [{"href": "http://controller:8774/9004b5f9eb7a40b4906d7e197abf6903/flavors/0", "rel": "bookmark"}]}, "id": "ed8b9ca1-967c-4a0f-859e-1d33a207e5c4", "OS-SRV-USG:terminated_at": null, "OS-EXT-AZ:availability_zone": "", "user_id": "40ea01e3ad834163b400129f6dae4b15", "name": "provider-instance", "created": "2016-08-12T13:16:03Z", "tenant_id": "9004b5f9eb7a40b4906d7e197abf6903", "OS-DCF:diskConfig": "MANUAL", "os-extended-volumes:volumes_attached": [], "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 0, "config_drive": "", "metadata": {}}}

REQ: curl -g -i -X GET http://controller:8774/v2.1/9004b5f9eb7a40b4906d7e197abf6903/images/31682baf-b55c-47ef-b773-9c8f462006d1 -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}d1918e0d0fe43f19c60f755d7dfb2fbc8b9a1761"
"GET /v2.1/9004b5f9eb7a40b4906d7e197abf6903/images/31682baf-b55c-47ef-b773-9c8f462006d1 HTTP/1.1" 200 677
RESP: [200] Content-Length: 677 Content-Type: application/json X-Openstack-Nova-Api-Version: 2.1 Vary: X-OpenStack-Nova-API-Version X-Compute-Request-Id: req-dbeb87c6-483c-4a74-b0b6-22f937e9c182 Date: Fri, 12 Aug 2016 13:16:04 GMT Connection: keep-alive 
RESP BODY: {"image": {"status": "ACTIVE", "updated": "2016-08-12T07:18:05Z", "links": [{"href": "http://controller:8774/v2.1/9004b5f9eb7a40b4906d7e197abf6903/images/31682baf-b55c-47ef-b773-9c8f462006d1", "rel": "self"}, {"href": "http://controller:8774/9004b5f9eb7a40b4906d7e197abf6903/images/31682baf-b55c-47ef-b773-9c8f462006d1", "rel": "bookmark"}, {"href": "http://10.0.0.40:9292/images/31682baf-b55c-47ef-b773-9c8f462006d1", "type": "application/vnd.openstack.image", "rel": "alternate"}], "id": "31682baf-b55c-47ef-b773-9c8f462006d1", "OS-EXT-IMG-SIZE:size": 13287936, "name": "cirros", "created": "2016-08-12T07:18:04Z", "minDisk": 0, "progress": 100, "minRam": 0, "metadata": {}}}

REQ: curl -g -i -X GET http://controller:8774/v2.1/9004b5f9eb7a40b4906d7e197abf6903/flavors/0 -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}d1918e0d0fe43f19c60f755d7dfb2fbc8b9a1761"
"GET /v2.1/9004b5f9eb7a40b4906d7e197abf6903/flavors/0 HTTP/1.1" 200 419
RESP: [200] Content-Length: 419 Content-Type: application/json X-Openstack-Nova-Api-Version: 2.1 Vary: X-OpenStack-Nova-API-Version X-Compute-Request-Id: req-6b5a2ae7-ea71-4dd5-8b5b-909fae592040 Date: Fri, 12 Aug 2016 13:16:04 GMT Connection: keep-alive 
RESP BODY: {"flavor": {"name": "m1.nano", "links": [{"href": "http://controller:8774/v2.1/9004b5f9eb7a40b4906d7e197abf6903/flavors/0", "rel": "self"}, {"href": "http://controller:8774/9004b5f9eb7a40b4906d7e197abf6903/flavors/0", "rel": "bookmark"}], "ram": 64, "OS-FLV-DISABLED:disabled": false, "vcpus": 1, "swap": "", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "0"}}

+--------------------------------------+-----------------------------------------------+
| Field                                | Value                                         |
+--------------------------------------+-----------------------------------------------+
| OS-DCF:diskConfig                    | MANUAL                                        |
| OS-EXT-AZ:availability_zone          |                                               |
| OS-EXT-SRV-ATTR:host                 | None                                          |
| OS-EXT-SRV-ATTR:hypervisor_hostname  | None                                          |
| OS-EXT-SRV-ATTR:instance_name        | instance-0000000c                             |
| OS-EXT-STS:power_state               | 0                                             |
| OS-EXT-STS:task_state                | scheduling                                    |
| OS-EXT-STS:vm_state                  | building                                      |
| OS-SRV-USG:launched_at               | None                                          |
| OS-SRV-USG:terminated_at             | None                                          |
| accessIPv4                           |                                               |
| accessIPv6                           |                                               |
| addresses                            |                                               |
| adminPass                            | byJ9CBASr39C                                  |
| config_drive                         |                                               |
| created                              | 2016-08-12T13:16:03Z                          |
| flavor                               | m1.nano (0)                                   |
| hostId                               |                                               |
| id                                   | ed8b9ca1-967c-4a0f-859e-1d33a207e5c4          |
| image                                | cirros (31682baf-b55c-47ef-b773-9c8f462006d1) |
| key_name                             | mykey                                         |
| name                                 | provider-instance                             |
| os-extended-volumes:volumes_attached | []                                            |
| progress                             | 0                                             |
| project_id                           | 9004b5f9eb7a40b4906d7e197abf6903              |
| properties                           |                                               |
| security_groups                      | [{u'name': u'default'}]                       |
| status                               | BUILD                                         |
| updated                              | 2016-08-12T13:16:04Z                          |
| user_id                              | 40ea01e3ad834163b400129f6dae4b15              |
+--------------------------------------+-----------------------------------------------+