Ask Your Question

Revision history [back]

Unexpected API Error

trying to create instance with reserved ip, seems to be crashing. May be the mapped volume as well. Will troubleshoot and refine.

using command:

server create --volume b2f1db21-463a-47b8-bbc5-45c670752fd2 --flavor Orbit.large --security-group default --nic port-id=orbdev1.orbit8.com orbdev1.orbit8.com

(openstack) server list
+--------------------------------------+---------+--------+--------------------------------+------------+
| ID | Name | Status | Networks | Image Name |
+--------------------------------------+---------+--------+--------------------------------+------------+
| e1492d01-748e-4c4b-81c4-320d81e2c7a7 | sddf | ACTIVE | polaris_external_15=10.1.15.34 | cirros |
| e736d645-7738-4119-8ffa-88e07c52bb2f | orbdev2 | ACTIVE | polaris_external_15=10.1.15.29 | |
+--------------------------------------+---------+--------+--------------------------------+------------+
(openstack) volume list
+--------------------------------------+--------------+-----------+------+----------------------------------+
| ID | Display Name | Status | Size | Attached to |
+--------------------------------------+--------------+-----------+------+----------------------------------+
| f991c440-edf4-4492-846f-bdd0928687de | | in-use | 100 | Attached to orbdev2 on /dev/vda |
| b2f1db21-463a-47b8-bbc5-45c670752fd2 | | available | 200 | |
+--------------------------------------+--------------+-----------+------+----------------------------------+
(openstack) port list
+--------------------------------------+--------------------+-------------------+------------------------------------------------------------------------------+
| ID | Name | MAC Address | Fixed IP Addresses |
+--------------------------------------+--------------------+-------------------+------------------------------------------------------------------------------+
| 0737228d-da99-471b-ba78-621068dbc97b | rwb2.orbit8.com | fa:16:3e:11:e4:b8 | ip_address='10.1.15.56', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 13aeb33e-de25-4d4a-8a25-2ec17933ddd0 | | fa:16:3e:13:ef:69 | ip_address='172.17.0.1', subnet_id='8410f6ef-d264-4509-b295-5b0a268f7cd0' |
| 14ae55b8-9b40-435d-9bd1-72987a76d304 | | fa:16:3e:a3:61:95 | ip_address='172.16.0.1', subnet_id='8036a43e-3cd9-402b-9898-b6314766f099' |
| 1d994403-0204-4b48-a0bf-00db14a55bb6 | | fa:16:3e:77:e0:74 | ip_address='50.205.206.34', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 2092a1d9-95aa-475d-b069-b0ad17eed85d | | fa:16:3e:e8:8e:1b | ip_address='172.16.0.2', subnet_id='8036a43e-3cd9-402b-9898-b6314766f099' |
| 2404e63c-8b9b-475d-85a9-7ef0c483f6b7 | | fa:16:3e:6c:e7:2b | ip_address='192.168.10.2', subnet_id='aaf18006-4f66-45aa-8003-fd3d64e68fe6' |
| 2f6aad25-3091-446b-adf7-d8bbfceb4a0a | | fa:16:3e:f8:c3:3b | ip_address='50.205.206.54', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 31daa221-cb9c-4345-9416-7773039bbb17 | | fa:16:3e:87:98:e0 | ip_address='10.1.15.26', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 4376a9e5-2c89-475a-9efb-57ae3c4e88ff | | fa:16:3e:90:1f:ae | ip_address='10.1.15.34', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 45605cf4-3ebb-4fbf-94f6-29bf9ca288ef | | fa:16:3e:55:d8:95 | ip_address='10.1.15.25', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 48f85efc-d02b-4e9c-8783-1ea534b0e3d3 | rwb1.orbit8.com | fa:16:3e:ea:b4:9d | ip_address='10.1.15.55', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 48fd38b1-9517-47bd-8cd6-32c5f0e5175d | | fa:16:3e:5f:69:0c | ip_address='50.205.206.42', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 5057a4d2-1147-47c3-a725-0cb14ea7cb29 | | fa:16:3e:51:0e:85 | ip_address='192.168.10.16', subnet_id='aaf18006-4f66-45aa-8003-fd3d64e68fe6' |
| 64e5d10f-c257-42b9-a911-b66d4c4d877b | | fa:16:3e:6b:bb:e0 | ip_address='172.17.0.6', subnet_id='8410f6ef-d264-4509-b295-5b0a268f7cd0' |
| 66c3f100-1269-41a6-9a8a-ac28e4124925 | | fa:16:3e:8d:78:2e | ip_address='192.168.10.1', subnet_id='aaf18006-4f66-45aa-8003-fd3d64e68fe6' |
| 6e755e56-0a9a-420f-99e6-056a51eab0b3 | rwb3.orbit8.com | fa:16:3e:ed:86:af | ip_address='10.1.15.57', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 70e27604-712e-427f-b1f4-6358e3154d7a | | fa:16:3e:53:a7:80 | ip_address='10.1.15.2', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 88779531-91d6-479c-b59b-15b588fab9b3 | | fa:16:3e:42:8b:55 | ip_address='172.17.0.2', subnet_id='8410f6ef-d264-4509-b295-5b0a268f7cd0' |
| 8bd37cd1-35ea-4082-96aa-5637398c6f27 | | fa:16:3e:60:ff:19 | ip_address='172.16.0.23', subnet_id='8036a43e-3cd9-402b-9898-b6314766f099' |
| 8c1a82be-208b-428f-8b2f-16bcd6f36f8e | | fa:16:3e:5a:2e:fb | ip_address='50.205.206.43', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 9b8990f2-2557-4d0a-901c-c776e21f13b6 | | fa:16:3e:3f:af:ce | ip_address='10.1.15.29', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| a2ad1af6-112e-43a1-bc95-68beb71d41e5 | orbdev1.orbit8.com | fa:16:3e:7e:2a:14 | ip_address='10.1.15.38', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| ddbac8d8-6b65-4635-988b-ea073ab9c974 | | fa:16:3e:8d:9c:9a | ip_address='50.205.206.61', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
+--------------------------------------+--------------------+-------------------+------------------------------------------------------------------------------+
(openstack) flavor list
+--------------------------------------+-------------+-------+------+-----------+-------+-----------+
| ID | Name | RAM | Disk | Ephemeral | VCPUs | Is Public |
+--------------------------------------+-------------+-------+------+-----------+-------+-----------+
| 0800454b-6443-488f-83e1-3b6dc28206cd | Orbit.large | 24576 | 200 | 0 | 6 | True |
| 1 | m1.tiny | 512 | 1 | 0 | 1 | True |
| 2 | m1.small | 2048 | 20 | 0 | 1 | True |
| 29a949c8-df05-4d37-b45b-c3e27354d317 | win.default | 8192 | 150 | 0 | 4 | True |
| 3 | m1.medium | 4096 | 40 | 0 | 2 | True |
| 4 | m1.large | 8192 | 80 | 0 | 4 | True |
| 88551500-f112-419e-8b86-39f688307b78 | RWB.large | 12288 | 0 | 0 | 6 | True |
| d496c777-6567-4190-b5ff-80af77b63971 | RWB.default | 6144 | 0 | 0 | 3 | True |
| df34cda0-dd1c-4c26-924c-511936fae7ca | m1.xlarge | 16384 | 160 | 0 | 8 | True |
+--------------------------------------+-------------+-------+------+-----------+-------+-----------+
(openstack) security group list
+--------------------------------------+--------------+------------------------+----------------------------------+
| ID | Name | Description | Project |
+--------------------------------------+--------------+------------------------+----------------------------------+
| 092a95a9-7919-4df7-9beb-8bf8dc7575d3 | default | Default security group | e321061a2503461cbdb2de337bb40ce8 |
| 21e0f5b5-f1e3-4992-a826-40015b8900dd | RWB_SG_Ports | Open Ports: | e321061a2503461cbdb2de337bb40ce8 |
| | | 22 (ssh) | |
| | | 1521 (oracle) | |
| | | 8000 (EBS/RWB) | |
| 3ae00dbd-0b54-405d-ab94-8a599bbec5cf | default | Default security group | d53fb31b2a7b4442ad2fdbaddb53f87a |
| 60680841-0204-455d-99fe-2551ccae8bc4 | default | Default security group | 0ea5806cf79b4292984df3b797898332 |
| 71b0f4a6-b414-4767-a129-9bff01ddc4f4 | all_test | | 13a1787f2d96486ab89a0cd43be60878 |
| 7e8ab26a-4ca3-4a39-9342-9774a7db89a9 | default | Default security group | bdf4deeb6a944b9f8b878242032a3007 |
| aea5209d-4611-47b8-90d4-5919c00e326c | Jumpbox | | 13a1787f2d96486ab89a0cd43be60878 |
| d53e3ee0-5df8-42bd-b587-e6fb08d23176 | default | Default security group | 13a1787f2d96486ab89a0cd43be60878 |
| e407d925-4a06-45c2-b786-88f583fc38ad | LocalNet | | 13a1787f2d96486ab89a0cd43be60878 |
+--------------------------------------+--------------+------------------------+----------------------------------+
(openstack)

==> /var/log/nova/nova-api.log <==
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions [req-6142acfa-ae8c-479a-ba5c-6981add0ff47 f7b5d10d858b46e3aa4609125ca8c845 bdf4deeb6a944b9f8b878242032a3007 - - -] Unexpected exception in API method
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions Traceback (most recent call last):
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/extensions.py", line 478, in wrapped
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return f(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 629, in create
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions **create_kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/hooks.py", line 154, in inner
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions rv = f(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1563, in create
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions check_server_group_quota=check_server_group_quota)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1146, in _create_instance
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions reservation_id, max_count)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 873, in _validate_and_build_base_options
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions pci_request_info, requested_networks)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 1088, in create_pci_requests_for_sriov_ports
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions context, neutron, request_net.port_id)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 1061, in _get_port_vnic_info
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions fields=['binding:vnic_type', 'network_id'])
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 908, in _show_port
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions result = neutron_client.show_port(port_id, fields=fields)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 97, in with_params
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions ret = self.function(instance, *args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 649, in show_port
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return self.get(self.port_path % (port), params=_params)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 358, in get
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions headers=headers, params=params)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 335, in retry_request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions headers=headers, params=params)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 286, in do_request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions resp, replybody = self.httpclient.do_request(action, method, body=body)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/client.py", line 306, in do_request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return self.request(url, method, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/client.py", line 294, in request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions resp = super(SessionClient, self).request(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 98, in request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return self.session.request(url, method, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/positional/__init__.py", line 94, in inner
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 370, in request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions auth_headers = self.get_auth_headers(auth)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 624, in get_auth_headers
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return auth.get_headers(self, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/plugin.py", line 84, in get_headers
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions token = self.get_token(session)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 90, in get_token
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return self.get_access(session).auth_token
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 136, in get_access
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions self.auth_ref = self.get_auth_ref(session)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/v3/base.py", line 167, in get_auth_ref
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions authenticated=False, log=False, **rkwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 572, in post
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return self.request(url, 'POST', **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/positional/__init__.py", line 94, in inner
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 467, in request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions raise exceptions.from_response(resp, method, url)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions NotFound: The resource could not be found. (HTTP 404) (Request-ID: req-50ed200a-6785-4edd-b861-835f9a8100ad)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions
2016-11-15 22:37:37.684 31941 INFO nova.api.openstack.wsgi [req-6142acfa-ae8c-479a-ba5c-6981add0ff47 f7b5d10d858b46e3aa4609125ca8c845 bdf4deeb6a944b9f8b878242032a3007 - - -] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'keystoneauth1.exceptions.http.NotFound'>
2016-11-15 22:37:37.685 31941 INFO nova.osapi_compute.wsgi.server [req-6142acfa-ae8c-479a-ba5c-6981add0ff47 f7b5d10d858b46e3aa4609125ca8c845 bdf4deeb6a944b9f8b878242032a3007 - - -] 10.212.134.200 "POST /v2/bdf4deeb6a944b9f8b878242032a3007/os-volumes_boot HTTP/1.1" status: 500 len: 443 time: 0.4011800

confirmed issue with port-create....... This used to work. will try doing this in another project with another ip, etc...

(openstack) port list
+--------------------------------------+--------------------+-------------------+------------------------------------------------------------------------------+
| ID | Name | MAC Address | Fixed IP Addresses |
+--------------------------------------+--------------------+-------------------+------------------------------------------------------------------------------+
| 0737228d-da99-471b-ba78-621068dbc97b | rwb2.orbit8.com | fa:16:3e:11:e4:b8 | ip_address='10.1.15.56', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 13aeb33e-de25-4d4a-8a25-2ec17933ddd0 | | fa:16:3e:13:ef:69 | ip_address='172.17.0.1', subnet_id='8410f6ef-d264-4509-b295-5b0a268f7cd0' |
| 14ae55b8-9b40-435d-9bd1-72987a76d304 | | fa:16:3e:a3:61:95 | ip_address='172.16.0.1', subnet_id='8036a43e-3cd9-402b-9898-b6314766f099' |
| 1d994403-0204-4b48-a0bf-00db14a55bb6 | | fa:16:3e:77:e0:74 | ip_address='50.205.206.34', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 2092a1d9-95aa-475d-b069-b0ad17eed85d | | fa:16:3e:e8:8e:1b | ip_address='172.16.0.2', subnet_id='8036a43e-3cd9-402b-9898-b6314766f099' |
| 2404e63c-8b9b-475d-85a9-7ef0c483f6b7 | | fa:16:3e:6c:e7:2b | ip_address='192.168.10.2', subnet_id='aaf18006-4f66-45aa-8003-fd3d64e68fe6' |
| 2f6aad25-3091-446b-adf7-d8bbfceb4a0a | | fa:16:3e:f8:c3:3b | ip_address='50.205.206.54', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 31daa221-cb9c-4345-9416-7773039bbb17 | | fa:16:3e:87:98:e0 | ip_address='10.1.15.26', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 4376a9e5-2c89-475a-9efb-57ae3c4e88ff | | fa:16:3e:90:1f:ae | ip_address='10.1.15.34', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 45605cf4-3ebb-4fbf-94f6-29bf9ca288ef | | fa:16:3e:55:d8:95 | ip_address='10.1.15.25', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 48f85efc-d02b-4e9c-8783-1ea534b0e3d3 | rwb1.orbit8.com | fa:16:3e:ea:b4:9d | ip_address='10.1.15.55', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 48fd38b1-9517-47bd-8cd6-32c5f0e5175d | | fa:16:3e:5f:69:0c | ip_address='50.205.206.42', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 5057a4d2-1147-47c3-a725-0cb14ea7cb29 | | fa:16:3e:51:0e:85 | ip_address='192.168.10.16', subnet_id='aaf18006-4f66-45aa-8003-fd3d64e68fe6' |
| 64e5d10f-c257-42b9-a911-b66d4c4d877b | | fa:16:3e:6b:bb:e0 | ip_address='172.17.0.6', subnet_id='8410f6ef-d264-4509-b295-5b0a268f7cd0' |
| 66c3f100-1269-41a6-9a8a-ac28e4124925 | | fa:16:3e:8d:78:2e | ip_address='192.168.10.1', subnet_id='aaf18006-4f66-45aa-8003-fd3d64e68fe6' |
| 6e755e56-0a9a-420f-99e6-056a51eab0b3 | rwb3.orbit8.com | fa:16:3e:ed:86:af | ip_address='10.1.15.57', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 70e27604-712e-427f-b1f4-6358e3154d7a | | fa:16:3e:53:a7:80 | ip_address='10.1.15.2', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 88779531-91d6-479c-b59b-15b588fab9b3 | | fa:16:3e:42:8b:55 | ip_address='172.17.0.2', subnet_id='8410f6ef-d264-4509-b295-5b0a268f7cd0' |
| 8bd37cd1-35ea-4082-96aa-5637398c6f27 | | fa:16:3e:60:ff:19 | ip_address='172.16.0.23', subnet_id='8036a43e-3cd9-402b-9898-b6314766f099' |
| 8c1a82be-208b-428f-8b2f-16bcd6f36f8e | | fa:16:3e:5a:2e:fb | ip_address='50.205.206.43', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 9b8990f2-2557-4d0a-901c-c776e21f13b6 | | fa:16:3e:3f:af:ce | ip_address='10.1.15.29', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| a2ad1af6-112e-43a1-bc95-68beb71d41e5 | orbdev1.orbit8.com | fa:16:3e:7e:2a:14 | ip_address='10.1.15.38', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| ddbac8d8-6b65-4635-988b-ea073ab9c974 | | fa:16:3e:8d:9c:9a | ip_address='50.205.206.61', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
+--------------------------------------+--------------------+-------------------+------------------------------------------------------------------------------+
(openstack) server create --volume b2f1db21-463a-47b8-bbc5-45c670752fd2 --flavor Orbit.large --security-group default --nic port-id=a2ad1af6-112e-43a1-bc95-68beb71d41e5 orbdev1.orbit8.com
Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'keystoneauth1.exceptions.http.NotFound'> (HTTP 500) (Request-ID: req-3594a962-0c55-4a0c-99d2-dc5e09a8e00f)
(openstack) server create --volume b2f1db21-463a-47b8-bbc5-45c670752fd2 --flavor Orbit.large --security-group default --nic net-id=polaris_external_15 orbdev1.orbit8.com
+--------------------------------------+----------------------------------------------------+
| Field | Value |
+--------------------------------------+----------------------------------------------------+
| OS-DCF:diskConfig | MANUAL |
| OS-EXT-AZ:availability_zone | |
| OS-EXT-SRV-ATTR:host | None |
| OS-EXT-SRV-ATTR:hypervisor_hostname | None |
| OS-EXT-SRV-ATTR:instance_name | instance-00000056 |
| OS-EXT-STS:power_state | NOSTATE |
| OS-EXT-STS:task_state | scheduling |
| OS-EXT-STS:vm_state | building |
| OS-SRV-USG:launched_at | None |
| OS-SRV-USG:terminated_at | None |
| accessIPv4 | |
| accessIPv6 | |
| addresses | |
| adminPass | nyJa2mSM4rdN |
| config_drive | |
| created | 2016-11-16T04:06:29Z |
| flavor | Orbit.large (0800454b-6443-488f-83e1-3b6dc28206cd) |
| hostId | |
| id | db2b952f-430f-4b6c-8014-1f14829e60fd |
| image | |
| key_name | None |
| name | orbdev1.orbit8.com |
| os-extended-volumes:volumes_attached | [{u'id': u'b2f1db21-463a-47b8-bbc5-45c670752fd2'}] |
| progress | 0 |
| project_id | bdf4deeb6a944b9f8b878242032a3007 |
| properties | |
| security_groups | [{u'name': u'default'}] |
| status | BUILD |
| updated | 2016-11-16T04:06:30Z |
| user_id | f7b5d10d858b46e3aa4609125ca8c845 |
+--------------------------------------+----------------------------------------------------+
(openstack)

Unexpected API Error

trying to create instance with reserved ip, seems to be crashing. May be the mapped volume as well. Will troubleshoot and refine.

using command:

server create --volume b2f1db21-463a-47b8-bbc5-45c670752fd2 --flavor Orbit.large --security-group default --nic port-id=orbdev1.orbit8.com orbdev1.orbit8.com

(openstack) server list
+--------------------------------------+---------+--------+--------------------------------+------------+
| ID | Name | Status | Networks | Image Name |
+--------------------------------------+---------+--------+--------------------------------+------------+
| e1492d01-748e-4c4b-81c4-320d81e2c7a7 | sddf | ACTIVE | polaris_external_15=10.1.15.34 | cirros |
| e736d645-7738-4119-8ffa-88e07c52bb2f | orbdev2 | ACTIVE | polaris_external_15=10.1.15.29 | |
+--------------------------------------+---------+--------+--------------------------------+------------+
(openstack) volume list
+--------------------------------------+--------------+-----------+------+----------------------------------+
| ID | Display Name | Status | Size | Attached to |
+--------------------------------------+--------------+-----------+------+----------------------------------+
| f991c440-edf4-4492-846f-bdd0928687de | | in-use | 100 | Attached to orbdev2 on /dev/vda |
| b2f1db21-463a-47b8-bbc5-45c670752fd2 | | available | 200 | |
+--------------------------------------+--------------+-----------+------+----------------------------------+
(openstack) port list
+--------------------------------------+--------------------+-------------------+------------------------------------------------------------------------------+
| ID | Name | MAC Address | Fixed IP Addresses |
+--------------------------------------+--------------------+-------------------+------------------------------------------------------------------------------+
| 0737228d-da99-471b-ba78-621068dbc97b | rwb2.orbit8.com | fa:16:3e:11:e4:b8 | ip_address='10.1.15.56', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 13aeb33e-de25-4d4a-8a25-2ec17933ddd0 | | fa:16:3e:13:ef:69 | ip_address='172.17.0.1', subnet_id='8410f6ef-d264-4509-b295-5b0a268f7cd0' |
| 14ae55b8-9b40-435d-9bd1-72987a76d304 | | fa:16:3e:a3:61:95 | ip_address='172.16.0.1', subnet_id='8036a43e-3cd9-402b-9898-b6314766f099' |
| 1d994403-0204-4b48-a0bf-00db14a55bb6 | | fa:16:3e:77:e0:74 | ip_address='50.205.206.34', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 2092a1d9-95aa-475d-b069-b0ad17eed85d | | fa:16:3e:e8:8e:1b | ip_address='172.16.0.2', subnet_id='8036a43e-3cd9-402b-9898-b6314766f099' |
| 2404e63c-8b9b-475d-85a9-7ef0c483f6b7 | | fa:16:3e:6c:e7:2b | ip_address='192.168.10.2', subnet_id='aaf18006-4f66-45aa-8003-fd3d64e68fe6' |
| 2f6aad25-3091-446b-adf7-d8bbfceb4a0a | | fa:16:3e:f8:c3:3b | ip_address='50.205.206.54', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 31daa221-cb9c-4345-9416-7773039bbb17 | | fa:16:3e:87:98:e0 | ip_address='10.1.15.26', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 4376a9e5-2c89-475a-9efb-57ae3c4e88ff | | fa:16:3e:90:1f:ae | ip_address='10.1.15.34', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 45605cf4-3ebb-4fbf-94f6-29bf9ca288ef | | fa:16:3e:55:d8:95 | ip_address='10.1.15.25', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 48f85efc-d02b-4e9c-8783-1ea534b0e3d3 | rwb1.orbit8.com | fa:16:3e:ea:b4:9d | ip_address='10.1.15.55', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 48fd38b1-9517-47bd-8cd6-32c5f0e5175d | | fa:16:3e:5f:69:0c | ip_address='50.205.206.42', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 5057a4d2-1147-47c3-a725-0cb14ea7cb29 | | fa:16:3e:51:0e:85 | ip_address='192.168.10.16', subnet_id='aaf18006-4f66-45aa-8003-fd3d64e68fe6' |
| 64e5d10f-c257-42b9-a911-b66d4c4d877b | | fa:16:3e:6b:bb:e0 | ip_address='172.17.0.6', subnet_id='8410f6ef-d264-4509-b295-5b0a268f7cd0' |
| 66c3f100-1269-41a6-9a8a-ac28e4124925 | | fa:16:3e:8d:78:2e | ip_address='192.168.10.1', subnet_id='aaf18006-4f66-45aa-8003-fd3d64e68fe6' |
| 6e755e56-0a9a-420f-99e6-056a51eab0b3 | rwb3.orbit8.com | fa:16:3e:ed:86:af | ip_address='10.1.15.57', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 70e27604-712e-427f-b1f4-6358e3154d7a | | fa:16:3e:53:a7:80 | ip_address='10.1.15.2', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 88779531-91d6-479c-b59b-15b588fab9b3 | | fa:16:3e:42:8b:55 | ip_address='172.17.0.2', subnet_id='8410f6ef-d264-4509-b295-5b0a268f7cd0' |
| 8bd37cd1-35ea-4082-96aa-5637398c6f27 | | fa:16:3e:60:ff:19 | ip_address='172.16.0.23', subnet_id='8036a43e-3cd9-402b-9898-b6314766f099' |
| 8c1a82be-208b-428f-8b2f-16bcd6f36f8e | | fa:16:3e:5a:2e:fb | ip_address='50.205.206.43', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 9b8990f2-2557-4d0a-901c-c776e21f13b6 | | fa:16:3e:3f:af:ce | ip_address='10.1.15.29', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| a2ad1af6-112e-43a1-bc95-68beb71d41e5 | orbdev1.orbit8.com | fa:16:3e:7e:2a:14 | ip_address='10.1.15.38', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| ddbac8d8-6b65-4635-988b-ea073ab9c974 | | fa:16:3e:8d:9c:9a | ip_address='50.205.206.61', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
+--------------------------------------+--------------------+-------------------+------------------------------------------------------------------------------+
(openstack) flavor list
+--------------------------------------+-------------+-------+------+-----------+-------+-----------+
| ID | Name | RAM | Disk | Ephemeral | VCPUs | Is Public |
+--------------------------------------+-------------+-------+------+-----------+-------+-----------+
| 0800454b-6443-488f-83e1-3b6dc28206cd | Orbit.large | 24576 | 200 | 0 | 6 | True |
| 1 | m1.tiny | 512 | 1 | 0 | 1 | True |
| 2 | m1.small | 2048 | 20 | 0 | 1 | True |
| 29a949c8-df05-4d37-b45b-c3e27354d317 | win.default | 8192 | 150 | 0 | 4 | True |
| 3 | m1.medium | 4096 | 40 | 0 | 2 | True |
| 4 | m1.large | 8192 | 80 | 0 | 4 | True |
| 88551500-f112-419e-8b86-39f688307b78 | RWB.large | 12288 | 0 | 0 | 6 | True |
| d496c777-6567-4190-b5ff-80af77b63971 | RWB.default | 6144 | 0 | 0 | 3 | True |
| df34cda0-dd1c-4c26-924c-511936fae7ca | m1.xlarge | 16384 | 160 | 0 | 8 | True |
+--------------------------------------+-------------+-------+------+-----------+-------+-----------+
(openstack) security group list
+--------------------------------------+--------------+------------------------+----------------------------------+
| ID | Name | Description | Project |
+--------------------------------------+--------------+------------------------+----------------------------------+
| 092a95a9-7919-4df7-9beb-8bf8dc7575d3 | default | Default security group | e321061a2503461cbdb2de337bb40ce8 |
| 21e0f5b5-f1e3-4992-a826-40015b8900dd | RWB_SG_Ports | Open Ports: | e321061a2503461cbdb2de337bb40ce8 |
| | | 22 (ssh) | |
| | | 1521 (oracle) | |
| | | 8000 (EBS/RWB) | |
| 3ae00dbd-0b54-405d-ab94-8a599bbec5cf | default | Default security group | d53fb31b2a7b4442ad2fdbaddb53f87a |
| 60680841-0204-455d-99fe-2551ccae8bc4 | default | Default security group | 0ea5806cf79b4292984df3b797898332 |
| 71b0f4a6-b414-4767-a129-9bff01ddc4f4 | all_test | | 13a1787f2d96486ab89a0cd43be60878 |
| 7e8ab26a-4ca3-4a39-9342-9774a7db89a9 | default | Default security group | bdf4deeb6a944b9f8b878242032a3007 |
| aea5209d-4611-47b8-90d4-5919c00e326c | Jumpbox | | 13a1787f2d96486ab89a0cd43be60878 |
| d53e3ee0-5df8-42bd-b587-e6fb08d23176 | default | Default security group | 13a1787f2d96486ab89a0cd43be60878 |
| e407d925-4a06-45c2-b786-88f583fc38ad | LocalNet | | 13a1787f2d96486ab89a0cd43be60878 |
+--------------------------------------+--------------+------------------------+----------------------------------+
(openstack)

==> /var/log/nova/nova-api.log <==
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions [req-6142acfa-ae8c-479a-ba5c-6981add0ff47 f7b5d10d858b46e3aa4609125ca8c845 bdf4deeb6a944b9f8b878242032a3007 - - -] Unexpected exception in API method
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions Traceback (most recent call last):
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/extensions.py", line 478, in wrapped
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return f(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 629, in create
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions **create_kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/hooks.py", line 154, in inner
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions rv = f(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1563, in create
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions check_server_group_quota=check_server_group_quota)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1146, in _create_instance
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions reservation_id, max_count)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 873, in _validate_and_build_base_options
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions pci_request_info, requested_networks)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 1088, in create_pci_requests_for_sriov_ports
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions context, neutron, request_net.port_id)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 1061, in _get_port_vnic_info
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions fields=['binding:vnic_type', 'network_id'])
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 908, in _show_port
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions result = neutron_client.show_port(port_id, fields=fields)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 97, in with_params
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions ret = self.function(instance, *args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 649, in show_port
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return self.get(self.port_path % (port), params=_params)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 358, in get
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions headers=headers, params=params)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 335, in retry_request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions headers=headers, params=params)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 286, in do_request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions resp, replybody = self.httpclient.do_request(action, method, body=body)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/client.py", line 306, in do_request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return self.request(url, method, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/client.py", line 294, in request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions resp = super(SessionClient, self).request(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 98, in request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return self.session.request(url, method, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/positional/__init__.py", line 94, in inner
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 370, in request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions auth_headers = self.get_auth_headers(auth)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 624, in get_auth_headers
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return auth.get_headers(self, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/plugin.py", line 84, in get_headers
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions token = self.get_token(session)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 90, in get_token
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return self.get_access(session).auth_token
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 136, in get_access
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions self.auth_ref = self.get_auth_ref(session)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/v3/base.py", line 167, in get_auth_ref
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions authenticated=False, log=False, **rkwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 572, in post
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return self.request(url, 'POST', **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/positional/__init__.py", line 94, in inner
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 467, in request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions raise exceptions.from_response(resp, method, url)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions NotFound: The resource could not be found. (HTTP 404) (Request-ID: req-50ed200a-6785-4edd-b861-835f9a8100ad)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions
2016-11-15 22:37:37.684 31941 INFO nova.api.openstack.wsgi [req-6142acfa-ae8c-479a-ba5c-6981add0ff47 f7b5d10d858b46e3aa4609125ca8c845 bdf4deeb6a944b9f8b878242032a3007 - - -] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'keystoneauth1.exceptions.http.NotFound'>
2016-11-15 22:37:37.685 31941 INFO nova.osapi_compute.wsgi.server [req-6142acfa-ae8c-479a-ba5c-6981add0ff47 f7b5d10d858b46e3aa4609125ca8c845 bdf4deeb6a944b9f8b878242032a3007 - - -] 10.212.134.200 "POST /v2/bdf4deeb6a944b9f8b878242032a3007/os-volumes_boot HTTP/1.1" status: 500 len: 443 time: 0.4011800

confirmed issue with port-create....... This used to work. will try doing this in another project with another ip, etc...

(openstack) port list
+--------------------------------------+--------------------+-------------------+------------------------------------------------------------------------------+
| ID | Name | MAC Address | Fixed IP Addresses |
+--------------------------------------+--------------------+-------------------+------------------------------------------------------------------------------+
| 0737228d-da99-471b-ba78-621068dbc97b | rwb2.orbit8.com | fa:16:3e:11:e4:b8 | ip_address='10.1.15.56', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 13aeb33e-de25-4d4a-8a25-2ec17933ddd0 | | fa:16:3e:13:ef:69 | ip_address='172.17.0.1', subnet_id='8410f6ef-d264-4509-b295-5b0a268f7cd0' |
| 14ae55b8-9b40-435d-9bd1-72987a76d304 | | fa:16:3e:a3:61:95 | ip_address='172.16.0.1', subnet_id='8036a43e-3cd9-402b-9898-b6314766f099' |
| 1d994403-0204-4b48-a0bf-00db14a55bb6 | | fa:16:3e:77:e0:74 | ip_address='50.205.206.34', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 2092a1d9-95aa-475d-b069-b0ad17eed85d | | fa:16:3e:e8:8e:1b | ip_address='172.16.0.2', subnet_id='8036a43e-3cd9-402b-9898-b6314766f099' |
| 2404e63c-8b9b-475d-85a9-7ef0c483f6b7 | | fa:16:3e:6c:e7:2b | ip_address='192.168.10.2', subnet_id='aaf18006-4f66-45aa-8003-fd3d64e68fe6' |
| 2f6aad25-3091-446b-adf7-d8bbfceb4a0a | | fa:16:3e:f8:c3:3b | ip_address='50.205.206.54', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 31daa221-cb9c-4345-9416-7773039bbb17 | | fa:16:3e:87:98:e0 | ip_address='10.1.15.26', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 4376a9e5-2c89-475a-9efb-57ae3c4e88ff | | fa:16:3e:90:1f:ae | ip_address='10.1.15.34', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 45605cf4-3ebb-4fbf-94f6-29bf9ca288ef | | fa:16:3e:55:d8:95 | ip_address='10.1.15.25', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 48f85efc-d02b-4e9c-8783-1ea534b0e3d3 | rwb1.orbit8.com | fa:16:3e:ea:b4:9d | ip_address='10.1.15.55', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 48fd38b1-9517-47bd-8cd6-32c5f0e5175d | | fa:16:3e:5f:69:0c | ip_address='50.205.206.42', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 5057a4d2-1147-47c3-a725-0cb14ea7cb29 | | fa:16:3e:51:0e:85 | ip_address='192.168.10.16', subnet_id='aaf18006-4f66-45aa-8003-fd3d64e68fe6' |
| 64e5d10f-c257-42b9-a911-b66d4c4d877b | | fa:16:3e:6b:bb:e0 | ip_address='172.17.0.6', subnet_id='8410f6ef-d264-4509-b295-5b0a268f7cd0' |
| 66c3f100-1269-41a6-9a8a-ac28e4124925 | | fa:16:3e:8d:78:2e | ip_address='192.168.10.1', subnet_id='aaf18006-4f66-45aa-8003-fd3d64e68fe6' |
| 6e755e56-0a9a-420f-99e6-056a51eab0b3 | rwb3.orbit8.com | fa:16:3e:ed:86:af | ip_address='10.1.15.57', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 70e27604-712e-427f-b1f4-6358e3154d7a | | fa:16:3e:53:a7:80 | ip_address='10.1.15.2', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 88779531-91d6-479c-b59b-15b588fab9b3 | | fa:16:3e:42:8b:55 | ip_address='172.17.0.2', subnet_id='8410f6ef-d264-4509-b295-5b0a268f7cd0' |
| 8bd37cd1-35ea-4082-96aa-5637398c6f27 | | fa:16:3e:60:ff:19 | ip_address='172.16.0.23', subnet_id='8036a43e-3cd9-402b-9898-b6314766f099' |
| 8c1a82be-208b-428f-8b2f-16bcd6f36f8e | | fa:16:3e:5a:2e:fb | ip_address='50.205.206.43', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 9b8990f2-2557-4d0a-901c-c776e21f13b6 | | fa:16:3e:3f:af:ce | ip_address='10.1.15.29', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| a2ad1af6-112e-43a1-bc95-68beb71d41e5 | orbdev1.orbit8.com | fa:16:3e:7e:2a:14 | ip_address='10.1.15.38', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| ddbac8d8-6b65-4635-988b-ea073ab9c974 | | fa:16:3e:8d:9c:9a | ip_address='50.205.206.61', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
+--------------------------------------+--------------------+-------------------+------------------------------------------------------------------------------+
(openstack) server create --volume b2f1db21-463a-47b8-bbc5-45c670752fd2 --flavor Orbit.large --security-group default --nic port-id=a2ad1af6-112e-43a1-bc95-68beb71d41e5 orbdev1.orbit8.com
Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'keystoneauth1.exceptions.http.NotFound'> (HTTP 500) (Request-ID: req-3594a962-0c55-4a0c-99d2-dc5e09a8e00f)
(openstack) server create --volume b2f1db21-463a-47b8-bbc5-45c670752fd2 --flavor Orbit.large --security-group default --nic net-id=polaris_external_15 orbdev1.orbit8.com
+--------------------------------------+----------------------------------------------------+
| Field | Value |
+--------------------------------------+----------------------------------------------------+
| OS-DCF:diskConfig | MANUAL |
| OS-EXT-AZ:availability_zone | |
| OS-EXT-SRV-ATTR:host | None |
| OS-EXT-SRV-ATTR:hypervisor_hostname | None |
| OS-EXT-SRV-ATTR:instance_name | instance-00000056 |
| OS-EXT-STS:power_state | NOSTATE |
| OS-EXT-STS:task_state | scheduling |
| OS-EXT-STS:vm_state | building |
| OS-SRV-USG:launched_at | None |
| OS-SRV-USG:terminated_at | None |
| accessIPv4 | |
| accessIPv6 | |
| addresses | |
| adminPass | nyJa2mSM4rdN |
| config_drive | |
| created | 2016-11-16T04:06:29Z |
| flavor | Orbit.large (0800454b-6443-488f-83e1-3b6dc28206cd) |
| hostId | |
| id | db2b952f-430f-4b6c-8014-1f14829e60fd |
| image | |
| key_name | None |
| name | orbdev1.orbit8.com |
| os-extended-volumes:volumes_attached | [{u'id': u'b2f1db21-463a-47b8-bbc5-45c670752fd2'}] |
| progress | 0 |
| project_id | bdf4deeb6a944b9f8b878242032a3007 |
| properties | |
| security_groups | [{u'name': u'default'}] |
| status | BUILD |
| updated | 2016-11-16T04:06:30Z |
| user_id | f7b5d10d858b46e3aa4609125ca8c845 |
+--------------------------------------+----------------------------------------------------+
(openstack)

Unexpected API ErrorError (nova/neutron port issue)

trying to create instance with reserved ip, seems to be crashing. May be the mapped volume as well. Will troubleshoot and refine.

UPDATE: Fails on assigning reserved ports. Fails using UUID as well

This works:

port create --network polaris_external_15 --fixed-ip subnet=4072fea3-59d7-4bd3-bbbe-b95ac66315d9,ip-address=10.1.15.38 orbdev1.orbit8.com

Port list shows:

| a2ad1af6-112e-43a1-bc95-68beb71d41e5 | orbdev1.orbit8.com | fa:16:3e:7e:2a:14 | ip_address='10.1.15.38', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9'    |

Both ways fail:

server create --volume b2f1db21-463a-47b8-bbc5-45c670752fd2 --flavor Orbit.large --security-group default --nic port-id=a2ad1af6-112e-43a1-bc95-68beb71d41e5 orbdev1.orbit8.com

server create --volume b2f1db21-463a-47b8-bbc5-45c670752fd2 --flavor Orbit.large --security-group default --nic port-id=orbdev1.orbit8.com orbdev1.orbit8.com
#############################################################################################using command:

server create --volume b2f1db21-463a-47b8-bbc5-45c670752fd2 --flavor Orbit.large --security-group default --nic port-id=orbdev1.orbit8.com orbdev1.orbit8.com

(openstack) server list
+--------------------------------------+---------+--------+--------------------------------+------------+
| ID | Name | Status | Networks | Image Name |
+--------------------------------------+---------+--------+--------------------------------+------------+
| e1492d01-748e-4c4b-81c4-320d81e2c7a7 | sddf | ACTIVE | polaris_external_15=10.1.15.34 | cirros |
| e736d645-7738-4119-8ffa-88e07c52bb2f | orbdev2 | ACTIVE | polaris_external_15=10.1.15.29 | |
+--------------------------------------+---------+--------+--------------------------------+------------+
(openstack) volume list
+--------------------------------------+--------------+-----------+------+----------------------------------+
| ID | Display Name | Status | Size | Attached to |
+--------------------------------------+--------------+-----------+------+----------------------------------+
| f991c440-edf4-4492-846f-bdd0928687de | | in-use | 100 | Attached to orbdev2 on /dev/vda |
| b2f1db21-463a-47b8-bbc5-45c670752fd2 | | available | 200 | |
+--------------------------------------+--------------+-----------+------+----------------------------------+
(openstack) port list
+--------------------------------------+--------------------+-------------------+------------------------------------------------------------------------------+
| ID | Name | MAC Address | Fixed IP Addresses |
+--------------------------------------+--------------------+-------------------+------------------------------------------------------------------------------+
| 0737228d-da99-471b-ba78-621068dbc97b | rwb2.orbit8.com | fa:16:3e:11:e4:b8 | ip_address='10.1.15.56', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 13aeb33e-de25-4d4a-8a25-2ec17933ddd0 | | fa:16:3e:13:ef:69 | ip_address='172.17.0.1', subnet_id='8410f6ef-d264-4509-b295-5b0a268f7cd0' |
| 14ae55b8-9b40-435d-9bd1-72987a76d304 | | fa:16:3e:a3:61:95 | ip_address='172.16.0.1', subnet_id='8036a43e-3cd9-402b-9898-b6314766f099' |
| 1d994403-0204-4b48-a0bf-00db14a55bb6 | | fa:16:3e:77:e0:74 | ip_address='50.205.206.34', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 2092a1d9-95aa-475d-b069-b0ad17eed85d | | fa:16:3e:e8:8e:1b | ip_address='172.16.0.2', subnet_id='8036a43e-3cd9-402b-9898-b6314766f099' |
| 2404e63c-8b9b-475d-85a9-7ef0c483f6b7 | | fa:16:3e:6c:e7:2b | ip_address='192.168.10.2', subnet_id='aaf18006-4f66-45aa-8003-fd3d64e68fe6' |
| 2f6aad25-3091-446b-adf7-d8bbfceb4a0a | | fa:16:3e:f8:c3:3b | ip_address='50.205.206.54', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 31daa221-cb9c-4345-9416-7773039bbb17 | | fa:16:3e:87:98:e0 | ip_address='10.1.15.26', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 4376a9e5-2c89-475a-9efb-57ae3c4e88ff | | fa:16:3e:90:1f:ae | ip_address='10.1.15.34', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 45605cf4-3ebb-4fbf-94f6-29bf9ca288ef | | fa:16:3e:55:d8:95 | ip_address='10.1.15.25', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 48f85efc-d02b-4e9c-8783-1ea534b0e3d3 | rwb1.orbit8.com | fa:16:3e:ea:b4:9d | ip_address='10.1.15.55', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 48fd38b1-9517-47bd-8cd6-32c5f0e5175d | | fa:16:3e:5f:69:0c | ip_address='50.205.206.42', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 5057a4d2-1147-47c3-a725-0cb14ea7cb29 | | fa:16:3e:51:0e:85 | ip_address='192.168.10.16', subnet_id='aaf18006-4f66-45aa-8003-fd3d64e68fe6' |
| 64e5d10f-c257-42b9-a911-b66d4c4d877b | | fa:16:3e:6b:bb:e0 | ip_address='172.17.0.6', subnet_id='8410f6ef-d264-4509-b295-5b0a268f7cd0' |
| 66c3f100-1269-41a6-9a8a-ac28e4124925 | | fa:16:3e:8d:78:2e | ip_address='192.168.10.1', subnet_id='aaf18006-4f66-45aa-8003-fd3d64e68fe6' |
| 6e755e56-0a9a-420f-99e6-056a51eab0b3 | rwb3.orbit8.com | fa:16:3e:ed:86:af | ip_address='10.1.15.57', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 70e27604-712e-427f-b1f4-6358e3154d7a | | fa:16:3e:53:a7:80 | ip_address='10.1.15.2', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 88779531-91d6-479c-b59b-15b588fab9b3 | | fa:16:3e:42:8b:55 | ip_address='172.17.0.2', subnet_id='8410f6ef-d264-4509-b295-5b0a268f7cd0' |
| 8bd37cd1-35ea-4082-96aa-5637398c6f27 | | fa:16:3e:60:ff:19 | ip_address='172.16.0.23', subnet_id='8036a43e-3cd9-402b-9898-b6314766f099' |
| 8c1a82be-208b-428f-8b2f-16bcd6f36f8e | | fa:16:3e:5a:2e:fb | ip_address='50.205.206.43', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 9b8990f2-2557-4d0a-901c-c776e21f13b6 | | fa:16:3e:3f:af:ce | ip_address='10.1.15.29', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| a2ad1af6-112e-43a1-bc95-68beb71d41e5 | orbdev1.orbit8.com | fa:16:3e:7e:2a:14 | ip_address='10.1.15.38', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| ddbac8d8-6b65-4635-988b-ea073ab9c974 | | fa:16:3e:8d:9c:9a | ip_address='50.205.206.61', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
+--------------------------------------+--------------------+-------------------+------------------------------------------------------------------------------+
(openstack) flavor list
+--------------------------------------+-------------+-------+------+-----------+-------+-----------+
| ID | Name | RAM | Disk | Ephemeral | VCPUs | Is Public |
+--------------------------------------+-------------+-------+------+-----------+-------+-----------+
| 0800454b-6443-488f-83e1-3b6dc28206cd | Orbit.large | 24576 | 200 | 0 | 6 | True |
| 1 | m1.tiny | 512 | 1 | 0 | 1 | True |
| 2 | m1.small | 2048 | 20 | 0 | 1 | True |
| 29a949c8-df05-4d37-b45b-c3e27354d317 | win.default | 8192 | 150 | 0 | 4 | True |
| 3 | m1.medium | 4096 | 40 | 0 | 2 | True |
| 4 | m1.large | 8192 | 80 | 0 | 4 | True |
| 88551500-f112-419e-8b86-39f688307b78 | RWB.large | 12288 | 0 | 0 | 6 | True |
| d496c777-6567-4190-b5ff-80af77b63971 | RWB.default | 6144 | 0 | 0 | 3 | True |
| df34cda0-dd1c-4c26-924c-511936fae7ca | m1.xlarge | 16384 | 160 | 0 | 8 | True |
+--------------------------------------+-------------+-------+------+-----------+-------+-----------+
(openstack) security group list
+--------------------------------------+--------------+------------------------+----------------------------------+
| ID | Name | Description | Project |
+--------------------------------------+--------------+------------------------+----------------------------------+
| 092a95a9-7919-4df7-9beb-8bf8dc7575d3 | default | Default security group | e321061a2503461cbdb2de337bb40ce8 |
| 21e0f5b5-f1e3-4992-a826-40015b8900dd | RWB_SG_Ports | Open Ports: | e321061a2503461cbdb2de337bb40ce8 |
| | | 22 (ssh) | |
| | | 1521 (oracle) | |
| | | 8000 (EBS/RWB) | |
| 3ae00dbd-0b54-405d-ab94-8a599bbec5cf | default | Default security group | d53fb31b2a7b4442ad2fdbaddb53f87a |
| 60680841-0204-455d-99fe-2551ccae8bc4 | default | Default security group | 0ea5806cf79b4292984df3b797898332 |
| 71b0f4a6-b414-4767-a129-9bff01ddc4f4 | all_test | | 13a1787f2d96486ab89a0cd43be60878 |
| 7e8ab26a-4ca3-4a39-9342-9774a7db89a9 | default | Default security group | bdf4deeb6a944b9f8b878242032a3007 |
| aea5209d-4611-47b8-90d4-5919c00e326c | Jumpbox | | 13a1787f2d96486ab89a0cd43be60878 |
| d53e3ee0-5df8-42bd-b587-e6fb08d23176 | default | Default security group | 13a1787f2d96486ab89a0cd43be60878 |
| e407d925-4a06-45c2-b786-88f583fc38ad | LocalNet | | 13a1787f2d96486ab89a0cd43be60878 |
+--------------------------------------+--------------+------------------------+----------------------------------+
(openstack)

==> /var/log/nova/nova-api.log <==
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions [req-6142acfa-ae8c-479a-ba5c-6981add0ff47 f7b5d10d858b46e3aa4609125ca8c845 bdf4deeb6a944b9f8b878242032a3007 - - -] Unexpected exception in API method
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions Traceback (most recent call last):
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/extensions.py", line 478, in wrapped
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return f(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 629, in create
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions **create_kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/hooks.py", line 154, in inner
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions rv = f(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1563, in create
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions check_server_group_quota=check_server_group_quota)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1146, in _create_instance
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions reservation_id, max_count)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 873, in _validate_and_build_base_options
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions pci_request_info, requested_networks)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 1088, in create_pci_requests_for_sriov_ports
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions context, neutron, request_net.port_id)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 1061, in _get_port_vnic_info
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions fields=['binding:vnic_type', 'network_id'])
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 908, in _show_port
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions result = neutron_client.show_port(port_id, fields=fields)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 97, in with_params
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions ret = self.function(instance, *args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 649, in show_port
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return self.get(self.port_path % (port), params=_params)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 358, in get
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions headers=headers, params=params)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 335, in retry_request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions headers=headers, params=params)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 286, in do_request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions resp, replybody = self.httpclient.do_request(action, method, body=body)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/client.py", line 306, in do_request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return self.request(url, method, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/client.py", line 294, in request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions resp = super(SessionClient, self).request(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 98, in request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return self.session.request(url, method, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/positional/__init__.py", line 94, in inner
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 370, in request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions auth_headers = self.get_auth_headers(auth)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 624, in get_auth_headers
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return auth.get_headers(self, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/plugin.py", line 84, in get_headers
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions token = self.get_token(session)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 90, in get_token
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return self.get_access(session).auth_token
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 136, in get_access
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions self.auth_ref = self.get_auth_ref(session)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/v3/base.py", line 167, in get_auth_ref
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions authenticated=False, log=False, **rkwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 572, in post
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return self.request(url, 'POST', **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/positional/__init__.py", line 94, in inner
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 467, in request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions raise exceptions.from_response(resp, method, url)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions NotFound: The resource could not be found. (HTTP 404) (Request-ID: req-50ed200a-6785-4edd-b861-835f9a8100ad)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions
2016-11-15 22:37:37.684 31941 INFO nova.api.openstack.wsgi [req-6142acfa-ae8c-479a-ba5c-6981add0ff47 f7b5d10d858b46e3aa4609125ca8c845 bdf4deeb6a944b9f8b878242032a3007 - - -] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'keystoneauth1.exceptions.http.NotFound'>
2016-11-15 22:37:37.685 31941 INFO nova.osapi_compute.wsgi.server [req-6142acfa-ae8c-479a-ba5c-6981add0ff47 f7b5d10d858b46e3aa4609125ca8c845 bdf4deeb6a944b9f8b878242032a3007 - - -] 10.212.134.200 "POST /v2/bdf4deeb6a944b9f8b878242032a3007/os-volumes_boot HTTP/1.1" status: 500 len: 443 time: 0.4011800

confirmed issue with port-create....... This used to work. will try doing this in another project with another ip, etc...

(openstack) port list
+--------------------------------------+--------------------+-------------------+------------------------------------------------------------------------------+
| ID | Name | MAC Address | Fixed IP Addresses |
+--------------------------------------+--------------------+-------------------+------------------------------------------------------------------------------+
| 0737228d-da99-471b-ba78-621068dbc97b | rwb2.orbit8.com | fa:16:3e:11:e4:b8 | ip_address='10.1.15.56', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 13aeb33e-de25-4d4a-8a25-2ec17933ddd0 | | fa:16:3e:13:ef:69 | ip_address='172.17.0.1', subnet_id='8410f6ef-d264-4509-b295-5b0a268f7cd0' |
| 14ae55b8-9b40-435d-9bd1-72987a76d304 | | fa:16:3e:a3:61:95 | ip_address='172.16.0.1', subnet_id='8036a43e-3cd9-402b-9898-b6314766f099' |
| 1d994403-0204-4b48-a0bf-00db14a55bb6 | | fa:16:3e:77:e0:74 | ip_address='50.205.206.34', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 2092a1d9-95aa-475d-b069-b0ad17eed85d | | fa:16:3e:e8:8e:1b | ip_address='172.16.0.2', subnet_id='8036a43e-3cd9-402b-9898-b6314766f099' |
| 2404e63c-8b9b-475d-85a9-7ef0c483f6b7 | | fa:16:3e:6c:e7:2b | ip_address='192.168.10.2', subnet_id='aaf18006-4f66-45aa-8003-fd3d64e68fe6' |
| 2f6aad25-3091-446b-adf7-d8bbfceb4a0a | | fa:16:3e:f8:c3:3b | ip_address='50.205.206.54', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 31daa221-cb9c-4345-9416-7773039bbb17 | | fa:16:3e:87:98:e0 | ip_address='10.1.15.26', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 4376a9e5-2c89-475a-9efb-57ae3c4e88ff | | fa:16:3e:90:1f:ae | ip_address='10.1.15.34', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 45605cf4-3ebb-4fbf-94f6-29bf9ca288ef | | fa:16:3e:55:d8:95 | ip_address='10.1.15.25', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 48f85efc-d02b-4e9c-8783-1ea534b0e3d3 | rwb1.orbit8.com | fa:16:3e:ea:b4:9d | ip_address='10.1.15.55', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 48fd38b1-9517-47bd-8cd6-32c5f0e5175d | | fa:16:3e:5f:69:0c | ip_address='50.205.206.42', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 5057a4d2-1147-47c3-a725-0cb14ea7cb29 | | fa:16:3e:51:0e:85 | ip_address='192.168.10.16', subnet_id='aaf18006-4f66-45aa-8003-fd3d64e68fe6' |
| 64e5d10f-c257-42b9-a911-b66d4c4d877b | | fa:16:3e:6b:bb:e0 | ip_address='172.17.0.6', subnet_id='8410f6ef-d264-4509-b295-5b0a268f7cd0' |
| 66c3f100-1269-41a6-9a8a-ac28e4124925 | | fa:16:3e:8d:78:2e | ip_address='192.168.10.1', subnet_id='aaf18006-4f66-45aa-8003-fd3d64e68fe6' |
| 6e755e56-0a9a-420f-99e6-056a51eab0b3 | rwb3.orbit8.com | fa:16:3e:ed:86:af | ip_address='10.1.15.57', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 70e27604-712e-427f-b1f4-6358e3154d7a | | fa:16:3e:53:a7:80 | ip_address='10.1.15.2', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 88779531-91d6-479c-b59b-15b588fab9b3 | | fa:16:3e:42:8b:55 | ip_address='172.17.0.2', subnet_id='8410f6ef-d264-4509-b295-5b0a268f7cd0' |
| 8bd37cd1-35ea-4082-96aa-5637398c6f27 | | fa:16:3e:60:ff:19 | ip_address='172.16.0.23', subnet_id='8036a43e-3cd9-402b-9898-b6314766f099' |
| 8c1a82be-208b-428f-8b2f-16bcd6f36f8e | | fa:16:3e:5a:2e:fb | ip_address='50.205.206.43', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 9b8990f2-2557-4d0a-901c-c776e21f13b6 | | fa:16:3e:3f:af:ce | ip_address='10.1.15.29', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| a2ad1af6-112e-43a1-bc95-68beb71d41e5 | orbdev1.orbit8.com | fa:16:3e:7e:2a:14 | ip_address='10.1.15.38', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| ddbac8d8-6b65-4635-988b-ea073ab9c974 | | fa:16:3e:8d:9c:9a | ip_address='50.205.206.61', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
+--------------------------------------+--------------------+-------------------+------------------------------------------------------------------------------+
(openstack) server create --volume b2f1db21-463a-47b8-bbc5-45c670752fd2 --flavor Orbit.large --security-group default --nic port-id=a2ad1af6-112e-43a1-bc95-68beb71d41e5 orbdev1.orbit8.com
Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'keystoneauth1.exceptions.http.NotFound'> (HTTP 500) (Request-ID: req-3594a962-0c55-4a0c-99d2-dc5e09a8e00f)
(openstack) server create --volume b2f1db21-463a-47b8-bbc5-45c670752fd2 --flavor Orbit.large --security-group default --nic net-id=polaris_external_15 orbdev1.orbit8.com
+--------------------------------------+----------------------------------------------------+
| Field | Value |
+--------------------------------------+----------------------------------------------------+
| OS-DCF:diskConfig | MANUAL |
| OS-EXT-AZ:availability_zone | |
| OS-EXT-SRV-ATTR:host | None |
| OS-EXT-SRV-ATTR:hypervisor_hostname | None |
| OS-EXT-SRV-ATTR:instance_name | instance-00000056 |
| OS-EXT-STS:power_state | NOSTATE |
| OS-EXT-STS:task_state | scheduling |
| OS-EXT-STS:vm_state | building |
| OS-SRV-USG:launched_at | None |
| OS-SRV-USG:terminated_at | None |
| accessIPv4 | |
| accessIPv6 | |
| addresses | |
| adminPass | nyJa2mSM4rdN |
| config_drive | |
| created | 2016-11-16T04:06:29Z |
| flavor | Orbit.large (0800454b-6443-488f-83e1-3b6dc28206cd) |
| hostId | |
| id | db2b952f-430f-4b6c-8014-1f14829e60fd |
| image | |
| key_name | None |
| name | orbdev1.orbit8.com |
| os-extended-volumes:volumes_attached | [{u'id': u'b2f1db21-463a-47b8-bbc5-45c670752fd2'}] |
| progress | 0 |
| project_id | bdf4deeb6a944b9f8b878242032a3007 |
| properties | |
| security_groups | [{u'name': u'default'}] |
| status | BUILD |
| updated | 2016-11-16T04:06:30Z |
| user_id | f7b5d10d858b46e3aa4609125ca8c845 |
+--------------------------------------+----------------------------------------------------+
(openstack)

Unexpected API Error (nova/neutron port issue)Error

trying to create instance with reserved ip, seems to be crashing. May be the mapped volume as well. Will troubleshoot and refine.

UPDATE: Fails on assigning reserved ports. Fails using UUID as well

This works:

port create --network polaris_external_15 --fixed-ip subnet=4072fea3-59d7-4bd3-bbbe-b95ac66315d9,ip-address=10.1.15.38 orbdev1.orbit8.com

Port list shows:

| a2ad1af6-112e-43a1-bc95-68beb71d41e5 | orbdev1.orbit8.com | fa:16:3e:7e:2a:14 | ip_address='10.1.15.38', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9'    |

Both ways fail:

server create --volume b2f1db21-463a-47b8-bbc5-45c670752fd2 --flavor Orbit.large --security-group default --nic port-id=a2ad1af6-112e-43a1-bc95-68beb71d41e5 orbdev1.orbit8.com

server create --volume b2f1db21-463a-47b8-bbc5-45c670752fd2 --flavor Orbit.large --security-group default --nic port-id=orbdev1.orbit8.com orbdev1.orbit8.com
#############################################################################################using #

using command:

server create --volume b2f1db21-463a-47b8-bbc5-45c670752fd2 --flavor Orbit.large --security-group default --nic port-id=orbdev1.orbit8.com orbdev1.orbit8.com

(openstack) server list
+--------------------------------------+---------+--------+--------------------------------+------------+
| ID | Name | Status | Networks | Image Name |
+--------------------------------------+---------+--------+--------------------------------+------------+
| e1492d01-748e-4c4b-81c4-320d81e2c7a7 | sddf | ACTIVE | polaris_external_15=10.1.15.34 | cirros |
| e736d645-7738-4119-8ffa-88e07c52bb2f | orbdev2 | ACTIVE | polaris_external_15=10.1.15.29 | |
+--------------------------------------+---------+--------+--------------------------------+------------+
(openstack) volume list
+--------------------------------------+--------------+-----------+------+----------------------------------+
| ID | Display Name | Status | Size | Attached to |
+--------------------------------------+--------------+-----------+------+----------------------------------+
| f991c440-edf4-4492-846f-bdd0928687de | | in-use | 100 | Attached to orbdev2 on /dev/vda |
| b2f1db21-463a-47b8-bbc5-45c670752fd2 | | available | 200 | |
+--------------------------------------+--------------+-----------+------+----------------------------------+
(openstack) port list
+--------------------------------------+--------------------+-------------------+------------------------------------------------------------------------------+
| ID | Name | MAC Address | Fixed IP Addresses |
+--------------------------------------+--------------------+-------------------+------------------------------------------------------------------------------+
| 0737228d-da99-471b-ba78-621068dbc97b | rwb2.orbit8.com | fa:16:3e:11:e4:b8 | ip_address='10.1.15.56', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 13aeb33e-de25-4d4a-8a25-2ec17933ddd0 | | fa:16:3e:13:ef:69 | ip_address='172.17.0.1', subnet_id='8410f6ef-d264-4509-b295-5b0a268f7cd0' |
| 14ae55b8-9b40-435d-9bd1-72987a76d304 | | fa:16:3e:a3:61:95 | ip_address='172.16.0.1', subnet_id='8036a43e-3cd9-402b-9898-b6314766f099' |
| 1d994403-0204-4b48-a0bf-00db14a55bb6 | | fa:16:3e:77:e0:74 | ip_address='50.205.206.34', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 2092a1d9-95aa-475d-b069-b0ad17eed85d | | fa:16:3e:e8:8e:1b | ip_address='172.16.0.2', subnet_id='8036a43e-3cd9-402b-9898-b6314766f099' |
| 2404e63c-8b9b-475d-85a9-7ef0c483f6b7 | | fa:16:3e:6c:e7:2b | ip_address='192.168.10.2', subnet_id='aaf18006-4f66-45aa-8003-fd3d64e68fe6' |
| 2f6aad25-3091-446b-adf7-d8bbfceb4a0a | | fa:16:3e:f8:c3:3b | ip_address='50.205.206.54', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 31daa221-cb9c-4345-9416-7773039bbb17 | | fa:16:3e:87:98:e0 | ip_address='10.1.15.26', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 4376a9e5-2c89-475a-9efb-57ae3c4e88ff | | fa:16:3e:90:1f:ae | ip_address='10.1.15.34', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 45605cf4-3ebb-4fbf-94f6-29bf9ca288ef | | fa:16:3e:55:d8:95 | ip_address='10.1.15.25', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 48f85efc-d02b-4e9c-8783-1ea534b0e3d3 | rwb1.orbit8.com | fa:16:3e:ea:b4:9d | ip_address='10.1.15.55', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 48fd38b1-9517-47bd-8cd6-32c5f0e5175d | | fa:16:3e:5f:69:0c | ip_address='50.205.206.42', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 5057a4d2-1147-47c3-a725-0cb14ea7cb29 | | fa:16:3e:51:0e:85 | ip_address='192.168.10.16', subnet_id='aaf18006-4f66-45aa-8003-fd3d64e68fe6' |
| 64e5d10f-c257-42b9-a911-b66d4c4d877b | | fa:16:3e:6b:bb:e0 | ip_address='172.17.0.6', subnet_id='8410f6ef-d264-4509-b295-5b0a268f7cd0' |
| 66c3f100-1269-41a6-9a8a-ac28e4124925 | | fa:16:3e:8d:78:2e | ip_address='192.168.10.1', subnet_id='aaf18006-4f66-45aa-8003-fd3d64e68fe6' |
| 6e755e56-0a9a-420f-99e6-056a51eab0b3 | rwb3.orbit8.com | fa:16:3e:ed:86:af | ip_address='10.1.15.57', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 70e27604-712e-427f-b1f4-6358e3154d7a | | fa:16:3e:53:a7:80 | ip_address='10.1.15.2', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 88779531-91d6-479c-b59b-15b588fab9b3 | | fa:16:3e:42:8b:55 | ip_address='172.17.0.2', subnet_id='8410f6ef-d264-4509-b295-5b0a268f7cd0' |
| 8bd37cd1-35ea-4082-96aa-5637398c6f27 | | fa:16:3e:60:ff:19 | ip_address='172.16.0.23', subnet_id='8036a43e-3cd9-402b-9898-b6314766f099' |
| 8c1a82be-208b-428f-8b2f-16bcd6f36f8e | | fa:16:3e:5a:2e:fb | ip_address='50.205.206.43', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 9b8990f2-2557-4d0a-901c-c776e21f13b6 | | fa:16:3e:3f:af:ce | ip_address='10.1.15.29', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| a2ad1af6-112e-43a1-bc95-68beb71d41e5 | orbdev1.orbit8.com | fa:16:3e:7e:2a:14 | ip_address='10.1.15.38', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| ddbac8d8-6b65-4635-988b-ea073ab9c974 | | fa:16:3e:8d:9c:9a | ip_address='50.205.206.61', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
+--------------------------------------+--------------------+-------------------+------------------------------------------------------------------------------+
(openstack) flavor list
+--------------------------------------+-------------+-------+------+-----------+-------+-----------+
| ID | Name | RAM | Disk | Ephemeral | VCPUs | Is Public |
+--------------------------------------+-------------+-------+------+-----------+-------+-----------+
| 0800454b-6443-488f-83e1-3b6dc28206cd | Orbit.large | 24576 | 200 | 0 | 6 | True |
| 1 | m1.tiny | 512 | 1 | 0 | 1 | True |
| 2 | m1.small | 2048 | 20 | 0 | 1 | True |
| 29a949c8-df05-4d37-b45b-c3e27354d317 | win.default | 8192 | 150 | 0 | 4 | True |
| 3 | m1.medium | 4096 | 40 | 0 | 2 | True |
| 4 | m1.large | 8192 | 80 | 0 | 4 | True |
| 88551500-f112-419e-8b86-39f688307b78 | RWB.large | 12288 | 0 | 0 | 6 | True |
| d496c777-6567-4190-b5ff-80af77b63971 | RWB.default | 6144 | 0 | 0 | 3 | True |
| df34cda0-dd1c-4c26-924c-511936fae7ca | m1.xlarge | 16384 | 160 | 0 | 8 | True |
+--------------------------------------+-------------+-------+------+-----------+-------+-----------+
(openstack) security group list
+--------------------------------------+--------------+------------------------+----------------------------------+
| ID | Name | Description | Project |
+--------------------------------------+--------------+------------------------+----------------------------------+
| 092a95a9-7919-4df7-9beb-8bf8dc7575d3 | default | Default security group | e321061a2503461cbdb2de337bb40ce8 |
| 21e0f5b5-f1e3-4992-a826-40015b8900dd | RWB_SG_Ports | Open Ports: | e321061a2503461cbdb2de337bb40ce8 |
| | | 22 (ssh) | |
| | | 1521 (oracle) | |
| | | 8000 (EBS/RWB) | |
| 3ae00dbd-0b54-405d-ab94-8a599bbec5cf | default | Default security group | d53fb31b2a7b4442ad2fdbaddb53f87a |
| 60680841-0204-455d-99fe-2551ccae8bc4 | default | Default security group | 0ea5806cf79b4292984df3b797898332 |
| 71b0f4a6-b414-4767-a129-9bff01ddc4f4 | all_test | | 13a1787f2d96486ab89a0cd43be60878 |
| 7e8ab26a-4ca3-4a39-9342-9774a7db89a9 | default | Default security group | bdf4deeb6a944b9f8b878242032a3007 |
| aea5209d-4611-47b8-90d4-5919c00e326c | Jumpbox | | 13a1787f2d96486ab89a0cd43be60878 |
| d53e3ee0-5df8-42bd-b587-e6fb08d23176 | default | Default security group | 13a1787f2d96486ab89a0cd43be60878 |
| e407d925-4a06-45c2-b786-88f583fc38ad | LocalNet | | 13a1787f2d96486ab89a0cd43be60878 |
+--------------------------------------+--------------+------------------------+----------------------------------+
(openstack)

==> /var/log/nova/nova-api.log <==
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions [req-6142acfa-ae8c-479a-ba5c-6981add0ff47 f7b5d10d858b46e3aa4609125ca8c845 bdf4deeb6a944b9f8b878242032a3007 - - -] Unexpected exception in API method
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions Traceback (most recent call last):
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/extensions.py", line 478, in wrapped
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return f(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 629, in create
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions **create_kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/hooks.py", line 154, in inner
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions rv = f(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1563, in create
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions check_server_group_quota=check_server_group_quota)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1146, in _create_instance
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions reservation_id, max_count)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 873, in _validate_and_build_base_options
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions pci_request_info, requested_networks)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 1088, in create_pci_requests_for_sriov_ports
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions context, neutron, request_net.port_id)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 1061, in _get_port_vnic_info
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions fields=['binding:vnic_type', 'network_id'])
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 908, in _show_port
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions result = neutron_client.show_port(port_id, fields=fields)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 97, in with_params
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions ret = self.function(instance, *args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 649, in show_port
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return self.get(self.port_path % (port), params=_params)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 358, in get
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions headers=headers, params=params)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 335, in retry_request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions headers=headers, params=params)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 286, in do_request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions resp, replybody = self.httpclient.do_request(action, method, body=body)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/client.py", line 306, in do_request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return self.request(url, method, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/neutronclient/client.py", line 294, in request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions resp = super(SessionClient, self).request(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 98, in request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return self.session.request(url, method, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/positional/__init__.py", line 94, in inner
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 370, in request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions auth_headers = self.get_auth_headers(auth)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 624, in get_auth_headers
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return auth.get_headers(self, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/plugin.py", line 84, in get_headers
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions token = self.get_token(session)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 90, in get_token
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return self.get_access(session).auth_token
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 136, in get_access
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions self.auth_ref = self.get_auth_ref(session)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/v3/base.py", line 167, in get_auth_ref
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions authenticated=False, log=False, **rkwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 572, in post
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return self.request(url, 'POST', **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/positional/__init__.py", line 94, in inner
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 467, in request
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions raise exceptions.from_response(resp, method, url)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions NotFound: The resource could not be found. (HTTP 404) (Request-ID: req-50ed200a-6785-4edd-b861-835f9a8100ad)
2016-11-15 22:37:37.682 31941 ERROR nova.api.openstack.extensions
2016-11-15 22:37:37.684 31941 INFO nova.api.openstack.wsgi [req-6142acfa-ae8c-479a-ba5c-6981add0ff47 f7b5d10d858b46e3aa4609125ca8c845 bdf4deeb6a944b9f8b878242032a3007 - - -] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'keystoneauth1.exceptions.http.NotFound'>
2016-11-15 22:37:37.685 31941 INFO nova.osapi_compute.wsgi.server [req-6142acfa-ae8c-479a-ba5c-6981add0ff47 f7b5d10d858b46e3aa4609125ca8c845 bdf4deeb6a944b9f8b878242032a3007 - - -] 10.212.134.200 "POST /v2/bdf4deeb6a944b9f8b878242032a3007/os-volumes_boot HTTP/1.1" status: 500 len: 443 time: 0.4011800

confirmed issue with port-create....... This used to work. will try doing this in another project with another ip, etc...

(openstack) port list
+--------------------------------------+--------------------+-------------------+------------------------------------------------------------------------------+
| ID | Name | MAC Address | Fixed IP Addresses |
+--------------------------------------+--------------------+-------------------+------------------------------------------------------------------------------+
| 0737228d-da99-471b-ba78-621068dbc97b | rwb2.orbit8.com | fa:16:3e:11:e4:b8 | ip_address='10.1.15.56', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 13aeb33e-de25-4d4a-8a25-2ec17933ddd0 | | fa:16:3e:13:ef:69 | ip_address='172.17.0.1', subnet_id='8410f6ef-d264-4509-b295-5b0a268f7cd0' |
| 14ae55b8-9b40-435d-9bd1-72987a76d304 | | fa:16:3e:a3:61:95 | ip_address='172.16.0.1', subnet_id='8036a43e-3cd9-402b-9898-b6314766f099' |
| 1d994403-0204-4b48-a0bf-00db14a55bb6 | | fa:16:3e:77:e0:74 | ip_address='50.205.206.34', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 2092a1d9-95aa-475d-b069-b0ad17eed85d | | fa:16:3e:e8:8e:1b | ip_address='172.16.0.2', subnet_id='8036a43e-3cd9-402b-9898-b6314766f099' |
| 2404e63c-8b9b-475d-85a9-7ef0c483f6b7 | | fa:16:3e:6c:e7:2b | ip_address='192.168.10.2', subnet_id='aaf18006-4f66-45aa-8003-fd3d64e68fe6' |
| 2f6aad25-3091-446b-adf7-d8bbfceb4a0a | | fa:16:3e:f8:c3:3b | ip_address='50.205.206.54', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 31daa221-cb9c-4345-9416-7773039bbb17 | | fa:16:3e:87:98:e0 | ip_address='10.1.15.26', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 4376a9e5-2c89-475a-9efb-57ae3c4e88ff | | fa:16:3e:90:1f:ae | ip_address='10.1.15.34', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 45605cf4-3ebb-4fbf-94f6-29bf9ca288ef | | fa:16:3e:55:d8:95 | ip_address='10.1.15.25', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 48f85efc-d02b-4e9c-8783-1ea534b0e3d3 | rwb1.orbit8.com | fa:16:3e:ea:b4:9d | ip_address='10.1.15.55', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 48fd38b1-9517-47bd-8cd6-32c5f0e5175d | | fa:16:3e:5f:69:0c | ip_address='50.205.206.42', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 5057a4d2-1147-47c3-a725-0cb14ea7cb29 | | fa:16:3e:51:0e:85 | ip_address='192.168.10.16', subnet_id='aaf18006-4f66-45aa-8003-fd3d64e68fe6' |
| 64e5d10f-c257-42b9-a911-b66d4c4d877b | | fa:16:3e:6b:bb:e0 | ip_address='172.17.0.6', subnet_id='8410f6ef-d264-4509-b295-5b0a268f7cd0' |
| 66c3f100-1269-41a6-9a8a-ac28e4124925 | | fa:16:3e:8d:78:2e | ip_address='192.168.10.1', subnet_id='aaf18006-4f66-45aa-8003-fd3d64e68fe6' |
| 6e755e56-0a9a-420f-99e6-056a51eab0b3 | rwb3.orbit8.com | fa:16:3e:ed:86:af | ip_address='10.1.15.57', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 70e27604-712e-427f-b1f4-6358e3154d7a | | fa:16:3e:53:a7:80 | ip_address='10.1.15.2', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| 88779531-91d6-479c-b59b-15b588fab9b3 | | fa:16:3e:42:8b:55 | ip_address='172.17.0.2', subnet_id='8410f6ef-d264-4509-b295-5b0a268f7cd0' |
| 8bd37cd1-35ea-4082-96aa-5637398c6f27 | | fa:16:3e:60:ff:19 | ip_address='172.16.0.23', subnet_id='8036a43e-3cd9-402b-9898-b6314766f099' |
| 8c1a82be-208b-428f-8b2f-16bcd6f36f8e | | fa:16:3e:5a:2e:fb | ip_address='50.205.206.43', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
| 9b8990f2-2557-4d0a-901c-c776e21f13b6 | | fa:16:3e:3f:af:ce | ip_address='10.1.15.29', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| a2ad1af6-112e-43a1-bc95-68beb71d41e5 | orbdev1.orbit8.com | fa:16:3e:7e:2a:14 | ip_address='10.1.15.38', subnet_id='4072fea3-59d7-4bd3-bbbe-b95ac66315d9' |
| ddbac8d8-6b65-4635-988b-ea073ab9c974 | | fa:16:3e:8d:9c:9a | ip_address='50.205.206.61', subnet_id='fe5c5d21-16e6-494f-8247-bd0df84ed31c' |
+--------------------------------------+--------------------+-------------------+------------------------------------------------------------------------------+
(openstack) server create --volume b2f1db21-463a-47b8-bbc5-45c670752fd2 --flavor Orbit.large --security-group default --nic port-id=a2ad1af6-112e-43a1-bc95-68beb71d41e5 orbdev1.orbit8.com
Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'keystoneauth1.exceptions.http.NotFound'> (HTTP 500) (Request-ID: req-3594a962-0c55-4a0c-99d2-dc5e09a8e00f)
(openstack) server create --volume b2f1db21-463a-47b8-bbc5-45c670752fd2 --flavor Orbit.large --security-group default --nic net-id=polaris_external_15 orbdev1.orbit8.com
+--------------------------------------+----------------------------------------------------+
| Field | Value |
+--------------------------------------+----------------------------------------------------+
| OS-DCF:diskConfig | MANUAL |
| OS-EXT-AZ:availability_zone | |
| OS-EXT-SRV-ATTR:host | None |
| OS-EXT-SRV-ATTR:hypervisor_hostname | None |
| OS-EXT-SRV-ATTR:instance_name | instance-00000056 |
| OS-EXT-STS:power_state | NOSTATE |
| OS-EXT-STS:task_state | scheduling |
| OS-EXT-STS:vm_state | building |
| OS-SRV-USG:launched_at | None |
| OS-SRV-USG:terminated_at | None |
| accessIPv4 | |
| accessIPv6 | |
| addresses | |
| adminPass | nyJa2mSM4rdN |
| config_drive | |
| created | 2016-11-16T04:06:29Z |
| flavor | Orbit.large (0800454b-6443-488f-83e1-3b6dc28206cd) |
| hostId | |
| id | db2b952f-430f-4b6c-8014-1f14829e60fd |
| image | |
| key_name | None |
| name | orbdev1.orbit8.com |
| os-extended-volumes:volumes_attached | [{u'id': u'b2f1db21-463a-47b8-bbc5-45c670752fd2'}] |
| progress | 0 |
| project_id | bdf4deeb6a944b9f8b878242032a3007 |
| properties | |
| security_groups | [{u'name': u'default'}] |
| status | BUILD |
| updated | 2016-11-16T04:06:30Z |
| user_id | f7b5d10d858b46e3aa4609125ca8c845 |
+--------------------------------------+----------------------------------------------------+
(openstack)