Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

binding:VIF_Type : binding_failed

I have a multi-node openstack installation. This is a Highly Available installation, multiple controller nodes and multiple Neutron Network nodes using VRRP (L3HA) with Open vSwitch and ML2 plug-in. All my neutron agents and nova endpoints seem to be in order and up. Launching of an instance keeps failing on my compute node, I have shut all down except one, and I cant find what causes the error, the port binding failure. I have the nova compute in debug mode and have captured the logs. I am including the section only around the instance launch time. I am hoping someone here can point me to the right direction. I have been struggling with this for over a week and have read and checked all postings that were related but none of their possible solutions were applicable to me. I hoping someone here can help by looking at the DEBUG trail.

Thanks in Advance

2015-11-18 15:16:01.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.service="" object="" at="" 0x4747590="">> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 2015-11-18 15:16:02.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 2015-11-18 15:16:02.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.service="" object="" at="" 0x4747590="">> sleeping for 19.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 2015-11-18 15:16:03.649 4330 DEBUG oslo_concurrency.lockutils [-] Lock "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" acquired by "_locked_do_build_and_run_instance" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444 2015-11-18 15:16:03.685 4330 INFO nova.compute.manager [req-88ccf1cb-83ba-41dd-baff-00991577ea99 c57621aee095478d950e87ff9d790d84 49a02b7bf2bb41d0996e5e2675b03d8b - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Starting instance... 2015-11-18 15:16:03.923 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" acquired by "instance_claim" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444 2015-11-18 15:16:03.923 4330 DEBUG nova.compute.resource_tracker [-] Memory overhead for 512 MB instance; 0 MB instance_claim /usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py:129 2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Attempting claim: memory 512 MB, disk 1 GB 2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Total memory: 96506 MB, used: 512.00 MB 2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] memory limit: 144759.00 MB, free: 144247.00 MB 2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Total disk: 49 GB, used: 0.00 GB 2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] disk limit not specified, defaulting to unlimited 2015-11-18 15:16:03.972 4330 DEBUG nova.compute.resources.vcpu [-] Total CPUs: 24 VCPUs, used: 0.00 VCPUs test /usr/lib/python2.7/site-packages/nova/compute/resources/vcpu.py:52 2015-11-18 15:16:03.972 4330 DEBUG nova.compute.resources.vcpu [-] CPUs limit not specified, defaulting to unlimited test /usr/lib/python2.7/site-packages/nova/compute/resources/vcpu.py:56 2015-11-18 15:16:03.972 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Claim successful 2015-11-18 15:16:04.223 4330 INFO nova.scheduler.client.report [-] Compute_service record updated for ('compute2.nueos', 'compute2.nueos') 2015-11-18 15:16:04.223 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" released by "instance_claim" :: held 0.300s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456 2015-11-18 15:16:04.468 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" acquired by "update_usage" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444 2015-11-18 15:16:04.553 4330 INFO nova.scheduler.client.report [-] Compute_service record updated for ('compute2.nueos', 'compute2.nueos') 2015-11-18 15:16:04.554 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" released by "update_usage" :: held 0.086s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456 2015-11-18 15:16:04.555 4330 DEBUG nova.compute.manager [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Allocating IP information in the background. _allocate_network_async /usr/lib/python2.7/site-packages/nova/compute/manager.py:1754 2015-11-18 15:16:04.555 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/extensions.json -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 2015-11-18 15:16:04.565 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:04 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 4591 x-openstack-request-id: req-8a400003-40b1-49e3-a38f-61ea79507d55 RESP BODY: {"extensions": [

{"updated": "2012-10-05T10:00:00-00:00", "name": "security-group", "links": [], "namespace": "http://docs.openstack.org/ext/securitygroups/api/v2.0", "alias": "security-group", "description": "The security groups extension."}, {"updated": "2013-02-07T10:00:00-00:00", "name": "L3 Agent Scheduler", "links": [], "namespace": "http://docs.openstack.org/ext/l3_agent_scheduler/api/v1.0", "alias": "l3_agent_scheduler", "description": "Schedule routers among l3 agents"}, {"updated": "2015-03-25T10:00:00-00:00", "name": "Network MTU", "links": [], "namespace": "http://docs.openstack.org/ext/net_mtu/api/v1.0", "alias": "net-mtu", "description": "Provides MTU attribute for a network resource."}, {"updated": "2013-03-28T10:00:00-00:00", "name": "Neutron L3 Configurable external gateway mode", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/ext-gw-mode/api/v1.0", "alias": "ext-gw-mode", "description": "Extension of the router abstraction for specifying whether SNAT should occur on the external gateway"}, {"updated": "2014-02-03T10:00:00-00:00", "name": "Port Binding", "links": [], "namespace": "http://docs.openstack.org/ext/binding/api/v1.0", "alias": "binding", "description": "Expose port bindings of a virtual port to external application"}, {"updated": "2012-09-07T10:00:00-00:00", "name": "Provider Network", "links": [], "namespace": "http://docs.openstack.org/ext/provider/api/v1.0", "alias": "provider", "description": "Expose mapping of virtual networks to physical networks"}, {"updated": "2013-02-03T10:00:00-00:00", "name": "agent", "links": [], "namespace": "http://docs.openstack.org/ext/agent/api/v2.0", "alias": "agent", "description": "The agent management extension."}, {"updated": "2012-07-29T10:00:00-00:00", "name": "Quota management support", "links": [], "namespace": "http://docs.openstack.org/network/ext/quotas-sets/api/v2.0", "alias": "quotas", "description": "Expose functions for quotas management per tenant"}, {"updated": "2015-03-30T10:00:00-00:00", "name": "Subnet Allocation", "links": [], "namespace": "http://docs.openstack.org/ext/subnet_allocation/api/v1.0", "alias": "subnet_allocation", "description": "Enables allocation of subnets from a subnet pool"}, {"updated": "2013-02-07T10:00:00-00:00", "name": "DHCP Agent Scheduler", "links": [], "namespace": "http://docs.openstack.org/ext/dhcp_agent_scheduler/api/v1.0", "alias": "dhcp_agent_scheduler", "description": "Schedule networks among dhcp agents"}, {"updated": "2014-04-26T00:00:00-00:00", "name": "HA Router extension", "links": [], "namespace": "", "alias": "l3-ha", "description": "Add HA capability to routers."}, {"updated": "2013-06-27T10:00:00-00:00", "name": "Multi Provider Network", "links": [], "namespace": "http://docs.openstack.org/ext/multi-provider/api/v1.0", "alias": "multi-provider", "description": "Expose mapping of virtual networks to multiple physical networks"}, {"updated": "2013-01-14T10:00:00-00:00", "name": "Neutron external network", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/external_net/api/v1.0", "alias": "external-net", "description": "Adds external network attribute to network resource."}, {"updated": "2012-07-20T10:00:00-00:00", "name": "Neutron L3 Router", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/router/api/v1.0", "alias": "router", "description": "Router abs traction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway."}, 43 {"updated": "2013-07-23T10:00:00-00:00", "name": "Allowed Address Pairs", "links": [], "namespace": "http://docs.openstack.org/ext/allowedaddresspairs/api/v2.0", "alias": "allowed-address-pairs", "d escription": "Provides allowed address pairs"}, 44 {"updated": "2013-02-01T10:00:00-00:00", "name": "Neutron Extra Route", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/extraroutes/api/v1.0", "alias": "extraroute", "description": "Extra routes configuration for L3 router"}, 45 {"updated": "2013-03-17T12:00:00-00:00", "name": "Neutron Extra DHCP opts", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/extra_dhcp_opt/api/v1.0", "alias": "extra_dhcp_opt", "des cription": "Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)"}, 46 47 {"updated": "2014-06-1T10:00:00-00:00", "name": "Distributed Virtual Router", "links": [], "namespace": "http://docs.openstack.org/ext/dvr/api/v1.0", "alias": "dvr", "description": "Enables configur ation of Distributed Virtual Routers."}]} 48 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 49 2015-11-18 15:16:04.566 4330 DEBUG oslo_concurrency.lockutils [-] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:391 50 2015-11-18 15:16:04.566 4330 DEBUG oslo_concurrency.lockutils [-] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:404 51 2015-11-18 15:16:04.566 4330 DEBUG nova.network.neutronv2.api [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] allocate_for_instance() allocate_for_instance /usr/lib/python2.7/site-packages/nova /network/neutronv2/api.py:414 52 2015-11-18 15:16:04.566 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/networks.json?id=958d7c44-66ba-4ab0-8061-ede751a6b8f9 -H "User-Agent: python-neutronc lient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 53 2015-11-18 15:16:04.601 4330 DEBUG nova.block_device [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] block_device_list [] volume_in_mapping /usr/lib/python2.7/site-packages/nova/block_device.py :565 54 2015-11-18 15:16:04.610 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:04 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 379 x-openstack-request-id: req-b526c453-c4b6-42bc-87af-462c645b1347 55 56 RESP BODY: 57 {"networks": 58 [{"status": "ACTIVE", "subnets": ["4e98d6cb-5154-4ebc-90d6-0a059e5e7306"], "name": "demo-net", "provider:physical_network": null, "router:external": false, "tenant_id": "49a02b7bf2bb41d0996e5e2675b0 3d8b", "admin_state_up": true, "mtu": 0, "shared": false, "provider:network_type": "gre", "id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "provider:segmentation_id": 1}]} 59 60 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 2015-11-18 15:16:04.611 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/security-groups.json?tenant_id=49a02b7bf2bb41d0996e5e2675b03d8b -H "User-Agent: pytho n-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 62 2015-11-18 15:16:04.648 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:04 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 155 0 x-openstack-request-id: req-959b8a5d-4fa1-4d5e-8f19-36f00bc42308 2015-11-18 15:16:04.648 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:04 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 155 0 x-openstack-request-id: req-959b8a5d-4fa1-4d5e-8f19-36f00bc42308 63 64 65 RESP BODY: 66 {"security_groups": [ 67 {"tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "description": "Default security group", "id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb", i 68 "security_group_rules": 69 [{"remote_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb", "direction": "ingress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv6", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "port_range_max": null, "port_range_min": null, "id": "10694d01-9d52-4394-945e-10b89cf5207b", "security_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb"}, 70 {"remote_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb", "direction": "ingress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv4", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "port_range_max": null, "port_range_min": null, "id": "50450e55-83a1-416e-b4df-9a07c9593a7c", "security_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb"}, 71 {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv4", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "port_range_max": null, "port_range _min": null, "id": "6e34bdd3-a7e2-47b8-9367-b0274f30b226", "security_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb"}, 72 {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv6", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "port_range_max": null, "port_range _min": null, "id": "790a57da-28ea-40d1-bdc5-d9f7ea5a6364", "security_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb"}], "name": "default"}]} 73 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 74 75 2015-11-18 15:16:04.648 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X POST http://controller:9696/v2.0/ports.json -H "User-Agent: python-neutronclient" -H "Content-Type: application/json" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" -d 76 77 '{"port": {"binding:host_id": "compute2.nueos", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "device_owner": "comput e:nova", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "device_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197"}}' 78 _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 79 80 2015-11-18 15:16:05.056 4330 DEBUG nova.block_device [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] block_device_list [] volume_in_mapping /usr/lib/python2.7/site-packages/nova/block_device.py :565 81 2015-11-18 15:16:05.056 4330 INFO nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Creating image 82 2015-11-18 15:16:05.057 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "/var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk.info" acqui red by "write_to_disk_info_file" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444 83 2015-11-18 15:16:05.057 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "/var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk.info" relea sed by "write_to_disk_info_file" :: held 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456

sed by "write_to_disk_info_file" :: held 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456 84 2015-11-18 15:16:05.058 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instan ces/_base/373ec6135cab5e510858923b4f2b1b24e193099d execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199 85 2015-11-18 15:16:05.079 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/373ec6135ca b5e510858923b4f2b1b24e193099d" returned: 0 in 0.021s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225 86 2015-11-18 15:16:05.080 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Acquired file lock "/var/lib/nova/instances/locks/nova-373ec6135cab5e510858923b4f2b 1b24e193099d" after waiting 0.000s acquire /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:212 87 2015-11-18 15:16:05.080 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "373ec6135cab5e510858923b4f2b1b24e193099d" acquired by "copy_qcow2_image" :: w aited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444 88 2015-11-18 15:16:05.080 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instan ces/_base/373ec6135cab5e510858923b4f2b1b24e193099d execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199 89 2015-11-18 15:16:05.098 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/373ec6135ca b5e510858923b4f2b1b24e193099d" returned: 0 in 0.018s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225 90 2015-11-18 15:16:05.099 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/var/lib/nova /instances/_base/373ec6135cab5e510858923b4f2b1b24e193099d /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py: 199 91 2015-11-18 15:16:05.120 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "qemu-img create -f qcow2 -o backing_file=/var/lib/nova/instances/_base/373e c6135cab5e510858923b4f2b1b24e193099d /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk" returned: 0 in 0.021s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.p y:225 92 2015-11-18 15:16:05.120 4330 DEBUG nova.virt.disk.api [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Checking if we can resize image /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb19 7/disk. size=1073741824 can_resize_image /usr/lib/python2.7/site-packages/nova/virt/disk/api.py:213 93 2015-11-18 15:16:05.121 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instan ces/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199 94 2015-11-18 15:16:05.139 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/9cecb6f2-cbfd-4c2 c-9bbf-9fcf987cb197/disk" returned: 0 in 0.019s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225 95 2015-11-18 15:16:05.140 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): qemu-img resize /var/lib/nova/instances/9cecb6f2-cbfd- 4c2c-9bbf-9fcf987cb197/disk 1073741824 execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199 96 2015-11-18 15:16:05.160 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "qemu-img resize /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb19 7/disk 1073741824" returned: 0 in 0.021s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225 97 2015-11-18 15:16:05.161 4330 DEBUG nova.virt.disk.api [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Checking if we can extend filesystem inside /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf -9fcf987cb197/disk. CoW=True is_image_extendable /usr/lib/python2.7/site-packages/nova/virt/disk/api.py:227 98 2015-11-18 15:16:05.161 4330 DEBUG nova.virt.disk.vfs.api [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Instance for image imgfile=/var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 /disk imgfmt=qcow2 partition=None instance_for_image /usr/lib/python2.7/site-packages/nova/virt/disk/vfs/api.py:46 99 2015-11-18 15:16:05.161 4330 DEBUG nova.virt.disk.vfs.api [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Using primary VFSGuestFS instance_for_image /usr/lib/python2.7/site-packages/nova/virt/ disk/vfs/api.py:50 100 2015-11-18 15:16:05.162 4330 DEBUG nova.virt.disk.vfs.guestfs [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Setting up appliance for /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb1 97/disk qcow2 setup /usr/lib/python2.7/site-packages/nova/virt/disk/vfs/guestfs.py:169 101 2015-11-18 15:16:05.387 4330 DEBUG keystoneclient.session [-] RESP: [201] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 703 x-openstack-request-id: req-0b9508b4-6cc0-47fc-817c-2aac5cf9c529 102 103 RESP BODY: 104 {"port": {"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips": [{"subnet_id" : "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "device_id": "9ce cb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}} 105 106 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 107 2015-11-18 15:16:05.391 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?tenant_id=49a02b7bf2bb41d0996e5e2675b03d8b&device_id=9cecb6f2-cbfd-4c2c-9b bf-9fcf987cb197 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-packag es/keystoneclient/session.py:195 108 2015-11-18 15:16:05.439 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 706 x-openstack-request-id: req-7324c594-b3bc-42f6-9dea-d88fe8957241 109 110 RESP BODY: {"ports": [{"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "dev ice_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:v if_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}]} 111 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 112 113 2015-11-18 15:16:05.440 4330 DEBUG nova.network.neutronv2.api [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Instance cache missing network info. _get_preexisting_port_ids /usr/lib/python2.7/s ite-packages/nova/network/neutronv2/api.py:1487 114 2015-11-18 15:16:05.440 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/floatingips.json?fixed_ip_address=192.168.1.18&port_id=1f864632-fc6f-41e9-a951-971bd4 c5820e -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-packages/keysto neclient/session.py:195 115 2015-11-18 15:16:05.453 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 19 x-openstack-request-id: req-f7f2161e-f0a2-4390-ae65-6f0945604966 116 RESP BODY: {"floatingips": []} 117 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 118 2015-11-18 15:16:05.453 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/subnets.json?id=4e98d6cb-5154-4ebc-90d6-0a059e5e7306 -H "User-Agent: python-neutroncl ient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 119 2015-11-18 15:16:05.476 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 466 x-openstack-request-id: req-218b0ead-8e56-48f7-975c-e394a7b8adc3 120 RESP BODY: {"subnets": [{"name": "demo-subnet", "enable_dhcp": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "dns_nameservers": [], "ga teway_ip": "192.168.1.1", "ipv6_ra_mode": null, "allocation_pools": [{"start": "192.168.1.2", "end": "192.168.1.254"}], "host_routes": [], "ip_version": 4, "ipv6_address_mode": null, "cidr": "192.16 8.1.0/24", "id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "subnetpool_id": null}]} 121 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 122 2015-11-18 15:16:05.477 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?network_id=958d7c44-66ba-4ab0-8061-ede751a6b8f9&device_owner=network%3Adhc p -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystonecli ent/session.py:195 123 2015-11-18 15:16:05.519 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 147 5 x-openstack-request-id: req-4cd24998-d2cd-426e-8816-276ff3289000 124 RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "network2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips" : [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.15"}], "id": "559372d5-5596-489b-9f84-6d8af30e5d76", "security_groups": [], "device_id": "dhcpfbb8622d-31c3-51ab-966 1-955e31f4fec6-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "bind ing:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:b8:a8:c0"}, {"status": "ACTIVE", "binding:host_id ": "network.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip _address": "192.168.1.2"}], "id": "c857c298-0251-42a0-971b-7b20b66f2d8f", "security_groups": [], "device_id": "dhcp7b60c1d9-602e-5110-8c89-a9475b89732c-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details": {"port_filter": true, "ovs_hybrid_plug": tr ue}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:78:c0:0c"}]} 125 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 126 2015-11-18 15:16:05.520 4330 DEBUG nova.network.base_api [-] Updating cache with info: [VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], ' routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2 675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params': None, 'meta': {}, 'details': {}, 'address': u' fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})] update_instance_cache_with_nw_info /usr/lib/python2.7/site-packag es/nova/network/base_api.py:42 127 2015-11-18 15:16:05.601 4330 DEBUG oslo_concurrency.lockutils [-] Releasing semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lock utils.py:404 128 2015-11-18 15:16:05.602 4330 DEBUG nova.compute.manager [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Instance network_info: |[VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete ': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})]| _allocate_network_ async /usr/lib/python2.7/site-packages/nova/compute/manager.py:1772 129 2015-11-18 15:16:05.820 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" acquired by "update_usage" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockuti ls.py:444 130 2015-11-18 15:16:05.912 4330 INFO nova.scheduler.client.report [-] Compute_service record updated for ('compute2.nueos', 'compute2.nueos') 131 2015-11-18 15:16:05.912 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" released by "update_usage" :: held 0.093s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils .py:456 132 2015-11-18 15:16:07.346 4330 DEBUG nova.virt.disk.vfs.guestfs [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Tearing down appliance teardown /usr/lib/python2.7/site-packages/nova/virt/disk/vfs /guestfs.py:221 133 2015-11-18 15:16:07.374 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Releasing file lock "/var/lib/nova/instances/locks/nova-373ec6135cab5e510858923b4f2 b1b24e193099d" after holding it for 2.295s release /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:227 134 2015-11-18 15:16:07.375 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "373ec6135cab5e510858923b4f2b1b24e193099d" released by "copy_qcow2_image" :: h eld 2.295s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456 135 2015-11-18 15:16:07.375 4330 DEBUG nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Start _get_guest_xml network_info=[V IF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating _ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devn ame': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e 9-a951-971bd4c5820e', 'qbg_params': None})] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk': {'bus': 'virtio', 'boot_index': '1', 'type': 'disk', 'dev': u'vda'}, 'root': {'bu s': 'virtio', 'boot_index': '1', 'type': 'disk', 'dev': u'vda'}}} image_meta={u'status': u'active', u'deleted': False, u'container_format': u'bare', u'min_ram': 0, u'updated_at': u'2015-11-10T20:12: 43.000000', u'min_disk': 0, u'owner': u'b53c28a8b0e445a0a9eb5b02dfb89649', u'is_public': True, u'deleted_at': None, u'properties': {}, u'size': 13287936, u'name': u'cirros-0.3.4-x86_64', u'checksum' : u'ee1eca47dc88f4879d8a229cc70a07c6', u'created_at': u'2015-11-10T20:12:42.000000', u'disk_format': u'qcow2', u'id': u'40801b73-f9cf-424e-a0a2-b78b0501d7d7'} rescue=None block_device_info={'block_d evice_mapping': [], 'root_device_name': u'/dev/vda', 'ephemerals': [], 'swap': None} _get_guest_xml /usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py:4169 2015-11-18 15:16:07.376 4330 DEBUG nova.objects.instance [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lazy-loading pci_devices' on Instance uuid 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 obj_loa d_attr /usr/lib/python2.7/site-packages/nova/objects/instance.py:983 137 2015-11-18 15:16:07.515 4330 DEBUG nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CPU mode 'host-model' model '' was chosen _get_guest_cpu_model_config /usr/lib/python 2.7/site-packages/nova/virt/libvirt/driver.py:3065 138 2015-11-18 15:16:07.516 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Getting desirable topologies for flavor Flavor(created_at=None,deleted=False,deleted_at=Non e,disabled=False,ephemeral_gb=0,extra_specs={},flavorid='1',id=2,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta {u'status': u'active', u'deleted': False, u'container_format': u'bare', u'min_ram': 0, u'updated_at': u'2015-11-10T20:12:43.000000', u'min_disk': 0, u'owner': u'b53c28a8b0e445a0a9eb5b02df b89649', u'is_public': True, u'deleted_at': None, u'properties': {}, u'size': 13287936, u'name': u'cirros-0.3.4-x86_64', u'checksum': u'ee1eca47dc88f4879d8a229cc70a07c6', u'created_at': u'2015-11-10 T20:12:42.000000', u'disk_format': u'qcow2', u'id': u'40801b73-f9cf-424e-a0a2-b78b0501d7d7'} _get_desirable_cpu_topologies /usr/lib/python2.7/site-packages/nova/virt/hardware.py:552 139 2015-11-18 15:16:07.516 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Flavor limits 65536:65536:65536 _get_cpu_topology_constraints /usr/lib/python2.7/site-packa ges/nova/virt/hardware.py:309 140 2015-11-18 15:16:07.516 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Image limits 65536:65536:65536 _get_cpu_topology_constraints /usr/lib/python2.7/site-packag es/nova/virt/hardware.py:322 141 2015-11-18 15:16:07.516 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Flavor pref -1:-1:-1 _get_cpu_topology_constraints /usr/lib/python2.7/site-packages/nova/vi rt/hardware.py:345 142 2015-11-18 15:16:07.517 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Image pref -1:-1:-1 _get_cpu_topology_constraints /usr/lib/python2.7/site-packages/nova/vir t/hardware.py:367 143 2015-11-18 15:16:07.517 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Chosen -1:-1:-1 limits 65536:65536:65536 _get_cpu_topology_constraints /usr/lib/python2.7/s ite-packages/nova/virt/hardware.py:396 144 2015-11-18 15:16:07.517 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Build topologies for 1 vcpu(s) 1:1:1 _get_possible_cpu_topologies /usr/lib/python2.7/site-p ackages/nova/virt/hardware.py:440 145 2015-11-18 15:16:07.517 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Got 1 possible topologies _get_possible_cpu_topologies /usr/lib/python2.7/site-packages/nov a/virt/hardware.py:475 146 2015-11-18 15:16:07.517 4330 DEBUG nova.objects.instance [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lazy-loadingvcpu_model' on Instance uuid 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 obj_load _attr /usr/lib/python2.7/site-packages/nova/objects/instance.py:983 147 2015-11-18 15:16:07.540 4330 DEBUG nova.virt.libvirt.vif [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] vif_type=binding_failed instance=Instance(access_ip_v4=None,access_ip_v6=None,architectu re=None,auto_disk_config=True,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2015-11-18T20:16:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=Fal se,deleted_at=None,disable_terminate=False,display_description='xx',display_name='xx',ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(2),host='compute2.nueos',hostname='xx',id=81,imag e_ref='40801b73-f9cf-424e-a0a2-b78b0501d7d7',info_cache=InstanceInfoCache,instance_type_id=2,kernel_id='',key_data=None,key_name=None,launch_index=0,launched_at=None,launched_on='compute2.nueos',loc ked=False,locked_by=None,memory_mb=512,metadata={},new_flavor=None,node='compute2.nueos',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,po wer_state=0,progress=0,project_id='49a02b7bf2bb41d0996e5e2675b03d8b',ramdisk_id='',reservation_id='r-vntcrctq',root_device_name='/dev/vda',root_gb=1,scheduled_at=None,security_groups=SecurityGroupLi st,shutdown_terminate=False,system_metadata={image_base_image_ref='40801b73-f9cf-424e-a0a2-b78b0501d7d7',image_container_format='bare',image_disk_format='qcow2',image_min_disk='1',image_min_ram='0', network_allocated='True'},tags=,task_state='spawning',terminated_at=None,updated_at=2015-11-18T20:16:05Z,user_data=None,user_id='c57621aee095478d950e87ff9d790d84',uuid=9cecb6f2-cbfd-4c2c-9bbf-9fc f987cb197,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif=VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete': False, 'network': Network({'bridge': None, 'subnets ': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8 b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e :59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None}) virt_typeqemu get_config /usr/lib/python2.7/site-packages/nova/virt/libvir t/vif.py:364 148 2015-11-18 15:16:07.541 4330 ERROR nova.compute.manager [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Instance failed to spawn 149 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Traceback (most recent call last): 150 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2442, in _build_resou rces 151 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] yield resources 152 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2314, in _build_and_r un_instance 153 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] block_device_info=block_device_info) 154 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2351, in spawn 155 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] write_to_disk=True) 156 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4172, in _get_gue st_xml 157 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] context) 158 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4043, in _get_gue st_config 159 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] flavor, virt_type) 160 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/vif.py", line 374, in get_config 161 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] _("Unexpected vif_type=%s") % vif_type) 162 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] NovaException: Unexpected vif_type=binding_failed 163 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] 164 2015-11-18 15:16:07.542 4330 INFO nova.compute.manager [req-88ccf1cb-83ba-41dd-baff-00991577ea99 c57621aee095478d950e87ff9d790d84 49a02b7bf2bb41d0996e5e2675b03d8b - - -] [instance: 9cecb6f2-cbfd-4c2 c-9bbf-9fcf987cb197] Terminating instance 165 2015-11-18 15:16:07.545 4330 INFO nova.virt.libvirt.driver [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] During wait destroy, instance disappeared. 166 2015-11-18 15:16:07.545 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): mv /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fc f987cb197 /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197_del execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199 167 2015-11-18 15:16:07.556 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "mv /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 /var/lib/no va/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197_del" returned: 0 in 0.011s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225 168 2015-11-18 15:16:07.556 4330 INFO nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Deleting instance files /var/lib/nova /instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197_del 169 2015-11-18 15:16:07.557 4330 INFO nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Deletion of /var/lib/nova/instances/9 cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197_del complete 170 2015-11-18 15:16:07.883 4330 DEBUG nova.compute.claims [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Aborting claim: [Claim: 512 MB memory, 1 GB disk] abort /usr/lib/python2.7/site-packages/nova/compute/claims.py:130 171 2015-11-18 15:16:07.884 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "compute_resources" acquired by "abort_instance_claim" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444 172 2015-11-18 15:16:07.940 4330 INFO nova.scheduler.client.report [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Compute_service record updated for ('compute2.nueos', 'compute2.nueos') 173 2015-11-18 15:16:07.940 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "compute_resources" released by "abort_instance_claim" :: held 0.056s inner /u sr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456 174 2015-11-18 15:16:07.940 4330 DEBUG nova.compute.utils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Unexpected vif_type=binding_failed notify_ about_instance_usage /usr/lib/python2.7/site-packages/nova/compute/utils.py:310 175 2015-11-18 15:16:07.941 4330 DEBUG nova.compute.manager [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Build of instance 9cecb6f2-cbfd-4c2c-9bb f-9fcf987cb197 was re-scheduled: Unexpected vif_type=binding_failed _do_build_and_run_instance /usr/lib/python2.7/site-packages/nova/compute/manager.py:2233 176 2015-11-18 15:16:08.301 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" released by "_locked_do_build_and_run_i nstance" :: held 4.651s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456 177 2015-11-18 15:16:21.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodi c_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 178 2015-11-18 15:16:21.363 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.s="" ervice="" object="" at="" 0x4747590="">> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 179 2015-11-18 15:16:22.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodi c_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 180 2015-11-18 15:16:22.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.s="" ervice="" object="" at="" 0x4747590="">> sleeping for 2.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 @ ervice object at 0x4747590>> sleeping for 2.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 181 2015-11-18 15:16:24.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_ tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 182 2015-11-18 15:16:24.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes /usr/lib/python2 .7/site-packages/nova/compute/manager.py:6197 183 2015-11-18 15:16:24.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.s="" ervice="" object="" at="" 0x4747590="">> sleeping for 15.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 184 2015-11-18 15:16:39.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodi c_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 185 2015-11-18 15:16:39.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Starting heal instance info cache _heal_instance_info_cache /usr/lib/python2.7/site-packa ges/nova/compute/manager.py:5537 186 2015-11-18 15:16:39.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Rebuilding the list of instances to heal _heal_instance_info_cache /usr/lib/python2.7/sit e-packages/nova/compute/manager.py:5541 187 2015-11-18 15:16:39.418 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr/l ib/python2.7/site-packages/oslo_concurrency/lockutils.py:391 188 2015-11-18 15:16:39.419 4330 DEBUG nova.network.neutronv2.api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] _get_instance_nw_info() _get_insta nce_nw_info /usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py:760 189 2015-11-18 15:16:39.419 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac kages/oslo_concurrency/lockutils.py:391 190 2015-11-18 15:16:39.419 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa ckages/oslo_concurrency/lockutils.py:404 191 2015-11-18 15:16:39.420 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?tenant_id=49a02b7bf2bb41d 0996e5e2675b03d8b&device_id=9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 192 2015-11-18 15:16:39.468 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap plication/json; charset=UTF-8 content-length: 706 x-openstack-request-id: req-9a10078d-bb25-4fc1-828b-b4067b057ff0 193 RESP BODY: {"ports": [{"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "dev ice_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:v if_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}]} 194 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 196 2015-11-18 15:16:39.592 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac kages/oslo_concurrency/lockutils.py:391 197 2015-11-18 15:16:39.592 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa ckages/oslo_concurrency/lockutils.py:404 198 2015-11-18 15:16:39.592 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/networks.json?id=958d7c44-66ba-4ab0- 8061-ede751a6b8f9 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pack ages/keystoneclient/session.py:195 199 2015-11-18 15:16:39.633 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap plication/json; charset=UTF-8 content-length: 379 x-openstack-request-id: req-0128968c-fd38-4a69-89d3-862bc37929e0 200 RESP BODY: {"networks": [{"status": "ACTIVE", "subnets": ["4e98d6cb-5154-4ebc-90d6-0a059e5e7306"], "name": "demo-net", "provider:physical_network": null, "router:external": false, "tenant_id": "49a0 2b7bf2bb41d0996e5e2675b03d8b", "admin_state_up": true, "mtu": 0, "shared": false, "provider:network_type": "gre", "id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "provider:segmentation_id": 1}]} 201 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 202 2015-11-18 15:16:39.633 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/floatingips.json?fixed_ip_address=19 2.168.1.18&port_id=1f864632-fc6f-41e9-a951-971bd4c5820e -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_lo g_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 203 2015-11-18 15:16:39.646 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap plication/json; charset=UTF-8 content-length: 19 x-openstack-request-id: req-1bf8c291-a59f-4ac3-83bc-447e8f8a49f9 204 RESP BODY: {"floatingips": []} 205 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 206 2015-11-18 15:16:39.646 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac kages/oslo_concurrency/lockutils.py:391 207 2015-11-18 15:16:39.646 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa ckages/oslo_concurrency/lockutils.py:404 208 2015-11-18 15:16:39.647 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/subnets.json?id=4e98d6cb-5154-4ebc-9 0d6-0a059e5e7306 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-packa ges/keystoneclient/session.py:195 209 2015-11-18 15:16:39.670 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap plication/json; charset=UTF-8 content-length: 466 x-openstack-request-id: req-5ce24c66-9a73-465c-aa0c-984434883975 210 RESP BODY: {"subnets": [{"name": "demo-subnet", "enable_dhcp": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "dns_nameservers": [], "ga teway_ip": "192.168.1.1", "ipv6_ra_mode": null, "allocation_pools": [{"start": "192.168.1.2", "end": "192.168.1.254"}], "host_routes": [], "ip_version": 4, "ipv6_address_mode": null, "cidr": "192.16 8.1.0/24", "id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "subnetpool_id": null}]} 211 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 212 2015-11-18 15:16:39.670 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac kages/oslo_concurrency/lockutils.py:391 213 2015-11-18 15:16:39.671 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa ckages/oslo_concurrency/lockutils.py:404 214 2015-11-18 15:16:39.671 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?network_id=958d7c44-66ba- 4ab0-8061-ede751a6b8f9&device_owner=network%3Adhcp -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_req uest /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 215 2015-11-18 15:16:39.713 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap plication/json; charset=UTF-8 content-length: 1475 x-openstack-request-id: req-6ad96980-c71d-4527-b456-32d670e12edf 216 RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "network2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips" : [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.15"}], "id": "559372d5-5596-489b-9f84-6d8af30e5d76", "security_groups": [], "device_id": "dhcpfbb8622d-31c3-51ab-966 1-955e31f4fec6-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "bind ing:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:b8:a8:c0"}, {"status": "ACTIVE", "binding:host_id ": "network.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip _address": "192.168.1.2"}], "id": "c857c298-0251-42a0-971b-7b20b66f2d8f", "security_groups": [], "device_id": "dhcp7b60c1d9-602e-5110-8c89-a9475b89732c-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details": {"port_filter": true, "ovs_hybrid_plug": tr ue}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:78:c0:0c"}]} 217 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 218 2015-11-18 15:16:39.714 4330 DEBUG nova.network.base_api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Updating cache with info: [VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_del ete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'met a': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injecte d': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params ': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})] update_instance_ cache_with_nw_info /usr/lib/python2.7/site-packages/nova/network/base_api.py:42 219 2015-11-18 15:16:39.736 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr/ lib/python2.7/site-packages/oslo_concurrency/lockutils.py:404 220 2015-11-18 15:16:39.736 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Updated the network info_cache for insta nce _heal_instance_info_cache /usr/lib/python2.7/site-packages/nova/compute/manager.py:5598 221 2015-11-18 15:16:39.736 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.s="" ervice="" object="" at="" 0x4747590="">> sleeping for 17.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 222 2015-11-18 15:16:56.737 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager.update_available_resource run_periodi c_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 223 2015-11-18 15:16:56.739 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Auditing locally available compute resources for node compute2.nueos 224 2015-11-18 15:16:56.879 4330 DEBUG nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Hypervisor: free VCPUs: 24 _report_hypervisor_resource_view /usr/lib/python2.7/s ite-packages/nova/compute/resource_tracker.py:518 225 2015-11-18 15:17:40.486 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa ckages/oslo_concurrency/lockutils.py:404 226 2015-11-18 15:17:40.487 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?tenant_id=49a02b7bf2bb41d 0996e5e2675b03d8b&device_id=9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 227 2015-11-18 15:17:40.529 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: ap plication/json; charset=UTF-8 content-length: 706 x-openstack-request-id: req-49f8a397-14af-4aae-b3be-5ae25ea4e348 228 RESP BODY: {"ports": [{"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "dev ice_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:v if_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}]} 229 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 230 2015-11-18 15:17:40.529 4330 DEBUG nova.objects.instance [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Lazy-loading `info_cache' on Instance uuid 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 obj_load _attr /usr/lib/python2.7/site-packages/nova/objects/instance.py:983 231 2015-11-18 15:17:40.654 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac kages/oslo_concurrency/lockutils.py:391 232 2015-11-18 15:17:40.654 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa ckages/oslo_concurrency/lockutils.py:404 233 2015-11-18 15:17:40.654 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/networks.json?id=958d7c44-66ba-4ab0- 8061-ede751a6b8f9 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pack ages/keystoneclient/session.py:195 234 2015-11-18 15:17:40.702 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: ap plication/json; charset=UTF-8 content-length: 379 x-openstack-request-id: req-063f2211-d019-486c-9f2a-43d35bac93e4 238 2015-11-18 15:17:40.715 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: a pplication/json; charset=UTF-8 content-length: 19 x-openstack-request-id: req-6f80cea6-f6e7-4318-bbb5-bd69f7be5d34 239 RESP BODY: {"floatingips": []} 240 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 241 2015-11-18 15:17:40.715 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa ckages/oslo_concurrency/lockutils.py:391 242 2015-11-18 15:17:40.716 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p ackages/oslo_concurrency/lockutils.py:404 243 2015-11-18 15:17:40.716 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/subnets.json?id=4e98d6cb-5154-4ebc- 90d6-0a059e5e7306 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pac kages/keystoneclient/session.py:195 244 2015-11-18 15:17:40.839 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: a pplication/json; charset=UTF-8 content-length: 466 x-openstack-request-id: req-d5b8c7ad-4e65-4522-af93-4e30d53f4f62 245 RESP BODY: {"subnets": [{"name": "demo-subnet", "enable_dhcp": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "dns_nameservers": [], "g ateway_ip": "192.168.1.1", "ipv6_ra_mode": null, "allocation_pools": [{"start": "192.168.1.2", "end": "192.168.1.254"}], "host_routes": [], "ip_version": 4, "ipv6_address_mode": null, "cidr": "192. 168.1.0/24", "id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "subnetpool_id": null}]} 246 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 247 2015-11-18 15:17:40.840 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa ckages/oslo_concurrency/lockutils.py:391 248 2015-11-18 15:17:40.840 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p ackages/oslo_concurrency/lockutils.py:404 249 2015-11-18 15:17:40.840 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?network_id=958d7c44-66ba -4ab0-8061-ede751a6b8f9&device_owner=network%3Adhcp -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_r equest /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 250 2015-11-18 15:17:40.881 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: a pplication/json; charset=UTF-8 content-length: 1475 x-openstack-request-id: req-61db012d-82fa-415c-84a6-f3181ae7a7a8 251 RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "network2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips ": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.15"}], "id": "559372d5-5596-489b-9f84-6d8af30e5d76", "security_groups": [], "device_id": "dhcpfbb8622d-31c3-51ab-9 661-955e31f4fec6-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "b inding:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:b8:a8:c0"}, {"status": "ACTIVE", "binding:hos t_id": "network.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306" , "ip_address": "192.168.1.2"}], "id": "c857c298-0251-42a0-971b-7b20b66f2d8f", "security_groups": [], "device_id": "dhcp7b60c1d9-602e-5110-8c89-a9475b89732c-958d7c44-66ba-4ab0-8061-ede751a6b8f9", " name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details": {"port_filter": true, "ovs_hybrid_pl ug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:78:c0:0c"}]} 252 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 253 2015-11-18 15:17:40.882 4330 DEBUG nova.network.base_api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Updating cache with info: [VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_de lete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'm eta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'inje cted': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_pa rams': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})] update_inst ance_cache_with_nw_info /usr/lib/python2.7/site-packages/nova/network/base_api.py:42 254 2015-11-18 15:17:40.907 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr /lib/python2.7/site-packages/oslo_concurrency/lockutils.py:404 255 2015-11-18 15:17:40.908 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Updated the network info_cache for inst ance _heal_instance_info_cache /usr/lib/python2.7/site-packages/nova/compute/manager.py:5598 256 2015-11-18 15:17:40.908 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.="" service="" object="" at="" 0x4747590="">> sleeping for 17.94 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 257 2015-11-18 15:17:58.847 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager.update_available_resource run_period ic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 258 2015-11-18 15:17:58.849 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Auditing locally available compute resources for node compute2.nueos 259 2015-11-18 15:17:58.983 4330 DEBUG nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Hypervisor: free VCPUs: 24 _report_hypervisor_resource_view /usr/lib/python2.7/ site-packages/nova/compute/resource_tracker.py:518 260 2015-11-18 15:17:58.983 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Lock "compute_resources" acquired by "_update_available_resource" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444 261 2015-11-18 15:17:59.144 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Total usable vcpus: 24, total allocated vcpus: 0 262 2015-11-18 15:17:59.144 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Final resource view: name=compute2.nueos phys_ram=96506MB used_ram=1024MB phys_d isk=49GB used_disk=1GB total_vcpus=24 used_vcpus=0 pci_stats=<nova.pci.stats.pcidevicestats object="" at="" 0x502bc10=""> 263 2015-11-18 15:17:59.194 4330 INFO nova.scheduler.client.report [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Compute_service record updated for ('compute2.nueos', 'compute2.nueos') 264 2015-11-18 15:17:59.195 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Compute_service record updated for compute2.nueos:compute2.nueos 265 2015-11-18 15:17:59.195 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Lock "compute_resources" released by "_update_available_resource" :: held 0.211s i nner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456 266 2015-11-18 15:17:59.225 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.="" service="" object="" at="" 0x4747590="">> sleeping for 2.13 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 267 2015-11-18 15:18:01.360 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._check_instance_build_time run_perio dic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 268 2015-11-18 15:18:01.360 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.="" service="" object="" at="" 0x4747590="">> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 269 2015-11-18 15:18:02.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_t asks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 270 2015-11-18 15:18:02.363 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.="" service="" object="" at="" 0x4747590="">> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 271 2015-11-18 15:18:03.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_task s /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 272 2015-11-18 15:18:03.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic _tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 273 2015-11-18 15:18:03.363 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.="" service="" object="" at="" 0x4747590="">> sleeping for 22.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 274 2015-11-18 15:18:25.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_period ic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 275 2015-11-18 15:18:25.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_period ic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 276 2015-11-18 15:18:25.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.="" service="" object="" at="" 0x4747590="">> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 277 2015-11-18 15:18:26.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic _tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219

278 2015-11-18 15:18:26.364 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes /usr/lib/python 2.7/site-packages/nova/compute/manager.py:6197 279 2015-11-18 15:18:26.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.="" service="" object="" at="" 0x4747590="">> sleeping for 15.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 280 2015-11-18 15:18:41.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_period ic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 281 2015-11-18 15:18:41.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Starting heal instance info cache _heal_instance_info_cache /usr/lib/python2.7/site-pack ages/nova/compute/manager.py:5537 282 2015-11-18 15:18:41.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Rebuilding the list of instances to heal _heal_instance_info_cache /usr/lib/python2.7/si te-packages/nova/compute/manager.py:5541 283 2015-11-18 15:18:41.419 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr/ lib/python2.7/site-packages/oslo_concurrency/lockutils.py:391 284 2015-11-18 15:18:41.419 4330 DEBUG nova.network.neutronv2.api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] _get_instance_nw_info() _get_inst ance_nw_info /usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py:760 285 2015-11-18 15:18:41.419 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa ckages/oslo_concurrency/lockutils.py:391 286 2015-11-18 15:18:41.420 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p ackages/oslo_concurrency/lockutils.py:404 287 2015-11-18 15:18:41.420 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?tenant_id=49a02b7bf2bb41 d0996e5e2675b03d8b&device_id=9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd632 6" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 288 2015-11-18 15:18:41.461 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a pplication/json; charset=UTF-8 content-length: 706 x-openstack-request-id: req-5512f74c-b7e1-490f-b1b9-c9e1a3e6e20c 289 RESP BODY: {"ports": [{"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "d evice_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "bindin g:vif_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}]} 290 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 291 2015-11-18 15:18:41.462 4330 DEBUG nova.objects.instance [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Lazy-loading `info_cache' on Instance uuid 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 obj_loa d_attr /usr/lib/python2.7/site-packages/nova/objects/instance.py:983 292 2015-11-18 15:18:41.575 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa ckages/oslo_concurrency/lockutils.py:391 293 2015-11-18 15:18:41.575 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p ackages/oslo_concurrency/lockutils.py:404 294 2015-11-18 15:18:41.575 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/networks.json?id=958d7c44-66ba-4ab0 -8061-ede751a6b8f9 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pa ckages/keystoneclient/session.py:195 295 2015-11-18 15:18:41.615 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a pplication/json; charset=UTF-8 content-length: 379 x-openstack-request-id: req-d0b4da6c-b782-4e80-b074-496fe6ff6da7 296 RESP BODY: {"networks": [{"status": "ACTIVE", "subnets": ["4e98d6cb-5154-4ebc-90d6-0a059e5e7306"], "name": "demo-net", "provider:physical_network": null, "router:external": false, "tenant_id": "49a 02b7bf2bb41d0996e5e2675b03d8b", "admin_state_up": true, "mtu": 0, "shared": false, "provider:network_type": "gre", "id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "provider:segmentation_id": 1}]} 297 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 298 2015-11-18 15:18:41.615 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/floatingips.json?fixed_ip_address=1 92.168.1.18&port_id=1f864632-fc6f-41e9-a951-971bd4c5820e -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_ log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 299 2015-11-18 15:18:41.629 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a pplication/json; charset=UTF-8 content-length: 19 x-openstack-request-id: req-988f2719-50f8-4f27-88bf-61a815f376b2 300 RESP BODY: {"floatingips": []} 301 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 302 2015-11-18 15:18:41.629 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa ckages/oslo_concurrency/lockutils.py:391 303 2015-11-18 15:18:41.630 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p ackages/oslo_concurrency/lockutils.py:404 304 2015-11-18 15:18:41.630 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/subnets.json?id=4e98d6cb-5154-4ebc- 90d6-0a059e5e7306 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pac kages/keystoneclient/session.py:195 305 2015-11-18 15:18:41.653 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a pplication/json; charset=UTF-8 content-length: 466 x-openstack-request-id: req-5456567e-def7-487a-a4d8-9a8087ea7411 306 RESP BODY: {"subnets": [{"name": "demo-subnet", "enable_dhcp": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "dns_nameservers": [], "g ateway_ip": "192.168.1.1", "ipv6_ra_mode": null, "allocation_pools": [{"start": "192.168.1.2", "end": "192.168.1.254"}], "host_routes": [], "ip_version": 4, "ipv6_address_mode": null, "cidr": "192. 168.1.0/24", "id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "subnetpool_id": null}]} 307 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 @
308 2015-11-18 15:18:41.653 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa ckages/oslo_concurrency/lockutils.py:391 309 2015-11-18 15:18:41.654 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p ackages/oslo_concurrency/lockutils.py:404 310 2015-11-18 15:18:41.654 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?network_id=958d7c44-66ba -4ab0-8061-ede751a6b8f9&device_owner=network%3Adhcp -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_r equest /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 311 2015-11-18 15:18:41.701 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a pplication/json; charset=UTF-8 content-length: 1475 x-openstack-request-id: req-ee6abea5-6acd-4616-924f-eb485de20331 312 RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "network2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips ": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.15"}], "id": "559372d5-5596-489b-9f84-6d8af30e5d76", "security_groups": [], "device_id": "dhcpfbb8622d-31c3-51ab-9 661-955e31f4fec6-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "b inding:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:b8:a8:c0"}, {"status": "ACTIVE", "binding:hos t_id": "network.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306" , "ip_address": "192.168.1.2"}], "id": "c857c298-0251-42a0-971b-7b20b66f2d8f", "security_groups": [], "device_id": "dhcp7b60c1d9-602e-5110-8c89-a9475b89732c-958d7c44-66ba-4ab0-8061-ede751a6b8f9", " name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details": {"port_filter": true, "ovs_hybrid_pl ug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:78:c0:0c"}]} 313 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 314 2015-11-18 15:18:41.702 4330 DEBUG nova.network.base_api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Updating cache with info: [VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_de lete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'm eta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'inje cted': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_pa rams': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})] update_inst ance_cache_with_nw_info /usr/lib/python2.7/site-packages/nova/network/base_api.py:42 315 2015-11-18 15:18:41.727 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr /lib/python2.7/site-packages/oslo_concurrency/lockutils.py:404 316 2015-11-18 15:18:41.727 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Updated the network info_cache for inst ance _heal_instance_info_cache /usr/lib/python2.7/site-packages/nova/compute/manager.py:5598 317 2015-11-18 15:18:41.727 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.="" service="" object="" at="" 0x4747590="">> sleeping for 18.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 ~

binding:VIF_Type : binding_failed

I have a multi-node openstack installation. This is a Highly Available installation, multiple controller nodes and multiple Neutron Network nodes using VRRP (L3HA) with Open vSwitch and ML2 plug-in. All my neutron agents and nova endpoints seem to be in order and up. Launching of an instance keeps failing on my compute node, I have shut all down except one, and I cant find what causes the error, the port binding failure. I have the nova compute in debug mode and have captured the logs. I am including the section only around the instance launch time. I am hoping someone here can point me to the right direction. I have been struggling with this for over a week and have read and checked all postings that were related but none of their possible solutions were applicable to me. I hoping someone here can help by looking at the DEBUG trail.

Thanks in Advance

2015-11-18 15:16:01.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.service="" object="" at="" 0x4747590="">> method Service.periodic_tasks of <nova.service.Service object at 0x4747590>> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
2015-11-18 15:16:02.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
2015-11-18 15:16:02.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.service="" object="" at="" 0x4747590="">> method Service.periodic_tasks of <nova.service.Service object at 0x4747590>> sleeping for 19.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
2015-11-18 15:16:03.649 4330 DEBUG oslo_concurrency.lockutils [-] Lock "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" acquired by "_locked_do_build_and_run_instance" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444
2015-11-18 15:16:03.685 4330 INFO nova.compute.manager [req-88ccf1cb-83ba-41dd-baff-00991577ea99 c57621aee095478d950e87ff9d790d84 49a02b7bf2bb41d0996e5e2675b03d8b - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Starting instance...
2015-11-18 15:16:03.923 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" acquired by "instance_claim" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444
2015-11-18 15:16:03.923 4330 DEBUG nova.compute.resource_tracker [-] Memory overhead for 512 MB instance; 0 MB instance_claim /usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py:129
2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Attempting claim: memory 512 MB, disk 1 GB
2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Total memory: 96506 MB, used: 512.00 MB
2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] memory limit: 144759.00 MB, free: 144247.00 MB
2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Total disk: 49 GB, used: 0.00 GB
2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] disk limit not specified, defaulting to unlimited
2015-11-18 15:16:03.972 4330 DEBUG nova.compute.resources.vcpu [-] Total CPUs: 24 VCPUs, used: 0.00 VCPUs test /usr/lib/python2.7/site-packages/nova/compute/resources/vcpu.py:52
2015-11-18 15:16:03.972 4330 DEBUG nova.compute.resources.vcpu [-] CPUs limit not specified, defaulting to unlimited test /usr/lib/python2.7/site-packages/nova/compute/resources/vcpu.py:56
2015-11-18 15:16:03.972 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Claim successful
2015-11-18 15:16:04.223 4330 INFO nova.scheduler.client.report [-] Compute_service record updated for ('compute2.nueos', 'compute2.nueos')
2015-11-18 15:16:04.223 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" released by "instance_claim" :: held 0.300s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456
2015-11-18 15:16:04.468 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" acquired by "update_usage" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444
2015-11-18 15:16:04.553 4330 INFO nova.scheduler.client.report [-] Compute_service record updated for ('compute2.nueos', 'compute2.nueos')
2015-11-18 15:16:04.554 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" released by "update_usage" :: held 0.086s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456
2015-11-18 15:16:04.555 4330 DEBUG nova.compute.manager [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Allocating IP information in the background. _allocate_network_async /usr/lib/python2.7/site-packages/nova/compute/manager.py:1754
 2015-11-18 15:16:04.555 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/extensions.json -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
2015-11-18 15:16:04.565 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:04 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 4591 x-openstack-request-id: req-8a400003-40b1-49e3-a38f-61ea79507d55
RESP BODY:
{"extensions":
[

[ {"updated": "2012-10-05T10:00:00-00:00", "name": "security-group", "links": [], "namespace": "http://docs.openstack.org/ext/securitygroups/api/v2.0", "alias": "security-group", "description": "The security groups extension."}, {"updated": "2013-02-07T10:00:00-00:00", "name": "L3 Agent Scheduler", "links": [], "namespace": "http://docs.openstack.org/ext/l3_agent_scheduler/api/v1.0", "alias": "l3_agent_scheduler", "description": "Schedule routers among l3 agents"}, {"updated": "2015-03-25T10:00:00-00:00", "name": "Network MTU", "links": [], "namespace": "http://docs.openstack.org/ext/net_mtu/api/v1.0", "alias": "net-mtu", "description": "Provides MTU attribute for a network resource."}, {"updated": "2013-03-28T10:00:00-00:00", "name": "Neutron L3 Configurable external gateway mode", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/ext-gw-mode/api/v1.0", "alias": "ext-gw-mode", "description": "Extension of the router abstraction for specifying whether SNAT should occur on the external gateway"}, {"updated": "2014-02-03T10:00:00-00:00", "name": "Port Binding", "links": [], "namespace": "http://docs.openstack.org/ext/binding/api/v1.0", "alias": "binding", "description": "Expose port bindings of a virtual port to external application"}, {"updated": "2012-09-07T10:00:00-00:00", "name": "Provider Network", "links": [], "namespace": "http://docs.openstack.org/ext/provider/api/v1.0", "alias": "provider", "description": "Expose mapping of virtual networks to physical networks"}, {"updated": "2013-02-03T10:00:00-00:00", "name": "agent", "links": [], "namespace": "http://docs.openstack.org/ext/agent/api/v2.0", "alias": "agent", "description": "The agent management extension."}, {"updated": "2012-07-29T10:00:00-00:00", "name": "Quota management support", "links": [], "namespace": "http://docs.openstack.org/network/ext/quotas-sets/api/v2.0", "alias": "quotas", "description": "Expose functions for quotas management per tenant"}, {"updated": "2015-03-30T10:00:00-00:00", "name": "Subnet Allocation", "links": [], "namespace": "http://docs.openstack.org/ext/subnet_allocation/api/v1.0", "alias": "subnet_allocation", "description": "Enables allocation of subnets from a subnet pool"}, {"updated": "2013-02-07T10:00:00-00:00", "name": "DHCP Agent Scheduler", "links": [], "namespace": "http://docs.openstack.org/ext/dhcp_agent_scheduler/api/v1.0", "alias": "dhcp_agent_scheduler", "description": "Schedule networks among dhcp agents"}, {"updated": "2014-04-26T00:00:00-00:00", "name": "HA Router extension", "links": [], "namespace": "", "alias": "l3-ha", "description": "Add HA capability to routers."}, {"updated": "2013-06-27T10:00:00-00:00", "name": "Multi Provider Network", "links": [], "namespace": "http://docs.openstack.org/ext/multi-provider/api/v1.0", "alias": "multi-provider", "description": "Expose mapping of virtual networks to multiple physical networks"}, {"updated": "2013-01-14T10:00:00-00:00", "name": "Neutron external network", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/external_net/api/v1.0", "alias": "external-net", "description": "Adds external network attribute to network resource."}, {"updated": "2012-07-20T10:00:00-00:00", "name": "Neutron L3 Router", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/router/api/v1.0", "alias": "router", "description": "Router abs traction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway."}, 43 {"updated": "2013-07-23T10:00:00-00:00", "name": "Allowed Address Pairs", "links": [], "namespace": "http://docs.openstack.org/ext/allowedaddresspairs/api/v2.0", "alias": "allowed-address-pairs", "d escription": "Provides allowed address pairs"}, 44 {"updated": "2013-02-01T10:00:00-00:00", "name": "Neutron Extra Route", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/extraroutes/api/v1.0", "alias": "extraroute", "description": "Extra routes configuration for L3 router"}, 45 {"updated": "2013-03-17T12:00:00-00:00", "name": "Neutron Extra DHCP opts", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/extra_dhcp_opt/api/v1.0", "alias": "extra_dhcp_opt", "des cription": "Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)"}, 46 47 {"updated": "2014-06-1T10:00:00-00:00", "name": "Distributed Virtual Router", "links": [], "namespace": "http://docs.openstack.org/ext/dvr/api/v1.0", "alias": "dvr", "description": "Enables configur ation of Distributed Virtual Routers."}]} 48 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 49 2015-11-18 15:16:04.566 4330 DEBUG oslo_concurrency.lockutils [-] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:391 50 2015-11-18 15:16:04.566 4330 DEBUG oslo_concurrency.lockutils [-] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:404 51 2015-11-18 15:16:04.566 4330 DEBUG nova.network.neutronv2.api [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] allocate_for_instance() allocate_for_instance /usr/lib/python2.7/site-packages/nova /network/neutronv2/api.py:414 52 2015-11-18 15:16:04.566 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/networks.json?id=958d7c44-66ba-4ab0-8061-ede751a6b8f9 -H "User-Agent: python-neutronc lient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 53 2015-11-18 15:16:04.601 4330 DEBUG nova.block_device [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] block_device_list [] volume_in_mapping /usr/lib/python2.7/site-packages/nova/block_device.py :565 54 2015-11-18 15:16:04.610 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:04 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 379 x-openstack-request-id: req-b526c453-c4b6-42bc-87af-462c645b1347 55 56 RESP BODY: 57 {"networks": 58 [{"status": "ACTIVE", "subnets": ["4e98d6cb-5154-4ebc-90d6-0a059e5e7306"], "name": "demo-net", "provider:physical_network": null, "router:external": false, "tenant_id": "49a02b7bf2bb41d0996e5e2675b0 3d8b", "admin_state_up": true, "mtu": 0, "shared": false, "provider:network_type": "gre", "id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "provider:segmentation_id": 1}]} 59 60 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 2015-11-18 15:16:04.611 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/security-groups.json?tenant_id=49a02b7bf2bb41d0996e5e2675b03d8b -H "User-Agent: pytho n-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 62 2015-11-18 15:16:04.648 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:04 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 155 0 x-openstack-request-id: req-959b8a5d-4fa1-4d5e-8f19-36f00bc42308 2015-11-18 15:16:04.648 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:04 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 155 0 x-openstack-request-id: req-959b8a5d-4fa1-4d5e-8f19-36f00bc42308 63 64 65 RESP BODY: 66 {"security_groups": [ 67 {"tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "description": "Default security group", "id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb", i 68 "security_group_rules": 69 [{"remote_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb", "direction": "ingress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv6", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "port_range_max": null, "port_range_min": null, "id": "10694d01-9d52-4394-945e-10b89cf5207b", "security_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb"}, 70 {"remote_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb", "direction": "ingress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv4", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "port_range_max": null, "port_range_min": null, "id": "50450e55-83a1-416e-b4df-9a07c9593a7c", "security_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb"}, 71 {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv4", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "port_range_max": null, "port_range _min": null, "id": "6e34bdd3-a7e2-47b8-9367-b0274f30b226", "security_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb"}, 72 {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv6", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "port_range_max": null, "port_range _min": null, "id": "790a57da-28ea-40d1-bdc5-d9f7ea5a6364", "security_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb"}], "name": "default"}]} 73 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 74 75 2015-11-18 15:16:04.648 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X POST http://controller:9696/v2.0/ports.json -H "User-Agent: python-neutronclient" -H "Content-Type: application/json" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" -d 76 77 '{"port": {"binding:host_id": "compute2.nueos", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "device_owner": "comput e:nova", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "device_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197"}}' 78 _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 79 80 2015-11-18 15:16:05.056 4330 DEBUG nova.block_device [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] block_device_list [] volume_in_mapping /usr/lib/python2.7/site-packages/nova/block_device.py :565 81 2015-11-18 15:16:05.056 4330 INFO nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Creating image 82 2015-11-18 15:16:05.057 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "/var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk.info" acqui red by "write_to_disk_info_file" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444 83 2015-11-18 15:16:05.057 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "/var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk.info" relea sed by "write_to_disk_info_file" :: held 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456

/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456 sed by "write_to_disk_info_file" :: held 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456 84 2015-11-18 15:16:05.058 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instan ces/_base/373ec6135cab5e510858923b4f2b1b24e193099d execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199 85 2015-11-18 15:16:05.079 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/373ec6135ca b5e510858923b4f2b1b24e193099d" returned: 0 in 0.021s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225 86 2015-11-18 15:16:05.080 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Acquired file lock "/var/lib/nova/instances/locks/nova-373ec6135cab5e510858923b4f2b 1b24e193099d" after waiting 0.000s acquire /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:212 87 2015-11-18 15:16:05.080 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "373ec6135cab5e510858923b4f2b1b24e193099d" acquired by "copy_qcow2_image" :: w aited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444 88 2015-11-18 15:16:05.080 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instan ces/_base/373ec6135cab5e510858923b4f2b1b24e193099d execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199 89 2015-11-18 15:16:05.098 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/373ec6135ca b5e510858923b4f2b1b24e193099d" returned: 0 in 0.018s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225 90 2015-11-18 15:16:05.099 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/var/lib/nova /instances/_base/373ec6135cab5e510858923b4f2b1b24e193099d /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py: 199 91 2015-11-18 15:16:05.120 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "qemu-img create -f qcow2 -o backing_file=/var/lib/nova/instances/_base/373e c6135cab5e510858923b4f2b1b24e193099d /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk" returned: 0 in 0.021s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.p y:225 92 2015-11-18 15:16:05.120 4330 DEBUG nova.virt.disk.api [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Checking if we can resize image /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb19 7/disk. size=1073741824 can_resize_image /usr/lib/python2.7/site-packages/nova/virt/disk/api.py:213 93 2015-11-18 15:16:05.121 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instan ces/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199 94 2015-11-18 15:16:05.139 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/9cecb6f2-cbfd-4c2 c-9bbf-9fcf987cb197/disk" returned: 0 in 0.019s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225 95 2015-11-18 15:16:05.140 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): qemu-img resize /var/lib/nova/instances/9cecb6f2-cbfd- 4c2c-9bbf-9fcf987cb197/disk 1073741824 execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199 96 2015-11-18 15:16:05.160 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "qemu-img resize /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb19 7/disk 1073741824" returned: 0 in 0.021s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225 97 2015-11-18 15:16:05.161 4330 DEBUG nova.virt.disk.api [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Checking if we can extend filesystem inside /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf -9fcf987cb197/disk. CoW=True is_image_extendable /usr/lib/python2.7/site-packages/nova/virt/disk/api.py:227 98 2015-11-18 15:16:05.161 4330 DEBUG nova.virt.disk.vfs.api [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Instance for image imgfile=/var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 /disk imgfmt=qcow2 partition=None instance_for_image /usr/lib/python2.7/site-packages/nova/virt/disk/vfs/api.py:46 99 2015-11-18 15:16:05.161 4330 DEBUG nova.virt.disk.vfs.api [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Using primary VFSGuestFS instance_for_image /usr/lib/python2.7/site-packages/nova/virt/ disk/vfs/api.py:50 100 2015-11-18 15:16:05.162 4330 DEBUG nova.virt.disk.vfs.guestfs [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Setting up appliance for /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb1 97/disk qcow2 setup /usr/lib/python2.7/site-packages/nova/virt/disk/vfs/guestfs.py:169 101 2015-11-18 15:16:05.387 4330 DEBUG keystoneclient.session [-] RESP: [201] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 703 x-openstack-request-id: req-0b9508b4-6cc0-47fc-817c-2aac5cf9c529 102 103 RESP BODY: 104 {"port": {"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips": [{"subnet_id" : "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "device_id": "9ce cb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}} 105 106 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 107 2015-11-18 15:16:05.391 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?tenant_id=49a02b7bf2bb41d0996e5e2675b03d8b&device_id=9cecb6f2-cbfd-4c2c-9b bf-9fcf987cb197 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-packag es/keystoneclient/session.py:195 108 2015-11-18 15:16:05.439 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 706 x-openstack-request-id: req-7324c594-b3bc-42f6-9dea-d88fe8957241 109 110 RESP BODY: {"ports": [{"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "dev ice_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:v if_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}]} 111 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 112 113 2015-11-18 15:16:05.440 4330 DEBUG nova.network.neutronv2.api [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Instance cache missing network info. _get_preexisting_port_ids /usr/lib/python2.7/s ite-packages/nova/network/neutronv2/api.py:1487 114 2015-11-18 15:16:05.440 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/floatingips.json?fixed_ip_address=192.168.1.18&port_id=1f864632-fc6f-41e9-a951-971bd4 c5820e -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-packages/keysto neclient/session.py:195 115 2015-11-18 15:16:05.453 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 19 x-openstack-request-id: req-f7f2161e-f0a2-4390-ae65-6f0945604966 116 RESP BODY: {"floatingips": []} 117 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 118 2015-11-18 15:16:05.453 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/subnets.json?id=4e98d6cb-5154-4ebc-90d6-0a059e5e7306 -H "User-Agent: python-neutroncl ient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 119 2015-11-18 15:16:05.476 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 466 x-openstack-request-id: req-218b0ead-8e56-48f7-975c-e394a7b8adc3 120 RESP BODY: {"subnets": [{"name": "demo-subnet", "enable_dhcp": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "dns_nameservers": [], "ga teway_ip": "192.168.1.1", "ipv6_ra_mode": null, "allocation_pools": [{"start": "192.168.1.2", "end": "192.168.1.254"}], "host_routes": [], "ip_version": 4, "ipv6_address_mode": null, "cidr": "192.16 8.1.0/24", "id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "subnetpool_id": null}]} 121 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 122 2015-11-18 15:16:05.477 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?network_id=958d7c44-66ba-4ab0-8061-ede751a6b8f9&device_owner=network%3Adhc p -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystonecli ent/session.py:195 123 2015-11-18 15:16:05.519 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 147 5 x-openstack-request-id: req-4cd24998-d2cd-426e-8816-276ff3289000 124 RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "network2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips" : [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.15"}], "id": "559372d5-5596-489b-9f84-6d8af30e5d76", "security_groups": [], "device_id": "dhcpfbb8622d-31c3-51ab-966 1-955e31f4fec6-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "bind ing:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:b8:a8:c0"}, {"status": "ACTIVE", "binding:host_id ": "network.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip _address": "192.168.1.2"}], "id": "c857c298-0251-42a0-971b-7b20b66f2d8f", "security_groups": [], "device_id": "dhcp7b60c1d9-602e-5110-8c89-a9475b89732c-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details": {"port_filter": true, "ovs_hybrid_plug": tr ue}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:78:c0:0c"}]} 125 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 126 2015-11-18 15:16:05.520 4330 DEBUG nova.network.base_api [-] Updating cache with info: [VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], ' routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2 675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params': None, 'meta': {}, 'details': {}, 'address': u' fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})] update_instance_cache_with_nw_info /usr/lib/python2.7/site-packag es/nova/network/base_api.py:42 127 2015-11-18 15:16:05.601 4330 DEBUG oslo_concurrency.lockutils [-] Releasing semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lock utils.py:404 128 2015-11-18 15:16:05.602 4330 DEBUG nova.compute.manager [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Instance network_info: |[VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete ': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})]| _allocate_network_ async /usr/lib/python2.7/site-packages/nova/compute/manager.py:1772 129 2015-11-18 15:16:05.820 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" acquired by "update_usage" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockuti ls.py:444 130 2015-11-18 15:16:05.912 4330 INFO nova.scheduler.client.report [-] Compute_service record updated for ('compute2.nueos', 'compute2.nueos') 131 2015-11-18 15:16:05.912 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" released by "update_usage" :: held 0.093s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils .py:456 132 2015-11-18 15:16:07.346 4330 DEBUG nova.virt.disk.vfs.guestfs [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Tearing down appliance teardown /usr/lib/python2.7/site-packages/nova/virt/disk/vfs /guestfs.py:221 133 2015-11-18 15:16:07.374 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Releasing file lock "/var/lib/nova/instances/locks/nova-373ec6135cab5e510858923b4f2 b1b24e193099d" after holding it for 2.295s release /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:227 134 2015-11-18 15:16:07.375 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "373ec6135cab5e510858923b4f2b1b24e193099d" released by "copy_qcow2_image" :: h eld 2.295s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456 135 2015-11-18 15:16:07.375 4330 DEBUG nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Start _get_guest_xml network_info=[V IF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating _ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devn ame': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e 9-a951-971bd4c5820e', 'qbg_params': None})] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk': {'bus': 'virtio', 'boot_index': '1', 'type': 'disk', 'dev': u'vda'}, 'root': {'bu s': 'virtio', 'boot_index': '1', 'type': 'disk', 'dev': u'vda'}}} image_meta={u'status': u'active', u'deleted': False, u'container_format': u'bare', u'min_ram': 0, u'updated_at': u'2015-11-10T20:12: 43.000000', u'min_disk': 0, u'owner': u'b53c28a8b0e445a0a9eb5b02dfb89649', u'is_public': True, u'deleted_at': None, u'properties': {}, u'size': 13287936, u'name': u'cirros-0.3.4-x86_64', u'checksum' : u'ee1eca47dc88f4879d8a229cc70a07c6', u'created_at': u'2015-11-10T20:12:42.000000', u'disk_format': u'qcow2', u'id': u'40801b73-f9cf-424e-a0a2-b78b0501d7d7'} rescue=None block_device_info={'block_d evice_mapping': [], 'root_device_name': u'/dev/vda', 'ephemerals': [], 'swap': None} _get_guest_xml /usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py:4169 ******************************************************************@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@************************************************ 2015-11-18 15:16:07.376 4330 DEBUG nova.objects.instance [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lazy-loading pci_devices' `pci_devices' on Instance uuid 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 obj_loa d_attr /usr/lib/python2.7/site-packages/nova/objects/instance.py:983 137 2015-11-18 15:16:07.515 4330 DEBUG nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CPU mode 'host-model' model '' was chosen _get_guest_cpu_model_config /usr/lib/python 2.7/site-packages/nova/virt/libvirt/driver.py:3065 138 2015-11-18 15:16:07.516 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Getting desirable topologies for flavor Flavor(created_at=None,deleted=False,deleted_at=Non e,disabled=False,ephemeral_gb=0,extra_specs={},flavorid='1',id=2,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta {u'status': u'active', u'deleted': False, u'container_format': u'bare', u'min_ram': 0, u'updated_at': u'2015-11-10T20:12:43.000000', u'min_disk': 0, u'owner': u'b53c28a8b0e445a0a9eb5b02df b89649', u'is_public': True, u'deleted_at': None, u'properties': {}, u'size': 13287936, u'name': u'cirros-0.3.4-x86_64', u'checksum': u'ee1eca47dc88f4879d8a229cc70a07c6', u'created_at': u'2015-11-10 T20:12:42.000000', u'disk_format': u'qcow2', u'id': u'40801b73-f9cf-424e-a0a2-b78b0501d7d7'} _get_desirable_cpu_topologies /usr/lib/python2.7/site-packages/nova/virt/hardware.py:552 139 2015-11-18 15:16:07.516 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Flavor limits 65536:65536:65536 _get_cpu_topology_constraints /usr/lib/python2.7/site-packa ges/nova/virt/hardware.py:309 140 2015-11-18 15:16:07.516 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Image limits 65536:65536:65536 _get_cpu_topology_constraints /usr/lib/python2.7/site-packag es/nova/virt/hardware.py:322 141 2015-11-18 15:16:07.516 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Flavor pref -1:-1:-1 _get_cpu_topology_constraints /usr/lib/python2.7/site-packages/nova/vi rt/hardware.py:345 142 2015-11-18 15:16:07.517 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Image pref -1:-1:-1 _get_cpu_topology_constraints /usr/lib/python2.7/site-packages/nova/vir t/hardware.py:367 143 2015-11-18 15:16:07.517 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Chosen -1:-1:-1 limits 65536:65536:65536 _get_cpu_topology_constraints /usr/lib/python2.7/s ite-packages/nova/virt/hardware.py:396 144 2015-11-18 15:16:07.517 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Build topologies for 1 vcpu(s) 1:1:1 _get_possible_cpu_topologies /usr/lib/python2.7/site-p ackages/nova/virt/hardware.py:440 145 2015-11-18 15:16:07.517 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Got 1 possible topologies _get_possible_cpu_topologies /usr/lib/python2.7/site-packages/nov a/virt/hardware.py:475 146 2015-11-18 15:16:07.517 4330 DEBUG nova.objects.instance [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lazy-loadingvcpu_model' Lazy-loading `vcpu_model' on Instance uuid 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 obj_load _attr /usr/lib/python2.7/site-packages/nova/objects/instance.py:983 147 2015-11-18 15:16:07.540 4330 DEBUG nova.virt.libvirt.vif [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] vif_type=binding_failed instance=Instance(access_ip_v4=None,access_ip_v6=None,architectu re=None,auto_disk_config=True,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2015-11-18T20:16:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=Fal se,deleted_at=None,disable_terminate=False,display_description='xx',display_name='xx',ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(2),host='compute2.nueos',hostname='xx',id=81,imag se,deleted_at=None,disable_terminate=False,display_description='xx',display_name='xx',ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(2),host='compute2.nueos',hostname='xx',id=81,imag e_ref='40801b73-f9cf-424e-a0a2-b78b0501d7d7',info_cache=InstanceInfoCache,instance_type_id=2,kernel_id='',key_data=None,key_name=None,launch_index=0,launched_at=None,launched_on='compute2.nueos',loc ked=False,locked_by=None,memory_mb=512,metadata={},new_flavor=None,node='compute2.nueos',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,po wer_state=0,progress=0,project_id='49a02b7bf2bb41d0996e5e2675b03d8b',ramdisk_id='',reservation_id='r-vntcrctq',root_device_name='/dev/vda',root_gb=1,scheduled_at=None,security_groups=SecurityGroupLi st,shutdown_terminate=False,system_metadata={image_base_image_ref='40801b73-f9cf-424e-a0a2-b78b0501d7d7',image_container_format='bare',image_disk_format='qcow2',image_min_disk='1',image_min_ram='0', network_allocated='True'},tags=,task_state='spawning',terminated_at=None,updated_at=2015-11-18T20:16:05Z,user_data=None,user_id='c57621aee095478d950e87ff9d790d84',uuid=9cecb6f2-cbfd-4c2c-9bbf-9fc network_allocated='True'},tags=<?>,task_state='spawning',terminated_at=None,updated_at=2015-11-18T20:16:05Z,user_data=None,user_id='c57621aee095478d950e87ff9d790d84',uuid=9cecb6f2-cbfd-4c2c-9bbf-9fc f987cb197,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif=VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete': False, 'network': Network({'bridge': None, 'subnets ': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8 b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e :59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None}) virt_typeqemu get_config /usr/lib/python2.7/site-packages/nova/virt/libvir t/vif.py:364 ******************************************************************@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@************************************************ 148 2015-11-18 15:16:07.541 4330 ERROR nova.compute.manager [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Instance failed to spawn 149 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Traceback (most recent call last): 150 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2442, in _build_resou rces 151 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] yield resources 152 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2314, in _build_and_r un_instance 153 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] block_device_info=block_device_info) 154 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2351, in spawn 155 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] write_to_disk=True) 156 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4172, in _get_gue st_xml 157 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] context) 158 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4043, in _get_gue st_config 159 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] flavor, virt_type) 160 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/vif.py", line 374, in get_config 161 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] _("Unexpected vif_type=%s") % vif_type) 162 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] NovaException: Unexpected vif_type=binding_failed 163 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] 164 2015-11-18 15:16:07.542 4330 INFO nova.compute.manager [req-88ccf1cb-83ba-41dd-baff-00991577ea99 c57621aee095478d950e87ff9d790d84 49a02b7bf2bb41d0996e5e2675b03d8b - - -] [instance: 9cecb6f2-cbfd-4c2 c-9bbf-9fcf987cb197] Terminating instance 165 2015-11-18 15:16:07.545 4330 INFO nova.virt.libvirt.driver [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] During wait destroy, instance disappeared. 166 2015-11-18 15:16:07.545 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): mv /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fc f987cb197 /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197_del execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199 167 2015-11-18 15:16:07.556 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "mv /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 /var/lib/no va/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197_del" returned: 0 in 0.011s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225 168 2015-11-18 15:16:07.556 4330 INFO nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Deleting instance files /var/lib/nova /instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197_del 169 2015-11-18 15:16:07.557 4330 INFO nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Deletion of /var/lib/nova/instances/9 cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197_del complete 170 2015-11-18 15:16:07.883 4330 DEBUG nova.compute.claims [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Aborting claim: [Claim: 512 MB memory, 1 GB disk] abort /usr/lib/python2.7/site-packages/nova/compute/claims.py:130 171 2015-11-18 15:16:07.884 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "compute_resources" acquired by "abort_instance_claim" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444 172 2015-11-18 15:16:07.940 4330 INFO nova.scheduler.client.report [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Compute_service record updated for ('compute2.nueos', 'compute2.nueos') 173 2015-11-18 15:16:07.940 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "compute_resources" released by "abort_instance_claim" :: held 0.056s inner /u sr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456 174 2015-11-18 15:16:07.940 4330 DEBUG nova.compute.utils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Unexpected vif_type=binding_failed notify_ about_instance_usage /usr/lib/python2.7/site-packages/nova/compute/utils.py:310 175 2015-11-18 15:16:07.941 4330 DEBUG nova.compute.manager [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Build of instance 9cecb6f2-cbfd-4c2c-9bb f-9fcf987cb197 was re-scheduled: Unexpected vif_type=binding_failed _do_build_and_run_instance /usr/lib/python2.7/site-packages/nova/compute/manager.py:2233 176 2015-11-18 15:16:08.301 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" released by "_locked_do_build_and_run_i nstance" :: held 4.651s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456 177 2015-11-18 15:16:21.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodi c_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 178 2015-11-18 15:16:21.363 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.s="" ervice="" object="" at="" 0x4747590="">> method Service.periodic_tasks of <nova.service.S ervice object at 0x4747590>> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 179 2015-11-18 15:16:22.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodi c_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 180 2015-11-18 15:16:22.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.s="" ervice="" object="" at="" 0x4747590="">> sleeping for 2.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 @ method Service.periodic_tasks of <nova.service.S ervice object at 0x4747590>> sleeping for 2.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 @ ervice object at 0x4747590>> sleeping for 2.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 181 2015-11-18 15:16:24.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_ tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 182 2015-11-18 15:16:24.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes /usr/lib/python2 .7/site-packages/nova/compute/manager.py:6197 183 2015-11-18 15:16:24.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.s="" ervice="" object="" at="" 0x4747590="">> method Service.periodic_tasks of <nova.service.S ervice object at 0x4747590>> sleeping for 15.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 184 2015-11-18 15:16:39.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodi c_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 185 2015-11-18 15:16:39.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Starting heal instance info cache _heal_instance_info_cache /usr/lib/python2.7/site-packa ges/nova/compute/manager.py:5537 186 2015-11-18 15:16:39.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Rebuilding the list of instances to heal _heal_instance_info_cache /usr/lib/python2.7/sit e-packages/nova/compute/manager.py:5541 187 2015-11-18 15:16:39.418 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr/l ib/python2.7/site-packages/oslo_concurrency/lockutils.py:391 188 2015-11-18 15:16:39.419 4330 DEBUG nova.network.neutronv2.api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] _get_instance_nw_info() _get_insta nce_nw_info /usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py:760 189 2015-11-18 15:16:39.419 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac kages/oslo_concurrency/lockutils.py:391 190 2015-11-18 15:16:39.419 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa ckages/oslo_concurrency/lockutils.py:404 ******************************************************************@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@************************************************ 191 2015-11-18 15:16:39.420 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?tenant_id=49a02b7bf2bb41d 0996e5e2675b03d8b&device_id=9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 192 2015-11-18 15:16:39.468 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap plication/json; charset=UTF-8 content-length: 706 x-openstack-request-id: req-9a10078d-bb25-4fc1-828b-b4067b057ff0 193 RESP BODY: {"ports": [{"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "dev ice_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:v if_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}]} 194 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 ******************************************************************@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@************************************************ 196 2015-11-18 15:16:39.592 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac kages/oslo_concurrency/lockutils.py:391 197 2015-11-18 15:16:39.592 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa ckages/oslo_concurrency/lockutils.py:404 198 2015-11-18 15:16:39.592 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/networks.json?id=958d7c44-66ba-4ab0- 8061-ede751a6b8f9 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pack ages/keystoneclient/session.py:195 199 2015-11-18 15:16:39.633 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap plication/json; charset=UTF-8 content-length: 379 x-openstack-request-id: req-0128968c-fd38-4a69-89d3-862bc37929e0 200 RESP BODY: {"networks": [{"status": "ACTIVE", "subnets": ["4e98d6cb-5154-4ebc-90d6-0a059e5e7306"], "name": "demo-net", "provider:physical_network": null, "router:external": false, "tenant_id": "49a0 2b7bf2bb41d0996e5e2675b03d8b", "admin_state_up": true, "mtu": 0, "shared": false, "provider:network_type": "gre", "id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "provider:segmentation_id": 1}]} 201 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 202 2015-11-18 15:16:39.633 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/floatingips.json?fixed_ip_address=19 2.168.1.18&port_id=1f864632-fc6f-41e9-a951-971bd4c5820e -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_lo g_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 203 2015-11-18 15:16:39.646 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap plication/json; charset=UTF-8 content-length: 19 x-openstack-request-id: req-1bf8c291-a59f-4ac3-83bc-447e8f8a49f9 204 RESP BODY: {"floatingips": []} 205 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 206 2015-11-18 15:16:39.646 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac kages/oslo_concurrency/lockutils.py:391 207 2015-11-18 15:16:39.646 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa ckages/oslo_concurrency/lockutils.py:404 208 2015-11-18 15:16:39.647 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/subnets.json?id=4e98d6cb-5154-4ebc-9 0d6-0a059e5e7306 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-packa ges/keystoneclient/session.py:195 209 2015-11-18 15:16:39.670 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap plication/json; charset=UTF-8 content-length: 466 x-openstack-request-id: req-5ce24c66-9a73-465c-aa0c-984434883975 210 RESP BODY: {"subnets": [{"name": "demo-subnet", "enable_dhcp": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "dns_nameservers": [], "ga teway_ip": "192.168.1.1", "ipv6_ra_mode": null, "allocation_pools": [{"start": "192.168.1.2", "end": "192.168.1.254"}], "host_routes": [], "ip_version": 4, "ipv6_address_mode": null, "cidr": "192.16 8.1.0/24", "id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "subnetpool_id": null}]} 211 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 212 2015-11-18 15:16:39.670 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac kages/oslo_concurrency/lockutils.py:391 213 2015-11-18 15:16:39.671 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa ckages/oslo_concurrency/lockutils.py:404 214 2015-11-18 15:16:39.671 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?network_id=958d7c44-66ba- 4ab0-8061-ede751a6b8f9&device_owner=network%3Adhcp -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_req uest /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 215 2015-11-18 15:16:39.713 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap plication/json; charset=UTF-8 content-length: 1475 x-openstack-request-id: req-6ad96980-c71d-4527-b456-32d670e12edf 216 RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "network2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips" : [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.15"}], "id": "559372d5-5596-489b-9f84-6d8af30e5d76", "security_groups": [], "device_id": "dhcpfbb8622d-31c3-51ab-966 1-955e31f4fec6-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "bind ing:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:b8:a8:c0"}, {"status": "ACTIVE", "binding:host_id ": "network.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip _address": "192.168.1.2"}], "id": "c857c298-0251-42a0-971b-7b20b66f2d8f", "security_groups": [], "device_id": "dhcp7b60c1d9-602e-5110-8c89-a9475b89732c-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details": {"port_filter": true, "ovs_hybrid_plug": tr ue}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:78:c0:0c"}]} 217 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 218 2015-11-18 15:16:39.714 4330 DEBUG nova.network.base_api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Updating cache with info: [VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_del ete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'met a': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injecte d': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params ': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})] update_instance_ cache_with_nw_info /usr/lib/python2.7/site-packages/nova/network/base_api.py:42 219 2015-11-18 15:16:39.736 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr/ lib/python2.7/site-packages/oslo_concurrency/lockutils.py:404 220 2015-11-18 15:16:39.736 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Updated the network info_cache for insta nce _heal_instance_info_cache /usr/lib/python2.7/site-packages/nova/compute/manager.py:5598 221 2015-11-18 15:16:39.736 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.s="" ervice="" object="" at="" 0x4747590="">> method Service.periodic_tasks of <nova.service.S ervice object at 0x4747590>> sleeping for 17.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 222 2015-11-18 15:16:56.737 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager.update_available_resource run_periodi c_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 223 2015-11-18 15:16:56.739 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Auditing locally available compute resources for node compute2.nueos 224 2015-11-18 15:16:56.879 4330 DEBUG nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Hypervisor: free VCPUs: 24 _report_hypervisor_resource_view /usr/lib/python2.7/s ite-packages/nova/compute/resource_tracker.py:518 225 2015-11-18 15:17:40.486 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa ckages/oslo_concurrency/lockutils.py:404 226 2015-11-18 15:17:40.487 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?tenant_id=49a02b7bf2bb41d 0996e5e2675b03d8b&device_id=9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 ******************************************************************@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@************************************************ 227 2015-11-18 15:17:40.529 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: ap plication/json; charset=UTF-8 content-length: 706 x-openstack-request-id: req-49f8a397-14af-4aae-b3be-5ae25ea4e348 228 RESP BODY: {"ports": [{"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "dev ice_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:v if_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}]} 229 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 ******************************************************************@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@************************************************ 230 2015-11-18 15:17:40.529 4330 DEBUG nova.objects.instance [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Lazy-loading `info_cache' on Instance uuid 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 obj_load _attr /usr/lib/python2.7/site-packages/nova/objects/instance.py:983 231 2015-11-18 15:17:40.654 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac kages/oslo_concurrency/lockutils.py:391 232 2015-11-18 15:17:40.654 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa ckages/oslo_concurrency/lockutils.py:404 233 2015-11-18 15:17:40.654 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/networks.json?id=958d7c44-66ba-4ab0- 8061-ede751a6b8f9 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pack ages/keystoneclient/session.py:195 234 2015-11-18 15:17:40.702 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: ap plication/json; charset=UTF-8 content-length: 379 x-openstack-request-id: req-063f2211-d019-486c-9f2a-43d35bac93e4 238 2015-11-18 15:17:40.715 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: a pplication/json; charset=UTF-8 content-length: 19 x-openstack-request-id: req-6f80cea6-f6e7-4318-bbb5-bd69f7be5d34 239 RESP BODY: {"floatingips": []} 240 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 241 2015-11-18 15:17:40.715 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa ckages/oslo_concurrency/lockutils.py:391 242 2015-11-18 15:17:40.716 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p ackages/oslo_concurrency/lockutils.py:404 243 2015-11-18 15:17:40.716 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/subnets.json?id=4e98d6cb-5154-4ebc- 90d6-0a059e5e7306 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pac kages/keystoneclient/session.py:195 244 2015-11-18 15:17:40.839 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: a pplication/json; charset=UTF-8 content-length: 466 x-openstack-request-id: req-d5b8c7ad-4e65-4522-af93-4e30d53f4f62 245 RESP BODY: {"subnets": [{"name": "demo-subnet", "enable_dhcp": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "dns_nameservers": [], "g ateway_ip": "192.168.1.1", "ipv6_ra_mode": null, "allocation_pools": [{"start": "192.168.1.2", "end": "192.168.1.254"}], "host_routes": [], "ip_version": 4, "ipv6_address_mode": null, "cidr": "192. 168.1.0/24", "id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "subnetpool_id": null}]} 246 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 247 2015-11-18 15:17:40.840 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa ckages/oslo_concurrency/lockutils.py:391 248 2015-11-18 15:17:40.840 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p ackages/oslo_concurrency/lockutils.py:404 249 2015-11-18 15:17:40.840 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?network_id=958d7c44-66ba -4ab0-8061-ede751a6b8f9&device_owner=network%3Adhcp -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_r equest /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 250 2015-11-18 15:17:40.881 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: a pplication/json; charset=UTF-8 content-length: 1475 x-openstack-request-id: req-61db012d-82fa-415c-84a6-f3181ae7a7a8 251 RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "network2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips ": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.15"}], "id": "559372d5-5596-489b-9f84-6d8af30e5d76", "security_groups": [], "device_id": "dhcpfbb8622d-31c3-51ab-9 661-955e31f4fec6-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "b inding:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:b8:a8:c0"}, {"status": "ACTIVE", "binding:hos t_id": "network.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306" , "ip_address": "192.168.1.2"}], "id": "c857c298-0251-42a0-971b-7b20b66f2d8f", "security_groups": [], "device_id": "dhcp7b60c1d9-602e-5110-8c89-a9475b89732c-958d7c44-66ba-4ab0-8061-ede751a6b8f9", " name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details": {"port_filter": true, "ovs_hybrid_pl ug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:78:c0:0c"}]} 252 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 253 2015-11-18 15:17:40.882 4330 DEBUG nova.network.base_api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Updating cache with info: [VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_de lete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'm eta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'inje cted': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_pa rams': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})] update_inst ance_cache_with_nw_info /usr/lib/python2.7/site-packages/nova/network/base_api.py:42 \\ 254 2015-11-18 15:17:40.907 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr /lib/python2.7/site-packages/oslo_concurrency/lockutils.py:404 255 2015-11-18 15:17:40.908 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Updated the network info_cache for inst ance _heal_instance_info_cache /usr/lib/python2.7/site-packages/nova/compute/manager.py:5598 256 2015-11-18 15:17:40.908 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.="" service="" object="" at="" 0x4747590="">> method Service.periodic_tasks of <nova.service. Service object at 0x4747590>> sleeping for 17.94 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 257 2015-11-18 15:17:58.847 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager.update_available_resource run_period ic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 258 2015-11-18 15:17:58.849 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Auditing locally available compute resources for node compute2.nueos 259 2015-11-18 15:17:58.983 4330 DEBUG nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Hypervisor: free VCPUs: 24 _report_hypervisor_resource_view /usr/lib/python2.7/ site-packages/nova/compute/resource_tracker.py:518 260 2015-11-18 15:17:58.983 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Lock "compute_resources" acquired by "_update_available_resource" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444 261 2015-11-18 15:17:59.144 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Total usable vcpus: 24, total allocated vcpus: 0 262 2015-11-18 15:17:59.144 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Final resource view: name=compute2.nueos phys_ram=96506MB used_ram=1024MB phys_d isk=49GB used_disk=1GB total_vcpus=24 used_vcpus=0 pci_stats=<nova.pci.stats.pcidevicestats object="" at="" 0x502bc10=""> pci_stats=<nova.pci.stats.PciDeviceStats object at 0x502bc10> 263 2015-11-18 15:17:59.194 4330 INFO nova.scheduler.client.report [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Compute_service record updated for ('compute2.nueos', 'compute2.nueos') 264 2015-11-18 15:17:59.195 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Compute_service record updated for compute2.nueos:compute2.nueos 265 2015-11-18 15:17:59.195 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Lock "compute_resources" released by "_update_available_resource" :: held 0.211s i nner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456 266 2015-11-18 15:17:59.225 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.="" service="" object="" at="" 0x4747590="">> method Service.periodic_tasks of <nova.service. Service object at 0x4747590>> sleeping for 2.13 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 267 2015-11-18 15:18:01.360 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._check_instance_build_time run_perio dic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 268 2015-11-18 15:18:01.360 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.="" service="" object="" at="" 0x4747590="">> method Service.periodic_tasks of <nova.service. Service object at 0x4747590>> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 269 2015-11-18 15:18:02.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_t asks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 270 2015-11-18 15:18:02.363 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.="" service="" object="" at="" 0x4747590="">> method Service.periodic_tasks of <nova.service. Service object at 0x4747590>> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 271 2015-11-18 15:18:03.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_task s /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 272 2015-11-18 15:18:03.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic _tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 273 2015-11-18 15:18:03.363 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.="" service="" object="" at="" 0x4747590="">> method Service.periodic_tasks of <nova.service. Service object at 0x4747590>> sleeping for 22.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 274 2015-11-18 15:18:25.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_period ic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 275 2015-11-18 15:18:25.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_period ic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 276 2015-11-18 15:18:25.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.="" service="" object="" at="" 0x4747590="">> method Service.periodic_tasks of <nova.service. Service object at 0x4747590>> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 277 2015-11-18 15:18:26.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic _tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219

/usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 278 2015-11-18 15:18:26.364 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes /usr/lib/python 2.7/site-packages/nova/compute/manager.py:6197 279 2015-11-18 15:18:26.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.="" service="" object="" at="" 0x4747590="">> method Service.periodic_tasks of <nova.service. Service object at 0x4747590>> sleeping for 15.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 280 2015-11-18 15:18:41.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_period ic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219 281 2015-11-18 15:18:41.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Starting heal instance info cache _heal_instance_info_cache /usr/lib/python2.7/site-pack ages/nova/compute/manager.py:5537 282 2015-11-18 15:18:41.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Rebuilding the list of instances to heal _heal_instance_info_cache /usr/lib/python2.7/si te-packages/nova/compute/manager.py:5541 283 2015-11-18 15:18:41.419 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr/ lib/python2.7/site-packages/oslo_concurrency/lockutils.py:391 284 2015-11-18 15:18:41.419 4330 DEBUG nova.network.neutronv2.api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] _get_instance_nw_info() _get_inst ance_nw_info /usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py:760 285 2015-11-18 15:18:41.419 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa ckages/oslo_concurrency/lockutils.py:391 286 2015-11-18 15:18:41.420 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p ackages/oslo_concurrency/lockutils.py:404 287 2015-11-18 15:18:41.420 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?tenant_id=49a02b7bf2bb41 d0996e5e2675b03d8b&device_id=9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd632 6" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 288 2015-11-18 15:18:41.461 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a pplication/json; charset=UTF-8 content-length: 706 x-openstack-request-id: req-5512f74c-b7e1-490f-b1b9-c9e1a3e6e20c 289 RESP BODY: {"ports": [{"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "d evice_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "bindin g:vif_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}]} 290 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 291 2015-11-18 15:18:41.462 4330 DEBUG nova.objects.instance [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Lazy-loading `info_cache' on Instance uuid 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 obj_loa d_attr /usr/lib/python2.7/site-packages/nova/objects/instance.py:983 292 2015-11-18 15:18:41.575 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa ckages/oslo_concurrency/lockutils.py:391 293 2015-11-18 15:18:41.575 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p ackages/oslo_concurrency/lockutils.py:404 294 2015-11-18 15:18:41.575 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/networks.json?id=958d7c44-66ba-4ab0 -8061-ede751a6b8f9 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pa ckages/keystoneclient/session.py:195 295 2015-11-18 15:18:41.615 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a pplication/json; charset=UTF-8 content-length: 379 x-openstack-request-id: req-d0b4da6c-b782-4e80-b074-496fe6ff6da7 296 RESP BODY: {"networks": [{"status": "ACTIVE", "subnets": ["4e98d6cb-5154-4ebc-90d6-0a059e5e7306"], "name": "demo-net", "provider:physical_network": null, "router:external": false, "tenant_id": "49a 02b7bf2bb41d0996e5e2675b03d8b", "admin_state_up": true, "mtu": 0, "shared": false, "provider:network_type": "gre", "id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "provider:segmentation_id": 1}]} 297 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 298 2015-11-18 15:18:41.615 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/floatingips.json?fixed_ip_address=1 92.168.1.18&port_id=1f864632-fc6f-41e9-a951-971bd4c5820e -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_ log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 299 2015-11-18 15:18:41.629 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a pplication/json; charset=UTF-8 content-length: 19 x-openstack-request-id: req-988f2719-50f8-4f27-88bf-61a815f376b2 300 RESP BODY: {"floatingips": []} 301 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 302 2015-11-18 15:18:41.629 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa ckages/oslo_concurrency/lockutils.py:391 303 2015-11-18 15:18:41.630 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p ackages/oslo_concurrency/lockutils.py:404 304 2015-11-18 15:18:41.630 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/subnets.json?id=4e98d6cb-5154-4ebc- 90d6-0a059e5e7306 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pac kages/keystoneclient/session.py:195 305 2015-11-18 15:18:41.653 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a pplication/json; charset=UTF-8 content-length: 466 x-openstack-request-id: req-5456567e-def7-487a-a4d8-9a8087ea7411 306 RESP BODY: {"subnets": [{"name": "demo-subnet", "enable_dhcp": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "dns_nameservers": [], "g ateway_ip": "192.168.1.1", "ipv6_ra_mode": null, "allocation_pools": [{"start": "192.168.1.2", "end": "192.168.1.254"}], "host_routes": [], "ip_version": 4, "ipv6_address_mode": null, "cidr": "192. 168.1.0/24", "id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "subnetpool_id": null}]} 307 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 @
308 2015-11-18 15:18:41.653 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa ckages/oslo_concurrency/lockutils.py:391 309 2015-11-18 15:18:41.654 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p ackages/oslo_concurrency/lockutils.py:404 310 2015-11-18 15:18:41.654 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?network_id=958d7c44-66ba -4ab0-8061-ede751a6b8f9&device_owner=network%3Adhcp -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_r equest /usr/lib/python2.7/site-packages/keystoneclient/session.py:195 311 2015-11-18 15:18:41.701 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a pplication/json; charset=UTF-8 content-length: 1475 x-openstack-request-id: req-ee6abea5-6acd-4616-924f-eb485de20331 312 RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "network2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips ": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.15"}], "id": "559372d5-5596-489b-9f84-6d8af30e5d76", "security_groups": [], "device_id": "dhcpfbb8622d-31c3-51ab-9 661-955e31f4fec6-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "b inding:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:b8:a8:c0"}, {"status": "ACTIVE", "binding:hos t_id": "network.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306" , "ip_address": "192.168.1.2"}], "id": "c857c298-0251-42a0-971b-7b20b66f2d8f", "security_groups": [], "device_id": "dhcp7b60c1d9-602e-5110-8c89-a9475b89732c-958d7c44-66ba-4ab0-8061-ede751a6b8f9", " name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details": {"port_filter": true, "ovs_hybrid_pl ug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:78:c0:0c"}]} 313 _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224 314 2015-11-18 15:18:41.702 4330 DEBUG nova.network.base_api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Updating cache with info: [VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_de lete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'm eta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'inje cted': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_pa rams': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})] update_inst ance_cache_with_nw_info /usr/lib/python2.7/site-packages/nova/network/base_api.py:42 315 2015-11-18 15:18:41.727 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr /lib/python2.7/site-packages/oslo_concurrency/lockutils.py:404 316 2015-11-18 15:18:41.727 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Updated the network info_cache for inst ance _heal_instance_info_cache /usr/lib/python2.7/site-packages/nova/compute/manager.py:5598 317 2015-11-18 15:18:41.727 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method="" service.periodic_tasks="" of="" <nova.service.="" service="" object="" at="" 0x4747590="">> method Service.periodic_tasks of <nova.service. Service object at 0x4747590>> sleeping for 18.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132 ~

~

binding:VIF_Type : binding_failed

I have a multi-node openstack installation. This is a Highly Available installation, multiple controller nodes and multiple Neutron Network nodes using VRRP (L3HA) with Open vSwitch and ML2 plug-in. All my neutron agents and nova endpoints seem to be in order and up. Launching of an instance keeps failing on my compute node, I have shut all down except one, and I cant find what causes the error, the port binding failure. I have the nova compute in debug mode and have captured the logs. I am including the section only around the instance launch time. I am hoping someone here can point me to the right direction. I have been struggling with this for over a week and have read and checked all postings that were related but none of their possible solutions were applicable to me. I hoping someone here can help by looking at the DEBUG trail.

Thanks in Advance

Highlighted Error

 107 2015-11-18 15:16:05.391 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?tenant_id=49a02b7bf2bb41d0996e5e2675b03d8b&device_id=9cecb6f2-cbfd-4c2c-9b        bf-9fcf987cb197 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-packag        es/keystoneclient/session.py:195
    108 2015-11-18 15:16:05.439 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 706         x-openstack-request-id: req-7324c594-b3bc-42f6-9dea-d88fe8957241
    109 
    110 RESP BODY: {"ports": [{"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips":         [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "dev        ice_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:v        if_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}]}
    111  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224
    112

135 2015-11-18 15:16:07.375 4330 DEBUG nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Start _get_guest_xml network_info=[V IF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating _ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devn ame': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e 9-a951-971bd4c5820e', 'qbg_params': None})] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk': {'bus': 'virtio', 'boot_index': '1', 'type': 'disk', 'dev': u'vda'}, 'root': {'bu s': 'virtio', 'boot_index': '1', 'type': 'disk', 'dev': u'vda'}}} image_meta={u'status': u'active', u'deleted': False, u'container_format': u'bare', u'min_ram': 0, u'updated_at': u'2015-11-10T20:12: 43.000000', u'min_disk': 0, u'owner': u'b53c28a8b0e445a0a9eb5b02dfb89649', u'is_public': True, u'deleted_at': None, u'properties': {}, u'size': 13287936, u'name': u'cirros-0.3.4-x86_64', u'checksum' : u'ee1eca47dc88f4879d8a229cc70a07c6', u'created_at': u'2015-11-10T20:12:42.000000', u'disk_format': u'qcow2', u'id': u'40801b73-f9cf-424e-a0a2-b78b0501d7d7'} rescue=None block_device_info={'block_d evice_mapping': [], 'root_device_name': u'/dev/vda', 'ephemerals': [], 'swap': None} _get_guest_xml /usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py:4169

47 2015-11-18 15:16:07.540 4330 DEBUG nova.virt.libvirt.vif [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] vif_type=binding_failed instance=Instance(access_ip_v4=None,access_ip_v6=None,architectu        re=None,auto_disk_config=True,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2015-11-18T20:16:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=Fal        se,deleted_at=None,disable_terminate=False,display_description='xx',display_name='xx',ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(2),host='compute2.nueos',hostname='xx',id=81,imag        e_ref='40801b73-f9cf-424e-a0a2-b78b0501d7d7',info_cache=InstanceInfoCache,instance_type_id=2,kernel_id='',key_data=None,key_name=None,launch_index=0,launched_at=None,launched_on='compute2.nueos',loc        ked=False,locked_by=None,memory_mb=512,metadata={},new_flavor=None,node='compute2.nueos',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,po        wer_state=0,progress=0,project_id='49a02b7bf2bb41d0996e5e2675b03d8b',ramdisk_id='',reservation_id='r-vntcrctq',root_device_name='/dev/vda',root_gb=1,scheduled_at=None,security_groups=SecurityGroupLi        st,shutdown_terminate=False,system_metadata={image_base_image_ref='40801b73-f9cf-424e-a0a2-b78b0501d7d7',image_container_format='bare',image_disk_format='qcow2',image_min_disk='1',image_min_ram='0',        network_allocated='True'},tags=<?>,task_state='spawning',terminated_at=None,updated_at=2015-11-18T20:16:05Z,user_data=None,user_id='c57621aee095478d950e87ff9d790d84',uuid=9cecb6f2-cbfd-4c2c-9bbf-9fc        f987cb197,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif=VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete': False, 'network': Network({'bridge': None, 'subnets        ': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes':         [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8        b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e        :59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9



2015-11-18 15:16:01.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.Service object at 0x4747590>> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
2015-11-18 15:16:02.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
2015-11-18 15:16:02.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.Service object at 0x4747590>> sleeping for 19.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
2015-11-18 15:16:03.649 4330 DEBUG oslo_concurrency.lockutils [-] Lock "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" acquired by "_locked_do_build_and_run_instance" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444
2015-11-18 15:16:03.685 4330 INFO nova.compute.manager [req-88ccf1cb-83ba-41dd-baff-00991577ea99 c57621aee095478d950e87ff9d790d84 49a02b7bf2bb41d0996e5e2675b03d8b - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Starting instance...
2015-11-18 15:16:03.923 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" acquired by "instance_claim" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444
2015-11-18 15:16:03.923 4330 DEBUG nova.compute.resource_tracker [-] Memory overhead for 512 MB instance; 0 MB instance_claim /usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py:129
2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Attempting claim: memory 512 MB, disk 1 GB
2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Total memory: 96506 MB, used: 512.00 MB
2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] memory limit: 144759.00 MB, free: 144247.00 MB
2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Total disk: 49 GB, used: 0.00 GB
2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] disk limit not specified, defaulting to unlimited
2015-11-18 15:16:03.972 4330 DEBUG nova.compute.resources.vcpu [-] Total CPUs: 24 VCPUs, used: 0.00 VCPUs test /usr/lib/python2.7/site-packages/nova/compute/resources/vcpu.py:52
2015-11-18 15:16:03.972 4330 DEBUG nova.compute.resources.vcpu [-] CPUs limit not specified, defaulting to unlimited test /usr/lib/python2.7/site-packages/nova/compute/resources/vcpu.py:56
2015-11-18 15:16:03.972 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Claim successful
2015-11-18 15:16:04.223 4330 INFO nova.scheduler.client.report [-] Compute_service record updated for ('compute2.nueos', 'compute2.nueos')
2015-11-18 15:16:04.223 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" released by "instance_claim" :: held 0.300s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456
2015-11-18 15:16:04.468 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" acquired by "update_usage" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444
2015-11-18 15:16:04.553 4330 INFO nova.scheduler.client.report [-] Compute_service record updated for ('compute2.nueos', 'compute2.nueos')
2015-11-18 15:16:04.554 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" released by "update_usage" :: held 0.086s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456
2015-11-18 15:16:04.555 4330 DEBUG nova.compute.manager [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Allocating IP information in the background. _allocate_network_async /usr/lib/python2.7/site-packages/nova/compute/manager.py:1754






2015-11-18 15:16:04.555 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/extensions.json -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
2015-11-18 15:16:04.565 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:04 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 4591 x-openstack-request-id: req-8a400003-40b1-49e3-a38f-61ea79507d55
RESP BODY:
{"extensions":
[

{"updated": "2012-10-05T10:00:00-00:00", "name": "security-group", "links": [], "namespace": "http://docs.openstack.org/ext/securitygroups/api/v2.0", "alias": "security-group", "description": "The security groups extension."},
{"updated": "2013-02-07T10:00:00-00:00", "name": "L3 Agent Scheduler", "links": [], "namespace": "http://docs.openstack.org/ext/l3_agent_scheduler/api/v1.0", "alias": "l3_agent_scheduler", "description": "Schedule routers among l3 agents"},
{"updated": "2015-03-25T10:00:00-00:00", "name": "Network MTU", "links": [], "namespace": "http://docs.openstack.org/ext/net_mtu/api/v1.0", "alias": "net-mtu", "description": "Provides MTU attribute for a network resource."},
{"updated": "2013-03-28T10:00:00-00:00", "name": "Neutron L3 Configurable external gateway mode", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/ext-gw-mode/api/v1.0", "alias": "ext-gw-mode", "description": "Extension of the router abstraction for specifying whether SNAT should occur on the external gateway"},
{"updated": "2014-02-03T10:00:00-00:00", "name": "Port Binding", "links": [], "namespace": "http://docs.openstack.org/ext/binding/api/v1.0", "alias": "binding", "description": "Expose port bindings of a virtual port to external application"},
{"updated": "2012-09-07T10:00:00-00:00", "name": "Provider Network", "links": [], "namespace": "http://docs.openstack.org/ext/provider/api/v1.0", "alias": "provider", "description": "Expose mapping of virtual networks to physical networks"},
{"updated": "2013-02-03T10:00:00-00:00", "name": "agent", "links": [], "namespace": "http://docs.openstack.org/ext/agent/api/v2.0", "alias": "agent", "description": "The agent management extension."},
{"updated": "2012-07-29T10:00:00-00:00", "name": "Quota management support", "links": [], "namespace": "http://docs.openstack.org/network/ext/quotas-sets/api/v2.0", "alias": "quotas", "description": "Expose functions for quotas management per tenant"},
{"updated": "2015-03-30T10:00:00-00:00", "name": "Subnet Allocation", "links": [], "namespace": "http://docs.openstack.org/ext/subnet_allocation/api/v1.0", "alias": "subnet_allocation", "description": "Enables allocation of subnets from a subnet pool"},
{"updated": "2013-02-07T10:00:00-00:00", "name": "DHCP Agent Scheduler", "links": [], "namespace": "http://docs.openstack.org/ext/dhcp_agent_scheduler/api/v1.0", "alias": "dhcp_agent_scheduler", "description": "Schedule networks among dhcp agents"},
{"updated": "2014-04-26T00:00:00-00:00", "name": "HA Router extension", "links": [], "namespace": "", "alias": "l3-ha", "description": "Add HA capability to routers."},
{"updated": "2013-06-27T10:00:00-00:00", "name": "Multi Provider Network", "links": [], "namespace": "http://docs.openstack.org/ext/multi-provider/api/v1.0", "alias": "multi-provider", "description": "Expose mapping of virtual networks to multiple physical networks"},
{"updated": "2013-01-14T10:00:00-00:00", "name": "Neutron external network", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/external_net/api/v1.0", "alias": "external-net", "description": "Adds external network attribute to network resource."},
{"updated": "2012-07-20T10:00:00-00:00", "name": "Neutron L3 Router", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/router/api/v1.0", "alias": "router", "description": "Router abs        traction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway."},
     43 {"updated": "2013-07-23T10:00:00-00:00", "name": "Allowed Address Pairs", "links": [], "namespace": "http://docs.openstack.org/ext/allowedaddresspairs/api/v2.0", "alias": "allowed-address-pairs", "d        escription": "Provides allowed address pairs"},
     44 {"updated": "2013-02-01T10:00:00-00:00", "name": "Neutron Extra Route", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/extraroutes/api/v1.0", "alias": "extraroute", "description":         "Extra routes configuration for L3 router"},
     45 {"updated": "2013-03-17T12:00:00-00:00", "name": "Neutron Extra DHCP opts", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/extra_dhcp_opt/api/v1.0", "alias": "extra_dhcp_opt", "des        cription": "Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)"},
     46 
     47 {"updated": "2014-06-1T10:00:00-00:00", "name": "Distributed Virtual Router", "links": [], "namespace": "http://docs.openstack.org/ext/dvr/api/v1.0", "alias": "dvr", "description": "Enables configur        ation of Distributed Virtual Routers."}]}
     48  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224




     49 2015-11-18 15:16:04.566 4330 DEBUG oslo_concurrency.lockutils [-] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:391
     50 2015-11-18 15:16:04.566 4330 DEBUG oslo_concurrency.lockutils [-] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:404
     51 2015-11-18 15:16:04.566 4330 DEBUG nova.network.neutronv2.api [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] allocate_for_instance() allocate_for_instance /usr/lib/python2.7/site-packages/nova        /network/neutronv2/api.py:414





     52 2015-11-18 15:16:04.566 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/networks.json?id=958d7c44-66ba-4ab0-8061-ede751a6b8f9 -H "User-Agent: python-neutronc        lient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
     53 2015-11-18 15:16:04.601 4330 DEBUG nova.block_device [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] block_device_list [] volume_in_mapping /usr/lib/python2.7/site-packages/nova/block_device.py        :565
     54 2015-11-18 15:16:04.610 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:04 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 379         x-openstack-request-id: req-b526c453-c4b6-42bc-87af-462c645b1347
     55 

     56 RESP BODY:
     57 {"networks":
     58 [{"status": "ACTIVE", "subnets": ["4e98d6cb-5154-4ebc-90d6-0a059e5e7306"], "name": "demo-net", "provider:physical_network": null, "router:external": false, "tenant_id": "49a02b7bf2bb41d0996e5e2675b0        3d8b", "admin_state_up": true, "mtu": 0, "shared": false, "provider:network_type": "gre", "id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "provider:segmentation_id": 1}]}
     60  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224




       2015-11-18 15:16:04.611 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/security-groups.json?tenant_id=49a02b7bf2bb41d0996e5e2675b03d8b -H "User-Agent: pytho        n-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
     62 2015-11-18 15:16:04.648 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:04 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 155        0 x-openstack-request-id: req-959b8a5d-4fa1-4d5e-8f19-36f00bc42308
2015-11-18 15:16:04.648 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:04 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 155        0 x-openstack-request-id: req-959b8a5d-4fa1-4d5e-8f19-36f00bc42308
     63 
     64 
     65 RESP BODY:
     66 {"security_groups": [
     67 {"tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "description": "Default security group", "id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb", i
     68 "security_group_rules":
     69 [{"remote_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb", "direction": "ingress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv6", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b",         "port_range_max": null, "port_range_min": null, "id": "10694d01-9d52-4394-945e-10b89cf5207b", "security_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb"},
     70 {"remote_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb", "direction": "ingress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv4", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b",         "port_range_max": null, "port_range_min": null, "id": "50450e55-83a1-416e-b4df-9a07c9593a7c", "security_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb"},
     71 {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv4", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "port_range_max": null, "port_range        _min": null, "id": "6e34bdd3-a7e2-47b8-9367-b0274f30b226", "security_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb"},
     72 {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv6", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "port_range_max": null, "port_range        _min": null, "id": "790a57da-28ea-40d1-bdc5-d9f7ea5a6364", "security_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb"}], "name": "default"}]}
     73  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224
     74 




     75 2015-11-18 15:16:04.648 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X POST http://controller:9696/v2.0/ports.json -H "User-Agent: python-neutronclient" -H "Content-Type: application/json"         -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" -d
     76 
     77 '{"port": {"binding:host_id": "compute2.nueos", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "device_owner": "comput        e:nova", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "device_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197"}}'
     78 _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195



     79 
     80 2015-11-18 15:16:05.056 4330 DEBUG nova.block_device [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] block_device_list [] volume_in_mapping /usr/lib/python2.7/site-packages/nova/block_device.py        :565
     81 2015-11-18 15:16:05.056 4330 INFO nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Creating image
     82 2015-11-18 15:16:05.057 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "/var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk.info" acqui        red by "write_to_disk_info_file" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444
     83 2015-11-18 15:16:05.057 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "/var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk.info" relea        sed by "write_to_disk_info_file" :: held 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456

   sed by "write_to_disk_info_file" :: held 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456
     84 2015-11-18 15:16:05.058 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instan        ces/_base/373ec6135cab5e510858923b4f2b1b24e193099d execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199
     85 2015-11-18 15:16:05.079 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/373ec6135ca        b5e510858923b4f2b1b24e193099d" returned: 0 in 0.021s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225
     86 2015-11-18 15:16:05.080 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Acquired file lock "/var/lib/nova/instances/locks/nova-373ec6135cab5e510858923b4f2b        1b24e193099d" after waiting 0.000s acquire /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:212
     87 2015-11-18 15:16:05.080 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "373ec6135cab5e510858923b4f2b1b24e193099d" acquired by "copy_qcow2_image" :: w        aited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444
     88 2015-11-18 15:16:05.080 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instan        ces/_base/373ec6135cab5e510858923b4f2b1b24e193099d execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199
     89 2015-11-18 15:16:05.098 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/373ec6135ca        b5e510858923b4f2b1b24e193099d" returned: 0 in 0.018s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225
     90 2015-11-18 15:16:05.099 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/var/lib/nova        /instances/_base/373ec6135cab5e510858923b4f2b1b24e193099d /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:        199
     91 2015-11-18 15:16:05.120 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "qemu-img create -f qcow2 -o backing_file=/var/lib/nova/instances/_base/373e        c6135cab5e510858923b4f2b1b24e193099d /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk" returned: 0 in 0.021s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.p        y:225
     92 2015-11-18 15:16:05.120 4330 DEBUG nova.virt.disk.api [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Checking if we can resize image /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb19        7/disk. size=1073741824 can_resize_image /usr/lib/python2.7/site-packages/nova/virt/disk/api.py:213
     93 2015-11-18 15:16:05.121 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instan        ces/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199
     94 2015-11-18 15:16:05.139 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/9cecb6f2-cbfd-4c2        c-9bbf-9fcf987cb197/disk" returned: 0 in 0.019s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225
     95 2015-11-18 15:16:05.140 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): qemu-img resize /var/lib/nova/instances/9cecb6f2-cbfd-        4c2c-9bbf-9fcf987cb197/disk 1073741824 execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199
     96 2015-11-18 15:16:05.160 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "qemu-img resize /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb19        7/disk 1073741824" returned: 0 in 0.021s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225
     97 2015-11-18 15:16:05.161 4330 DEBUG nova.virt.disk.api [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Checking if we can extend filesystem inside /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf        -9fcf987cb197/disk. CoW=True is_image_extendable /usr/lib/python2.7/site-packages/nova/virt/disk/api.py:227
     98 2015-11-18 15:16:05.161 4330 DEBUG nova.virt.disk.vfs.api [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Instance for image imgfile=/var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197        /disk imgfmt=qcow2 partition=None instance_for_image /usr/lib/python2.7/site-packages/nova/virt/disk/vfs/api.py:46
99 2015-11-18 15:16:05.161 4330 DEBUG nova.virt.disk.vfs.api [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Using primary VFSGuestFS instance_for_image /usr/lib/python2.7/site-packages/nova/virt/        disk/vfs/api.py:50
    100 2015-11-18 15:16:05.162 4330 DEBUG nova.virt.disk.vfs.guestfs [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Setting up appliance for /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb1        97/disk qcow2 setup /usr/lib/python2.7/site-packages/nova/virt/disk/vfs/guestfs.py:169
    101 2015-11-18 15:16:05.387 4330 DEBUG keystoneclient.session [-] RESP: [201] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 703         x-openstack-request-id: req-0b9508b4-6cc0-47fc-817c-2aac5cf9c529
    102 
    103 RESP BODY:
    104 {"port": {"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips": [{"subnet_id"        : "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "device_id": "9ce        cb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details":         {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}}
    106  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224

    107 2015-11-18 15:16:05.391 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?tenant_id=49a02b7bf2bb41d0996e5e2675b03d8b&device_id=9cecb6f2-cbfd-4c2c-9b        bf-9fcf987cb197 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-packag        es/keystoneclient/session.py:195
    108 2015-11-18 15:16:05.439 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 706         x-openstack-request-id: req-7324c594-b3bc-42f6-9dea-d88fe8957241
    109 
    110 RESP BODY: {"ports": [{"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips":         [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "dev        ice_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:v        if_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}]}
    111  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224
    112 



    113 2015-11-18 15:16:05.440 4330 DEBUG nova.network.neutronv2.api [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Instance cache missing network info. _get_preexisting_port_ids /usr/lib/python2.7/s        ite-packages/nova/network/neutronv2/api.py:1487
    114 2015-11-18 15:16:05.440 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/floatingips.json?fixed_ip_address=192.168.1.18&port_id=1f864632-fc6f-41e9-a951-971bd4        c5820e -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-packages/keysto        neclient/session.py:195
    115 2015-11-18 15:16:05.453 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 19         x-openstack-request-id: req-f7f2161e-f0a2-4390-ae65-6f0945604966
116 RESP BODY: {"floatingips": []}
    117  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224





    118 2015-11-18 15:16:05.453 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/subnets.json?id=4e98d6cb-5154-4ebc-90d6-0a059e5e7306 -H "User-Agent: python-neutroncl        ient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
    119 2015-11-18 15:16:05.476 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 466         x-openstack-request-id: req-218b0ead-8e56-48f7-975c-e394a7b8adc3
    120 RESP BODY: {"subnets": [{"name": "demo-subnet", "enable_dhcp": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "dns_nameservers": [], "ga        teway_ip": "192.168.1.1", "ipv6_ra_mode": null, "allocation_pools": [{"start": "192.168.1.2", "end": "192.168.1.254"}], "host_routes": [], "ip_version": 4, "ipv6_address_mode": null, "cidr": "192.16        8.1.0/24", "id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "subnetpool_id": null}]}
    121  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224




    122 2015-11-18 15:16:05.477 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?network_id=958d7c44-66ba-4ab0-8061-ede751a6b8f9&device_owner=network%3Adhc        p -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystonecli        ent/session.py:195
    123 2015-11-18 15:16:05.519 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 147        5 x-openstack-request-id: req-4cd24998-d2cd-426e-8816-276ff3289000

    124 RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "network2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips"        : [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.15"}], "id": "559372d5-5596-489b-9f84-6d8af30e5d76", "security_groups": [], "device_id": "dhcpfbb8622d-31c3-51ab-966        1-955e31f4fec6-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "bind        ing:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:b8:a8:c0"}, {"status": "ACTIVE", "binding:host_id        ": "network.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip        _address": "192.168.1.2"}], "id": "c857c298-0251-42a0-971b-7b20b66f2d8f", "security_groups": [], "device_id": "dhcp7b60c1d9-602e-5110-8c89-a9475b89732c-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name":         "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details": {"port_filter": true, "ovs_hybrid_plug": tr        ue}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:78:c0:0c"}]}
    125  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224







 126 2015-11-18 15:16:05.520 4330 DEBUG nova.network.base_api [-] Updating cache with info: [VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete': False, 'network': Network({'bridge': None,         'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], '        routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2        675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params': None, 'meta': {}, 'details': {}, 'address': u'        fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})] update_instance_cache_with_nw_info /usr/lib/python2.7/site-packag        es/nova/network/base_api.py:42
    127 2015-11-18 15:16:05.601 4330 DEBUG oslo_concurrency.lockutils [-] Releasing semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lock        utils.py:404




    128 2015-11-18 15:16:05.602 4330 DEBUG nova.compute.manager [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Instance network_info: |[VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete        ': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta':         {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected':         False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params':         None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})]| _allocate_network_        async /usr/lib/python2.7/site-packages/nova/compute/manager.py:1772




    129 2015-11-18 15:16:05.820 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" acquired by "update_usage" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockuti        ls.py:444
    130 2015-11-18 15:16:05.912 4330 INFO nova.scheduler.client.report [-] Compute_service record updated for ('compute2.nueos', 'compute2.nueos')
    131 2015-11-18 15:16:05.912 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" released by "update_usage" :: held 0.093s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils        .py:456
    132 2015-11-18 15:16:07.346 4330 DEBUG nova.virt.disk.vfs.guestfs [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Tearing down appliance teardown /usr/lib/python2.7/site-packages/nova/virt/disk/vfs        /guestfs.py:221
    133 2015-11-18 15:16:07.374 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Releasing file lock "/var/lib/nova/instances/locks/nova-373ec6135cab5e510858923b4f2        b1b24e193099d" after holding it for 2.295s release /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:227
    134 2015-11-18 15:16:07.375 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "373ec6135cab5e510858923b4f2b1b24e193099d" released by "copy_qcow2_image" :: h        eld 2.295s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456
    135 2015-11-18 15:16:07.375 4330 DEBUG nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Start _get_guest_xml network_info=[V        IF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating        _ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type':         'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devn        ame': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e        9-a951-971bd4c5820e', 'qbg_params': None})] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk': {'bus': 'virtio', 'boot_index': '1', 'type': 'disk', 'dev': u'vda'}, 'root': {'bu        s': 'virtio', 'boot_index': '1', 'type': 'disk', 'dev': u'vda'}}} image_meta={u'status': u'active', u'deleted': False, u'container_format': u'bare', u'min_ram': 0, u'updated_at': u'2015-11-10T20:12:        43.000000', u'min_disk': 0, u'owner': u'b53c28a8b0e445a0a9eb5b02dfb89649', u'is_public': True, u'deleted_at': None, u'properties': {}, u'size': 13287936, u'name': u'cirros-0.3.4-x86_64', u'checksum'        : u'ee1eca47dc88f4879d8a229cc70a07c6', u'created_at': u'2015-11-10T20:12:42.000000', u'disk_format': u'qcow2', u'id': u'40801b73-f9cf-424e-a0a2-b78b0501d7d7'} rescue=None block_device_info={'block_d        evice_mapping': [], 'root_device_name': u'/dev/vda', 'ephemerals': [], 'swap': None} _get_guest_xml /usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py:4169



******************************************************************@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@************************************************
 2015-11-18 15:16:07.376 4330 DEBUG nova.objects.instance [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lazy-loading `pci_devices' on Instance uuid 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 obj_loa        d_attr /usr/lib/python2.7/site-packages/nova/objects/instance.py:983
    137 2015-11-18 15:16:07.515 4330 DEBUG nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CPU mode 'host-model' model '' was chosen _get_guest_cpu_model_config /usr/lib/python        2.7/site-packages/nova/virt/libvirt/driver.py:3065
    138 2015-11-18 15:16:07.516 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Getting desirable topologies for flavor Flavor(created_at=None,deleted=False,deleted_at=Non        e,disabled=False,ephemeral_gb=0,extra_specs={},flavorid='1',id=2,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and         image_meta {u'status': u'active', u'deleted': False, u'container_format': u'bare', u'min_ram': 0, u'updated_at': u'2015-11-10T20:12:43.000000', u'min_disk': 0, u'owner': u'b53c28a8b0e445a0a9eb5b02df        b89649', u'is_public': True, u'deleted_at': None, u'properties': {}, u'size': 13287936, u'name': u'cirros-0.3.4-x86_64', u'checksum': u'ee1eca47dc88f4879d8a229cc70a07c6', u'created_at': u'2015-11-10        T20:12:42.000000', u'disk_format': u'qcow2', u'id': u'40801b73-f9cf-424e-a0a2-b78b0501d7d7'} _get_desirable_cpu_topologies /usr/lib/python2.7/site-packages/nova/virt/hardware.py:552
    139 2015-11-18 15:16:07.516 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Flavor limits 65536:65536:65536 _get_cpu_topology_constraints /usr/lib/python2.7/site-packa        ges/nova/virt/hardware.py:309
    140 2015-11-18 15:16:07.516 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Image limits 65536:65536:65536 _get_cpu_topology_constraints /usr/lib/python2.7/site-packag        es/nova/virt/hardware.py:322
    141 2015-11-18 15:16:07.516 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Flavor pref -1:-1:-1 _get_cpu_topology_constraints /usr/lib/python2.7/site-packages/nova/vi        rt/hardware.py:345
    142 2015-11-18 15:16:07.517 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Image pref -1:-1:-1 _get_cpu_topology_constraints /usr/lib/python2.7/site-packages/nova/vir        t/hardware.py:367
    143 2015-11-18 15:16:07.517 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Chosen -1:-1:-1 limits 65536:65536:65536 _get_cpu_topology_constraints /usr/lib/python2.7/s        ite-packages/nova/virt/hardware.py:396
    144 2015-11-18 15:16:07.517 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Build topologies for 1 vcpu(s) 1:1:1 _get_possible_cpu_topologies /usr/lib/python2.7/site-p        ackages/nova/virt/hardware.py:440
    145 2015-11-18 15:16:07.517 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Got 1 possible topologies _get_possible_cpu_topologies /usr/lib/python2.7/site-packages/nov        a/virt/hardware.py:475
    146 2015-11-18 15:16:07.517 4330 DEBUG nova.objects.instance [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lazy-loading `vcpu_model' on Instance uuid 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 obj_load        _attr /usr/lib/python2.7/site-packages/nova/objects/instance.py:983
147 2015-11-18 15:16:07.540 4330 DEBUG nova.virt.libvirt.vif [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] vif_type=binding_failed instance=Instance(access_ip_v4=None,access_ip_v6=None,architectu        re=None,auto_disk_config=True,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2015-11-18T20:16:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=Fal        se,deleted_at=None,disable_terminate=False,display_description='xx',display_name='xx',ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(2),host='compute2.nueos',hostname='xx',id=81,imag        e_ref='40801b73-f9cf-424e-a0a2-b78b0501d7d7',info_cache=InstanceInfoCache,instance_type_id=2,kernel_id='',key_data=None,key_name=None,launch_index=0,launched_at=None,launched_on='compute2.nueos',loc        ked=False,locked_by=None,memory_mb=512,metadata={},new_flavor=None,node='compute2.nueos',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,po        wer_state=0,progress=0,project_id='49a02b7bf2bb41d0996e5e2675b03d8b',ramdisk_id='',reservation_id='r-vntcrctq',root_device_name='/dev/vda',root_gb=1,scheduled_at=None,security_groups=SecurityGroupLi        st,shutdown_terminate=False,system_metadata={image_base_image_ref='40801b73-f9cf-424e-a0a2-b78b0501d7d7',image_container_format='bare',image_disk_format='qcow2',image_min_disk='1',image_min_ram='0',        network_allocated='True'},tags=<?>,task_state='spawning',terminated_at=None,updated_at=2015-11-18T20:16:05Z,user_data=None,user_id='c57621aee095478d950e87ff9d790d84',uuid=9cecb6f2-cbfd-4c2c-9bbf-9fc        f987cb197,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif=VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete': False, 'network': Network({'bridge': None, 'subnets        ': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes':         [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8        b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e        :59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None}) virt_typeqemu get_config /usr/lib/python2.7/site-packages/nova/virt/libvir        t/vif.py:364
******************************************************************@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@************************************************






    148 2015-11-18 15:16:07.541 4330 ERROR nova.compute.manager [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Instance failed to spawn
    149 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Traceback (most recent call last):
    150 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2442, in _build_resou        rces
    151 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]     yield resources
    152 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2314, in _build_and_r        un_instance
    153 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]     block_device_info=block_device_info)
    154 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2351, in spawn
    155 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]     write_to_disk=True)
    156 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4172, in _get_gue        st_xml
    157 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]     context)
    158 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4043, in _get_gue        st_config
    159 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]     flavor, virt_type)
    160 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/vif.py", line 374, in get_config
    161 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]     _("Unexpected vif_type=%s") % vif_type)
    162 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] NovaException: Unexpected vif_type=binding_failed
    163 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]
164 2015-11-18 15:16:07.542 4330 INFO nova.compute.manager [req-88ccf1cb-83ba-41dd-baff-00991577ea99 c57621aee095478d950e87ff9d790d84 49a02b7bf2bb41d0996e5e2675b03d8b - - -] [instance: 9cecb6f2-cbfd-4c2        c-9bbf-9fcf987cb197] Terminating instance
    165 2015-11-18 15:16:07.545 4330 INFO nova.virt.libvirt.driver [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] During wait destroy, instance disappeared.
    166 2015-11-18 15:16:07.545 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): mv /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fc        f987cb197 /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197_del execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199
    167 2015-11-18 15:16:07.556 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "mv /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 /var/lib/no        va/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197_del" returned: 0 in 0.011s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225
    168 2015-11-18 15:16:07.556 4330 INFO nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Deleting instance files /var/lib/nova        /instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197_del
    169 2015-11-18 15:16:07.557 4330 INFO nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Deletion of /var/lib/nova/instances/9        cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197_del complete
    170 2015-11-18 15:16:07.883 4330 DEBUG nova.compute.claims [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Aborting claim: [Claim: 512 MB memory, 1         GB disk] abort /usr/lib/python2.7/site-packages/nova/compute/claims.py:130
    171 2015-11-18 15:16:07.884 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "compute_resources" acquired by "abort_instance_claim" :: waited 0.000s inner         /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444
    172 2015-11-18 15:16:07.940 4330 INFO nova.scheduler.client.report [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Compute_service record updated for ('compute2.nueos', 'compute2.nueos')
    173 2015-11-18 15:16:07.940 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "compute_resources" released by "abort_instance_claim" :: held 0.056s inner /u        sr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456
    174 2015-11-18 15:16:07.940 4330 DEBUG nova.compute.utils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Unexpected vif_type=binding_failed notify_        about_instance_usage /usr/lib/python2.7/site-packages/nova/compute/utils.py:310
    175 2015-11-18 15:16:07.941 4330 DEBUG nova.compute.manager [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Build of instance 9cecb6f2-cbfd-4c2c-9bb        f-9fcf987cb197 was re-scheduled: Unexpected vif_type=binding_failed _do_build_and_run_instance /usr/lib/python2.7/site-packages/nova/compute/manager.py:2233
    176 2015-11-18 15:16:08.301 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" released by "_locked_do_build_and_run_i        nstance" :: held 4.651s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456
    177 2015-11-18 15:16:21.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodi        c_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    178 2015-11-18 15:16:21.363 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.S        ervice object at 0x4747590>> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    179 2015-11-18 15:16:22.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodi        c_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    180 2015-11-18 15:16:22.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.S        ervice object at 0x4747590>> sleeping for 2.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
@                                                                                                                                                                     ervice object at 0x4747590>> sleeping for 2.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    181 2015-11-18 15:16:24.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_        tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    182 2015-11-18 15:16:24.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes /usr/lib/python2        .7/site-packages/nova/compute/manager.py:6197
    183 2015-11-18 15:16:24.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.S        ervice object at 0x4747590>> sleeping for 15.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    184 2015-11-18 15:16:39.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodi        c_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    185 2015-11-18 15:16:39.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Starting heal instance info cache _heal_instance_info_cache /usr/lib/python2.7/site-packa        ges/nova/compute/manager.py:5537
    186 2015-11-18 15:16:39.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Rebuilding the list of instances to heal _heal_instance_info_cache /usr/lib/python2.7/sit        e-packages/nova/compute/manager.py:5541
    187 2015-11-18 15:16:39.418 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr/l        ib/python2.7/site-packages/oslo_concurrency/lockutils.py:391
    188 2015-11-18 15:16:39.419 4330 DEBUG nova.network.neutronv2.api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] _get_instance_nw_info() _get_insta        nce_nw_info /usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py:760
    189 2015-11-18 15:16:39.419 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac        kages/oslo_concurrency/lockutils.py:391
    190 2015-11-18 15:16:39.419 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:404


******************************************************************@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@************************************************


    191 2015-11-18 15:16:39.420 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?tenant_id=49a02b7bf2bb41d        0996e5e2675b03d8b&device_id=9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326"         _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
    192 2015-11-18 15:16:39.468 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap        plication/json; charset=UTF-8 content-length: 706 x-openstack-request-id: req-9a10078d-bb25-4fc1-828b-b4067b057ff0
    193 RESP BODY: {"ports": [{"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips":         [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "dev        ice_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:v        if_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}]}
    194  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224
******************************************************************@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@************************************************


 196 2015-11-18 15:16:39.592 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac        kages/oslo_concurrency/lockutils.py:391
    197 2015-11-18 15:16:39.592 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:404



    198 2015-11-18 15:16:39.592 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/networks.json?id=958d7c44-66ba-4ab0-        8061-ede751a6b8f9 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pack        ages/keystoneclient/session.py:195
    199 2015-11-18 15:16:39.633 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap        plication/json; charset=UTF-8 content-length: 379 x-openstack-request-id: req-0128968c-fd38-4a69-89d3-862bc37929e0
    200 RESP BODY: {"networks": [{"status": "ACTIVE", "subnets": ["4e98d6cb-5154-4ebc-90d6-0a059e5e7306"], "name": "demo-net", "provider:physical_network": null, "router:external": false, "tenant_id": "49a0        2b7bf2bb41d0996e5e2675b03d8b", "admin_state_up": true, "mtu": 0, "shared": false, "provider:network_type": "gre", "id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "provider:segmentation_id": 1}]}
    201  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224



    202 2015-11-18 15:16:39.633 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/floatingips.json?fixed_ip_address=19        2.168.1.18&port_id=1f864632-fc6f-41e9-a951-971bd4c5820e -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_lo        g_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
    203 2015-11-18 15:16:39.646 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap        plication/json; charset=UTF-8 content-length: 19 x-openstack-request-id: req-1bf8c291-a59f-4ac3-83bc-447e8f8a49f9
    204 RESP BODY: {"floatingips": []}
    205  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224
    206 2015-11-18 15:16:39.646 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac        kages/oslo_concurrency/lockutils.py:391
    207 2015-11-18 15:16:39.646 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:404



    208 2015-11-18 15:16:39.647 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/subnets.json?id=4e98d6cb-5154-4ebc-9        0d6-0a059e5e7306 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-packa        ges/keystoneclient/session.py:195
    209 2015-11-18 15:16:39.670 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap        plication/json; charset=UTF-8 content-length: 466 x-openstack-request-id: req-5ce24c66-9a73-465c-aa0c-984434883975
    210 RESP BODY: {"subnets": [{"name": "demo-subnet", "enable_dhcp": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "dns_nameservers": [], "ga        teway_ip": "192.168.1.1", "ipv6_ra_mode": null, "allocation_pools": [{"start": "192.168.1.2", "end": "192.168.1.254"}], "host_routes": [], "ip_version": 4, "ipv6_address_mode": null, "cidr": "192.16        8.1.0/24", "id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "subnetpool_id": null}]}
    211  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224







    212 2015-11-18 15:16:39.670 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac        kages/oslo_concurrency/lockutils.py:391
213 2015-11-18 15:16:39.671 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:404



    214 2015-11-18 15:16:39.671 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?network_id=958d7c44-66ba-        4ab0-8061-ede751a6b8f9&device_owner=network%3Adhcp -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_req        uest /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
    215 2015-11-18 15:16:39.713 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap        plication/json; charset=UTF-8 content-length: 1475 x-openstack-request-id: req-6ad96980-c71d-4527-b456-32d670e12edf

    216 RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "network2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips"        : [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.15"}], "id": "559372d5-5596-489b-9f84-6d8af30e5d76", "security_groups": [], "device_id": "dhcpfbb8622d-31c3-51ab-966        1-955e31f4fec6-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "bind        ing:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:b8:a8:c0"}, {"status": "ACTIVE", "binding:host_id        ": "network.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip        _address": "192.168.1.2"}], "id": "c857c298-0251-42a0-971b-7b20b66f2d8f", "security_groups": [], "device_id": "dhcp7b60c1d9-602e-5110-8c89-a9475b89732c-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name":         "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details": {"port_filter": true, "ovs_hybrid_plug": tr        ue}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:78:c0:0c"}]}
    217  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224






    218 2015-11-18 15:16:39.714 4330 DEBUG nova.network.base_api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Updating cache with info: [VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_del        ete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'met        a': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injecte        d': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params        ': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})] update_instance_        cache_with_nw_info /usr/lib/python2.7/site-packages/nova/network/base_api.py:42




    219 2015-11-18 15:16:39.736 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr/        lib/python2.7/site-packages/oslo_concurrency/lockutils.py:404
    220 2015-11-18 15:16:39.736 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Updated the network info_cache for insta        nce _heal_instance_info_cache /usr/lib/python2.7/site-packages/nova/compute/manager.py:5598
221 2015-11-18 15:16:39.736 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.S        ervice object at 0x4747590>> sleeping for 17.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    222 2015-11-18 15:16:56.737 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager.update_available_resource run_periodi        c_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    223 2015-11-18 15:16:56.739 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Auditing locally available compute resources for node compute2.nueos
    224 2015-11-18 15:16:56.879 4330 DEBUG nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Hypervisor: free VCPUs: 24 _report_hypervisor_resource_view /usr/lib/python2.7/s        ite-packages/nova/compute/resource_tracker.py:518
    225 2015-11-18 15:17:40.486 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:404




    226 2015-11-18 15:17:40.487 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?tenant_id=49a02b7bf2bb41d        0996e5e2675b03d8b&device_id=9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326"         _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195


******************************************************************@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@************************************************
    227 2015-11-18 15:17:40.529 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: ap        plication/json; charset=UTF-8 content-length: 706 x-openstack-request-id: req-49f8a397-14af-4aae-b3be-5ae25ea4e348
    228 RESP BODY: {"ports": [{"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips":         [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "dev        ice_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:v        if_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}]}
    229  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224
******************************************************************@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@************************************************



    230 2015-11-18 15:17:40.529 4330 DEBUG nova.objects.instance [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Lazy-loading `info_cache' on Instance uuid 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 obj_load        _attr /usr/lib/python2.7/site-packages/nova/objects/instance.py:983
    231 2015-11-18 15:17:40.654 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac        kages/oslo_concurrency/lockutils.py:391
    232 2015-11-18 15:17:40.654 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:404
    233 2015-11-18 15:17:40.654 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/networks.json?id=958d7c44-66ba-4ab0-        8061-ede751a6b8f9 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pack        ages/keystoneclient/session.py:195
    234 2015-11-18 15:17:40.702 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: ap        plication/json; charset=UTF-8 content-length: 379 x-openstack-request-id: req-063f2211-d019-486c-9f2a-43d35bac93e4
 238 2015-11-18 15:17:40.715 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: a        pplication/json; charset=UTF-8 content-length: 19 x-openstack-request-id: req-6f80cea6-f6e7-4318-bbb5-bd69f7be5d34
    239 RESP BODY: {"floatingips": []}
    240  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224
    241 2015-11-18 15:17:40.715 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:391
    242 2015-11-18 15:17:40.716 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p        ackages/oslo_concurrency/lockutils.py:404





    243 2015-11-18 15:17:40.716 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/subnets.json?id=4e98d6cb-5154-4ebc-        90d6-0a059e5e7306 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pac        kages/keystoneclient/session.py:195
    244 2015-11-18 15:17:40.839 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: a        pplication/json; charset=UTF-8 content-length: 466 x-openstack-request-id: req-d5b8c7ad-4e65-4522-af93-4e30d53f4f62
    245 RESP BODY: {"subnets": [{"name": "demo-subnet", "enable_dhcp": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "dns_nameservers": [], "g        ateway_ip": "192.168.1.1", "ipv6_ra_mode": null, "allocation_pools": [{"start": "192.168.1.2", "end": "192.168.1.254"}], "host_routes": [], "ip_version": 4, "ipv6_address_mode": null, "cidr": "192.        168.1.0/24", "id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "subnetpool_id": null}]}
    246  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224







    247 2015-11-18 15:17:40.840 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:391
    248 2015-11-18 15:17:40.840 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p        ackages/oslo_concurrency/lockutils.py:404







    249 2015-11-18 15:17:40.840 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?network_id=958d7c44-66ba        -4ab0-8061-ede751a6b8f9&device_owner=network%3Adhcp -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_r        equest /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
    250 2015-11-18 15:17:40.881 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: a        pplication/json; charset=UTF-8 content-length: 1475 x-openstack-request-id: req-61db012d-82fa-415c-84a6-f3181ae7a7a8

    251 RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "network2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips        ": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.15"}], "id": "559372d5-5596-489b-9f84-6d8af30e5d76", "security_groups": [], "device_id": "dhcpfbb8622d-31c3-51ab-9        661-955e31f4fec6-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "b        inding:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:b8:a8:c0"}, {"status": "ACTIVE", "binding:hos        t_id": "network.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306"        , "ip_address": "192.168.1.2"}], "id": "c857c298-0251-42a0-971b-7b20b66f2d8f", "security_groups": [], "device_id": "dhcp7b60c1d9-602e-5110-8c89-a9475b89732c-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "        name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details": {"port_filter": true, "ovs_hybrid_pl        ug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:78:c0:0c"}]}
    252  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224


253 2015-11-18 15:17:40.882 4330 DEBUG nova.network.base_api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Updating cache with info: [VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_de        lete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'm        eta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'inje        cted': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_pa        rams': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})] update_inst        ance_cache_with_nw_info /usr/lib/python2.7/site-packages/nova/network/base_api.py:42
\\
    254 2015-11-18 15:17:40.907 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr        /lib/python2.7/site-packages/oslo_concurrency/lockutils.py:404
    255 2015-11-18 15:17:40.908 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Updated the network info_cache for inst        ance _heal_instance_info_cache /usr/lib/python2.7/site-packages/nova/compute/manager.py:5598
    256 2015-11-18 15:17:40.908 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.        Service object at 0x4747590>> sleeping for 17.94 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    257 2015-11-18 15:17:58.847 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager.update_available_resource run_period        ic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    258 2015-11-18 15:17:58.849 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Auditing locally available compute resources for node compute2.nueos
    259 2015-11-18 15:17:58.983 4330 DEBUG nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Hypervisor: free VCPUs: 24 _report_hypervisor_resource_view /usr/lib/python2.7/        site-packages/nova/compute/resource_tracker.py:518
    260 2015-11-18 15:17:58.983 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Lock "compute_resources" acquired by "_update_available_resource" :: waited 0.000s         inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444
    261 2015-11-18 15:17:59.144 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Total usable vcpus: 24, total allocated vcpus: 0
    262 2015-11-18 15:17:59.144 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Final resource view: name=compute2.nueos phys_ram=96506MB used_ram=1024MB phys_d        isk=49GB used_disk=1GB total_vcpus=24 used_vcpus=0 pci_stats=<nova.pci.stats.PciDeviceStats object at 0x502bc10>
    263 2015-11-18 15:17:59.194 4330 INFO nova.scheduler.client.report [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Compute_service record updated for ('compute2.nueos', 'compute2.nueos')
    264 2015-11-18 15:17:59.195 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Compute_service record updated for compute2.nueos:compute2.nueos
    265 2015-11-18 15:17:59.195 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Lock "compute_resources" released by "_update_available_resource" :: held 0.211s i        nner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456
 266 2015-11-18 15:17:59.225 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.        Service object at 0x4747590>> sleeping for 2.13 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    267 2015-11-18 15:18:01.360 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._check_instance_build_time run_perio        dic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    268 2015-11-18 15:18:01.360 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.        Service object at 0x4747590>> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    269 2015-11-18 15:18:02.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_t        asks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    270 2015-11-18 15:18:02.363 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.        Service object at 0x4747590>> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    271 2015-11-18 15:18:03.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_task        s /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    272 2015-11-18 15:18:03.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic        _tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    273 2015-11-18 15:18:03.363 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.        Service object at 0x4747590>> sleeping for 22.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    274 2015-11-18 15:18:25.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_period        ic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    275 2015-11-18 15:18:25.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_period        ic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    276 2015-11-18 15:18:25.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.        Service object at 0x4747590>> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    277 2015-11-18 15:18:26.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic        _tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219

278 2015-11-18 15:18:26.364 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes /usr/lib/python        2.7/site-packages/nova/compute/manager.py:6197
    279 2015-11-18 15:18:26.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.        Service object at 0x4747590>> sleeping for 15.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    280 2015-11-18 15:18:41.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_period        ic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    281 2015-11-18 15:18:41.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Starting heal instance info cache _heal_instance_info_cache /usr/lib/python2.7/site-pack        ages/nova/compute/manager.py:5537
    282 2015-11-18 15:18:41.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Rebuilding the list of instances to heal _heal_instance_info_cache /usr/lib/python2.7/si        te-packages/nova/compute/manager.py:5541
    283 2015-11-18 15:18:41.419 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr/        lib/python2.7/site-packages/oslo_concurrency/lockutils.py:391
    284 2015-11-18 15:18:41.419 4330 DEBUG nova.network.neutronv2.api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] _get_instance_nw_info() _get_inst        ance_nw_info /usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py:760
    285 2015-11-18 15:18:41.419 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:391
    286 2015-11-18 15:18:41.420 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p        ackages/oslo_concurrency/lockutils.py:404





    287 2015-11-18 15:18:41.420 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?tenant_id=49a02b7bf2bb41        d0996e5e2675b03d8b&device_id=9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd632        6" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
    288 2015-11-18 15:18:41.461 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a        pplication/json; charset=UTF-8 content-length: 706 x-openstack-request-id: req-5512f74c-b7e1-490f-b1b9-c9e1a3e6e20c
    289 RESP BODY: {"ports": [{"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips":         [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "d        evice_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "bindin        g:vif_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}]}
    290  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224



291 2015-11-18 15:18:41.462 4330 DEBUG nova.objects.instance [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Lazy-loading `info_cache' on Instance uuid 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 obj_loa        d_attr /usr/lib/python2.7/site-packages/nova/objects/instance.py:983
    292 2015-11-18 15:18:41.575 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:391
    293 2015-11-18 15:18:41.575 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p        ackages/oslo_concurrency/lockutils.py:404





    294 2015-11-18 15:18:41.575 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/networks.json?id=958d7c44-66ba-4ab0        -8061-ede751a6b8f9 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pa        ckages/keystoneclient/session.py:195
    295 2015-11-18 15:18:41.615 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a        pplication/json; charset=UTF-8 content-length: 379 x-openstack-request-id: req-d0b4da6c-b782-4e80-b074-496fe6ff6da7
    296 RESP BODY: {"networks": [{"status": "ACTIVE", "subnets": ["4e98d6cb-5154-4ebc-90d6-0a059e5e7306"], "name": "demo-net", "provider:physical_network": null, "router:external": false, "tenant_id": "49a        02b7bf2bb41d0996e5e2675b03d8b", "admin_state_up": true, "mtu": 0, "shared": false, "provider:network_type": "gre", "id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "provider:segmentation_id": 1}]}
    297  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224




    298 2015-11-18 15:18:41.615 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/floatingips.json?fixed_ip_address=1        92.168.1.18&port_id=1f864632-fc6f-41e9-a951-971bd4c5820e -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_        log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
    299 2015-11-18 15:18:41.629 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a        pplication/json; charset=UTF-8 content-length: 19 x-openstack-request-id: req-988f2719-50f8-4f27-88bf-61a815f376b2
    300 RESP BODY: {"floatingips": []}


    301  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224
    302 2015-11-18 15:18:41.629 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:391
    303 2015-11-18 15:18:41.630 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p        ackages/oslo_concurrency/lockutils.py:404


    304 2015-11-18 15:18:41.630 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/subnets.json?id=4e98d6cb-5154-4ebc-        90d6-0a059e5e7306 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pac        kages/keystoneclient/session.py:195
    305 2015-11-18 15:18:41.653 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a        pplication/json; charset=UTF-8 content-length: 466 x-openstack-request-id: req-5456567e-def7-487a-a4d8-9a8087ea7411

    306 RESP BODY: {"subnets": [{"name": "demo-subnet", "enable_dhcp": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "dns_nameservers": [], "g        ateway_ip": "192.168.1.1", "ipv6_ra_mode": null, "allocation_pools": [{"start": "192.168.1.2", "end": "192.168.1.254"}], "host_routes": [], "ip_version": 4, "ipv6_address_mode": null, "cidr": "192.        168.1.0/24", "id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "subnetpool_id": null}]}
    307  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224


@                                                                                                                                                                                                            
 308 2015-11-18 15:18:41.653 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:391
    309 2015-11-18 15:18:41.654 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p        ackages/oslo_concurrency/lockutils.py:404


    310 2015-11-18 15:18:41.654 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?network_id=958d7c44-66ba        -4ab0-8061-ede751a6b8f9&device_owner=network%3Adhcp -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_r        equest /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
    311 2015-11-18 15:18:41.701 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a        pplication/json; charset=UTF-8 content-length: 1475 x-openstack-request-id: req-ee6abea5-6acd-4616-924f-eb485de20331


    312 RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "network2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips        ": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.15"}], "id": "559372d5-5596-489b-9f84-6d8af30e5d76", "security_groups": [], "device_id": "dhcpfbb8622d-31c3-51ab-9        661-955e31f4fec6-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "b        inding:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:b8:a8:c0"}, {"status": "ACTIVE", "binding:hos        t_id": "network.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306"        , "ip_address": "192.168.1.2"}], "id": "c857c298-0251-42a0-971b-7b20b66f2d8f", "security_groups": [], "device_id": "dhcp7b60c1d9-602e-5110-8c89-a9475b89732c-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "        name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details": {"port_filter": true, "ovs_hybrid_pl        ug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:78:c0:0c"}]}
    313  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224


    314 2015-11-18 15:18:41.702 4330 DEBUG nova.network.base_api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Updating cache with info: [VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_de        lete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'm        eta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'inje        cted': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_pa        rams': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})] update_inst        ance_cache_with_nw_info /usr/lib/python2.7/site-packages/nova/network/base_api.py:42
    315 2015-11-18 15:18:41.727 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr        /lib/python2.7/site-packages/oslo_concurrency/lockutils.py:404

    316 2015-11-18 15:18:41.727 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Updated the network info_cache for inst        ance _heal_instance_info_cache /usr/lib/python2.7/site-packages/nova/compute/manager.py:5598
    317 2015-11-18 15:18:41.727 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.        Service object at 0x4747590>> sleeping for 18.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
~

binding:VIF_Type : binding_failed

I have a multi-node openstack installation. This is a Highly Available installation, multiple controller nodes and multiple Neutron Network nodes using VRRP (L3HA) with Open vSwitch and ML2 plug-in. All my neutron agents and nova endpoints seem to be in order and up. Launching of an instance keeps failing on my compute node, I have shut all down except one, and I cant find what causes the error, the port binding failure. I have the nova compute in debug mode and have captured the logs. I am including the section only around the instance launch time. I am hoping someone here can point me to the right direction. I have been struggling with this for over a week and have read and checked all postings that were related but none of their possible solutions were applicable to me. I hoping someone here can help by looking at the DEBUG trail.

Thanks in Advance

Highlighted Error

 107 2015-11-18 15:16:05.391 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?tenant_id=49a02b7bf2bb41d0996e5e2675b03d8b&device_id=9cecb6f2-cbfd-4c2c-9b        bf-9fcf987cb197 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-packag        es/keystoneclient/session.py:195
    108 2015-11-18 15:16:05.439 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 706         x-openstack-request-id: req-7324c594-b3bc-42f6-9dea-d88fe8957241
    109 
    110 RESP BODY: {"ports": [{"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips":         [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "dev        ice_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:v        if_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}]}
    111  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224
    112

112 135 2015-11-18 15:16:07.375 4330 DEBUG nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Start _get_guest_xml network_info=[V IF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating _ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devn ame': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e 9-a951-971bd4c5820e', 'qbg_params': None})] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk': {'bus': 'virtio', 'boot_index': '1', 'type': 'disk', 'dev': u'vda'}, 'root': {'bu s': 'virtio', 'boot_index': '1', 'type': 'disk', 'dev': u'vda'}}} image_meta={u'status': u'active', u'deleted': False, u'container_format': u'bare', u'min_ram': 0, u'updated_at': u'2015-11-10T20:12: 43.000000', u'min_disk': 0, u'owner': u'b53c28a8b0e445a0a9eb5b02dfb89649', u'is_public': True, u'deleted_at': None, u'properties': {}, u'size': 13287936, u'name': u'cirros-0.3.4-x86_64', u'checksum' : u'ee1eca47dc88f4879d8a229cc70a07c6', u'created_at': u'2015-11-10T20:12:42.000000', u'disk_format': u'qcow2', u'id': u'40801b73-f9cf-424e-a0a2-b78b0501d7d7'} rescue=None block_device_info={'block_d evice_mapping': [], 'root_device_name': u'/dev/vda', 'ephemerals': [], 'swap': None} _get_guest_xml /usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py:4169

/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py:4169

47 2015-11-18 15:16:07.540 4330 DEBUG nova.virt.libvirt.vif [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] vif_type=binding_failed instance=Instance(access_ip_v4=None,access_ip_v6=None,architectu        re=None,auto_disk_config=True,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2015-11-18T20:16:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=Fal        se,deleted_at=None,disable_terminate=False,display_description='xx',display_name='xx',ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(2),host='compute2.nueos',hostname='xx',id=81,imag        e_ref='40801b73-f9cf-424e-a0a2-b78b0501d7d7',info_cache=InstanceInfoCache,instance_type_id=2,kernel_id='',key_data=None,key_name=None,launch_index=0,launched_at=None,launched_on='compute2.nueos',loc        ked=False,locked_by=None,memory_mb=512,metadata={},new_flavor=None,node='compute2.nueos',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,po        wer_state=0,progress=0,project_id='49a02b7bf2bb41d0996e5e2675b03d8b',ramdisk_id='',reservation_id='r-vntcrctq',root_device_name='/dev/vda',root_gb=1,scheduled_at=None,security_groups=SecurityGroupLi        st,shutdown_terminate=False,system_metadata={image_base_image_ref='40801b73-f9cf-424e-a0a2-b78b0501d7d7',image_container_format='bare',image_disk_format='qcow2',image_min_disk='1',image_min_ram='0',        network_allocated='True'},tags=<?>,task_state='spawning',terminated_at=None,updated_at=2015-11-18T20:16:05Z,user_data=None,user_id='c57621aee095478d950e87ff9d790d84',uuid=9cecb6f2-cbfd-4c2c-9bbf-9fc        f987cb197,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif=VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete': False, 'network': Network({'bridge': None, 'subnets        ': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes':         [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8        b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e        :59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9



2015-11-18 15:16:01.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.Service object at 0x4747590>> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
2015-11-18 15:16:02.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
2015-11-18 15:16:02.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.Service object at 0x4747590>> sleeping for 19.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
2015-11-18 15:16:03.649 4330 DEBUG oslo_concurrency.lockutils [-] Lock "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" acquired by "_locked_do_build_and_run_instance" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444
2015-11-18 15:16:03.685 4330 INFO nova.compute.manager [req-88ccf1cb-83ba-41dd-baff-00991577ea99 c57621aee095478d950e87ff9d790d84 49a02b7bf2bb41d0996e5e2675b03d8b - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Starting instance...
2015-11-18 15:16:03.923 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" acquired by "instance_claim" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444
2015-11-18 15:16:03.923 4330 DEBUG nova.compute.resource_tracker [-] Memory overhead for 512 MB instance; 0 MB instance_claim /usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py:129
2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Attempting claim: memory 512 MB, disk 1 GB
2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Total memory: 96506 MB, used: 512.00 MB
2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] memory limit: 144759.00 MB, free: 144247.00 MB
2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Total disk: 49 GB, used: 0.00 GB
2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] disk limit not specified, defaulting to unlimited
2015-11-18 15:16:03.972 4330 DEBUG nova.compute.resources.vcpu [-] Total CPUs: 24 VCPUs, used: 0.00 VCPUs test /usr/lib/python2.7/site-packages/nova/compute/resources/vcpu.py:52
2015-11-18 15:16:03.972 4330 DEBUG nova.compute.resources.vcpu [-] CPUs limit not specified, defaulting to unlimited test /usr/lib/python2.7/site-packages/nova/compute/resources/vcpu.py:56
2015-11-18 15:16:03.972 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Claim successful
2015-11-18 15:16:04.223 4330 INFO nova.scheduler.client.report [-] Compute_service record updated for ('compute2.nueos', 'compute2.nueos')
2015-11-18 15:16:04.223 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" released by "instance_claim" :: held 0.300s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456
2015-11-18 15:16:04.468 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" acquired by "update_usage" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444
2015-11-18 15:16:04.553 4330 INFO nova.scheduler.client.report [-] Compute_service record updated for ('compute2.nueos', 'compute2.nueos')
2015-11-18 15:16:04.554 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" released by "update_usage" :: held 0.086s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456
2015-11-18 15:16:04.555 4330 DEBUG nova.compute.manager [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Allocating IP information in the background. _allocate_network_async /usr/lib/python2.7/site-packages/nova/compute/manager.py:1754






2015-11-18 15:16:04.555 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/extensions.json -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
2015-11-18 15:16:04.565 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:04 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 4591 x-openstack-request-id: req-8a400003-40b1-49e3-a38f-61ea79507d55
RESP BODY:
{"extensions":
[

{"updated": "2012-10-05T10:00:00-00:00", "name": "security-group", "links": [], "namespace": "http://docs.openstack.org/ext/securitygroups/api/v2.0", "alias": "security-group", "description": "The security groups extension."},
{"updated": "2013-02-07T10:00:00-00:00", "name": "L3 Agent Scheduler", "links": [], "namespace": "http://docs.openstack.org/ext/l3_agent_scheduler/api/v1.0", "alias": "l3_agent_scheduler", "description": "Schedule routers among l3 agents"},
{"updated": "2015-03-25T10:00:00-00:00", "name": "Network MTU", "links": [], "namespace": "http://docs.openstack.org/ext/net_mtu/api/v1.0", "alias": "net-mtu", "description": "Provides MTU attribute for a network resource."},
{"updated": "2013-03-28T10:00:00-00:00", "name": "Neutron L3 Configurable external gateway mode", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/ext-gw-mode/api/v1.0", "alias": "ext-gw-mode", "description": "Extension of the router abstraction for specifying whether SNAT should occur on the external gateway"},
{"updated": "2014-02-03T10:00:00-00:00", "name": "Port Binding", "links": [], "namespace": "http://docs.openstack.org/ext/binding/api/v1.0", "alias": "binding", "description": "Expose port bindings of a virtual port to external application"},
{"updated": "2012-09-07T10:00:00-00:00", "name": "Provider Network", "links": [], "namespace": "http://docs.openstack.org/ext/provider/api/v1.0", "alias": "provider", "description": "Expose mapping of virtual networks to physical networks"},
{"updated": "2013-02-03T10:00:00-00:00", "name": "agent", "links": [], "namespace": "http://docs.openstack.org/ext/agent/api/v2.0", "alias": "agent", "description": "The agent management extension."},
{"updated": "2012-07-29T10:00:00-00:00", "name": "Quota management support", "links": [], "namespace": "http://docs.openstack.org/network/ext/quotas-sets/api/v2.0", "alias": "quotas", "description": "Expose functions for quotas management per tenant"},
{"updated": "2015-03-30T10:00:00-00:00", "name": "Subnet Allocation", "links": [], "namespace": "http://docs.openstack.org/ext/subnet_allocation/api/v1.0", "alias": "subnet_allocation", "description": "Enables allocation of subnets from a subnet pool"},
{"updated": "2013-02-07T10:00:00-00:00", "name": "DHCP Agent Scheduler", "links": [], "namespace": "http://docs.openstack.org/ext/dhcp_agent_scheduler/api/v1.0", "alias": "dhcp_agent_scheduler", "description": "Schedule networks among dhcp agents"},
{"updated": "2014-04-26T00:00:00-00:00", "name": "HA Router extension", "links": [], "namespace": "", "alias": "l3-ha", "description": "Add HA capability to routers."},
{"updated": "2013-06-27T10:00:00-00:00", "name": "Multi Provider Network", "links": [], "namespace": "http://docs.openstack.org/ext/multi-provider/api/v1.0", "alias": "multi-provider", "description": "Expose mapping of virtual networks to multiple physical networks"},
{"updated": "2013-01-14T10:00:00-00:00", "name": "Neutron external network", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/external_net/api/v1.0", "alias": "external-net", "description": "Adds external network attribute to network resource."},
{"updated": "2012-07-20T10:00:00-00:00", "name": "Neutron L3 Router", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/router/api/v1.0", "alias": "router", "description": "Router abs        traction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway."},
     43 {"updated": "2013-07-23T10:00:00-00:00", "name": "Allowed Address Pairs", "links": [], "namespace": "http://docs.openstack.org/ext/allowedaddresspairs/api/v2.0", "alias": "allowed-address-pairs", "d        escription": "Provides allowed address pairs"},
     44 {"updated": "2013-02-01T10:00:00-00:00", "name": "Neutron Extra Route", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/extraroutes/api/v1.0", "alias": "extraroute", "description":         "Extra routes configuration for L3 router"},
     45 {"updated": "2013-03-17T12:00:00-00:00", "name": "Neutron Extra DHCP opts", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/extra_dhcp_opt/api/v1.0", "alias": "extra_dhcp_opt", "des        cription": "Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)"},
     46 
     47 {"updated": "2014-06-1T10:00:00-00:00", "name": "Distributed Virtual Router", "links": [], "namespace": "http://docs.openstack.org/ext/dvr/api/v1.0", "alias": "dvr", "description": "Enables configur        ation of Distributed Virtual Routers."}]}
     48  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224




     49 2015-11-18 15:16:04.566 4330 DEBUG oslo_concurrency.lockutils [-] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:391
     50 2015-11-18 15:16:04.566 4330 DEBUG oslo_concurrency.lockutils [-] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:404
     51 2015-11-18 15:16:04.566 4330 DEBUG nova.network.neutronv2.api [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] allocate_for_instance() allocate_for_instance /usr/lib/python2.7/site-packages/nova        /network/neutronv2/api.py:414





     52 2015-11-18 15:16:04.566 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/networks.json?id=958d7c44-66ba-4ab0-8061-ede751a6b8f9 -H "User-Agent: python-neutronc        lient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
     53 2015-11-18 15:16:04.601 4330 DEBUG nova.block_device [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] block_device_list [] volume_in_mapping /usr/lib/python2.7/site-packages/nova/block_device.py        :565
     54 2015-11-18 15:16:04.610 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:04 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 379         x-openstack-request-id: req-b526c453-c4b6-42bc-87af-462c645b1347
     55 

     56 RESP BODY:
     57 {"networks":
     58 [{"status": "ACTIVE", "subnets": ["4e98d6cb-5154-4ebc-90d6-0a059e5e7306"], "name": "demo-net", "provider:physical_network": null, "router:external": false, "tenant_id": "49a02b7bf2bb41d0996e5e2675b0        3d8b", "admin_state_up": true, "mtu": 0, "shared": false, "provider:network_type": "gre", "id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "provider:segmentation_id": 1}]}
     60  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224




       2015-11-18 15:16:04.611 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/security-groups.json?tenant_id=49a02b7bf2bb41d0996e5e2675b03d8b -H "User-Agent: pytho        n-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
     62 2015-11-18 15:16:04.648 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:04 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 155        0 x-openstack-request-id: req-959b8a5d-4fa1-4d5e-8f19-36f00bc42308
2015-11-18 15:16:04.648 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:04 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 155        0 x-openstack-request-id: req-959b8a5d-4fa1-4d5e-8f19-36f00bc42308
     63 
     64 
     65 RESP BODY:
     66 {"security_groups": [
     67 {"tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "description": "Default security group", "id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb", i
     68 "security_group_rules":
     69 [{"remote_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb", "direction": "ingress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv6", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b",         "port_range_max": null, "port_range_min": null, "id": "10694d01-9d52-4394-945e-10b89cf5207b", "security_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb"},
     70 {"remote_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb", "direction": "ingress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv4", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b",         "port_range_max": null, "port_range_min": null, "id": "50450e55-83a1-416e-b4df-9a07c9593a7c", "security_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb"},
     71 {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv4", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "port_range_max": null, "port_range        _min": null, "id": "6e34bdd3-a7e2-47b8-9367-b0274f30b226", "security_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb"},
     72 {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv6", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "port_range_max": null, "port_range        _min": null, "id": "790a57da-28ea-40d1-bdc5-d9f7ea5a6364", "security_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb"}], "name": "default"}]}
     73  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224
     74 




     75 2015-11-18 15:16:04.648 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X POST http://controller:9696/v2.0/ports.json -H "User-Agent: python-neutronclient" -H "Content-Type: application/json"         -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" -d
     76 
     77 '{"port": {"binding:host_id": "compute2.nueos", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "device_owner": "comput        e:nova", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "device_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197"}}'
     78 _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195



     79 
     80 2015-11-18 15:16:05.056 4330 DEBUG nova.block_device [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] block_device_list [] volume_in_mapping /usr/lib/python2.7/site-packages/nova/block_device.py        :565
     81 2015-11-18 15:16:05.056 4330 INFO nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Creating image
     82 2015-11-18 15:16:05.057 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "/var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk.info" acqui        red by "write_to_disk_info_file" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444
     83 2015-11-18 15:16:05.057 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "/var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk.info" relea        sed by "write_to_disk_info_file" :: held 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456

   sed by "write_to_disk_info_file" :: held 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456
     84 2015-11-18 15:16:05.058 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instan        ces/_base/373ec6135cab5e510858923b4f2b1b24e193099d execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199
     85 2015-11-18 15:16:05.079 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/373ec6135ca        b5e510858923b4f2b1b24e193099d" returned: 0 in 0.021s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225
     86 2015-11-18 15:16:05.080 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Acquired file lock "/var/lib/nova/instances/locks/nova-373ec6135cab5e510858923b4f2b        1b24e193099d" after waiting 0.000s acquire /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:212
     87 2015-11-18 15:16:05.080 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "373ec6135cab5e510858923b4f2b1b24e193099d" acquired by "copy_qcow2_image" :: w        aited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444
     88 2015-11-18 15:16:05.080 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instan        ces/_base/373ec6135cab5e510858923b4f2b1b24e193099d execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199
     89 2015-11-18 15:16:05.098 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/373ec6135ca        b5e510858923b4f2b1b24e193099d" returned: 0 in 0.018s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225
     90 2015-11-18 15:16:05.099 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/var/lib/nova        /instances/_base/373ec6135cab5e510858923b4f2b1b24e193099d /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:        199
     91 2015-11-18 15:16:05.120 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "qemu-img create -f qcow2 -o backing_file=/var/lib/nova/instances/_base/373e        c6135cab5e510858923b4f2b1b24e193099d /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk" returned: 0 in 0.021s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.p        y:225
     92 2015-11-18 15:16:05.120 4330 DEBUG nova.virt.disk.api [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Checking if we can resize image /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb19        7/disk. size=1073741824 can_resize_image /usr/lib/python2.7/site-packages/nova/virt/disk/api.py:213
     93 2015-11-18 15:16:05.121 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instan        ces/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199
     94 2015-11-18 15:16:05.139 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/9cecb6f2-cbfd-4c2        c-9bbf-9fcf987cb197/disk" returned: 0 in 0.019s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225
     95 2015-11-18 15:16:05.140 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): qemu-img resize /var/lib/nova/instances/9cecb6f2-cbfd-        4c2c-9bbf-9fcf987cb197/disk 1073741824 execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199
     96 2015-11-18 15:16:05.160 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "qemu-img resize /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb19        7/disk 1073741824" returned: 0 in 0.021s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225
     97 2015-11-18 15:16:05.161 4330 DEBUG nova.virt.disk.api [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Checking if we can extend filesystem inside /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf        -9fcf987cb197/disk. CoW=True is_image_extendable /usr/lib/python2.7/site-packages/nova/virt/disk/api.py:227
     98 2015-11-18 15:16:05.161 4330 DEBUG nova.virt.disk.vfs.api [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Instance for image imgfile=/var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197        /disk imgfmt=qcow2 partition=None instance_for_image /usr/lib/python2.7/site-packages/nova/virt/disk/vfs/api.py:46
99 2015-11-18 15:16:05.161 4330 DEBUG nova.virt.disk.vfs.api [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Using primary VFSGuestFS instance_for_image /usr/lib/python2.7/site-packages/nova/virt/        disk/vfs/api.py:50
    100 2015-11-18 15:16:05.162 4330 DEBUG nova.virt.disk.vfs.guestfs [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Setting up appliance for /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb1        97/disk qcow2 setup /usr/lib/python2.7/site-packages/nova/virt/disk/vfs/guestfs.py:169
    101 2015-11-18 15:16:05.387 4330 DEBUG keystoneclient.session [-] RESP: [201] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 703         x-openstack-request-id: req-0b9508b4-6cc0-47fc-817c-2aac5cf9c529
    102 
    103 RESP BODY:
    104 {"port": {"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips": [{"subnet_id"        : "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "device_id": "9ce        cb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details":         {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}}
    106  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224

    107 2015-11-18 15:16:05.391 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?tenant_id=49a02b7bf2bb41d0996e5e2675b03d8b&device_id=9cecb6f2-cbfd-4c2c-9b        bf-9fcf987cb197 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-packag        es/keystoneclient/session.py:195
    108 2015-11-18 15:16:05.439 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 706         x-openstack-request-id: req-7324c594-b3bc-42f6-9dea-d88fe8957241
    109 
    110 RESP BODY: {"ports": [{"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips":         [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "dev        ice_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:v        if_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}]}
    111  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224
    112 



    113 2015-11-18 15:16:05.440 4330 DEBUG nova.network.neutronv2.api [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Instance cache missing network info. _get_preexisting_port_ids /usr/lib/python2.7/s        ite-packages/nova/network/neutronv2/api.py:1487
    114 2015-11-18 15:16:05.440 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/floatingips.json?fixed_ip_address=192.168.1.18&port_id=1f864632-fc6f-41e9-a951-971bd4        c5820e -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-packages/keysto        neclient/session.py:195
    115 2015-11-18 15:16:05.453 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 19         x-openstack-request-id: req-f7f2161e-f0a2-4390-ae65-6f0945604966
116 RESP BODY: {"floatingips": []}
    117  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224





    118 2015-11-18 15:16:05.453 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/subnets.json?id=4e98d6cb-5154-4ebc-90d6-0a059e5e7306 -H "User-Agent: python-neutroncl        ient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
    119 2015-11-18 15:16:05.476 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 466         x-openstack-request-id: req-218b0ead-8e56-48f7-975c-e394a7b8adc3
    120 RESP BODY: {"subnets": [{"name": "demo-subnet", "enable_dhcp": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "dns_nameservers": [], "ga        teway_ip": "192.168.1.1", "ipv6_ra_mode": null, "allocation_pools": [{"start": "192.168.1.2", "end": "192.168.1.254"}], "host_routes": [], "ip_version": 4, "ipv6_address_mode": null, "cidr": "192.16        8.1.0/24", "id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "subnetpool_id": null}]}
    121  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224




    122 2015-11-18 15:16:05.477 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?network_id=958d7c44-66ba-4ab0-8061-ede751a6b8f9&device_owner=network%3Adhc        p -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystonecli        ent/session.py:195
    123 2015-11-18 15:16:05.519 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 147        5 x-openstack-request-id: req-4cd24998-d2cd-426e-8816-276ff3289000

    124 RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "network2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips"        : [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.15"}], "id": "559372d5-5596-489b-9f84-6d8af30e5d76", "security_groups": [], "device_id": "dhcpfbb8622d-31c3-51ab-966        1-955e31f4fec6-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "bind        ing:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:b8:a8:c0"}, {"status": "ACTIVE", "binding:host_id        ": "network.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip        _address": "192.168.1.2"}], "id": "c857c298-0251-42a0-971b-7b20b66f2d8f", "security_groups": [], "device_id": "dhcp7b60c1d9-602e-5110-8c89-a9475b89732c-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name":         "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details": {"port_filter": true, "ovs_hybrid_plug": tr        ue}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:78:c0:0c"}]}
    125  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224







 126 2015-11-18 15:16:05.520 4330 DEBUG nova.network.base_api [-] Updating cache with info: [VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete': False, 'network': Network({'bridge': None,         'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], '        routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2        675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params': None, 'meta': {}, 'details': {}, 'address': u'        fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})] update_instance_cache_with_nw_info /usr/lib/python2.7/site-packag        es/nova/network/base_api.py:42
    127 2015-11-18 15:16:05.601 4330 DEBUG oslo_concurrency.lockutils [-] Releasing semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lock        utils.py:404




    128 2015-11-18 15:16:05.602 4330 DEBUG nova.compute.manager [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Instance network_info: |[VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete        ': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta':         {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected':         False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params':         None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})]| _allocate_network_        async /usr/lib/python2.7/site-packages/nova/compute/manager.py:1772




    129 2015-11-18 15:16:05.820 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" acquired by "update_usage" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockuti        ls.py:444
    130 2015-11-18 15:16:05.912 4330 INFO nova.scheduler.client.report [-] Compute_service record updated for ('compute2.nueos', 'compute2.nueos')
    131 2015-11-18 15:16:05.912 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" released by "update_usage" :: held 0.093s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils        .py:456
    132 2015-11-18 15:16:07.346 4330 DEBUG nova.virt.disk.vfs.guestfs [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Tearing down appliance teardown /usr/lib/python2.7/site-packages/nova/virt/disk/vfs        /guestfs.py:221
    133 2015-11-18 15:16:07.374 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Releasing file lock "/var/lib/nova/instances/locks/nova-373ec6135cab5e510858923b4f2        b1b24e193099d" after holding it for 2.295s release /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:227
    134 2015-11-18 15:16:07.375 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "373ec6135cab5e510858923b4f2b1b24e193099d" released by "copy_qcow2_image" :: h        eld 2.295s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456
    135 2015-11-18 15:16:07.375 4330 DEBUG nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Start _get_guest_xml network_info=[V        IF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating        _ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type':         'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devn        ame': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e        9-a951-971bd4c5820e', 'qbg_params': None})] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk': {'bus': 'virtio', 'boot_index': '1', 'type': 'disk', 'dev': u'vda'}, 'root': {'bu        s': 'virtio', 'boot_index': '1', 'type': 'disk', 'dev': u'vda'}}} image_meta={u'status': u'active', u'deleted': False, u'container_format': u'bare', u'min_ram': 0, u'updated_at': u'2015-11-10T20:12:        43.000000', u'min_disk': 0, u'owner': u'b53c28a8b0e445a0a9eb5b02dfb89649', u'is_public': True, u'deleted_at': None, u'properties': {}, u'size': 13287936, u'name': u'cirros-0.3.4-x86_64', u'checksum'        : u'ee1eca47dc88f4879d8a229cc70a07c6', u'created_at': u'2015-11-10T20:12:42.000000', u'disk_format': u'qcow2', u'id': u'40801b73-f9cf-424e-a0a2-b78b0501d7d7'} rescue=None block_device_info={'block_d        evice_mapping': [], 'root_device_name': u'/dev/vda', 'ephemerals': [], 'swap': None} _get_guest_xml /usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py:4169



******************************************************************@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@************************************************
 2015-11-18 15:16:07.376 4330 DEBUG nova.objects.instance [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lazy-loading `pci_devices' on Instance uuid 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 obj_loa        d_attr /usr/lib/python2.7/site-packages/nova/objects/instance.py:983
    137 2015-11-18 15:16:07.515 4330 DEBUG nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CPU mode 'host-model' model '' was chosen _get_guest_cpu_model_config /usr/lib/python        2.7/site-packages/nova/virt/libvirt/driver.py:3065
    138 2015-11-18 15:16:07.516 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Getting desirable topologies for flavor Flavor(created_at=None,deleted=False,deleted_at=Non        e,disabled=False,ephemeral_gb=0,extra_specs={},flavorid='1',id=2,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and         image_meta {u'status': u'active', u'deleted': False, u'container_format': u'bare', u'min_ram': 0, u'updated_at': u'2015-11-10T20:12:43.000000', u'min_disk': 0, u'owner': u'b53c28a8b0e445a0a9eb5b02df        b89649', u'is_public': True, u'deleted_at': None, u'properties': {}, u'size': 13287936, u'name': u'cirros-0.3.4-x86_64', u'checksum': u'ee1eca47dc88f4879d8a229cc70a07c6', u'created_at': u'2015-11-10        T20:12:42.000000', u'disk_format': u'qcow2', u'id': u'40801b73-f9cf-424e-a0a2-b78b0501d7d7'} _get_desirable_cpu_topologies /usr/lib/python2.7/site-packages/nova/virt/hardware.py:552
    139 2015-11-18 15:16:07.516 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Flavor limits 65536:65536:65536 _get_cpu_topology_constraints /usr/lib/python2.7/site-packa        ges/nova/virt/hardware.py:309
    140 2015-11-18 15:16:07.516 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Image limits 65536:65536:65536 _get_cpu_topology_constraints /usr/lib/python2.7/site-packag        es/nova/virt/hardware.py:322
    141 2015-11-18 15:16:07.516 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Flavor pref -1:-1:-1 _get_cpu_topology_constraints /usr/lib/python2.7/site-packages/nova/vi        rt/hardware.py:345
    142 2015-11-18 15:16:07.517 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Image pref -1:-1:-1 _get_cpu_topology_constraints /usr/lib/python2.7/site-packages/nova/vir        t/hardware.py:367
    143 2015-11-18 15:16:07.517 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Chosen -1:-1:-1 limits 65536:65536:65536 _get_cpu_topology_constraints /usr/lib/python2.7/s        ite-packages/nova/virt/hardware.py:396
    144 2015-11-18 15:16:07.517 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Build topologies for 1 vcpu(s) 1:1:1 _get_possible_cpu_topologies /usr/lib/python2.7/site-p        ackages/nova/virt/hardware.py:440
    145 2015-11-18 15:16:07.517 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Got 1 possible topologies _get_possible_cpu_topologies /usr/lib/python2.7/site-packages/nov        a/virt/hardware.py:475
    146 2015-11-18 15:16:07.517 4330 DEBUG nova.objects.instance [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lazy-loading `vcpu_model' on Instance uuid 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 obj_load        _attr /usr/lib/python2.7/site-packages/nova/objects/instance.py:983
147 2015-11-18 15:16:07.540 4330 DEBUG nova.virt.libvirt.vif [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] vif_type=binding_failed instance=Instance(access_ip_v4=None,access_ip_v6=None,architectu        re=None,auto_disk_config=True,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2015-11-18T20:16:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=Fal        se,deleted_at=None,disable_terminate=False,display_description='xx',display_name='xx',ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(2),host='compute2.nueos',hostname='xx',id=81,imag        e_ref='40801b73-f9cf-424e-a0a2-b78b0501d7d7',info_cache=InstanceInfoCache,instance_type_id=2,kernel_id='',key_data=None,key_name=None,launch_index=0,launched_at=None,launched_on='compute2.nueos',loc        ked=False,locked_by=None,memory_mb=512,metadata={},new_flavor=None,node='compute2.nueos',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,po        wer_state=0,progress=0,project_id='49a02b7bf2bb41d0996e5e2675b03d8b',ramdisk_id='',reservation_id='r-vntcrctq',root_device_name='/dev/vda',root_gb=1,scheduled_at=None,security_groups=SecurityGroupLi        st,shutdown_terminate=False,system_metadata={image_base_image_ref='40801b73-f9cf-424e-a0a2-b78b0501d7d7',image_container_format='bare',image_disk_format='qcow2',image_min_disk='1',image_min_ram='0',        network_allocated='True'},tags=<?>,task_state='spawning',terminated_at=None,updated_at=2015-11-18T20:16:05Z,user_data=None,user_id='c57621aee095478d950e87ff9d790d84',uuid=9cecb6f2-cbfd-4c2c-9bbf-9fc        f987cb197,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif=VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete': False, 'network': Network({'bridge': None, 'subnets        ': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes':         [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8        b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e        :59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None}) virt_typeqemu get_config /usr/lib/python2.7/site-packages/nova/virt/libvir        t/vif.py:364
******************************************************************@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@************************************************






    148 2015-11-18 15:16:07.541 4330 ERROR nova.compute.manager [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Instance failed to spawn
    149 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Traceback (most recent call last):
    150 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2442, in _build_resou        rces
    151 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]     yield resources
    152 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2314, in _build_and_r        un_instance
    153 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]     block_device_info=block_device_info)
    154 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2351, in spawn
    155 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]     write_to_disk=True)
    156 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4172, in _get_gue        st_xml
    157 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]     context)
    158 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4043, in _get_gue        st_config
    159 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]     flavor, virt_type)
    160 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/vif.py", line 374, in get_config
    161 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]     _("Unexpected vif_type=%s") % vif_type)
    162 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] NovaException: Unexpected vif_type=binding_failed
    163 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]
164 2015-11-18 15:16:07.542 4330 INFO nova.compute.manager [req-88ccf1cb-83ba-41dd-baff-00991577ea99 c57621aee095478d950e87ff9d790d84 49a02b7bf2bb41d0996e5e2675b03d8b - - -] [instance: 9cecb6f2-cbfd-4c2        c-9bbf-9fcf987cb197] Terminating instance
    165 2015-11-18 15:16:07.545 4330 INFO nova.virt.libvirt.driver [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] During wait destroy, instance disappeared.
    166 2015-11-18 15:16:07.545 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): mv /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fc        f987cb197 /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197_del execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199
    167 2015-11-18 15:16:07.556 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "mv /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 /var/lib/no        va/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197_del" returned: 0 in 0.011s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225
    168 2015-11-18 15:16:07.556 4330 INFO nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Deleting instance files /var/lib/nova        /instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197_del
    169 2015-11-18 15:16:07.557 4330 INFO nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Deletion of /var/lib/nova/instances/9        cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197_del complete
    170 2015-11-18 15:16:07.883 4330 DEBUG nova.compute.claims [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Aborting claim: [Claim: 512 MB memory, 1         GB disk] abort /usr/lib/python2.7/site-packages/nova/compute/claims.py:130
    171 2015-11-18 15:16:07.884 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "compute_resources" acquired by "abort_instance_claim" :: waited 0.000s inner         /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444
    172 2015-11-18 15:16:07.940 4330 INFO nova.scheduler.client.report [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Compute_service record updated for ('compute2.nueos', 'compute2.nueos')
    173 2015-11-18 15:16:07.940 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "compute_resources" released by "abort_instance_claim" :: held 0.056s inner /u        sr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456
    174 2015-11-18 15:16:07.940 4330 DEBUG nova.compute.utils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Unexpected vif_type=binding_failed notify_        about_instance_usage /usr/lib/python2.7/site-packages/nova/compute/utils.py:310
    175 2015-11-18 15:16:07.941 4330 DEBUG nova.compute.manager [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Build of instance 9cecb6f2-cbfd-4c2c-9bb        f-9fcf987cb197 was re-scheduled: Unexpected vif_type=binding_failed _do_build_and_run_instance /usr/lib/python2.7/site-packages/nova/compute/manager.py:2233
    176 2015-11-18 15:16:08.301 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" released by "_locked_do_build_and_run_i        nstance" :: held 4.651s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456
    177 2015-11-18 15:16:21.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodi        c_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    178 2015-11-18 15:16:21.363 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.S        ervice object at 0x4747590>> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    179 2015-11-18 15:16:22.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodi        c_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    180 2015-11-18 15:16:22.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.S        ervice object at 0x4747590>> sleeping for 2.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
@                                                                                                                                                                     ervice object at 0x4747590>> sleeping for 2.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    181 2015-11-18 15:16:24.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_        tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    182 2015-11-18 15:16:24.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes /usr/lib/python2        .7/site-packages/nova/compute/manager.py:6197
    183 2015-11-18 15:16:24.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.S        ervice object at 0x4747590>> sleeping for 15.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    184 2015-11-18 15:16:39.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodi        c_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    185 2015-11-18 15:16:39.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Starting heal instance info cache _heal_instance_info_cache /usr/lib/python2.7/site-packa        ges/nova/compute/manager.py:5537
    186 2015-11-18 15:16:39.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Rebuilding the list of instances to heal _heal_instance_info_cache /usr/lib/python2.7/sit        e-packages/nova/compute/manager.py:5541
    187 2015-11-18 15:16:39.418 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr/l        ib/python2.7/site-packages/oslo_concurrency/lockutils.py:391
    188 2015-11-18 15:16:39.419 4330 DEBUG nova.network.neutronv2.api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] _get_instance_nw_info() _get_insta        nce_nw_info /usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py:760
    189 2015-11-18 15:16:39.419 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac        kages/oslo_concurrency/lockutils.py:391
    190 2015-11-18 15:16:39.419 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:404


******************************************************************@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@************************************************


    191 2015-11-18 15:16:39.420 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?tenant_id=49a02b7bf2bb41d        0996e5e2675b03d8b&device_id=9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326"         _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
    192 2015-11-18 15:16:39.468 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap        plication/json; charset=UTF-8 content-length: 706 x-openstack-request-id: req-9a10078d-bb25-4fc1-828b-b4067b057ff0
    193 RESP BODY: {"ports": [{"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips":         [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "dev        ice_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:v        if_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}]}
    194  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224
******************************************************************@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@************************************************


 196 2015-11-18 15:16:39.592 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac        kages/oslo_concurrency/lockutils.py:391
    197 2015-11-18 15:16:39.592 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:404



    198 2015-11-18 15:16:39.592 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/networks.json?id=958d7c44-66ba-4ab0-        8061-ede751a6b8f9 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pack        ages/keystoneclient/session.py:195
    199 2015-11-18 15:16:39.633 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap        plication/json; charset=UTF-8 content-length: 379 x-openstack-request-id: req-0128968c-fd38-4a69-89d3-862bc37929e0
    200 RESP BODY: {"networks": [{"status": "ACTIVE", "subnets": ["4e98d6cb-5154-4ebc-90d6-0a059e5e7306"], "name": "demo-net", "provider:physical_network": null, "router:external": false, "tenant_id": "49a0        2b7bf2bb41d0996e5e2675b03d8b", "admin_state_up": true, "mtu": 0, "shared": false, "provider:network_type": "gre", "id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "provider:segmentation_id": 1}]}
    201  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224



    202 2015-11-18 15:16:39.633 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/floatingips.json?fixed_ip_address=19        2.168.1.18&port_id=1f864632-fc6f-41e9-a951-971bd4c5820e -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_lo        g_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
    203 2015-11-18 15:16:39.646 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap        plication/json; charset=UTF-8 content-length: 19 x-openstack-request-id: req-1bf8c291-a59f-4ac3-83bc-447e8f8a49f9
    204 RESP BODY: {"floatingips": []}
    205  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224
    206 2015-11-18 15:16:39.646 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac        kages/oslo_concurrency/lockutils.py:391
    207 2015-11-18 15:16:39.646 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:404



    208 2015-11-18 15:16:39.647 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/subnets.json?id=4e98d6cb-5154-4ebc-9        0d6-0a059e5e7306 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-packa        ges/keystoneclient/session.py:195
    209 2015-11-18 15:16:39.670 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap        plication/json; charset=UTF-8 content-length: 466 x-openstack-request-id: req-5ce24c66-9a73-465c-aa0c-984434883975
    210 RESP BODY: {"subnets": [{"name": "demo-subnet", "enable_dhcp": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "dns_nameservers": [], "ga        teway_ip": "192.168.1.1", "ipv6_ra_mode": null, "allocation_pools": [{"start": "192.168.1.2", "end": "192.168.1.254"}], "host_routes": [], "ip_version": 4, "ipv6_address_mode": null, "cidr": "192.16        8.1.0/24", "id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "subnetpool_id": null}]}
    211  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224







    212 2015-11-18 15:16:39.670 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac        kages/oslo_concurrency/lockutils.py:391
213 2015-11-18 15:16:39.671 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:404



    214 2015-11-18 15:16:39.671 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?network_id=958d7c44-66ba-        4ab0-8061-ede751a6b8f9&device_owner=network%3Adhcp -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_req        uest /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
    215 2015-11-18 15:16:39.713 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap        plication/json; charset=UTF-8 content-length: 1475 x-openstack-request-id: req-6ad96980-c71d-4527-b456-32d670e12edf

    216 RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "network2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips"        : [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.15"}], "id": "559372d5-5596-489b-9f84-6d8af30e5d76", "security_groups": [], "device_id": "dhcpfbb8622d-31c3-51ab-966        1-955e31f4fec6-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "bind        ing:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:b8:a8:c0"}, {"status": "ACTIVE", "binding:host_id        ": "network.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip        _address": "192.168.1.2"}], "id": "c857c298-0251-42a0-971b-7b20b66f2d8f", "security_groups": [], "device_id": "dhcp7b60c1d9-602e-5110-8c89-a9475b89732c-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name":         "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details": {"port_filter": true, "ovs_hybrid_plug": tr        ue}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:78:c0:0c"}]}
    217  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224






    218 2015-11-18 15:16:39.714 4330 DEBUG nova.network.base_api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Updating cache with info: [VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_del        ete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'met        a': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injecte        d': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params        ': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})] update_instance_        cache_with_nw_info /usr/lib/python2.7/site-packages/nova/network/base_api.py:42




    219 2015-11-18 15:16:39.736 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr/        lib/python2.7/site-packages/oslo_concurrency/lockutils.py:404
    220 2015-11-18 15:16:39.736 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Updated the network info_cache for insta        nce _heal_instance_info_cache /usr/lib/python2.7/site-packages/nova/compute/manager.py:5598
221 2015-11-18 15:16:39.736 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.S        ervice object at 0x4747590>> sleeping for 17.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    222 2015-11-18 15:16:56.737 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager.update_available_resource run_periodi        c_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    223 2015-11-18 15:16:56.739 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Auditing locally available compute resources for node compute2.nueos
    224 2015-11-18 15:16:56.879 4330 DEBUG nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Hypervisor: free VCPUs: 24 _report_hypervisor_resource_view /usr/lib/python2.7/s        ite-packages/nova/compute/resource_tracker.py:518
    225 2015-11-18 15:17:40.486 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:404




    226 2015-11-18 15:17:40.487 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?tenant_id=49a02b7bf2bb41d        0996e5e2675b03d8b&device_id=9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326"         _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195


******************************************************************@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@************************************************
    227 2015-11-18 15:17:40.529 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: ap        plication/json; charset=UTF-8 content-length: 706 x-openstack-request-id: req-49f8a397-14af-4aae-b3be-5ae25ea4e348
    228 RESP BODY: {"ports": [{"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips":         [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "dev        ice_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:v        if_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}]}
    229  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224
******************************************************************@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@************************************************



    230 2015-11-18 15:17:40.529 4330 DEBUG nova.objects.instance [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Lazy-loading `info_cache' on Instance uuid 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 obj_load        _attr /usr/lib/python2.7/site-packages/nova/objects/instance.py:983
    231 2015-11-18 15:17:40.654 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac        kages/oslo_concurrency/lockutils.py:391
    232 2015-11-18 15:17:40.654 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:404
    233 2015-11-18 15:17:40.654 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/networks.json?id=958d7c44-66ba-4ab0-        8061-ede751a6b8f9 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pack        ages/keystoneclient/session.py:195
    234 2015-11-18 15:17:40.702 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: ap        plication/json; charset=UTF-8 content-length: 379 x-openstack-request-id: req-063f2211-d019-486c-9f2a-43d35bac93e4
 238 2015-11-18 15:17:40.715 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: a        pplication/json; charset=UTF-8 content-length: 19 x-openstack-request-id: req-6f80cea6-f6e7-4318-bbb5-bd69f7be5d34
    239 RESP BODY: {"floatingips": []}
    240  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224
    241 2015-11-18 15:17:40.715 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:391
    242 2015-11-18 15:17:40.716 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p        ackages/oslo_concurrency/lockutils.py:404





    243 2015-11-18 15:17:40.716 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/subnets.json?id=4e98d6cb-5154-4ebc-        90d6-0a059e5e7306 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pac        kages/keystoneclient/session.py:195
    244 2015-11-18 15:17:40.839 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: a        pplication/json; charset=UTF-8 content-length: 466 x-openstack-request-id: req-d5b8c7ad-4e65-4522-af93-4e30d53f4f62
    245 RESP BODY: {"subnets": [{"name": "demo-subnet", "enable_dhcp": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "dns_nameservers": [], "g        ateway_ip": "192.168.1.1", "ipv6_ra_mode": null, "allocation_pools": [{"start": "192.168.1.2", "end": "192.168.1.254"}], "host_routes": [], "ip_version": 4, "ipv6_address_mode": null, "cidr": "192.        168.1.0/24", "id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "subnetpool_id": null}]}
    246  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224







    247 2015-11-18 15:17:40.840 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:391
    248 2015-11-18 15:17:40.840 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p        ackages/oslo_concurrency/lockutils.py:404







    249 2015-11-18 15:17:40.840 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?network_id=958d7c44-66ba        -4ab0-8061-ede751a6b8f9&device_owner=network%3Adhcp -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_r        equest /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
    250 2015-11-18 15:17:40.881 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: a        pplication/json; charset=UTF-8 content-length: 1475 x-openstack-request-id: req-61db012d-82fa-415c-84a6-f3181ae7a7a8

    251 RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "network2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips        ": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.15"}], "id": "559372d5-5596-489b-9f84-6d8af30e5d76", "security_groups": [], "device_id": "dhcpfbb8622d-31c3-51ab-9        661-955e31f4fec6-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "b        inding:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:b8:a8:c0"}, {"status": "ACTIVE", "binding:hos        t_id": "network.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306"        , "ip_address": "192.168.1.2"}], "id": "c857c298-0251-42a0-971b-7b20b66f2d8f", "security_groups": [], "device_id": "dhcp7b60c1d9-602e-5110-8c89-a9475b89732c-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "        name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details": {"port_filter": true, "ovs_hybrid_pl        ug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:78:c0:0c"}]}
    252  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224


253 2015-11-18 15:17:40.882 4330 DEBUG nova.network.base_api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Updating cache with info: [VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_de        lete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'm        eta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'inje        cted': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_pa        rams': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})] update_inst        ance_cache_with_nw_info /usr/lib/python2.7/site-packages/nova/network/base_api.py:42
\\
    254 2015-11-18 15:17:40.907 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr        /lib/python2.7/site-packages/oslo_concurrency/lockutils.py:404
    255 2015-11-18 15:17:40.908 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Updated the network info_cache for inst        ance _heal_instance_info_cache /usr/lib/python2.7/site-packages/nova/compute/manager.py:5598
    256 2015-11-18 15:17:40.908 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.        Service object at 0x4747590>> sleeping for 17.94 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    257 2015-11-18 15:17:58.847 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager.update_available_resource run_period        ic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    258 2015-11-18 15:17:58.849 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Auditing locally available compute resources for node compute2.nueos
    259 2015-11-18 15:17:58.983 4330 DEBUG nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Hypervisor: free VCPUs: 24 _report_hypervisor_resource_view /usr/lib/python2.7/        site-packages/nova/compute/resource_tracker.py:518
    260 2015-11-18 15:17:58.983 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Lock "compute_resources" acquired by "_update_available_resource" :: waited 0.000s         inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444
    261 2015-11-18 15:17:59.144 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Total usable vcpus: 24, total allocated vcpus: 0
    262 2015-11-18 15:17:59.144 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Final resource view: name=compute2.nueos phys_ram=96506MB used_ram=1024MB phys_d        isk=49GB used_disk=1GB total_vcpus=24 used_vcpus=0 pci_stats=<nova.pci.stats.PciDeviceStats object at 0x502bc10>
    263 2015-11-18 15:17:59.194 4330 INFO nova.scheduler.client.report [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Compute_service record updated for ('compute2.nueos', 'compute2.nueos')
    264 2015-11-18 15:17:59.195 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Compute_service record updated for compute2.nueos:compute2.nueos
    265 2015-11-18 15:17:59.195 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Lock "compute_resources" released by "_update_available_resource" :: held 0.211s i        nner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456
 266 2015-11-18 15:17:59.225 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.        Service object at 0x4747590>> sleeping for 2.13 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    267 2015-11-18 15:18:01.360 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._check_instance_build_time run_perio        dic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    268 2015-11-18 15:18:01.360 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.        Service object at 0x4747590>> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    269 2015-11-18 15:18:02.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_t        asks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    270 2015-11-18 15:18:02.363 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.        Service object at 0x4747590>> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    271 2015-11-18 15:18:03.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_task        s /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    272 2015-11-18 15:18:03.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic        _tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    273 2015-11-18 15:18:03.363 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.        Service object at 0x4747590>> sleeping for 22.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    274 2015-11-18 15:18:25.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_period        ic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    275 2015-11-18 15:18:25.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_period        ic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    276 2015-11-18 15:18:25.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.        Service object at 0x4747590>> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    277 2015-11-18 15:18:26.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic        _tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219

278 2015-11-18 15:18:26.364 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes /usr/lib/python        2.7/site-packages/nova/compute/manager.py:6197
    279 2015-11-18 15:18:26.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.        Service object at 0x4747590>> sleeping for 15.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    280 2015-11-18 15:18:41.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_period        ic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    281 2015-11-18 15:18:41.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Starting heal instance info cache _heal_instance_info_cache /usr/lib/python2.7/site-pack        ages/nova/compute/manager.py:5537
    282 2015-11-18 15:18:41.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Rebuilding the list of instances to heal _heal_instance_info_cache /usr/lib/python2.7/si        te-packages/nova/compute/manager.py:5541
    283 2015-11-18 15:18:41.419 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr/        lib/python2.7/site-packages/oslo_concurrency/lockutils.py:391
    284 2015-11-18 15:18:41.419 4330 DEBUG nova.network.neutronv2.api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] _get_instance_nw_info() _get_inst        ance_nw_info /usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py:760
    285 2015-11-18 15:18:41.419 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:391
    286 2015-11-18 15:18:41.420 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p        ackages/oslo_concurrency/lockutils.py:404





    287 2015-11-18 15:18:41.420 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?tenant_id=49a02b7bf2bb41        d0996e5e2675b03d8b&device_id=9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd632        6" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
    288 2015-11-18 15:18:41.461 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a        pplication/json; charset=UTF-8 content-length: 706 x-openstack-request-id: req-5512f74c-b7e1-490f-b1b9-c9e1a3e6e20c
    289 RESP BODY: {"ports": [{"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips":         [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "d        evice_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "bindin        g:vif_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}]}
    290  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224



291 2015-11-18 15:18:41.462 4330 DEBUG nova.objects.instance [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Lazy-loading `info_cache' on Instance uuid 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 obj_loa        d_attr /usr/lib/python2.7/site-packages/nova/objects/instance.py:983
    292 2015-11-18 15:18:41.575 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:391
    293 2015-11-18 15:18:41.575 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p        ackages/oslo_concurrency/lockutils.py:404





    294 2015-11-18 15:18:41.575 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/networks.json?id=958d7c44-66ba-4ab0        -8061-ede751a6b8f9 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pa        ckages/keystoneclient/session.py:195
    295 2015-11-18 15:18:41.615 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a        pplication/json; charset=UTF-8 content-length: 379 x-openstack-request-id: req-d0b4da6c-b782-4e80-b074-496fe6ff6da7
    296 RESP BODY: {"networks": [{"status": "ACTIVE", "subnets": ["4e98d6cb-5154-4ebc-90d6-0a059e5e7306"], "name": "demo-net", "provider:physical_network": null, "router:external": false, "tenant_id": "49a        02b7bf2bb41d0996e5e2675b03d8b", "admin_state_up": true, "mtu": 0, "shared": false, "provider:network_type": "gre", "id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "provider:segmentation_id": 1}]}
    297  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224




    298 2015-11-18 15:18:41.615 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/floatingips.json?fixed_ip_address=1        92.168.1.18&port_id=1f864632-fc6f-41e9-a951-971bd4c5820e -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_        log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
    299 2015-11-18 15:18:41.629 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a        pplication/json; charset=UTF-8 content-length: 19 x-openstack-request-id: req-988f2719-50f8-4f27-88bf-61a815f376b2
    300 RESP BODY: {"floatingips": []}


    301  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224
    302 2015-11-18 15:18:41.629 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:391
    303 2015-11-18 15:18:41.630 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p        ackages/oslo_concurrency/lockutils.py:404


    304 2015-11-18 15:18:41.630 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/subnets.json?id=4e98d6cb-5154-4ebc-        90d6-0a059e5e7306 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pac        kages/keystoneclient/session.py:195
    305 2015-11-18 15:18:41.653 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a        pplication/json; charset=UTF-8 content-length: 466 x-openstack-request-id: req-5456567e-def7-487a-a4d8-9a8087ea7411

    306 RESP BODY: {"subnets": [{"name": "demo-subnet", "enable_dhcp": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "dns_nameservers": [], "g        ateway_ip": "192.168.1.1", "ipv6_ra_mode": null, "allocation_pools": [{"start": "192.168.1.2", "end": "192.168.1.254"}], "host_routes": [], "ip_version": 4, "ipv6_address_mode": null, "cidr": "192.        168.1.0/24", "id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "subnetpool_id": null}]}
    307  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224


@                                                                                                                                                                                                            
 308 2015-11-18 15:18:41.653 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:391
    309 2015-11-18 15:18:41.654 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p        ackages/oslo_concurrency/lockutils.py:404


    310 2015-11-18 15:18:41.654 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?network_id=958d7c44-66ba        -4ab0-8061-ede751a6b8f9&device_owner=network%3Adhcp -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_r        equest /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
    311 2015-11-18 15:18:41.701 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a        pplication/json; charset=UTF-8 content-length: 1475 x-openstack-request-id: req-ee6abea5-6acd-4616-924f-eb485de20331


    312 RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "network2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips        ": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.15"}], "id": "559372d5-5596-489b-9f84-6d8af30e5d76", "security_groups": [], "device_id": "dhcpfbb8622d-31c3-51ab-9        661-955e31f4fec6-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "b        inding:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:b8:a8:c0"}, {"status": "ACTIVE", "binding:hos        t_id": "network.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306"        , "ip_address": "192.168.1.2"}], "id": "c857c298-0251-42a0-971b-7b20b66f2d8f", "security_groups": [], "device_id": "dhcp7b60c1d9-602e-5110-8c89-a9475b89732c-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "        name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details": {"port_filter": true, "ovs_hybrid_pl        ug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:78:c0:0c"}]}
    313  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224


    314 2015-11-18 15:18:41.702 4330 DEBUG nova.network.base_api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Updating cache with info: [VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_de        lete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'm        eta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'inje        cted': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_pa        rams': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})] update_inst        ance_cache_with_nw_info /usr/lib/python2.7/site-packages/nova/network/base_api.py:42
    315 2015-11-18 15:18:41.727 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr        /lib/python2.7/site-packages/oslo_concurrency/lockutils.py:404

    316 2015-11-18 15:18:41.727 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Updated the network info_cache for inst        ance _heal_instance_info_cache /usr/lib/python2.7/site-packages/nova/compute/manager.py:5598
    317 2015-11-18 15:18:41.727 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.        Service object at 0x4747590>> sleeping for 18.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
~

binding:VIF_Type : binding_failed

I have a multi-node openstack installation. This is a Highly Available installation, multiple controller nodes and multiple Neutron Network nodes using VRRP (L3HA) with Open vSwitch and ML2 plug-in. All my neutron agents and nova endpoints seem to be in order and up. Launching of an instance keeps failing on my compute node, I have shut all down except one, and I cant find what causes the error, the port binding failure. I have the nova compute in debug mode and have captured the logs. I am including the section only around the instance launch time. I am hoping someone here can point me to the right direction. I have been struggling with this for over a week and have read and checked all postings that were related but none of their possible solutions were applicable to me. I hoping someone here me.

My schedulers show no error. My conductor has an error just saying that the instance can help by looking not be created because of unexpected vif-type and it is to be rescheduled. My neutron openvswitch agents on my network nodes have no errors at the DEBUG trail. time of the launch and they just say the security member got updated. there are some INFO messages about ports not being present on br-int but they appear an hour before I had even launched the instance. My neutron openvswitch agent on the Compute node has similar info as the network nodes

I have tried both kvm and qemu as hypervisor with the same result.

My nova-compute log in Debug mode is attached below. I tried to highlight the errors. everything seems to be in order except when the assigned dhcp ip tries to bind to the vif and I end up with a port status down. It appears to me that the port is marked as down because of the vif bonding failure but I am new to openstack and dont understand the order of events very well.

Thanks in Advance

Highlighted Error

 107 2015-11-18 15:16:05.391 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?tenant_id=49a02b7bf2bb41d0996e5e2675b03d8b&device_id=9cecb6f2-cbfd-4c2c-9b        bf-9fcf987cb197 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-packag        es/keystoneclient/session.py:195
    108 2015-11-18 15:16:05.439 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 706         x-openstack-request-id: req-7324c594-b3bc-42f6-9dea-d88fe8957241
    109 
    110 RESP BODY: {"ports": [{"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips":         [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "dev        ice_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:v        if_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}]}
    111  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224
    112 

135 2015-11-18 15:16:07.375 4330 DEBUG nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Start _get_guest_xml network_info=[V        IF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating        _ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type':         'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devn        ame': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e        9-a951-971bd4c5820e', 'qbg_params': None})] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk': {'bus': 'virtio', 'boot_index': '1', 'type': 'disk', 'dev': u'vda'}, 'root': {'bu        s': 'virtio', 'boot_index': '1', 'type': 'disk', 'dev': u'vda'}}} image_meta={u'status': u'active', u'deleted': False, u'container_format': u'bare', u'min_ram': 0, u'updated_at': u'2015-11-10T20:12:        43.000000', u'min_disk': 0, u'owner': u'b53c28a8b0e445a0a9eb5b02dfb89649', u'is_public': True, u'deleted_at': None, u'properties': {}, u'size': 13287936, u'name': u'cirros-0.3.4-x86_64', u'checksum'        : u'ee1eca47dc88f4879d8a229cc70a07c6', u'created_at': u'2015-11-10T20:12:42.000000', u'disk_format': u'qcow2', u'id': u'40801b73-f9cf-424e-a0a2-b78b0501d7d7'} rescue=None block_device_info={'block_d        evice_mapping': [], 'root_device_name': u'/dev/vda', 'ephemerals': [], 'swap': None} _get_guest_xml /usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py:4169

47 2015-11-18 15:16:07.540 4330 DEBUG nova.virt.libvirt.vif [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] vif_type=binding_failed instance=Instance(access_ip_v4=None,access_ip_v6=None,architectu        re=None,auto_disk_config=True,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2015-11-18T20:16:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=Fal        se,deleted_at=None,disable_terminate=False,display_description='xx',display_name='xx',ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(2),host='compute2.nueos',hostname='xx',id=81,imag        e_ref='40801b73-f9cf-424e-a0a2-b78b0501d7d7',info_cache=InstanceInfoCache,instance_type_id=2,kernel_id='',key_data=None,key_name=None,launch_index=0,launched_at=None,launched_on='compute2.nueos',loc        ked=False,locked_by=None,memory_mb=512,metadata={},new_flavor=None,node='compute2.nueos',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,po        wer_state=0,progress=0,project_id='49a02b7bf2bb41d0996e5e2675b03d8b',ramdisk_id='',reservation_id='r-vntcrctq',root_device_name='/dev/vda',root_gb=1,scheduled_at=None,security_groups=SecurityGroupLi        st,shutdown_terminate=False,system_metadata={image_base_image_ref='40801b73-f9cf-424e-a0a2-b78b0501d7d7',image_container_format='bare',image_disk_format='qcow2',image_min_disk='1',image_min_ram='0',        network_allocated='True'},tags=<?>,task_state='spawning',terminated_at=None,updated_at=2015-11-18T20:16:05Z,user_data=None,user_id='c57621aee095478d950e87ff9d790d84',uuid=9cecb6f2-cbfd-4c2c-9bbf-9fc        f987cb197,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif=VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete': False, 'network': Network({'bridge': None, 'subnets        ': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes':         [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8        b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e        :59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9



2015-11-18 15:16:01.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.Service object at 0x4747590>> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
2015-11-18 15:16:02.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
2015-11-18 15:16:02.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.Service object at 0x4747590>> sleeping for 19.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
2015-11-18 15:16:03.649 4330 DEBUG oslo_concurrency.lockutils [-] Lock "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" acquired by "_locked_do_build_and_run_instance" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444
2015-11-18 15:16:03.685 4330 INFO nova.compute.manager [req-88ccf1cb-83ba-41dd-baff-00991577ea99 c57621aee095478d950e87ff9d790d84 49a02b7bf2bb41d0996e5e2675b03d8b - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Starting instance...
2015-11-18 15:16:03.923 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" acquired by "instance_claim" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444
2015-11-18 15:16:03.923 4330 DEBUG nova.compute.resource_tracker [-] Memory overhead for 512 MB instance; 0 MB instance_claim /usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py:129
2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Attempting claim: memory 512 MB, disk 1 GB
2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Total memory: 96506 MB, used: 512.00 MB
2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] memory limit: 144759.00 MB, free: 144247.00 MB
2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Total disk: 49 GB, used: 0.00 GB
2015-11-18 15:16:03.925 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] disk limit not specified, defaulting to unlimited
2015-11-18 15:16:03.972 4330 DEBUG nova.compute.resources.vcpu [-] Total CPUs: 24 VCPUs, used: 0.00 VCPUs test /usr/lib/python2.7/site-packages/nova/compute/resources/vcpu.py:52
2015-11-18 15:16:03.972 4330 DEBUG nova.compute.resources.vcpu [-] CPUs limit not specified, defaulting to unlimited test /usr/lib/python2.7/site-packages/nova/compute/resources/vcpu.py:56
2015-11-18 15:16:03.972 4330 INFO nova.compute.claims [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Claim successful
2015-11-18 15:16:04.223 4330 INFO nova.scheduler.client.report [-] Compute_service record updated for ('compute2.nueos', 'compute2.nueos')
2015-11-18 15:16:04.223 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" released by "instance_claim" :: held 0.300s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456
2015-11-18 15:16:04.468 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" acquired by "update_usage" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444
2015-11-18 15:16:04.553 4330 INFO nova.scheduler.client.report [-] Compute_service record updated for ('compute2.nueos', 'compute2.nueos')
2015-11-18 15:16:04.554 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" released by "update_usage" :: held 0.086s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456
2015-11-18 15:16:04.555 4330 DEBUG nova.compute.manager [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Allocating IP information in the background. _allocate_network_async /usr/lib/python2.7/site-packages/nova/compute/manager.py:1754






2015-11-18 15:16:04.555 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/extensions.json -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
2015-11-18 15:16:04.565 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:04 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 4591 x-openstack-request-id: req-8a400003-40b1-49e3-a38f-61ea79507d55
RESP BODY:
{"extensions":
[

{"updated": "2012-10-05T10:00:00-00:00", "name": "security-group", "links": [], "namespace": "http://docs.openstack.org/ext/securitygroups/api/v2.0", "alias": "security-group", "description": "The security groups extension."},
{"updated": "2013-02-07T10:00:00-00:00", "name": "L3 Agent Scheduler", "links": [], "namespace": "http://docs.openstack.org/ext/l3_agent_scheduler/api/v1.0", "alias": "l3_agent_scheduler", "description": "Schedule routers among l3 agents"},
{"updated": "2015-03-25T10:00:00-00:00", "name": "Network MTU", "links": [], "namespace": "http://docs.openstack.org/ext/net_mtu/api/v1.0", "alias": "net-mtu", "description": "Provides MTU attribute for a network resource."},
{"updated": "2013-03-28T10:00:00-00:00", "name": "Neutron L3 Configurable external gateway mode", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/ext-gw-mode/api/v1.0", "alias": "ext-gw-mode", "description": "Extension of the router abstraction for specifying whether SNAT should occur on the external gateway"},
{"updated": "2014-02-03T10:00:00-00:00", "name": "Port Binding", "links": [], "namespace": "http://docs.openstack.org/ext/binding/api/v1.0", "alias": "binding", "description": "Expose port bindings of a virtual port to external application"},
{"updated": "2012-09-07T10:00:00-00:00", "name": "Provider Network", "links": [], "namespace": "http://docs.openstack.org/ext/provider/api/v1.0", "alias": "provider", "description": "Expose mapping of virtual networks to physical networks"},
{"updated": "2013-02-03T10:00:00-00:00", "name": "agent", "links": [], "namespace": "http://docs.openstack.org/ext/agent/api/v2.0", "alias": "agent", "description": "The agent management extension."},
{"updated": "2012-07-29T10:00:00-00:00", "name": "Quota management support", "links": [], "namespace": "http://docs.openstack.org/network/ext/quotas-sets/api/v2.0", "alias": "quotas", "description": "Expose functions for quotas management per tenant"},
{"updated": "2015-03-30T10:00:00-00:00", "name": "Subnet Allocation", "links": [], "namespace": "http://docs.openstack.org/ext/subnet_allocation/api/v1.0", "alias": "subnet_allocation", "description": "Enables allocation of subnets from a subnet pool"},
{"updated": "2013-02-07T10:00:00-00:00", "name": "DHCP Agent Scheduler", "links": [], "namespace": "http://docs.openstack.org/ext/dhcp_agent_scheduler/api/v1.0", "alias": "dhcp_agent_scheduler", "description": "Schedule networks among dhcp agents"},
{"updated": "2014-04-26T00:00:00-00:00", "name": "HA Router extension", "links": [], "namespace": "", "alias": "l3-ha", "description": "Add HA capability to routers."},
{"updated": "2013-06-27T10:00:00-00:00", "name": "Multi Provider Network", "links": [], "namespace": "http://docs.openstack.org/ext/multi-provider/api/v1.0", "alias": "multi-provider", "description": "Expose mapping of virtual networks to multiple physical networks"},
{"updated": "2013-01-14T10:00:00-00:00", "name": "Neutron external network", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/external_net/api/v1.0", "alias": "external-net", "description": "Adds external network attribute to network resource."},
{"updated": "2012-07-20T10:00:00-00:00", "name": "Neutron L3 Router", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/router/api/v1.0", "alias": "router", "description": "Router abs        traction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway."},
     43 {"updated": "2013-07-23T10:00:00-00:00", "name": "Allowed Address Pairs", "links": [], "namespace": "http://docs.openstack.org/ext/allowedaddresspairs/api/v2.0", "alias": "allowed-address-pairs", "d        escription": "Provides allowed address pairs"},
     44 {"updated": "2013-02-01T10:00:00-00:00", "name": "Neutron Extra Route", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/extraroutes/api/v1.0", "alias": "extraroute", "description":         "Extra routes configuration for L3 router"},
     45 {"updated": "2013-03-17T12:00:00-00:00", "name": "Neutron Extra DHCP opts", "links": [], "namespace": "http://docs.openstack.org/ext/neutron/extra_dhcp_opt/api/v1.0", "alias": "extra_dhcp_opt", "des        cription": "Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)"},
     46 
     47 {"updated": "2014-06-1T10:00:00-00:00", "name": "Distributed Virtual Router", "links": [], "namespace": "http://docs.openstack.org/ext/dvr/api/v1.0", "alias": "dvr", "description": "Enables configur        ation of Distributed Virtual Routers."}]}
     48  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224




     49 2015-11-18 15:16:04.566 4330 DEBUG oslo_concurrency.lockutils [-] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:391
     50 2015-11-18 15:16:04.566 4330 DEBUG oslo_concurrency.lockutils [-] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:404
     51 2015-11-18 15:16:04.566 4330 DEBUG nova.network.neutronv2.api [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] allocate_for_instance() allocate_for_instance /usr/lib/python2.7/site-packages/nova        /network/neutronv2/api.py:414





     52 2015-11-18 15:16:04.566 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/networks.json?id=958d7c44-66ba-4ab0-8061-ede751a6b8f9 -H "User-Agent: python-neutronc        lient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
     53 2015-11-18 15:16:04.601 4330 DEBUG nova.block_device [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] block_device_list [] volume_in_mapping /usr/lib/python2.7/site-packages/nova/block_device.py        :565
     54 2015-11-18 15:16:04.610 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:04 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 379         x-openstack-request-id: req-b526c453-c4b6-42bc-87af-462c645b1347
     55 

     56 RESP BODY:
     57 {"networks":
     58 [{"status": "ACTIVE", "subnets": ["4e98d6cb-5154-4ebc-90d6-0a059e5e7306"], "name": "demo-net", "provider:physical_network": null, "router:external": false, "tenant_id": "49a02b7bf2bb41d0996e5e2675b0        3d8b", "admin_state_up": true, "mtu": 0, "shared": false, "provider:network_type": "gre", "id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "provider:segmentation_id": 1}]}
     60  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224




       2015-11-18 15:16:04.611 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/security-groups.json?tenant_id=49a02b7bf2bb41d0996e5e2675b03d8b -H "User-Agent: pytho        n-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
     62 2015-11-18 15:16:04.648 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:04 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 155        0 x-openstack-request-id: req-959b8a5d-4fa1-4d5e-8f19-36f00bc42308
2015-11-18 15:16:04.648 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:04 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 155        0 x-openstack-request-id: req-959b8a5d-4fa1-4d5e-8f19-36f00bc42308
     63 
     64 
     65 RESP BODY:
     66 {"security_groups": [
     67 {"tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "description": "Default security group", "id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb", i
     68 "security_group_rules":
     69 [{"remote_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb", "direction": "ingress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv6", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b",         "port_range_max": null, "port_range_min": null, "id": "10694d01-9d52-4394-945e-10b89cf5207b", "security_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb"},
     70 {"remote_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb", "direction": "ingress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv4", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b",         "port_range_max": null, "port_range_min": null, "id": "50450e55-83a1-416e-b4df-9a07c9593a7c", "security_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb"},
     71 {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv4", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "port_range_max": null, "port_range        _min": null, "id": "6e34bdd3-a7e2-47b8-9367-b0274f30b226", "security_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb"},
     72 {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv6", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "port_range_max": null, "port_range        _min": null, "id": "790a57da-28ea-40d1-bdc5-d9f7ea5a6364", "security_group_id": "2c396c40-0a07-4112-9ffe-38699fd1a3fb"}], "name": "default"}]}
     73  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224
     74 




     75 2015-11-18 15:16:04.648 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X POST http://controller:9696/v2.0/ports.json -H "User-Agent: python-neutronclient" -H "Content-Type: application/json"         -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" -d
     76 
     77 '{"port": {"binding:host_id": "compute2.nueos", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "device_owner": "comput        e:nova", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "device_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197"}}'
     78 _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195



     79 
     80 2015-11-18 15:16:05.056 4330 DEBUG nova.block_device [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] block_device_list [] volume_in_mapping /usr/lib/python2.7/site-packages/nova/block_device.py        :565
     81 2015-11-18 15:16:05.056 4330 INFO nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Creating image
     82 2015-11-18 15:16:05.057 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "/var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk.info" acqui        red by "write_to_disk_info_file" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444
     83 2015-11-18 15:16:05.057 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "/var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk.info" relea        sed by "write_to_disk_info_file" :: held 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456

   sed by "write_to_disk_info_file" :: held 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456
     84 2015-11-18 15:16:05.058 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instan        ces/_base/373ec6135cab5e510858923b4f2b1b24e193099d execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199
     85 2015-11-18 15:16:05.079 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/373ec6135ca        b5e510858923b4f2b1b24e193099d" returned: 0 in 0.021s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225
     86 2015-11-18 15:16:05.080 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Acquired file lock "/var/lib/nova/instances/locks/nova-373ec6135cab5e510858923b4f2b        1b24e193099d" after waiting 0.000s acquire /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:212
     87 2015-11-18 15:16:05.080 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "373ec6135cab5e510858923b4f2b1b24e193099d" acquired by "copy_qcow2_image" :: w        aited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444
     88 2015-11-18 15:16:05.080 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instan        ces/_base/373ec6135cab5e510858923b4f2b1b24e193099d execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199
     89 2015-11-18 15:16:05.098 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/373ec6135ca        b5e510858923b4f2b1b24e193099d" returned: 0 in 0.018s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225
     90 2015-11-18 15:16:05.099 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/var/lib/nova        /instances/_base/373ec6135cab5e510858923b4f2b1b24e193099d /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:        199
     91 2015-11-18 15:16:05.120 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "qemu-img create -f qcow2 -o backing_file=/var/lib/nova/instances/_base/373e        c6135cab5e510858923b4f2b1b24e193099d /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk" returned: 0 in 0.021s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.p        y:225
     92 2015-11-18 15:16:05.120 4330 DEBUG nova.virt.disk.api [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Checking if we can resize image /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb19        7/disk. size=1073741824 can_resize_image /usr/lib/python2.7/site-packages/nova/virt/disk/api.py:213
     93 2015-11-18 15:16:05.121 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instan        ces/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197/disk execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199
     94 2015-11-18 15:16:05.139 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/9cecb6f2-cbfd-4c2        c-9bbf-9fcf987cb197/disk" returned: 0 in 0.019s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225
     95 2015-11-18 15:16:05.140 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): qemu-img resize /var/lib/nova/instances/9cecb6f2-cbfd-        4c2c-9bbf-9fcf987cb197/disk 1073741824 execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199
     96 2015-11-18 15:16:05.160 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "qemu-img resize /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb19        7/disk 1073741824" returned: 0 in 0.021s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225
     97 2015-11-18 15:16:05.161 4330 DEBUG nova.virt.disk.api [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Checking if we can extend filesystem inside /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf        -9fcf987cb197/disk. CoW=True is_image_extendable /usr/lib/python2.7/site-packages/nova/virt/disk/api.py:227
     98 2015-11-18 15:16:05.161 4330 DEBUG nova.virt.disk.vfs.api [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Instance for image imgfile=/var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197        /disk imgfmt=qcow2 partition=None instance_for_image /usr/lib/python2.7/site-packages/nova/virt/disk/vfs/api.py:46
99 2015-11-18 15:16:05.161 4330 DEBUG nova.virt.disk.vfs.api [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Using primary VFSGuestFS instance_for_image /usr/lib/python2.7/site-packages/nova/virt/        disk/vfs/api.py:50
    100 2015-11-18 15:16:05.162 4330 DEBUG nova.virt.disk.vfs.guestfs [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Setting up appliance for /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb1        97/disk qcow2 setup /usr/lib/python2.7/site-packages/nova/virt/disk/vfs/guestfs.py:169
    101 2015-11-18 15:16:05.387 4330 DEBUG keystoneclient.session [-] RESP: [201] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 703         x-openstack-request-id: req-0b9508b4-6cc0-47fc-817c-2aac5cf9c529
    102 
    103 RESP BODY:
    104 {"port": {"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips": [{"subnet_id"        : "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "device_id": "9ce        cb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details":         {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}}
    106  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224

    107 2015-11-18 15:16:05.391 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?tenant_id=49a02b7bf2bb41d0996e5e2675b03d8b&device_id=9cecb6f2-cbfd-4c2c-9b        bf-9fcf987cb197 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-packag        es/keystoneclient/session.py:195
    108 2015-11-18 15:16:05.439 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 706         x-openstack-request-id: req-7324c594-b3bc-42f6-9dea-d88fe8957241
    109 
    110 RESP BODY: {"ports": [{"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips":         [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "dev        ice_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:v        if_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}]}
    111  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224
    112 



    113 2015-11-18 15:16:05.440 4330 DEBUG nova.network.neutronv2.api [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Instance cache missing network info. _get_preexisting_port_ids /usr/lib/python2.7/s        ite-packages/nova/network/neutronv2/api.py:1487
    114 2015-11-18 15:16:05.440 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/floatingips.json?fixed_ip_address=192.168.1.18&port_id=1f864632-fc6f-41e9-a951-971bd4        c5820e -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-packages/keysto        neclient/session.py:195
    115 2015-11-18 15:16:05.453 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 19         x-openstack-request-id: req-f7f2161e-f0a2-4390-ae65-6f0945604966
116 RESP BODY: {"floatingips": []}
    117  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224





    118 2015-11-18 15:16:05.453 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/subnets.json?id=4e98d6cb-5154-4ebc-90d6-0a059e5e7306 -H "User-Agent: python-neutroncl        ient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
    119 2015-11-18 15:16:05.476 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 466         x-openstack-request-id: req-218b0ead-8e56-48f7-975c-e394a7b8adc3
    120 RESP BODY: {"subnets": [{"name": "demo-subnet", "enable_dhcp": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "dns_nameservers": [], "ga        teway_ip": "192.168.1.1", "ipv6_ra_mode": null, "allocation_pools": [{"start": "192.168.1.2", "end": "192.168.1.254"}], "host_routes": [], "ip_version": 4, "ipv6_address_mode": null, "cidr": "192.16        8.1.0/24", "id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "subnetpool_id": null}]}
    121  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224




    122 2015-11-18 15:16:05.477 4330 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?network_id=958d7c44-66ba-4ab0-8061-ede751a6b8f9&device_owner=network%3Adhc        p -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}cf848583b462cb6e3437b3f730c5f55f65d95ed2" _http_log_request /usr/lib/python2.7/site-packages/keystonecli        ent/session.py:195
    123 2015-11-18 15:16:05.519 4330 DEBUG keystoneclient.session [-] RESP: [200] date: Wed, 18 Nov 2015 20:16:05 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 147        5 x-openstack-request-id: req-4cd24998-d2cd-426e-8816-276ff3289000

    124 RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "network2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips"        : [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.15"}], "id": "559372d5-5596-489b-9f84-6d8af30e5d76", "security_groups": [], "device_id": "dhcpfbb8622d-31c3-51ab-966        1-955e31f4fec6-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "bind        ing:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:b8:a8:c0"}, {"status": "ACTIVE", "binding:host_id        ": "network.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip        _address": "192.168.1.2"}], "id": "c857c298-0251-42a0-971b-7b20b66f2d8f", "security_groups": [], "device_id": "dhcp7b60c1d9-602e-5110-8c89-a9475b89732c-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name":         "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details": {"port_filter": true, "ovs_hybrid_plug": tr        ue}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:78:c0:0c"}]}
    125  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224







 126 2015-11-18 15:16:05.520 4330 DEBUG nova.network.base_api [-] Updating cache with info: [VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete': False, 'network': Network({'bridge': None,         'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], '        routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2        675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params': None, 'meta': {}, 'details': {}, 'address': u'        fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})] update_instance_cache_with_nw_info /usr/lib/python2.7/site-packag        es/nova/network/base_api.py:42
    127 2015-11-18 15:16:05.601 4330 DEBUG oslo_concurrency.lockutils [-] Releasing semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lock        utils.py:404




    128 2015-11-18 15:16:05.602 4330 DEBUG nova.compute.manager [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Instance network_info: |[VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete        ': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta':         {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected':         False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params':         None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})]| _allocate_network_        async /usr/lib/python2.7/site-packages/nova/compute/manager.py:1772




    129 2015-11-18 15:16:05.820 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" acquired by "update_usage" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockuti        ls.py:444
    130 2015-11-18 15:16:05.912 4330 INFO nova.scheduler.client.report [-] Compute_service record updated for ('compute2.nueos', 'compute2.nueos')
    131 2015-11-18 15:16:05.912 4330 DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" released by "update_usage" :: held 0.093s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils        .py:456
    132 2015-11-18 15:16:07.346 4330 DEBUG nova.virt.disk.vfs.guestfs [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Tearing down appliance teardown /usr/lib/python2.7/site-packages/nova/virt/disk/vfs        /guestfs.py:221
    133 2015-11-18 15:16:07.374 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Releasing file lock "/var/lib/nova/instances/locks/nova-373ec6135cab5e510858923b4f2        b1b24e193099d" after holding it for 2.295s release /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:227
    134 2015-11-18 15:16:07.375 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "373ec6135cab5e510858923b4f2b1b24e193099d" released by "copy_qcow2_image" :: h        eld 2.295s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456
    135 2015-11-18 15:16:07.375 4330 DEBUG nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Start _get_guest_xml network_info=[V        IF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating        _ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type':         'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devn        ame': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e        9-a951-971bd4c5820e', 'qbg_params': None})] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk': {'bus': 'virtio', 'boot_index': '1', 'type': 'disk', 'dev': u'vda'}, 'root': {'bu        s': 'virtio', 'boot_index': '1', 'type': 'disk', 'dev': u'vda'}}} image_meta={u'status': u'active', u'deleted': False, u'container_format': u'bare', u'min_ram': 0, u'updated_at': u'2015-11-10T20:12:        43.000000', u'min_disk': 0, u'owner': u'b53c28a8b0e445a0a9eb5b02dfb89649', u'is_public': True, u'deleted_at': None, u'properties': {}, u'size': 13287936, u'name': u'cirros-0.3.4-x86_64', u'checksum'        : u'ee1eca47dc88f4879d8a229cc70a07c6', u'created_at': u'2015-11-10T20:12:42.000000', u'disk_format': u'qcow2', u'id': u'40801b73-f9cf-424e-a0a2-b78b0501d7d7'} rescue=None block_device_info={'block_d        evice_mapping': [], 'root_device_name': u'/dev/vda', 'ephemerals': [], 'swap': None} _get_guest_xml /usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py:4169



******************************************************************@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@************************************************
 2015-11-18 15:16:07.376 4330 DEBUG nova.objects.instance [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lazy-loading `pci_devices' on Instance uuid 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 obj_loa        d_attr /usr/lib/python2.7/site-packages/nova/objects/instance.py:983
    137 2015-11-18 15:16:07.515 4330 DEBUG nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CPU mode 'host-model' model '' was chosen _get_guest_cpu_model_config /usr/lib/python        2.7/site-packages/nova/virt/libvirt/driver.py:3065
    138 2015-11-18 15:16:07.516 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Getting desirable topologies for flavor Flavor(created_at=None,deleted=False,deleted_at=Non        e,disabled=False,ephemeral_gb=0,extra_specs={},flavorid='1',id=2,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and         image_meta {u'status': u'active', u'deleted': False, u'container_format': u'bare', u'min_ram': 0, u'updated_at': u'2015-11-10T20:12:43.000000', u'min_disk': 0, u'owner': u'b53c28a8b0e445a0a9eb5b02df        b89649', u'is_public': True, u'deleted_at': None, u'properties': {}, u'size': 13287936, u'name': u'cirros-0.3.4-x86_64', u'checksum': u'ee1eca47dc88f4879d8a229cc70a07c6', u'created_at': u'2015-11-10        T20:12:42.000000', u'disk_format': u'qcow2', u'id': u'40801b73-f9cf-424e-a0a2-b78b0501d7d7'} _get_desirable_cpu_topologies /usr/lib/python2.7/site-packages/nova/virt/hardware.py:552
    139 2015-11-18 15:16:07.516 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Flavor limits 65536:65536:65536 _get_cpu_topology_constraints /usr/lib/python2.7/site-packa        ges/nova/virt/hardware.py:309
    140 2015-11-18 15:16:07.516 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Image limits 65536:65536:65536 _get_cpu_topology_constraints /usr/lib/python2.7/site-packag        es/nova/virt/hardware.py:322
    141 2015-11-18 15:16:07.516 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Flavor pref -1:-1:-1 _get_cpu_topology_constraints /usr/lib/python2.7/site-packages/nova/vi        rt/hardware.py:345
    142 2015-11-18 15:16:07.517 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Image pref -1:-1:-1 _get_cpu_topology_constraints /usr/lib/python2.7/site-packages/nova/vir        t/hardware.py:367
    143 2015-11-18 15:16:07.517 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Chosen -1:-1:-1 limits 65536:65536:65536 _get_cpu_topology_constraints /usr/lib/python2.7/s        ite-packages/nova/virt/hardware.py:396
    144 2015-11-18 15:16:07.517 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Build topologies for 1 vcpu(s) 1:1:1 _get_possible_cpu_topologies /usr/lib/python2.7/site-p        ackages/nova/virt/hardware.py:440
    145 2015-11-18 15:16:07.517 4330 DEBUG nova.virt.hardware [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Got 1 possible topologies _get_possible_cpu_topologies /usr/lib/python2.7/site-packages/nov        a/virt/hardware.py:475
    146 2015-11-18 15:16:07.517 4330 DEBUG nova.objects.instance [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lazy-loading `vcpu_model' on Instance uuid 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 obj_load        _attr /usr/lib/python2.7/site-packages/nova/objects/instance.py:983
147 2015-11-18 15:16:07.540 4330 DEBUG nova.virt.libvirt.vif [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] vif_type=binding_failed instance=Instance(access_ip_v4=None,access_ip_v6=None,architectu        re=None,auto_disk_config=True,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2015-11-18T20:16:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=Fal        se,deleted_at=None,disable_terminate=False,display_description='xx',display_name='xx',ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(2),host='compute2.nueos',hostname='xx',id=81,imag        e_ref='40801b73-f9cf-424e-a0a2-b78b0501d7d7',info_cache=InstanceInfoCache,instance_type_id=2,kernel_id='',key_data=None,key_name=None,launch_index=0,launched_at=None,launched_on='compute2.nueos',loc        ked=False,locked_by=None,memory_mb=512,metadata={},new_flavor=None,node='compute2.nueos',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,po        wer_state=0,progress=0,project_id='49a02b7bf2bb41d0996e5e2675b03d8b',ramdisk_id='',reservation_id='r-vntcrctq',root_device_name='/dev/vda',root_gb=1,scheduled_at=None,security_groups=SecurityGroupLi        st,shutdown_terminate=False,system_metadata={image_base_image_ref='40801b73-f9cf-424e-a0a2-b78b0501d7d7',image_container_format='bare',image_disk_format='qcow2',image_min_disk='1',image_min_ram='0',        network_allocated='True'},tags=<?>,task_state='spawning',terminated_at=None,updated_at=2015-11-18T20:16:05Z,user_data=None,user_id='c57621aee095478d950e87ff9d790d84',uuid=9cecb6f2-cbfd-4c2c-9bbf-9fc        f987cb197,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif=VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_delete': False, 'network': Network({'bridge': None, 'subnets        ': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'meta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes':         [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injected': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8        b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e        :59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None}) virt_typeqemu get_config /usr/lib/python2.7/site-packages/nova/virt/libvir        t/vif.py:364
******************************************************************@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@************************************************






    148 2015-11-18 15:16:07.541 4330 ERROR nova.compute.manager [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Instance failed to spawn
    149 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Traceback (most recent call last):
    150 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2442, in _build_resou        rces
    151 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]     yield resources
    152 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2314, in _build_and_r        un_instance
    153 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]     block_device_info=block_device_info)
    154 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2351, in spawn
    155 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]     write_to_disk=True)
    156 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4172, in _get_gue        st_xml
    157 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]     context)
    158 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4043, in _get_gue        st_config
    159 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]     flavor, virt_type)
    160 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/vif.py", line 374, in get_config
    161 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]     _("Unexpected vif_type=%s") % vif_type)
    162 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] NovaException: Unexpected vif_type=binding_failed
    163 2015-11-18 15:16:07.541 4330 TRACE nova.compute.manager [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197]
164 2015-11-18 15:16:07.542 4330 INFO nova.compute.manager [req-88ccf1cb-83ba-41dd-baff-00991577ea99 c57621aee095478d950e87ff9d790d84 49a02b7bf2bb41d0996e5e2675b03d8b - - -] [instance: 9cecb6f2-cbfd-4c2        c-9bbf-9fcf987cb197] Terminating instance
    165 2015-11-18 15:16:07.545 4330 INFO nova.virt.libvirt.driver [-] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] During wait destroy, instance disappeared.
    166 2015-11-18 15:16:07.545 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Running cmd (subprocess): mv /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fc        f987cb197 /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197_del execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:199
    167 2015-11-18 15:16:07.556 4330 DEBUG oslo_concurrency.processutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] CMD "mv /var/lib/nova/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 /var/lib/no        va/instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197_del" returned: 0 in 0.011s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:225
    168 2015-11-18 15:16:07.556 4330 INFO nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Deleting instance files /var/lib/nova        /instances/9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197_del
    169 2015-11-18 15:16:07.557 4330 INFO nova.virt.libvirt.driver [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Deletion of /var/lib/nova/instances/9        cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197_del complete
    170 2015-11-18 15:16:07.883 4330 DEBUG nova.compute.claims [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Aborting claim: [Claim: 512 MB memory, 1         GB disk] abort /usr/lib/python2.7/site-packages/nova/compute/claims.py:130
    171 2015-11-18 15:16:07.884 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "compute_resources" acquired by "abort_instance_claim" :: waited 0.000s inner         /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444
    172 2015-11-18 15:16:07.940 4330 INFO nova.scheduler.client.report [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Compute_service record updated for ('compute2.nueos', 'compute2.nueos')
    173 2015-11-18 15:16:07.940 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "compute_resources" released by "abort_instance_claim" :: held 0.056s inner /u        sr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456
    174 2015-11-18 15:16:07.940 4330 DEBUG nova.compute.utils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Unexpected vif_type=binding_failed notify_        about_instance_usage /usr/lib/python2.7/site-packages/nova/compute/utils.py:310
    175 2015-11-18 15:16:07.941 4330 DEBUG nova.compute.manager [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Build of instance 9cecb6f2-cbfd-4c2c-9bb        f-9fcf987cb197 was re-scheduled: Unexpected vif_type=binding_failed _do_build_and_run_instance /usr/lib/python2.7/site-packages/nova/compute/manager.py:2233
    176 2015-11-18 15:16:08.301 4330 DEBUG oslo_concurrency.lockutils [req-35c9a4d6-3649-4eed-8f0d-7397c9357379 - - - - -] Lock "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" released by "_locked_do_build_and_run_i        nstance" :: held 4.651s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456
    177 2015-11-18 15:16:21.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodi        c_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    178 2015-11-18 15:16:21.363 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.S        ervice object at 0x4747590>> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    179 2015-11-18 15:16:22.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodi        c_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    180 2015-11-18 15:16:22.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.S        ervice object at 0x4747590>> sleeping for 2.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
@                                                                                                                                                                     ervice object at 0x4747590>> sleeping for 2.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    181 2015-11-18 15:16:24.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_        tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    182 2015-11-18 15:16:24.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes /usr/lib/python2        .7/site-packages/nova/compute/manager.py:6197
    183 2015-11-18 15:16:24.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.S        ervice object at 0x4747590>> sleeping for 15.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    184 2015-11-18 15:16:39.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodi        c_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    185 2015-11-18 15:16:39.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Starting heal instance info cache _heal_instance_info_cache /usr/lib/python2.7/site-packa        ges/nova/compute/manager.py:5537
    186 2015-11-18 15:16:39.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Rebuilding the list of instances to heal _heal_instance_info_cache /usr/lib/python2.7/sit        e-packages/nova/compute/manager.py:5541
    187 2015-11-18 15:16:39.418 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr/l        ib/python2.7/site-packages/oslo_concurrency/lockutils.py:391
    188 2015-11-18 15:16:39.419 4330 DEBUG nova.network.neutronv2.api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] _get_instance_nw_info() _get_insta        nce_nw_info /usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py:760
    189 2015-11-18 15:16:39.419 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac        kages/oslo_concurrency/lockutils.py:391
    190 2015-11-18 15:16:39.419 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:404


******************************************************************@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@************************************************


    191 2015-11-18 15:16:39.420 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?tenant_id=49a02b7bf2bb41d        0996e5e2675b03d8b&device_id=9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326"         _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
    192 2015-11-18 15:16:39.468 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap        plication/json; charset=UTF-8 content-length: 706 x-openstack-request-id: req-9a10078d-bb25-4fc1-828b-b4067b057ff0
    193 RESP BODY: {"ports": [{"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips":         [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "dev        ice_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:v        if_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}]}
    194  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224
******************************************************************@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@************************************************


 196 2015-11-18 15:16:39.592 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac        kages/oslo_concurrency/lockutils.py:391
    197 2015-11-18 15:16:39.592 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:404



    198 2015-11-18 15:16:39.592 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/networks.json?id=958d7c44-66ba-4ab0-        8061-ede751a6b8f9 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pack        ages/keystoneclient/session.py:195
    199 2015-11-18 15:16:39.633 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap        plication/json; charset=UTF-8 content-length: 379 x-openstack-request-id: req-0128968c-fd38-4a69-89d3-862bc37929e0
    200 RESP BODY: {"networks": [{"status": "ACTIVE", "subnets": ["4e98d6cb-5154-4ebc-90d6-0a059e5e7306"], "name": "demo-net", "provider:physical_network": null, "router:external": false, "tenant_id": "49a0        2b7bf2bb41d0996e5e2675b03d8b", "admin_state_up": true, "mtu": 0, "shared": false, "provider:network_type": "gre", "id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "provider:segmentation_id": 1}]}
    201  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224



    202 2015-11-18 15:16:39.633 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/floatingips.json?fixed_ip_address=19        2.168.1.18&port_id=1f864632-fc6f-41e9-a951-971bd4c5820e -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_lo        g_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
    203 2015-11-18 15:16:39.646 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap        plication/json; charset=UTF-8 content-length: 19 x-openstack-request-id: req-1bf8c291-a59f-4ac3-83bc-447e8f8a49f9
    204 RESP BODY: {"floatingips": []}
    205  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224
    206 2015-11-18 15:16:39.646 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac        kages/oslo_concurrency/lockutils.py:391
    207 2015-11-18 15:16:39.646 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:404



    208 2015-11-18 15:16:39.647 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/subnets.json?id=4e98d6cb-5154-4ebc-9        0d6-0a059e5e7306 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-packa        ges/keystoneclient/session.py:195
    209 2015-11-18 15:16:39.670 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap        plication/json; charset=UTF-8 content-length: 466 x-openstack-request-id: req-5ce24c66-9a73-465c-aa0c-984434883975
    210 RESP BODY: {"subnets": [{"name": "demo-subnet", "enable_dhcp": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "dns_nameservers": [], "ga        teway_ip": "192.168.1.1", "ipv6_ra_mode": null, "allocation_pools": [{"start": "192.168.1.2", "end": "192.168.1.254"}], "host_routes": [], "ip_version": 4, "ipv6_address_mode": null, "cidr": "192.16        8.1.0/24", "id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "subnetpool_id": null}]}
    211  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224







    212 2015-11-18 15:16:39.670 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac        kages/oslo_concurrency/lockutils.py:391
213 2015-11-18 15:16:39.671 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:404



    214 2015-11-18 15:16:39.671 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?network_id=958d7c44-66ba-        4ab0-8061-ede751a6b8f9&device_owner=network%3Adhcp -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_req        uest /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
    215 2015-11-18 15:16:39.713 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:16:39 GMT connection: keep-alive content-type: ap        plication/json; charset=UTF-8 content-length: 1475 x-openstack-request-id: req-6ad96980-c71d-4527-b456-32d670e12edf

    216 RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "network2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips"        : [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.15"}], "id": "559372d5-5596-489b-9f84-6d8af30e5d76", "security_groups": [], "device_id": "dhcpfbb8622d-31c3-51ab-966        1-955e31f4fec6-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "bind        ing:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:b8:a8:c0"}, {"status": "ACTIVE", "binding:host_id        ": "network.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip        _address": "192.168.1.2"}], "id": "c857c298-0251-42a0-971b-7b20b66f2d8f", "security_groups": [], "device_id": "dhcp7b60c1d9-602e-5110-8c89-a9475b89732c-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name":         "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details": {"port_filter": true, "ovs_hybrid_plug": tr        ue}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:78:c0:0c"}]}
    217  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224






    218 2015-11-18 15:16:39.714 4330 DEBUG nova.network.base_api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Updating cache with info: [VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_del        ete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'met        a': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'injecte        d': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_params        ': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})] update_instance_        cache_with_nw_info /usr/lib/python2.7/site-packages/nova/network/base_api.py:42




    219 2015-11-18 15:16:39.736 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr/        lib/python2.7/site-packages/oslo_concurrency/lockutils.py:404
    220 2015-11-18 15:16:39.736 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Updated the network info_cache for insta        nce _heal_instance_info_cache /usr/lib/python2.7/site-packages/nova/compute/manager.py:5598
221 2015-11-18 15:16:39.736 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.S        ervice object at 0x4747590>> sleeping for 17.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    222 2015-11-18 15:16:56.737 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager.update_available_resource run_periodi        c_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    223 2015-11-18 15:16:56.739 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Auditing locally available compute resources for node compute2.nueos
    224 2015-11-18 15:16:56.879 4330 DEBUG nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Hypervisor: free VCPUs: 24 _report_hypervisor_resource_view /usr/lib/python2.7/s        ite-packages/nova/compute/resource_tracker.py:518
    225 2015-11-18 15:17:40.486 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:404




    226 2015-11-18 15:17:40.487 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?tenant_id=49a02b7bf2bb41d        0996e5e2675b03d8b&device_id=9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326"         _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195


******************************************************************@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@************************************************
    227 2015-11-18 15:17:40.529 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: ap        plication/json; charset=UTF-8 content-length: 706 x-openstack-request-id: req-49f8a397-14af-4aae-b3be-5ae25ea4e348
    228 RESP BODY: {"ports": [{"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips":         [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "dev        ice_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:v        if_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}]}
    229  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224
******************************************************************@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@************************************************



    230 2015-11-18 15:17:40.529 4330 DEBUG nova.objects.instance [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Lazy-loading `info_cache' on Instance uuid 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 obj_load        _attr /usr/lib/python2.7/site-packages/nova/objects/instance.py:983
    231 2015-11-18 15:17:40.654 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pac        kages/oslo_concurrency/lockutils.py:391
    232 2015-11-18 15:17:40.654 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:404
    233 2015-11-18 15:17:40.654 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/networks.json?id=958d7c44-66ba-4ab0-        8061-ede751a6b8f9 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pack        ages/keystoneclient/session.py:195
    234 2015-11-18 15:17:40.702 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: ap        plication/json; charset=UTF-8 content-length: 379 x-openstack-request-id: req-063f2211-d019-486c-9f2a-43d35bac93e4
 238 2015-11-18 15:17:40.715 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: a        pplication/json; charset=UTF-8 content-length: 19 x-openstack-request-id: req-6f80cea6-f6e7-4318-bbb5-bd69f7be5d34
    239 RESP BODY: {"floatingips": []}
    240  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224
    241 2015-11-18 15:17:40.715 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:391
    242 2015-11-18 15:17:40.716 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p        ackages/oslo_concurrency/lockutils.py:404





    243 2015-11-18 15:17:40.716 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/subnets.json?id=4e98d6cb-5154-4ebc-        90d6-0a059e5e7306 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pac        kages/keystoneclient/session.py:195
    244 2015-11-18 15:17:40.839 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: a        pplication/json; charset=UTF-8 content-length: 466 x-openstack-request-id: req-d5b8c7ad-4e65-4522-af93-4e30d53f4f62
    245 RESP BODY: {"subnets": [{"name": "demo-subnet", "enable_dhcp": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "dns_nameservers": [], "g        ateway_ip": "192.168.1.1", "ipv6_ra_mode": null, "allocation_pools": [{"start": "192.168.1.2", "end": "192.168.1.254"}], "host_routes": [], "ip_version": 4, "ipv6_address_mode": null, "cidr": "192.        168.1.0/24", "id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "subnetpool_id": null}]}
    246  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224







    247 2015-11-18 15:17:40.840 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:391
    248 2015-11-18 15:17:40.840 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p        ackages/oslo_concurrency/lockutils.py:404







    249 2015-11-18 15:17:40.840 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?network_id=958d7c44-66ba        -4ab0-8061-ede751a6b8f9&device_owner=network%3Adhcp -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_r        equest /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
    250 2015-11-18 15:17:40.881 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:17:40 GMT connection: keep-alive content-type: a        pplication/json; charset=UTF-8 content-length: 1475 x-openstack-request-id: req-61db012d-82fa-415c-84a6-f3181ae7a7a8

    251 RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "network2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips        ": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.15"}], "id": "559372d5-5596-489b-9f84-6d8af30e5d76", "security_groups": [], "device_id": "dhcpfbb8622d-31c3-51ab-9        661-955e31f4fec6-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "b        inding:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:b8:a8:c0"}, {"status": "ACTIVE", "binding:hos        t_id": "network.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306"        , "ip_address": "192.168.1.2"}], "id": "c857c298-0251-42a0-971b-7b20b66f2d8f", "security_groups": [], "device_id": "dhcp7b60c1d9-602e-5110-8c89-a9475b89732c-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "        name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details": {"port_filter": true, "ovs_hybrid_pl        ug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:78:c0:0c"}]}
    252  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224


253 2015-11-18 15:17:40.882 4330 DEBUG nova.network.base_api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Updating cache with info: [VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_de        lete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'm        eta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'inje        cted': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_pa        rams': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})] update_inst        ance_cache_with_nw_info /usr/lib/python2.7/site-packages/nova/network/base_api.py:42
\\
    254 2015-11-18 15:17:40.907 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr        /lib/python2.7/site-packages/oslo_concurrency/lockutils.py:404
    255 2015-11-18 15:17:40.908 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Updated the network info_cache for inst        ance _heal_instance_info_cache /usr/lib/python2.7/site-packages/nova/compute/manager.py:5598
    256 2015-11-18 15:17:40.908 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.        Service object at 0x4747590>> sleeping for 17.94 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    257 2015-11-18 15:17:58.847 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager.update_available_resource run_period        ic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    258 2015-11-18 15:17:58.849 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Auditing locally available compute resources for node compute2.nueos
    259 2015-11-18 15:17:58.983 4330 DEBUG nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Hypervisor: free VCPUs: 24 _report_hypervisor_resource_view /usr/lib/python2.7/        site-packages/nova/compute/resource_tracker.py:518
    260 2015-11-18 15:17:58.983 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Lock "compute_resources" acquired by "_update_available_resource" :: waited 0.000s         inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:444
    261 2015-11-18 15:17:59.144 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Total usable vcpus: 24, total allocated vcpus: 0
    262 2015-11-18 15:17:59.144 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Final resource view: name=compute2.nueos phys_ram=96506MB used_ram=1024MB phys_d        isk=49GB used_disk=1GB total_vcpus=24 used_vcpus=0 pci_stats=<nova.pci.stats.PciDeviceStats object at 0x502bc10>
    263 2015-11-18 15:17:59.194 4330 INFO nova.scheduler.client.report [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Compute_service record updated for ('compute2.nueos', 'compute2.nueos')
    264 2015-11-18 15:17:59.195 4330 INFO nova.compute.resource_tracker [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Compute_service record updated for compute2.nueos:compute2.nueos
    265 2015-11-18 15:17:59.195 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Lock "compute_resources" released by "_update_available_resource" :: held 0.211s i        nner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:456
 266 2015-11-18 15:17:59.225 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.        Service object at 0x4747590>> sleeping for 2.13 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    267 2015-11-18 15:18:01.360 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._check_instance_build_time run_perio        dic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    268 2015-11-18 15:18:01.360 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.        Service object at 0x4747590>> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    269 2015-11-18 15:18:02.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_t        asks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    270 2015-11-18 15:18:02.363 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.        Service object at 0x4747590>> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    271 2015-11-18 15:18:03.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_task        s /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    272 2015-11-18 15:18:03.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic        _tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    273 2015-11-18 15:18:03.363 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.        Service object at 0x4747590>> sleeping for 22.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    274 2015-11-18 15:18:25.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_period        ic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    275 2015-11-18 15:18:25.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_period        ic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    276 2015-11-18 15:18:25.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.        Service object at 0x4747590>> sleeping for 1.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    277 2015-11-18 15:18:26.364 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic        _tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219

278 2015-11-18 15:18:26.364 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes /usr/lib/python        2.7/site-packages/nova/compute/manager.py:6197
    279 2015-11-18 15:18:26.364 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.        Service object at 0x4747590>> sleeping for 15.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
    280 2015-11-18 15:18:41.363 4330 DEBUG nova.openstack.common.periodic_task [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_period        ic_tasks /usr/lib/python2.7/site-packages/nova/openstack/common/periodic_task.py:219
    281 2015-11-18 15:18:41.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Starting heal instance info cache _heal_instance_info_cache /usr/lib/python2.7/site-pack        ages/nova/compute/manager.py:5537
    282 2015-11-18 15:18:41.363 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Rebuilding the list of instances to heal _heal_instance_info_cache /usr/lib/python2.7/si        te-packages/nova/compute/manager.py:5541
    283 2015-11-18 15:18:41.419 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr/        lib/python2.7/site-packages/oslo_concurrency/lockutils.py:391
    284 2015-11-18 15:18:41.419 4330 DEBUG nova.network.neutronv2.api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] _get_instance_nw_info() _get_inst        ance_nw_info /usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py:760
    285 2015-11-18 15:18:41.419 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:391
    286 2015-11-18 15:18:41.420 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p        ackages/oslo_concurrency/lockutils.py:404





    287 2015-11-18 15:18:41.420 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?tenant_id=49a02b7bf2bb41        d0996e5e2675b03d8b&device_id=9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd632        6" _http_log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
    288 2015-11-18 15:18:41.461 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a        pplication/json; charset=UTF-8 content-length: 706 x-openstack-request-id: req-5512f74c-b7e1-490f-b1b9-c9e1a3e6e20c
    289 RESP BODY: {"ports": [{"status": "DOWN", "binding:host_id": "compute2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips":         [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.18"}], "id": "1f864632-fc6f-41e9-a951-971bd4c5820e", "security_groups": ["2c396c40-0a07-4112-9ffe-38699fd1a3fb"], "d        evice_id": "9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "bindin        g:vif_details": {}, "binding:vnic_type": "normal", "binding:vif_type": "binding_failed", "mac_address": "fa:16:3e:59:71:e1"}]}
    290  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224



291 2015-11-18 15:18:41.462 4330 DEBUG nova.objects.instance [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Lazy-loading `info_cache' on Instance uuid 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197 obj_loa        d_attr /usr/lib/python2.7/site-packages/nova/objects/instance.py:983
    292 2015-11-18 15:18:41.575 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:391
    293 2015-11-18 15:18:41.575 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p        ackages/oslo_concurrency/lockutils.py:404





    294 2015-11-18 15:18:41.575 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/networks.json?id=958d7c44-66ba-4ab0        -8061-ede751a6b8f9 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pa        ckages/keystoneclient/session.py:195
    295 2015-11-18 15:18:41.615 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a        pplication/json; charset=UTF-8 content-length: 379 x-openstack-request-id: req-d0b4da6c-b782-4e80-b074-496fe6ff6da7
    296 RESP BODY: {"networks": [{"status": "ACTIVE", "subnets": ["4e98d6cb-5154-4ebc-90d6-0a059e5e7306"], "name": "demo-net", "provider:physical_network": null, "router:external": false, "tenant_id": "49a        02b7bf2bb41d0996e5e2675b03d8b", "admin_state_up": true, "mtu": 0, "shared": false, "provider:network_type": "gre", "id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "provider:segmentation_id": 1}]}
    297  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224




    298 2015-11-18 15:18:41.615 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/floatingips.json?fixed_ip_address=1        92.168.1.18&port_id=1f864632-fc6f-41e9-a951-971bd4c5820e -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_        log_request /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
    299 2015-11-18 15:18:41.629 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a        pplication/json; charset=UTF-8 content-length: 19 x-openstack-request-id: req-988f2719-50f8-4f27-88bf-61a815f376b2
    300 RESP BODY: {"floatingips": []}


    301  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224
    302 2015-11-18 15:18:41.629 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:391
    303 2015-11-18 15:18:41.630 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p        ackages/oslo_concurrency/lockutils.py:404


    304 2015-11-18 15:18:41.630 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/subnets.json?id=4e98d6cb-5154-4ebc-        90d6-0a059e5e7306 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_request /usr/lib/python2.7/site-pac        kages/keystoneclient/session.py:195
    305 2015-11-18 15:18:41.653 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a        pplication/json; charset=UTF-8 content-length: 466 x-openstack-request-id: req-5456567e-def7-487a-a4d8-9a8087ea7411

    306 RESP BODY: {"subnets": [{"name": "demo-subnet", "enable_dhcp": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "dns_nameservers": [], "g        ateway_ip": "192.168.1.1", "ipv6_ra_mode": null, "allocation_pools": [{"start": "192.168.1.2", "end": "192.168.1.254"}], "host_routes": [], "ip_version": 4, "ipv6_address_mode": null, "cidr": "192.        168.1.0/24", "id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "subnetpool_id": null}]}
    307  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224


@                                                                                                                                                                                                            
 308 2015-11-18 15:18:41.653 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Acquired semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-pa        ckages/oslo_concurrency/lockutils.py:391
    309 2015-11-18 15:18:41.654 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "neutron_admin_auth_token_lock" lock /usr/lib/python2.7/site-p        ackages/oslo_concurrency/lockutils.py:404


    310 2015-11-18 15:18:41.654 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] REQ: curl -g -i -X GET http://controller:9696/v2.0/ports.json?network_id=958d7c44-66ba        -4ab0-8061-ede751a6b8f9&device_owner=network%3Adhcp -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}e2a397d58952037a7b95efe0dd7ea435d6cd6326" _http_log_r        equest /usr/lib/python2.7/site-packages/keystoneclient/session.py:195
    311 2015-11-18 15:18:41.701 4330 DEBUG keystoneclient.session [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] RESP: [200] date: Wed, 18 Nov 2015 20:18:41 GMT connection: keep-alive content-type: a        pplication/json; charset=UTF-8 content-length: 1475 x-openstack-request-id: req-ee6abea5-6acd-4616-924f-eb485de20331


    312 RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "network2.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips        ": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306", "ip_address": "192.168.1.15"}], "id": "559372d5-5596-489b-9f84-6d8af30e5d76", "security_groups": [], "device_id": "dhcpfbb8622d-31c3-51ab-9        661-955e31f4fec6-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "b        inding:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:b8:a8:c0"}, {"status": "ACTIVE", "binding:hos        t_id": "network.nueos", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "network:dhcp", "binding:profile": {}, "fixed_ips": [{"subnet_id": "4e98d6cb-5154-4ebc-90d6-0a059e5e7306"        , "ip_address": "192.168.1.2"}], "id": "c857c298-0251-42a0-971b-7b20b66f2d8f", "security_groups": [], "device_id": "dhcp7b60c1d9-602e-5110-8c89-a9475b89732c-958d7c44-66ba-4ab0-8061-ede751a6b8f9", "        name": "", "admin_state_up": true, "network_id": "958d7c44-66ba-4ab0-8061-ede751a6b8f9", "tenant_id": "49a02b7bf2bb41d0996e5e2675b03d8b", "binding:vif_details": {"port_filter": true, "ovs_hybrid_pl        ug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:78:c0:0c"}]}
    313  _http_log_response /usr/lib/python2.7/site-packages/keystoneclient/session.py:224


    314 2015-11-18 15:18:41.702 4330 DEBUG nova.network.base_api [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Updating cache with info: [VIF({'profile': {}, 'ovs_interfaceid': None, 'preserve_on_de        lete': False, 'network': Network({'bridge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'address': u'192.168.1.18'})], 'version': 4, 'm        eta': {'dhcp_server': u'192.168.1.2'}, 'dns': [], 'routes': [], 'cidr': u'192.168.1.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'192.168.1.1'})})], 'meta': {'inje        cted': False, 'tenant_id': u'49a02b7bf2bb41d0996e5e2675b03d8b'}, 'id': u'958d7c44-66ba-4ab0-8061-ede751a6b8f9', 'label': u'demo-net'}), 'devname': u'tap1f864632-fc', 'vnic_type': u'normal', 'qbh_pa        rams': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:59:71:e1', 'active': False, 'type': u'binding_failed', 'id': u'1f864632-fc6f-41e9-a951-971bd4c5820e', 'qbg_params': None})] update_inst        ance_cache_with_nw_info /usr/lib/python2.7/site-packages/nova/network/base_api.py:42
    315 2015-11-18 15:18:41.727 4330 DEBUG oslo_concurrency.lockutils [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Releasing semaphore "refresh_cache-9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197" lock /usr        /lib/python2.7/site-packages/oslo_concurrency/lockutils.py:404

    316 2015-11-18 15:18:41.727 4330 DEBUG nova.compute.manager [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] [instance: 9cecb6f2-cbfd-4c2c-9bbf-9fcf987cb197] Updated the network info_cache for inst        ance _heal_instance_info_cache /usr/lib/python2.7/site-packages/nova/compute/manager.py:5598
    317 2015-11-18 15:18:41.727 4330 DEBUG nova.openstack.common.loopingcall [req-356d7777-ef4c-47b5-ae90-b7d83967832d - - - - -] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.        Service object at 0x4747590>> sleeping for 18.00 seconds _inner /usr/lib/python2.7/site-packages/nova/openstack/common/loopingcall.py:132
~