Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

I am attaching the nova-compute.log here. It appears that the machine with nova-compute only is getting a message to reboot a VM instance that does not exist. Any help in debugging will be greatly appreciated +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

2012-04-24 11:15:09 DEBUG nova.service [-] Full set of FLAGS: from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:402 2012-04-24 11:15:09 DEBUG nova.service [-] default_floating_pool : nova from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] storage_availability_zone : nova from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] rescue_image_id : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] num_networks : 1 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] default_publisher_id : luke from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] sql_connection_debug : 0 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] fixed_range : 10.0.1.0/24 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] compute_topic : compute from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] glance_port : 9292 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] glance_api_servers : ['192.168.1.201:9292'] from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] rabbit_password : FLAG SET from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:409 2012-04-24 11:15:09 DEBUG nova.service [-] osapi_compute_listen_port : 8774 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] s3_dmz : 192.168.1.202 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] quota_ram : 51200 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] xenapi_sparse_copy : True from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] osapi_compute_listen : 0.0.0.0 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] cache_images : True from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] vlan_interface : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] aws_access_key_id : FLAG SET from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:409 2012-04-24 11:15:09 DEBUG nova.service [-] bandwith_poll_interval : 600 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] xenapi_sr_base_path : /var/run/sr-mount from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] network_size : 8 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] host_state_interval : 120 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] virt_mkfs : ['default=mkfs.ext3 -L %(fs_label)s -F %(target)s', 'linux=mkfs.ext3 -L %(fs_label)s -F %(target)s', 'windows=mkfs.ntfs --force --fast --label %(fs_label)s %(target)s'] from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] enable_new_services : True from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] my_ip : 192.168.1.202 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] live_migration_retry_count : 30 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] ec2_dmz_host : 192.168.1.202 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] password_length : 12 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] quota_max_injected_files : 5 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] security_group_handler : nova.network.quantum.sg.NullSecurityGroupHandler from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] public_interface : eth0 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] iqn_prefix : iqn.2010-10.org.openstack from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] default_schedule_zone : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] libvirt_disk_prefix : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] logdir : /var/log/nova from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] osapi_volume_listen : 0.0.0.0 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] sqlite_db : nova.sqlite from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] iscsi_ip_address : 192.168.1.202 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] osapi_compute_extension : ['nova.api.openstack.compute.contrib.standard_extensions'] from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] allow_resize_to_same_host : False from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] reclaim_instance_interval : 0 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] network_device_mtu : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] cert_manager : nova.cert.manager.CertManager from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] cnt_vpn_clients : 0 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] use_usb_tablet : True from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] ipv6_backend : rfc2462 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] notification_driver : nova.notifier.no_op_notifier from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] osapi_max_limit : 1000 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] enable_instance_password : FLAG SET from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:409 2012-04-24 11:15:09 DEBUG nova.service [-] compute_api_class : nova.compute.api.API from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] remove_unused_base_images : False from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] rabbit_port : 5672 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] auto_assign_floating_ip : False from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] vmwareapi_host_password : FLAG SET from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:409 2012-04-24 11:15:09 DEBUG nova.service [-] default_access_ip_network_name : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] rabbit_max_retries : 0 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] resume_guests_state_on_host_boot : True from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] dhcp_lease_time : 120 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] ec2_listen : 0.0.0.0 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] logfile : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] floating_ip_dns_manager : nova.network.dns_driver.DNSDriver from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] xenapi_remap_vbd_dev_prefix : sd from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] injected_network_template : /usr/lib/python2.7/dist-packages/nova/virt/interfaces.template from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] network_host : 192.168.1.201 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] send_arp_for_ha : False from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] xenapi_connection_concurrent : 5 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] snapshot_name_template : snapshot-%08x from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] vmwareapi_host_username : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] resize_confirm_window : 0 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] vncserver_proxyclient_address : 127.0.0.1 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] xenapi_connection_username : root from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] metadata_host : 192.168.1.202 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] quota_cores : 20 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] heal_instance_info_cache_interval : 60 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] debug : False from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] auth_strategy : keystone from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] routing_source_ip : 192.168.1.201 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] policy_file : policy.json from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] default_log_levels : ['amqplib=WARN', 'sqlalchemy=WARN', 'boto=WARN', 'suds=INFO', 'eventlet.wsgi.server=WARN'] from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] volume_topic : volume from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] libvirt_use_virtio_for_bridges : True from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] dnsmasq_config_file : from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] osapi_glance_link_prefix : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] vmwareapi_wsdl_loc : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] volume_name_template : volume-%08x from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] lock_path : /var/lock/nova from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] live_migration_uri : qemu+tcp://%s/system from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] state_path : /var/lib/nova from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] allow_same_net_traffic : True from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] iscsi_num_targets : 100 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] libvirt_vif_type : bridge from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] flat_network_dns : 8.8.4.4 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] remove_unused_original_minimum_age_seconds : 86400 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] log_config : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] use_stderr : True from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] connection_type : libvirt from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] default_project : openstack from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] s3_port : 3333 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] max_kernel_ramdisk_size : 16777216 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] logfile_mode : 0644 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] default_ephemeral_format : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] logging_context_format_string : %(asctime)s %(levelname)s %(name)s [%(request_id)s %(user_id)s %(project_id)s] %(instance)s%(message)s from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] metadata_listen_port : 8775 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] vpn_ip : 192.168.1.202 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] isolated_hosts : [] from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] instance_name_template : instance-%08x from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] ec2_host : 192.168.1.201 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] instance_usage_audit_period : month from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] log_dir : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] rabbit_durable_queues : False from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] live_migration_bandwidth : 0 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] quota_metadata_items : 128 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] logging_debug_format_suffix : from (pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] stub_network : False from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] console_manager : nova.console.manager.ConsoleProxyManager from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] zombie_instance_updated_at_window : 172800 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] use_join_force : True from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] rpc_backend : nova.rpc.impl_kombu from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] rabbit_userid : guest from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] running_deleted_instance_poll_interval : 30 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] osapi_volume_extension : ['nova.api.openstack.volume.contrib.standard_extensions'] from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] osapi_scheme : http from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] dhcp_domain : novalocal from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] sql_connection : FLAG SET from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:409 2012-04-24 11:15:09 DEBUG nova.service [-] console_topic : console from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] instances_path : /var/lib/nova/instances from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] flat_injected : False from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] api_rate_limit : True from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] use_local_volumes : True from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] host : luke from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] instance_dns_domain : from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] target_port : 3260 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] fixed_ip_disassociate_timeout : 600 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] running_deleted_instance_action : log from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] console_host : luke from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] xenapi_remap_vbd_dev : False from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] libvirt_ovs_bridge : br-int from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] quota_max_injected_file_content_bytes : 10240 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] libvirt_vif_driver : nova.virt.libvirt.vif.LibvirtBridgeDriver from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] floating_range : 192.168.1.240/29 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] reboot_timeout : 0 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] multi_host : False from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] glance_num_retries : 0 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] db_backend : sqlalchemy from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] num_shell_tries : 3 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] image_cache_manager_interval : 40 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] sql_retry_interval : 10 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] vmwareapi_task_poll_interval : 5.0 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] volume_driver : nova.volume.driver.ISCSIDriver from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] networks_path : /var/lib/nova/networks from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] remove_unused_resized_minimum_age_seconds : 3600 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] gateway_v6 : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] monkey_patch : False from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] rpc_conn_pool_size : 30 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] s3_host : 192.168.1.201 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] snapshot_image_format : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] libvirt_nonblocking : False from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] sqlite_synchronous : True from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] vmwareapi_host_ip : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] max_nbd_devices : 16 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] xenapi_connection_url : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] linuxnet_ovs_integration_bridge : br-int from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] volume_force_update_capabilities : False from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] scheduler_topic : scheduler from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] verbose : True from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] flat_network_bridge : br100 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] sql_max_retries : 10 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] num_iscsi_scan_tries : 3 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] default_instance_type : m1.small from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] metadata_listen : 0.0.0.0 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] firewall_driver : nova.virt.libvirt.firewall.IptablesFirewallDriver from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] libvirt_type : kvm from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] periodic_interval : 60 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] vpn_key_suffix : FLAG SET from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:409 2012-04-24 11:15:09 DEBUG nova.service [-] xenapi_vif_driver : nova.virt.xenapi.vif.XenAPIBridgeDriver from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] use_cow_images : True from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] osapi_volume_listen_port : 8776 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] gateway : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] null_kernel : nokernel from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] target_host : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] flat_interface : eth1 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] force_raw_images : True from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] instance_format : [instance: %(uuid)s] from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] osapi_compute_link_prefix : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] dmz_cidr : 10.128.0.0/24 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] rpc_response_timeout : 60 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] libvirt_xml_template : /usr/lib/python2.7/dist-packages/nova/virt/libvirt.xml.template from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] osapi_compute_ext_list : [] from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] default_notification_level : INFO from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] publish_errors : False from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] consoleauth_topic : consoleauth from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] xenapi_agent_path : usr/sbin/xe-update-networking from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] iscsi_helper : tgtadm from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] iscsi_port : 3260 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] novncproxy_base_url : http://127.0.0.1:6080/vnc_auto.html from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] service_down_time : 60 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] logging_exception_prefix : %(asctime)s TRACE %(name)s %(instance)s from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] enabled_apis : ['ec2', 'osapi_compute', 'osapi_volume', 'metadata'] from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] volume_api_class : nova.volume.api.API from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] vmwareapi_vlan_interface : vmnic0 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] report_interval : 10 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] scheduler_manager : nova.scheduler.manager.SchedulerManager from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] ec2_port : 8773 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] xenapi_running_timeout : 60 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] monkey_patch_modules : ['nova.api.ec2.cloud:nova.notifier.api.notify_decorator', 'nova.compute.api:nova.notifier.api.notify_decorator'] from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] rescue_kernel_id : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] rabbit_retry_backoff : 2 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] auth_token_ttl : 3600 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] quota_volumes : 10 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] libvirt_uri : from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] ec2_listen_port : 8773 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] ec2_scheme : http from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] vpn_image_id : 0 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] disable_process_locking : False from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] fixed_range_v6 : fd00::/48 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] block_migration_flag : VIR_MIGRATE_UNDEFINE_SOURCE, VIR_MIGRATE_PEER2PEER, VIR_MIGRATE_NON_SHARED_INC from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] dns_server : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] cert_topic : cert from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] quota_floating_ips : 10 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] fake_call : False from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] cpuinfo_xml_template : /usr/lib/python2.7/dist-packages/nova/virt/cpuinfo.xml.template from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] instance_dns_manager : nova.network.dns_driver.DNSDriver from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] sql_idle_timeout : 3600 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] glance_host : 192.168.1.202 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] xvpvncproxy_base_url : http://127.0.0.1:6081/console from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] default_image : ami-11111 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] aws_secret_access_key : FLAG SET from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:409 2012-04-24 11:15:09 DEBUG nova.service [-] use_ipv6 : False from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] log_format : %(asctime)s %(levelname)8s [%(name)s] %(message)s from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] iscsi_target_prefix : iqn.2010-10.org.openstack: from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] fake_network : False from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] metadata_port : 8775 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] force_dhcp_release : True from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] dhcpbridge_flagfile : /etc/nova/nova.conf from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] quota_gigabytes : 1000 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] region_list : [] from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] xenapi_vhd_coalesce_poll_interval : 5.0 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] dhcpbridge : /usr/bin/nova-dhcpbridge from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] vpn_start : 1000 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] xenapi_vhd_coalesce_max_attempts : 5 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] running_deleted_instance_timeout : 0 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] network_manager : nova.network.manager.FlatDHCPManager from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] root_helper : sudo nova-rootwrap from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] rescue_ramdisk_id : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] checksum_base_images : False from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] memcached_servers : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] logging_default_format_string : %(asctime)s %(levelname)s %(name)s [-] %(instance)s%(message)s from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] osapi_volume_ext_list : [] from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] find_host_timeout : 30 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] libvirt_wait_soft_reboot_seconds : 120 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] quota_max_injected_file_path_bytes : 255 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] default_os_type : linux from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] fake_rabbit : False from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] log_date_format : %Y-%m-%d %H:%M:%S from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] timeout_nbd : 10 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] block_device_creation_timeout : 10 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] rabbit_host : 192.168.1.201 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] rescue_timeout : 0 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] live_migration_flag : VIR_MIGRATE_UNDEFINE_SOURCE, VIR_MIGRATE_PEER2PEER from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] policy_default_rule : default from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] xenapi_login_timeout : 10 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] vncserver_listen : 127.0.0.1 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] use_syslog : False from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] rpc_thread_pool_size : 1024 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] use_single_default_gateway : False from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] osapi_path : /v1.1/ from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] syslog_log_facility : LOG_USER from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] ec2_path : /services/Cloud from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] vmware_vif_driver : nova.virt.vmwareapi.vif.VMWareVlanBridgeDriver from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] vmwareapi_api_retry_count : 10 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] linuxnet_interface_driver : nova.network.linux_net.LinuxBridgeInterfaceDriver from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] bindir : /usr/lib/python2.7/dist-packages/bin from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] rabbit_use_ssl : False from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] rabbit_retry_interval : 1 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] config_file : ['/tmp/nova-conf-YyGuFt/tmpsL0YlY.conf', '/tmp/nova-conf-YyGuFt/tmpIjYXET.conf'] from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] rbd_secret_uuid : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] agent_version_timeout : 300 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] network_api_class : nova.network.api.API from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] node_availability_zone : nova from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] rbd_user : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] db_driver : nova.db from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] rbd_pool : rbd from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] create_unique_mac_address_attempts : 5 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] img_handlers : ['loop', 'nbd', 'guestfs'] from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] volume_manager : nova.volume.manager.VolumeManager from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] start_guests_on_host_boot : True from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] pybasedir : /usr/lib/python2.7/dist-packages from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] xenapi_generate_swap : False from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] vlan_start : 100 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] metadata_manager : nova.api.manager.MetadataManager from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] sr_matching_filter : other-config:i18n-key=local-storage from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] l3_lib : nova.network.l3.LinuxNetL3 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] isolated_images : [] from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] vnc_enabled : True from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] api_paste_config : /etc/nova/api-paste.ini from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] xenapi_connection_password : FLAG SET from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:409 2012-04-24 11:15:09 DEBUG nova.service [-] rabbit_virtual_host : / from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] libvirt_volume_drivers : ['iscsi=nova.virt.libvirt.volume.LibvirtISCSIVolumeDriver', 'local=nova.virt.libvirt.volume.LibvirtVolumeDriver', 'fake=nova.virt.libvirt.volume.LibvirtFakeVolumeDriver', 'rbd=nova.virt.libvirt.volume.LibvirtNetVolumeDriver', 'sheepdog=nova.virt.libvirt.volume.LibvirtNetVolumeDriver'] from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] network_driver : nova.network.linux_net from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] quota_instances : 10 from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] vnc_keymap : FLAG SET from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:409 2012-04-24 11:15:09 DEBUG nova.service [-] image_service : nova.image.glance.GlanceImageService from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] libvirt_inject_password : FLAG SET from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:409 2012-04-24 11:15:09 DEBUG nova.service [-] control_exchange : nova from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] volume_group : nova-volumes from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] log_file : None from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] compute_manager : nova.compute.manager.ComputeManager from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] compute_driver : nova.virt.connection.get_connection from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 DEBUG nova.service [-] network_topic : network from (pid=4599) wait /usr/lib/python2.7/dist-packages/nova/service.py:411 2012-04-24 11:15:09 AUDIT nova.service [-] Starting compute node (version 2012.1-LOCALBRANCH:LOCALREVISION) 2012-04-24 11:15:09 DEBUG nova.utils [req-829f224c-3e3a-4457-8140-56f6b018edd8 None None] backend <module 'nova.db.sqlalchemy.api'="" from="" '="" usr="" lib="" python2.7="" dist-packages="" nova="" db="" sqlalchemy="" api.pyc'=""> from (pid=4599) __get_backend /usr/lib/python2.7/dist-packages/nova/utils.py:658 2012-04-24 11:15:09 DEBUG nova.compute.manager [req-829f224c-3e3a-4457-8140-56f6b018edd8 None None] [instance: 3355c6db-4a8c-4d29-9888-1eeedc980870] Checking state from (pid=4599) _get_power_state /usr/lib/python2.7/dist-packages/nova/compute/manager.py:260 2012-04-24 11:15:09 DEBUG nova.virt.libvirt.connection [req-829f224c-3e3a-4457-8140-56f6b018edd8 None None] Connecting to libvirt: qemu:///system from (pid=4599) _get_connection /usr/lib/python2.7/dist-packages/nova/virt/libvirt/connection.py:292 2012-04-24 11:15:09 DEBUG nova.compute.manager [req-829f224c-3e3a-4457-8140-56f6b018edd8 None None] [instance: 3355c6db-4a8c-4d29-9888-1eeedc980870] Current state is 8, state in DB is 5. from (pid=4599) init_host /usr/lib/python2.7/dist-packages/nova/compute/manager.py:241 2012-04-24 11:15:09 INFO nova.compute.manager [req-829f224c-3e3a-4457-8140-56f6b018edd8 None None] [instance: 3355c6db-4a8c-4d29-9888-1eeedc980870] Rebooting instance after nova-compute restart. 2012-04-24 11:15:09 INFO nova.compute.manager [req-829f224c-3e3a-4457-8140-56f6b018edd8 None None] check_instance_lock: decorating: |<function reboot_instance="" at="" 0x178c758="">| 2012-04-24 11:15:09 INFO nova.compute.manager [req-829f224c-3e3a-4457-8140-56f6b018edd8 None None] check_instance_lock: arguments: |<nova.compute.manager.computemanager object="" at="" 0x7f9a27176b90="">| |<nova.context.requestcontext object="" at="" 0x1e67290="">| |3355c6db-4a8c-4d29-9888-1eeedc980870| 2012-04-24 11:15:09 DEBUG nova.compute.manager [req-829f224c-3e3a-4457-8140-56f6b018edd8 None None] instance 3355c6db-4a8c-4d29-9888-1eeedc980870: getting locked state from (pid=4599) get_lock /usr/lib/python2.7/dist-packages/nova/compute/manager.py:1597 2012-04-24 11:15:09 INFO nova.compute.manager [req-829f224c-3e3a-4457-8140-56f6b018edd8 None None] check_instance_lock: locked: |False| 2012-04-24 11:15:09 INFO nova.compute.manager [req-829f224c-3e3a-4457-8140-56f6b018edd8 None None] check_instance_lock: admin: |True| 2012-04-24 11:15:09 INFO nova.compute.manager [req-829f224c-3e3a-4457-8140-56f6b018edd8 None None] check_instance_lock: executing: |<function reboot_instance="" at="" 0x178c758="">| 2012-04-24 11:15:09 AUDIT nova.compute.manager [req-829f224c-3e3a-4457-8140-56f6b018edd8 None None] Rebooting instance 3355c6db-4a8c-4d29-9888-1eeedc980870 2012-04-24 11:15:09 DEBUG nova.compute.manager [req-829f224c-3e3a-4457-8140-56f6b018edd8 None None] [instance: 3355c6db-4a8c-4d29-9888-1eeedc980870] Checking state from (pid=4599) _get_power_state /usr/lib/python2.7/dist-packages/nova/compute/manager.py:260 2012-04-24 11:15:10 WARNING nova.compute.manager [req-829f224c-3e3a-4457-8140-56f6b018edd8 None None] trying to reboot a non-running instance: 3355c6db-4a8c-4d29-9888-1eeedc980870 (state: 5 expected: 1) 2012-04-24 11:15:10 DEBUG nova.rpc.amqp [req-829f224c-3e3a-4457-8140-56f6b018edd8 None None] Making asynchronous call on network ... from (pid=4599) multicall /usr/lib/python2.7/dist-packages/nova/rpc/amqp.py:321 2012-04-24 11:15:10 DEBUG nova.rpc.amqp [req-829f224c-3e3a-4457-8140-56f6b018edd8 None None] MSG_ID is a26e2d9f773b43a39a33e30cd876cbcc from (pid=4599) multicall /usr/lib/python2.7/dist-packages/nova/rpc/amqp.py:324 2012-04-24 11:15:10 DEBUG nova.rpc.amqp [req-829f224c-3e3a-4457-8140-56f6b018edd8 None None] Pool creating new connection from (pid=4599) create /usr/lib/python2.7/dist-packages/nova/rpc/amqp.py:59 2012-04-24 11:15:10 INFO nova.rpc.common [req-829f224c-3e3a-4457-8140-56f6b018edd8 None None] Connected to AMQP server on 192.168.1.201:5672 2012-04-24 11:15:11 CRITICAL nova [-] Instance instance-0000000e could not be found. 2012-04-24 11:15:11 TRACE nova Traceback (most recent call last): 2012-04-24 11:15:11 TRACE nova File "/usr/bin/nova-compute", line 49, in <module> 2012-04-24 11:15:11 TRACE nova service.wait() 2012-04-24 11:15:11 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/service.py", line 413, in wait 2012-04-24 11:15:11 TRACE nova _launcher.wait() 2012-04-24 11:15:11 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/service.py", line 131, in wait 2012-04-24 11:15:11 TRACE nova service.wait() 2012-04-24 11:15:11 TRACE nova File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 166, in wait 2012-04-24 11:15:11 TRACE nova return self._exit_event.wait() 2012-04-24 11:15:11 TRACE nova File "/usr/lib/python2.7/dist-packages/eventlet/event.py", line 116, in wait 2012-04-24 11:15:11 TRACE nova return hubs.get_hub().switch() 2012-04-24 11:15:11 TRACE nova File "/usr/lib/python2.7/dist-packages/eventlet/hubs/hub.py", line 177, in switch 2012-04-24 11:15:11 TRACE nova return self.greenlet.switch() 2012-04-24 11:15:11 TRACE nova File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 192, in main 2012-04-24 11:15:11 TRACE nova result = function(args, *kwargs) 2012-04-24 11:15:11 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/service.py", line 101, in run_server 2012-04-24 11:15:11 TRACE nova server.start() 2012-04-24 11:15:11 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/service.py", line 162, in start 2012-04-24 11:15:11 TRACE nova self.manager.init_host() 2012-04-24 11:15:11 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 247, in init_host 2012-04-24 11:15:11 TRACE nova self.reboot_instance(context, instance['uuid']) 2012-04-24 11:15:11 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 114, in wrapped 2012-04-24 11:15:11 TRACE nova return f(args, *kw) 2012-04-24 11:15:11 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 153, in decorated_function 2012-04-24 11:15:11 TRACE nova function(self, context, instance_uuid, args, *kwargs) 2012-04-24 11:15:11 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 171, in decorated_function 2012-04-24 11:15:11 TRACE nova return function(self, context, instance_uuid, args, *kwargs) 2012-04-24 11:15:11 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 898, in reboot_instance 2012-04-24 11:15:11 TRACE nova reboot_type) 2012-04-24 11:15:11 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 114, in wrapped 2012-04-24 11:15:11 TRACE nova return f(args, *kw) 2012-04-24 11:15:11 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/connection.py", line 718, in reboot 2012-04-24 11:15:11 TRACE nova if self._soft_reboot(instance): 2012-04-24 11:15:11 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/connection.py", line 738, in _soft_reboot 2012-04-24 11:15:11 TRACE nova dom = self._lookup_by_name(instance.name) 2012-04-24 11:15:11 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/connection.py", line 1542, in _lookup_by_name 2012-04-24 11:15:11 TRACE nova raise exception.InstanceNotFound(instance_id=instance_name) 2012-04-24 11:15:11 TRACE nova InstanceNotFound: Instance instance-0000000e could not be found. 2012-04-24 11:15:11 TRACE nova