Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

nova network-create ERROR: The server has either erred or is incapable of performing the requested operation. (HTTP 500)

I am installing openstack Legacy Networking on 2 virtual machines, both run by kvm and own Ubuntu 14.04 OS. every thing was fine untill netwroking section of Openstack Ubuntu14.04.

whe i insert this command:

controller@controller:~$ nova network-create demo-net --bridge br100 --multi-host T --fixed-range-v4 192.168.1.0/24

this error pops up:

ERROR: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-54d6d35d-be6e-496e-844a-f65fe02a85a0)

here are my log files

**********LOG FILES**********

/var/log/nova/nova-api.log

controller@controller:~$ cat /var/log/nova/nova-api.log  | grep 18:04
2015-01-16 18:04:24.978 3841 ERROR nova.api.openstack [req-133c94da-b618-447b-a1cb-2db01226ac07 fae6f5682a874e63a5dca6c186f2e0f8 01b51d755c5b4ce1af6976bc6ae1726f] Caught error: Timed out waiting for a reply to message ID ab60fa10feac43388c4bb2e6598b2340
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack Traceback (most recent call last):
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/__init__.py", line 125, in __call__
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return req.get_response(self.application)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1320, in send
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     application, catch_exc_info=False)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1284, in call_application
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     app_iter = application(self.environ, start_response)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return resp(environ, start_response)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/keystoneclient/middleware/auth_token.py", line 582, in __call__
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return self.app(env, start_response)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return resp(environ, start_response)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return resp(environ, start_response)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/routes/middleware.py", line 131, in __call__
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     response = self.app(environ, start_response)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return resp(environ, start_response)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 130, in __call__
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     resp = self.call_func(req, *args, **self.kwargs)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 195, in call_func
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return self.func(req, *args, **kwargs)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py", line 917, in __call__
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     content_type, body, accept)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py", line 983, in _process_stack
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     action_result = self.dispatch(meth, request, action_args)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py", line 1070, in dispatch
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return method(req=request, **action_args)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/contrib/os_networks.py", line 131, in create
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     network = self.network_api.create(context, **params)[0]
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 101, in wrapped
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return func(self, context, *args, **kwargs)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 156, in create
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return self.network_rpcapi.create_networks(context, **kwargs)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/network/rpcapi.py", line 98, in create_networks
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return self.client.call(ctxt, 'create_networks', **kwargs)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/client.py", line 361, in call
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return self.prepare().call(ctxt, method, **kwargs)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/client.py", line 150, in call
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     wait_for_reply=True, timeout=timeout)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/oslo/messaging/transport.py", line 90, in _send
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     timeout=timeout)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 412, in send
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return self._send(target, ctxt, message, wait_for_reply, timeout)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 403, in _send
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     result = self._waiter.wait(msg_id, timeout)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 267, in wait
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     reply, ending = self._poll_connection(msg_id, timeout)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 217, in _poll_connection
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     % msg_id)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack MessagingTimeout: Timed out waiting for a reply to message ID ab60fa10feac43388c4bb2e6598b2340
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack 
2015-01-16 18:04:25.036 3841 INFO nova.api.openstack [req-133c94da-b618-447b-a1cb-2db01226ac07 fae6f5682a874e63a5dca6c186f2e0f8 01b51d755c5b4ce1af6976bc6ae1726f] http://controller:8774/v2/01b51d755c5b4ce1af6976bc6ae1726f/os-networks returned with HTTP 500
2015-01-16 18:04:25.036 3841 DEBUG nova.api.openstack.wsgi [req-133c94da-b618-447b-a1cb-2db01226ac07 fae6f5682a874e63a5dca6c186f2e0f8 01b51d755c5b4ce1af6976bc6ae1726f] Returning 500 to user: The server has either erred or is incapable of performing the requested operation. __call__ /usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py:1215
2015-01-16 18:04:25.042 3841 INFO nova.osapi_compute.wsgi.server [req-133c94da-b618-447b-a1cb-2db01226ac07 fae6f5682a874e63a5dca6c186f2e0f8 01b51d755c5b4ce1af6976bc6ae1726f] 192.168.1.11 "POST /v2/01b51d755c5b4ce1af6976bc6ae1726f/os-networks HTTP/1.1" status: 500 len: 335 time: 60.1302481
controller@controller:~$

****nova-cert.log********

controller@controller:~$ cat /var/log/nova/nova-cert.log  | grep 18:04
2015-01-16 18:04:23.006 3751 DEBUG nova.openstack.common.loopingcall [-] Dynamic looping call sleeping for 60.00 seconds _inner /usr/lib/python2.7/dist-packages/nova/openstack/common/loopingcall.py:132

***nova-conductor.log ********

controller@controller:~$ cat /var/log/nova/nova-conductor.log  | grep 18:04
2015-01-16 18:04:31.433 3836 DEBUG nova.openstack.common.loopingcall [-] Dynamic looping call sleeping for 60.00 seconds _inner /usr/lib/python2.7/dist-packages/nova/openstack/common/loopingcall.py:132

****nova-consoleauth.log******

controller@controller:~$ cat /var/log/nova/nova-consoleauth.log | grep 18:04
2015-01-16 18:04:39.169 3768 DEBUG nova.openstack.common.loopingcall [-] Dynamic looping call sleeping for 60.00 seconds _inner /usr/lib/python2.7/dist-packages/nova/openstack/common/loopingcall.py:132

********nova-scheduler.log********

controller@controller:~$ cat /var/log/nova/nova-scheduler.log | grep 18:04
2015-01-16 18:04:41.410 3785 DEBUG nova.openstack.common.periodic_task [-] Running periodic task SchedulerManager._expire_reservations run_periodic_tasks /usr/lib/python2.7/dist-packages/nova/openstack/common/periodic_task.py:178
2015-01-16 18:04:41.412 3785 DEBUG nova.openstack.common.periodic_task [-] Running periodic task SchedulerManager._run_periodic_tasks run_periodic_tasks /usr/lib/python2.7/dist-packages/nova/openstack/common/periodic_task.py:178
2015-01-16 18:04:41.412 3785 DEBUG nova.openstack.common.loopingcall [-] Dynamic looping call sleeping for 60.00 seconds _inner /usr/lib/python2.7/dist-packages/nova/openstack/common/loopingcall.py:132

********CONTROLLER NOVA.CONF*********

controller@controller:~$ sudo cat /etc/nova/nova.conf
[sudo] password for controller: 
[DEFAULT]
dhcpbridge_flagfile=/etc/nova/nova.conf
dhcpbridge=/usr/bin/nova-dhcpbridge
logdir=/var/log/nova
state_path=/var/lib/nova
lock_path=/var/lock/nova
force_dhcp_release=True
iscsi_helper=tgtadm
libvirt_use_virtio_for_bridges=True
connection_type=libvirt
root_helper=sudo nova-rootwrap /etc/nova/rootwrap.conf
verbose=True
ec2_private_dns_show_ip=True
api_paste_config=/etc/nova/api-paste.ini
volumes_path=/var/lib/nova/volumes
enabled_apis=ec2,osapi_compute,metadata
network_api_class = nova.network.api.API
security_group_api = nova
rpc_backend=rabbit
rabbit_host = controller
rabbit_password = 12345 
auth_strategy = keystone
debug=True
my_ip = 192.168.1.11
vncserver_listen = 192.168.1.11
vncserver_proxyclient_address = 192.168.1.11

[database]
connection = mysql://nova:myPass@controller/nova

[keystone_authtoken]

auth_uri = http://controller:5000/v2.0
identity_uri = http://controller:35357
admin_tenant_name = service
admin_user = nova
admin_password = 12345

auth_host = 127.0.0.1
auth_port = 35357
auth_protocol = http



[glance]
host = controller
controller@controller:~$ 

salar@controller:~$

******COMPUTE NOVA.CONF**********

compute@compute1:~$ sudo cat /etc/nova/nova.conf
[sudo] password for compute: 
[DEFAULT]
dhcpbridge_flagfile=/etc/nova/nova.conf
dhcpbridge=/usr/bin/nova-dhcpbridge
logdir=/var/log/nova
state_path=/var/lib/nova
lock_path=/var/lock/nova
force_dhcp_release=True
libvirt_use_virtio_for_bridges=True
verbose=True
ec2_private_dns_show_ip=True
api_paste_config=/etc/nova/api-paste.ini
enabled_apis=ec2,osapi_compute,metadata
rpc_backend = rabbit
rabbit_host = controller
rabbit_password = 12345 
auth_strategy = keystone
my_ip = 192.168.1.31
vnc_enabled = True
vncserver_listen = 0.0.0.0
vncserver_proxyclient_address = 192.168.1.31
novncproxy_base_url = http://controller:6080/vnc_auto.html

network_api_class = nova.network.api.API
security_group_api = nova
firewall_driver = nova.virt.libvirt.firewall.IptablesFirewallDriver
network_manager = nova.network.manager.FlatDHCPManager
network_size = 254
allow_same_net_traffic = False
multi_host = True
send_arp_for_ha = True
share_dhcp_address = True
force_dhcp_release = True
flat_network_bridge = br100
flat_interface = eth1
public_interface = eth1


[keystone_authtoken]

auth_uri = http://controller:5000/v2.0
identify_uri = http://controller:35357
admin_tenant_name = service
admin_user = nova
admin_password = 12345

auth_host = 127.0.0.1
auth_port = 35357
auth_protocol = http

[glance]
host = controller
compute@compute1:~$
salar@controller:~$

*********ON CONTROLLER NODE **********

controller@controller:~$ cat /etc/network/interfaces
# interfaces(5) file used by ifup(8) and ifdown(8)
auto lo
iface lo inet loopback

auto eth0
iface eth0 inet static
    address 192.168.1.11
    netmask 255.255.255.0
    gateway 192.168.1.1
    dns-nameservers 8.8.8.8 8.8.8.4 
controller@controller:~$  ping -c 4 controller 
PING controller (192.168.1.11) 56(84) bytes of data.
64 bytes from controller (192.168.1.11): icmp_seq=1 ttl=64 time=0.057 ms
64 bytes from controller (192.168.1.11): icmp_seq=2 ttl=64 time=0.046 ms
64 bytes from controller (192.168.1.11): icmp_seq=3 ttl=64 time=0.045 ms
64 bytes from controller (192.168.1.11): icmp_seq=4 ttl=64 time=0.034 ms

--- controller ping statistics ---
4 packets transmitted, 4 received, 0% packet loss, time 2999ms
rtt min/avg/max/mdev = 0.034/0.045/0.057/0.010 ms
controller@controller:~$ ping -c 4 compute1 
PING compute1 (192.168.1.31) 56(84) bytes of data.
64 bytes from compute1 (192.168.1.31): icmp_seq=1 ttl=64 time=0.280 ms
64 bytes from compute1 (192.168.1.31): icmp_seq=2 ttl=64 time=0.279 ms
64 bytes from compute1 (192.168.1.31): icmp_seq=3 ttl=64 time=0.290 ms
64 bytes from compute1 (192.168.1.31): icmp_seq=4 ttl=64 time=0.794 ms

--- compute1 ping statistics ---
4 packets transmitted, 4 received, 0% packet loss, time 2997ms
rtt min/avg/max/mdev = 0.279/0.410/0.794/0.222 ms
controller@controller:~$ ping openstack.org
PING openstack.org (192.237.193.83) 56(84) bytes of data.
64 bytes from 192.237.193.83: icmp_seq=1 ttl=39 time=294 ms
64 bytes from 192.237.193.83: icmp_seq=2 ttl=39 time=295 ms
64 bytes from 192.237.193.83: icmp_seq=3 ttl=39 time=293 ms
64 bytes from 192.237.193.83: icmp_seq=4 ttl=39 time=294 ms

controller@controller:~$ cat /etc/hosts
127.0.0.1   localhost   
#127.0.1.1  controller


#openstack
#.
#.
#controller node
192.168.1.11    controller
192.168.1.31    compute1
#.
#.
#/openstack

# The following lines are desirable for IPv6 capable hosts
::1     ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
controller@controller:~$

***********ON COMPUTE NODE ************

compute@compute1:~$ cat /etc/network/interfaces
# interfaces(5) file used by ifup(8) and ifdown(8)
auto lo
iface lo inet loopback

auto eth0
iface eth0 inet static
    address 192.168.1.31
    netmask 255.255.255.0
    gateway 192.168.1.1
dns-nameservers 8.8.8.8 8.8.8.4

auto eth1
iface eth1 inet manual
    up ip link set dev $IFACE up
    down ip link set dev $IFACE down
compute@compute1:~$ ping compute1 
PING compute1 (192.168.1.31) 56(84) bytes of data.
64 bytes from compute1 (192.168.1.31): icmp_seq=1 ttl=64 time=0.025 ms
64 bytes from compute1 (192.168.1.31): icmp_seq=2 ttl=64 time=0.031 ms
^C
--- compute1 ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 999ms
rtt min/avg/max/mdev = 0.025/0.028/0.031/0.003 ms
compute@compute1:~$ ping -c 4 controller 
PING controller (192.168.1.11) 56(84) bytes of data.
64 bytes from controller (192.168.1.11): icmp_seq=1 ttl=64 time=1.34 ms
64 bytes from controller (192.168.1.11): icmp_seq=2 ttl=64 time=0.297 ms
64 bytes from controller (192.168.1.11): icmp_seq=3 ttl=64 time=0.296 ms
64 bytes from controller (192.168.1.11): icmp_seq=4 ttl=64 time=0.335 ms

--- controller ping statistics ---
4 packets transmitted, 4 received, 0% packet loss, time 3000ms
rtt min/avg/max/mdev = 0.296/0.569/1.348/0.450 ms

compute@compute1:~$ ping -c 4 openstack.org
PING openstack.org (192.237.193.83) 56(84) bytes of data.
64 bytes from 192.237.193.83: icmp_seq=1 ttl=39 time=293 ms
64 bytes from 192.237.193.83: icmp_seq=2 ttl=39 time=293 ms
64 bytes from 192.237.193.83: icmp_seq=3 ttl=39 time=293 ms
64 bytes from 192.237.193.83: icmp_seq=4 ttl=39 time=294 ms

--- openstack.org ping statistics ---
4 packets transmitted, 4 received, 0% packet loss, time 3002ms
rtt min/avg/max/mdev = 293.625/293.836/294.254/0.599 ms
compute@compute1:~$ 

compute@compute1:~$ cat /etc/hosts
127.0.0.1   localhost
#127.0.1.1  compute1

#openstack
#.
#.
192.168.1.11    controller
192.168.1.31    compute1
#.
#.
#/openstack

# The following lines are desirable for IPv6 capable hosts
::1     ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
compute@compute1:~$

$ nova net-list : works fine > shows table with empty data

nova network-create ERROR: The server has either erred or is incapable of performing the requested operation. (HTTP 500)

I am installing openstack Legacy Networking on 2 virtual machines, both run by kvm and own Ubuntu 14.04 OS. every thing was fine untill netwroking section of Openstack Ubuntu14.04.

whe i insert this command:

controller@controller:~$ nova network-create demo-net --bridge br100 --multi-host T --fixed-range-v4 192.168.1.0/24

this error pops up:

ERROR: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-54d6d35d-be6e-496e-844a-f65fe02a85a0)

here are my log files

**********LOG FILES**********

/var/log/nova/nova-api.log

controller@controller:~$ cat /var/log/nova/nova-api.log  | grep 18:04
2015-01-16 18:04:24.978 3841 ERROR nova.api.openstack [req-133c94da-b618-447b-a1cb-2db01226ac07 fae6f5682a874e63a5dca6c186f2e0f8 01b51d755c5b4ce1af6976bc6ae1726f] Caught error: Timed out waiting for a reply to message ID ab60fa10feac43388c4bb2e6598b2340
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack Traceback (most recent call last):
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/__init__.py", line 125, in __call__
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return req.get_response(self.application)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1320, in send
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     application, catch_exc_info=False)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1284, in call_application
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     app_iter = application(self.environ, start_response)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return resp(environ, start_response)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/keystoneclient/middleware/auth_token.py", line 582, in __call__
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return self.app(env, start_response)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return resp(environ, start_response)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return resp(environ, start_response)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/routes/middleware.py", line 131, in __call__
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     response = self.app(environ, start_response)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return resp(environ, start_response)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 130, in __call__
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     resp = self.call_func(req, *args, **self.kwargs)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 195, in call_func
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return self.func(req, *args, **kwargs)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py", line 917, in __call__
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     content_type, body, accept)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py", line 983, in _process_stack
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     action_result = self.dispatch(meth, request, action_args)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py", line 1070, in dispatch
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return method(req=request, **action_args)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/contrib/os_networks.py", line 131, in create
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     network = self.network_api.create(context, **params)[0]
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 101, in wrapped
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return func(self, context, *args, **kwargs)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 156, in create
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return self.network_rpcapi.create_networks(context, **kwargs)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/network/rpcapi.py", line 98, in create_networks
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return self.client.call(ctxt, 'create_networks', **kwargs)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/client.py", line 361, in call
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return self.prepare().call(ctxt, method, **kwargs)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/client.py", line 150, in call
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     wait_for_reply=True, timeout=timeout)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/oslo/messaging/transport.py", line 90, in _send
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     timeout=timeout)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 412, in send
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     return self._send(target, ctxt, message, wait_for_reply, timeout)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 403, in _send
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     result = self._waiter.wait(msg_id, timeout)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 267, in wait
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     reply, ending = self._poll_connection(msg_id, timeout)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 217, in _poll_connection
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack     % msg_id)
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack MessagingTimeout: Timed out waiting for a reply to message ID ab60fa10feac43388c4bb2e6598b2340
2015-01-16 18:04:24.978 3841 TRACE nova.api.openstack 
2015-01-16 18:04:25.036 3841 INFO nova.api.openstack [req-133c94da-b618-447b-a1cb-2db01226ac07 fae6f5682a874e63a5dca6c186f2e0f8 01b51d755c5b4ce1af6976bc6ae1726f] http://controller:8774/v2/01b51d755c5b4ce1af6976bc6ae1726f/os-networks returned with HTTP 500
2015-01-16 18:04:25.036 3841 DEBUG nova.api.openstack.wsgi [req-133c94da-b618-447b-a1cb-2db01226ac07 fae6f5682a874e63a5dca6c186f2e0f8 01b51d755c5b4ce1af6976bc6ae1726f] Returning 500 to user: The server has either erred or is incapable of performing the requested operation. __call__ /usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py:1215
2015-01-16 18:04:25.042 3841 INFO nova.osapi_compute.wsgi.server [req-133c94da-b618-447b-a1cb-2db01226ac07 fae6f5682a874e63a5dca6c186f2e0f8 01b51d755c5b4ce1af6976bc6ae1726f] 192.168.1.11 "POST /v2/01b51d755c5b4ce1af6976bc6ae1726f/os-networks HTTP/1.1" status: 500 len: 335 time: 60.1302481
controller@controller:~$

****nova-cert.log********

controller@controller:~$ cat /var/log/nova/nova-cert.log  | grep 18:04
2015-01-16 18:04:23.006 3751 DEBUG nova.openstack.common.loopingcall [-] Dynamic looping call sleeping for 60.00 seconds _inner /usr/lib/python2.7/dist-packages/nova/openstack/common/loopingcall.py:132

***nova-conductor.log ********

controller@controller:~$ cat /var/log/nova/nova-conductor.log  | grep 18:04
2015-01-16 18:04:31.433 3836 DEBUG nova.openstack.common.loopingcall [-] Dynamic looping call sleeping for 60.00 seconds _inner /usr/lib/python2.7/dist-packages/nova/openstack/common/loopingcall.py:132

****nova-consoleauth.log******

controller@controller:~$ cat /var/log/nova/nova-consoleauth.log | grep 18:04
2015-01-16 18:04:39.169 3768 DEBUG nova.openstack.common.loopingcall [-] Dynamic looping call sleeping for 60.00 seconds _inner /usr/lib/python2.7/dist-packages/nova/openstack/common/loopingcall.py:132

********nova-scheduler.log********

controller@controller:~$ cat /var/log/nova/nova-scheduler.log | grep 18:04
2015-01-16 18:04:41.410 3785 DEBUG nova.openstack.common.periodic_task [-] Running periodic task SchedulerManager._expire_reservations run_periodic_tasks /usr/lib/python2.7/dist-packages/nova/openstack/common/periodic_task.py:178
2015-01-16 18:04:41.412 3785 DEBUG nova.openstack.common.periodic_task [-] Running periodic task SchedulerManager._run_periodic_tasks run_periodic_tasks /usr/lib/python2.7/dist-packages/nova/openstack/common/periodic_task.py:178
2015-01-16 18:04:41.412 3785 DEBUG nova.openstack.common.loopingcall [-] Dynamic looping call sleeping for 60.00 seconds _inner /usr/lib/python2.7/dist-packages/nova/openstack/common/loopingcall.py:132

********CONTROLLER NOVA.CONF*********

controller@controller:~$ sudo cat /etc/nova/nova.conf
[sudo] password for controller: 
[DEFAULT]
dhcpbridge_flagfile=/etc/nova/nova.conf
dhcpbridge=/usr/bin/nova-dhcpbridge
logdir=/var/log/nova
state_path=/var/lib/nova
lock_path=/var/lock/nova
force_dhcp_release=True
iscsi_helper=tgtadm
libvirt_use_virtio_for_bridges=True
connection_type=libvirt
root_helper=sudo nova-rootwrap /etc/nova/rootwrap.conf
verbose=True
ec2_private_dns_show_ip=True
api_paste_config=/etc/nova/api-paste.ini
volumes_path=/var/lib/nova/volumes
enabled_apis=ec2,osapi_compute,metadata
network_api_class = nova.network.api.API
security_group_api = nova
rpc_backend=rabbit
rabbit_host = controller
rabbit_password = 12345 
auth_strategy = keystone
debug=True
my_ip = 192.168.1.11
vncserver_listen = 192.168.1.11
vncserver_proxyclient_address = 192.168.1.11

[database]
connection = mysql://nova:myPass@controller/nova

[keystone_authtoken]

auth_uri = http://controller:5000/v2.0
identity_uri = http://controller:35357
admin_tenant_name = service
admin_user = nova
admin_password = 12345

auth_host = 127.0.0.1
auth_port = 35357
auth_protocol = http



[glance]
host = controller
controller@controller:~$ 

salar@controller:~$

******COMPUTE NOVA.CONF**********

compute@compute1:~$ sudo cat /etc/nova/nova.conf
[sudo] password for compute: 
[DEFAULT]
dhcpbridge_flagfile=/etc/nova/nova.conf
dhcpbridge=/usr/bin/nova-dhcpbridge
logdir=/var/log/nova
state_path=/var/lib/nova
lock_path=/var/lock/nova
force_dhcp_release=True
libvirt_use_virtio_for_bridges=True
verbose=True
ec2_private_dns_show_ip=True
api_paste_config=/etc/nova/api-paste.ini
enabled_apis=ec2,osapi_compute,metadata
rpc_backend = rabbit
rabbit_host = controller
rabbit_password = 12345 
auth_strategy = keystone
my_ip = 192.168.1.31
vnc_enabled = True
vncserver_listen = 0.0.0.0
vncserver_proxyclient_address = 192.168.1.31
novncproxy_base_url = http://controller:6080/vnc_auto.html

network_api_class = nova.network.api.API
security_group_api = nova
firewall_driver = nova.virt.libvirt.firewall.IptablesFirewallDriver
network_manager = nova.network.manager.FlatDHCPManager
network_size = 254
allow_same_net_traffic = False
multi_host = True
send_arp_for_ha = True
share_dhcp_address = True
force_dhcp_release = True
flat_network_bridge = br100
flat_interface = eth1
public_interface = eth1


[keystone_authtoken]

auth_uri = http://controller:5000/v2.0
identify_uri = http://controller:35357
admin_tenant_name = service
admin_user = nova
admin_password = 12345

auth_host = 127.0.0.1
auth_port = 35357
auth_protocol = http

[glance]
host = controller
compute@compute1:~$
salar@controller:~$

*********ON CONTROLLER NODE **********

controller@controller:~$ cat /etc/network/interfaces
# interfaces(5) file used by ifup(8) and ifdown(8)
auto lo
iface lo inet loopback

auto eth0
iface eth0 inet static
    address 192.168.1.11
    netmask 255.255.255.0
    gateway 192.168.1.1
    dns-nameservers 8.8.8.8 8.8.8.4 
controller@controller:~$  ping -c 4 controller 
PING controller (192.168.1.11) 56(84) bytes of data.
64 bytes from controller (192.168.1.11): icmp_seq=1 ttl=64 time=0.057 ms
64 bytes from controller (192.168.1.11): icmp_seq=2 ttl=64 time=0.046 ms
64 bytes from controller (192.168.1.11): icmp_seq=3 ttl=64 time=0.045 ms
64 bytes from controller (192.168.1.11): icmp_seq=4 ttl=64 time=0.034 ms

--- controller ping statistics ---
4 packets transmitted, 4 received, 0% packet loss, time 2999ms
rtt min/avg/max/mdev = 0.034/0.045/0.057/0.010 ms
controller@controller:~$ ping -c 4 compute1 
PING compute1 (192.168.1.31) 56(84) bytes of data.
64 bytes from compute1 (192.168.1.31): icmp_seq=1 ttl=64 time=0.280 ms
64 bytes from compute1 (192.168.1.31): icmp_seq=2 ttl=64 time=0.279 ms
64 bytes from compute1 (192.168.1.31): icmp_seq=3 ttl=64 time=0.290 ms
64 bytes from compute1 (192.168.1.31): icmp_seq=4 ttl=64 time=0.794 ms

--- compute1 ping statistics ---
4 packets transmitted, 4 received, 0% packet loss, time 2997ms
rtt min/avg/max/mdev = 0.279/0.410/0.794/0.222 ms
controller@controller:~$ ping openstack.org
PING openstack.org (192.237.193.83) 56(84) bytes of data.
64 bytes from 192.237.193.83: icmp_seq=1 ttl=39 time=294 ms
64 bytes from 192.237.193.83: icmp_seq=2 ttl=39 time=295 ms
64 bytes from 192.237.193.83: icmp_seq=3 ttl=39 time=293 ms
64 bytes from 192.237.193.83: icmp_seq=4 ttl=39 time=294 ms

controller@controller:~$ cat /etc/hosts
127.0.0.1   localhost   
#127.0.1.1  controller


#openstack
#.
#.
#controller node
192.168.1.11    controller
192.168.1.31    compute1
#.
#.
#/openstack

# The following lines are desirable for IPv6 capable hosts
::1     ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
controller@controller:~$

***********ON COMPUTE NODE ************

compute@compute1:~$ cat /etc/network/interfaces
# interfaces(5) file used by ifup(8) and ifdown(8)
auto lo
iface lo inet loopback

auto eth0
iface eth0 inet static
    address 192.168.1.31
    netmask 255.255.255.0
    gateway 192.168.1.1
dns-nameservers 8.8.8.8 8.8.8.4

auto eth1
iface eth1 inet manual
    up ip link set dev $IFACE up
    down ip link set dev $IFACE down
compute@compute1:~$ ping compute1 
PING compute1 (192.168.1.31) 56(84) bytes of data.
64 bytes from compute1 (192.168.1.31): icmp_seq=1 ttl=64 time=0.025 ms
64 bytes from compute1 (192.168.1.31): icmp_seq=2 ttl=64 time=0.031 ms
^C
--- compute1 ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 999ms
rtt min/avg/max/mdev = 0.025/0.028/0.031/0.003 ms
compute@compute1:~$ ping -c 4 controller 
PING controller (192.168.1.11) 56(84) bytes of data.
64 bytes from controller (192.168.1.11): icmp_seq=1 ttl=64 time=1.34 ms
64 bytes from controller (192.168.1.11): icmp_seq=2 ttl=64 time=0.297 ms
64 bytes from controller (192.168.1.11): icmp_seq=3 ttl=64 time=0.296 ms
64 bytes from controller (192.168.1.11): icmp_seq=4 ttl=64 time=0.335 ms

--- controller ping statistics ---
4 packets transmitted, 4 received, 0% packet loss, time 3000ms
rtt min/avg/max/mdev = 0.296/0.569/1.348/0.450 ms

compute@compute1:~$ ping -c 4 openstack.org
PING openstack.org (192.237.193.83) 56(84) bytes of data.
64 bytes from 192.237.193.83: icmp_seq=1 ttl=39 time=293 ms
64 bytes from 192.237.193.83: icmp_seq=2 ttl=39 time=293 ms
64 bytes from 192.237.193.83: icmp_seq=3 ttl=39 time=293 ms
64 bytes from 192.237.193.83: icmp_seq=4 ttl=39 time=294 ms

--- openstack.org ping statistics ---
4 packets transmitted, 4 received, 0% packet loss, time 3002ms
rtt min/avg/max/mdev = 293.625/293.836/294.254/0.599 ms
compute@compute1:~$ 

compute@compute1:~$ cat /etc/hosts
127.0.0.1   localhost
#127.0.1.1  compute1

#openstack
#.
#.
192.168.1.11    controller
192.168.1.31    compute1
#.
#.
#/openstack

# The following lines are desirable for IPv6 capable hosts
::1     ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
compute@compute1:~$

$ nova net-list : works fine > shows table with empty data

and also on compute node when i insert the comand of nova-network i get these msges :

compute@compute:~$ nova-network 
2015-01-16 19:26:44.968 2927 INFO oslo.messaging._drivers.impl_rabbit [req-8edc870f-46f9-4c2f-b092-94cc3a9bf26e ] Connecting to AMQP server on localhost:5672
2015-01-16 19:26:44.972 2927 ERROR oslo.messaging._drivers.impl_rabbit [req-8edc870f-46f9-4c2f-b092-94cc3a9bf26e ] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
2015-01-16 19:26:45.973 2927 INFO oslo.messaging._drivers.impl_rabbit [req-8edc870f-46f9-4c2f-b092-94cc3a9bf26e ] Delaying reconnect for 1.0 seconds...
2015-01-16 19:26:46.975 2927 INFO oslo.messaging._drivers.impl_rabbit [req-8edc870f-46f9-4c2f-b092-94cc3a9bf26e ] Connecting to AMQP server on localhost:5672
2015-01-16 19:26:47.001 2927 ERROR oslo.messaging._drivers.impl_rabbit [req-8edc870f-46f9-4c2f-b092-94cc3a9bf26e ] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 3 seconds.
2015-01-16 19:26:50.013 2927 INFO oslo.messaging._drivers.impl_rabbit [req-8edc870f-46f9-4c2f-b092-94cc3a9bf26e ] Delaying reconnect for 1.0 seconds...
2015-01-16 19:26:51.015 2927 INFO oslo.messaging._drivers.impl_rabbit [req-8edc870f-46f9-4c2f-b092-94cc3a9bf26e ] Connecting to AMQP server on localhost:5672
2015-01-16 19:26:51.018 2927 ERROR oslo.messaging._drivers.impl_rabbit [req-8edc870f-46f9-4c2f-b092-94cc3a9bf26e ] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 5 seconds.
2015-01-16 19:26:56.022 2927 INFO oslo.messaging._drivers.impl_rabbit [req-8edc870f-46f9-4c2f-b092-94cc3a9bf26e ] Delaying reconnect for 1.0 seconds...
2015-01-16 19:26:57.024 2927 INFO oslo.messaging._drivers.impl_rabbit [req-8edc870f-46f9-4c2f-b092-94cc3a9bf26e ] Connecting to AMQP server on localhost:5672
2015-01-16 19:26:57.038 2927 ERROR oslo.messaging._drivers.impl_rabbit [req-8edc870f-46f9-4c2f-b092-94cc3a9bf26e ] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 7 seconds.
^C