# neutron stops working with multiple compute nodes

Hey guys,

Overview

I am working on a small set-up using 1 controller, 1 neutron networking node and 3 compute nodes. The set-up worked well with one compute node but as soon as I started the other two the networking stopped working... no errors in log files (even with verbose on). The only thing that worked was reinstalling the demo network and router but this only fixed things for a few mins....

DETAIL

I followed the wiki http://docs.openstack.org/icehouse/install-guide/install/yum/content/ch_preface.html (here) with a single compute node and everything worked perfectly. I was able to launch the test instance, ping external networks and ssh into it from external networks. I then processed to build out the last two compute nodes in the exact same way I did on the first. (with the slight change of the IPs for my_ip and vncserver_proxyclient_address in noca.conf).

When I attempted to start a new VM it refused to DHCP and the original VM was no longer able to ping anything including the virtual router...

After messing around with all the logs files, seeing nothing, i reinstalled the demo router and network... this worked for a few mins but then stopped again... The only error I could find was to do with nova showing:

2014-07-27 19:25:04.599 1698 WARNING keystoneclient.middleware.auth_token [-] Authorization failed for token


I have checked all the config files on each host and the only thing diffrent in them was the IPs

6c6
< my_ip = 10.10.0.32
---
> my_ip = 10.10.0.31
9c9
---


Question

Is there anything i need to be changing for multi node to be supported?

edit retag close merge delete

Sort by » oldest newest most voted

How's about neutron agent-list and ovs-vsctl show ? which connection type do you use between VLAN and GRE tunneling ? I never faced this problem. The neutron must work well with multiple compute node. I've installed icehouse with GRE tunneling which have 1 controller node, 1 network node and 15 compute nodes. If it has problem, it should has something in neutron log files. Anyway, I would like to suggest you to follow from OpenStack icehouse manual in main websites and I'm totally sure that everything work. I didn't find other websites for troubleshooting as same as previous versions.

more

Hey Totten25,

For connection between the hosts I use GRE:

[ml2_type_gre]
tunnel_type = gre


However I do have all 3 networks running over vlan tagged sub interfaces on a single nic. This is due to the number of ports I have free on the switch, the switch is not heavily loaded but it has allot of lab equipment plugged in. I did originally think that this was the issue however as it is working with a single compute node there is no reasoning for it not to work with multiple.

The output to those commands are below.

# neutron agent-list
+--------------------------------------+--------------------+------------+-------+----------------+
| id                                   | agent_type         | host       | alive | admin_state_up |
+--------------------------------------+--------------------+------------+-------+----------------+
| 62faa219-6ded-43d1-b259-f110ca3013dc | Open vSwitch agent | network    | :-)   | True           |
| 76f0fede-b541-4f2c-b64d-e139e5f72ef0 | Open vSwitch agent | comp03     | :-)   | True           |
| 88c740b7-bfd6-49fe-acdf-042c1e6df076 | L3 agent           | network    | :-)   | True           |
| a1b2526c-136a-417c-9b9c-db5c4d3e718a | Open vSwitch agent | comp01     | :-)   | True           |
| a3a3cc18-c89f-438e-8d46-ae125c357a10 | DHCP agent         | network    | :-)   | True           |
| dc65f326-02a2-4d9a-8f99-b054d328f578 | Open vSwitch agent | comp02     | :-)   | True           |
| ef9223b5-ac4a-4d7d-a980-dcc37148a594 | Metadata agent     | network    | :-)   | True           |
+--------------------------------------+--------------------+------------+-------+----------------+


# ovs-vsctl show
82c1c968-ac66-482c-b30a-7fc625838511
Bridge br-int
Port patch-tun
Interface patch-tun
type: patch
options: {peer=patch-int}
Port "qr-f62f3914-8f"
tag: 2
Interface "qr-f62f3914-8f"
type: internal
Port br-int
Interface br-int
type: internal
Port "tapefe5a571-77"
tag: 2
Interface "tapefe5a571-77"
type: internal
Bridge br-ex
Port "qg-650a8cd3-74"
Interface "qg-650a8cd3-74"
type: internal
Port "eth4.138"
Interface "eth4.138"
Port br-ex
Interface br-ex
type: internal
Bridge br-tun
Port br-tun
Interface br-tun
type: internal
Port "gre-0a648920"
Interface "gre-0a648920"
type: gre
options: {in_key=flow, local_ip="10.10.1.21", out_key=flow, remote_ip="10.10.1.31"}
Port "gre-0a648921"
Interface "gre-0a648921"
type: gre
options: {in_key=flow, local_ip="10.10.1.21", out_key=flow, remote_ip="10.10.1.32"}
Port patch-int
Interface patch-int
type: patch
options: {peer=patch-tun}
Port "gre-0a648922"
Interface "gre-0a648922"
type: gre
options: {in_key=flow, local_ip="10.10.1.21", out_key=flow, remote_ip="10.10.1.33"}
ovs_version: "1.11.0"

more

It seems your output is ok but i will show my neutron, nova files later. I think that your settings file are something wrong.

( 2014-07-28 02:24:43 -0500 )edit

# Get to know Ask OpenStack

Resources for moderators