Ask Your Question
1

neutron stops working with multiple compute nodes

asked 2014-07-27 13:58:16 -0500

david.ward gravatar image

Hey guys,

Overview

I am working on a small set-up using 1 controller, 1 neutron networking node and 3 compute nodes. The set-up worked well with one compute node but as soon as I started the other two the networking stopped working... no errors in log files (even with verbose on). The only thing that worked was reinstalling the demo network and router but this only fixed things for a few mins....

DETAIL

I followed the wiki http://docs.openstack.org/icehouse/install-guide/install/yum/content/ch_preface.html (here) with a single compute node and everything worked perfectly. I was able to launch the test instance, ping external networks and ssh into it from external networks. I then processed to build out the last two compute nodes in the exact same way I did on the first. (with the slight change of the IPs for my_ip and vncserver_proxyclient_address in noca.conf).

When I attempted to start a new VM it refused to DHCP and the original VM was no longer able to ping anything including the virtual router...

After messing around with all the logs files, seeing nothing, i reinstalled the demo router and network... this worked for a few mins but then stopped again... The only error I could find was to do with nova showing:

2014-07-27 19:25:04.599 1698 WARNING keystoneclient.middleware.auth_token [-] Authorization failed for token

I have checked all the config files on each host and the only thing diffrent in them was the IPs

6c6
< my_ip = 10.10.0.32
---
> my_ip = 10.10.0.31
9c9
< vncserver_proxyclient_address = 10.10.0.32
---
> vncserver_proxyclient_address = 10.10.0.31

Question

Is there anything i need to be changing for multi node to be supported?

edit retag flag offensive close merge delete

2 answers

Sort by ยป oldest newest most voted
0

answered 2014-07-27 23:38:28 -0500

totten25 gravatar image

updated 2014-07-27 23:50:27 -0500

How's about neutron agent-list and ovs-vsctl show ? which connection type do you use between VLAN and GRE tunneling ? I never faced this problem. The neutron must work well with multiple compute node. I've installed icehouse with GRE tunneling which have 1 controller node, 1 network node and 15 compute nodes. If it has problem, it should has something in neutron log files. Anyway, I would like to suggest you to follow from OpenStack icehouse manual in main websites and I'm totally sure that everything work. I didn't find other websites for troubleshooting as same as previous versions.

edit flag offensive delete link more
0

answered 2014-07-28 01:39:15 -0500

david.ward gravatar image

Hey Totten25,

For connection between the hosts I use GRE:

[ml2_type_gre]
tunnel_type = gre

However I do have all 3 networks running over vlan tagged sub interfaces on a single nic. This is due to the number of ports I have free on the switch, the switch is not heavily loaded but it has allot of lab equipment plugged in. I did originally think that this was the issue however as it is working with a single compute node there is no reasoning for it not to work with multiple.

The output to those commands are below.

# neutron agent-list
+--------------------------------------+--------------------+------------+-------+----------------+
| id                                   | agent_type         | host       | alive | admin_state_up |
+--------------------------------------+--------------------+------------+-------+----------------+
| 62faa219-6ded-43d1-b259-f110ca3013dc | Open vSwitch agent | network    | :-)   | True           |
| 76f0fede-b541-4f2c-b64d-e139e5f72ef0 | Open vSwitch agent | comp03     | :-)   | True           |
| 88c740b7-bfd6-49fe-acdf-042c1e6df076 | L3 agent           | network    | :-)   | True           |
| a1b2526c-136a-417c-9b9c-db5c4d3e718a | Open vSwitch agent | comp01     | :-)   | True           |
| a3a3cc18-c89f-438e-8d46-ae125c357a10 | DHCP agent         | network    | :-)   | True           |
| dc65f326-02a2-4d9a-8f99-b054d328f578 | Open vSwitch agent | comp02     | :-)   | True           |
| ef9223b5-ac4a-4d7d-a980-dcc37148a594 | Metadata agent     | network    | :-)   | True           |
+--------------------------------------+--------------------+------------+-------+----------------+

# ovs-vsctl show
82c1c968-ac66-482c-b30a-7fc625838511
    Bridge br-int
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
        Port "qr-f62f3914-8f"
            tag: 2
            Interface "qr-f62f3914-8f"
                type: internal
        Port br-int
            Interface br-int
                type: internal
        Port "tapefe5a571-77"
            tag: 2
            Interface "tapefe5a571-77"
                type: internal
    Bridge br-ex
        Port "qg-650a8cd3-74"
            Interface "qg-650a8cd3-74"
                type: internal
        Port "eth4.138"
            Interface "eth4.138"
        Port br-ex
            Interface br-ex
                type: internal
    Bridge br-tun
        Port br-tun
            Interface br-tun
                type: internal
        Port "gre-0a648920"
            Interface "gre-0a648920"
                type: gre
                options: {in_key=flow, local_ip="10.10.1.21", out_key=flow, remote_ip="10.10.1.31"}
        Port "gre-0a648921"
            Interface "gre-0a648921"
                type: gre
                options: {in_key=flow, local_ip="10.10.1.21", out_key=flow, remote_ip="10.10.1.32"}
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port "gre-0a648922"
            Interface "gre-0a648922"
                type: gre
                options: {in_key=flow, local_ip="10.10.1.21", out_key=flow, remote_ip="10.10.1.33"}
    ovs_version: "1.11.0"
edit flag offensive delete link more

Comments

It seems your output is ok but i will show my neutron, nova files later. I think that your settings file are something wrong.

totten25 gravatar imagetotten25 ( 2014-07-28 02:24:43 -0500 )edit

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

Stats

Asked: 2014-07-27 13:58:16 -0500

Seen: 188 times

Last updated: Jul 28 '14