Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

asked 2016-05-26 22:53:21 -0500

don gravatar image

vxlan peers not being created (mitaka openvswitch agent native driver)

My vxlan peers are not coming up (not being created). Below is the config of a compute node. There are no errors, it just doesn't create the vxlan tunnel interface. Can you suggest where to look?

(This is on Ubunto 16.04 with Mitaka)

If i look in the database:

mysql> select * from ml2_vxlan_endpoints;
+---------------+----------+---------+
| ip_address    | udp_port | host    |
+---------------+----------+---------+
| 10.100.10.122 |     4789 | nubo-19 |
| 10.100.10.123 |     4789 | nubo-20 |
| 10.100.10.124 |     4789 | nubo-21 |
| 10.100.10.126 |     4789 | nubo-23 |
| 10.100.10.64  |     4789 | nubo-5  |
| 10.100.10.65  |     4789 | nubo-6  |
| 10.100.10.67  |     4789 | nubo-8  |
| 10.100.10.68  |     4789 | nubo-9  |
| 10.100.10.75  |     4789 | nubo-16 |
| 167.88.32.134 |     4789 | nubo-4  |
+---------------+----------+---------+
10 rows in set (0.00 sec)

the node w/ the config below is nubo-23 (they are all the same).

I don't see any errors in the logs. Not a 1.

i'm expecting to see an entry in br-tun like:

Bridge br-tun Port "vxlan-0a640a97" Interface "vxlan-0a640a97" type: vxlan options: {df_default="true", in_key=flow, local_ip="167.88.32.136", out_key=flow, remote_ip="10.100.10.151"}

but i have no entries.

This is on Ubuntu 16.04.

mysql> select * from ml2_vxlan_allocations where allocated = 1;
+-----------+-----------+
| vxlan_vni | allocated |
+-----------+-----------+
|        63 |         1 |
+-----------+-----------+
1 row in set (0.00 sec)

ml2_conf.ini::

[ml2]
type_drivers = vxlan
tenant_network_types = vxlan
mechanism_drivers = openvswitch

[ml2_type_flat]
flat_networks = *

[ml2_type_vxlan]
vni_ranges = 1:32000
#vxlan_group = 239.1.1.2

[securitygroup]
enable_security_group = false

openvswitch_agent.ini::

[agent]
arp_responder = True
l2_population = True
minimize_polling = True
ovsdb_monitor_respawn_interval = 30
polling_interval = 5
prevent_arp_spoofing = False
tunnel_types = vxlan

[ovs]
bridge_mappings = physnet1:br-ex
enable_tunneling=True
local_ip = 10.100.10.126
of_interface = native
ovsdb_connection = tcp:127.0.0.1:6640
ovsdb_interface = native
tenant_network_type = vxlan
tunnel_id_ranges = 1:32000
tunnel_type = vxlan

[securitygroup]
firewall_driver = neutron.agent.firewall.NoopFirewallDriver
#firewall_driver=neutron.agent.linux.iptables_firewall.OVSHybridIptablesFirewallDriver

enable_security_group = False

ovs-vsctl output::

1b3be5ce-7ae1-41b1-9bc0-7c4e2e088414
    Manager "ptcp:6640:127.0.0.1"
        is_connected: true
    Bridge br-int
        Controller "tcp:127.0.0.1:6633"
            is_connected: true
        fail_mode: secure
        Port br-int
            Interface br-int
                type: internal
        Port int-br-ex
            Interface int-br-ex
                type: patch
                options: {peer=phy-br-ex}
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
    Bridge br-ex
        Controller "tcp:127.0.0.1:6633"
            is_connected: true
        Port phy-br-ex
            Interface phy-br-ex
                type: patch
                options: {peer=int-br-ex}
        Port "enp3s0f1"
            Interface "enp3s0f1"
        Port br-ex
            Interface br-ex
                type: internal
    Bridge br-tun
        Controller "tcp:127.0.0.1:6633"
            is_connected: true
        fail_mode: secure
        Port br-tun
            Interface br-tun
                type: internal
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
    ovs_version: "2.5.0"

ifconfig::

br-ex     Link encap:Ethernet  HWaddr d0:43:1e:d6:03:35 
          inet addr:10.100.10.126  Bcast:10.100.10.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:9000  Metric:1
          RX packets:295129 errors:0 dropped:4 overruns:0 frame:0
          TX packets:45436 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1
          RX bytes:27115572 (27.1 MB)  TX bytes:9312921 (9.3 MB)

br-int    Link encap:Ethernet  HWaddr b2:e7:33:0a:8c:4f 
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:35 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1
          RX bytes:3452 (3.4 KB)  TX bytes:0 (0.0 B)

br-tun    Link encap:Ethernet  HWaddr 1e:8c:dc:d7:f5:4e 
          UP BROADCAST RUNNING MULTICAST  MTU:9000  Metric:1
          RX packets:7 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1
          RX bytes:322 (322.0 B)  TX bytes:0 (0.0 B)

docker0   Link encap:Ethernet  HWaddr 02:42:e6:ad:04:fe 
          inet addr:172.17.0.1  Bcast:0.0.0.0  Mask:255.255.0.0
          UP BROADCAST MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

eno1      Link encap:Ethernet  HWaddr d0:43:1e:d6:03:2f 
          inet addr:192.168.10.126  Bcast:192.168.10.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:135622 errors:0 dropped:0 overruns:0 frame:0
          TX packets:1309 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:8152083 (8.1 MB)  TX bytes:489822 (489.8 KB)

enp3s0f1  Link encap:Ethernet  HWaddr d0:43:1e:d6:03:35 
          UP BROADCAST RUNNING MULTICAST  MTU:9000  Metric:1
          RX packets:297590 errors:0 dropped:0 overruns:0 frame:0
          TX packets:46479 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:31439747 (31.4 MB)  TX bytes:9381759 (9.3 MB)

lo        Link encap:Local Loopback 
          inet addr:127.0.0.1  Mask:255.0.0.0
          UP LOOPBACK RUNNING  MTU:65536  Metric:1
          RX packets:77136 errors:0 dropped:0 overruns:0 frame:0
          TX packets:77136 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1
          RX bytes:6224382 (6.2 MB)  TX bytes:6224382 (6.2 MB)

vxlan peers not being created (mitaka openvswitch agent native driver)

My vxlan peers are not coming up (not being created). Below is the config of a compute node. There are no errors, it just doesn't create the vxlan tunnel interface. Can you suggest where to look?

(This is on Ubunto 16.04 with Mitaka)

If i look in the database:

mysql> select * from ml2_vxlan_endpoints;
+---------------+----------+---------+
| ip_address    | udp_port | host    |
+---------------+----------+---------+
| 10.100.10.122 |     4789 | nubo-19 |
| 10.100.10.123 |     4789 | nubo-20 |
| 10.100.10.124 |     4789 | nubo-21 |
| 10.100.10.126 |     4789 | nubo-23 |
| 10.100.10.64  |     4789 | nubo-5  |
| 10.100.10.65  |     4789 | nubo-6  |
| 10.100.10.67  |     4789 | nubo-8  |
| 10.100.10.68  |     4789 | nubo-9  |
| 10.100.10.75  |     4789 | nubo-16 |
| 167.88.32.134 |     4789 | nubo-4  |
+---------------+----------+---------+
10 rows in set (0.00 sec)

the node w/ the config below is nubo-23 (they are all the same).

I don't see any errors in the logs. Not a 1.

i'm expecting to see an entry in br-tun like:

Bridge br-tun Port "vxlan-0a640a97" Interface "vxlan-0a640a97" type: vxlan options: {df_default="true", in_key=flow, local_ip="167.88.32.136", local_ip="xx.xx.xx.xx", out_key=flow, remote_ip="10.100.10.151"}

but i have no entries.

This is on Ubuntu 16.04.

mysql> select * from ml2_vxlan_allocations where allocated = 1;
+-----------+-----------+
| vxlan_vni | allocated |
+-----------+-----------+
|        63 |         1 |
+-----------+-----------+
1 row in set (0.00 sec)

ml2_conf.ini::

[ml2]
type_drivers = vxlan
tenant_network_types = vxlan
mechanism_drivers = openvswitch

[ml2_type_flat]
flat_networks = *

[ml2_type_vxlan]
vni_ranges = 1:32000
#vxlan_group = 239.1.1.2

[securitygroup]
enable_security_group = false

openvswitch_agent.ini::

[agent]
arp_responder = True
l2_population = True
minimize_polling = True
ovsdb_monitor_respawn_interval = 30
polling_interval = 5
prevent_arp_spoofing = False
tunnel_types = vxlan

[ovs]
bridge_mappings = physnet1:br-ex
enable_tunneling=True
local_ip = 10.100.10.126
of_interface = native
ovsdb_connection = tcp:127.0.0.1:6640
ovsdb_interface = native
tenant_network_type = vxlan
tunnel_id_ranges = 1:32000
tunnel_type = vxlan

[securitygroup]
firewall_driver = neutron.agent.firewall.NoopFirewallDriver
#firewall_driver=neutron.agent.linux.iptables_firewall.OVSHybridIptablesFirewallDriver

enable_security_group = False

ovs-vsctl output::

1b3be5ce-7ae1-41b1-9bc0-7c4e2e088414
    Manager "ptcp:6640:127.0.0.1"
        is_connected: true
    Bridge br-int
        Controller "tcp:127.0.0.1:6633"
            is_connected: true
        fail_mode: secure
        Port br-int
            Interface br-int
                type: internal
        Port int-br-ex
            Interface int-br-ex
                type: patch
                options: {peer=phy-br-ex}
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
    Bridge br-ex
        Controller "tcp:127.0.0.1:6633"
            is_connected: true
        Port phy-br-ex
            Interface phy-br-ex
                type: patch
                options: {peer=int-br-ex}
        Port "enp3s0f1"
            Interface "enp3s0f1"
        Port br-ex
            Interface br-ex
                type: internal
    Bridge br-tun
        Controller "tcp:127.0.0.1:6633"
            is_connected: true
        fail_mode: secure
        Port br-tun
            Interface br-tun
                type: internal
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
    ovs_version: "2.5.0"

ifconfig::

br-ex     Link encap:Ethernet  HWaddr d0:43:1e:d6:03:35 
          inet addr:10.100.10.126  Bcast:10.100.10.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:9000  Metric:1
          RX packets:295129 errors:0 dropped:4 overruns:0 frame:0
          TX packets:45436 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1
          RX bytes:27115572 (27.1 MB)  TX bytes:9312921 (9.3 MB)

br-int    Link encap:Ethernet  HWaddr b2:e7:33:0a:8c:4f 
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:35 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1
          RX bytes:3452 (3.4 KB)  TX bytes:0 (0.0 B)

br-tun    Link encap:Ethernet  HWaddr 1e:8c:dc:d7:f5:4e 
          UP BROADCAST RUNNING MULTICAST  MTU:9000  Metric:1
          RX packets:7 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1
          RX bytes:322 (322.0 B)  TX bytes:0 (0.0 B)

docker0   Link encap:Ethernet  HWaddr 02:42:e6:ad:04:fe 
          inet addr:172.17.0.1  Bcast:0.0.0.0  Mask:255.255.0.0
          UP BROADCAST MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

eno1      Link encap:Ethernet  HWaddr d0:43:1e:d6:03:2f 
          inet addr:192.168.10.126  Bcast:192.168.10.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:135622 errors:0 dropped:0 overruns:0 frame:0
          TX packets:1309 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:8152083 (8.1 MB)  TX bytes:489822 (489.8 KB)

enp3s0f1  Link encap:Ethernet  HWaddr d0:43:1e:d6:03:35 
          UP BROADCAST RUNNING MULTICAST  MTU:9000  Metric:1
          RX packets:297590 errors:0 dropped:0 overruns:0 frame:0
          TX packets:46479 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:31439747 (31.4 MB)  TX bytes:9381759 (9.3 MB)

lo        Link encap:Local Loopback 
          inet addr:127.0.0.1  Mask:255.0.0.0
          UP LOOPBACK RUNNING  MTU:65536  Metric:1
          RX packets:77136 errors:0 dropped:0 overruns:0 frame:0
          TX packets:77136 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1
          RX bytes:6224382 (6.2 MB)  TX bytes:6224382 (6.2 MB)