Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

Icehouse neutron can't access to instance with floating IP

Hi, All. I have deployed Openstack icehouse version on RHEL 6.5 for test lab followed by official guideline. After neutron configuration and initiate VM, I can't access to floating IP of VM. Nova instance have two interface for public and private network, I can't access neither of them. So, I can't reach instance. I have tried restart all things and re-configure neutron network. I'm not really familiar with openvswitch and networking, I have thought that i'm missing some important thing. Please help me.

I have two node configuration, first node act as controller, network node and compute node. and second node act as compute node.

Each node have two network interface, one for external and other for private.

**Controller Node and network node and compute node 1 (with External network IP -10.183.120.170)

br-ex     Link encap:Ethernet  HWaddr 68:B5:99:C7:D2:8C  
          inet addr:10.183.120.170  Bcast:10.183.120.191  Mask:255.255.255.192 (bridged to eth0)
eth1      Link encap:Ethernet  HWaddr 68:B5:99:C7:D2:8E  
          inet addr:192.168.255.10  Bcast:192.168.255.255  Mask:255.255.255.0 (GRE Tunnel)

[root@osnode01 neutron]# netstat -rn
Kernel IP routing table
Destination     Gateway         Genmask         Flags   MSS Window  irtt Iface
10.183.120.128  0.0.0.0         255.255.255.192 U         0 0          0 br-ex
192.168.122.0   0.0.0.0         255.255.255.0   U         0 0          0 virbr0
192.168.255.0   0.0.0.0         255.255.255.0   U         0 0          0 eth1
169.254.0.0     0.0.0.0         255.255.0.0     U         0 0          0 eth0
169.254.0.0     0.0.0.0         255.255.0.0     U         0 0          0 eth1
169.254.0.0     0.0.0.0         255.255.0.0     U         0 0          0 br-ex
0.0.0.0         10.183.120.190  0.0.0.0         UG        0 0          0 br-ex


** Compute node 2 (with External network IP - 10.183.120.171)
eth0      Link encap:Ethernet  HWaddr 1C:C1:DE:E5:49:1C  
          inet addr:10.183.120.171  Bcast:10.183.120.191  Mask:255.255.255.192
eth1      Link encap:Ethernet  HWaddr 1C:C1:DE:E5:49:1E  
          inet addr:192.168.255.11  Bcast:192.168.255.255  Mask:255.255.255.0

[root@osnode02 ~]# netstat -rn
Kernel IP routing table
Destination     Gateway         Genmask         Flags   MSS Window  irtt Iface
10.183.120.128  0.0.0.0         255.255.255.192 U         0 0          0 eth0
192.168.122.0   0.0.0.0         255.255.255.0   U         0 0          0 virbr0
192.168.255.0   0.0.0.0         255.255.255.0   U         0 0          0 eth1
169.254.0.0     0.0.0.0         255.255.0.0     U         0 0          0 eth0
169.254.0.0     0.0.0.0         255.255.0.0     U         0 0          0 eth1
0.0.0.0         10.183.120.190  0.0.0.0         UG        0 0          0 eth0


** My neutron configuration described as below:

[root@osnode01 neutron]# grep -v '#' dhcp_agent.ini | grep -v ^$ 
[DEFAULT]
interface_driver = neutron.agent.linux.interface.OVSInterfaceDriver
dhcp_driver = neutron.agent.linux.dhcp.Dnsmasq
use_namespaces = True
verbose = True

[root@osnode01 neutron]# grep -v '#' l3_agent.ini | grep -v ^$
[DEFAULT]
interface_driver = neutron.agent.linux.interface.OVSInterfaceDriver
use_namespaces = True
verbose = True

[root@osnode01 neutron]# grep -v '#' plugin.ini | grep -v ^$
[ml2]
type_drivers = gre
tenant_network_types = gre
mechanism_drivers = openvswitch
verbose = True
[ml2_type_flat]
[ml2_type_vlan]
[ml2_type_gre]
tunnel_id_ranges = 1:1000
[ml2_type_vxlan]
[securitygroup]
firewall_driver = neutron.agent.linux.iptables_firewall.OVSHybridIptablesFirewallDriver
enable_security_group = True
[ovs]
local_ip = 192.168.255.10
tunnel_type = gre
enable_tunneling = True
[root@osnode01 neutron]# 

I found that my neutron router have Public IP with 10.183.120.173, but, router_gateway port status is down.

[root@osnode02 ~]# neutron port-show 27c4a5dd-522c-440d-be0f-df8fa53822ea
+-----------------------+---------------------------------------------------------------------------------------+
| Field                 | Value                                                                                 |
+-----------------------+---------------------------------------------------------------------------------------+
| admin_state_up        | True                                                                                  |
| allowed_address_pairs |                                                                                       |
| binding:host_id       | osnode01                                                                              |
| binding:profile       | {}                                                                                    |
| binding:vif_details   | {"port_filter": true, "ovs_hybrid_plug": true}                                        |
| binding:vif_type      | ovs                                                                                   |
| binding:vnic_type     | normal                                                                                |
| device_id             | c34e8c21-fac7-4b90-b7a8-ea8cc910fe70                                                  |
| device_owner          | network:router_gateway                                                                |
| extra_dhcp_opts       |                                                                                       |
| fixed_ips             | {"subnet_id": "873df82f-a426-437a-8e42-45f6faecae40", "ip_address": "10.183.120.173"} |
| id                    | 27c4a5dd-522c-440d-be0f-df8fa53822ea                                                  |
| mac_address           | fa:16:3e:04:dd:5b                                                                     |
| name                  |                                                                                       |
| network_id            | 7334d180-2ec0-4754-beb2-e4df6fcada56                                                  |
| security_groups       |                                                                                       |
| status                | DOWN                                                                                  |
| tenant_id             |                                                                                       |
+-----------------------+---------------------------------------------------------------------------------------+

[root@osnode01 neutron]# neutron subnet-show external-subnet
+------------------+------------------------------------------------------+
| Field            | Value                                                |
+------------------+------------------------------------------------------+
| allocation_pools | {"start": "10.183.120.173", "end": "10.183.120.185"} |
| cidr             | 10.183.120.128/26                                    |
| dns_nameservers  |                                                      |
| enable_dhcp      | False                                                |
| gateway_ip       | 10.183.120.190                                       |
| host_routes      |                                                      |
| id               | 873df82f-a426-437a-8e42-45f6faecae40                 |
| ip_version       | 4                                                    |
| name             | external-subnet                                      |
| network_id       | 7334d180-2ec0-4754-beb2-e4df6fcada56                 |
| tenant_id        | ae9e6ba99e03457fa5d87b0993c6ba6d                     |
+------------------+------------------------------------------------------+

[root@osnode01 neutron]# neutron net-show 7334d180-2ec0-4754-beb2-e4df6fcada56
+---------------------------+--------------------------------------+
| Field                     | Value                                |
+---------------------------+--------------------------------------+
| admin_state_up            | True                                 |
| id                        | 7334d180-2ec0-4754-beb2-e4df6fcada56 |
| name                      | external-net                         |
| provider:network_type     | gre                                  |
| provider:physical_network |                                      |
| provider:segmentation_id  | 1                                    |
| router:external           | True                                 |
| shared                    | True                                 |
| status                    | ACTIVE                               |
| subnets                   | 873df82f-a426-437a-8e42-45f6faecae40 |
| tenant_id                 | ae9e6ba99e03457fa5d87b0993c6ba6d     |
+---------------------------+--------------------------------------+


[root@osnode01 neutron]# neutron router-show default-router
+-----------------------+-----------------------------------------------------------------------------+
| Field                 | Value                                                                       |
+-----------------------+-----------------------------------------------------------------------------+
| admin_state_up        | True                                                                        |
| external_gateway_info | {"network_id": "7334d180-2ec0-4754-beb2-e4df6fcada56", "enable_snat": true} |
| id                    | c34e8c21-fac7-4b90-b7a8-ea8cc910fe70                                        |
| name                  | default-router                                                              |
| routes                |                                                                             |
| status                | ACTIVE                                                                      |
| tenant_id             | ae9e6ba99e03457fa5d87b0993c6ba6d                                            |
+-----------------------+-----------------------------------------------------------------------------+

OpenVSwitch configuration shown as below : qr and qg interface indicates link down status

[root@osnode01 neutron]# ovs-vsctl show
fa6bcf23-b2b9-4c67-af59-74bc441431bc
    Bridge br-tun
        Port br-tun
            Interface br-tun
                type: internal
        Port "gre-c0a8ff0b"
            Interface "gre-c0a8ff0b"
                type: gre
                options: {in_key=flow, local_ip="192.168.255.10", out_key=flow, remote_ip="192.168.255.11"}
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
    Bridge br-ex
        Port "qg-27c4a5dd-52"
            Interface "qg-27c4a5dd-52"
                type: internal
        Port br-ex
            Interface br-ex
                type: internal
        Port "eth0"
            Interface "eth0"
    Bridge br-int
        Port "tap3f6e93e0-12"
            tag: 6
            Interface "tap3f6e93e0-12"
                type: internal
        Port br-int
            Interface br-int
                type: internal
        Port "qr-b56d6fe5-4d"
            tag: 6
            Interface "qr-b56d6fe5-4d"
                type: internal
        Port "qvoedb33d90-af"
            tag: 7
            Interface "qvoedb33d90-af"
        Port "qvo31a8f535-d0"
            tag: 6
            Interface "qvo31a8f535-d0"
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
    ovs_version: "1.11.0"


[root@osnode01 neutron]# ovs-ofctl show br-int
OFPT_FEATURES_REPLY (xid=0x2): dpid:00008eb963dcee45
n_tables:254, n_buffers:256
capabilities: FLOW_STATS TABLE_STATS PORT_STATS QUEUE_STATS ARP_MATCH_IP
actions: OUTPUT SET_VLAN_VID SET_VLAN_PCP STRIP_VLAN SET_DL_SRC SET_DL_DST SET_NW_SRC SET_NW_DST SET_NW_TOS SET_TP_SRC SET_TP_DST ENQUEUE
 1(patch-tun): addr:3a:e2:17:56:52:15
     config:     0
     state:      0
     speed: 0 Mbps now, 0 Mbps max
 4(qr-b56d6fe5-4d): addr:02:64:19:0b:58:e7
     config:     PORT_DOWN
     state:      LINK_DOWN
     speed: 0 Mbps now, 0 Mbps max
 6(tap3f6e93e0-12): addr:02:64:19:0b:58:e7
     config:     PORT_DOWN
     state:      LINK_DOWN
     speed: 0 Mbps now, 0 Mbps max
 7(qvo31a8f535-d0): addr:02:64:19:0b:58:e7
     config:     0
     state:      0
     current:    10GB-FD COPPER
     speed: 10000 Mbps now, 0 Mbps max
 8(qvoedb33d90-af): addr:a6:69:4e:15:cf:fc
     config:     0
     state:      0
     current:    10GB-FD COPPER
     speed: 10000 Mbps now, 0 Mbps max
 LOCAL(br-int): addr:8e:b9:63:dc:ee:45
     config:     0
     state:      0
     speed: 0 Mbps now, 0 Mbps max
OFPT_GET_CONFIG_REPLY (xid=0x4): frags=normal miss_send_len=0


[root@osnode01 neutron]# ovs-ofctl show br-ex
OFPT_FEATURES_REPLY (xid=0x2): dpid:000068b599c7d28c
n_tables:254, n_buffers:256
capabilities: FLOW_STATS TABLE_STATS PORT_STATS QUEUE_STATS ARP_MATCH_IP
actions: OUTPUT SET_VLAN_VID SET_VLAN_PCP STRIP_VLAN SET_DL_SRC SET_DL_DST SET_NW_SRC SET_NW_DST SET_NW_TOS SET_TP_SRC SET_TP_DST ENQUEUE
 1(qg-27c4a5dd-52): addr:68:b5:99:c7:d2:8c
     config:     PORT_DOWN
     state:      LINK_DOWN
     speed: 0 Mbps now, 0 Mbps max
 2(eth0): addr:68:b5:99:c7:d2:8c
     config:     0
     state:      0
     current:    1GB-FD COPPER AUTO_NEG
     advertised: 10MB-HD 10MB-FD 100MB-HD 100MB-FD 1GB-FD AUTO_NEG
     supported:  10MB-HD 10MB-FD 100MB-HD 100MB-FD 1GB-FD COPPER AUTO_NEG
     speed: 1000 Mbps now, 1000 Mbps max
 LOCAL(br-ex): addr:68:b5:99:c7:d2:8c
     config:     0
     state:      0
     speed: 0 Mbps now, 0 Mbps max
OFPT_GET_CONFIG_REPLY (xid=0x4): frags=normal miss_send_len=0

OpenVSwitch external network namespace have each interface IP for networking. but, I can't found instance floating IP everywhere. (is floating IP only visible inside instance?)

[root@osnode01 neutron]# ip netns exec qrouter-c34e8c21-fac7-4b90-b7a8-ea8cc910fe70 ip a
38: lo: <loopback,up,lower_up> mtu 16436 qdisc noqueue state UNKNOWN 
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
41: qr-b56d6fe5-4d: <broadcast,up,lower_up> mtu 1500 qdisc noqueue state UNKNOWN 
    link/ether fa:16:3e:f1:c9:b2 brd ff:ff:ff:ff:ff:ff
    inet 172.16.32.1/24 brd 172.16.32.255 scope global qr-b56d6fe5-4d
    inet6 fe80::f816:3eff:fef1:c9b2/64 scope link 
       valid_lft forever preferred_lft forever
43: qg-27c4a5dd-52: <broadcast,up,lower_up> mtu 1500 qdisc noqueue state UNKNOWN 
    link/ether fa:16:3e:04:dd:5b brd ff:ff:ff:ff:ff:ff
    inet 10.183.120.173/26 brd 10.183.120.191 scope global qg-27c4a5dd-52
    inet6 fe80::f816:3eff:fe04:dd5b/64 scope link 
       valid_lft forever preferred_lft forever

I'm looking forward your answer. thank you.

Icehouse neutron can't access to instance with floating IP

Hi, All. I have deployed Openstack icehouse version on RHEL 6.5 for test lab followed by official guideline. After neutron configuration and initiate VM, I can't access to floating IP of VM. Nova instance have two interface for public and private network, I can't access neither of them. So, I can't reach instance. I have tried restart all things and re-configure neutron network. I'm not really familiar with openvswitch and networking, I have thought that i'm missing some important thing. Please help me.

I have two node configuration, first node act as controller, network node and compute node. and second node act as compute node.

Each node have two network interface, one for external and other for private.

**Controller Node and network node and compute node 1 (with External network IP -10.183.120.170)

[root@osnode01 neutron]# ifconfig -a br-ex     Link encap:Ethernet  HWaddr 68:B5:99:C7:D2:8C  
          inet addr:10.183.120.170  Bcast:10.183.120.191  Mask:255.255.255.192 (bridged to eth0)
eth1   Mask:255.255.255.192
          inet6 addr: fe80::fc72:2dff:fe52:4709/64 Scope:Link
          UP BROADCAST RUNNING  MTU:1500  Metric:1
          RX packets:4698305 errors:0 dropped:0 overruns:0 frame:0
          TX packets:4369482 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:1803665841 (1.6 GiB)  TX bytes:1833241255 (1.7 GiB)

br-int    Link encap:Ethernet  HWaddr 8E:B9:63:DC:EE:45  
          inet6 addr: fe80::2c21:cff:fe90:d4fa/64 Scope:Link
          UP BROADCAST RUNNING  MTU:1500  Metric:1
          RX packets:536 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:32184 (31.4 KiB)  TX bytes:468 (468.0 b)

br-tun    Link encap:Ethernet  HWaddr D6:F1:17:0D:CA:4E  
          inet6 addr: fe80::8024:fdff:fe14:af81/64 Scope:Link
          UP BROADCAST RUNNING  MTU:1500  Metric:1
          RX packets:230 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:15164 (14.8 KiB)  TX bytes:468 (468.0 b)

eth0      Link encap:Ethernet  HWaddr 68:B5:99:C7:D2:8C  
          inet6 addr: fe80::6ab5:99ff:fec7:d28c/64 Scope:Link
          UP BROADCAST RUNNING PROMISC MULTICAST  MTU:1500  Metric:1
          RX packets:5101773 errors:0 dropped:0 overruns:0 frame:0
          TX packets:4779571 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:1851895406 (1.7 GiB)  TX bytes:1879660396 (1.7 GiB)

eth1      Link encap:Ethernet  HWaddr 68:B5:99:C7:D2:8E  
          inet addr:192.168.255.10  Bcast:192.168.255.255  Mask:255.255.255.0 (GRE Tunnel)
Mask:255.255.255.0
          inet6 addr: fe80::6ab5:99ff:fec7:d28e/64 Scope:Link
          UP BROADCAST RUNNING PROMISC MULTICAST  MTU:1500  Metric:1
          RX packets:792 errors:0 dropped:0 overruns:0 frame:0
          TX packets:812 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:67862 (66.2 KiB)  TX bytes:61564 (60.1 KiB)

lo        Link encap:Local Loopback  
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:30954888 errors:0 dropped:0 overruns:0 frame:0
          TX packets:30954888 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:11089210953 (10.3 GiB)  TX bytes:11089210953 (10.3 GiB)

ovs-system Link encap:Ethernet  HWaddr C2:3E:A8:84:8C:CA  
          BROADCAST MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

qbredb33d90-af Link encap:Ethernet  HWaddr 2A:94:F8:56:E1:44  
          inet6 addr: fe80::d4f4:e2ff:fef3:3d43/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:7 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:440 (440.0 b)  TX bytes:468 (468.0 b)

qbr31a8f535-d0 Link encap:Ethernet  HWaddr 82:19:81:73:DC:41  
          inet6 addr: fe80::cf7:5aff:fe77:6d47/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:148 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:5276 (5.1 KiB)  TX bytes:468 (468.0 b)

qvbedb33d90-af Link encap:Ethernet  HWaddr 2A:94:F8:56:E1:44  
          inet6 addr: fe80::2894:f8ff:fe56:e144/64 Scope:Link
          UP BROADCAST RUNNING PROMISC MULTICAST  MTU:1500  Metric:1
          RX packets:8 errors:0 dropped:0 overruns:0 frame:0
          TX packets:10 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:628 (628.0 b)  TX bytes:756 (756.0 b)

qvb31a8f535-d0 Link encap:Ethernet  HWaddr 82:19:81:73:DC:41  
          inet6 addr: fe80::8019:81ff:fe73:dc41/64 Scope:Link
          UP BROADCAST RUNNING PROMISC MULTICAST  MTU:1500  Metric:1
          RX packets:160 errors:0 dropped:0 overruns:0 frame:0
          TX packets:172 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:12897 (12.5 KiB)  TX bytes:10612 (10.3 KiB)

qvoedb33d90-af Link encap:Ethernet  HWaddr A6:69:4E:15:CF:FC  
          inet6 addr: fe80::a469:4eff:fe15:cffc/64 Scope:Link
          UP BROADCAST RUNNING PROMISC MULTICAST  MTU:1500  Metric:1
          RX packets:10 errors:0 dropped:0 overruns:0 frame:0
          TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:756 (756.0 b)  TX bytes:628 (628.0 b)

qvo31a8f535-d0 Link encap:Ethernet  HWaddr 02:64:19:0B:58:E7  
          inet6 addr: fe80::64:19ff:fe0b:58e7/64 Scope:Link
          UP BROADCAST RUNNING PROMISC MULTICAST  MTU:1500  Metric:1
          RX packets:172 errors:0 dropped:0 overruns:0 frame:0
          TX packets:160 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:10612 (10.3 KiB)  TX bytes:12897 (12.5 KiB)

tapedb33d90-af Link encap:Ethernet  HWaddr FE:16:3E:10:28:FF  
          inet6 addr: fe80::fc16:3eff:fe10:28ff/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:10 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500 
          RX bytes:0 (0.0 b)  TX bytes:756 (756.0 b)

tap31a8f535-d0 Link encap:Ethernet  HWaddr FE:16:3E:DE:2B:7E  
          inet6 addr: fe80::fc16:3eff:fede:2b7e/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:162 errors:0 dropped:0 overruns:0 frame:0
          TX packets:69 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500 
          RX bytes:9856 (9.6 KiB)  TX bytes:6151 (6.0 KiB)

virbr0    Link encap:Ethernet  HWaddr 52:54:00:58:94:DA  
          inet addr:192.168.122.1  Bcast:192.168.122.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

virbr0-nic Link encap:Ethernet  HWaddr 52:54:00:58:94:DA  
          BROADCAST MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500 
          RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

[root@osnode01 neutron]# netstat -rn
Kernel IP routing table
Destination     Gateway         Genmask         Flags   MSS Window  irtt Iface
10.183.120.128  0.0.0.0         255.255.255.192 U         0 0          0 br-ex
192.168.122.0   0.0.0.0         255.255.255.0   U         0 0          0 virbr0
192.168.255.0   0.0.0.0         255.255.255.0   U         0 0          0 eth1
169.254.0.0     0.0.0.0         255.255.0.0     U         0 0          0 eth0
169.254.0.0     0.0.0.0         255.255.0.0     U         0 0          0 eth1
169.254.0.0     0.0.0.0         255.255.0.0     U         0 0          0 br-ex
0.0.0.0         10.183.120.190  0.0.0.0         UG        0 0          0 br-ex


** Compute node 2 (with External network IP - 10.183.120.171)
eth0   [root@osnode02 ~]# ifconfig -a
br-int    Link encap:Ethernet  HWaddr BE:6F:C9:30:6E:42  
          inet6 addr: fe80::9060:a9ff:fe5c:6b81/64 Scope:Link
          UP BROADCAST RUNNING  MTU:1500  Metric:1
          RX packets:62 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:12144 (11.8 KiB)  TX bytes:468 (468.0 b)

br-tun    Link encap:Ethernet  HWaddr 2E:CB:72:FD:F4:47  
          inet6 addr: fe80::5c84:49ff:fe3a:a00c/64 Scope:Link
          UP BROADCAST RUNNING  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 b)  TX bytes:468 (468.0 b)

eth0      Link encap:Ethernet  HWaddr 1C:C1:DE:E5:49:1C  
          inet addr:10.183.120.171  Bcast:10.183.120.191  Mask:255.255.255.192
          inet6 addr: fe80::1ec1:deff:fee5:491c/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:4756857 errors:13 dropped:0 overruns:0 frame:13
          TX packets:4623014 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:1864579331 (1.7 GiB)  TX bytes:1810210749 (1.6 GiB)

eth1      Link encap:Ethernet  HWaddr 1C:C1:DE:E5:49:1E  
          inet addr:192.168.255.11  Bcast:192.168.255.255  Mask:255.255.255.0
          inet6 addr: fe80::1ec1:deff:fee5:491e/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:814 errors:0 dropped:0 overruns:0 frame:0
          TX packets:800 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:62752 (61.2 KiB)  TX bytes:68442 (66.8 KiB)

lo        Link encap:Local Loopback  
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:687317 errors:0 dropped:0 overruns:0 frame:0
          TX packets:687317 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:644692502 (614.8 MiB)  TX bytes:644692502 (614.8 MiB)

ovs-system Link encap:Ethernet  HWaddr 8A:29:8D:DA:E5:04  
          BROADCAST MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

virbr0    Link encap:Ethernet  HWaddr 52:54:00:E4:79:97  
          inet addr:192.168.122.1  Bcast:192.168.122.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

virbr0-nic Link encap:Ethernet  HWaddr 52:54:00:E4:79:97  
          BROADCAST MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500 
          RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)


[root@osnode02 ~]# netstat -rn
Kernel IP routing table
Destination     Gateway         Genmask         Flags   MSS Window  irtt Iface
10.183.120.128  0.0.0.0         255.255.255.192 U         0 0          0 eth0
192.168.122.0   0.0.0.0         255.255.255.0   U         0 0          0 virbr0
192.168.255.0   0.0.0.0         255.255.255.0   U         0 0          0 eth1
169.254.0.0     0.0.0.0         255.255.0.0     U         0 0          0 eth0
169.254.0.0     0.0.0.0         255.255.0.0     U         0 0          0 eth1
0.0.0.0         10.183.120.190  0.0.0.0         UG        0 0          0 eth0


** My neutron configuration described as below:

[root@osnode01 neutron]# grep -v '#' dhcp_agent.ini | grep -v ^$ 
[DEFAULT]
interface_driver = neutron.agent.linux.interface.OVSInterfaceDriver
dhcp_driver = neutron.agent.linux.dhcp.Dnsmasq
use_namespaces = True
verbose = True

[root@osnode01 neutron]# grep -v '#' l3_agent.ini | grep -v ^$
[DEFAULT]
interface_driver = neutron.agent.linux.interface.OVSInterfaceDriver
use_namespaces = True
verbose = True

[root@osnode01 neutron]# grep -v '#' plugin.ini | grep -v ^$
[ml2]
type_drivers = gre
tenant_network_types = gre
mechanism_drivers = openvswitch
verbose = True
[ml2_type_flat]
[ml2_type_vlan]
[ml2_type_gre]
tunnel_id_ranges = 1:1000
[ml2_type_vxlan]
[securitygroup]
firewall_driver = neutron.agent.linux.iptables_firewall.OVSHybridIptablesFirewallDriver
enable_security_group = True
[ovs]
local_ip = 192.168.255.10
tunnel_type = gre
enable_tunneling = True
[root@osnode01 neutron]# 

I found that my neutron router have Public IP with 10.183.120.173, but, router_gateway port status is down.

[root@osnode01 neutron]# neutron net-list
+--------------------------------------+--------------+--------------------------------------------------------+
| id                                   | name         | subnets                                                |
+--------------------------------------+--------------+--------------------------------------------------------+
| 7334d180-2ec0-4754-beb2-e4df6fcada56 | external-net | 873df82f-a426-437a-8e42-45f6faecae40 10.183.120.128/26 |
| d3f4191c-b120-42a4-ad9e-e0105a3b76e9 | tenant-net   | 916dfe09-98a0-490f-a419-c66275d7e861 172.16.32.0/24    |
+--------------------------------------+--------------+--------------------------------------------------------+
[root@osnode01 neutron]# neutron router-list
+--------------------------------------+----------------+-----------------------------------------------------------------------------+
| id                                   | name           | external_gateway_info                                                       |
+--------------------------------------+----------------+-----------------------------------------------------------------------------+
| c34e8c21-fac7-4b90-b7a8-ea8cc910fe70 | default-router | {"network_id": "7334d180-2ec0-4754-beb2-e4df6fcada56", "enable_snat": true} |
+--------------------------------------+----------------+-----------------------------------------------------------------------------+
[root@osnode02 ~]# neutron port-show 27c4a5dd-522c-440d-be0f-df8fa53822ea
+-----------------------+---------------------------------------------------------------------------------------+
| Field                 | Value                                                                                 |
+-----------------------+---------------------------------------------------------------------------------------+
| admin_state_up        | True                                                                                  |
| allowed_address_pairs |                                                                                       |
| binding:host_id       | osnode01                                                                              |
| binding:profile       | {}                                                                                    |
| binding:vif_details   | {"port_filter": true, "ovs_hybrid_plug": true}                                        |
| binding:vif_type      | ovs                                                                                   |
| binding:vnic_type     | normal                                                                                |
| device_id             | c34e8c21-fac7-4b90-b7a8-ea8cc910fe70                                                  |
| device_owner          | network:router_gateway                                                                |
| extra_dhcp_opts       |                                                                                       |
| fixed_ips             | {"subnet_id": "873df82f-a426-437a-8e42-45f6faecae40", "ip_address": "10.183.120.173"} |
| id                    | 27c4a5dd-522c-440d-be0f-df8fa53822ea                                                  |
| mac_address           | fa:16:3e:04:dd:5b                                                                     |
| name                  |                                                                                       |
| network_id            | 7334d180-2ec0-4754-beb2-e4df6fcada56                                                  |
| security_groups       |                                                                                       |
| status                | DOWN                                                                                  |
| tenant_id             |                                                                                       |
+-----------------------+---------------------------------------------------------------------------------------+

[root@osnode01 neutron]# neutron subnet-show external-subnet
+------------------+------------------------------------------------------+
| Field            | Value                                                |
+------------------+------------------------------------------------------+
| allocation_pools | {"start": "10.183.120.173", "end": "10.183.120.185"} |
| cidr             | 10.183.120.128/26                                    |
| dns_nameservers  |                                                      |
| enable_dhcp      | False                                                |
| gateway_ip       | 10.183.120.190                                       |
| host_routes      |                                                      |
| id               | 873df82f-a426-437a-8e42-45f6faecae40                 |
| ip_version       | 4                                                    |
| name             | external-subnet                                      |
| network_id       | 7334d180-2ec0-4754-beb2-e4df6fcada56                 |
| tenant_id        | ae9e6ba99e03457fa5d87b0993c6ba6d                     |
+------------------+------------------------------------------------------+

[root@osnode01 neutron]# neutron net-show 7334d180-2ec0-4754-beb2-e4df6fcada56
+---------------------------+--------------------------------------+
| Field                     | Value                                |
+---------------------------+--------------------------------------+
| admin_state_up            | True                                 |
| id                        | 7334d180-2ec0-4754-beb2-e4df6fcada56 |
| name                      | external-net                         |
| provider:network_type     | gre                                  |
| provider:physical_network |                                      |
| provider:segmentation_id  | 1                                    |
| router:external           | True                                 |
| shared                    | True                                 |
| status                    | ACTIVE                               |
| subnets                   | 873df82f-a426-437a-8e42-45f6faecae40 |
| tenant_id                 | ae9e6ba99e03457fa5d87b0993c6ba6d     |
+---------------------------+--------------------------------------+


[root@osnode01 neutron]# neutron router-show default-router
+-----------------------+-----------------------------------------------------------------------------+
| Field                 | Value                                                                       |
+-----------------------+-----------------------------------------------------------------------------+
| admin_state_up        | True                                                                        |
| external_gateway_info | {"network_id": "7334d180-2ec0-4754-beb2-e4df6fcada56", "enable_snat": true} |
| id                    | c34e8c21-fac7-4b90-b7a8-ea8cc910fe70                                        |
| name                  | default-router                                                              |
| routes                |                                                                             |
| status                | ACTIVE                                                                      |
| tenant_id             | ae9e6ba99e03457fa5d87b0993c6ba6d                                            |
+-----------------------+-----------------------------------------------------------------------------+

OpenVSwitch configuration shown as below : qr and qg interface indicates link down status

** ovs-vsctl show result
[root@osnode01 neutron]# ovs-vsctl show
show fa6bcf23-b2b9-4c67-af59-74bc441431bc
    Bridge br-tun
        Port br-tun
            Interface br-tun
                type: internal
        Port "gre-c0a8ff0b"
            Interface "gre-c0a8ff0b"
                type: gre
                options: {in_key=flow, local_ip="192.168.255.10", out_key=flow, remote_ip="192.168.255.11"}
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
    Bridge br-ex
        Port "qg-27c4a5dd-52"
            Interface "qg-27c4a5dd-52"
                type: internal
        Port br-ex
            Interface br-ex
                type: internal
        Port "eth0"
            Interface "eth0"
    Bridge br-int
        Port "tap3f6e93e0-12"
            tag: 6
            Interface "tap3f6e93e0-12"
                type: internal
        Port br-int
            Interface br-int
                type: internal
        Port "qr-b56d6fe5-4d"
            tag: 6
            Interface "qr-b56d6fe5-4d"
                type: internal
        Port "qvoedb33d90-af"
            tag: 7
            Interface "qvoedb33d90-af"
        Port "qvo31a8f535-d0"
            tag: 6
            Interface "qvo31a8f535-d0"
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
    ovs_version: "1.11.0"

[root@osnode02 ~]# ovs-vsctl show
5757c78d-450c-4e48-90cc-e2d2492fa6a6
    Bridge br-int
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
        Port br-int
            Interface br-int
                type: internal
    Bridge br-tun
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port "gre-c0a8ff0a"
            Interface "gre-c0a8ff0a"
                type: gre
                options: {in_key=flow, local_ip="192.168.255.11", out_key=flow, remote_ip="192.168.255.10"}
        Port br-tun
            Interface br-tun
                type: internal
    ovs_version: "1.11.0"

[root@osnode01 neutron]# ovs-ofctl show br-int
OFPT_FEATURES_REPLY (xid=0x2): dpid:00008eb963dcee45
n_tables:254, n_buffers:256
capabilities: FLOW_STATS TABLE_STATS PORT_STATS QUEUE_STATS ARP_MATCH_IP
actions: OUTPUT SET_VLAN_VID SET_VLAN_PCP STRIP_VLAN SET_DL_SRC SET_DL_DST SET_NW_SRC SET_NW_DST SET_NW_TOS SET_TP_SRC SET_TP_DST ENQUEUE
 1(patch-tun): addr:3a:e2:17:56:52:15
     config:     0
     state:      0
     speed: 0 Mbps now, 0 Mbps max
 4(qr-b56d6fe5-4d): addr:02:64:19:0b:58:e7
     config:     PORT_DOWN
     state:      LINK_DOWN
     speed: 0 Mbps now, 0 Mbps max
 6(tap3f6e93e0-12): addr:02:64:19:0b:58:e7
     config:     PORT_DOWN
     state:      LINK_DOWN
     speed: 0 Mbps now, 0 Mbps max
 7(qvo31a8f535-d0): addr:02:64:19:0b:58:e7
     config:     0
     state:      0
     current:    10GB-FD COPPER
     speed: 10000 Mbps now, 0 Mbps max
 8(qvoedb33d90-af): addr:a6:69:4e:15:cf:fc
     config:     0
     state:      0
     current:    10GB-FD COPPER
     speed: 10000 Mbps now, 0 Mbps max
 LOCAL(br-int): addr:8e:b9:63:dc:ee:45
     config:     0
     state:      0
     speed: 0 Mbps now, 0 Mbps max
OFPT_GET_CONFIG_REPLY (xid=0x4): frags=normal miss_send_len=0


[root@osnode01 neutron]# ovs-ofctl show br-ex
OFPT_FEATURES_REPLY (xid=0x2): dpid:000068b599c7d28c
n_tables:254, n_buffers:256
capabilities: FLOW_STATS TABLE_STATS PORT_STATS QUEUE_STATS ARP_MATCH_IP
actions: OUTPUT SET_VLAN_VID SET_VLAN_PCP STRIP_VLAN SET_DL_SRC SET_DL_DST SET_NW_SRC SET_NW_DST SET_NW_TOS SET_TP_SRC SET_TP_DST ENQUEUE
 1(qg-27c4a5dd-52): addr:68:b5:99:c7:d2:8c
     config:     PORT_DOWN
     state:      LINK_DOWN
     speed: 0 Mbps now, 0 Mbps max
 2(eth0): addr:68:b5:99:c7:d2:8c
     config:     0
     state:      0
     current:    1GB-FD COPPER AUTO_NEG
     advertised: 10MB-HD 10MB-FD 100MB-HD 100MB-FD 1GB-FD AUTO_NEG
     supported:  10MB-HD 10MB-FD 100MB-HD 100MB-FD 1GB-FD COPPER AUTO_NEG
     speed: 1000 Mbps now, 1000 Mbps max
 LOCAL(br-ex): addr:68:b5:99:c7:d2:8c
     config:     0
     state:      0
     speed: 0 Mbps now, 0 Mbps max
OFPT_GET_CONFIG_REPLY (xid=0x4): frags=normal miss_send_len=0

[root@osnode01 neutron]# brctl show
bridge name     bridge id               STP enabled     interfaces
qbr31a8f535-d0          8000.82198173dc41       no              qvb31a8f535-d0
                                                        tap31a8f535-d0
qbredb33d90-af          8000.2a94f856e144       no              qvbedb33d90-af
                                                        tapedb33d90-af
virbr0          8000.5254005894da       yes             virbr0-nic

OpenVSwitch external network namespace have each interface IP for networking. but, I can't found instance floating IP everywhere. (is floating IP only visible inside instance?)

[root@osnode01 neutron]# ip netns 
qrouter-ffb362d0-3e38-4d80-8410-3e1725cf3376
qrouter-c34e8c21-fac7-4b90-b7a8-ea8cc910fe70
qdhcp-d3f4191c-b120-42a4-ad9e-e0105a3b76e9
qdhcp-f616d3d6-3700-449a-9e6e-45388c9fc53b

[root@osnode01 neutron]# ip netns exec qrouter-c34e8c21-fac7-4b90-b7a8-ea8cc910fe70 ip a
a 38: lo: <loopback,up,lower_up> mtu 16436 qdisc noqueue state UNKNOWN 
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
41: qr-b56d6fe5-4d: <broadcast,up,lower_up> mtu 1500 qdisc noqueue state UNKNOWN 
    link/ether fa:16:3e:f1:c9:b2 brd ff:ff:ff:ff:ff:ff
    inet 172.16.32.1/24 brd 172.16.32.255 scope global qr-b56d6fe5-4d
    inet6 fe80::f816:3eff:fef1:c9b2/64 scope link 
       valid_lft forever preferred_lft forever
43: qg-27c4a5dd-52: <broadcast,up,lower_up> mtu 1500 qdisc noqueue state UNKNOWN 
    link/ether fa:16:3e:04:dd:5b brd ff:ff:ff:ff:ff:ff
    inet 10.183.120.173/26 brd 10.183.120.191 scope global qg-27c4a5dd-52
    inet6 fe80::f816:3eff:fe04:dd5b/64 scope link 
       valid_lft forever preferred_lft forever

I'm looking forward your answer. thank you.