Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

Instance fails to spawn with Unexpected vif_type=binding_failed

Hello everyone

I have a similar issue like

https://ask.openstack.org/en/question/48407/instance-failing-to-spawn-logs-show-novaexception-unexpected-vif_typebinding_failed/ https://ask.openstack.org/en/question/43813/failed-to-bind-port-in-neutron-on-router/ https://ask.openstack.org/en/question/47533/instance-fails-to-spawn-with-unexpected-vif_typebinding_failed/ https://ask.openstack.org/en/question/30333/error-unexpected-vif_typebinding_failed/

. My instances dosen't spawn if I configure them with an interface on the external network.

Internal network works fine: instances are spawned and they get full connectivity throught my openstack router on both interfaces.

No errors in logs except

 neutron.plugins.ml2.managers [req-a3d90314-1c7c-443c-98b0-dcc3b4a9e6e6 None] Failed to bind port 86510eae-291c-4cbd-a61a-aeaeb63c6591 on host cdk7

and of course Unexpected vif_type=binding_failed on the compute node.

I tried various fixed from other bugs, but:

Neutron is spawn using the correct config file:

neutron  20429  3.3  0.0 252688 88508 ?        Ss   16:23   0:33 /usr/bin/python /usr/bin/neutron-server --config-file /etc/neutron/neutron.conf --log-file /var/log/neutron/server.log --config-file /etc/neutron/plugins/ml2/ml2_conf.ini

Openvswitch agents are spawn with the correct config file:

neutron  20429  3.3  0.0 252688 88508 ?        Ss   16:23   0:33 /usr/bin/python /usr/bin/neutron-server --config-file /etc/neutron/neutron.conf --log-file /var/log/neutron/server.log --config-file /etc/neutron/plugins/ml2/ml2_conf.ini

Agents:

+--------------------------------------+--------------------+----------+-------+----------------+---------------------------+
| id                                   | agent_type         | host     | alive | admin_state_up | binary                    |
+--------------------------------------+--------------------+----------+-------+----------------+---------------------------+
| 05363c02-a05e-4261-8555-eb7ef2abd812 | DHCP agent         | cdk2 | :-)   | True           | neutron-dhcp-agent        |
| 13b0890d-637f-4879-ae81-65912f2e0849 | Open vSwitch agent | cdk8 | :-)   | True           | neutron-openvswitch-agent |
| 1fa247e1-1517-4a8a-8c0e-619f690176ab | Open vSwitch agent | cdk4 | :-)   | True           | neutron-openvswitch-agent |
| 5e743013-9175-4772-8ce4-4b268e4c72e6 | Open vSwitch agent | cdk6 | :-)   | True           | neutron-openvswitch-agent |
| 6673d3b8-bc81-4158-842a-be98df094978 | Open vSwitch agent | cdk3 | :-)   | True           | neutron-openvswitch-agent |
| 78826bef-49c4-4004-a4bb-c56bacd0dd03 | Open vSwitch agent | cdk5 | :-)   | True           | neutron-openvswitch-agent |
| 965ebaa4-c36f-458f-b6d9-4c9ef48decf1 | Open vSwitch agent | cdk9 | :-)   | True           | neutron-openvswitch-agent |
| aa5eb61b-0a4e-4df1-a839-2978a33fbefa | Open vSwitch agent | cdk0 | :-)   | True           | neutron-openvswitch-agent |
| b1493f13-54a0-4920-bc0d-525a47cce8b4 | L3 agent           | cdk2 | :-)   | True           | neutron-l3-agent          |
| c2e84809-ec0a-45a0-b478-ab08374bc6e0 | Open vSwitch agent | cdk1 | :-)   | True           | neutron-openvswitch-agent |
| e50bf940-1108-46fa-9397-f449f4ee7b63 | Open vSwitch agent | cdk7 | :-)   | True           | neutron-openvswitch-agent |
| fa1d9ce0-2262-4218-b7f4-2fe07571254d | Open vSwitch agent | cdk2 | :-)   | True           | neutron-openvswitch-agent |
| ff3f9c21-70bb-487f-96f2-44c7aabdd35d | Metadata agent     | cdk2 | :-)   | True           | neutron-metadata-agent    |
+--------------------------------------+--------------------+----------+-------+----------------+---------------------------+

External network:

+---------------------------+--------------------------------------+
| Field                     | Value                                |
+---------------------------+--------------------------------------+
| admin_state_up            | True                                 |
| id                        | 683e7db6-1fcc-4641-b2f6-e245dfff3406 |
| name                      | ext-net                              |
| provider:network_type     | flat                                 |
| provider:physical_network | external                             |
| provider:segmentation_id  |                                      |
| router:external           | True                                 |
| shared                    | True                                 |
| status                    | ACTIVE                               |
| subnets                   | 2c3c8db0-e2bf-4964-ad1f-4a7fa53f631d |
| tenant_id                 | 4e3dbd665e9e4e99a25322017c205092     |
+---------------------------+--------------------------------------+

The port of the router also is in binding_failed, but works :

(neutron) port-show 5a4df071-c1af-4fdb-a81b-990d707ff242
+-----------------------+-------------------------------------------------------------------------------------+
| Field                 | Value                                                                               |
+-----------------------+-------------------------------------------------------------------------------------+
| admin_state_up        | True                                                                                |
| allowed_address_pairs |                                                                                     |
| binding:host_id       | cdk2                                                                            |
| binding:profile       | {}                                                                                  |
| binding:vif_details   | {}                                                                                  |
| binding:vif_type      | binding_failed                                                                      |
| binding:vnic_type     | normal                                                                              |
| device_id             | f2b5b7d3-5786-42bf-a729-eda2722f307d                                                |
| device_owner          | network:router_gateway                                                              |
| extra_dhcp_opts       |                                                                                     |
| fixed_ips             | {"subnet_id": "2c3c8db0-e2bf-4964-ad1f-4a7fa53f631d", "ip_address": "192.168.1.19"} |
| id                    | 5a4df071-c1af-4fdb-a81b-990d707ff242                                                |
| mac_address           | fa:16:3e:dc:07:10                                                                   |
| name                  |                                                                                     |
| network_id            | 683e7db6-1fcc-4641-b2f6-e245dfff3406                                                |
| security_groups       |                                                                                     |
| status                | DOWN                                                                                |
| tenant_id             |                                                                                     |
+-----------------------+-------------------------------------------------------------------------------------+

ml2_conf.ini for all nodes

[ml2]
type_drivers = flat,gre
tenant_network_types = gre
mechanism_drivers = openvswitch
[ml2_type_flat]
flat_networks = external
[ml2_type_vlan]
[ml2_type_gre]
tunnel_id_ranges = 1:1000
[ml2_type_vxlan]
[securitygroup]
enable_security_group = True
enable_ipset = True
firewall_driver = neutron.agent.linux.iptables_firewall.OVSHybridIptablesFirewallDriver
[ovs]
local_ip = 192.168.1.22
enable_tunneling = True
tunnel_type = gre
bridge_mappings = external:br-ex # ONLY ON THE NETWORK NODE
[database]
connection = mysql://neutron:x@cdk0/neutron
[agent]
tunnel_types = gre

neutron.conf

[DEFAULT]
verbose = True
lock_path = $state_path/lock
core_plugin = neutron.plugins.ml2.plugin.Ml2Plugin
service_plugins = router
auth_strategy = keystone
allow_overlapping_ips = True
agent_down_time = 75
notify_nova_on_port_status_changes = True
notify_nova_on_port_data_changes = True
nova_url = http://cdk0:8774/v2
nova_region_name = CDK
nova_admin_username = nova
nova_admin_tenant_id = 881a34a5c1d24d1dac67532190e4d38a
nova_admin_password = x
rabbit_host = cdk0
rabbit_password = x
rpc_backend=rabbit
[matchmaker_redis]
[matchmaker_ring]
[quotas]
[agent]
root_helper = sudo /usr/bin/neutron-rootwrap /etc/neutron/rootwrap.conf
report_interval = 5
tunnel_types = gre
[keystone_authtoken]
auth_uri = http://cdk0:5000/v2.0
identity_uri = http://cdk0:35357
admin_tenant_name = service
admin_user = neutron
admin_password = x
[database]
connection = mysql://neutron:x@cdk0/neutron
[service_providers]
service_provider=LOADBALANCER:Haproxy:neutron.services.loadbalancer.drivers.haproxy.plugin_driver.HaproxyOnHostPluginDriver:default
service_provider=VPN:openswan:neutron.services.vpn.service_drivers.ipsec.IPsecVPNDriver:default

nova.conf:

[DEFAULT]
dhcpbridge_flagfile=/etc/nova/nova.conf
dhcpbridge=/usr/bin/nova-dhcpbridge
logdir=/var/log/nova
state_path=/var/lib/nova
lock_path=/var/lock/nova
force_dhcp_release=True
libvirt_use_virtio_for_bridges=True
verbose=True
ec2_private_dns_show_ip=True
api_paste_config=/etc/nova/api-paste.ini
enabled_apis=ec2,osapi_compute,metadata
compute_driver = libvirt.LibvirtDriver
libvirt_vif_driver=nova.virt.libvirt.vif.LibvirtGenericVIFDriver
rpc_backend = rabbit
rabbit_host = cdk0
rabbit_password = x
auth_strategy = keystone
my_ip = 192.168.1.20
vnc_enabled = True
vncserver_listen = 0.0.0.0
vncserver_proxyclient_address = 192.168.1.20
novncproxy_base_url = http://cdk0:6080/vnc_auto.html
network_api_class = nova.network.neutronv2.api.API
security_group_api = neutron
linuxnet_interface_driver = nova.network.linux_net.LinuxOVSInterfaceDriver
firewall_driver = nova.virt.firewall.NoopFirewallDriver
vif_plugging_is_fatal = False
vif_plugging_timeout = 0
[keystone_authtoken]
auth_uri = http://cdk0:5000/v2.0
identity_uri = http://cdk0:35357
admin_tenant_name = service
admin_user = nova
admin_password = x
[glance]
host = cdk1
[database]
connection = mysql://nova:x@cdk0/nova
[neutron]
url = http://cdk0:9696
auth_strategy = keystone
admin_auth_url = http://cdk0:35357/v2.0
admin_tenant_name = service
admin_username = neutron
admin_password = x
service_metadata_proxy = True
metadata_proxy_shared_secret = x
[libvirt]
virt_type = kvm

nova-conpute.conf:

[DEFAULT]
compute_driver=libvirt.LibvirtDriver
[libvirt]
virt_type=kvmonf:

On the compute node:

149fd981-aa5e-4b8e-9ed5-3af487783fd1
    Bridge br-tun
        Port "gre-c0a80115"
            Interface "gre-c0a80115"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.27", out_key=flow, remote_ip="192.168.1.21"}
        Port "gre-c0a8011a"
            Interface "gre-c0a8011a"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.27", out_key=flow, remote_ip="192.168.1.26"}
        Port "gre-c0a80118"
            Interface "gre-c0a80118"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.27", out_key=flow, remote_ip="192.168.1.24"}
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port "gre-c0a80117"
            Interface "gre-c0a80117"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.27", out_key=flow, remote_ip="192.168.1.23"}
        Port "gre-c0a8011c"
            Interface "gre-c0a8011c"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.27", out_key=flow, remote_ip="192.168.1.28"}
        Port "gre-c0a8011d"
            Interface "gre-c0a8011d"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.27", out_key=flow, remote_ip="192.168.1.29"}
        Port "gre-c0a80116"
            Interface "gre-c0a80116"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.27", out_key=flow, remote_ip="192.168.1.22"}
        Port "gre-c0a80119"
            Interface "gre-c0a80119"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.27", out_key=flow, remote_ip="192.168.1.25"}
        Port "gre-c0a80114"
            Interface "gre-c0a80114"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.27", out_key=flow, remote_ip="192.168.1.20"}
        Port br-tun
            Interface br-tun
                type: internal
    Bridge br-int
        fail_mode: secure
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
        Port br-int
            Interface br-int
                type: internal
        Port "qvodcf76c74-64"
            tag: 1
            Interface "qvodcf76c74-64"
    ovs_version: "2.0.2"
br-int    Link encap:Ethernet  HWaddr 3a:5e:47:c5:bf:4a  
          inet6 addr: fe80::2c6e:20ff:fe67:9c5a/64 Scope:Link
          UP BROADCAST RUNNING  MTU:1500  Metric:1
          RX packets:53 errors:0 dropped:0 overruns:0 frame:0
          TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:4780 (4.7 KB)  TX bytes:648 (648.0 B)

br-tun    Link encap:Ethernet  HWaddr 4e:6d:2a:c2:c6:48  
          inet6 addr: fe80::f4c6:aff:fec3:5d71/64 Scope:Link
          UP BROADCAST RUNNING  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 B)  TX bytes:648 (648.0 B)

lo        Link encap:Local Loopback  
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:65536  Metric:1
          RX packets:6125 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6125 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:869210 (869.2 KB)  TX bytes:869210 (869.2 KB)

p1p1      Link encap:Ethernet  HWaddr 38:2c:4a:71:44:c9  
          inet addr:192.168.1.27  Bcast:192.168.1.255  Mask:255.255.255.0
          inet6 addr: fe80::3a2c:4aff:fe71:44c9/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:24033458 errors:0 dropped:0 overruns:17834951 frame:0
          TX packets:45025569 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:3078112015 (3.0 GB)  TX bytes:5764179497 (5.7 GB)
          Memory:fb400000-fb420000 

qbrdcf76c74-64 Link encap:Ethernet  HWaddr 12:17:13:74:ce:33  
          inet6 addr: fe80::f07a:2cff:fe68:13cb/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:43 errors:0 dropped:0 overruns:0 frame:0
          TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:3386 (3.3 KB)  TX bytes:648 (648.0 B)

qvbdcf76c74-64 Link encap:Ethernet  HWaddr 12:17:13:74:ce:33  
          inet6 addr: fe80::1017:13ff:fe74:ce33/64 Scope:Link
          UP BROADCAST RUNNING PROMISC MULTICAST  MTU:1500  Metric:1
          RX packets:125 errors:0 dropped:0 overruns:0 frame:0
          TX packets:152 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:13363 (13.3 KB)  TX bytes:14912 (14.9 KB)

qvodcf76c74-64 Link encap:Ethernet  HWaddr 82:17:93:77:ac:9a  
          inet6 addr: fe80::8017:93ff:fe77:ac9a/64 Scope:Link
          UP BROADCAST RUNNING PROMISC MULTICAST  MTU:1500  Metric:1
          RX packets:152 errors:0 dropped:0 overruns:0 frame:0
          TX packets:125 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:14912 (14.9 KB)  TX bytes:13363 (13.3 KB)

tapdcf76c74-64 Link encap:Ethernet  HWaddr fe:16:3e:f6:0e:13  
          inet6 addr: fe80::fc16:3eff:fef6:e13/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:137 errors:0 dropped:0 overruns:0 frame:0
          TX packets:112 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500 
          RX bytes:13706 (13.7 KB)  TX bytes:12293 (12.2 KB)

virbr0    Link encap:Ethernet  HWaddr 96:46:c8:1e:f7:d7  
          inet addr:192.168.122.1  Bcast:192.168.122.255  Mask:255.255.255.0
          UP BROADCAST MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

On the network node:

4a677e60-c115-4e72-a0ef-40150c826af4
    Bridge br-ex
        Port "qg-5a4df071-c1"
            Interface "qg-5a4df071-c1"
                type: internal
        Port "eth0"
            Interface "eth0"
        Port phy-br-ex
            Interface phy-br-ex
                type: patch
                options: {peer=int-br-ex}
        Port br-ex
            Interface br-ex
                type: internal
    Bridge br-tun
        Port "gre-c0a8011c"
            Interface "gre-c0a8011c"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.22", out_key=flow, remote_ip="192.168.1.28"}
        Port br-tun
            Interface br-tun
                type: internal
        Port "gre-c0a80119"
            Interface "gre-c0a80119"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.22", out_key=flow, remote_ip="192.168.1.25"}
        Port "gre-c0a8011d"
            Interface "gre-c0a8011d"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.22", out_key=flow, remote_ip="192.168.1.29"}
        Port "gre-c0a80114"
            Interface "gre-c0a80114"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.22", out_key=flow, remote_ip="192.168.1.20"}
        Port "gre-c0a80118"
            Interface "gre-c0a80118"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.22", out_key=flow, remote_ip="192.168.1.24"}
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port "gre-c0a80117"
            Interface "gre-c0a80117"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.22", out_key=flow, remote_ip="192.168.1.23"}
        Port "gre-c0a8011a"
            Interface "gre-c0a8011a"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.22", out_key=flow, remote_ip="192.168.1.26"}
        Port "gre-c0a8011b"
            Interface "gre-c0a8011b"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.22", out_key=flow, remote_ip="192.168.1.27"}
        Port "gre-c0a80115"
            Interface "gre-c0a80115"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.22", out_key=flow, remote_ip="192.168.1.21"}
    Bridge br-int
        fail_mode: secure
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
        Port br-int
            Interface br-int
                type: internal
        Port "tap7371c880-ef"
            tag: 1
            Interface "tap7371c880-ef"
                type: internal
        Port "qr-657952a3-ae"
            tag: 1
            Interface "qr-657952a3-ae"
                type: internal
        Port int-br-ex
            Interface int-br-ex
                type: patch
                options: {peer=phy-br-ex}
    ovs_version: "2.0.2"
br-ex     Link encap:Ethernet  HWaddr e4:1f:13:1f:7f:30  
          inet addr:192.168.1.22  Bcast:192.168.1.255  Mask:255.255.255.0
          inet6 addr: fe80::788c:1ff:fe07:7a06/64 Scope:Link
          UP BROADCAST RUNNING  MTU:1500  Metric:1
          RX packets:50511 errors:0 dropped:0 overruns:0 frame:0
          TX packets:59954 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:7547757 (7.5 MB)  TX bytes:10451624 (10.4 MB)

br-int    Link encap:Ethernet  HWaddr f6:e3:60:b7:ed:43  
          inet6 addr: fe80::7c5e:c3ff:fe5f:460/64 Scope:Link
          UP BROADCAST RUNNING  MTU:1500  Metric:1
          RX packets:878 errors:0 dropped:0 overruns:0 frame:0
          TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:91724 (91.7 KB)  TX bytes:648 (648.0 B)

br-tun    Link encap:Ethernet  HWaddr b6:d4:e5:6d:e0:42  
          inet6 addr: fe80::1886:62ff:fed7:85b4/64 Scope:Link
          UP BROADCAST RUNNING  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 B)  TX bytes:648 (648.0 B)

eth0      Link encap:Ethernet  HWaddr e4:1f:13:1f:7f:30  
          inet6 addr: fe80::e61f:13ff:fe1f:7f30/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:51383 errors:0 dropped:0 overruns:0 frame:0
          TX packets:60356 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:7822560 (7.8 MB)  TX bytes:10721388 (10.7 MB)

lo        Link encap:Local Loopback  
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:65536  Metric:1
          RX packets:432 errors:0 dropped:0 overruns:0 frame:0
          TX packets:432 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:41447 (41.4 KB)  TX bytes:41447 (41.4 KB)

virbr0    Link encap:Ethernet  HWaddr 8e:78:51:dd:cb:2e  
          inet addr:192.168.122.1  Bcast:192.168.122.255  Mask:255.255.255.0
          UP BROADCAST MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

Ubuntu 10.04 with juno.

Any idea ? Thanks !

Instance fails to spawn with Unexpected vif_type=binding_failed

Hello everyone

I have a similar issue like

https://ask.openstack.org/en/question/48407/instance-failing-to-spawn-logs-show-novaexception-unexpected-vif_typebinding_failed/ https://ask.openstack.org/en/question/43813/failed-to-bind-port-in-neutron-on-router/ https://ask.openstack.org/en/question/47533/instance-fails-to-spawn-with-unexpected-vif_typebinding_failed/ https://ask.openstack.org/en/question/30333/error-unexpected-vif_typebinding_failed/

. My instances dosen't spawn if I configure them with an interface on the external network.

Internal network works fine: instances are spawned and they get full connectivity throught my openstack router on both interfaces.

No errors in logs except

 neutron.plugins.ml2.managers [req-a3d90314-1c7c-443c-98b0-dcc3b4a9e6e6 None] Failed to bind port 86510eae-291c-4cbd-a61a-aeaeb63c6591 on host cdk7

and of course Unexpected vif_type=binding_failed on the compute node.

I tried various fixed from other bugs, but:

Neutron is spawn using the correct config file:

neutron  20429  3.3  0.0 252688 88508 ?        Ss   16:23   0:33 /usr/bin/python /usr/bin/neutron-server --config-file /etc/neutron/neutron.conf --log-file /var/log/neutron/server.log --config-file /etc/neutron/plugins/ml2/ml2_conf.ini

Openvswitch agents are spawn with the correct config file:

neutron  20429  3.3  0.0 252688 88508 ?        Ss   16:23   0:33 /usr/bin/python /usr/bin/neutron-server --config-file /etc/neutron/neutron.conf --log-file /var/log/neutron/server.log --config-file /etc/neutron/plugins/ml2/ml2_conf.ini

Agents:

+--------------------------------------+--------------------+----------+-------+----------------+---------------------------+
| id                                   | agent_type         | host     | alive | admin_state_up | binary                    |
+--------------------------------------+--------------------+----------+-------+----------------+---------------------------+
| 05363c02-a05e-4261-8555-eb7ef2abd812 | DHCP agent         | cdk2 | :-)   | True           | neutron-dhcp-agent        |
| 13b0890d-637f-4879-ae81-65912f2e0849 | Open vSwitch agent | cdk8 | :-)   | True           | neutron-openvswitch-agent |
| 1fa247e1-1517-4a8a-8c0e-619f690176ab | Open vSwitch agent | cdk4 | :-)   | True           | neutron-openvswitch-agent |
| 5e743013-9175-4772-8ce4-4b268e4c72e6 | Open vSwitch agent | cdk6 | :-)   | True           | neutron-openvswitch-agent |
| 6673d3b8-bc81-4158-842a-be98df094978 | Open vSwitch agent | cdk3 | :-)   | True           | neutron-openvswitch-agent |
| 78826bef-49c4-4004-a4bb-c56bacd0dd03 | Open vSwitch agent | cdk5 | :-)   | True           | neutron-openvswitch-agent |
| 965ebaa4-c36f-458f-b6d9-4c9ef48decf1 | Open vSwitch agent | cdk9 | :-)   | True           | neutron-openvswitch-agent |
| aa5eb61b-0a4e-4df1-a839-2978a33fbefa | Open vSwitch agent | cdk0 | :-)   | True           | neutron-openvswitch-agent |
| b1493f13-54a0-4920-bc0d-525a47cce8b4 | L3 agent           | cdk2 | :-)   | True           | neutron-l3-agent          |
| c2e84809-ec0a-45a0-b478-ab08374bc6e0 | Open vSwitch agent | cdk1 | :-)   | True           | neutron-openvswitch-agent |
| e50bf940-1108-46fa-9397-f449f4ee7b63 | Open vSwitch agent | cdk7 | :-)   | True           | neutron-openvswitch-agent |
| fa1d9ce0-2262-4218-b7f4-2fe07571254d | Open vSwitch agent | cdk2 | :-)   | True           | neutron-openvswitch-agent |
| ff3f9c21-70bb-487f-96f2-44c7aabdd35d | Metadata agent     | cdk2 | :-)   | True           | neutron-metadata-agent    |
+--------------------------------------+--------------------+----------+-------+----------------+---------------------------+

External network:

+---------------------------+--------------------------------------+
| Field                     | Value                                |
+---------------------------+--------------------------------------+
| admin_state_up            | True                                 |
| id                        | 683e7db6-1fcc-4641-b2f6-e245dfff3406 |
| name                      | ext-net                              |
| provider:network_type     | flat                                 |
| provider:physical_network | external                             |
| provider:segmentation_id  |                                      |
| router:external           | True                                 |
| shared                    | True                                 |
| status                    | ACTIVE                               |
| subnets                   | 2c3c8db0-e2bf-4964-ad1f-4a7fa53f631d |
| tenant_id                 | 4e3dbd665e9e4e99a25322017c205092     |
+---------------------------+--------------------------------------+

The port of the router also is in binding_failed, but works :

(neutron) port-show 5a4df071-c1af-4fdb-a81b-990d707ff242
+-----------------------+-------------------------------------------------------------------------------------+
| Field                 | Value                                                                               |
+-----------------------+-------------------------------------------------------------------------------------+
| admin_state_up        | True                                                                                |
| allowed_address_pairs |                                                                                     |
| binding:host_id       | cdk2                                                                            |
| binding:profile       | {}                                                                                  |
| binding:vif_details   | {}                                                                                  |
| binding:vif_type      | binding_failed                                                                      |
| binding:vnic_type     | normal                                                                              |
| device_id             | f2b5b7d3-5786-42bf-a729-eda2722f307d                                                |
| device_owner          | network:router_gateway                                                              |
| extra_dhcp_opts       |                                                                                     |
| fixed_ips             | {"subnet_id": "2c3c8db0-e2bf-4964-ad1f-4a7fa53f631d", "ip_address": "192.168.1.19"} |
| id                    | 5a4df071-c1af-4fdb-a81b-990d707ff242                                                |
| mac_address           | fa:16:3e:dc:07:10                                                                   |
| name                  |                                                                                     |
| network_id            | 683e7db6-1fcc-4641-b2f6-e245dfff3406                                                |
| security_groups       |                                                                                     |
| status                | DOWN                                                                                |
| tenant_id             |                                                                                     |
+-----------------------+-------------------------------------------------------------------------------------+

ml2_conf.ini for all nodes

[ml2]
type_drivers = flat,gre
tenant_network_types = gre
mechanism_drivers = openvswitch
[ml2_type_flat]
flat_networks = external
[ml2_type_vlan]
[ml2_type_gre]
tunnel_id_ranges = 1:1000
[ml2_type_vxlan]
[securitygroup]
enable_security_group = True
enable_ipset = True
firewall_driver = neutron.agent.linux.iptables_firewall.OVSHybridIptablesFirewallDriver
[ovs]
local_ip = 192.168.1.22
enable_tunneling = True
tunnel_type = gre
bridge_mappings = external:br-ex # ONLY ON THE NETWORK NODE
[database]
connection = mysql://neutron:x@cdk0/neutron
[agent]
tunnel_types = gre

neutron.conf

[DEFAULT]
verbose = True
lock_path = $state_path/lock
core_plugin = neutron.plugins.ml2.plugin.Ml2Plugin
service_plugins = router
auth_strategy = keystone
allow_overlapping_ips = True
agent_down_time = 75
notify_nova_on_port_status_changes = True
notify_nova_on_port_data_changes = True
nova_url = http://cdk0:8774/v2
nova_region_name = CDK
nova_admin_username = nova
nova_admin_tenant_id = 881a34a5c1d24d1dac67532190e4d38a
nova_admin_password = x
rabbit_host = cdk0
rabbit_password = x
rpc_backend=rabbit
[matchmaker_redis]
[matchmaker_ring]
[quotas]
[agent]
root_helper = sudo /usr/bin/neutron-rootwrap /etc/neutron/rootwrap.conf
report_interval = 5
tunnel_types = gre
[keystone_authtoken]
auth_uri = http://cdk0:5000/v2.0
identity_uri = http://cdk0:35357
admin_tenant_name = service
admin_user = neutron
admin_password = x
[database]
connection = mysql://neutron:x@cdk0/neutron
[service_providers]
service_provider=LOADBALANCER:Haproxy:neutron.services.loadbalancer.drivers.haproxy.plugin_driver.HaproxyOnHostPluginDriver:default
service_provider=VPN:openswan:neutron.services.vpn.service_drivers.ipsec.IPsecVPNDriver:default

nova.conf:

[DEFAULT]
dhcpbridge_flagfile=/etc/nova/nova.conf
dhcpbridge=/usr/bin/nova-dhcpbridge
logdir=/var/log/nova
state_path=/var/lib/nova
lock_path=/var/lock/nova
force_dhcp_release=True
libvirt_use_virtio_for_bridges=True
verbose=True
ec2_private_dns_show_ip=True
api_paste_config=/etc/nova/api-paste.ini
enabled_apis=ec2,osapi_compute,metadata
compute_driver = libvirt.LibvirtDriver
libvirt_vif_driver=nova.virt.libvirt.vif.LibvirtGenericVIFDriver
rpc_backend = rabbit
rabbit_host = cdk0
rabbit_password = x
auth_strategy = keystone
my_ip = 192.168.1.20
vnc_enabled = True
vncserver_listen = 0.0.0.0
vncserver_proxyclient_address = 192.168.1.20
novncproxy_base_url = http://cdk0:6080/vnc_auto.html
network_api_class = nova.network.neutronv2.api.API
security_group_api = neutron
linuxnet_interface_driver = nova.network.linux_net.LinuxOVSInterfaceDriver
firewall_driver = nova.virt.firewall.NoopFirewallDriver
vif_plugging_is_fatal = False
vif_plugging_timeout = 0
[keystone_authtoken]
auth_uri = http://cdk0:5000/v2.0
identity_uri = http://cdk0:35357
admin_tenant_name = service
admin_user = nova
admin_password = x
[glance]
host = cdk1
[database]
connection = mysql://nova:x@cdk0/nova
[neutron]
url = http://cdk0:9696
auth_strategy = keystone
admin_auth_url = http://cdk0:35357/v2.0
admin_tenant_name = service
admin_username = neutron
admin_password = x
service_metadata_proxy = True
metadata_proxy_shared_secret = x
[libvirt]
virt_type = kvm

nova-conpute.conf:

[DEFAULT]
compute_driver=libvirt.LibvirtDriver
[libvirt]
virt_type=kvmonf:

On the compute node:

149fd981-aa5e-4b8e-9ed5-3af487783fd1
    Bridge br-tun
        Port "gre-c0a80115"
            Interface "gre-c0a80115"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.27", out_key=flow, remote_ip="192.168.1.21"}
        Port "gre-c0a8011a"
            Interface "gre-c0a8011a"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.27", out_key=flow, remote_ip="192.168.1.26"}
        Port "gre-c0a80118"
            Interface "gre-c0a80118"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.27", out_key=flow, remote_ip="192.168.1.24"}
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port "gre-c0a80117"
            Interface "gre-c0a80117"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.27", out_key=flow, remote_ip="192.168.1.23"}
        Port "gre-c0a8011c"
            Interface "gre-c0a8011c"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.27", out_key=flow, remote_ip="192.168.1.28"}
        Port "gre-c0a8011d"
            Interface "gre-c0a8011d"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.27", out_key=flow, remote_ip="192.168.1.29"}
        Port "gre-c0a80116"
            Interface "gre-c0a80116"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.27", out_key=flow, remote_ip="192.168.1.22"}
        Port "gre-c0a80119"
            Interface "gre-c0a80119"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.27", out_key=flow, remote_ip="192.168.1.25"}
        Port "gre-c0a80114"
            Interface "gre-c0a80114"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.27", out_key=flow, remote_ip="192.168.1.20"}
        Port br-tun
            Interface br-tun
                type: internal
    Bridge br-int
        fail_mode: secure
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
        Port br-int
            Interface br-int
                type: internal
        Port "qvodcf76c74-64"
            tag: 1
            Interface "qvodcf76c74-64"
    ovs_version: "2.0.2"
br-int    Link encap:Ethernet  HWaddr 3a:5e:47:c5:bf:4a  
          inet6 addr: fe80::2c6e:20ff:fe67:9c5a/64 Scope:Link
          UP BROADCAST RUNNING  MTU:1500  Metric:1
          RX packets:53 errors:0 dropped:0 overruns:0 frame:0
          TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:4780 (4.7 KB)  TX bytes:648 (648.0 B)

br-tun    Link encap:Ethernet  HWaddr 4e:6d:2a:c2:c6:48  
          inet6 addr: fe80::f4c6:aff:fec3:5d71/64 Scope:Link
          UP BROADCAST RUNNING  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 B)  TX bytes:648 (648.0 B)

lo        Link encap:Local Loopback  
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:65536  Metric:1
          RX packets:6125 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6125 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:869210 (869.2 KB)  TX bytes:869210 (869.2 KB)

p1p1      Link encap:Ethernet  HWaddr 38:2c:4a:71:44:c9  
          inet addr:192.168.1.27  Bcast:192.168.1.255  Mask:255.255.255.0
          inet6 addr: fe80::3a2c:4aff:fe71:44c9/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:24033458 errors:0 dropped:0 overruns:17834951 frame:0
          TX packets:45025569 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:3078112015 (3.0 GB)  TX bytes:5764179497 (5.7 GB)
          Memory:fb400000-fb420000 

qbrdcf76c74-64 Link encap:Ethernet  HWaddr 12:17:13:74:ce:33  
          inet6 addr: fe80::f07a:2cff:fe68:13cb/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:43 errors:0 dropped:0 overruns:0 frame:0
          TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:3386 (3.3 KB)  TX bytes:648 (648.0 B)

qvbdcf76c74-64 Link encap:Ethernet  HWaddr 12:17:13:74:ce:33  
          inet6 addr: fe80::1017:13ff:fe74:ce33/64 Scope:Link
          UP BROADCAST RUNNING PROMISC MULTICAST  MTU:1500  Metric:1
          RX packets:125 errors:0 dropped:0 overruns:0 frame:0
          TX packets:152 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:13363 (13.3 KB)  TX bytes:14912 (14.9 KB)

qvodcf76c74-64 Link encap:Ethernet  HWaddr 82:17:93:77:ac:9a  
          inet6 addr: fe80::8017:93ff:fe77:ac9a/64 Scope:Link
          UP BROADCAST RUNNING PROMISC MULTICAST  MTU:1500  Metric:1
          RX packets:152 errors:0 dropped:0 overruns:0 frame:0
          TX packets:125 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:14912 (14.9 KB)  TX bytes:13363 (13.3 KB)

tapdcf76c74-64 Link encap:Ethernet  HWaddr fe:16:3e:f6:0e:13  
          inet6 addr: fe80::fc16:3eff:fef6:e13/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:137 errors:0 dropped:0 overruns:0 frame:0
          TX packets:112 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500 
          RX bytes:13706 (13.7 KB)  TX bytes:12293 (12.2 KB)

virbr0    Link encap:Ethernet  HWaddr 96:46:c8:1e:f7:d7  
          inet addr:192.168.122.1  Bcast:192.168.122.255  Mask:255.255.255.0
          UP BROADCAST MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

On the network node:

4a677e60-c115-4e72-a0ef-40150c826af4
    Bridge br-ex
        Port "qg-5a4df071-c1"
            Interface "qg-5a4df071-c1"
                type: internal
        Port "eth0"
            Interface "eth0"
        Port phy-br-ex
            Interface phy-br-ex
                type: patch
                options: {peer=int-br-ex}
        Port br-ex
            Interface br-ex
                type: internal
    Bridge br-tun
        Port "gre-c0a8011c"
            Interface "gre-c0a8011c"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.22", out_key=flow, remote_ip="192.168.1.28"}
        Port br-tun
            Interface br-tun
                type: internal
        Port "gre-c0a80119"
            Interface "gre-c0a80119"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.22", out_key=flow, remote_ip="192.168.1.25"}
        Port "gre-c0a8011d"
            Interface "gre-c0a8011d"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.22", out_key=flow, remote_ip="192.168.1.29"}
        Port "gre-c0a80114"
            Interface "gre-c0a80114"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.22", out_key=flow, remote_ip="192.168.1.20"}
        Port "gre-c0a80118"
            Interface "gre-c0a80118"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.22", out_key=flow, remote_ip="192.168.1.24"}
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port "gre-c0a80117"
            Interface "gre-c0a80117"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.22", out_key=flow, remote_ip="192.168.1.23"}
        Port "gre-c0a8011a"
            Interface "gre-c0a8011a"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.22", out_key=flow, remote_ip="192.168.1.26"}
        Port "gre-c0a8011b"
            Interface "gre-c0a8011b"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.22", out_key=flow, remote_ip="192.168.1.27"}
        Port "gre-c0a80115"
            Interface "gre-c0a80115"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="192.168.1.22", out_key=flow, remote_ip="192.168.1.21"}
    Bridge br-int
        fail_mode: secure
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
        Port br-int
            Interface br-int
                type: internal
        Port "tap7371c880-ef"
            tag: 1
            Interface "tap7371c880-ef"
                type: internal
        Port "qr-657952a3-ae"
            tag: 1
            Interface "qr-657952a3-ae"
                type: internal
        Port int-br-ex
            Interface int-br-ex
                type: patch
                options: {peer=phy-br-ex}
    ovs_version: "2.0.2"
br-ex     Link encap:Ethernet  HWaddr e4:1f:13:1f:7f:30  
          inet addr:192.168.1.22  Bcast:192.168.1.255  Mask:255.255.255.0
          inet6 addr: fe80::788c:1ff:fe07:7a06/64 Scope:Link
          UP BROADCAST RUNNING  MTU:1500  Metric:1
          RX packets:50511 errors:0 dropped:0 overruns:0 frame:0
          TX packets:59954 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:7547757 (7.5 MB)  TX bytes:10451624 (10.4 MB)

br-int    Link encap:Ethernet  HWaddr f6:e3:60:b7:ed:43  
          inet6 addr: fe80::7c5e:c3ff:fe5f:460/64 Scope:Link
          UP BROADCAST RUNNING  MTU:1500  Metric:1
          RX packets:878 errors:0 dropped:0 overruns:0 frame:0
          TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:91724 (91.7 KB)  TX bytes:648 (648.0 B)

br-tun    Link encap:Ethernet  HWaddr b6:d4:e5:6d:e0:42  
          inet6 addr: fe80::1886:62ff:fed7:85b4/64 Scope:Link
          UP BROADCAST RUNNING  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 B)  TX bytes:648 (648.0 B)

eth0      Link encap:Ethernet  HWaddr e4:1f:13:1f:7f:30  
          inet6 addr: fe80::e61f:13ff:fe1f:7f30/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:51383 errors:0 dropped:0 overruns:0 frame:0
          TX packets:60356 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:7822560 (7.8 MB)  TX bytes:10721388 (10.7 MB)

lo        Link encap:Local Loopback  
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:65536  Metric:1
          RX packets:432 errors:0 dropped:0 overruns:0 frame:0
          TX packets:432 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:41447 (41.4 KB)  TX bytes:41447 (41.4 KB)

virbr0    Link encap:Ethernet  HWaddr 8e:78:51:dd:cb:2e  
          inet addr:192.168.122.1  Bcast:192.168.122.255  Mask:255.255.255.0
          UP BROADCAST MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

Ubuntu 10.04 with juno.

Any idea ? Thanks !

Edit: On compute:

 ls -l /etc/neutron/*
-rw-r--r-- 1 root neutron  1010 Oct 16 15:14 /etc/neutron/api-paste.ini
-rw-r--r-- 1 root neutron   109 Oct  3 01:25 /etc/neutron/fwaas_driver.ini
-rw-r--r-- 1 root neutron  3996 Oct 16 15:14 /etc/neutron/l3_agent.ini
-rw-r--r-- 1 root neutron 22427 Nov 17 15:49 /etc/neutron/neutron.conf
-rw-r--r-- 1 root neutron 22295 Oct 17 09:26 /etc/neutron/neutron.conf.dpkg-dist
-rw-r--r-- 1 root neutron  6016 Oct 16 15:14 /etc/neutron/policy.json
-rw-r--r-- 1 root root     1164 Oct 16 15:14 /etc/neutron/rootwrap.conf
-rw-r--r-- 1 root neutron   526 Oct  3 01:25 /etc/neutron/vpn_agent.ini

/etc/neutron/plugins:
total 4
drwxr-xr-x 2 root neutron 4096 Nov 17 16:21 ml2

/etc/neutron/rootwrap.d:
total 24
-rw-r--r-- 1 root root  473 Oct  3 01:25 debug.filters
-rw-r--r-- 1 root root  348 Oct 16 15:14 ipset-firewall.filters
-rw-r--r-- 1 root root  683 Oct  3 01:25 iptables-firewall.filters
-rw-r--r-- 1 root root 1771 Oct 16 15:14 l3.filters
-rw-r--r-- 1 root root  658 Oct  3 01:25 openvswitch-plugin.filters
-rw-r--r-- 1 root root  346 Oct  3 01:25 vpnaas.filters

On network:

ls -l /etc/neutron/*
-rw-r--r-- 1 root neutron  1010 Oct 16 15:14 /etc/neutron/api-paste.ini
-rw-r--r-- 1 root neutron  3683 Nov 17 13:53 /etc/neutron/dhcp_agent.ini
-rw-r--r-- 1 root neutron   109 Oct 16 15:14 /etc/neutron/fwaas_driver.ini
-rw-r--r-- 1 root neutron  4025 Nov 12 15:46 /etc/neutron/l3_agent.ini
-rw-r--r-- 1 root neutron  2057 Nov 17 13:53 /etc/neutron/metadata_agent.ini
-rw-r--r-- 1 root neutron 22427 Nov 17 15:49 /etc/neutron/neutron.conf
-rw-r--r-- 1 root neutron  6016 Oct 16 15:14 /etc/neutron/policy.json
-rw-r--r-- 1 root root     1164 Oct 16 15:14 /etc/neutron/rootwrap.conf
-rw-r--r-- 1 root neutron   526 Oct 16 15:14 /etc/neutron/vpn_agent.ini

/etc/neutron/plugins:
total 4
drwxr-xr-x 2 root neutron 4096 Nov 17 16:21 ml2

/etc/neutron/rootwrap.d:
total 28
-rw-r--r-- 1 root root  473 Oct 16 15:14 debug.filters
-rw-r--r-- 1 root root 1466 Oct 16 15:14 dhcp.filters
-rw-r--r-- 1 root root  348 Oct 16 15:14 ipset-firewall.filters
-rw-r--r-- 1 root root  683 Oct 16 15:14 iptables-firewall.filters
-rw-r--r-- 1 root root 1771 Oct 16 15:14 l3.filters
-rw-r--r-- 1 root root  658 Oct 16 15:14 openvswitch-plugin.filters
-rw-r--r-- 1 root root  346 Oct 16 15:14 vpnaas.filters

On controller:

ls -l /etc/neutron/*
-rw-r--r-- 1 root neutron  1010 Oct 16 15:14 /etc/neutron/api-paste.ini
-rw-r--r-- 1 root neutron   109 Oct 16 15:14 /etc/neutron/fwaas_driver.ini
-rw-r--r-- 1 root neutron  3996 Oct 16 15:14 /etc/neutron/l3_agent.ini
-rw-r--r-- 1 root neutron 22427 Nov 17 15:49 /etc/neutron/neutron.conf
-rw-r--r-- 1 root neutron  6016 Oct 16 15:14 /etc/neutron/policy.json
-rw-r--r-- 1 root root     1164 Oct 16 15:14 /etc/neutron/rootwrap.conf
-rw-r--r-- 1 root neutron   526 Oct 16 15:14 /etc/neutron/vpn_agent.ini

/etc/neutron/plugins:
total 4
drwxr-xr-x 2 root neutron 4096 Nov 17 16:21 ml2

/etc/neutron/rootwrap.d:
total 24
-rw-r--r-- 1 root root  473 Oct 16 15:14 debug.filters
-rw-r--r-- 1 root root  348 Oct 16 15:14 ipset-firewall.filters
-rw-r--r-- 1 root root  683 Oct 16 15:14 iptables-firewall.filters
-rw-r--r-- 1 root root 1771 Oct 16 15:14 l3.filters
-rw-r--r-- 1 root root  658 Oct 16 15:14 openvswitch-plugin.filters
-rw-r--r-- 1 root root  346 Oct 16 15:14 vpnaas.filters