Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

ovs-vswitchd crashing continuously on reboot of network node

Hi,

I recently finished the first phase of a 4 node OpenStack (Juno) lab on CentOS 7 using the guide found here:

http://docs.openstack.org/juno/install-guide/install/yum/content/ch_preface.html

On the whole this went pretty smoothly and I was able to launch instances and ping the l3 agent router IPs etc. I'm running into an external issue that necessitates that I reboot my network node and am finding that after it comes back up, my instances are no longer able to leverage any network node services any longer (dhcp and l3 are now inaccessible).

I noticed that ovs-vswitchd seems to be crashing and respawning constantly after the reboot with messages to this effect:

2015-04-22T03:07:31.535Z|00023|bridge|INFO|ovs-vswitchd (Open vSwitch) 2.1.3
2015-04-24T21:47:21.457Z|00024|memory|INFO|43132 kB peak resident set size after 10.0 seconds
2015-04-24T21:47:21.457Z|00025|memory|INFO|dispatchers:1 flow_dumpers:1 handlers:1 ports:13 revalidator keys:1 revalidators:1 rules:11
2015-04-24T21:47:26.187Z|00026|bridge|INFO|bridge br-int: added interface tap9dc19b59-70 on port 1
2015-04-24T21:47:26.855Z|00027|netdev_linux|INFO|ioctl(SIOCGIFHWADDR) on tap9dc19b59-70 device failed: No such device
2015-04-24T21:47:26.874Z|00028|netdev_linux|WARN|ioctl(SIOCGIFINDEX) on tap9dc19b59-70 device failed: No such device
2015-04-24T21:47:26.875Z|00029|netdev_linux|WARN|tap9dc19b59-70: removing policing failed: No such device
2015-04-24T21:47:27.013Z|00030|bridge|INFO|bridge br-int: added interface int-br-ex on port 2
2015-04-24T21:47:27.160Z|00031|bridge|INFO|bridge br-ex: added interface phy-br-ex on port 2
2015-04-24T21:47:27.652Z|00002|daemon(monitor)|ERR|1 crashes: pid 666 died, killed (Segmentation fault), restarting
2015-04-24T21:47:27.655Z|00003|memory|INFO|9520 kB peak resident set size after 16.2 seconds
2015-04-24T21:47:27.655Z|00004|reconnect|INFO|unix:/var/run/openvswitch/db.sock: connecting...
2015-04-24T21:47:27.655Z|00005|reconnect|INFO|unix:/var/run/openvswitch/db.sock: connected
2015-04-24T21:47:27.706Z|00006|netdev_linux|INFO|ioctl(SIOCGIFHWADDR) on tap9dc19b59-70 device failed: No such device
2015-04-24T21:47:27.709Z|00007|bridge|INFO|bridge br-ex: added interface br-ex on port 65534
2015-04-24T21:47:27.709Z|00008|bridge|INFO|bridge br-ex: added interface eno50338560 on port 1
2015-04-24T21:47:27.709Z|00009|bridge|INFO|bridge br-ex: added interface phy-br-ex on port 2
2015-04-24T21:47:27.709Z|00010|bridge|INFO|bridge br-int: added interface br-int on port 65534
2015-04-24T21:47:27.709Z|00011|bridge|INFO|bridge br-int: added interface tap9dc19b59-70 on port 1
2015-04-24T21:47:27.712Z|00012|netdev_linux|WARN|ioctl(SIOCGIFINDEX) on tap9dc19b59-70 device failed: No such device
2015-04-24T21:47:27.712Z|00013|bridge|INFO|bridge br-int: added interface int-br-ex on port 2
2015-04-24T21:47:27.712Z|00014|bridge|INFO|bridge br-ex: using datapath ID 0000005056996d07
2015-04-24T21:47:27.712Z|00015|connmgr|INFO|br-ex: added service controller "punix:/var/run/openvswitch/br-ex.mgmt"
2015-04-24T21:47:27.712Z|00016|bridge|INFO|bridge br-int: using datapath ID 00003a25509d8841
2015-04-24T21:47:27.712Z|00017|netdev_linux|WARN|tap9dc19b59-70: removing policing failed: No such device
2015-04-24T21:47:27.712Z|00018|connmgr|INFO|br-int: added service controller "punix:/var/run/openvswitch/br-int.mgmt"
2015-04-24T21:47:27.718Z|00019|bridge|INFO|ovs-vswitchd (Open vSwitch) 2.1.3
2015-04-24T21:47:27.825Z|00020|bridge|INFO|bridge br-tun: added interface br-tun on port 65534
2015-04-24T21:47:27.825Z|00021|bridge|INFO|bridge br-tun: using datapath ID 0000d284cce7f34b
2015-04-24T21:47:27.825Z|00022|connmgr|INFO|br-tun: added service controller "punix:/var/run/openvswitch/br-tun.mgmt"
2015-04-24T21:47:27.915Z|00023|bridge|INFO|bridge br-int: added interface patch-tun on port 3
2015-04-24T21:47:28.174Z|00024|bridge|INFO|bridge br-tun: added interface patch-int on port 1
2015-04-24T21:47:29.104Z|00025|bridge|INFO|bridge br-int: added interface qr-eb15101e-58 on port 4
2015-04-24T21:47:29.295Z|00026|netdev_linux|INFO|ioctl(SIOCGIFHWADDR) on qr-eb15101e-58 device failed: No such device
2015-04-24T21:47:29.615Z|00027|netdev_linux|WARN|ioctl(SIOCGIFINDEX) on qr-eb15101e-58 device failed: No such device
2015-04-24T21:47:29.615Z|00028|netdev_linux|WARN|qr-eb15101e-58: removing policing failed: No such device
2015-04-24T21:47:29.995Z|00029|bridge|INFO|bridge br-ex: added interface qg-aac1b24f-5d on port 3
2015-04-24T21:47:30.156Z|00030|netdev_linux|INFO|ioctl(SIOCGIFHWADDR) on qg-aac1b24f-5d device failed: No such device
2015-04-24T21:47:30.181Z|00031|netdev_linux|WARN|ioctl(SIOCGIFINDEX) on qg-aac1b24f-5d device failed: No such device
2015-04-24T21:47:30.181Z|00032|netdev_linux|WARN|qg-aac1b24f-5d: removing policing failed: No such device
2015-04-24T21:47:30.249Z|00033|bridge|INFO|bridge br-int: added interface int-br-ex on port 5
2015-04-24T21:47:30.383Z|00034|bridge|INFO|bridge br-ex: added interface phy-br-ex on port 4
2015-04-24T21:47:30.893Z|00003|daemon(monitor)|WARN|2 crashes: pid 2502 died, killed (Segmentation fault), waiting until 10 seconds since last restart

If I delete the br-ex bridge and recreate it then the errors and restarts cease, but that doesn't return things to an operational state.

Anyway this is probably a simple one that others have already hit and fixed, but I am still a little new to OS et al, so any help would be appreciated.

Best regards, Nate

I've included some additional diagnostic output below if it helps.

PRE REBOOT (EVERYTHING WORKING)---------------------------------------------------->

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN 
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eno16780032: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
    link/ether 00:50:56:99:0e:39 brd ff:ff:ff:ff:ff:ff
    inet 172.24.98.122/23 brd 172.24.99.255 scope global eno16780032
       valid_lft forever preferred_lft forever
    inet6 fe80::250:56ff:fe99:e39/64 scope link 
       valid_lft forever preferred_lft forever
3: eno33559296: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
    link/ether 00:50:56:99:26:39 brd ff:ff:ff:ff:ff:ff
    inet 10.11.21.122/16 brd 10.11.255.255 scope global eno33559296
       valid_lft forever preferred_lft forever
    inet6 fe80::250:56ff:fe99:2639/64 scope link 
       valid_lft forever preferred_lft forever
4: eno50338560: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master ovs-system state UP qlen 1000
    link/ether 00:50:56:99:6d:07 brd ff:ff:ff:ff:ff:ff
    inet 169.254.5.159/16 brd 169.254.255.255 scope link eno50338560
       valid_lft forever preferred_lft forever
    inet6 fe80::250:56ff:fe99:6d07/64 scope link 
       valid_lft forever preferred_lft forever
5: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN 
    link/ether fa:99:df:bb:4b:40 brd ff:ff:ff:ff:ff:ff
6: br-ex: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN 
    link/ether 00:50:56:99:6d:07 brd ff:ff:ff:ff:ff:ff
7: br-int: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN 
    link/ether 3a:25:50:9d:88:41 brd ff:ff:ff:ff:ff:ff
9: br-tun: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN 
    link/ether 8a:31:e5:86:ec:4a brd ff:ff:ff:ff:ff:ff

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN 
2: eno16780032: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
3: eno33559296: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
4: eno50338560: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master ovs-system state UP qlen 1000
5: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN 
6: br-ex: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN 
7: br-int: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN 
9: br-tun: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN 

qdhcp-5f08e097-8a66-4e8b-baa7-7af0bb468831
qrouter-af5664b1-0da5-405b-bb02-3c570c93da82

qdhcp-5f08e097-8a66-4e8b-baa7-7af0bb468831: 
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN 
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
20: tap9dc19b59-70: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN 
    link/ether fa:16:3e:80:43:ea brd ff:ff:ff:ff:ff:ff
    inet 192.168.1.3/24 brd 192.168.1.255 scope global tap9dc19b59-70
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fe80:43ea/64 scope link 
       valid_lft forever preferred_lft forever
qrouter-af5664b1-0da5-405b-bb02-3c570c93da82: 
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN 
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
18: qr-d38f9fd5-28: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN 
    link/ether fa:16:3e:cd:b2:7f brd ff:ff:ff:ff:ff:ff
    inet 192.168.1.1/24 brd 192.168.1.255 scope global qr-d38f9fd5-28
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fecd:b27f/64 scope link 
       valid_lft forever preferred_lft forever
19: qg-aac1b24f-5d: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN 
    link/ether fa:16:3e:aa:e9:53 brd ff:ff:ff:ff:ff:ff
    inet 10.12.21.200/16 brd 10.12.255.255 scope global qg-aac1b24f-5d
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:feaa:e953/64 scope link 
       valid_lft forever preferred_lft forever

Chain INPUT (policy ACCEPT)
target     prot opt source               destination         
neutron-openvswi-INPUT  all  --  anywhere             anywhere            

Chain FORWARD (policy ACCEPT)
target     prot opt source               destination         
neutron-filter-top  all  --  anywhere             anywhere            
neutron-openvswi-FORWARD  all  --  anywhere             anywhere            

Chain OUTPUT (policy ACCEPT)
target     prot opt source               destination         
neutron-filter-top  all  --  anywhere             anywhere            
neutron-openvswi-OUTPUT  all  --  anywhere             anywhere            

Chain neutron-filter-top (2 references)
target     prot opt source               destination         
neutron-openvswi-local  all  --  anywhere             anywhere            

Chain neutron-openvswi-FORWARD (1 references)
target     prot opt source               destination         

Chain neutron-openvswi-INPUT (1 references)
target     prot opt source               destination         

Chain neutron-openvswi-OUTPUT (1 references)
target     prot opt source               destination         

Chain neutron-openvswi-local (1 references)
target     prot opt source               destination         

Chain neutron-openvswi-sg-chain (0 references)
target     prot opt source               destination         

Chain neutron-openvswi-sg-fallback (0 references)
target     prot opt source               destination         
DROP       all  --  anywhere             anywhere            

1530f058-11e1-48d2-9d55-6a41dbe96181
    Bridge br-ex
        Port br-ex
            Interface br-ex
                type: internal
        Port phy-br-ex
            Interface phy-br-ex
                type: patch
                options: {peer=int-br-ex}
        Port "qg-aac1b24f-5d"
            Interface "qg-aac1b24f-5d"
                type: internal
        Port "eno50338560"
            Interface "eno50338560"
    Bridge br-tun
        Port "gre-0a0b157b"
            Interface "gre-0a0b157b"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="10.11.21.122", out_key=flow, remote_ip="10.11.21.123"}
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port br-tun
            Interface br-tun
                type: internal
        Port "gre-0a0b157c"
            Interface "gre-0a0b157c"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="10.11.21.122", out_key=flow, remote_ip="10.11.21.124"}
    Bridge br-int
        fail_mode: secure
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
        Port "tap9dc19b59-70"
            tag: 4
            Interface "tap9dc19b59-70"
                type: internal
        Port br-int
            Interface br-int
                type: internal
        Port int-br-ex
            Interface int-br-ex
                type: patch
                options: {peer=phy-br-ex}
        Port "qr-d38f9fd5-28"
            tag: 4
            Interface "qr-d38f9fd5-28"
                type: internal
    ovs_version: "2.1.3"

+--------------------------------------+--------------------+-----------------------+-------+----------------+---------------------------+
| id                                   | agent_type         | host                  | alive | admin_state_up | binary                    |
+--------------------------------------+--------------------+-----------------------+-------+----------------+---------------------------+
| 0e88bd7b-0dd4-49bf-9418-f5960157c59e | Metadata agent     | network01.example.com | :-)   | True           | neutron-metadata-agent    |
| 602f6ca2-669d-4583-8c81-488705bca439 | Open vSwitch agent | network01.example.com | :-)   | True           | neutron-openvswitch-agent |
| a5288e91-1c58-4087-b33f-55a43e60ca30 | DHCP agent         | network01.example.com | :-)   | True           | neutron-dhcp-agent        |
| bab10ca8-416f-4d74-8761-5d091a49af4c | Open vSwitch agent | compute01.example.com | :-)   | True           | neutron-openvswitch-agent |
| c5d16d92-fb38-4ac6-9e29-80f339f69ff5 | Open vSwitch agent | compute02.example.com | :-)   | True           | neutron-openvswitch-agent |
| ebc50ac7-a7f1-49f9-9436-5ada48083815 | L3 agent           | network01.example.com | :-)   | True           | neutron-l3-agent          |
+--------------------------------------+--------------------+-----------------------+-------+----------------+---------------------------+

+----+------------------+--------------------------+----------+---------+-------+----------------------------+-----------------+
| Id | Binary           | Host                     | Zone     | Status  | State | Updated_at                 | Disabled Reason |
+----+------------------+--------------------------+----------+---------+-------+----------------------------+-----------------+
| 1  | nova-cert        | controller01.example.com | internal | enabled | up    | 2015-04-24T21:46:34.000000 | -               |
| 2  | nova-consoleauth | controller01.example.com | internal | enabled | up    | 2015-04-24T21:46:33.000000 | -               |
| 3  | nova-conductor   | controller01.example.com | internal | enabled | up    | 2015-04-24T21:46:35.000000 | -               |
| 4  | nova-scheduler   | controller01.example.com | internal | enabled | up    | 2015-04-24T21:46:32.000000 | -               |
| 5  | nova-compute     | compute01.example.com    | nova     | enabled | up    | 2015-04-24T21:46:32.000000 | -               |
| 6  | nova-compute     | compute02.example.com    | nova     | enabled | up    | 2015-04-24T21:46:27.000000 | -               |
+----+------------------+--------------------------+----------+---------+-------+----------------------------+-----------------+

POST REBOOT (dhcp and l3 not working)---------------------------------------------------->

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN 
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eno16780032: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
    link/ether 00:50:56:99:0e:39 brd ff:ff:ff:ff:ff:ff
    inet 172.24.98.122/23 brd 172.24.99.255 scope global eno16780032
       valid_lft forever preferred_lft forever
    inet6 fe80::250:56ff:fe99:e39/64 scope link 
       valid_lft forever preferred_lft forever
3: eno33559296: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
    link/ether 00:50:56:99:26:39 brd ff:ff:ff:ff:ff:ff
    inet 10.11.21.122/16 brd 10.11.255.255 scope global eno33559296
       valid_lft forever preferred_lft forever
    inet6 fe80::250:56ff:fe99:2639/64 scope link 
       valid_lft forever preferred_lft forever
4: eno50338560: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master ovs-system state UP qlen 1000
    link/ether 00:50:56:99:6d:07 brd ff:ff:ff:ff:ff:ff
    inet 169.254.5.159/16 brd 169.254.255.255 scope link eno50338560
       valid_lft forever preferred_lft forever
    inet6 fe80::250:56ff:fe99:6d07/64 scope link 
       valid_lft forever preferred_lft forever
5: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN 
    link/ether 7a:77:a7:c4:ad:22 brd ff:ff:ff:ff:ff:ff
6: br-ex: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN 
    link/ether 00:50:56:99:6d:07 brd ff:ff:ff:ff:ff:ff
8: br-int: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN 
    link/ether 3a:25:50:9d:88:41 brd ff:ff:ff:ff:ff:ff
17: br-tun: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN 
    link/ether ba:af:49:96:86:4a brd ff:ff:ff:ff:ff:ff

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN 
2: eno16780032: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
3: eno33559296: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
4: eno50338560: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master ovs-system state UP qlen 1000
5: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN 
6: br-ex: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN 
8: br-int: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN 
17: br-tun: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN 

qdhcp-5f08e097-8a66-4e8b-baa7-7af0bb468831
qrouter-af5664b1-0da5-405b-bb02-3c570c93da82

qdhcp-5f08e097-8a66-4e8b-baa7-7af0bb468831: 
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN 
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
12: tap9dc19b59-70: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN 
    link/ether fa:16:3e:80:43:ea brd ff:ff:ff:ff:ff:ff
    inet 192.168.1.3/24 brd 192.168.1.255 scope global tap9dc19b59-70
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fe80:43ea/64 scope link 
       valid_lft forever preferred_lft forever
qrouter-af5664b1-0da5-405b-bb02-3c570c93da82: 
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN 
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
14: qr-eb15101e-58: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN 
    link/ether fa:16:3e:86:4a:b7 brd ff:ff:ff:ff:ff:ff
    inet 192.168.1.1/24 brd 192.168.1.255 scope global qr-eb15101e-58
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fe86:4ab7/64 scope link 
       valid_lft forever preferred_lft forever
15: qg-aac1b24f-5d: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN 
    link/ether fa:16:3e:aa:e9:53 brd ff:ff:ff:ff:ff:ff
    inet 10.12.21.200/16 brd 10.12.255.255 scope global qg-aac1b24f-5d
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:feaa:e953/64 scope link 
       valid_lft forever preferred_lft forever

Chain INPUT (policy ACCEPT)
target     prot opt source               destination         
neutron-openvswi-INPUT  all  --  anywhere             anywhere            

Chain FORWARD (policy ACCEPT)
target     prot opt source               destination         
neutron-filter-top  all  --  anywhere             anywhere            
neutron-openvswi-FORWARD  all  --  anywhere             anywhere            

Chain OUTPUT (policy ACCEPT)
target     prot opt source               destination         
neutron-filter-top  all  --  anywhere             anywhere            
neutron-openvswi-OUTPUT  all  --  anywhere             anywhere            

Chain neutron-filter-top (2 references)
target     prot opt source               destination         
neutron-openvswi-local  all  --  anywhere             anywhere            

Chain neutron-openvswi-FORWARD (1 references)
target     prot opt source               destination         

Chain neutron-openvswi-INPUT (1 references)
target     prot opt source               destination         

Chain neutron-openvswi-OUTPUT (1 references)
target     prot opt source               destination         

Chain neutron-openvswi-local (1 references)
target     prot opt source               destination         

Chain neutron-openvswi-sg-chain (0 references)
target     prot opt source               destination         

Chain neutron-openvswi-sg-fallback (0 references)
target     prot opt source               destination         
DROP       all  --  anywhere             anywhere            

1530f058-11e1-48d2-9d55-6a41dbe96181
    Bridge br-ex
        Port "qg-aac1b24f-5d"
            Interface "qg-aac1b24f-5d"
                type: internal
        Port phy-br-ex
            Interface phy-br-ex
                type: patch
                options: {peer=int-br-ex}
        Port br-ex
            Interface br-ex
                type: internal
        Port "eno50338560"
            Interface "eno50338560"
    Bridge br-tun
        Port br-tun
            Interface br-tun
                type: internal
        Port "gre-0a0b157c"
            Interface "gre-0a0b157c"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="10.11.21.122", out_key=flow, remote_ip="10.11.21.124"}
        Port "gre-0a0b157b"
            Interface "gre-0a0b157b"
                type: gre
                options: {df_default="true", in_key=flow, local_ip="10.11.21.122", out_key=flow, remote_ip="10.11.21.123"}
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
    Bridge br-int
        fail_mode: secure
        Port "tap9dc19b59-70"
            tag: 1
            Interface "tap9dc19b59-70"
                type: internal
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
        Port "qr-eb15101e-58"
            tag: 4095
            Interface "qr-eb15101e-58"
                type: internal
        Port br-int
            Interface br-int
                type: internal
        Port int-br-ex
            Interface int-br-ex
                type: patch
                options: {peer=phy-br-ex}
    ovs_version: "2.1.3"

+--------------------------------------+--------------------+-----------------------+-------+----------------+---------------------------+
| id                                   | agent_type         | host                  | alive | admin_state_up | binary                    |
+--------------------------------------+--------------------+-----------------------+-------+----------------+---------------------------+
| 0e88bd7b-0dd4-49bf-9418-f5960157c59e | Metadata agent     | network01.example.com | :-)   | True           | neutron-metadata-agent    |
| 602f6ca2-669d-4583-8c81-488705bca439 | Open vSwitch agent | network01.example.com | :-)   | True           | neutron-openvswitch-agent |
| a5288e91-1c58-4087-b33f-55a43e60ca30 | DHCP agent         | network01.example.com | :-)   | True           | neutron-dhcp-agent        |
| bab10ca8-416f-4d74-8761-5d091a49af4c | Open vSwitch agent | compute01.example.com | :-)   | True           | neutron-openvswitch-agent |
| c5d16d92-fb38-4ac6-9e29-80f339f69ff5 | Open vSwitch agent | compute02.example.com | :-)   | True           | neutron-openvswitch-agent |
| ebc50ac7-a7f1-49f9-9436-5ada48083815 | L3 agent           | network01.example.com | :-)   | True           | neutron-l3-agent          |
+--------------------------------------+--------------------+-----------------------+-------+----------------+---------------------------+

+----+------------------+--------------------------+----------+---------+-------+----------------------------+-----------------+
| Id | Binary           | Host                     | Zone     | Status  | State | Updated_at                 | Disabled Reason |
+----+------------------+--------------------------+----------+---------+-------+----------------------------+-----------------+
| 1  | nova-cert        | controller01.example.com | internal | enabled | up    | 2015-04-24T21:50:54.000000 | -               |
| 2  | nova-consoleauth | controller01.example.com | internal | enabled | up    | 2015-04-24T21:50:53.000000 | -               |
| 3  | nova-conductor   | controller01.example.com | internal | enabled | up    | 2015-04-24T21:50:55.000000 | -               |
| 4  | nova-scheduler   | controller01.example.com | internal | enabled | up    | 2015-04-24T21:50:52.000000 | -               |
| 5  | nova-compute     | compute01.example.com    | nova     | enabled | up    | 2015-04-24T21:50:52.000000 | -               |
| 6  | nova-compute     | compute02.example.com    | nova     | enabled | up    | 2015-04-24T21:50:47.000000 | -               |
+----+------------------+--------------------------+----------+---------+-------+----------------------------+-----------------+