Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

neutron-ovs-cleanup failure on juno rdo lacp bonded port

i'm getting an error with my rdo rerun after i created a lacp bond for my ovs-based compute nodes

my rdo/packstack config is:

CONFIG_NEUTRON_ML2_TYPE_DRIVERS=vxlan,flat,vlan
CONFIG_NEUTRON_ML2_TENANT_NETWORK_TYPES=vxlan
CONFIG_NEUTRON_ML2_MECHANISM_DRIVERS=openvswitch
CONFIG_NEUTRON_ML2_FLAT_NETWORKS=*
CONFIG_NEUTRON_ML2_VLAN_RANGES=vlannet:831:831,vlannet:1441:1441
CONFIG_NEUTRON_ML2_TUNNEL_ID_RANGES=
CONFIG_NEUTRON_ML2_VXLAN_GROUP=
CONFIG_NEUTRON_ML2_VNI_RANGES=60000:69999
CONFIG_NEUTRON_L2_AGENT=openvswitch
CONFIG_NEUTRON_LB_INTERFACE_MAPPINGS=
CONFIG_NEUTRON_OVS_BRIDGE_MAPPINGS=vlannet:br-vlan
CONFIG_NEUTRON_OVS_BRIDGE_IFACES=
CONFIG_NEUTRON_OVS_TUNNEL_IF=
CONFIG_NEUTRON_OVS_VXLAN_UDP_PORT=4789

but when i run packstack, it complains about:

# systemctl status neutron-ovs-cleanup.service
neutron-ovs-cleanup.service - OpenStack Neutron Open vSwitch Cleanup Utility
   Loaded: loaded (/usr/lib/systemd/system/neutron-ovs-cleanup.service; enabled)
   Active: failed (Result: exit-code) since Thu 2015-04-23 23:48:04 PDT; 6min ago
  Process: 3359 ExecStart=/usr/bin/neutron-ovs-cleanup --config-file /usr/share/neutron/neutron-dist.conf --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/openvswitch/ovs_neutron_plugin.ini --log-file /var/log/neutron/ovs-cleanup.log (code=exited, status=1/FAILURE)
 Main PID: 3359 (code=exited, status=1/FAILURE)

Apr 23 23:48:03 net-pool02 sudo[3370]: neutron : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/bin/neutron-rootwrap /etc/neutron/rootwrap.conf ovs-vsctl --timeout=10 get Inter...external_ids
Apr 23 23:48:03 net-pool02 sudo[3375]: neutron : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/bin/neutron-rootwrap /etc/neutron/rootwrap.conf ovs-vsctl --timeout=10 get Inter...-vlan ofport
Apr 23 23:48:03 net-pool02 sudo[3379]: neutron : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/bin/neutron-rootwrap /etc/neutron/rootwrap.conf ovs-vsctl --timeout=10 get Inter...external_ids
Apr 23 23:48:03 net-pool02 sudo[3382]: neutron : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/bin/neutron-rootwrap /etc/neutron/rootwrap.conf ovs-vsctl --timeout=10 get Inter...h-tun ofport
Apr 23 23:48:03 net-pool02 sudo[3385]: neutron : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/bin/neutron-rootwrap /etc/neutron/rootwrap.conf ovs-vsctl --timeout=10 list-ports br-ex
Apr 23 23:48:03 net-pool02 sudo[3388]: neutron : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/bin/neutron-rootwrap /etc/neutron/rootwrap.conf ovs-vsctl --timeout=10 get Inter...external_ids
Apr 23 23:48:04 net-pool02 ovs-vsctl[3390]: ovs|00001|vsctl|ERR|no row "bond0" in table Interface
Apr 23 23:48:04 net-pool02 systemd[1]: neutron-ovs-cleanup.service: main process exited, code=exited, status=1/FAILURE
Apr 23 23:48:04 net-pool02 systemd[1]: Failed to start OpenStack Neutron Open vSwitch Cleanup Utility.
Apr 23 23:48:04 net-pool02 systemd[1]: Unit neutron-ovs-cleanup.service entered failed state.
Hint: Some lines were ellipsized, use -l to show in full.

the /var/log/neutron/ovs-cleanup.log shows:

2015-04-23 01:13:28.303 28739 ERROR neutron.agent.linux.utils [-]
Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', 'get', 'Interface', 'bond0', 'external_ids']
Exit code: 1
Stdout: ''
Stderr: 'ovs-vsctl: no row "bond0" in table Interface\n'
2015-04-23 01:13:28.304 28739 ERROR neutron.agent.linux.ovs_lib [-] Unable to execute ['ovs-vsctl', '--timeout=10', 'get', 'Interface', 'bond0', 'external_ids']. Exception:
Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', 'get', 'Interface', 'bond0', 'external_ids']
Exit code: 1
Stdout: ''
Stderr: 'ovs-vsctl: no row "bond0" in table Interface\n'
2015-04-23 01:13:28.304 28739 CRITICAL neutron [-] RuntimeError:
Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', 'get', 'Interface', 'bond0', 'external_ids']
Exit code: 1
Stdout: ''
Stderr: 'ovs-vsctl: no row "bond0" in table Interface\n'
2015-04-23 01:13:28.304 28739 TRACE neutron Traceback (most recent call last):
2015-04-23 01:13:28.304 28739 TRACE neutron   File "/usr/bin/neutron-ovs-cleanup", line 10, in <module>
2015-04-23 01:13:28.304 28739 TRACE neutron     sys.exit(main())
2015-04-23 01:13:28.304 28739 TRACE neutron   File "/usr/lib/python2.7/site-packages/neutron/agent/ovs_cleanup_util.py", line 100, in main
2015-04-23 01:13:28.304 28739 TRACE neutron     conf.AGENT.root_helper)
2015-04-23 01:13:28.304 28739 TRACE neutron   File "/usr/lib/python2.7/site-packages/neutron/agent/ovs_cleanup_util.py", line 60, in collect_neutron_ports
2015-04-23 01:13:28.304 28739 TRACE neutron     ports += [port.port_name for port in ovs.get_vif_ports()]
2015-04-23 01:13:28.304 28739 TRACE neutron   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 300, in get_vif_ports
2015-04-23 01:13:28.304 28739 TRACE neutron     check_error=True)
2015-04-23 01:13:28.304 28739 TRACE neutron   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 253, in db_get_map
2015-04-23 01:13:28.304 28739 TRACE neutron     output = self.run_vsctl(["get", table, record, column], check_error)
2015-04-23 01:13:28.304 28739 TRACE neutron   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 76, in run_vsctl
2015-04-23 01:13:28.304 28739 TRACE neutron     ctxt.reraise = False
2015-04-23 01:13:28.304 28739 TRACE neutron   File "/usr/lib/python2.7/site-packages/neutron/openstack/common/excutils.py", line 82, in __exit__
2015-04-23 01:13:28.304 28739 TRACE neutron     six.reraise(self.type_, self.value, self.tb)
2015-04-23 01:13:28.304 28739 TRACE neutron   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 69, in run_vsctl

my ovs topology is:

# ovs-vsctl show
e56daad5-cd7a-4087-8182-5aa004f08b6d
    Bridge br-ex
        Port "bond0"
            Interface "em1"
            Interface "em2"
        Port patch-to-vlan
            Interface patch-to-vlan
                type: patch
                options: {peer=patch-to-ex}
        Port br-ex
            Interface br-ex
                type: internal
    Bridge br-int
        fail_mode: secure
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
        Port br-int
            Interface br-int
                type: internal
        Port int-br-vlan
            Interface int-br-vlan
                type: patch
                options: {peer=phy-br-vlan}
    Bridge br-tun
        Port br-tun
            Interface br-tun
                type: internal
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port "vxlan-ac17630b"
            Interface "vxlan-ac17630b"
                type: vxlan
                options: {df_default="true", in_key=flow, local_ip="172.23.99.12", out_key=flow, remote_ip="172.23.99.11"}
    Bridge br-vlan
        Port patch-to-ex
            Interface patch-to-ex
                type: patch
                options: {peer=patch-to-vlan}
        Port phy-br-vlan
            Interface phy-br-vlan
                type: patch
                options: {peer=int-br-vlan}
        Port br-vlan
            Interface br-vlan
                type: internal
    ovs_version: "2.3.1"