Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

Neutron cannot ping router gateway external flat network

Dear Stackers,

I build HA openstack juno on debian wheezy 7.7 with neutron network.

But when i try create external network, i can't ping router::gateway and i found some weird on my neutron-server (controller) and neutron-plugins (network)

neutron.log (controller)

2015-01-17 18:32:38.126 5940 INFO neutron.api.extensions [-] Extension 'Distributed Virtual Router' provides no backward compatibility map for extended attributes

2015-01-17 18:32:38.126 5940 INFO neutron.api.extensions [-] Extension 'Neutron Extra Route' provides no backward compatibility map for extended attributes

neutron-openvswitch-agent.log (network)

2015-01-17 18:26:01.022 13974 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [req-6bb9cbe5-7ce9-4d29-a6d5-17b249f31110 None] Agent out of sync with plugin!

2015-01-17 18:26:01.081 13974 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [req-6bb9cbe5-7ce9-4d29-a6d5-17b249f31110 None] Agent tunnel out of sync with plugin!

2015-01-17 18:27:54.622 13974 ERROR neutron.agent.linux.ovsdb_monitor [-] Error received from ovsdb monitor: ovsdb-client: unix:/var/run/openvswitch/db.sock: receive failed (End of file)

2015-01-17 18:27:54.637 13974 ERROR neutron.agent.linux.utils [-] 
Command: ['ps', '--ppid', '14139', '-o', 'pid=']
Exit code: 1
Stdout: ''
Stderr: ''

2015-01-17 18:27:55.638 13974 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [req-6bb9cbe5-7ce9-4d29-a6d5-17b249f31110 None] Mapping physical network external to bridge br-ex

2015-01-17 18:27:57.628 13974 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [req-6bb9cbe5-7ce9-4d29-a6d5-17b249f31110 None] Agent tunnel out of sync with plugin!

neutron-l3-agent.log (network)

2015-01-17 18:34:29.424 13859 ERROR neutron.agent.linux.utils [-] 
Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-9b5a9267-ef06-4c21-b19d-c62b248e55d9', 'ip', '-o', '-d', 'link', 'list']
Exit code: 1
Stdout: ''
Stderr: 'Cannot open network namespace "qrouter-9b5a9267-ef06-4c21-b19d-c62b248e55d9": No such file or directory\n'

2015-01-17 18:34:29.425 13859 ERROR neutron.agent.l3_agent [-] 
Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-9b5a9267-ef06-4c21-b19d-c62b248e55d9', 'ip', '-o', '-d', 'link', 'list']
Exit code: 1
Stdout: ''
Stderr: 'Cannot open network namespace "qrouter-9b5a9267-ef06-4c21-b19d-c62b248e55d9": No such file or directory\n'

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent Traceback (most recent call last):

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent   File "/usr/lib/python2.7/dist-packages/neutron/common/utils.py", line 341, in call

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent     return func(*args, **kwargs)

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent   File "/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 904, in process_router

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent     existing_devices = self._get_existing_devices(ri)

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent   File "/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 858, in _get_existing_devices

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent     ip_devs = ip_wrapper.get_devices(exclude_loopback=True)

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent   File "/usr/lib/python2.7/dist-packages/neutron/agent/linux/ip_lib.py", line 104, in get_devices

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent     self.root_helper, self.namespace)

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent   File "/usr/lib/python2.7/dist-packages/neutron/agent/linux/ip_lib.py", line 86, in _execute

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent     log_fail_as_error=log_fail_as_error)

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent   File "/usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py", line 84, in execute

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent     raise RuntimeError(m)

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent RuntimeError: 

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-9b5a9267-ef06-4c21-b19d-c62b248e55d9', 'ip', '-o', '-d', 'link', 'list']

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent Exit code: 1

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent Stdout: ''

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent Stderr: 'Cannot open network namespace "qrouter-9b5a9267-ef06-4c21-b19d-c62b248e55d9": No such file or directory\n'

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent

ovs-vsctl show

Bridge br-ex
        Port phy-br-ex
            Interface phy-br-ex
                type: patch
                options: {peer=int-br-ex}
        Port br-ex
            Interface br-ex
                type: internal
        Port "eth3"
            Interface "eth3"
    Bridge br-int
        fail_mode: secure
        Port int-br-ex
            Interface int-br-ex
                type: patch
                options: {peer=phy-br-ex}
        Port br-int
            Interface br-int
                type: internal
        Port "tapfeb59a93-4a"
            tag: 1
            Interface "tapfeb59a93-4a"
                type: internal
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
    Bridge br-tun
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port br-tun
            Interface br-tun
                type: internal
    ovs_version: "2.1.0"

Please really need help T___T,

Really, really appreciate your help..

Thank you

Neutron cannot ping router gateway external flat network

Dear Stackers,

I build HA openstack juno on debian wheezy 7.7 with neutron network.

But when i try create external network, i can't ping router::gateway (status down) and i found some weird on my neutron-server (controller) and neutron-plugins (network)

neutron.log (controller)

2015-01-17 18:32:38.126 5940 INFO neutron.api.extensions [-] Extension 'Distributed Virtual Router' provides no backward compatibility map for extended attributes

2015-01-17 18:32:38.126 5940 INFO neutron.api.extensions [-] Extension 'Neutron Extra Route' provides no backward compatibility map for extended attributes

neutron-openvswitch-agent.log (network)

2015-01-17 18:26:01.022 13974 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [req-6bb9cbe5-7ce9-4d29-a6d5-17b249f31110 None] Agent out of sync with plugin!

2015-01-17 18:26:01.081 13974 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [req-6bb9cbe5-7ce9-4d29-a6d5-17b249f31110 None] Agent tunnel out of sync with plugin!

2015-01-17 18:27:54.622 13974 ERROR neutron.agent.linux.ovsdb_monitor [-] Error received from ovsdb monitor: ovsdb-client: unix:/var/run/openvswitch/db.sock: receive failed (End of file)

2015-01-17 18:27:54.637 13974 ERROR neutron.agent.linux.utils [-] 
Command: ['ps', '--ppid', '14139', '-o', 'pid=']
Exit code: 1
Stdout: ''
Stderr: ''

2015-01-17 18:27:55.638 13974 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [req-6bb9cbe5-7ce9-4d29-a6d5-17b249f31110 None] Mapping physical network external to bridge br-ex

2015-01-17 18:27:57.628 13974 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [req-6bb9cbe5-7ce9-4d29-a6d5-17b249f31110 None] Agent tunnel out of sync with plugin!

neutron-l3-agent.log (network)

2015-01-17 18:34:29.424 13859 ERROR neutron.agent.linux.utils [-] 
Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-9b5a9267-ef06-4c21-b19d-c62b248e55d9', 'ip', '-o', '-d', 'link', 'list']
Exit code: 1
Stdout: ''
Stderr: 'Cannot open network namespace "qrouter-9b5a9267-ef06-4c21-b19d-c62b248e55d9": No such file or directory\n'

2015-01-17 18:34:29.425 13859 ERROR neutron.agent.l3_agent [-] 
Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-9b5a9267-ef06-4c21-b19d-c62b248e55d9', 'ip', '-o', '-d', 'link', 'list']
Exit code: 1
Stdout: ''
Stderr: 'Cannot open network namespace "qrouter-9b5a9267-ef06-4c21-b19d-c62b248e55d9": No such file or directory\n'

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent Traceback (most recent call last):

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent   File "/usr/lib/python2.7/dist-packages/neutron/common/utils.py", line 341, in call

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent     return func(*args, **kwargs)

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent   File "/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 904, in process_router

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent     existing_devices = self._get_existing_devices(ri)

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent   File "/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 858, in _get_existing_devices

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent     ip_devs = ip_wrapper.get_devices(exclude_loopback=True)

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent   File "/usr/lib/python2.7/dist-packages/neutron/agent/linux/ip_lib.py", line 104, in get_devices

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent     self.root_helper, self.namespace)

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent   File "/usr/lib/python2.7/dist-packages/neutron/agent/linux/ip_lib.py", line 86, in _execute

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent     log_fail_as_error=log_fail_as_error)

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent   File "/usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py", line 84, in execute

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent     raise RuntimeError(m)

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent RuntimeError: 

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-9b5a9267-ef06-4c21-b19d-c62b248e55d9', 'ip', '-o', '-d', 'link', 'list']

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent Exit code: 1

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent Stdout: ''

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent Stderr: 'Cannot open network namespace "qrouter-9b5a9267-ef06-4c21-b19d-c62b248e55d9": No such file or directory\n'

2015-01-17 18:34:29.425 13859 TRACE neutron.agent.l3_agent

ovs-vsctl show

Bridge br-ex
        Port phy-br-ex
            Interface phy-br-ex
                type: patch
                options: {peer=int-br-ex}
        Port br-ex
            Interface br-ex
                type: internal
        Port "eth3"
            Interface "eth3"
    Bridge br-int
        fail_mode: secure
        Port int-br-ex
            Interface int-br-ex
                type: patch
                options: {peer=phy-br-ex}
        Port br-int
            Interface br-int
                type: internal
        Port "tapfeb59a93-4a"
            tag: 1
            Interface "tapfeb59a93-4a"
                type: internal
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
    Bridge br-tun
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port br-tun
            Interface br-tun
                type: internal
    ovs_version: "2.1.0"

Please really need help T___T,

Really, really appreciate your help..

Thank you