seting the network namespace failed: Invalid argument argument

asked 2014-04-06 16:19:43 -0500

Eduardo Piva gravatar image

Quantum: Version: 1:2013.1.4-0ubuntu1~cloud0 Deployed on: Ubuntu 12.04.4 LTS

Recently we've created a new network for a small test on our openstack deployment.

After the deletion of the network attachment of floating ip started failling and we started to have some issues with new instances creating, such as not acquiring DHCP.

After that I restarted quantum services and noticed that the dnmasq service was not restarting, and in the quantum/dhcp-agent.log I had the following error:

Command: ['sudo', 'quantum-rootwrap', '/etc/quantum/rootwrap.conf', 'ip', 'link', 'add', 'tapca76e440-f0', 'type', 'veth', 'peer', 'name', 'ns-ca76e440-f0', 'netns', 'qdhcp-60b51379-182b-406b-aed5-f9f882cf1f1a']
Exit code: 2
Stdout: ''
Stderr: 'RTNETLINK answers: File exists\n'

So the command was indeed trying to create a link that already existed. So I deleted that link and did a quantum-netns-cleanup.

The quantum-netns-cleanup is also not running properly:

$ sudo quantum-netns-cleanup 
Command: ['sudo', 'ip', 'netns', 'exec', 'qrouter-577b0cec-de89-4db8-b69a-0b583b93b0d9', 'ip', '-o', 'link', 'list']
Exit code: 1
Stdout: ''
Stderr: 'seting the network namespace failed: Invalid argument\n'

After that attempt of cleanup when I try to restart quantum-dhcp-agent and quantum-l3 I'm having problems:

quantum-dhcp-agent-log:

2014-04-06 18:08:38    ERROR [quantum.agent.dhcp_agent] Unable to enable dhcp. Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/quantum/agent/dhcp_agent.py", line 131, in call_driver getattr(driver, action)()
File "/usr/lib/python2.7/dist-packages/quantum/agent/linux/dhcp.py", line 124, in enable
reuse_existing=True)
File "/usr/lib/python2.7/dist-packages/quantum/agent/dhcp_agent.py", line 602, in setup
namespace=namespace)
File "/usr/lib/python2.7/dist-packages/quantum/agent/linux/interface.py", line 173, in plug
namespace2=namespace)
File "/usr/lib/python2.7/dist-packages/quantum/agent/linux/ip_lib.py", line 102, in add_veth
self._as_root('', 'link', tuple(args))
File "/usr/lib/python2.7/dist-packages/quantum/agent/linux/ip_lib.py", line 47, in _as_root
namespace)
File "/usr/lib/python2.7/dist-packages/quantum/agent/linux/ip_lib.py", line 58, in _execute
root_helper=root_helper)
File "/usr/lib/python2.7/dist-packages/quantum/agent/linux/utils.py", line 61, in execute
raise RuntimeError(m)
RuntimeError: 
Command: ['sudo', 'quantum-rootwrap', '/etc/quantum/rootwrap.conf', 'ip', 'link', 'add', 'tapca76e440-f0', 'type', 'veth', 'peer', 'name', 'ns-ca76e440-f0', 'netns', 'qdhcp-60b51379-182b-406b-aed5-f9f882cf1f1a']
Exit code: 2
Stdout: ''
Stderr: 'RTNETLINK answers: Invalid argument\n'

quantum-l3-log:

2014-04-06 18:08:34    ERROR [quantum.agent.l3_agent] Failed synchronizing routers Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/quantum/agent/l3_agent.py", line 638, in _sync_routers_task
self._process_routers(routers, all_routers=True)
File "/usr/lib/python2.7/dist-packages/quantum/agent/l3_agent.py", line 621, in _process_routers
self.process_router(ri)
File "/usr/lib/python2.7/dist-packages/quantum/agent/l3_agent.py", line 319, in process_router
self.external_gateway_added(ri, ex_gw_port, internal_cidrs)
File "/usr/lib/python2.7/dist-packages/quantum/agent/l3_agent.py", line 410, in external_gateway_added
prefix=EXTERNAL_DEV_PREFIX)
File "/usr/lib/python2.7/dist-packages/quantum/agent/linux/interface.py", line 191, in plug
namespace_obj.add_device_to_namespace(ns_dev)
File "/usr/lib/python2.7/dist-packages/quantum/agent/linux/ip_lib.py", line 129, in add_device_to_namespace
device.link.set_netns(self.namespace)
File "/usr/lib/python2.7/dist-packages/quantum ...
(more)
edit retag flag offensive close merge delete