Ask Your Question
0

Router Interfaces Down

asked 2014-02-13 08:08:54 -0600

Le Wang gravatar image

After checking previous questions/answers, I still can not get my router working properly.

I have dedicated controller, compute and networking nodes running on Ubuntu12.04 with Havana. The problem is on Neutron node, when I create a router and attach a public and private network to it. I am using GRE to connect nodes.

The findings are

  1. The tap and qr ports connected to br-int are always down.

    ~#ovs-ofctl show br-int

 2(patch-tun): addr:0e:22:43:31:0c:b9
 config:     0
 state:      0
 speed: 0 Mbps now, 0 Mbps max  3(tapc6385b42-b8):
 addr:e5:01:00:00:00:00
 config:     PORT_DOWN
 state:      LINK_DOWN
 speed: 0 Mbps now, 0 Mbps max  4(qr-56fa966b-cf):
 addr:e3:01:00:00:00:00
 config:     PORT_DOWN
 state:      LINK_DOWN
 speed: 0 Mbps now, 0 Mbps max  LOCAL(br-int): addr:62:ac:83:9d:38:48
 config:     0
 state:      0
 speed: 0 Mbps now, 0 Mbps max OFPT_GET_CONFIG_REPLY (xid=0x4):
 frags=normal miss_send_len=0
  1. It is similar to qg interface

    ~#ovs-ofctl show br-ex

     1(qg-d482a3ce-b0): addr:e3:01:00:00:00:00
     config:     PORT_DOWN
     state:      LINK_DOWN
     speed: 0 Mbps now, 0 Mbps max
     2(eth2): addr:08:00:27:d9:0a:17
     config:     0
     state:      0
     current:    1GB-FD COPPER AUTO_NEG
     advertised: 10MB-HD 10MB-FD 100MB-HD 100MB-FD 1GB-FD COPPER AUTO_NEG
     supported:  10MB-HD 10MB-FD 100MB-HD 100MB-FD 1GB-FD COPPER AUTO_NEG
     speed: 1000 Mbps now, 1000 Mbps max
     LOCAL(br-ex): addr:08:00:27:d9:0a:17
     config:     0
     state:      0
     speed: 0 Mbps now, 0 Mbps max
     OFPT_GET_CONFIG_REPLY (xid=0x4): frags=normal miss_send_len=0
    
  2. However, the GRE tunnel between Networking and Compute nodes is up and running.

    ~#ovs-ofctl show br-tun

addr:32:85:96:3f:ea:e7  config:     0 
state:      0  
speed: 0 Mbps now, 0
Mbps max  2(gre-1):
addr:ee:4e:ff:d0:dd:9d  config:     0 
state:      0  speed: 0 Mbps now, 0
Mbps max  LOCAL(br-tun):
addr:1a:4b:85:9f:d5:45  config:     0 
state:      0  speed: 0 Mbps now, 0
Mbps max OFPT_GET_CONFIG_REPLY
(xid=0x4):frags=normal miss_send_len=0

Some errors found from /var/log/neutron* ~#tail /var/log/neutron/dhcp-agent.log 2014-02-13 14:32:41.082 7622 ERROR neutron.common.legacy [-] Skipping unknown group key: firewall_driver

~#tail /var/log/neutron/l3-agent.log 2014-02-13 14:32:41.414 7630 ERROR neutron.common.legacy [-] Skipping unknown group key: firewall_driver 2014-02-13 14:32:47.175 7630 WARNING neutron.openstack.common.loopingcall [-] task run outlasted interval by 1.702282 sec

~# tail /var/log/neutron/openvswitch-agent.log 2014-02-13 14:32:43.512 7646 ERROR neutron.openstack.common.rpc.amqp [-] Exception during message handling 2014-02-13 14:32:43.512 7646 TRACE neutron.openstack.common.rpc.amqp Traceback (most recent call last): 2014-02-13 14:32:43.512 7646 TRACE neutron.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/neutron/openstack/common/rpc/amqp.py", line 438, in _process_data 2014-02-13 14:32:43.512 7646 TRACE neutron.openstack.common.rpc.amqp *args) 2014-02-13 14:32:43.512 7646 TRACE neutron.openstack.common.rpc.amqp File "/usr/lib/python2 ... (more)

edit retag flag offensive close merge delete

Comments

Did the instance receive an IP from DHCP? Can the instance ping the internal network gateway?

darragh-oreilly gravatar imagedarragh-oreilly ( 2014-02-13 16:26:32 -0600 )edit

Took me a while playing with up/down states of physical interfaces and proper /etc/network/interfaces configuration to see everything working without manual "ip link set dev ethX up" commands. I just upped every interface "ip link show" could see and suddenly it worked. If you send me your output of "ip link show" on the network node I can compare to mine.

Mathias Ewald gravatar imageMathias Ewald ( 2014-02-14 01:20:39 -0600 )edit

@darragh-oreilly the instance can not receive IP from DHCP and ping to the internal gateway. To solve this problem, I did some digging and found "tap" and "qr" interfaces are both down. This explains why the instance fails to receive anything.

Le Wang gravatar imageLe Wang ( 2014-02-14 01:54:50 -0600 )edit

@Mathias Ewald Thanks and have a look at "ip link show" status from here http://textuploader.com/1c35 Any findings?

Le Wang gravatar imageLe Wang ( 2014-02-14 02:26:23 -0600 )edit

Have a look in the ovs agent log and the output of `ovs-vsctl show`.

darragh-oreilly gravatar imagedarragh-oreilly ( 2014-02-14 03:59:05 -0600 )edit

1 answer

Sort by ยป oldest newest most voted
0

answered 2014-02-14 04:50:33 -0600

Le Wang gravatar image

updated 2014-02-14 06:50:26 -0600

The problem is caused by libvirt on my compute node. After reinstalling it, the instance can get IP address and ping to the outside. However, "ovs-ofctl show br-int" on networking node still shows tap and qr interfaces are down, even though traffic can go though them.Thanks for all the help so far.

edit flag offensive delete link more

Comments

What do you mean by "uninstalling the Libvirt VIF Driver"? The openflow port information from 'ovs-ofctl show br-int' is not useful for troubleshooting neutron.

darragh-oreilly gravatar imagedarragh-oreilly ( 2014-02-14 05:11:33 -0600 )edit

sorry, I mean reinstalling the driver. 'ovs-ofctl show br-int' shows the tap and qr interfaces are down. For me, it looks like the links between dhcp agent and the instance, and between l3 agent and the instances are down.So, the instance was not able to get DHCP reply.

Le Wang gravatar imageLe Wang ( 2014-02-14 05:34:32 -0600 )edit

ok, so what do you mean by "reinstalling the driver"? How exactly did you do that?

darragh-oreilly gravatar imagedarragh-oreilly ( 2014-02-14 05:39:55 -0600 )edit

I read a bug related to libvirt driver, so I reinstalled libvirt. The wording is confusing.

Le Wang gravatar imageLe Wang ( 2014-02-14 06:49:54 -0600 )edit
2

Can you please provide a url link to the bug report. This will help other people reading this, if they have the same problem.

darragh-oreilly gravatar imagedarragh-oreilly ( 2014-02-14 07:10:34 -0600 )edit

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

Stats

Asked: 2014-02-13 08:08:54 -0600

Seen: 6,459 times

Last updated: Feb 14 '14