DHCP Packets are not reaching neutron-dhcp-agent in Openstack-Ansible

asked 2018-05-29 01:35:20 -0500

cshivash gravatar image

Hi,

I have deployed Openstack-ansbile (Pike) in my test environment on Ubuntu 16 with One controller Node and One Compute node.

I am able to see VM's getting an IP alloted in horizon, but inside VM there is no IP present. When i checked logs, i saw cloud-init failed as meta-data server was not reachable.

 url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [0/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7fb8a90573c8>: Failed to establish a new connection: [Errno 101] Network is unreachable',))]

So i was tracking the DHCP Discover message, i can see it coming out of tap interface connected to VM. Then i see it going on br-mgmt interface of compute node to br-mgmt interface of controller node. Finally the packet was seen on eth1 interface of neutron-agents-container. After that im not able to trace the packet to any of the interfaces in either qdhcp namespace or qrouter namespace.

brctl output on neutron-agents container:

root@infra1-neutron-agents-container-c10b7f82:/# brctl show
bridge name bridge id       STP enabled interfaces
brqa3f8aa76-66      8000.5a1245a05a1f   no      tap1d824ac5-cf
                                                            tapbf7cdab2-d1
                                                             vxlan-66
brqe609be0b-73      8000.00163eefa145   no      eth12
                                                            tapadc03cd4-75
root@infra1-neutron-agents-container-c10b7f82:/#

Other details on neutron-agents-container:

root@infra1-neutron-agents-container-c10b7f82:/# ip netns
qrouter-d9e6d4f7-46cf-459a-8faa-a2f11dc006d8 (id: 2)
qdhcp-a3f8aa76-66c0-414e-b7c2-76461168aa5a (id: 1)
root@infra1-neutron-agents-container-c10b7f82:/# 
root@infra1-neutron-agents-container-c10b7f82:/# ip netns e qrouter-d9e6d4f7-46cf-459a-8faa-a2f11dc006d8 ip -4 a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
2: qr-bf7cdab2-d1@if3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc noqueue state UP group default qlen 1000 link-netnsid 0
    inet 10.0.0.1/24 brd 10.0.0.255 scope global qr-bf7cdab2-d1
       valid_lft forever preferred_lft forever
3: qg-adc03cd4-75@if6: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link-netnsid 0
    inet 192.168.88.220/24 brd 192.168.88.255 scope global qg-adc03cd4-75
       valid_lft forever preferred_lft forever
root@infra1-neutron-agents-container-c10b7f82:/# 
root@infra1-neutron-agents-container-c10b7f82:/# ip netns e qdhcp-a3f8aa76-66c0-414e-b7c2-76461168aa5a ip -4 a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
2: ns-1d824ac5-cf: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc noqueue state UP group default qlen 1000 link-netnsid 0
    inet 10.0.0.2/24 brd 10.0.0.255 scope global ns-1d824ac5-cf
       valid_lft forever preferred_lft forever
    inet 169.254.169.254/16 brd 169.254.255.255 scope global ns-1d824ac5-cf
       valid_lft forever preferred_lft forever
root@infra1-neutron-agents-container-c10b7f82:/# 
root@infra1-neutron-agents-container-c10b7f82:/# ip netns e qrouter-d9e6d4f7-46cf-459a-8faa-a2f11dc006d8 netstat -ntlp
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name
tcp        0      0 0.0.0.0:9697            0.0.0.0:*               LISTEN      5608/haproxy    
root@infra1-neutron-agents-container-c10b7f82:/# 
root@infra1-neutron-agents-container-c10b7f82:/# ps -f --pid 5608  | fold -s -w 100
UID        PID  PPID  C STIME TTY          TIME CMD
neutron   5608     1  0 May23 ?        00:00:25 haproxy ...
(more)
edit retag flag offensive close merge delete