Ask Your Question
0

DHCP and Instances Addressing stopped working

asked 2014-07-18 17:38:23 -0500

RStack gravatar image

updated 2014-07-18 18:48:47 -0500

Hi,

I'm running openStack with the following Setup

  • 1x Controller Node has ( Glance, Neutron, Horizon, MySQl, Nova ) and the network model is GRE "CONFIG_NOVA_NETWORK_MANAGER=nova.network.manager.FlatDHCPManager"
  • 1x Compute Node ( nova-compute )

OS : CentOS 6 - 64bit + KVM

The setup was completely stable until today, Suddenly all new vm's can't get new IP from the neutron server and i have old vm's currently running if one of them is restarted it will not get the local IP Address. So i think there may be a problem withing dhcp or any other stuff.

From Controller Node

~ cat /var/log/neutron/dhcp-agent.log

2014-07-19 01:18:30.322 11403 INFO neutron.openstack.common.service [-] Caught SIGTERM, exiting
2014-07-19 01:18:30.867 30198 INFO neutron.common.config [-] Logging enabled!
2014-07-19 01:18:30.868 30198 ERROR neutron.common.legacy [-] Skipping unknown group key: firewall_driver
2014-07-19 01:18:30.882 30198 INFO neutron.agent.linux.dhcp [-] dnsmasq version: 2.48
2014-07-19 01:18:30.998 30198 INFO neutron.agent.dhcp_agent [-] DHCP agent started
2014-07-19 01:18:31.027 30198 INFO neutron.agent.dhcp_agent [-] Synchronizing state

From my Compute Node

tail -n 100 /var/log/neutron/openvswitch-agent.log

http://paste.openstack.org/show/87197/

Installed Packages and Versions.

~ rpm -qa | grep -i openstack - On control Node
openstack-selinux-0.1.3-2.el6ost.noarch
openstack-puppet-modules-2013.2-9.1.el6.noarch
openstack-ceilometer-api-2013.2.3-2.el6.noarch
openstack-packstack-2013.2.1-0.36.dev1013.el6.noarch
openstack-nova-scheduler-2013.2.3-1.el6.noarch
openstack-ceilometer-common-2013.2.3-2.el6.noarch
python-django-openstack-auth-1.1.2-1.el6.noarch
openstack-ceilometer-central-2013.2.3-2.el6.noarch
openstack-ceilometer-collector-2013.2.3-2.el6.noarch
openstack-neutron-openvswitch-2013.2.3-9.el6.noarch
openstack-nova-common-2013.2.3-1.el6.noarch
openstack-packstack-puppet-2013.2.1-0.36.dev1013.el6.noarch
openstack-glance-2013.2.3-2.el6.noarch
openstack-nova-conductor-2013.2.3-1.el6.noarch
openstack-nova-novncproxy-2013.2.3-1.el6.noarch
openstack-nova-cert-2013.2.3-1.el6.noarch
openstack-keystone-2013.2.3-3.el6.noarch
openstack-neutron-2013.2.3-9.el6.noarch
openstack-ceilometer-alarm-2013.2.3-2.el6.noarch
openstack-dashboard-2013.2.3-1.el6.noarch
openstack-nova-api-2013.2.3-1.el6.noarch
openstack-nova-console-2013.2.3-1.el6.noarch
openstack-utils-2013.2-2.el6.noarch

~ rpm -qa | grep -i openstack - On Compute Node
openstack-ceilometer-common-2013.2.3-2.el6.noarch
openstack-neutron-openvswitch-2013.2.3-9.el6.noarch
openstack-utils-2013.2-2.el6.noarch
openstack-ceilometer-compute-2013.2.3-2.el6.noarch
openstack-nova-compute-2013.2.3-1.el6.noarch
openstack-selinux-0.1.3-2.el6ost.noarch
openstack-nova-common-2013.2.3-1.el6.noarch
openstack-neutron-2013.2.3-9.el6.noarch

dhcp-agent is running on the controller node.

neutron  30198  0.4  0.1 275060 33732 ?        S    01:18   0:03 /usr/bin/python /usr/bin/neutron-dhcp-agent --log-file /var/log/neutron/dhcp-agent.log --config-file /usr/share/neutron/neutron-dist.conf --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/dhcp_agent.ini

Help please.

edit retag flag offensive close merge delete

Comments

On controller
$ ps -ef | grep dnsmasq
What says /var/log/neutron/dnsmasq.log

dbaxps gravatar imagedbaxps ( 2014-07-19 00:58:13 -0500 )edit

@dbaxpsnobody 12639 1 0 04:10 ? 00:00:00 dnsmasq --no-hosts --no-resolv --strict-order --bind-interfaces --interface=tap7139b265-41 --except-interface=lo --pid-file=/var/lib/neutron/dhcp/c19ca2ea-8278-4069-bfea-dadd92961cac/pid --dhcp-hostsfile=/var/lib/neutron/dhcp/c19ca2ea-8278-4069-bfea-dadd92961cac/host --dhcp-optsfile=/var/lib/neutron/dhcp/c19ca2ea-8278-4069-bfea-dadd92961cac/opts --leasefile-ro --dhcp-range=tag0,10.0.0.0,static,86400s --dhcp-lease-max=256 --conf-file= --domain=openstacklocal

This file not found on the controller node "/var/log/neutron/dnsmasq.log"

RStack gravatar imageRStack ( 2014-07-19 08:43:49 -0500 )edit

ip netns exec qdhcp-corresponding-network-id ifconfig
ip netns exec qdhcp-corresponding-network-id ip a

dbaxps gravatar imagedbaxps ( 2014-07-19 10:02:00 -0500 )edit

@dbaxps

# ip netns exec qdhcp-network-id ip a
16: tap7139b265-41: <BROADCAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN 
    link/ether fa:16:3e:2e:18:35 brd ff:ff:ff:ff:ff:ff
    inet 10.0.0.3/24 brd 10.0.0.255 scope global tap7139b265-41
    inet6 fe80::f816:3eff:fe2e:1835/64 scope link 
       valid_lft forever preferred_lft forever
17: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue state UNKNOWN 
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
# ip netns exec qdhcp-network-id ifconfig
lo        Link encap:Local Loopback  
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:4 errors:0 dropped:0 overruns:0 frame:0
          TX ...
(more)
RStack gravatar imageRStack ( 2014-07-19 10:13:31 -0500 )edit

Temporary set dhcp_lease_time=120 in nova.conf and run
Restart nova services
Start VM on network
$ ip netns exec qdhcp-network-id tcpdump -ln -i tap7139b265-41 ( for 5-10 min)

dbaxps gravatar imagedbaxps ( 2014-07-19 10:25:30 -0500 )edit

1 answer

Sort by ยป oldest newest most voted
0

answered 2014-07-19 11:45:08 -0500

RStack gravatar image

I got the problem solved by enabling ipv6 through modprobe. It was disabled on my CentOS system.

edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

Stats

Asked: 2014-07-18 17:38:23 -0500

Seen: 415 times

Last updated: Jul 19 '14