Ask Your Question

RStack's profile - activity

2014-11-08 11:59:11 -0500 received badge  Famous Question (source)
2014-08-06 13:48:35 -0500 received badge  Famous Question (source)
2014-07-26 19:09:26 -0500 received badge  Enthusiast
2014-07-25 21:37:01 -0500 commented question VM Can't get DHCP IP

@vasanth-rajasekaran i have disabled IPtables with the same problem.

2014-07-25 10:23:05 -0500 received badge  Notable Question (source)
2014-07-25 00:00:21 -0500 received badge  Popular Question (source)
2014-07-24 18:27:45 -0500 commented question VM Can't get DHCP IP

@jproulx This is a realtime compute node log after restarting vm network service

http://paste.openstack.org/show/88039/

2014-07-24 18:17:08 -0500 commented question VM Can't get DHCP IP

@jproulx I restarted qpidd several times with no luck. What's the log file path please should i review ?

2014-07-24 16:18:56 -0500 asked a question VM Can't get DHCP IP

I'm running OpenStack RDO with the following setup.

  • 1x Controller Node ( Neutron - Nova - glance - Horizon - Keystone - GRE + FlatDHCPManager)
  • 10x Compute Nodes ( Nova Compute - KVM )
  • OS : CentOS 6 - 64bit

Suddenly all vm's on the compute nodes can't get new IP address from the controller node. It was working properly hours ago without any modifications from me. I tried to restart neutron-dhcp-agent - qpidd and dnsmasq with no luck.

This log from the controller node - many errors

http://paste.openstack.org/show/88016/

And this from the compute node

http://paste.openstack.org/show/88017/

Realtime compute node log after restarting vm network service

http://paste.openstack.org/show/88039/

Installed packages on Controller Node : rpm -qa | grep -i opensta

openstack-selinux-0.1.3-2.el6ost.noarch
openstack-puppet-modules-2013.2-9.1.el6.noarch
openstack-ceilometer-api-2013.2.3-2.el6.noarch
openstack-packstack-2013.2.1-0.36.dev1013.el6.noarch
openstack-nova-scheduler-2013.2.3-1.el6.noarch
openstack-ceilometer-common-2013.2.3-2.el6.noarch
python-django-openstack-auth-1.1.2-1.el6.noarch
openstack-ceilometer-central-2013.2.3-2.el6.noarch
openstack-ceilometer-collector-2013.2.3-2.el6.noarch
openstack-neutron-openvswitch-2013.2.3-9.el6.noarch
openstack-nova-common-2013.2.3-1.el6.noarch
openstack-packstack-puppet-2013.2.1-0.36.dev1013.el6.noarch
openstack-glance-2013.2.3-2.el6.noarch
openstack-nova-conductor-2013.2.3-1.el6.noarch
openstack-nova-novncproxy-2013.2.3-1.el6.noarch
openstack-nova-cert-2013.2.3-1.el6.noarch
openstack-keystone-2013.2.3-3.el6.noarch
openstack-neutron-2013.2.3-9.el6.noarch
openstack-ceilometer-alarm-2013.2.3-2.el6.noarch
openstack-dashboard-2013.2.3-1.el6.noarch
openstack-nova-api-2013.2.3-1.el6.noarch
openstack-nova-console-2013.2.3-1.el6.noarch
openstack-utils-2013.2-2.el6.noarch

On Controller Node

 >> ps aux | grep -i dhcp
nobody   12639  0.0  0.0  12884   864 ?        S    Jul19   0:00 dnsmasq --no-hosts --no-resolv --strict-order --bind-interfaces --interface=tap7139b265-41 --except-interface=lo --pid-file=/var/lib/neutron/dhcp/c19ca2ea-8278-4069-bfea-dadd92961cac/pid --dhcp-hostsfile=/var/lib/neutron/dhcp/c19ca2ea-8278-4069-bfea-dadd92961cac/host --dhcp-optsfile=/var/lib/neutron/dhcp/c19ca2ea-8278-4069-bfea-dadd92961cac/opts --leasefile-ro --dhcp-range=tag0,10.0.0.0,static,86400s --dhcp-lease-max=256 --conf-file= --domain=openstacklocal
neutron  24884  0.0  0.1 273748 32140 ?        S    Jul24   0:00 /usr/bin/python /usr/bin/neutron-dhcp-agent --log-file /var/log/neutron/dhcp-agent.log --config-file /usr/share/neutron/neutron-dist.conf --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/dhcp_agent.ini

>> ip netns
qrouter-id
qdhcp-id

>> ip netns exec qdhcp-network-id ip a
16: tap7139b265-41: <BROADCAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN 
    link/ether fa:16:3e:2e:18:35 brd ff:ff:ff:ff:ff:ff
    inet 10.0.0.3/24 brd 10.0.0.255 scope global tap7139b265-41
    inet6 fe80::f816:3eff:fe2e:1835/64 scope link 
       valid_lft forever preferred_lft forever
17: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue state UNKNOWN 
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
>> ip netns exec qdhcp-network-id ifconfig
lo        Link encap:Local Loopback  
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:4 errors:0 dropped:0 overruns:0 frame:0
          TX packets:4 errors:0 dropped ...
(more)
2014-07-20 08:59:30 -0500 received badge  Notable Question (source)
2014-07-19 11:45:08 -0500 answered a question DHCP and Instances Addressing stopped working

I got the problem solved by enabling ipv6 through modprobe. It was disabled on my CentOS system.

2014-07-19 10:50:58 -0500 commented question DHCP and Instances Addressing stopped working

@dbaxps I executed "service network restart" on my CentOS VM and monitored /var/log/neutron/openvswitch-agent.log on the compute node

http://paste.openstack.org/show/87211/

tcpdump on controller node

http://paste.openstack.org/show/87212/

May be the problem related to ipv6 dhcpv6 or ip6tables ?

2014-07-19 10:33:03 -0500 commented question DHCP and Instances Addressing stopped working

@dbaxps should i change this directive inside controller server or nova compute ? From my controller and compute nodes

# grep dhcp_lease nova.conf
#dhcp_lease_time=120
2014-07-19 10:13:31 -0500 commented question DHCP and Instances Addressing stopped working

@dbaxps

# ip netns exec qdhcp-network-id ip a
16: tap7139b265-41: <BROADCAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN 
    link/ether fa:16:3e:2e:18:35 brd ff:ff:ff:ff:ff:ff
    inet 10.0.0.3/24 brd 10.0.0.255 scope global tap7139b265-41
    inet6 fe80::f816:3eff:fe2e:1835/64 scope link 
       valid_lft forever preferred_lft forever
17: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue state UNKNOWN 
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
# ip netns exec qdhcp-network-id ifconfig
lo        Link encap:Local Loopback  
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:4 errors:0 dropped:0 overruns:0 frame:0
          TX ...
(more)
2014-07-19 08:43:49 -0500 commented question DHCP and Instances Addressing stopped working

@dbaxps nobody 12639 1 0 04:10 ? 00:00:00 dnsmasq --no-hosts --no-resolv --strict-order --bind-interfaces --interface=tap7139b265-41 --except-interface=lo --pid-file=/var/lib/neutron/dhcp/c19ca2ea-8278-4069-bfea-dadd92961cac/pid --dhcp-hostsfile=/var/lib/neutron/dhcp/c19ca2ea-8278-4069-bfea-dadd92961cac/host --dhcp-optsfile=/var/lib/neutron/dhcp/c19ca2ea-8278-4069-bfea-dadd92961cac/opts --leasefile-ro --dhcp-range=tag0,10.0.0.0,static,86400s --dhcp-lease-max=256 --conf-file= --domain=openstacklocal

This file not found on the controller node "/var/log/neutron/dnsmasq.log"

2014-07-19 08:31:59 -0500 received badge  Popular Question (source)
2014-07-18 18:48:47 -0500 received badge  Editor (source)
2014-07-18 17:38:23 -0500 asked a question DHCP and Instances Addressing stopped working

Hi,

I'm running openStack with the following Setup

  • 1x Controller Node has ( Glance, Neutron, Horizon, MySQl, Nova ) and the network model is GRE "CONFIG_NOVA_NETWORK_MANAGER=nova.network.manager.FlatDHCPManager"
  • 1x Compute Node ( nova-compute )

OS : CentOS 6 - 64bit + KVM

The setup was completely stable until today, Suddenly all new vm's can't get new IP from the neutron server and i have old vm's currently running if one of them is restarted it will not get the local IP Address. So i think there may be a problem withing dhcp or any other stuff.

From Controller Node

~ cat /var/log/neutron/dhcp-agent.log

2014-07-19 01:18:30.322 11403 INFO neutron.openstack.common.service [-] Caught SIGTERM, exiting
2014-07-19 01:18:30.867 30198 INFO neutron.common.config [-] Logging enabled!
2014-07-19 01:18:30.868 30198 ERROR neutron.common.legacy [-] Skipping unknown group key: firewall_driver
2014-07-19 01:18:30.882 30198 INFO neutron.agent.linux.dhcp [-] dnsmasq version: 2.48
2014-07-19 01:18:30.998 30198 INFO neutron.agent.dhcp_agent [-] DHCP agent started
2014-07-19 01:18:31.027 30198 INFO neutron.agent.dhcp_agent [-] Synchronizing state

From my Compute Node

tail -n 100 /var/log/neutron/openvswitch-agent.log

http://paste.openstack.org/show/87197/

Installed Packages and Versions.

~ rpm -qa | grep -i openstack - On control Node
openstack-selinux-0.1.3-2.el6ost.noarch
openstack-puppet-modules-2013.2-9.1.el6.noarch
openstack-ceilometer-api-2013.2.3-2.el6.noarch
openstack-packstack-2013.2.1-0.36.dev1013.el6.noarch
openstack-nova-scheduler-2013.2.3-1.el6.noarch
openstack-ceilometer-common-2013.2.3-2.el6.noarch
python-django-openstack-auth-1.1.2-1.el6.noarch
openstack-ceilometer-central-2013.2.3-2.el6.noarch
openstack-ceilometer-collector-2013.2.3-2.el6.noarch
openstack-neutron-openvswitch-2013.2.3-9.el6.noarch
openstack-nova-common-2013.2.3-1.el6.noarch
openstack-packstack-puppet-2013.2.1-0.36.dev1013.el6.noarch
openstack-glance-2013.2.3-2.el6.noarch
openstack-nova-conductor-2013.2.3-1.el6.noarch
openstack-nova-novncproxy-2013.2.3-1.el6.noarch
openstack-nova-cert-2013.2.3-1.el6.noarch
openstack-keystone-2013.2.3-3.el6.noarch
openstack-neutron-2013.2.3-9.el6.noarch
openstack-ceilometer-alarm-2013.2.3-2.el6.noarch
openstack-dashboard-2013.2.3-1.el6.noarch
openstack-nova-api-2013.2.3-1.el6.noarch
openstack-nova-console-2013.2.3-1.el6.noarch
openstack-utils-2013.2-2.el6.noarch

~ rpm -qa | grep -i openstack - On Compute Node
openstack-ceilometer-common-2013.2.3-2.el6.noarch
openstack-neutron-openvswitch-2013.2.3-9.el6.noarch
openstack-utils-2013.2-2.el6.noarch
openstack-ceilometer-compute-2013.2.3-2.el6.noarch
openstack-nova-compute-2013.2.3-1.el6.noarch
openstack-selinux-0.1.3-2.el6ost.noarch
openstack-nova-common-2013.2.3-1.el6.noarch
openstack-neutron-2013.2.3-9.el6.noarch

dhcp-agent is running on the controller node.

neutron  30198  0.4  0.1 275060 33732 ?        S    01:18   0:03 /usr/bin/python /usr/bin/neutron-dhcp-agent --log-file /var/log/neutron/dhcp-agent.log --config-file /usr/share/neutron/neutron-dist.conf --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/dhcp_agent.ini

Help please.