Running instance unable to ping gateway

asked 2015-12-03 18:09:34 -0500

mgreville gravatar image

updated 2015-12-03 22:04:30 -0500

Hi folks,

I am running a Juno installation on Centos7 on 3 nodes. The compute node is physical and the controller and network nodes are KVM virtual machines. I have followed the OpenStack installation guide for Centos 7.

I am stuck at the point of my launched VM instance being unable to hit it's gateway on the demo-router.

@ # ping
100% packet loss

Everything else seems to be in order -

I can ping the external interface and I can ping the internal gateway when using an ip netns command as per:

@network ~]# ip netns exec qrouter-e77947ea-d03c-4b90-aebe-2d394faf10ff ping
PING ( 56(84) bytes of data.
64 bytes from icmp_seq=1 ttl=64 time=0.021 ms

The router interface is receiving arp requests

@network ~]# ip netns exec qrouter-e77947ea-d03c-4b90-aebe-2d394faf10ff tcpdump -i qr-71aad27a-68
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on qr-71aad27a-68, link-type EN10MB (Ethernet), capture size 65535 bytes
10:30:02.477929 ARP, Request who-has network tell, length 28
10:30:02.477937 ARP, Reply network is-at fa:16:3e:bc:45:20 (oui Unknown), length 28

and is successfully getting the MAC for the interface

 @network ~]# ip netns exec qrouter-e77947ea-d03c-4b90-aebe-2d394faf10ff arp
Address                  HWtype  HWaddress           Flags Mask            Iface              ether   fa:16:3e:37:fa:b9   C                     qr-71aad27a-68

The qrouter routing table looks correct.

@network ~]# ip netns exec qrouter-e77947ea-d03c-4b90-aebe-2d394faf10ff netstat -nr
Kernel IP routing table
Destination     Gateway         Genmask         Flags   MSS Window  irtt Iface         UG        0 0          0 qg-5a67ac82-1c   U         0 0          0 qg-5a67ac82-1c   U         0 0          0 qr-71aad27a-68

The router interface details are here.

@network ~]# ip netns exec qrouter-e77947ea-d03c-4b90-aebe-2d394faf10ff ifconfig qr-71aad27a-68
qr-71aad27a-68: flags=4419<UP,BROADCAST,RUNNING,PROMISC,MULTICAST>  mtu 1400
        inet  netmask  broadcast
        inet6 fe80::f816:3eff:febc:4520  prefixlen 64  scopeid 0x20<link>
        ether fa:16:3e:bc:45:20  txqueuelen 0  (Ethernet)
        RX packets 31966  bytes 1344198 (1.2 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 32005  bytes 1362126 (1.2 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

The RX and TX packet count on the router goes up every time an arp request/reply is received/sent while on the vm node only the TX packet count increments, the RX count stays the same.

So, the arp replies are never getting back to the host and I am unable to explain why.

My vm's are completely cut off from the external network but can communicate between themselves on the network.

Some details -

Security Group is ... (more)

edit retag flag offensive close merge delete


What does route -n says on instance CLI

Mohit gravatar imageMohit ( 2015-12-03 23:22:17 -0500 )edit

Hi Mohit, as there is no ARP there is no DCHP so I am configuring the instance IP and GW manually. The routing table looks

route -n         UG    0      0        0 eth0   U     0      0        0 eth0
mgreville gravatar imagemgreville ( 2015-12-04 00:08:49 -0500 )edit