Openstack seems to not map internal IPs to local network properly [closed]

asked 2013-10-14 13:46:08 -0600

filpano gravatar image

updated 2013-10-14 17:36:47 -0600

Hello everyone,

I have a very confusing issue which I can't seem to resolve.

I followed a guide by Loic Dachary on installing Openstack Folsom on Wheezy, and deployed it on two hosts: a cluster node, and my workstation.

On these two hosts I'm running a benchmarking application that communicated from one host to the other in the following fashion:

image description

The following are the routing tables for the node host, the workstation, and the internal VMs:

image description

(Note: the entry was for an additional network interface. It ended up being unneeded and is not up on any of the VMs. Hence, it has no impact since nothing is being routed to destination 10.0.1.x)

Now, my issue is the following:

The benchmarking application starts an RMI call from one of the VMs on the workstation, (say to one of the VMs on the node (say,

It is my understanding that the following should occur:

  1. The VM sees desination 172.23.x.x network route and goes through the default route (the workstation compute host)

  2. The nova network service sees that is mapped to some IP (say, on the local network. So it changes the source IP to that.

  3. The workstation host sees destination 172.23.x.x and routes through to

  4. Nova network sees the IP and since the mapping say, -> exists, it changes destination to

  5. VM on node with internal IP gets the the request from workstation VM. (@

This works fine. The actual request gets sent. However, there is something wrong with the reply.

Here's the log of my application run just after the request is sent:

RemoteException was: java.rmi.ServerException: RemoteException occurred in server thread; nested exception is:
->      java.rmi.ConnectIOException: Exception creating connection to:; nested exception is:
-> No route to host

So it must be the case that the node VM replied with it's source being In other words, the nova network service never changed the source IP of the node VM to its routable 172.23.x.x address!

How is this possible? Both VM's can ping themselves (node->workstation, workstation->node), and I don't see anything wrong with the routing tables.

The only odd factor I can see is the following traceroute information:

Workstation VM -> Node

root@client-01:~# traceroute
traceroute to (, 30 hops max, 60 byte packets
 1 (  0.406 ms  0.399 ms  0.390 ms
 2 (  0.381 ms  0.378 ms  0.422 ...
edit retag flag offensive reopen merge delete

Closed for the following reason question is not relevant or outdated by rbowen
close date 2016-06-21 14:16:12.183357


The version of OpenStack that this is opened against has been declared EOL as per Please open a new issue if you are still seeing this problem with a more recent, supported version of OpenStack. Thanks.

rbowen gravatar imagerbowen ( 2016-06-21 14:16:06 -0600 )edit