Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

Router interface on provider network replies to ARP requests but nothing else

Hi,

I'm trying to learn OpenStack by following the OpenStack Installation Tutorial for Ubuntu, which describes the Newton release. I've chosen to use network option 2 in that tutorial, which results in a provider network and a self-service network. Everything looked OK, up until the point where the tutorial asks to ping the IP address of the gateway IP address on the provider network: no matter where I ping from, replies never come.

I noticed that ARP resolution for the gateway IP address did work: when pinging from my desktop machine (which is in the provider network), its ARP table contained the same MAC-address that is shown in the output of neutron router-port-list.

Also, when starting an instance it doesn't seem to receive an IP address via DHCP: if I interpret the log correctly, the instance doesn't seem to receive any replies to the DHCPDISCOVERs it sends.

My guess is that once I solved the ping problem, the DHCP problem will also be solved.

I double checked whether I followed the tutorial correctly, but I wasn't able to find what I did wrong. I would be grateful if somebody could point me in the right direction.


My setup:

I've created a controller node and one compute node. These are Ubuntu 16.04 LTS virtual machines on an ESXi 6.5 host. The ESXi host has just one physical network port. Each VM has two virtual network interfaces: one connected to the default (untagged) VLAN, another connected to a tagged VLAN3. The vSwitch is configured to allow forged transmits and MAC changes, but is not configured for promiscuous mode. This configuration seems to work correctly: when I configure a static address on the virtual interfaces connected to the provider network (the untagged VLAN), I can ping these from my desktop just fine.

Network:
10.0.0.0/24: VLAN3, gateway 10.0.0.253, routed/NATted to the internet
192.168.178.0/24: default VLAN, gateway 192.168.178.253. routed/NATted to the internet

Controller node:
ens160: 10.0.0.100
ens192: unnumbered

Compute node:
ens160: 10.0.0.120
ens192: unnumbered

Pinging from the gateway to 192.168.178.155 results in no ping replies, and this tcpdump fragment and ARP cache contents:

09:27:24.728856 arp who-has 192.168.178.155 tell 192.168.178.253
09:27:24.729116 arp reply 192.168.178.155 is-at fa:16:3e:55:6a:e5

192.168.178.155                      fa:16:3e:55:6a:e5    re0 11m31s

...which is the MAC address of the gateway as shown in the output of neutron router-port-list as shown below. Pinging from my Windows desktop (which is also in the untagged VLAN and the 192.168.178/24 subnet) results in the same: an ARP cache entry but no replies to the ping:

192.168.178.155       fa-16-3e-55-6a-e5     dynamic

The OpenStack network configuration is as follows:

joskam@controller:~$ openstack service list
+----------------------------------+----------+----------+
| ID                               | Name     | Type     |
+----------------------------------+----------+----------+
| 5b8761e7b63e49428254dd21ad546b93 | nova     | compute  |
| 5cfa793823894a6dbb8cb1d3e54be9c0 | keystone | identity |
| f28452bab922497296b48d1728dcdb34 | neutron  | network  |
| f79b69466b9c47d8ba9e2430d524df63 | glance   | image    |
+----------------------------------+----------+----------+
joskam@controller:~$ nova service-list
+----+------------------+------------+----------+---------+-------+----------------------------+-----------------+
| Id | Binary           | Host       | Zone     | Status  | State | Updated_at                 | Disabled Reason |
+----+------------------+------------+----------+---------+-------+----------------------------+-----------------+
| 4  | nova-consoleauth | controller | internal | enabled | up    | 2016-12-02T09:37:51.000000 | -               |
| 5  | nova-scheduler   | controller | internal | enabled | up    | 2016-12-02T09:37:48.000000 | -               |
| 6  | nova-conductor   | controller | internal | enabled | up    | 2016-12-02T09:37:50.000000 | -               |
| 8  | nova-compute     | compute0   | nova     | enabled | up    | 2016-12-02T09:37:50.000000 | -               |
+----+------------------+------------+----------+---------+-------+----------------------------+-----------------+

joskam@controller:~$ neutron agent-list
+----------------------------+--------------------+------------+-------------------+-------+----------------+---------------------------+
| id                         | agent_type         | host       | availability_zone | alive | admin_state_up | binary                    |
+----------------------------+--------------------+------------+-------------------+-------+----------------+---------------------------+
| 03a8fcb8-f58d-             | Linux bridge agent | controller |                   | :-)   | True           | neutron-linuxbridge-agent |
| 4e67-bf67-bec87c910a0f     |                    |            |                   |       |                |                           |
| 082f6fe5-09c8-4a1e-        | Metadata agent     | controller |                   | :-)   | True           | neutron-metadata-agent    |
| a7f9-af34e5cbe532          |                    |            |                   |       |                |                           |
| 311915d9-9578-4c3d-8c2a-   | DHCP agent         | controller | nova              | :-)   | True           | neutron-dhcp-agent        |
| 6307ebc0a485               |                    |            |                   |       |                |                           |
| 9c057d3c-c3c8-451d-998e-   | L3 agent           | controller | nova              | :-)   | True           | neutron-l3-agent          |
| e7f7f66ba140               |                    |            |                   |       |                |                           |
| dac24b66-a4bf-             | Linux bridge agent | compute0   |                   | :-)   | True           | neutron-linuxbridge-agent |
| 4f15-8116-e6aba7fbee0e     |                    |            |                   |       |                |                           |
+----------------------------+--------------------+------------+-------------------+-------+----------------+---------------------------+

joskam@controller:~$ neutron router-list
+--------------------------------------+--------+--------------------------------------------------------+-------------+-------+
| id                                   | name   | external_gateway_info                                  | distributed | ha    |
+--------------------------------------+--------+--------------------------------------------------------+-------------+-------+
| 30c10e23-5d2f-4c71-a305-ad54ce8d92e6 | router | {"network_id": "c6aed8bb-4514-4d37-8be6-546b1fbc7cff", | False       | False |
|                                      |        | "enable_snat": true, "external_fixed_ips":             |             |       |
|                                      |        | [{"subnet_id": "7369bfbd-70de-4bc9-be50-d2af6c223bbb", |             |       |
|                                      |        | "ip_address": "192.168.178.155"}]}                     |             |       |
+--------------------------------------+--------+--------------------------------------------------------+-------------+-------+
joskam@controller:~$ neutron net-list
+--------------------------------------+-------------+-------------------------------------------------------+
| id                                   | name        | subnets                                               |
+--------------------------------------+-------------+-------------------------------------------------------+
| c6aed8bb-4514-4d37-8be6-546b1fbc7cff | provider    | 7369bfbd-70de-4bc9-be50-d2af6c223bbb 192.168.178.0/24 |
| cd856420-1973-4419-9a47-4672976993a4 | selfservice | 0a2ce47e-c44d-413a-892b-8838c567144d 172.16.0.0/24    |
+--------------------------------------+-------------+-------------------------------------------------------+
joskam@controller:~$ neutron router-port-list router
+--------------------------------------+------+-------------------+----------------------------------------------------------+
| id                                   | name | mac_address       | fixed_ips                                                |
+--------------------------------------+------+-------------------+----------------------------------------------------------+
| a0ab8a77-7896-4da7-8b4f-f08526aed573 |      | fa:16:3e:1c:38:04 | {"subnet_id": "0a2ce47e-c44d-413a-892b-8838c567144d",    |
|                                      |      |                   | "ip_address": "172.16.0.1"}                              |
| a87f89c9-f908-4e01-a78e-39f872389753 |      | fa:16:3e:55:6a:e5 | {"subnet_id": "7369bfbd-70de-4bc9-be50-d2af6c223bbb",    |
|                                      |      |                   | "ip_address": "192.168.178.155"}                         |
+--------------------------------------+------+-------------------+----------------------------------------------------------+