Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

Getting binding_failed on router to VLAN provider Network (Open Vswitch)

I am trying to set up a cluster of Openstack systems and started with a single node, on that node that is working I used a flat provider network to keep it simple but I need to set up a vlan provider network.

On the second node that I created for testing like the first as a all-in-one system I first got the OpenVswitch working to support the VLANS on the host computer before even trying to get OpenStack working and have done so. I then created a new Region (wanting to keep my first running stack up for now) and got to the point of creating the first router between an internal network (on the admin project for now) and the provider network (called home-net) I create the router but get. the following on the gateway port.

[pwd@pwd-stack-1 ~(keystone_admin)]$ openstack port show 39ec7053-2d56-4ff6-9ea4-87bc3b1ab170
+-----------------------+---------------------------------------------------------------------------+
| Field                 | Value                                                                     |
+-----------------------+---------------------------------------------------------------------------+
| admin_state_up        | UP                                                                        |
| allowed_address_pairs |                                                                           |
| binding_host_id       | pwd-stack-1.frame.biz                                                     |
| binding_profile       |                                                                           |
| binding_vif_details   |                                                                           |
| binding_vif_type      | binding_failed                                                            |
| binding_vnic_type     | normal                                                                    |
| created_at            | 2017-06-29T12:53:53Z                                                      |
| description           |                                                                           |
| device_id             | 356abdd1-8bbb-4de1-99b8-df9e8d3759a4                                      |
| device_owner          | network:router_gateway                                                    |
| dns_assignment        | None                                                                      |
| dns_name              | None                                                                      |
| extra_dhcp_opts       |                                                                           |
| fixed_ips             | ip_address='10.72.10.2', subnet_id='3aa89106-e623-46b4-8aed-054628035bdd' |
| id                    | 39ec7053-2d56-4ff6-9ea4-87bc3b1ab170                                      |
| ip_address            | None                                                                      |
| mac_address           | fa:16:3e:d4:81:8a                                                         |
| name                  |                                                                           |
| network_id            | 1d935e53-41bd-49cc-be4b-2eb23fe2d738                                      |
| option_name           | None                                                                      |
| option_value          | None                                                                      |
| port_security_enabled | False                                                                     |
| project_id            |                                                                           |
| qos_policy_id         | None                                                                      |
| revision_number       | 4                                                                         |
| security_groups       |                                                                           |
| status                | DOWN                                                                      |
| subnet_id             | None                                                                      |
| updated_at            | 2017-06-29T12:53:56Z                                                      |
+-----------------------+---------------------------------------------------------------------------+

my openvswitch bridge is called br-ovs0 and (clearing comments and blank lines from the config files) I show:

[pwd@pwd-stack-1 ~(keystone_admin)]$ sudo grep -v '#' /etc/neutron/plugin.ini | grep -v -e '^[[:space:]]*$'
[DEFAULT]
[ml2]
type_drivers = vxlan,flat,vlan,gre
tenant_network_types = vxlan
mechanism_drivers =openvswitch
path_mtu = 0
[ml2_type_flat]
flat_networks = *
[ml2_type_geneve]
[ml2_type_gre]
tunnel_id_ranges =
[ml2_type_vlan]
network_vlan_ranges = br-ovs0
[ml2_type_vxlan]
vni_ranges =300:600
vxlan_group = 224.0.0.1
[securitygroup]
firewall_driver = neutron.agent.linux.iptables_firewall.OVSHybridIptablesFirewallDriver
enable_security_group = True

[pwd@pwd-stack-1 ~(keystone_admin)]$ sudo grep -v '#' /etc/neutron/neutron.conf | grep -v -e '^[[:space:]]*$'
[DEFAULT]
bind_host=0.0.0.0
auth_strategy=keystone
core_plugin=neutron.plugins.ml2.plugin.Ml2Plugin
service_plugins=router,metering
allow_overlapping_ips=True
notify_nova_on_port_status_changes=True
notify_nova_on_port_data_changes=True
api_workers=24
rpc_workers=24
router_scheduler_driver=neutron.scheduler.l3_agent_scheduler.ChanceScheduler
l3_ha=False
max_l3_agents_per_router=3
debug=False
log_dir=/var/log/neutron
transport_url=rabbit://guest:guest@10.73.1.111:5672/
rpc_backend=rabbit
control_exchange=neutron
[agent]
root_helper=sudo neutron-rootwrap /etc/neutron/rootwrap.conf
[cors]
[cors.subdomain]
[database]
connection=mysql+pymysql://neutron:042fbc2e9ed94b66@10.73.1.111/neutron
[keystone_authtoken]
auth_uri=http://10.73.1.111:5000/v3
auth_type=password
auth_url=http://10.73.1.111:35357
username=neutron
password=XXXXXXXXXXXXXXXXXXXX
user_domain_name=Default
project_name=services
project_domain_name=Default
[matchmaker_redis]
[nova]
region_name=AtlPwd1
auth_url=http://10.73.1.111:35357
auth_type=password
password=XXXXXXXXXXXXXXXXXXXX
project_domain_id=default
project_domain_name=Default
project_name=services
tenant_name=services
user_domain_id=default
user_domain_name=Default
username=nova
[oslo_concurrency]
lock_path=$state_path/lock
[oslo_messaging_amqp]
[oslo_messaging_kafka]
[oslo_messaging_notifications]
[oslo_messaging_rabbit]
rabbit_use_ssl=False
[oslo_messaging_zmq]
[oslo_middleware]
[oslo_policy]
policy_file=/etc/neutron/policy.json
[qos]
[quotas]
[ssl]
[service_providers]

[pwd@pwd-stack-1 ~(keystone_admin)]$ openstack router list
+--------------------------------------+-----------+--------+-------+-------------+-------+----------------------------------+
| ID                                   | Name      | Status | State | Distributed | HA    | Project                          |
+--------------------------------------+-----------+--------+-------+-------------+-------+----------------------------------+
| 356abdd1-8bbb-4de1-99b8-df9e8d3759a4 | home-test | ACTIVE | UP    | False       | False | f82c693f83934651bfcb40ae2453b77b |
+--------------------------------------+-----------+--------+-------+-------------+-------+----------------------------------+
[pwd@pwd-stack-1 ~(keystone_admin)]$ openstack router show home-test
+-------------------------+-----------------------------------------------------------------------------------------------------------+
| Field                   | Value                                                                                                     |
+-------------------------+-----------------------------------------------------------------------------------------------------------+
| admin_state_up          | UP                                                                                                        |
| availability_zone_hints |                                                                                                           |
| availability_zones      | nova                                                                                                      |
| created_at              | 2017-06-29T12:53:02Z                                                                                      |
| description             |                                                                                                           |
| distributed             | False                                                                                                     |
| external_gateway_info   | {"network_id": "1d935e53-41bd-49cc-be4b-2eb23fe2d738", "enable_snat": true, "external_fixed_ips":         |
|                         | [{"subnet_id": "3aa89106-e623-46b4-8aed-054628035bdd", "ip_address": "10.72.10.2"}]}                      |
| flavor_id               | None                                                                                                      |
| ha                      | False                                                                                                     |
| id                      | 356abdd1-8bbb-4de1-99b8-df9e8d3759a4                                                                      |
| name                    | home-test                                                                                                 |
| project_id              | f82c693f83934651bfcb40ae2453b77b                                                                          |
| revision_number         | 12                                                                                                        |
| routes                  |                                                                                                           |
| status                  | ACTIVE                                                                                                    |
| updated_at              | 2017-06-29T12:53:54Z                                                                                      |
+-------------------------+-----------------------------------------------------------------------------------------------------------+
[pwd@pwd-stack-1 ~(keystone_admin)]$ openstack port list
+--------------------------------------+------+-------------------+------------------------------------------------+--------+
| ID                                   | Name | MAC Address       | Fixed IP Addresses                             | Status |
+--------------------------------------+------+-------------------+------------------------------------------------+--------+
| 1c51b7c9-df3b-473f-9992-7f1503806d76 |      | fa:16:3e:b9:bf:e4 | ip_address='10.72.10.1',                       | N/A    |
|                                      |      |                   | subnet_id='3aa89106-e623-46b4-8aed-            |        |
|                                      |      |                   | 054628035bdd'                                  |        |
| 224113cb-635f-4e21-85ee-434056abab8a |      | fa:16:3e:00:ec:db | ip_address='172.20.20.2',                      | ACTIVE |
|                                      |      |                   | subnet_id='1f11a2a0-567a-4023-841c-            |        |
|                                      |      |                   | d08d176fe88f'                                  |        |
| 2ca96612-2795-4d8b-9da7-b06cefe8385d |      | fa:16:3e:9a:96:f1 | ip_address='10.72.10.10',                      | N/A    |
|                                      |      |                   | subnet_id='3aa89106-e623-46b4-8aed-            |        |
|                                      |      |                   | 054628035bdd'                                  |        |
| 38cc37a9-29c4-4b5b-a7e6-e770b2f8a6f7 |      | fa:16:3e:6d:6c:7a | ip_address='172.20.20.5',                      | ACTIVE |
|                                      |      |                   | subnet_id='1f11a2a0-567a-4023-841c-            |        |
|                                      |      |                   | d08d176fe88f'                                  |        |
| 39ec7053-2d56-4ff6-9ea4-87bc3b1ab170 |      | fa:16:3e:d4:81:8a | ip_address='10.72.10.2',                       | DOWN   |
|                                      |      |                   | subnet_id='3aa89106-e623-46b4-8aed-            |        |
|                                      |      |                   | 054628035bdd'                                  |        |
| fceae14a-8156-41ac-af99-98c6d25c59c9 |      | fa:16:3e:9f:3e:22 | ip_address='172.20.20.3',                      | ACTIVE |
|                                      |      |                   | subnet_id='1f11a2a0-567a-4023-841c-            |        |
|                                      |      |                   | d08d176fe88f'                                  |        |
+--------------------------------------+------+-------------------+------------------------------------------------+--------+

Getting binding_failed on router to VLAN provider Network (Open Vswitch)

I am trying to set up a cluster of Openstack systems and started with a single node, on that node that is working I used a flat provider network to keep it simple but I need to set up a vlan provider network.

On the second node that I created for testing like the first as a all-in-one system I first got the OpenVswitch working to support the VLANS on the host computer before even trying to get OpenStack working and have done so. I then created a new Region (wanting to keep my first running stack up for now) and got to the point of creating the first router between an internal network (on the admin project for now) and the provider network (called home-net) I create the router but get. the following on the gateway port.

[pwd@pwd-stack-1 ~(keystone_admin)]$ openstack port show 39ec7053-2d56-4ff6-9ea4-87bc3b1ab170
+-----------------------+---------------------------------------------------------------------------+
| Field                 | Value                                                                     |
+-----------------------+---------------------------------------------------------------------------+
| admin_state_up        | UP                                                                        |
| allowed_address_pairs |                                                                           |
| binding_host_id       | pwd-stack-1.frame.biz                                                     |
| binding_profile       |                                                                           |
| binding_vif_details   |                                                                           |
| binding_vif_type      | binding_failed                                                            |
| binding_vnic_type     | normal                                                                    |
| created_at            | 2017-06-29T12:53:53Z                                                      |
| description           |                                                                           |
| device_id             | 356abdd1-8bbb-4de1-99b8-df9e8d3759a4                                      |
| device_owner          | network:router_gateway                                                    |
| dns_assignment        | None                                                                      |
| dns_name              | None                                                                      |
| extra_dhcp_opts       |                                                                           |
| fixed_ips             | ip_address='10.72.10.2', subnet_id='3aa89106-e623-46b4-8aed-054628035bdd' |
| id                    | 39ec7053-2d56-4ff6-9ea4-87bc3b1ab170                                      |
| ip_address            | None                                                                      |
| mac_address           | fa:16:3e:d4:81:8a                                                         |
| name                  |                                                                           |
| network_id            | 1d935e53-41bd-49cc-be4b-2eb23fe2d738                                      |
| option_name           | None                                                                      |
| option_value          | None                                                                      |
| port_security_enabled | False                                                                     |
| project_id            |                                                                           |
| qos_policy_id         | None                                                                      |
| revision_number       | 4                                                                         |
| security_groups       |                                                                           |
| status                | DOWN                                                                      |
| subnet_id             | None                                                                      |
| updated_at            | 2017-06-29T12:53:56Z                                                      |
+-----------------------+---------------------------------------------------------------------------+

my openvswitch bridge is called br-ovs0 and (clearing comments and blank lines from the config files) I show:

[pwd@pwd-stack-1 ~(keystone_admin)]$ sudo grep -v '#' /etc/neutron/plugin.ini | grep -v -e '^[[:space:]]*$'
[DEFAULT]
[ml2]
type_drivers = vxlan,flat,vlan,gre
tenant_network_types = vxlan
mechanism_drivers =openvswitch
path_mtu = 0
[ml2_type_flat]
flat_networks = *
[ml2_type_geneve]
[ml2_type_gre]
tunnel_id_ranges =
[ml2_type_vlan]
network_vlan_ranges = br-ovs0
[ml2_type_vxlan]
vni_ranges =300:600
vxlan_group = 224.0.0.1
[securitygroup]
firewall_driver = neutron.agent.linux.iptables_firewall.OVSHybridIptablesFirewallDriver
enable_security_group = True

[pwd@pwd-stack-1 ~(keystone_admin)]$ sudo grep -v '#' /etc/neutron/neutron.conf | grep -v -e '^[[:space:]]*$'
[DEFAULT]
bind_host=0.0.0.0
auth_strategy=keystone
core_plugin=neutron.plugins.ml2.plugin.Ml2Plugin
service_plugins=router,metering
allow_overlapping_ips=True
notify_nova_on_port_status_changes=True
notify_nova_on_port_data_changes=True
api_workers=24
rpc_workers=24
router_scheduler_driver=neutron.scheduler.l3_agent_scheduler.ChanceScheduler
l3_ha=False
max_l3_agents_per_router=3
debug=False
log_dir=/var/log/neutron
transport_url=rabbit://guest:guest@10.73.1.111:5672/
rpc_backend=rabbit
control_exchange=neutron
[agent]
root_helper=sudo neutron-rootwrap /etc/neutron/rootwrap.conf
[cors]
[cors.subdomain]
[database]
connection=mysql+pymysql://neutron:042fbc2e9ed94b66@10.73.1.111/neutron
[keystone_authtoken]
auth_uri=http://10.73.1.111:5000/v3
auth_type=password
auth_url=http://10.73.1.111:35357
username=neutron
password=XXXXXXXXXXXXXXXXXXXX
user_domain_name=Default
project_name=services
project_domain_name=Default
[matchmaker_redis]
[nova]
region_name=AtlPwd1
auth_url=http://10.73.1.111:35357
auth_type=password
password=XXXXXXXXXXXXXXXXXXXX
project_domain_id=default
project_domain_name=Default
project_name=services
tenant_name=services
user_domain_id=default
user_domain_name=Default
username=nova
[oslo_concurrency]
lock_path=$state_path/lock
[oslo_messaging_amqp]
[oslo_messaging_kafka]
[oslo_messaging_notifications]
[oslo_messaging_rabbit]
rabbit_use_ssl=False
[oslo_messaging_zmq]
[oslo_middleware]
[oslo_policy]
policy_file=/etc/neutron/policy.json
[qos]
[quotas]
[ssl]
[service_providers]

[pwd@pwd-stack-1 ~(keystone_admin)]$ openstack router list
+--------------------------------------+-----------+--------+-------+-------------+-------+----------------------------------+
| ID                                   | Name      | Status | State | Distributed | HA    | Project                          |
+--------------------------------------+-----------+--------+-------+-------------+-------+----------------------------------+
| 356abdd1-8bbb-4de1-99b8-df9e8d3759a4 | home-test | ACTIVE | UP    | False       | False | f82c693f83934651bfcb40ae2453b77b |
+--------------------------------------+-----------+--------+-------+-------------+-------+----------------------------------+
[pwd@pwd-stack-1 ~(keystone_admin)]$ openstack router show home-test
+-------------------------+-----------------------------------------------------------------------------------------------------------+
| Field                   | Value                                                                                                     |
+-------------------------+-----------------------------------------------------------------------------------------------------------+
| admin_state_up          | UP                                                                                                        |
| availability_zone_hints |                                                                                                           |
| availability_zones      | nova                                                                                                      |
| created_at              | 2017-06-29T12:53:02Z                                                                                      |
| description             |                                                                                                           |
| distributed             | False                                                                                                     |
| external_gateway_info   | {"network_id": "1d935e53-41bd-49cc-be4b-2eb23fe2d738", "enable_snat": true, "external_fixed_ips":         |
|                         | [{"subnet_id": "3aa89106-e623-46b4-8aed-054628035bdd", "ip_address": "10.72.10.2"}]}                      |
| flavor_id               | None                                                                                                      |
| ha                      | False                                                                                                     |
| id                      | 356abdd1-8bbb-4de1-99b8-df9e8d3759a4                                                                      |
| name                    | home-test                                                                                                 |
| project_id              | f82c693f83934651bfcb40ae2453b77b                                                                          |
| revision_number         | 12                                                                                                        |
| routes                  |                                                                                                           |
| status                  | ACTIVE                                                                                                    |
| updated_at              | 2017-06-29T12:53:54Z                                                                                      |
+-------------------------+-----------------------------------------------------------------------------------------------------------+
[pwd@pwd-stack-1 ~(keystone_admin)]$ openstack port list
+--------------------------------------+------+-------------------+------------------------------------------------+--------+
| ID                                   | Name | MAC Address       | Fixed IP Addresses                             | Status |
+--------------------------------------+------+-------------------+------------------------------------------------+--------+
| 1c51b7c9-df3b-473f-9992-7f1503806d76 |      | fa:16:3e:b9:bf:e4 | ip_address='10.72.10.1',                       | N/A    |
|                                      |      |                   | subnet_id='3aa89106-e623-46b4-8aed-            |        |
|                                      |      |                   | 054628035bdd'                                  |        |
| 224113cb-635f-4e21-85ee-434056abab8a |      | fa:16:3e:00:ec:db | ip_address='172.20.20.2',                      | ACTIVE |
|                                      |      |                   | subnet_id='1f11a2a0-567a-4023-841c-            |        |
|                                      |      |                   | d08d176fe88f'                                  |        |
| 2ca96612-2795-4d8b-9da7-b06cefe8385d |      | fa:16:3e:9a:96:f1 | ip_address='10.72.10.10',                      | N/A    |
|                                      |      |                   | subnet_id='3aa89106-e623-46b4-8aed-            |        |
|                                      |      |                   | 054628035bdd'                                  |        |
| 38cc37a9-29c4-4b5b-a7e6-e770b2f8a6f7 |      | fa:16:3e:6d:6c:7a | ip_address='172.20.20.5',                      | ACTIVE |
|                                      |      |                   | subnet_id='1f11a2a0-567a-4023-841c-            |        |
|                                      |      |                   | d08d176fe88f'                                  |        |
| 39ec7053-2d56-4ff6-9ea4-87bc3b1ab170 |      | fa:16:3e:d4:81:8a | ip_address='10.72.10.2',                       | DOWN   |
|                                      |      |                   | subnet_id='3aa89106-e623-46b4-8aed-            |        |
|                                      |      |                   | 054628035bdd'                                  |        |
| fceae14a-8156-41ac-af99-98c6d25c59c9 |      | fa:16:3e:9f:3e:22 | ip_address='172.20.20.3',                      | ACTIVE |
|                                      |      |                   | subnet_id='1f11a2a0-567a-4023-841c-            |        |
|                                      |      |                   | d08d176fe88f'                                  |        |
+--------------------------------------+------+-------------------+------------------------------------------------+--------+

UPDATE!!!!

After updating the plugin.ini file to have

network_vlan_ranges = br-ovs0:70:80

The VLAN I am working on here is VLAN = 72 (I have 71 - 75 on this switch).

I Deleted and re-created the router (getting different UUIDs of course) and greped the log files for the port UUID. I find 10 tries to bind all looking like:

12:06:17.616 5386 INFO neutron.plugins.ml2.plugin [req-d9f9cfb6-1981-44de-bec9-2b95248303da - - - - -] Attempt 10 to bind port 39e60956-4ad1-4db7-9954-b5d80a9de000
12:06:17.648 5386 ERROR neutron.plugins.ml2.managers [req-d9f9cfb6-1981-44de-bec9-2b95248303da - - - - -] Failed to bind port 39e60956-4ad1-4db7-9954-b5d80a9de000 
        on host pwd-stack-1.frame.biz for vnic_type normal using segments [{'segmentation_id': 72, 
        'physical_network': u'br-ovs0', 'id': u'6a09547b-2856-412e-bd1d-1f74d140b636', 'network_type': u'vlan'}]

I wrapped the long line (but maybe not enough)