Ask Your Question
0

rocky linux_bridge selfsevice network router interface down

asked 2018-12-15 10:23:12 -0600

Johnny gravatar image

Hello!

I installed openstack with some nodes. 1 controller and 2 compute nodes. The network service is on the controller node.

I configured a provider network. It works. I configured a selfservice network. It works between nodes which were connected to. If I want to use only the selfservice network, and i want to conect to the internet through this network it doesn't work (internet access). I created a router with interface. But this interface is in down state.

I use linux_bridge, not openvswitch. As the example described on http://openstack.org

Did i miss something, or did i do wrong?

thank you. Johnny

root@mantis(controller)~ # openstack network list
+--------------------------------------+----------+--------------------------------------+
| ID                                   | Name     | Subnets                              |
+--------------------------------------+----------+--------------------------------------+
| 165c112f-7e3c-4b52-a2e2-dbd013defd10 | external | 5b48de07-3c3b-4fad-91e4-527fc6504abf |
| e1c5cd35-6e4e-4b4f-a1ba-6b49244e0c6d | internal | fa606c14-65fa-4f4f-ae47-bb87cc46e89a |
+--------------------------------------+----------+--------------------------------------+
root@mantis(controller)~ # openstack network show e1c5cd35-6e4e-4b4f-a1ba-6b49244e0c6d
+---------------------------+--------------------------------------+
| Field                     | Value                                |
+---------------------------+--------------------------------------+
| admin_state_up            | UP                                   |
| availability_zone_hints   |                                      |
| availability_zones        | nova                                 |
| created_at                | 2018-12-15T14:11:52Z                 |
| description               |                                      |
| dns_domain                | None                                 |
| id                        | e1c5cd35-6e4e-4b4f-a1ba-6b49244e0c6d |
| ipv4_address_scope        | None                                 |
| ipv6_address_scope        | None                                 |
| is_default                | None                                 |
| is_vlan_transparent       | None                                 |
| mtu                       | 1450                                 |
| name                      | internal                             |
| port_security_enabled     | True                                 |
| project_id                | ba546ea8e5224748860d3476d2401106     |
| provider:network_type     | vxlan                                |
| provider:physical_network | None                                 |
| provider:segmentation_id  | 1                                    |
| qos_policy_id             | None                                 |
| revision_number           | 1                                    |
| router:external           | Internal                             |
| segments                  | None                                 |
| shared                    | True                                 |
| status                    | ACTIVE                               |
| subnets                   | fa606c14-65fa-4f4f-ae47-bb87cc46e89a |
| tags                      |                                      |
| updated_at                | 2018-12-15T14:11:52Z                 |
+---------------------------+--------------------------------------+
root@mantis(controller)~ # openstack network show 165c112f-7e3c-4b52-a2e2-dbd013defd10
+---------------------------+--------------------------------------+
| Field                     | Value                                |
+---------------------------+--------------------------------------+
| admin_state_up            | UP                                   |
| availability_zone_hints   |                                      |
| availability_zones        | nova                                 |
| created_at                | 2018-12-15T13:57:26Z                 |
| description               |                                      |
| dns_domain                | None                                 |
| id                        | 165c112f-7e3c-4b52-a2e2-dbd013defd10 |
| ipv4_address_scope        | None                                 |
| ipv6_address_scope        | None                                 |
| is_default                | False                                |
| is_vlan_transparent       | None                                 |
| mtu                       | 1500                                 |
| name                      | external                             |
| port_security_enabled     | True                                 |
| project_id                | ba546ea8e5224748860d3476d2401106     |
| provider:network_type     | flat                                 |
| provider:physical_network | provider                             |
| provider:segmentation_id  | None                                 |
| qos_policy_id             | None                                 |
| revision_number           | 1                                    |
| router:external           | External                             |
| segments                  | None                                 |
| shared                    | True                                 |
| status                    | ACTIVE                               |
| subnets                   | 5b48de07-3c3b-4fad-91e4-527fc6504abf |
| tags                      |                                      |
| updated_at                | 2018-12-15T13:57:26Z                 |
+---------------------------+--------------------------------------+

root@mantis(controller)~ # openstack subnet list
+--------------------------------------+-------+--------------------------------------+-----------------+
| ID                                   | Name  | Network                              | Subnet          |
+--------------------------------------+-------+--------------------------------------+-----------------+
| 5b48de07-3c3b-4fad-91e4-527fc6504abf | local | 165c112f-7e3c-4b52-a2e2-dbd013defd10 | 192.168.96.0/21 |
| fa606c14-65fa-4f4f-ae47-bb87cc46e89a | int1  | e1c5cd35-6e4e-4b4f-a1ba-6b49244e0c6d | 10.1.0.0/24     |
+--------------------------------------+-------+--------------------------------------+-----------------+
root@mantis(controller)~ # openstack subnet show fa606c14-65fa-4f4f-ae47-bb87cc46e89a
+-------------------+--------------------------------------+
| Field             | Value                                |
+-------------------+--------------------------------------+
| allocation_pools  | 10.1.0.10-10.1.0.100                 |
| cidr              | 10.1.0.0/24                          |
| created_at        | 2018-12-15T14:11:52Z                 |
| description       |                                      |
| dns_nameservers   |                                      |
| enable_dhcp       | True                                 |
| gateway_ip        | 10.1.0.1                             |
| host_routes       |                                      |
| id                | fa606c14-65fa-4f4f-ae47-bb87cc46e89a |
| ip_version        | 4                                    |
| ipv6_address_mode | None                                 |
| ipv6_ra_mode      | None                                 |
| name              | int1                                 |
| network_id        | e1c5cd35-6e4e-4b4f-a1ba-6b49244e0c6d |
| project_id        | ba546ea8e5224748860d3476d2401106     |
| revision_number   | 0                                    |
| segment_id        | None                                 |
| service_types     |                                      |
| subnetpool_id     | None                                 |
| tags              |                                      |
| updated_at        | 2018-12-15T14:11:52Z                 |
+-------------------+--------------------------------------+
root@mantis(controller)~ # openstack subnet show 5b48de07-3c3b-4fad-91e4-527fc6504abf
+-------------------+--------------------------------------+
| Field             | Value                                |
+-------------------+--------------------------------------+
| allocation_pools  | 192.168.100.175-192.168.100.180      |
| cidr              | 192.168.96.0/21                      |
| created_at        | 2018-12-15T13:57:26Z                 |
| description       |                                      |
| dns_nameservers   | 192.168.98.40                        |
| enable_dhcp       | True                                 |
| gateway_ip        | 192.168.100.1                        |
| host_routes       |                                      |
| id                | 5b48de07-3c3b-4fad-91e4-527fc6504abf |
| ip_version        | 4                                    |
| ipv6_address_mode | None                                 |
| ipv6_ra_mode      | None                                 |
| name              | local                                |
| network_id        | 165c112f-7e3c-4b52-a2e2-dbd013defd10 |
| project_id        | ba546ea8e5224748860d3476d2401106     |
| revision_number   | 0                                    |
| segment_id        | None                                 |
| service_types     |                                      |
| subnetpool_id     | None                                 |
| tags              |                                      |
| updated_at        | 2018-12-15T13:57:26Z                 |
+-------------------+--------------------------------------+


root@mantis(controller)~ # openstack router list
+--------------------------------------+--------+--------+-------+-------------+-------+----------------------------------+
| ID                                   | Name   | Status | State | Distributed | HA    | Project                          |
+--------------------------------------+--------+--------+-------+-------------+-------+----------------------------------+
| b641dbe1-c3ff-4dad-a9b0-6029e36002c3 | router | ACTIVE | UP    | False       | False | ba546ea8e5224748860d3476d2401106 |
+--------------------------------------+--------+--------+-------+-------------+-------+----------------------------------+
root@mantis(controller)~ # openstack router show b641dbe1-c3ff-4dad-a9b0-6029e36002c3
+-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Field                   | Value                                                                                                                                                                                       |
+-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| admin_state_up          | UP                                                                                                                                                                                          |
| availability_zone_hints |                                                                                                                                                                                             |
| availability_zones      |                                                                                                                                                                                             |
| created_at              | 2018-12-15T14:12:40Z                                                                                                                                                                        |
| description             |                                                                                                                                                                                             |
| distributed             | False                                                                                                                                                                                       |
| external_gateway_info   | {"network_id": "165c112f-7e3c-4b52-a2e2-dbd013defd10", "enable_snat": true, "external_fixed_ips": [{"subnet_id": "5b48de07-3c3b-4fad-91e4-527fc6504abf", "ip_address": "192.168.100.178"}]} |
| flavor_id               | None                                                                                                                                                                                        |
| ha                      | False                                                                                                                                                                                       |
| id                      | b641dbe1-c3ff-4dad-a9b0-6029e36002c3                                                                                                                                                        |
| interfaces_info         | [{"subnet_id": "fa606c14-65fa-4f4f-ae47-bb87cc46e89a", "ip_address": "10.1.0.1", "port_id": "4c12fe81-5dcf-4081-a867-7ed83c5717ea"}]                                                        |
| name                    | router                                                                                                                                                                                      |
| project_id              | ba546ea8e5224748860d3476d2401106                                                                                                                                                            |
| revision_number         | 3                                                                                                                                                                                           |
| routes                  |                                                                                                                                                                                             |
| status                  | ACTIVE                                                                                                                                                                                      |
| tags                    |                                                                                                                                                                                             |
| updated_at              | 2018-12-15T14:24:07Z                                                                                                                                                                        |
+-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

root@mantis(controller)~ # openstack port ...
(more)
edit retag flag offensive close merge delete

Comments

The external network’s addresses are private (192.168.100.xxx). Are you sure this network is connected to the internet?

Bernd Bausch gravatar imageBernd Bausch ( 2018-12-18 18:28:30 -0600 )edit

yes. I can use the external network and the 'internal' separatelly.

the internal is work between the instances. Only the router is failed.

Johnny gravatar imageJohnny ( 2018-12-19 09:05:39 -0600 )edit

I would approach this in the following way. First, is there connectivity between instances and router. If yes, go into the router's network namespace and check what happens with the packets that come from the instances. Check netfilter rules (iptables) and routing table. Use tcpdump to trace.

Bernd Bausch gravatar imageBernd Bausch ( 2018-12-19 18:37:34 -0600 )edit

If instances don't have connectivity to the router, you need to trace along the connection between instances and router. I have no experience with Linuxbridge, but the networking guide should help you find tracing points.

Bernd Bausch gravatar imageBernd Bausch ( 2018-12-19 18:39:42 -0600 )edit

Of course, also double-check the configuration, though apart from the mapping to your datacenter infrastructure, I wouldn't know what to look for.

You have two provider networks; is provider:vlan0.100 correct, and is vlan0.100 connected to the internet?

Bernd Bausch gravatar imageBernd Bausch ( 2018-12-19 18:44:32 -0600 )edit

2 answers

Sort by » oldest newest most voted
0

answered 2018-12-19 09:03:28 -0600

Johnny gravatar image

updated 2018-12-27 01:49:50 -0600

UPDATE

root@mantis(controller)~ # ip netns exec qrouter-f8516b33-e6b4-487c-b613-6a33833a4c21 ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
2: qr-3c3e46e5-e3@if16: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc noqueue state UP group default qlen 1000
    link/ether fa:16:3e:8b:d3:ef brd ff:ff:ff:ff:ff:ff link-netnsid 0
    inet 10.1.0.1/24 brd 10.1.0.255 scope global qr-3c3e46e5-e3
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fe8b:d3ef/64 scope link
       valid_lft forever preferred_lft forever
3: qg-4295f084-41@if17: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether fa:16:3e:74:bc:13 brd ff:ff:ff:ff:ff:ff link-netnsid 0
    inet 192.168.100.179/21 brd 192.168.103.255 scope global qg-4295f084-41
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fe74:bc13/64 scope link
       valid_lft forever preferred_lft forever


root@mantis(controller)~ # ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
2: ens161: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond115 state UP group default qlen 1000
    link/ether 00:50:56:84:9a:c2 brd ff:ff:ff:ff:ff:ff
3: ens192: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master vlan0.100 state UP group default qlen 1000
    link/ether 00:50:56:84:e0:a0 brd ff:ff:ff:ff:ff:ff
4: ens193: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond116 state UP group default qlen 1000
    link/ether 00:50:56:84:5c:a3 brd ff:ff:ff:ff:ff:ff
5: ens224: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond115 state UP group default qlen 1000
    link/ether 00:50:56:84:9a:c2 brd ff:ff:ff:ff:ff:ff
6: ens256: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond116 state UP group default qlen 1000
    link/ether 00:50:56:84:5c:a3 brd ff:ff:ff:ff:ff:ff
7: vlan0.100: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue master brq165c112f-7e state UP group default qlen 1000
    link/ether 00:50:56:84:e0:a0 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::d3a6:f266:f532:5913/64 scope link noprefixroute
       valid_lft forever preferred_lft forever
8: bond116: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 00:50:56:84:5c:a3 brd ff:ff:ff:ff:ff ...
(more)
edit flag offensive delete link more
0

answered 2018-12-18 04:19:17 -0600

BiG_NoBoDy gravatar image

You need to set gateway and if you specified IP for GW on a subnet, so Router should have that IP address assigned.

edit flag offensive delete link more

Comments

Hello!

I already added a gateway :(

| external_gateway_info | {"network_id": "165c112f-7e3c-4b52-a2e2-dbd013defd10", "enable_snat": true, "external_fixed_ips": [{"subnet_id": "5b48de07-3c3b-4fad-91e4-527fc6504abf", "ip_address": "192.168.100.178"}]} |

The IP was automaticaly added by openstack.

Johnny gravatar imageJohnny ( 2018-12-18 07:00:28 -0600 )edit

So, there are two networks. "public" 192.168.96.0/21 and the network for instances is: 10.1.0.0/24

The instances got IP from dhcp. They can ping together (both of them are on different compute node) external fixed ip : 192.168.100.178 for this network (instance network)

Johnny gravatar imageJohnny ( 2018-12-18 07:05:03 -0600 )edit

You say “The IP was automaticaly added by openstack“. OpenStack doesn’t automatically add subnet address ranges, but perhaps your deployment tool did. How did you deploy your cloud?

Bernd Bausch gravatar imageBernd Bausch ( 2018-12-18 18:30:33 -0600 )edit

Hello! Is the deployment tool the openstack command? I Used that. Openstack added ip from previously defined dhcp range. So i could not defined the gw addr. I deployed openstack by guide. Step by step on redhat 7. The router configured on the dashboard. All the other configure by 'openstack' command

Johnny gravatar imageJohnny ( 2018-12-19 01:10:09 -0600 )edit

The openstack command doesn’t deploy a cloud. You do it manually or use a tool like tripleo.

My question is really, how is the external network connected to the internet.

Also, you followed a guide. Can you say which guide? Which commands did you use to create the external network and its subnet?

Bernd Bausch gravatar imageBernd Bausch ( 2018-12-19 03:19:24 -0600 )edit

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

Stats

Asked: 2018-12-15 10:23:12 -0600

Seen: 129 times

Last updated: Dec 27 '18