Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

asked 2015-08-07 02:25:58 -0600

smcas gravatar image

No internet access in virtual machine

We have configured 3-node setup of openstack icehouse on CentOS : Controller , Compute and Network Node.

We have following networks :
Public Network - 192.168.10.0/24
Management Network - 10.0.0.0/24
GRE TUNNEL Network - 10.0.1.0/24
VM TRAFFIC-FloatingIp Network - 172.16.3.0/24

we create another network i.e, 192.168.8.0/24 which is available for instances running on compute node, it will be tunneled over to the network node where a neutron router will route the traffic to the external network(172.16.3.0/24), here we assign floating IP.

image description

We are facing following problems:

1. Whenever we attach bridge br-ex to Network Node at 192.168.10.4, internet connectivity is lost  and this node becomes inaccessible via public network.
2. Instances are getting IP from Floating IP through DHCP. Though, IP is displayed on the dashboard but when we execute 'ifconfig' from VM terminal, it does not show any IP.
3. No internet access  in the virtual machine.
4. ip netns on network node doesn’t  show qdhcp<id>  as its output.
5. Router interface and gateway always down.

No internet access in virtual machine

We have configured 3-node setup of openstack icehouse on CentOS : Controller , Compute and Network Node.

We have following networks :
Public Network - 192.168.10.0/24
Management Network - 10.0.0.0/24
GRE TUNNEL Network - 10.0.1.0/24
VM TRAFFIC-FloatingIp Network - 172.16.3.0/24
192.168.12.0/16

image description we create another network i.e, 192.168.8.0/24 172.16.24.0/24 which is available for instances running on compute node, it will be tunneled over to the network node where a neutron router will route the traffic to the external network(172.16.3.0/24), here we assign floating IP.

image descriptionnode.

We are facing following problems:

1. Whenever we attach bridge br-ex to Network Node at 192.168.10.4, internet connectivity is lost  and this node becomes inaccessible via public network.
2. Instances are getting IP from Floating IP through DHCP. Though, IP is displayed on the dashboard but when we execute 'ifconfig' from VM terminal, it does not show any IP.
3. 2. No internet access  in the virtual machine.
4. ip netns on network node doesn’t  show qdhcp<id>  as its output.
5. 3. Router interface and gateway always down.

OUR CONFIGURATION IS :

Bridge config:

DEVICE=br-ex
DEVICETYPE=ovs
TYPE=OVSIntPort
OVS_BRIDGE=br-ex
NM_CONTROLLED=nO
MACADDR=f8:0f:41:fc:48:65
BOOTPROTO=static
ONBOOT=yes
IPADDR=192.168.12.2
PREFIX=16
NETMASK=255.255.0.0
GATEWAY=192.168.0.3
DNS1=202.138.96.2
DNS2=8.8.8.8
DEFROUTE=yes
IPV4_FAILURE_FATAL=yes
IPV6INIT=no

Ethernet port config:

DEVICE=eth3
HWADDR=F8:0F:41:FC:48:65
TYPE=OVSPort
DEVICETYPE=ovs
OVS_BRIDGE=br-ex
UUID=e84b351d-bfc7-427f-8dda-84a1b1df5f26
ONBOOT=yes
NM_CONTROLLED=no
BOOTPROTO=none
IPV4_FAILURE_FATAL=yes
IPV6INIT=no

ovs-vsctl show on network node:

[root@newnetwork ~]# ovs-vsctl show
821c052b-827b-41db-9412-cfa33407d615
    Bridge br-ex
        Port phy-br-ex
            Interface phy-br-ex
        Port "eth3"
            Interface "eth3"
        Port br-ex
            Interface br-ex
                type: internal
    Bridge br-tun
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port br-tun
            Interface br-tun
                type: internal
    Bridge br-int
        fail_mode: secure
        Port "tap9300d1c6-f4"
            tag: 4095
            Interface "tap9300d1c6-f4"
                type: internal
        Port br-int
            Interface br-int
                type: internal
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
        Port int-br-ex
            Interface int-br-ex
    ovs_version: "2.1.3"

ovs-vsctl on compute node:

[root@newcompute1 ~]# ovs-vsctl show
8290fd1a-7636-4887-b108-82768338455d
    Bridge br-tun
        Port br-tun
            Interface br-tun
                type: internal
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port "gre-0a000104"
            Interface "gre-0a000104"
                type: gre
                options: {in_key=flow, local_ip="10.0.1.5", out_key=flow, remote_ip="10.0.1.4"}
    Bridge br-int
        fail_mode: secure
        Port "qvo625284a7-2c"
            tag: 4095
            Interface "qvo625284a7-2c"
        Port br-int
            Interface br-int
                type: internal
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
    ovs_version: "2.1.3"

No internet access in virtual machine

We have configured 3-node setup of openstack icehouse on CentOS : Controller , Compute and Network Node.

We have following networks :
Public Network - 192.168.10.0/24
Management Network - 10.0.0.0/24
GRE TUNNEL Network - 10.0.1.0/24
VM TRAFFIC-FloatingIp Network - 192.168.12.0/16

image description image description

we create another network i.e, 172.16.24.0/24 which is available for instances running on compute node.

We are facing following problems:

1. Instances are getting IP from Floating IP through DHCP. Though, IP is displayed on the dashboard but when we execute 'ifconfig' from VM terminal, it does not show any IP.
2. No internet access  in the virtual machine.
3. Router interface and gateway always down.

OUR CONFIGURATION IS :

Bridge config:

DEVICE=br-ex
DEVICETYPE=ovs
TYPE=OVSIntPort
OVS_BRIDGE=br-ex
NM_CONTROLLED=nO
MACADDR=f8:0f:41:fc:48:65
BOOTPROTO=static
ONBOOT=yes
IPADDR=192.168.12.2
PREFIX=16
NETMASK=255.255.0.0
GATEWAY=192.168.0.3
DNS1=202.138.96.2
DNS2=8.8.8.8
DEFROUTE=yes
IPV4_FAILURE_FATAL=yes
IPV6INIT=no

Ethernet port config:

DEVICE=eth3
HWADDR=F8:0F:41:FC:48:65
TYPE=OVSPort
DEVICETYPE=ovs
OVS_BRIDGE=br-ex
UUID=e84b351d-bfc7-427f-8dda-84a1b1df5f26
ONBOOT=yes
NM_CONTROLLED=no
BOOTPROTO=none
IPV4_FAILURE_FATAL=yes
IPV6INIT=no

ovs-vsctl show on network node:

[root@newnetwork ~]# ovs-vsctl show
821c052b-827b-41db-9412-cfa33407d615
    Bridge br-ex
        Port phy-br-ex
            Interface phy-br-ex
        Port "eth3"
            Interface "eth3"
        Port br-ex
            Interface br-ex
                type: internal
    Bridge br-tun
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port br-tun
            Interface br-tun
                type: internal
    Bridge br-int
        fail_mode: secure
        Port "tap9300d1c6-f4"
            tag: 4095
            Interface "tap9300d1c6-f4"
                type: internal
        Port br-int
            Interface br-int
                type: internal
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
        Port int-br-ex
            Interface int-br-ex
    ovs_version: "2.1.3"

ovs-vsctl on compute node:

[root@newcompute1 ~]# ovs-vsctl show
8290fd1a-7636-4887-b108-82768338455d
    Bridge br-tun
        Port br-tun
            Interface br-tun
                type: internal
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port "gre-0a000104"
            Interface "gre-0a000104"
                type: gre
                options: {in_key=flow, local_ip="10.0.1.5", out_key=flow, remote_ip="10.0.1.4"}
    Bridge br-int
        fail_mode: secure
        Port "qvo625284a7-2c"
            tag: 4095
            Interface "qvo625284a7-2c"
        Port br-int
            Interface br-int
                type: internal
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
    ovs_version: "2.1.3"

No internet access in virtual machine

We have configured 3-node setup of openstack icehouse on CentOS : Controller , Compute and Network Node.

We have following networks :
Public Network - 192.168.10.0/24
Management Network - 10.0.0.0/24
GRE TUNNEL Network - 10.0.1.0/24
VM TRAFFIC-FloatingIp Network - 192.168.12.0/16

image description image description

we create another network i.e, 172.16.24.0/24 which is available for instances running on compute node.

We are facing following problems:

1. Instances are getting IP from Floating IP through DHCP. Though, IP is displayed on the dashboard but when we execute 'ifconfig' from VM terminal, it does not show any IP.
2. No internet access  in the virtual machine.
3. Router interface and gateway always down.

OUR CONFIGURATION IS :

Bridge config:

DEVICE=br-ex
DEVICETYPE=ovs
TYPE=OVSIntPort
OVS_BRIDGE=br-ex
NM_CONTROLLED=nO
MACADDR=f8:0f:41:fc:48:65
BOOTPROTO=static
ONBOOT=yes
IPADDR=192.168.12.2
PREFIX=16
NETMASK=255.255.0.0
GATEWAY=192.168.0.3
DNS1=202.138.96.2
DNS2=8.8.8.8
DEFROUTE=yes
IPV4_FAILURE_FATAL=yes
IPV6INIT=no

Ethernet port config:

DEVICE=eth3
HWADDR=F8:0F:41:FC:48:65
TYPE=OVSPort
DEVICETYPE=ovs
OVS_BRIDGE=br-ex
UUID=e84b351d-bfc7-427f-8dda-84a1b1df5f26
ONBOOT=yes
NM_CONTROLLED=no
BOOTPROTO=none
IPV4_FAILURE_FATAL=yes
IPV6INIT=no

ovs-vsctl show on network node:

[root@newnetwork ~]# ovs-vsctl show
821c052b-827b-41db-9412-cfa33407d615
    Bridge br-ex
        Port phy-br-ex
            Interface phy-br-ex
        Port "eth3"
            Interface "eth3"
        Port br-ex
            Interface br-ex
                type: internal
    Bridge br-tun
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port br-tun
            Interface br-tun
                type: internal
    Bridge br-int
        fail_mode: secure
        Port "tap9300d1c6-f4"
            tag: 4095
            Interface "tap9300d1c6-f4"
                type: internal
        Port br-int
            Interface br-int
                type: internal
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
        Port int-br-ex
            Interface int-br-ex
    ovs_version: "2.1.3"

ovs-vsctl on compute node:

[root@newcompute1 ~]# ovs-vsctl show
8290fd1a-7636-4887-b108-82768338455d
    Bridge br-tun
        Port br-tun
            Interface br-tun
                type: internal
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port "gre-0a000104"
            Interface "gre-0a000104"
                type: gre
                options: {in_key=flow, local_ip="10.0.1.5", out_key=flow, remote_ip="10.0.1.4"}
    Bridge br-int
        fail_mode: secure
        Port "qvo625284a7-2c"
            tag: 4095
            Interface "qvo625284a7-2c"
        Port br-int
            Interface br-int
                type: internal
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
    ovs_version: "2.1.3"

As per the suggestions we have made changes and the internet connectivity on network node is fine after adding bridge but still have issues.. plz suggest what we have still missing

No internet access in virtual machine

We have configured 3-node setup of openstack icehouse on CentOS : Controller , Compute and Network Node.

We have following networks :
Public Network - 192.168.10.0/24
192.168.10.0/16
Management Network - 10.0.0.0/24
GRE TUNNEL Network - 10.0.1.0/24
VM TRAFFIC-FloatingIp Network - 192.168.12.0/16

image description image description

we create another network i.e, 172.16.24.0/24 which is available for instances running on compute node.

We are facing following problems:

1. Instances are getting IP from Floating IP through DHCP. Though, IP is displayed on the dashboard but when we execute 'ifconfig' from VM terminal, it does not show any IP.
2. No internet access  in the virtual machine.
3. Router interface and gateway always down.
down. 
4. Ports are showing down on br-int .
5. VMs are not able to ping the compute node and external network.
6. ip a  on any node shows UNKNOWN or DOWN status of interfaces.
7. ip netns does not show router namespace.
8. ovs-vsctl shows dead tag 4095.

OUR CONFIGURATION IS :

Bridge config:

DEVICE=br-ex
DEVICETYPE=ovs
TYPE=OVSIntPort
OVS_BRIDGE=br-ex
NM_CONTROLLED=nO
MACADDR=f8:0f:41:fc:48:65
BOOTPROTO=static
ONBOOT=yes
IPADDR=192.168.12.2
PREFIX=16
NETMASK=255.255.0.0
GATEWAY=192.168.0.3
DNS1=202.138.96.2
DNS2=8.8.8.8
DEFROUTE=yes
IPV4_FAILURE_FATAL=yes
IPV6INIT=no

Ethernet port config:

DEVICE=eth3
HWADDR=F8:0F:41:FC:48:65
TYPE=OVSPort
DEVICETYPE=ovs
OVS_BRIDGE=br-ex
UUID=e84b351d-bfc7-427f-8dda-84a1b1df5f26
ONBOOT=yes
NM_CONTROLLED=no
BOOTPROTO=none
IPV4_FAILURE_FATAL=yes
IPV6INIT=no

ovs-vsctl show on network node:

[root@newnetwork ~]# ovs-vsctl show
821c052b-827b-41db-9412-cfa33407d615
    Bridge br-ex
        Port phy-br-ex
            Interface phy-br-ex
        Port "eth3"
            Interface "eth3"
        Port br-ex
            Interface br-ex
                type: internal
    Bridge br-tun
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port br-tun
            Interface br-tun
                type: internal
    Bridge br-int
        fail_mode: secure
        Port "tap9300d1c6-f4"
            tag: 4095
            Interface "tap9300d1c6-f4"
                type: internal
        Port br-int
            Interface br-int
                type: internal
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
        Port int-br-ex
            Interface int-br-ex
    ovs_version: "2.1.3"

ovs-vsctl on compute node:

[root@newcompute1 ~]# ovs-vsctl show
8290fd1a-7636-4887-b108-82768338455d
    Bridge br-tun
        Port br-tun
            Interface br-tun
                type: internal
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port "gre-0a000104"
            Interface "gre-0a000104"
                type: gre
                options: {in_key=flow, local_ip="10.0.1.5", out_key=flow, remote_ip="10.0.1.4"}
    Bridge br-int
        fail_mode: secure
        Port "qvo625284a7-2c"
            tag: 4095
            Interface "qvo625284a7-2c"
        Port br-int
            Interface br-int
                type: internal
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
    ovs_version: "2.1.3"

As per the suggestions we have made changes and the internet connectivity on network node is fine after adding bridge but still have issues.. plz please suggest what we have are still missing missing. We are waiting for the response.