Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

Why do instacnces on my compute note not route externally?

I have two nodes in my setup (OpenStack Icehouse on Ubuntu 14.04 LTS). Instances on the 1st node are fine, this is controller etc. Instances on the 2nd node, which is a compute node cannot route beyond host.

I installed as follows:

Node1:

./openstack_networking.sh ./openstack_server_test.sh ./openstack_system_update.sh ./openstack_setup.sh ./openstack_splunk.sh ./openstack_mysql.sh ./openstack_keystone.sh ./openstack_glance.sh ./openstack_cinder.sh ./openstack_loop.sh ./openstack_nova.sh ./openstack_horizon.sh

nova-manage network create private --fixed_range_v4=172.16.100.0/24 --num_networks=1 --bridge=br100 --bridge_interface=eth0 --network_size=255

nova-manage floating create --pool=nova --ip_range=10.10.12.0/24

service nova-network restart

Node2:

./openstack_networking.sh ./openstack_server_test.sh ./openstack_system_update.sh ./openstack_setup.sh ./openstack_cinder.sh ./openstack_loop.sh ./openstack_nova_compute.sh

01 ~# nova-manage service list Binary Host Zone Status State Updated_At nova-conductor qa-openstack01 internal enabled :-) 2014-09-02 10:35:16 nova-consoleauth qa-openstack01 internal enabled :-) 2014-09-02 10:35:12 nova-network qa-openstack01 internal enabled :-) 2014-09-02 10:35:11 nova-cert qa-openstack01 internal enabled :-) 2014-09-02 10:35:12 nova-scheduler qa-openstack01 internal enabled :-) 2014-09-02 10:35:12 nova-compute qa-openstack01 nova enabled :-) 2014-09-02 10:35:11 nova-compute qa-openstack02 nova enabled :-) 2014-09-02 10:35:11

The network configuration shows differently on my 2nd node so I suspec that this is the issue but I'm unsure what I need to do to resolve. Do I need to install something else on it or perhaps I have missed some configuration?

Node1: 01 ~# ifconfig br100 Link encap:Ethernet HWaddr 00:22:64:9b:38:46 inet addr:172.16.100.1 Bcast:172.16.100.255 Mask:255.255.255.0 <- 172.16.100.0 address inet6 addr: fe80::a09b:6eff:fe2e:3f2a/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:1847317 errors:0 dropped:0 overruns:0 frame:0 TX packets:923282 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:2429935153 (2.4 GB) TX bytes:2338583671 (2.3 GB)

br101 Link encap:Ethernet HWaddr 00:00:00:00:00:00 inet addr:172.16.101.1 Bcast:172.16.101.255 Mask:255.255.255.0 inet6 addr: fe80::d8e0:1aff:fec3:42c7/64 Scope:Link UP BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:8 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 B) TX bytes:648 (648.0 B)

eth0 Link encap:Ethernet HWaddr 00:22:64:9b:38:46 inet6 addr: fe80::222:64ff:fe9b:3846/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:2222018 errors:0 dropped:190 overruns:0 frame:0 TX packets:2372391 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:2489523926 (2.4 GB) TX bytes:2443757841 (2.4 GB)

eth1 Link encap:Ethernet HWaddr 00:22:64:9b:58:8a inet addr:10.10.13.231 Bcast:10.10.13.255 Mask:255.255.255.0 UP BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:65536 Metric:1 RX packets:429166 errors:0 dropped:0 overruns:0 frame:0 TX packets:429166 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:777483058 (777.4 MB) TX bytes:777483058 (777.4 MB)

virbr0 Link encap:Ethernet HWaddr 00:00:00:00:00:00 inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0 UP BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:509577 errors:0 dropped:0 overruns:0 frame:0 TX packets:826469 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:26933182 (26.9 MB) TX bytes:1180100264 (1.1 GB)

01 ~# netstat -rn Kernel IP routing table Destination Gateway Genmask Flags MSS Window irtt Iface 0.0.0.0 10.10.12.1 0.0.0.0 UG 0 0 0 br100 10.10.12.0 0.0.0.0 255.255.255.0 U 0 0 0 br100 10.10.13.0 0.0.0.0 255.255.255.0 U 0 0 0 eth1 172.16.100.0 0.0.0.0 255.255.255.0 U 0 0 0 br100 172.16.101.0 0.0.0.0 255.255.255.0 U 0 0 0 br101 192.168.122.0 0.0.0.0 255.255.255.0 U 0 0 0 virbr0

Node2: 02 ~# ifconfig br100 Link encap:Ethernet HWaddr 00:1f:29:0a:7c:84 inet addr:10.10.12.20 Bcast:10.10.12.255 Mask:255.255.255.0 <- 10.10.12.0 address inet6 addr: fe80::34cb:afff:fe2e:33b3/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:1252502 errors:0 dropped:0 overruns:0 frame:0 TX packets:825145 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:3327615325 (3.3 GB) TX bytes:59125280 (59.1 MB)

br101 Link encap:Ethernet HWaddr 00:1f:29:0a:7c:82 inet addr:10.10.13.232 Bcast:10.10.13.255 Mask:255.255.255.0 inet6 addr: fe80::541f:a6ff:fe27:c7f0/64 Scope:Link UP BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:3 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 B) TX bytes:230 (230.0 B)

eth0 Link encap:Ethernet HWaddr 00:1f:29:0a:7c:84 inet6 addr: fe80::21f:29ff:fe0a:7c84/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:3786853 errors:0 dropped:372 overruns:0 frame:0 TX packets:1272104 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:5651602008 (5.6 GB) TX bytes:93970669 (93.9 MB)

eth1 Link encap:Ethernet HWaddr 00:1f:29:0a:7c:82 UP BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:65536 Metric:1 RX packets:1750 errors:0 dropped:0 overruns:0 frame:0 TX packets:1750 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:88792 (88.7 KB) TX bytes:88792 (88.7 KB)

virbr0 Link encap:Ethernet HWaddr c2:db:c3:f0:3c:3f inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0 UP BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

02 ~# netstat -rn Kernel IP routing table Destination Gateway Genmask Flags MSS Window irtt Iface 0.0.0.0 10.10.12.1 0.0.0.0 UG 0 0 0 br100 10.10.12.0 0.0.0.0 255.255.255.0 U 0 0 0 br100 10.10.13.0 0.0.0.0 255.255.255.0 U 0 0 0 br101 192.168.122.0 0.0.0.0 255.255.255.0 U 0 0 0 virbr0

Why do instacnces instances on my compute note not route externally?

I have two nodes in my setup (OpenStack Icehouse on Ubuntu 14.04 LTS). Instances on the 1st node are fine, this is the controller etc. node. Instances on the 2nd node, which is a compute node cannot route beyond host.host.

I installed as follows:

Node1:

./openstack_networking.sh ./openstack_server_test.sh ./openstack_system_update.sh ./openstack_setup.sh ./openstack_splunk.sh ./openstack_mysql.sh ./openstack_keystone.sh ./openstack_glance.sh ./openstack_cinder.sh ./openstack_loop.sh ./openstack_nova.sh ./openstack_horizon.sh

nova-manage network create private --fixed_range_v4=172.16.100.0/24 --num_networks=1 --bridge=br100 --bridge_interface=eth0 --network_size=255

nova-manage floating create --pool=nova --ip_range=10.10.12.0/24

service nova-network restart

Node2:

./openstack_networking.sh ./openstack_server_test.sh ./openstack_system_update.sh ./openstack_setup.sh ./openstack_cinder.sh ./openstack_loop.sh ./openstack_nova_compute.sh

01 ~# nova-manage service list Binary Host Zone Status State Updated_At nova-conductor qa-openstack01 internal enabled :-) 2014-09-02 10:35:16 nova-consoleauth qa-openstack01 internal enabled :-) 2014-09-02 10:35:12 nova-network qa-openstack01 internal enabled :-) 2014-09-02 10:35:11 nova-cert qa-openstack01 internal enabled :-) 2014-09-02 10:35:12 nova-scheduler qa-openstack01 internal enabled :-) 2014-09-02 10:35:12 nova-compute qa-openstack01 nova enabled :-) 2014-09-02 10:35:11 nova-compute qa-openstack02 nova enabled :-) 2014-09-02 10:35:11

The network configuration shows differently on my 2nd node so I suspec suspect that this is the issue but I'm unsure what I need to do to resolve. Do I need to install something else on it or perhaps I have missed some configuration?configuration? Anyone got some ideas for me?

Node1: 01 ~# ifconfig br100 Link encap:Ethernet HWaddr 00:22:64:9b:38:46 inet addr:172.16.100.1 Bcast:172.16.100.255 Mask:255.255.255.0 <- 172.16.100.0 address inet6 addr: fe80::a09b:6eff:fe2e:3f2a/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:1847317 errors:0 dropped:0 overruns:0 frame:0 TX packets:923282 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:2429935153 (2.4 GB) TX bytes:2338583671 (2.3 GB)

br101 Link encap:Ethernet HWaddr 00:00:00:00:00:00 inet addr:172.16.101.1 Bcast:172.16.101.255 Mask:255.255.255.0 inet6 addr: fe80::d8e0:1aff:fec3:42c7/64 Scope:Link UP BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:8 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 B) TX bytes:648 (648.0 B)

eth0 Link encap:Ethernet HWaddr 00:22:64:9b:38:46 inet6 addr: fe80::222:64ff:fe9b:3846/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:2222018 errors:0 dropped:190 overruns:0 frame:0 TX packets:2372391 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:2489523926 (2.4 GB) TX bytes:2443757841 (2.4 GB)

eth1 Link encap:Ethernet HWaddr 00:22:64:9b:58:8a inet addr:10.10.13.231 Bcast:10.10.13.255 Mask:255.255.255.0 UP BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:65536 Metric:1 RX packets:429166 errors:0 dropped:0 overruns:0 frame:0 TX packets:429166 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:777483058 (777.4 MB) TX bytes:777483058 (777.4 MB)

virbr0 Link encap:Ethernet HWaddr 00:00:00:00:00:00 inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0 UP BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:509577 errors:0 dropped:0 overruns:0 frame:0 TX packets:826469 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:26933182 (26.9 MB) TX bytes:1180100264 (1.1 GB)

01 ~# netstat -rn Kernel IP routing table Destination Gateway Genmask Flags MSS Window irtt Iface 0.0.0.0 10.10.12.1 0.0.0.0 UG 0 0 0 br100 10.10.12.0 0.0.0.0 255.255.255.0 U 0 0 0 br100 10.10.13.0 0.0.0.0 255.255.255.0 U 0 0 0 eth1 172.16.100.0 0.0.0.0 255.255.255.0 U 0 0 0 br100 172.16.101.0 0.0.0.0 255.255.255.0 U 0 0 0 br101 192.168.122.0 0.0.0.0 255.255.255.0 U 0 0 0 virbr0

Node2: 02 ~# ifconfig br100 Link encap:Ethernet HWaddr 00:1f:29:0a:7c:84 inet addr:10.10.12.20 Bcast:10.10.12.255 Mask:255.255.255.0 <- 10.10.12.0 address inet6 addr: fe80::34cb:afff:fe2e:33b3/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:1252502 errors:0 dropped:0 overruns:0 frame:0 TX packets:825145 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:3327615325 (3.3 GB) TX bytes:59125280 (59.1 MB)

br101 Link encap:Ethernet HWaddr 00:1f:29:0a:7c:82 inet addr:10.10.13.232 Bcast:10.10.13.255 Mask:255.255.255.0 inet6 addr: fe80::541f:a6ff:fe27:c7f0/64 Scope:Link UP BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:3 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 B) TX bytes:230 (230.0 B)

eth0 Link encap:Ethernet HWaddr 00:1f:29:0a:7c:84 inet6 addr: fe80::21f:29ff:fe0a:7c84/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:3786853 errors:0 dropped:372 overruns:0 frame:0 TX packets:1272104 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:5651602008 (5.6 GB) TX bytes:93970669 (93.9 MB)

eth1 Link encap:Ethernet HWaddr 00:1f:29:0a:7c:82 UP BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:65536 Metric:1 RX packets:1750 errors:0 dropped:0 overruns:0 frame:0 TX packets:1750 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:88792 (88.7 KB) TX bytes:88792 (88.7 KB)

virbr0 Link encap:Ethernet HWaddr c2:db:c3:f0:3c:3f inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0 UP BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

02 ~# netstat -rn Kernel IP routing table Destination Gateway Genmask Flags MSS Window irtt Iface 0.0.0.0 10.10.12.1 0.0.0.0 UG 0 0 0 br100 10.10.12.0 0.0.0.0 255.255.255.0 U 0 0 0 br100 10.10.13.0 0.0.0.0 255.255.255.0 U 0 0 0 br101 192.168.122.0 0.0.0.0 255.255.255.0 U 0 0 0 virbr0