Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

Debugging noVNC Problem (Error 1006/111)

I'm running a OpenStack Kilo on VMware VMs, everything goes well except online console. (I was following the Getting Started guide on OpenStack website)

The console shows Starting VNC handshake and then Failed to connect to server (code: 1006)

If any further information is needed, please comment! (included, nova.conf for both compute and controller, network information, and novncproxy log)

My network configuration:

* Controller (controller)
  > 2 NIC
    - Management
      * 172.16.135.131
    - External
      * 172.16.155.150
* Compute (compute1)
  > 2 NIC
    - Management
      * 172.16.135.133
    - Tunnel
      - 192.168.38.20
* Compute (compute2)
  > 2 NIC
    - Management
      * 172.16.135.137
    - Tunnel
      * 192.168.38.21

DNS Settings
openstack.local maps to 172.16.155.150
controller.openstack.local maps to 172.16.135.131

Here's my configuration file on the controller node:

> cat /etc/nova/nova.conf

[DEFAULT]
dhcpbridge_flagfile=/etc/nova/nova.conf
dhcpbridge=/usr/bin/nova-dhcpbridge
logdir=/var/log/nova
state_path=/var/lib/nova
lock_path=/var/lock/nova
force_dhcp_release=True
libvirt_use_virtio_for_bridges=True
verbose=True
ec2_private_dns_show_ip=True
api_paste_config=/etc/nova/api-paste.ini
enabled_apis=ec2,osapi_compute,metadata
rpc_backend = rabbit
auth_strategy = keystone
my_ip = 172.16.135.131
vncserver_listen = 172.16.135.131
vncserver_proxyclient_address = 172.16.135.131
network_api_class = nova.network.neutronv2.api.API
security_group_api = neutron
linuxnet_interface_driver = nova.network.linux_net.LinuxOVSInterfaceDriver
firewall_driver = nova.virt.firewall.NoopFirewallDriver

[database]
connection = mysql://nova:PASSWORD@controller.openstack.local/nova

[oslo_messaging_rabbit]
rabbit_host = controller.openstack.local
rabbit_userid = openstack
rabbit_password = PASSWORD

[oslo_concurrency]
lock_path = /var/lock/nova

[keystone_authtoken]
auth_uri = http://controller.openstack.local:5000
auth_url = http://controller.openstack.local:35357
auth_plugin = password
project_domain_id = default
user_domain_id = default
project_name = service
username = nova
password = PASSWORD

[glance]
host = controller.openstack.local

[neutron]
service_metadata_proxy = True
metadata_proxy_shared_secret = PASSWORD
url = http://controller.openstack.local:9696
auth_strategy = keystone
admin_auth_url = http://controller.openstack.local:35357/v2.0
admin_tenant_name = service
admin_username = neutron
admin_password = PASSWORD

And this is the configuration file on each of the compute node:

> cat /etc/nova/nova.conf

[DEFAULT]
dhcpbridge_flagfile=/etc/nova/nova.conf
dhcpbridge=/usr/bin/nova-dhcpbridge
logdir=/var/log/nova
state_path=/var/lib/nova
lock_path=/var/lock/nova
force_dhcp_release=True
libvirt_use_virtio_for_bridges=True
verbose=True
ec2_private_dns_show_ip=True
api_paste_config=/etc/nova/api-paste.ini
enabled_apis=ec2,osapi_compute,metadata

rpc_backend = rabbit

auth_strategy = keystone

my_ip = 172.16.135.137

vnc_enabled = True
vncserver_listen = 0.0.0.0
vncserver_proxyclient_address = 172.16.135.131
novncproxy_base_url = http://openstack.local:6080/vnc_auto.html

# verbose = True

network_api_class = nova.network.neutronv2.api.API
security_group_api = neutron
linuxnet_interface_driver = nova.network.linux_net.LinuxOVSInterfaceDriver
firewall_driver = nova.virt.firewall.NoopFirewallDriver

[oslo_messaging_rabbit]
rabbit_host = controller.openstack.local
rabbit_userid = openstack
rabbit_password = PASSWORD

[keystone_authtoken]
auth_uri = http://controller.openstack.local:5000
auth_url = http://controller.openstack.local:35357
auth_plugin = password
project_domain_id = default
user_domain_id = default
project_name = service
username = nova
password = PASSWORD

[glance]
host = controller.openstack.local

[oslo_concurrency]
lock_path = /var/lock/nova

[neutron]
url = http://controller.openstack.local:9696
auth_strategy = keystone
admin_auth_url = http://controller.openstack.local:35357/v2.0
admin_tenant_name = service
admin_username = neutron
admin_password = PASSWORD

Logs on controller

ConsoleAuth

> tail nova-consoleauth.log

2015-05-13 01:56:23.577 2000 INFO oslo_messaging._drivers.impl_rabbit [req-5e0aabb6-6582-47c0-9e06-5c19489412b5 84ef4aea3bea495bb37588a22d3f3684 e20b13df269146daaa14395b570f04f8 - - -] Connecting to AMQP server on controller.openstack.local:5672
2015-05-13 01:56:23.608 2000 INFO oslo_messaging._drivers.impl_rabbit [req-5e0aabb6-6582-47c0-9e06-5c19489412b5 84ef4aea3bea495bb37588a22d3f3684 e20b13df269146daaa14395b570f04f8 - - -] Connected to AMQP server on controller.openstack.local:5672
2015-05-13 01:56:24.979 2000 INFO nova.consoleauth.manager [req-fecfeada-e99a-4214-a95a-7b33aef7f6f9 - - - - -] Checking Token: db64ef55-922a-40f7-b4b8-05bfd199ec33, True
2015-05-13 01:56:25.016 2000 INFO oslo_messaging._drivers.impl_rabbit [req-fecfeada-e99a-4214-a95a-7b33aef7f6f9 - - - - -] Connecting to AMQP server on controller.openstack.local:5672
2015-05-13 01:56:25.028 2000 INFO oslo_messaging._drivers.impl_rabbit [req-fecfeada-e99a-4214-a95a-7b33aef7f6f9 - - - - -] Connected to AMQP server on controller.openstack.local:5672
2015-05-13 02:14:31.120 2000 INFO nova.consoleauth.manager [req-29159feb-8f15-4fa9-ba46-7f523c463447 - - - - -] Checking Token: db64ef55-922a-40f7-b4b8-05bfd199ec33, False
2015-05-13 02:15:18.047 2000 INFO nova.consoleauth.manager [req-82d6a0bc-f381-4d33-b3e4-3eeda07a8fcf - - - - -] Checking Token: db64ef55-922a-40f7-b4b8-05bfd199ec33, False
2015-05-13 02:18:44.153 2000 INFO nova.consoleauth.manager [req-3d9ff0ea-2016-4e6e-b57b-2dfdc479133e 84ef4aea3bea495bb37588a22d3f3684 e20b13df269146daaa14395b570f04f8 - - -] Received Token: 33ea7638-6a42-44ac-bb8c-2fd5bd040193, {'instance_uuid': u'00980a2a-daa4-460a-95f5-35c412ff72b5', 'access_url': u'http://openstack.local:6080/vnc_auto.html?token=33ea7638-6a42-44ac-bb8c-2fd5bd040193', 'token': u'33ea7638-6a42-44ac-bb8c-2fd5bd040193', 'last_activity_at': 1431454724.152924, 'internal_access_path': None, 'console_type': u'novnc', 'host': u'172.16.135.131', 'port': u'5900'}
2015-05-13 02:18:44.437 2000 INFO nova.consoleauth.manager [req-270788ee-c7a0-476f-92dc-96f17675bfdb - - - - -] Checking Token: 33ea7638-6a42-44ac-bb8c-2fd5bd040193, True
2015-05-13 02:18:46.415 2000 INFO nova.consoleauth.manager [req-e550fd92-7e61-4689-a9a1-a73dc6e2d311 - - - - -] Checking Token: 33ea7638-6a42-44ac-bb8c-2fd5bd040193, True

NoVNCProxy

> tail nova-novncproxy.log

2015-05-13 02:18:44.571 2647 INFO nova.console.websocketproxy [req-270788ee-c7a0-476f-92dc-96f17675bfdb - - - - -]  14: connect info: {u'instance_uuid': u'00980a2a-daa4-460a-95f5-35c412ff72b5', u'internal_access_path': None, u'last_activity_at': 1431454724.152924, u'console_type': u'novnc', u'host': u'172.16.135.131', u'token': u'33ea7638-6a42-44ac-bb8c-2fd5bd040193', u'access_url': u'http://openstack.local:6080/vnc_auto.html?token=33ea7638-6a42-44ac-bb8c-2fd5bd040193', u'port': u'5900'}
2015-05-13 02:18:44.572 2647 INFO nova.console.websocketproxy [req-270788ee-c7a0-476f-92dc-96f17675bfdb - - - - -]  14: connecting to: 172.16.135.131:5900
2015-05-13 02:18:44.718 2647 INFO nova.console.websocketproxy [req-270788ee-c7a0-476f-92dc-96f17675bfdb - - - - -] handler exception: [Errno 111] ECONNREFUSED
2015-05-13 02:18:46.390 2648 INFO oslo_messaging._drivers.impl_rabbit [req-e550fd92-7e61-4689-a9a1-a73dc6e2d311 - - - - -] Connecting to AMQP server on controller.openstack.local:5672
2015-05-13 02:18:46.398 2648 INFO oslo_messaging._drivers.impl_rabbit [req-e550fd92-7e61-4689-a9a1-a73dc6e2d311 - - - - -] Connected to AMQP server on controller.openstack.local:5672
2015-05-13 02:18:46.404 2648 INFO oslo_messaging._drivers.impl_rabbit [req-e550fd92-7e61-4689-a9a1-a73dc6e2d311 - - - - -] Connecting to AMQP server on controller.openstack.local:5672
2015-05-13 02:18:46.412 2648 INFO oslo_messaging._drivers.impl_rabbit [req-e550fd92-7e61-4689-a9a1-a73dc6e2d311 - - - - -] Connected to AMQP server on controller.openstack.local:5672
2015-05-13 02:18:46.447 2648 INFO nova.console.websocketproxy [req-e550fd92-7e61-4689-a9a1-a73dc6e2d311 - - - - -]  15: connect info: {u'instance_uuid': u'00980a2a-daa4-460a-95f5-35c412ff72b5', u'internal_access_path': None, u'last_activity_at': 1431454724.152924, u'console_type': u'novnc', u'host': u'172.16.135.131', u'token': u'33ea7638-6a42-44ac-bb8c-2fd5bd040193', u'access_url': u'http://openstack.local:6080/vnc_auto.html?token=33ea7638-6a42-44ac-bb8c-2fd5bd040193', u'port': u'5900'}
2015-05-13 02:18:46.447 2648 INFO nova.console.websocketproxy [req-e550fd92-7e61-4689-a9a1-a73dc6e2d311 - - - - -]  15: connecting to: 172.16.135.131:5900
2015-05-13 02:18:46.449 2648 INFO nova.console.websocketproxy [req-e550fd92-7e61-4689-a9a1-a73dc6e2d311 - - - - -] handler exception: [Errno 111] ECONNREFUSED