Ask Your Question
0

Compute status Down

asked 2017-01-31 05:26:28 -0500

AlexNastas gravatar image

I have a controller host + 2 computes (Liberty) For some reason, the controller sees one openstack compute node as down: 

[root@os-controller log(keystone_admin)]# nova hypervisor-list
+----+------------------------+-------+---------+
| ID | Hypervisor hostname    | State | Status  |
+----+------------------------+-------+---------+
| 3  | os-compute01.novalocal | down  | enabled |
| 4  | os-compute02.novalocal | up    | enabled |
+----+------------------------+-------+---------+

However, the compute node is up and running. I'm able to connect in SSH and start instances using virsh start ... openstack-nova-compute sevice is up and running

I have tried rebooting the compute server - nothing changes - the controller still sees it as down:

These are the last messages from the last reboot in nova-compute.log:

2017-01-31 02:39:15.821 18444 INFO oslo_service.service [req-c7a37ae6-28b2-4452-b66c-62991bc2719b - - - - -] Caught SIGTERM, exiting
2017-01-31 02:39:33.881 2759 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
2017-01-31 02:39:33.987 2759 INFO nova.virt.driver [-] Loading compute driver 'libvirt.LibvirtDriver'
2017-01-31 02:39:34.186 2759 WARNING oslo_config.cfg [req-81704963-7f8f-4073-8d05-a0ac614e83ea - - - - -] Option "amqp_durable_queues" from group "DEFAULT" is deprecated. Use option "amqp_durable_queues" from group "oslo_messaging_rabbit".
2017-01-31 02:39:34.191 2759 INFO oslo.messaging._drivers.impl_rabbit [req-81704963-7f8f-4073-8d05-a0ac614e83ea - - - - -] Connecting to AMQP server on 10.0.0.10:5672
2017-01-31 02:39:34.207 2759 INFO oslo.messaging._drivers.impl_rabbit [req-81704963-7f8f-4073-8d05-a0ac614e83ea - - - - -] Connected to AMQP server on 10.0.0.10:5672
2017-01-31 02:39:34.213 2759 INFO oslo.messaging._drivers.impl_rabbit [req-81704963-7f8f-4073-8d05-a0ac614e83ea - - - - -] Connecting to AMQP server on 10.0.0.10:5672
2017-01-31 02:39:34.227 2759 INFO oslo.messaging._drivers.impl_rabbit [req-81704963-7f8f-4073-8d05-a0ac614e83ea - - - - -] Connected to AMQP server on 10.0.0.10:5672
2017-01-31 02:39:34.246 2759 WARNING oslo_config.cfg [req-81704963-7f8f-4073-8d05-a0ac614e83ea - - - - -] Option "admin_auth_url" from group "neutron" is deprecated for removal.  Its value may be silently ignored in the future.
2017-01-31 02:39:34.247 2759 WARNING oslo_config.cfg [req-81704963-7f8f-4073-8d05-a0ac614e83ea - - - - -] Option "admin_password" from group "neutron" is deprecated for removal.  Its value may be silently ignored in the future.
2017-01-31 02:39:34.247 2759 WARNING oslo_config.cfg [req-81704963-7f8f-4073-8d05-a0ac614e83ea - - - - -] Option "admin_tenant_name" from group "neutron" is deprecated for removal.  Its value may be silently ignored in the future.
2017-01-31 02:39:34.248 2759 WARNING oslo_config.cfg [req-81704963-7f8f-4073-8d05-a0ac614e83ea - - - - -] Option "admin_username" from group "neutron" is deprecated for removal.  Its value may be silently ignored in the future.
2017-01-31 02:39:34.248 2759 WARNING oslo_config.cfg [req-81704963-7f8f-4073-8d05-a0ac614e83ea - - - - -] Option "auth_strategy" from group "neutron" is deprecated for removal.  Its value may be silently ignored in the future.
2017-01-31 02:39:34.250 2759 WARNING oslo_config.cfg [req-81704963-7f8f-4073-8d05-a0ac614e83ea - - - - -] Option "vnc_enabled" from group "DEFAULT" is deprecated. Use option "enabled" from group "vnc".
2017-01-31 02:39:34.250 2759 WARNING oslo_config.cfg [req-81704963-7f8f-4073-8d05-a0ac614e83ea - - - - -] Option "vnc_keymap" from group "DEFAULT" is deprecated. Use option "keymap" from group "vnc".
2017-01-31 02:39:34.251 2759 WARNING oslo_config.cfg [req-81704963-7f8f-4073-8d05-a0ac614e83ea - - - - -] Option "novncproxy_base_url" from group "DEFAULT" is deprecated. Use option "novncproxy_base_url" from group "vnc".
2017-01-31 02:39:34.251 2759 WARNING oslo_config.cfg [req-81704963-7f8f-4073-8d05-a0ac614e83ea - - - - -] Option "vncserver_listen" from group "DEFAULT" is deprecated. Use option "vncserver_listen" from group "vnc".
2017-01-31 02:39:34.251 2759 WARNING oslo_config.cfg [req-81704963-7f8f-4073-8d05-a0ac614e83ea - - - - -] Option "vncserver_proxyclient_address" from group "DEFAULT ...
(more)
edit retag flag offensive close merge delete

Comments

@AlexNastas: Can you send the nova-api.log from the controller?

gianpietro gravatar imagegianpietro ( 2017-01-31 08:46:33 -0500 )edit
add a comment

1 answer

Sort by ยป oldest newest most voted
0

answered 2017-01-31 10:04:29 -0500

AlexNastas gravatar image

updated 2017-01-31 10:19:51 -0500

@gianpietro: Ok ! I actually can't upload files because apparently I need at least 10 points for this. And the file is to big to paste it here. So here's a grep :

[root@os-controller nova]# cat nova-api.log | grep compute01   
    2017-01-31 00:49:51.756 26871 INFO nova.osapi_compute.wsgi.server [req-72c68a60-b628-4eb2-a275-90dbdc5a685a c7a58f8fb9434b8bb2ff44fa6a46c44e 9c1e2623a1ec432195644234c4aa4bd2 - - -] 10.0.0.11 "GET /v2/9c1e2623a1ec432195644234c4aa4bd2/servers/detail?all_tenants=True&host=os-compute01.novalocal HTTP/1.1" status: 200 len: 10000 time: 0.2507911
    2017-01-31 00:52:37.243 26871 INFO nova.osapi_compute.wsgi.server [req-eeddd0c8-3d09-4f38-88a3-40ee532154d7 c7a58f8fb9434b8bb2ff44fa6a46c44e 9c1e2623a1ec432195644234c4aa4bd2 - - -] 10.0.0.11 "GET /v2/9c1e2623a1ec432195644234c4aa4bd2/servers/detail?all_tenants=True&host=os-compute01.novalocal HTTP/1.1" status: 200 len: 10000 time: 0.2651899
    2017-01-31 01:02:36.964 26871 INFO nova.osapi_compute.wsgi.server [req-d34c5b98-825f-4656-871c-ee908638feac c7a58f8fb9434b8bb2ff44fa6a46c44e 9c1e2623a1ec432195644234c4aa4bd2 - - -] 10.0.0.11 "GET /v2/9c1e2623a1ec432195644234c4aa4bd2/servers/detail?all_tenants=True&changes-since=2017-01-31T08%3A52%3A37.953877%2B00%3A00&host=os-compute01.novalocal HTTP/1.1" status: 200 len: 211 time: 0.1165690
    2017-01-31 01:12:36.963 26871 INFO nova.osapi_compute.wsgi.server [req-fc2f9869-0a99-4bdf-8804-b7058e6042e0 c7a58f8fb9434b8bb2ff44fa6a46c44e 9c1e2623a1ec432195644234c4aa4bd2 - - -] 10.0.0.11 "GET /v2/9c1e2623a1ec432195644234c4aa4bd2/servers/detail?all_tenants=True&changes-since=2017-01-31T09%3A02%3A36.967028%2B00%3A00&host=os-compute01.novalocal HTTP/1.1" status: 200 len: 211 time: 0.1147239
    2017-01-31 01:13:08.877 26871 INFO nova.osapi_compute.wsgi.server [req-1eacc479-c72d-4f67-87b2-dc8bb2ad342a c7a58f8fb9434b8bb2ff44fa6a46c44e 9c1e2623a1ec432195644234c4aa4bd2 - - -] 10.0.0.11 "GET /v2/9c1e2623a1ec432195644234c4aa4bd2/servers/detail?all_tenants=True&host=os-compute01.novalocal HTTP/1.1" status: 200 len: 10000 time: 0.2583692
    2017-01-31 01:23:08.132 3436 INFO nova.osapi_compute.wsgi.server [req-979fc086-e632-4fa6-8dbe-fab10267918a c7a58f8fb9434b8bb2ff44fa6a46c44e 9c1e2623a1ec432195644234c4aa4bd2 - - -] 10.0.0.11 "GET /v2/9c1e2623a1ec432195644234c4aa4bd2/servers/detail?all_tenants=True&changes-since=2017-01-31T09%3A13%3A08.993878%2B00%3A00&host=os-compute01.novalocal HTTP/1.1" status: 200 len: 211 time: 0.1289501
    2017-01-31 01:33:08.148 3441 INFO nova.osapi_compute.wsgi.server [req-d0ede4ad-217c-4462-8b73-cf9dd497d321 c7a58f8fb9434b8bb2ff44fa6a46c44e 9c1e2623a1ec432195644234c4aa4bd2 - - -] 10.0.0.11 "GET /v2/9c1e2623a1ec432195644234c4aa4bd2/servers/detail?all_tenants=True&changes-since=2017-01-31T09%3A23%3A08.134055%2B00%3A00&host=os-compute01.novalocal HTTP/1.1" status: 200 len: 211 time: 0.1444678
    2017-01-31 01:43:08.112 3436 INFO nova.osapi_compute.wsgi.server [req-5037b741-dc30-4705-be4f-736669441d12 c7a58f8fb9434b8bb2ff44fa6a46c44e 9c1e2623a1ec432195644234c4aa4bd2 - - -] 10.0.0.11 "GET /v2/9c1e2623a1ec432195644234c4aa4bd2/servers/detail?all_tenants=True&changes-since=2017-01-31T09%3A33%3A08.150257%2B00%3A00&host=os-compute01.novalocal HTTP/1.1" status: 200 len: 211 time: 0.1085072
    2017-01-31 01:53:08.119 3436 INFO nova.osapi_compute.wsgi.server [req-4ea874af-3bb9-498f-94b6-99bcc82f9555 c7a58f8fb9434b8bb2ff44fa6a46c44e 9c1e2623a1ec432195644234c4aa4bd2 - - -] 10.0.0.11 "GET /v2/9c1e2623a1ec432195644234c4aa4bd2/servers/detail?all_tenants=True&changes-since=2017-01-31T09%3A43%3A08.113587%2B00%3A00&host=os-compute01.novalocal HTTP/1.1" status: 200 len: 211 time: 0.1147540
    2017-01-31 02:03:08.125 3442 INFO nova.osapi_compute.wsgi.server [req-3cd4448f-9288-477a-9257-308f39f4e60a c7a58f8fb9434b8bb2ff44fa6a46c44e 9c1e2623a1ec432195644234c4aa4bd2 - - -] 10.0.0.11 "GET /v2/9c1e2623a1ec432195644234c4aa4bd2/servers/detail?all_tenants=True&changes-since=2017-01-31T09%3A53%3A08.120896%2B00%3A00&host=os-compute01.novalocal HTTP/1.1" status: 200 len: 211 time: 0.1198561
    2017-01-31 02:13:08.033 3440 INFO nova.osapi_compute.wsgi.server [-] 10.0.0.11 "GET /v2/9c1e2623a1ec432195644234c4aa4bd2/servers/detail?all_tenants=True&changes-since=2017-01-31T10%3A03%3A08.126736%2B00%3A00&host ...
(more)
edit flag offensive delete link more
add a comment

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

subscribe to rss feed

Stats

Asked: 2017-01-31 05:18:36 -0500

Seen: 302 times

Last updated: Jan 31 '17

Related questions

OpenStack Liberty with CEPH , Create Instance failed

tenant bind with certain hypervisor

live-migration unable to execute QEMU command 'migrate'

How to change cpu_allocation_ratio

Documentation for Server status ?

Does disk space required in compute node when launch instance from block storage?

liberty novnc console does not work

nova service-list Error : Unknown Error (HTTP 503)Service Unavailable: The server is currently unavailable. Please try again at a later time, while nova-manage service list command shows all the services running fine. [closed]

Instance stuck in build status

Abnormal resource consumption in RDO environment.